CN106919247B - Virtual image display method and device - Google Patents

Abstract

The invention discloses a virtual image display method and a virtual image display device, and relates to the technical field of virtual-real interaction.

Description

Virtual image display method and device

technical field

The present invention relates to the technical field of virtual-real interaction, and in particular, to a virtual image display method and device.

Background technique

Virtual image is a concept that emerged with the rapid development of computer technology and the continuous improvement of chroma key technology in recent years. Generally, when a user stands in front of a display interface, a virtual image corresponding to the user is displayed on the display interface.

However, in the prior art, when virtual images are displayed, only virtual images of the same size are displayed, and the distance between the user and the display interface will not change, resulting in a single size of the virtual image displayed and poor user experience. .

SUMMARY OF THE INVENTION

In view of the above problems, the present invention is proposed to provide a virtual image display method and device that overcome the above problems or at least partially solve the above problems.

According to one aspect of the present invention, there is provided a virtual image display method, comprising:

When a user located in the preset area is detected, the height of the user is determined, and a mapping relationship is searched according to the height of the user to obtain a virtual image corresponding to the height of the user, where the mapping relationship includes: height and Correspondence between virtual images;

obtaining the first distance between the user and the display interface;

adjusting the size of the virtual image according to the first distance;

The adjusted virtual image is displayed at a preset position on the display interface.

Optionally, after displaying the adjusted virtual image at a preset position on the display interface, the method further includes:

After a predetermined time interval, the step of obtaining the first distance between the user and the display interface is performed again;

The size of the virtual image displayed at the preset position on the display interface is adjusted according to the re-acquired first distance.

Optionally, before determining the height of the user when the user located in the preset area is detected, the method further includes:

making the infrared emitter located at the bottom of the display interface emit infrared rays in a direction that is at a preset angle with the preset area,

Correspondingly, when a user located in a preset area is detected, determining the height of the user specifically includes:

When the infrared receiver disposed opposite to the infrared transmitter cannot receive the infrared, determine that the user located in the preset area is detected;

obtaining a second distance between the user and the display interface;

The height of the user is determined according to the preset angle and the second distance.

Optionally, before displaying the adjusted virtual image at a preset position on the display interface, the method further includes:

The preset position is determined according to the size of the adjusted virtual image and the first distance between the user and the display interface.

Optionally, the acquiring the first distance between the user and the display interface specifically includes:

The first distance between the user and the display interface collected by the ranging sensor is acquired.

Optionally, in the mapping relationship, one height corresponds to multiple virtual images of different postures;

Correspondingly, before the searching for the mapping relationship according to the height of the user, the method further includes:

obtain the current posture of the user;

Correspondingly, the searching for a mapping relationship according to the height of the user to obtain a virtual image corresponding to the height of the user specifically includes:

A mapping relationship is searched according to the user's height and current posture, so as to obtain a virtual image corresponding to the user's height and current posture.

Optionally, the acquiring the current posture of the user specifically includes:

obtain an image of the user;

performing foreground segmentation on the image to obtain the outline of the human body in the image;

The human body contour is matched with the preset contour, and the posture corresponding to the matched preset contour is used as the current posture of the user.

According to another aspect of the present invention, a virtual image display device is provided, comprising:

The image obtaining unit is adapted to determine the height of the user when a user located in the preset area is detected, and search for a mapping relationship according to the height of the user, so as to obtain a virtual image corresponding to the height of the user, the mapping The relationship includes: the corresponding relationship between the height and the virtual image;

a distance obtaining unit, adapted to obtain the first distance between the user and the display interface;

an image adjustment unit, adapted to adjust the size of the virtual image according to the first distance;

The image display unit is adapted to display the adjusted virtual image at a preset position on the display interface.

Optionally, the device further includes:

an interval acquisition unit, adapted to call the distance acquisition unit after a predetermined time interval;

The re-adjustment unit is adapted to adjust the size of the virtual image displayed at the preset position on the display interface according to the re-acquired first distance.

Optionally, the device further includes:

an infrared control unit, adapted to make the infrared emitter disposed at the bottom of the display interface emit infrared rays in a direction at a preset angle with the preset area,

Correspondingly, the image obtaining unit is specifically adapted to determine that the user located in the preset area is detected when the infrared receiver disposed opposite to the infrared transmitter cannot receive the infrared light; obtain the user a second distance from the display interface; determining the height of the user according to the preset angle and the second distance.

Optionally, the device further includes:

The position determination unit is adapted to determine the preset position according to the size of the adjusted virtual image and the first distance between the user and the display interface.

Optionally, the acquiring the first distance between the user and the display interface specifically includes:

The first distance between the user and the display interface collected by the ranging sensor is acquired.

Optionally, in the mapping relationship, one height corresponds to multiple virtual images of different postures;

Correspondingly, the device also includes:

a gesture acquisition unit, adapted to acquire the current gesture of the user;

Correspondingly, the image obtaining unit is specifically adapted to search for a mapping relationship according to the user's height and current posture, so as to obtain a virtual image corresponding to the user's height and current posture.

Optionally, the posture obtaining unit is specifically adapted to obtain an image of the user; perform foreground segmentation on the image to obtain the outline of the human body in the image; match the outline of the human body with a preset outline, The gesture corresponding to the matched preset contour is taken as the current gesture of the user.

When a user located in a preset area is detected, the present invention obtains a virtual image corresponding to the height of the user, obtains a first distance between the user and the display interface, and adjusts the The size of the virtual image is adjusted, and the adjusted virtual image is displayed at the preset position on the display interface, which can realize the change according to the distance between the user and the display interface, and avoids the display of the virtual image having a single size. Improved user experience.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for the purpose of illustrating preferred embodiments only and are not to be considered limiting of the invention. Also, the same components are denoted by the same reference numerals throughout the drawings. In the attached image:

FIG. 1 is a flowchart of a virtual image display method according to an embodiment of the present invention;

FIG. 2 is a flowchart of a virtual image display method according to an embodiment of the present invention;

FIG. 3 is a flowchart of a virtual image display method according to an embodiment of the present invention;

4 is a schematic diagram of height determination according to an embodiment of the present invention;

FIG. 5 is a flowchart of a virtual image display method according to an embodiment of the present invention;

FIG. 6 is a flowchart of a virtual image display method according to an embodiment of the present invention;

FIG. 7 is a structural block diagram of a virtual image display device according to an embodiment of the present invention.

Detailed ways

The specific embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments. The following examples are intended to illustrate the present invention, but not to limit the scope of the present invention.

FIG. 1 is a flowchart of a virtual image display method according to an embodiment of the present invention; referring to FIG. 1 , the method includes:

S101: When a user located in a preset area is detected, determine the height of the user, and search for a mapping relationship according to the height of the user to obtain a virtual image corresponding to the height of the user, where the mapping relationship includes: Correspondence between height and virtual image;

It should be noted that, the execution subject of this embodiment is a device for realizing virtual image display, and of course, it may also be a device with other similar functions, which is not limited in this embodiment.

It is understandable that the preset area is usually an area opposite to the display interface of the device, and of course, it may also be other areas, which are not limited in this embodiment.

In the specific implementation, since there may be differences in the heights of different users, it is assumed that a virtual image of the same height is directly used for each user, which will make the virtual image less realistic and affect the user experience. Therefore, in this embodiment, it is necessary to A virtual image corresponding to the height of the user is obtained.

In order to facilitate searching for the virtual image corresponding to the height of the user, a mapping relationship may be established in advance, and the mapping relationship includes: the corresponding relationship between the height and the virtual image.

Of course, considering the difference in the user's attribute information (ie, age, gender, etc.), the mapping relationship can be related to the user's attribute information, that is, a virtual image is generated according to the user's attribute information, and then the height and the generated The corresponding relationship between the virtual images.

S102: Obtain the first distance between the user and the display interface;

It is understandable that the acquisition of the first distance between the user and the display interface can be implemented in various ways, for example, by means of acquiring a distance measuring sensor such as a laser distance measuring sensor or an ultrasonic distance measuring sensor. It can be implemented in other manners, which are not limited in this embodiment.

S103: Adjust the size of the virtual image according to the first distance;

It should be noted that, since the distance between the user and the mirror will affect the size of the image in the mirror, in order to make the display interface have a mirror-like effect, thereby improving the user experience, in this embodiment, according to the first A distance adjusts the size of the virtual image.

S104: Display the adjusted virtual image at a preset position on the display interface.

When a user located in a preset area is detected in this implementation manner, a virtual image corresponding to the height of the user is obtained, a first distance between the user and the display interface is obtained, and a The size of the virtual image is adjusted, and the adjusted virtual image is displayed at the preset position on the display interface, which can realize the change according to the distance between the user and the display interface, and avoids the display of the virtual image having a single size. , which improves the user experience.

FIG. 2 is a flowchart of a virtual image display method according to an embodiment of the present invention; with reference to FIG. 2 , the method includes:

S201: When a user located in a preset area is detected, determine the height of the user, and search for a mapping relationship according to the height of the user to obtain a virtual image corresponding to the height of the user, where the mapping relationship includes: Correspondence between height and virtual image;

S202: Obtain the first distance between the user and the display interface;

S203: Adjust the size of the virtual image according to the first distance;

S204: Display the adjusted virtual image at a preset position on the display interface;

Steps S201 to S204 are the same as steps S101 to S104 of the embodiment shown in FIG. 1 , and will not be repeated here.

S205: After a predetermined time interval, execute the step of acquiring the first distance between the user and the display interface again;

It is understandable that since the user may move, for example, from the preset area to the direction of the display interface, that is to say, the first distance between the user and the display interface may change.

Therefore, in this embodiment, the first distance between the user and the display interface is acquired at predetermined time intervals.

In a specific implementation, if the predetermined time interval is too large, the virtual image will lag too much, causing the display of the virtual image to freeze, and if the predetermined time interval is too small, the processing load of the device will also increase. Therefore, in this embodiment, the value range of the predetermined time interval may be 30ms˜40ms, and of course, other values may also be set, which are not limited in this embodiment.

S206: Adjust the size of the virtual image displayed at the preset position on the display interface according to the re-acquired first distance.

It should be noted that, when the first distance between the user and the display interface changes, correspondingly, it is necessary to adjust the size of the virtual image displayed at the preset position on the display interface according to the re-acquired first distance. size.

FIG. 3 is a flowchart of a virtual image display method according to an embodiment of the present invention; with reference to FIG. 3 , the method includes:

S300: Make the infrared emitter disposed at the bottom of the display interface emit infrared rays in a direction that forms a preset angle with the preset area;

Referring to FIG. 4 , the infrared emitter B at the bottom of the display interface A emits infrared light C in a direction forming a preset angle a with the preset area.

S301: When an infrared receiver disposed opposite to the infrared transmitter cannot receive the infrared rays, determine that the user located in a preset area is detected, and obtain a second distance between the user and the display interface, determining the height of the user according to the preset angle and the second distance;

Referring to FIG. 4 , when the infrared receiver D disposed opposite to the infrared transmitter B cannot receive the infrared light C, it is determined that the user E located in the preset area is monitored, and the relationship between the user and the display interface is obtained. Since the preset angle and the second distance are both known values, the height of the user can be simply calculated and determined according to the length of the sides of the triangle.

S302: Find a mapping relationship according to the height of the user to obtain a virtual image corresponding to the height of the user, where the mapping relationship includes: a corresponding relationship between the height and the virtual image;

S303: Obtain the first distance between the user and the display interface;

S304: Adjust the size of the virtual image according to the first distance;

S305: Display the adjusted virtual image at a preset position on the display interface;

Steps S303 to S305 are the same as steps S102 to S104 of the embodiment shown in FIG. 1 , and are not repeated here.

FIG. 5 is a flowchart of a virtual image display method according to an embodiment of the present invention; with reference to FIG. 5 , the present invention includes:

S501: When a user located in a preset area is detected, determine the height of the user, and search for a mapping relationship according to the height of the user to obtain a virtual image corresponding to the height of the user, where the mapping relationship includes: Correspondence between height and virtual image;

S502: Obtain the first distance between the user and the display interface;

S503: Adjust the size of the virtual image according to the first distance;

Steps S501 to S503 are the same as steps S101 to S103 of the embodiment shown in FIG. 1 , and are not repeated here.

S504: Determine the preset position according to the size of the adjusted virtual image and the first distance between the user and the display interface;

It can be understood that, because the sizes of different virtual images occupy different sizes of the areas in the display interface, and for different first distances, the distances between the bottom pixels of the virtual images and the bottom of the display interface are also different. Therefore, in this embodiment, the preset position can be determined according to the size of the adjusted virtual image and the first distance between the user and the display interface.

S505: Display the adjusted virtual image at a preset position on the display interface.

Step S505 is the same as step S104 in the embodiment shown in FIG. 1 , and details are not repeated here.

FIG. 6 is a flowchart of a virtual image display method according to an embodiment of the present invention; with reference to FIG. 6 , the method includes:

S601: When a user located in a preset area is detected, determine the height of the user, obtain the current posture of the user, and search for a mapping relationship according to the height of the user and the current posture, so as to obtain the height and the current posture of the user. The virtual image corresponding to the current posture, the mapping relationship includes: the corresponding relationship between the height and the virtual image, and one height corresponds to a plurality of virtual images of different postures;

It is understandable that, since the posture of the user may change, it is assumed that when the virtual image is displayed, the size of the virtual image is only adjusted according to the first distance. At this time, only the size of the virtual image in the virtual image changes. , but it cannot correspond to the user's posture, which affects the user experience. To avoid this problem, in this embodiment, the current posture of the user can be obtained, and the mapping relationship can be searched according to the height and the current posture of the user, so as to obtain the corresponding The virtual image corresponding to the user's height and the current posture can make the obtained virtual image correspond to the user's posture, thereby improving user experience.

In specific implementation, the current posture of the user can be acquired in various ways, but in order to improve the accuracy of posture acquisition, in this embodiment, when acquiring the current posture of the user, the image of the user is acquired, and the The image is subjected to foreground segmentation to obtain the outline of the human body in the image, the outline of the human body is matched with the preset outline, and the posture corresponding to the matched preset outline is taken as the current posture of the user.

Of course, the current posture of the user may also be acquired in other manners, which are not limited in this embodiment.

S602: Obtain the first distance between the user and the display interface;

S603: Adjust the size of the virtual image according to the first distance;

S604: Display the adjusted virtual image at a preset position on the display interface.

Steps S602 to S604 are the same as steps S102 to S104 of the embodiment shown in FIG. 1 , and are not repeated here.

For the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the embodiments of the present invention are not limited by the described sequence of actions, because according to the embodiments of the present invention , certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

FIG. 7 is a structural block diagram of a virtual image display device according to an embodiment of the present invention; with reference to FIG. 7 , the device includes:

The image obtaining unit 701 is adapted to determine the height of the user when a user located in a preset area is detected, and search for a mapping relationship according to the height of the user to obtain a virtual image corresponding to the height of the user, the The mapping relationship includes: the corresponding relationship between the height and the virtual image;

a distance obtaining unit 702, adapted to obtain a first distance between the user and the display interface;

an image adjustment unit 703, adapted to adjust the size of the virtual image according to the first distance;

The image display unit 704 is adapted to display the adjusted virtual image at a preset position on the display interface.

In an optional embodiment of the present invention, the device further includes:

an interval acquisition unit, adapted to call the distance acquisition unit after a predetermined time interval;

The re-adjustment unit is adapted to adjust the size of the virtual image displayed at the preset position on the display interface according to the re-acquired first distance.

In an optional embodiment of the present invention, the device further includes:

an infrared control unit, adapted to make the infrared emitter disposed at the bottom of the display interface emit infrared rays in a direction at a preset angle with the preset area,

Correspondingly, the image obtaining unit is specifically adapted to determine that the user located in the preset area is detected when the infrared receiver disposed opposite to the infrared transmitter cannot receive the infrared light; obtain the user a second distance from the display interface; determining the height of the user according to the preset angle and the second distance.

In an optional embodiment of the present invention, the device further includes:

The position determination unit is adapted to determine the preset position according to the size of the adjusted virtual image and the first distance between the user and the display interface.

In an optional embodiment of the present invention, the acquiring the first distance between the user and the display interface specifically includes:

The first distance between the user and the display interface collected by the ranging sensor is acquired.

In an optional embodiment of the present invention, in the mapping relationship, one height corresponds to multiple virtual images of different postures;

Correspondingly, the device also includes:

a gesture acquisition unit, adapted to acquire the current gesture of the user;

Correspondingly, the image obtaining unit is specifically adapted to search for a mapping relationship according to the user's height and current posture, so as to obtain a virtual image corresponding to the user's height and current posture.

In an optional embodiment of the present invention, the posture obtaining unit is specifically adapted to obtain an image of the user; perform foreground segmentation on the image to obtain the outline of a human body in the image; The contour is matched with the preset contour, and the posture corresponding to the matched preset contour is taken as the current posture of the user.

As for the apparatus embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for related parts.

It should be noted that, in each component of the device of the present invention, the components are logically divided according to the functions to be implemented, but the present invention is not limited to this, and each component can be re-divided as required Alternatively, for example, some components may be combined into a single component, or some components may be further decomposed into more sub-components.

Various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in the apparatus according to the embodiments of the present invention. The present invention can also be implemented as apparatus or apparatus programs (eg, computer programs and computer program products) for performing part or all of the methods described herein. Such a program implementing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.

It should be noted that the above-described embodiments illustrate rather than limit the invention, and that alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.

The above embodiments are only suitable for illustrating the present invention, rather than limiting the present invention. Those of ordinary skill in the relevant technical field can also make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, all Equivalent technical solutions also belong to the scope of the present invention, and the patent protection scope of the present invention should be defined by the claims.

Claims (12)

1. A virtual image display method comprises the following steps:

when a user in a preset area is detected, the height of the user is determined, and a mapping relation is searched according to the height of the user to obtain a virtual image corresponding to the height of the user, wherein the mapping relation comprises: the corresponding relation between the height and the virtual image;

acquiring a first distance between the user and a display interface;

adjusting the size of the virtual image according to the first distance;

displaying the adjusted virtual image at a preset position on the display interface;

wherein, before determining the height of the user when the user located in the preset area is detected, the method further comprises:

the infrared emitter arranged at the bottom of the display interface emits infrared rays in a direction forming a preset angle with the preset area,

correspondingly, when the user located in the preset area is detected, the determining the height of the user specifically includes:

when an infrared receiver arranged opposite to the infrared transmitter does not receive the infrared rays, determining that the user in a preset area is detected;

acquiring a second distance between the user and a display interface;

and determining the height of the user according to the preset angle and the second distance.

2. The method of claim 1, wherein after displaying the adjusted virtual image at the predetermined position on the display interface, the method further comprises:

after a preset time interval, executing the step of acquiring the first distance between the user and the display interface again;

and adjusting the size of the virtual image displayed at the preset position on the display interface according to the re-acquired first distance.

3. The method of claim 1, wherein before displaying the adjusted virtual image at the predetermined position on the display interface, the method further comprises:

and determining the preset position according to the adjusted size of the virtual image and the first distance between the user and the display interface.

4. The method of claim 1, wherein the obtaining of the first distance between the user and the display interface specifically comprises:

acquiring a first distance between the user and a display interface acquired by a ranging sensor.

5. The method of any one of claims 1 to 4, wherein in the mapping, a height corresponds to a plurality of virtual images of different postures;

correspondingly, before the mapping relation is found according to the height of the user, the method further includes:

acquiring the current posture of the user;

correspondingly, the searching for the mapping relationship according to the height of the user to obtain the virtual image corresponding to the height of the user specifically includes:

and searching a mapping relation according to the height and the current posture of the user to obtain a virtual image corresponding to the height and the current posture of the user.

6. The method of claim 5, wherein the obtaining the current posture of the user specifically comprises:

acquiring an image of the user;

performing foreground segmentation on the image to obtain a human body contour in the image;

and matching the human body contour with a preset contour, and taking the posture corresponding to the matched preset contour as the current posture of the user.

7. A virtual image display device comprises:

the image obtaining unit is suitable for determining the height of a user when the user in a preset area is detected, and searching a mapping relation according to the height of the user to obtain a virtual image corresponding to the height of the user, wherein the mapping relation comprises: the corresponding relation between the height and the virtual image;

the distance acquisition unit is suitable for acquiring a first distance between the user and a display interface;

the image adjusting unit is suitable for adjusting the size of the virtual image according to the first distance;

the image display unit is suitable for displaying the adjusted virtual image at a preset position on the display interface;

wherein the apparatus further comprises:

an infrared control unit, which is suitable for enabling an infrared emitter arranged at the bottom of the display interface to emit infrared rays in a direction forming a preset angle with the preset area,

correspondingly, the image obtaining unit is specifically adapted to determine that the user located in a preset area is detected when an infrared receiver arranged opposite to the infrared transmitter does not receive the infrared ray; acquiring a second distance between the user and a display interface; and determining the height of the user according to the preset angle and the second distance.

8. The apparatus of claim 7, further comprising:

an interval acquisition unit adapted to invoke the distance acquisition unit after a predetermined time interval;

and the re-adjusting unit is suitable for adjusting the size of the virtual image displayed at the preset position on the display interface according to the re-acquired first distance.

9. The apparatus of claim 7, further comprising:

and the position determining unit is suitable for determining the preset position according to the adjusted size of the virtual image and the first distance between the user and the display interface.

10. The apparatus of claim 7, wherein the obtaining of the first distance between the user and the display interface specifically comprises:

acquiring a first distance between the user and a display interface acquired by a ranging sensor.

11. The apparatus according to any one of claims 7 to 10, wherein one height corresponds to a plurality of virtual images of different postures;

correspondingly, the device further comprises:

a gesture obtaining unit adapted to obtain a current gesture of the user;

correspondingly, the image obtaining unit is specifically adapted to search a mapping relationship according to the height and the current posture of the user, so as to obtain a virtual image corresponding to the height and the current posture of the user.

12. The apparatus of claim 11, the gesture acquisition unit being specifically adapted to acquire an image of the user; performing foreground segmentation on the image to obtain a human body contour in the image; and matching the human body contour with a preset contour, and taking the posture corresponding to the matched preset contour as the current posture of the user.

Images