CN108038916B - Augmented reality display method - Google Patents

Abstract

The embodiment of the invention relates to the field of augmented reality and discloses a display method of augmented reality. The invention provides an augmented reality display method, which comprises the following steps: acquiring a two-dimensional plane where a screen of input equipment is located; acquiring a target space position according to the two-dimensional plane; the target space position is used as a space position of a virtual display screen superposed in a real environment; the virtual display screen displays the content input by the input equipment, so that the position of the virtual display screen can be quickly acquired, and the input equipment with display capacity and the augmented reality glasses are adopted to perform direct information interaction, so that the application capacity of the augmented reality is improved.

Description

A display method for augmented reality

technical field

Embodiments of the present invention relate to the field of augmented reality, and in particular, to an augmented reality display method.

Background technique

Augmented reality refers to the use of image display devices to present the real world environment, and to add some sensory input generated by computers, such as sound, video, graphics and other data. As a new type of human-machine interface and simulation tool, augmented reality technology has received more and more attention, and has played an important role in many fields, providing a powerful means for the expansion of human intelligence, and has had a huge impact on production methods and social life. profound influence. As a new type of computing device, augmented reality glasses have been widely used in many fields such as military, industry, medical treatment, and science and technology. Augmented reality glasses combine various comprehensive technical means such as computer graphics technology, simulation technology and display technology, and can intuitively display and manipulate digital content by superimposing virtual 3D graphics generated by computers in real scenes. Since the augmented reality glasses need to be superimposed with the current real environment when displaying digital content, the augmented reality glasses need to collect the spatial coordinate information of the current environment through the sensor system. When using augmented reality glasses to scan the environment, it is necessary to combine computer graphics technology, simulation technology and display technology to create an augmented reality environment and interact with the real environment.

However, the inventors have found that at least the following problems exist in the prior art: generating an augmented reality environment requires structured light to scan and model the reality environment multiple times, the technical implementation is very complicated, and when loading a virtual display screen, the user is often absent. Therefore, it is necessary to find the position of the virtual display screen, which greatly affects the user experience. That is to say, in the prior art, it is difficult to quickly obtain the position of the virtual display screen, and the technical implementation is relatively complicated.

Another technical problem that augmented reality glasses need to solve is information interaction with users. As wearable devices, physical buttons integrated on glasses, touch pads or wireless remote control devices are commonly used as input devices in the prior art, and have a A set of independently running application software uses these interactive devices. These input devices generally have simple functions, no display capabilities, and it is difficult to perform intuitive interaction or more complex text input, which greatly limits the application capabilities of augmented reality.

Contents of the invention

The purpose of the embodiments of the present invention is to provide an augmented reality display method, so that the position of the virtual display screen can be quickly obtained, and an input device with display capability is used to perform direct information interaction with the augmented reality glasses, so that the application ability of augmented reality can be improved. improve.

In order to solve the above technical problems, an embodiment of the present invention provides an augmented reality display method, including:

Obtain the two-dimensional plane where the screen of the input device is located;

Obtain the target spatial position according to the two-dimensional plane;

The target spatial position is superimposed as the spatial position of the virtual display screen in the real environment; wherein, the virtual display screen displays the content input by the input device.

Compared with the prior art, the embodiment of the present invention obtains the two-dimensional plane where the screen of the input device is located; obtains the target spatial position according to the two-dimensional plane; superimposes the target spatial position as the spatial position of the virtual display screen in the real environment; Wherein, the virtual display screen displays content input by the input device. By directly obtaining the two-dimensional plane where the screen of the input device is located, the spatial position of the virtual display in the real environment can be quickly obtained, which is beneficial to avoid scanning the complex real environment, and then superimposing the virtual display on the screen based on the scanning recognition results. This relatively complex method in the real environment greatly reduces the workload at the technical level. At the same time, the content input by the user through the input device can be directly displayed on the virtual display screen. The input device has a screen, and the screen has display capabilities, and can directly interact with the augmented reality glasses for relatively complex information, which improves the application capability of augmented reality.

In addition, obtaining the two-dimensional plane where the screen of the input device is located specifically includes: scanning the feature image displayed on the screen of the input device; extracting feature points on the feature image; and obtaining the two-dimensional plane where the screen of the input device is located according to the extracted feature points . Since the features of the feature points of the feature image on the screen are more obvious, the extracted feature points are relatively stable, and the two-dimensional plane obtained based on the relatively stable feature points is also relatively stable, so that the spatial position of the obtained virtual display screen is also relatively stable. Stable and greatly improved user experience.

In addition, after superimposing the target spatial position as the virtual display screen on the spatial position in the real environment, it also includes: receiving control information input from the input device; and controlling the display state of the virtual display screen according to the control information. Through the control information input by the input device, the change of the display state such as the size and shape of the virtual display screen can be controlled, so that the display state of the virtual display screen can be adjusted according to actual needs, which is convenient for users to use.

In addition, after controlling the display state of the virtual display screen, it also includes: judging whether a screen lock signal sent by the input device is received; if the screen lock signal is received, then locking the virtual display screen. Locking the virtual display screen allows the user to use the input device as a keyboard, mouse, or remote control, etc., which are used by the user every day. Through the input device, related operations can be performed intuitively and conveniently on the locked virtual display screen, making the augmented reality display method more flexible.

Description of drawings

One or more embodiments are exemplified by the pictures in the corresponding drawings, and these exemplifications do not constitute a limitation to the embodiments. Elements with the same reference numerals in the drawings represent similar elements. Unless otherwise stated, the drawings in the drawings are not limited to scale.

FIG. 1 is a schematic flowchart of an augmented reality display method according to a first embodiment of the present invention;

Fig. 2 (a) is a schematic diagram of a characteristic image displayed on the screen of the input device according to the first embodiment of the present invention;

2(b) is a schematic diagram of a characteristic image displayed on the screen of the input device according to the first embodiment of the present invention;

Fig. 2 (c) is a schematic diagram of a characteristic image displayed on the screen of the input device according to the first embodiment of the present invention;

FIG. 3 is a schematic diagram of a practical application of an augmented reality display method according to a first embodiment of the present invention;

FIG. 4 is a schematic flowchart of an augmented reality display method according to a second embodiment of the present invention;

Fig. 5 is a schematic diagram of a parameter setting interface of an input device according to a second embodiment of the present invention;

6 is a schematic diagram of the size and position changes of the virtual display screen according to the second embodiment of the present invention;

FIG. 7 is a schematic diagram of an input device regarded as a mouse according to a second embodiment of the present invention;

FIG. 8 is a schematic diagram of an input device regarded as a keyboard according to a second embodiment of the present invention;

Fig. 9 is a schematic flowchart of an augmented reality display method according to a third embodiment of the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, various implementation modes of the present invention will be described in detail below in conjunction with the accompanying drawings. However, those of ordinary skill in the art can understand that, in each implementation manner of the present invention, many technical details are provided for readers to better understand the present application. However, even without these technical details and various changes and modifications based on the following implementation modes, the technical solution claimed in this application can also be realized.

The first embodiment of the present invention relates to an augmented reality display method. The core of this embodiment is to obtain the two-dimensional plane where the screen of the input device is located; obtain the target spatial position according to the two-dimensional plane; superimpose the target spatial position as the virtual display screen on the spatial position in the real environment; wherein, the virtual display screen displays The content input by the input device makes it possible to quickly obtain the position of the virtual display screen, and use the input device with display capability to perform direct information interaction with the augmented reality glasses, so that the application capability of augmented reality is improved. The implementation details of the augmented reality display method of this embodiment will be described in detail below, and the following content is only implementation details provided for easy understanding, and is not necessary for implementing this solution.

The flowchart of the augmented reality display method according to the first embodiment of the present invention is shown in FIG. 1 . The augmented reality display method can be applied to augmented reality glasses, and specifically includes:

Step 101: Obtain the two-dimensional plane where the screen of the input device is located.

Specifically, the augmented reality glasses can acquire the two-dimensional plane where the screen of the input device is located, and the input device can be a personal computer, a mobile phone, a tablet computer and other smart devices with a screen capable of displaying images. The input device in this embodiment is a mobile phone as an example, but it is not limited to this in practical applications.

Augmented reality glasses can scan the screen of the mobile phone and extract feature points on the screen of the mobile phone. Feature points can be understood as special points in an image that are different from other points. For example, there are no feature points on a pure white image. And if there are several black spots on this pure white image, since these black spots are different from other points on this pure white image, then these black spots can be used as feature points. The feature points on the mobile phone screen can be understood as the points at the frame of the mobile phone, or the points at the junction of black and white around the mobile phone screen. It can be understood that the coordinates of at least four points are required to obtain a two-dimensional plane, therefore, the coordinates of at least four feature points are required to obtain the two-dimensional plane where the screen of the mobile phone is located. The augmented reality glasses can extract the coordinates of at least four points on the screen of the mobile phone. Of course, the more feature points extracted, the more accurate the obtained two-dimensional plane. For example, the extracted feature points on the mobile phone screen can be the coordinates (u1, v1), (u2, v2), ..., (un, vn) of the feature points on the screen, then according to the coordinates of these points, the mobile phone can be obtained The 2D plane on which the screen resides.

The augmented reality glasses can also scan the feature image displayed on the screen of the mobile phone and extract the feature points on the feature image. The characteristic images on the mobile phone screen can be shown in Figure 2(a), 2(b), and 2(c). Of course, this embodiment only provides three possible characteristic images, but it is not used in practical applications. To the limit, the feature image can be various patterns, numbers, letters, etc. Since the feature points of the feature image on the mobile phone screen are more prominent and obvious, and augmented reality glasses can easily extract multiple relatively stable feature points, then based on these large number of relatively stable feature points The obtained two-dimensional plane of the mobile phone screen is relatively accurate and more stable.

It should be noted that this embodiment only provides two methods for obtaining the two-dimensional plane where the screen of the input device is located, but it is not limited to this in practical applications. The two-dimensional plane methods are all within the protection scope of this embodiment.

Step 102: Obtain the target spatial position according to the two-dimensional plane.

Specifically, the augmented reality glasses can obtain the first spatial position of the mobile phone according to the two-dimensional plane where the mobile phone screen is located; obtain the target spatial position according to the first spatial position of the mobile phone, and the target spatial position can be understood as the space of the virtual display screen Location. For example, if the camera in the augmented reality glasses scans the screen of the mobile phone, then a camera coordinate system (Xc, Yc, Zc) centered on the camera can be established. The two sides are parallel, the Z axis is the optical axis of the lens, and is perpendicular to the phase plane. The coordinates in the camera coordinate system are the coordinates of the first spatial position where the mobile phone is located. At the same time, a world coordinate system (Xw, Yw, Zw) based on the mobile phone screen is established. The world coordinate system takes a certain feature point extracted above as the origin, and the XY plane (two-dimensional plane) coincides with the plane where the mobile phone plane is located. , the Z axis is perpendicular to the phone plane. The coordinates in the world coordinate system are the coordinates of the target space where the virtual display screen is located. The conversion relationship between the camera coordinate system and the world coordinate system can be established through an algorithm, and the rotation matrix R and translation matrix T from the world coordinate system to the camera coordinate system can be obtained. The direct linear transformation algorithm is used to calculate the homography matrix Homography of the world plane and the camera plane, so as to obtain the rotation matrix R and translation matrix T between the two coordinate systems. Similarly, the nonlinear optimization method can also be used to calculate the rotation matrix R and translation matrix T between the two coordinate systems. Thus, the target spatial position is obtained according to the first spatial position where the mobile phone is located.

In order to obtain the spatial position of the virtual display screen, the extracted four or more feature points can also be used to transform the coordinate system. Suppose the coordinates of the feature points on the screen (u1, v1), (u2, v2), ..., (un, vn), through the internal parameters of the camera, the two-dimensional coordinates of the feature points on the two-dimensional plane where the mobile phone screen is located can be Convert to camera coordinates (X1c, Y1c, Z1c), (X2c, Y2c, Z2c), ..., (Xnc, Ync, Znc). If the mobile phone screen or the relevant feature information of the feature image displayed on the mobile phone screen, such as the size, is marked in advance, then the position of each corresponding feature point in the world coordinate system can also be obtained (X1w, Y1w, Z1w) , (X2w, Y2w, Z2w), ..., (Xnw, Ynw, Znw).

It should be noted that this embodiment only provides two implementation methods for obtaining the target spatial position based on the two-dimensional plane, and is not limited to this in practical applications. Any method for obtaining the target spatial position based on the two-dimensional plane is included in this Within the protection scope of the invention embodiment.

Step 103: Project the virtual display screen to the target space position.

Specifically, the target spatial position obtained in step 102 is superimposed on the spatial position in the real environment as a virtual display screen, that is, the augmented reality glasses will project the virtual display screen to the target spatial position, and the virtual display screen can display input The content of the device input. The spatial position of the virtual display is determined, and its size and shape can be default values or values set through the mobile phone. For example, the relationship among the augmented reality glasses 301 , the virtual display screen 302 , and the mobile phone 303 in this embodiment can be as shown in FIG. 3 , and the content input by the mobile phone 303 can be displayed on the virtual display screen 302 . The user can obtain a virtual display screen 302 on the top of the mobile phone, which can display the content on the screen of the mobile phone 303. At the same time, the virtual display screen 302 can also move with the movement of the mobile phone 303, which is equivalent to adding a mobile phone 303 A big, portable screen.

Compared with the prior art, in this embodiment, the two-dimensional plane where the screen of the input device is located is obtained; the target spatial position is obtained according to the two-dimensional plane; the target spatial position is superimposed on the virtual display screen as the spatial position in the real environment; Wherein, the virtual display screen displays content input by the input device. By directly obtaining the two-dimensional plane where the screen of the input device is located, the spatial position of the virtual display in the real environment can be quickly obtained, which is beneficial to avoid scanning the complex real environment and then superimposing the virtual display on the reality based on the scanning recognition results This relatively complex method in the environment greatly reduces the workload at the technical level. At the same time, the content input by the user through the input device can be directly displayed on the virtual display screen. The input device has a screen, and the screen has display capabilities, and can directly interact with the augmented reality glasses for relatively complex information, which improves the application capability of augmented reality.

The second embodiment of the present invention relates to an augmented reality display method. The second embodiment is a further improvement of the first embodiment. The main improvement is: after superimposing the target spatial position as a virtual display screen on the spatial position in the real environment, it also includes: receiving control information input by the input device; Information to control the display status of the virtual display.

The flowchart of the augmented reality display method according to the second embodiment of the present invention is shown in FIG. 4 , which specifically includes:

Step 401: Obtain the two-dimensional plane where the screen of the input device is located.

Step 402: Obtain the target spatial position according to the two-dimensional plane.

Step 403: Project the virtual display screen to the target spatial position.

Since steps 401 to 403 in this embodiment are substantially the same as steps 101 to 103 in the first embodiment, they will not be described again to avoid repetition.

Step 404: Receive the control information input by the input device.

Specifically, the control information input by the input device may be information such as the size, shape, and distance from the augmented reality glasses of the virtual display screen. For example, if the user feels that the size of the current virtual display is too small, he can input the estimated size to the input device, and the input device will send the estimated size to the augmented reality glasses. Of course, the augmented reality glasses and the input device can be connected wirelessly. The augmented reality glasses can receive the control information input by the input device through a wired connection. Users can also set the shape of the virtual display according to their preferences, such as circle, square or any other shape. If the user feels that the current virtual display screen is relatively close to the user and is uncomfortable to look at, the above-mentioned distance can also be adjusted to achieve a satisfactory distance for the user.

For example, a schematic diagram of an interface for setting parameters of an input device is shown in FIG. 5 . The input device can be a mobile phone, through which parameters can be input to adjust the display status such as the size and position of the virtual display screen. In order to adapt to various needs of users, the size, shape and distance of the virtual display screen can be changed. The button 501 on the screen of the mobile phone is to adjust the virtual display to move up, down, left, and right or to select the shape of the virtual display, the button 502 is to adjust the virtual display to move forward and backward, the button 503 is to adjust the size of the virtual display, and the button 504 is to move forward and backward on the smart phone interface . This embodiment only provides a schematic diagram of an interface for setting parameters of an input device, and the interface for setting parameters in practical applications is not limited thereto. Step 405: Control the display state of the virtual display screen according to the control information.

Specifically, if the control information is to increase the size of the virtual display, then the augmented reality glasses will control the size of the virtual display to increase to the size indicated by the control information, or control the virtual display according to the control information input by the mobile phone. The position of the screen changes. For example, the schematic diagram of the size and position change of the virtual display screen can be shown in FIG. After receiving the control information, the augmented reality glasses display the updated virtual display screen 602 at the desired position of the user. Of course, the shape of the virtual display screen in this embodiment is a quadrilateral as an example, which is not limited in practical applications.

Step 406: Judging whether the screen lock signal sent by the input device is received, if yes, execute step 407, if not, the process ends.

For example, if the user feels that the size and shape of the current virtual display screen are more appropriate, and he does not want to change the position of the current virtual display screen due to the movement of the mobile phone (input device), then he can use the mobile phone to enhance the display status. The reality glasses send a lock screen signal. The augmented reality glasses can determine whether the screen lock signal sent by the mobile phone is received, and if the screen lock signal is received, step 407 is performed; otherwise, the process ends.

Step 407: Lock the virtual display screen.

Specifically, after the virtual display is locked, the position of the virtual display will not change due to the movement of the input device, then the input device can be regarded as a mouse as shown in Figure 7, and the input device can be a mobile phone , the mobile phone now has the function of a mouse, and can perform corresponding operations on the content displayed on the virtual display screen. The input device can also be regarded as a keyboard as shown in FIG. 8 , the input device can be a mobile phone, and the mobile phone has the function of a keyboard at this time, and the content that the user wants to see on the virtual display screen can be input through the keyboard. Of course, the input device can also be used as a remote controller, a handle, etc. In this embodiment, only the implementation scheme of the input device as a mouse and a keyboard is provided, but it is not limited to this in practical applications.

It should be noted that the input device in this embodiment is just a mobile phone as an example, but it is not limited to this in practical applications.

Compared with the prior art, the embodiment of the present invention can control the change of the display state such as the size and shape of the virtual display screen through the control information input by the input device, so that the display state of the virtual display screen can be adjusted according to actual needs, which is convenient User's use. Locking the virtual display screen allows the user to use the input device as a keyboard, mouse, or remote control, etc., which are used by the user every day. Through the input device, related operations can be performed intuitively and conveniently on the locked virtual display screen, making the augmented reality display method more flexible.

The third embodiment of the present invention relates to an augmented reality display method. The third embodiment is a further improvement of the first embodiment. The main improvement is that after superimposing the target spatial position as a virtual display screen on the spatial position in the real environment, it also includes: acquiring display content according to the information input by the input device; The virtual display screen displays content input by the input device, specifically: the virtual display screen displays acquired display content.

The flowchart of the augmented reality display method according to the third embodiment of the present invention is shown in FIG. 9 , which specifically includes:

Step 901: Obtain the two-dimensional plane where the screen of the input device is located.

Step 902: Obtain the target spatial position according to the two-dimensional plane.

Step 903: Project the virtual display screen to the target space position.

Since steps 901 to 903 in this embodiment are substantially the same as steps 101 to 103 in the first embodiment, they will not be described again to avoid repetition.

Step 904: Obtain display content according to the information input by the input device.

Specifically, the augmented reality glasses can obtain information input by the input device by scanning the screen of the input device, and obtain display content according to the scanned information. The input device can be a mobile phone, and the information input by the mobile phone can be two-dimensional code information. The two-dimensional code is displayed on the screen of the mobile phone. The augmented reality glasses obtain the content to be displayed by scanning the two-dimensional code, and the content to be displayed is the two-dimensional code. corresponding content. The information input by the mobile phone can also be a URL, and the URL is displayed on the screen of the mobile phone in the format of text and pictures. The augmented reality glasses can obtain the content to be displayed by scanning the URL on the screen of the mobile phone. The content to be displayed can be the URL corresponding to the URL. A webpage, or the URL itself. If the information input by the mobile phone is just an ordinary picture, then the displayed content obtained by the augmented reality glasses by scanning the picture displayed on the mobile phone is the picture displayed on the mobile phone. Of course, in actual use, the mobile phone can also be paired and connected with the augmented reality glasses through Bluetooth, and the mobile phone can directly send the input information to the augmented reality glasses, and the augmented reality glasses can obtain the information input by the mobile phone by receiving the information sent by the mobile phone.

It is worth mentioning that the augmented reality glasses can also log in, add, log out, or delete the account information entered by the user when receiving the account information. For example, the content corresponding to the QR code can also be the user name (account information). If the user needs to use the QR code to log in, the virtual display screen can display the user name corresponding to the QR code, and can also display the success or failure of the login. interface. The augmented reality glasses can also add the account information corresponding to the recognized two-dimensional code as a friend, or delete it from the friend list, or log out. The account information can be obtained by scanning the QR code displayed on the input device by the augmented reality glasses, or by the user directly inputting the account information in the input device and sending it to the augmented reality glasses. In short, the information input by the input device can correspond to various display states, and the content displayed on the virtual display screen can be the content represented by the image displayed on the screen of the input device, or other content corresponding to the information input by the input device.

It should be noted that this embodiment only provides two methods for the augmented reality glasses to obtain the content to be displayed, and is not limited to this in practical applications. within the scope of protection.

Step 905: Display the displayed content on the virtual display screen.

For example, if the displayed content acquired by the augmented reality glasses is the content of the web page corresponding to the two-dimensional code, then the content of the web page is displayed on the virtual display screen. If the display content obtained by the augmented reality glasses is the content in the website corresponding to the URL, then the content in the website is displayed on the virtual display. If the display content obtained by the augmented reality glasses is a video corresponding to the video link, then the corresponding video can be played on the virtual display screen. If the display content obtained by the augmented reality glasses is the user's account information, then the relevant login or logout interface, interface for adding friends, interface for deleting friends, interface for canceling account, etc. can be displayed on the virtual display screen. Of course, this embodiment only provides several possible contents displayed on the virtual display screen, but it is not limited thereto in practical applications. It is worth mentioning that the input device can also send data in abstract characters, images, sounds and other formats to the augmented reality glasses through wired or wireless channels, which expands the input capability of the input device and at the same time improves the output capability of the augmented reality glasses. Great improvement.

Compared with the prior art, the third embodiment of the present invention obtains the display content according to the information input by the input device, so that the display content can be changed according to the change of the input information, and the user can input different information through the input device according to actual needs, so that The content that the user wants to see is displayed on the virtual display screen, which greatly improves the input and output capabilities of the augmented reality glasses, creates an augmented reality environment that can be operated flexibly for the user, and facilitates the use of the user.

The step division of the above various methods is only for the sake of clarity of description. During implementation, it can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. ; Adding insignificant modifications or introducing insignificant designs to the algorithm or process, but not changing the core design of the algorithm and process are all within the scope of protection of this patent.

Those skilled in the art can understand that all or part of the steps in the method of the above-mentioned embodiments can be completed by instructing related hardware through a program, the program is stored in a storage medium, and includes several instructions to make a device (which can be A single chip microcomputer, a chip, etc.) or a processor (processor) executes all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, and other media that can store program codes.

Those of ordinary skill in the art can understand that the above-mentioned embodiments are specific examples for realizing the present invention, and in practical applications, various changes can be made to it in form and details without departing from the spirit and spirit of the present invention. scope.

Claims (8)

1. A display method for augmented reality, comprising: Obtain the two-dimensional plane where the screen of the input device is located; Acquiring the spatial position of the target according to the two-dimensional plane; Superimposing the target spatial position as a virtual display screen on a spatial position in the real environment; wherein, the virtual display screen displays content input by the input device; Wherein, after the said target spatial position is superimposed on the spatial position in the real environment as a virtual display screen, it also includes: receiving control information input by the input device; controlling the display state of the virtual display screen according to the control information; After said controlling the display state of said virtual display screen, it also includes: Judging whether the screen lock signal sent by the input device is received; wherein the screen lock signal is a signal sent by the input device after determining that the display state of the virtual display screen does not need to be adjusted; If the lock screen signal is received, the virtual display screen is locked; wherein, after the virtual display screen is locked, the input device has the functions of a mouse, a keyboard, a remote control or a handle and the virtual display screen The position of the screen will not change due to the movement of the input device. 2. The display method of augmented reality according to claim 1, wherein said obtaining the target spatial position according to said two-dimensional plane specifically comprises: Acquiring a first spatial position of the input device according to the two-dimensional plane; Acquire the target spatial position according to the first spatial position. 3. The method for displaying augmented reality according to claim 1, wherein the acquisition of the two-dimensional plane where the screen of the input device is located specifically includes: scanning the screen of said input device; extracting feature points on the screen of the input device; The two-dimensional plane where the screen of the input device is located is acquired according to the extracted feature points. 4. The display method of augmented reality according to claim 1, wherein said acquisition of the two-dimensional plane where the screen of the input device is located specifically includes: scanning the characteristic image displayed on the screen of the input device; extracting feature points on the feature image; The two-dimensional plane where the screen of the input device is located is acquired according to the extracted feature points. 5. The display method of augmented reality according to claim 1, characterized in that, after superimposing the target spatial position as a virtual display screen on the spatial position in the real environment, further comprising: acquiring display content according to information input by the input device; The virtual display screen displays content input by the input device, specifically: the virtual display screen displays the acquired display content. 6. The method for displaying augmented reality according to claim 5, wherein the acquiring display content according to the information input by the input device specifically comprises: Obtaining information input by the input device by scanning the screen of the input device; The displayed content is acquired according to the scanned information. 7. The method for displaying augmented reality according to claim 5, characterized in that the acquiring the feature information input by the input device is specifically: Obtaining information input by the input device by receiving information sent by the input device; Acquire the display content according to the sent information. 8. The display method of augmented reality according to claim 5, characterized in that, after superimposing the target spatial position as a virtual display screen on the spatial position in the real environment, further comprising: Determine whether the account information provided by the input device is received; If the account information is received, log in, log out, add or delete the account information.

Images