CN106650727B - An information display method and an AR device - Google Patents

Abstract

The invention discloses an information display method and an AR device. The method includes: when it is detected that the image information of the current scene includes text, recognizing the text information that the text refers to; receiving the font for the target text in the image information a conversion instruction, the font conversion instruction is used to instruct to convert the font of the target text in the image information into a target font; according to the font conversion instruction and the target text information referred to by the target text, on the image information Displaying the target text information in the target font can realize font conversion of the text contained in the image information, help the user to recognize the text in the image information more clearly, and improve the user experience.

Description

An information display method and an AR device

technical field

The present invention relates to the technical field of terminals, and in particular, to an information display method and an AR device.

Background technique

Augmented Reality (AR) is a technology that calculates the position and angle of camera images in real time and adds corresponding images, videos, and 3D models. Augmented reality technology can display real-world information and virtual worlds on the screen. Information is "seamlessly" integrated and interactive. With the improvement of the CPU computing power of portable electronic products, AR devices are increasingly used by users.

However, in the prior art, the AR device can collect image information in the scene and display it. When the image information includes text, the AR device can recognize the text as much as possible, and the text in the image information can only be displayed in the image information. The fonts are displayed as they are, and the texts in the collected image information cannot be converted to fonts. For example, some users do not know traditional Chinese characters, so that the users cannot recognize them, and the user experience is poor.

SUMMARY OF THE INVENTION

Embodiments of the present invention disclose an information display method and an AR device, which can realize font conversion of text contained in image information, help users to more clearly identify text in image information, and improve user experience.

In a first aspect, an embodiment of the present invention provides an information display method, including:

When it is detected that the image information of the current scene includes text, identifying the text information that the text refers to;

receiving a font conversion instruction for the target text in the image information, where the font conversion instruction is used to instruct to convert the font of the target text in the image information into a target font;

According to the font conversion instruction and the target text information indicated by the target text, the target text information is displayed in the target font on the image information.

Optionally, displaying the target text information in the target font on the image information according to the font conversion instruction and the target text information referred to by the target text includes:

removing the target text in the image information;

According to the font conversion instruction and the target text information indicated by the target text, the target text information is displayed in the target font at the position corresponding to the target text in the image information.

Optionally, when it is detected that the image information of the current scene includes text, after identifying the text information referred to by the text, the method further includes:

receiving a font size setting instruction input for the target text in the image information, where the font size setting instruction is used to set the font size of the target text as the target font size;

The displaying the target text information in the target font on the image information according to the font conversion instruction and the text information referred to by the target text includes:

According to the font conversion command, the font size setting command, and target text information indicated by the target text, the target text information is displayed on the image information in the target font and the target font size.

Optionally, after displaying the target text information in the target font on the image information according to the font conversion instruction and the text information referred to by the target text, the method further includes:

Sending a retrieval request to the server using the target text information as a keyword, so that the server returns a retrieval result after receiving the retrieval request;

The retrieval result is received and displayed.

Optionally, the keyword further includes location information; the location information is the acquired current location; and the retrieval result is the information with the highest matching degree with the keyword among the retrieved information.

In a second aspect, an embodiment of the present invention further provides an AR device, including:

a processing unit, configured to recognize the text information referred to by the text when it is detected that the image information of the current scene includes text;

a receiving unit, configured to receive a font conversion instruction for the target text in the image information, where the font conversion instruction is used to instruct to convert the font of the target text in the image information into a target font;

A display unit, configured to display the target text information in the target font on the image information according to the font conversion instruction and the target text information referred to by the target text.

Optionally, the processing unit is further configured to: remove the target text in the image information;

The display unit is further configured to: display the target text information in the target font at the position corresponding to the target text in the image information according to the font conversion instruction and the target text information indicated by the target text .

Optionally, the receiving unit is further configured to: receive a font size setting instruction input for the target text in the image information, where the font size setting instruction is used to set the font size of the target text as the target font size;

The display unit is further configured to: display the target font and the target font size on the image information according to the font conversion instruction, the font size setting instruction and the target text information referred to by the target text the target text information.

Optionally, the AR device further includes:

A sending unit, configured to send a retrieval request to a server with the target text information as a keyword, so that the server returns a retrieval result after receiving the retrieval request;

The receiving unit is further configured to: receive and display the retrieval result.

Optionally, the keyword further includes location information; the location information is the acquired current location; and the retrieval result is the information with the highest matching degree with the keyword among the retrieved information.

In the above invention, when it is detected that the image information of the current scene includes text, the AR device recognizes the text information that the text refers to; receives a font conversion instruction for the target text in the image information, and the font conversion instruction is used to instruct the The font of the target text in the image information is converted into a target font; and according to the font conversion instruction and the target text information that the target text refers to, the target text information is displayed in the target font on the image information. , which can realize the font conversion of the text contained in the image information, help the user to recognize the text in the image information more clearly, and improve the user experience.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

1 is a system architecture diagram of a communication system provided by an embodiment of the present invention;

2 is a schematic flowchart of an information display method provided by an embodiment of the present invention;

3 is a schematic structural diagram of an embodiment of a font conversion operation provided by an embodiment of the present invention;

4A-4D are schematic diagrams of steps in a method for displaying target text information provided by an embodiment of the present invention;

5 is a schematic structural diagram of an embodiment of a font size setting operation provided by an embodiment of the present invention;

6 is a schematic structural diagram of a retrieval result display interface provided by an embodiment of the present invention;

7 is a schematic structural diagram of an AR device provided by an embodiment of the present invention;

8 is a schematic structural diagram of another AR device provided by an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of another AR device provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments.

It should be noted that the terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

Please refer to FIG. 1. FIG. 1 is a system architecture diagram of a communication system provided by an embodiment of the present invention. The communication system may include an Augmented Reality (AR) device 11 , a mobile terminal 12 , a server 13 , etc., where the AR device 11 may have a communication function to establish a communication connection with the mobile terminal 12 or the server 13 . It should be understood that the information display method of the present invention can be implemented based on the AR device 11 , can also be implemented based on a communication system composed of the AR device 11 and the server 13 , and can also be implemented based on the communication system shown in FIG. 1 .

The AR device 11 may include at least one image sensor, such as a camera, for acquiring image information of the current scene, the AR device 11 may be smart glasses, a smartphone, a tablet, etc., and may be arranged according to one or more other types of wireless communication (eg, protocol) to communicate. The wireless communication may include Bluetooth, cellular technology, Zigbee, NFC (Near Field Communication), and RFID (Radio Frequency Identification, radio frequency identification) communication, and so on.

The mobile terminal 12 has a communication connection relationship with the AR device 11, which may be a smart phone, a tablet computer, etc., and may include a wireless communication function to request information from the server.

Please refer to FIG. 2. FIG. 2 is a schematic flowchart of an information display method provided by an embodiment of the present invention. As shown in Figure 2, the information display method includes the following steps:

Step S210: When it is detected that the image information of the current scene includes text, identify the text information that the text refers to.

Specifically, the AR device can obtain the image information of the current scene through an image sensor, such as a camera, and detect whether the image information of the current scene contains text. If so, the image information of the current scene contains text, and identify the text that the text refers to. information; otherwise, the image information of the current scene does not contain text, and the process can be ended.

Wherein, the AR device detects whether the acquired image information of the current scene contains text information, and the method for identifying the text information referred to by the text may be: the AR device converts the image information of the current scene into a grayscale image , binarize the grayscale image, remove image noise, correct the inclination, and then segment multiple characters included in the image information, match the segmented characters with the standard character template, and calculate the difference between the segmented characters and the standard character template. For the degree of similarity between standard text templates, the text information corresponding to the standard text template with the greatest similarity is taken as the recognition result. At this time, the image information of the current scene detected by the AR device contains text information.

Step S220: Receive a font conversion instruction for the target text in the image information, where the font conversion instruction is used to instruct to convert the font of the target text in the image information into the target font.

Specifically, the target text in the image information may include all or part of the text in the image information. The font conversion instruction may be generated by the AR device according to the font conversion operation input by the user for the target text in the image information; it may also be that the AR device triggers the generated font after recognizing the text information referred to by the text in the image information. The conversion instruction, specifically, the AR device can preset the target font for text display. Please refer to FIG. 3 , which is a schematic structural diagram of an implementation manner of a font conversion operation provided by an embodiment of the present invention. The font conversion operation may be a selection operation input by the user for the target text 321 "Lotus Pond Moonlight" in the display interface of the image information 31 of the current scene, and the target font "Song Ti" is selected in the font option drop-down menu 331 in the menu bar 33. . It can be understood that the image information 31 of the current scene may include multiple characters 32 shown in dotted boxes, and the target character 321 may include all or part of the multiple characters 32 .

It can be understood that the font conversion includes traditional and simplified Chinese font conversion, font format conversion, and the like.

Step S230: Display the target text information in the target font on the image information according to the font conversion instruction and the target text information indicated by the target text.

Specifically, the AR device can input target text information whose font is the target font on the image information, and display the image information after the input target text information. It can be understood that the input target text information can cover the original target text for display.

In this embodiment of the present invention, an implementation manner of step S130 may be: the AR device may remove the target text in the image information, and further, according to the font conversion instruction and the text information referred to by the target text, in the The position corresponding to the target text in the image information displays the target text information in the target font. Please refer to FIGS. 4A-4D. FIGS. 4A-4D are schematic diagrams of steps in a method for displaying target text information provided by an embodiment of the present invention. Specifically, FIG. 4A is a schematic interface diagram of the image information of the target text before font conversion; the AR device can remove the target text in the image information, as shown in FIG. 4B ; and then render the background color of the image information to the removal target The area after the text is shown in FIG. 4C ; the target text information is only displayed in the target font at the position corresponding to the target text in the image information; as shown in FIG. 4D .

In this embodiment of the present invention, after step S110, the information display method may further include: the AR device receives a font size setting instruction input for the target text in the image information, and the font size setting instruction is used to display the target text The font size of the font size is set as the target font size; at this time, an implementation manner of step S130 may be: according to the font conversion instruction, the font size setting instruction and the text information referred to by the target text, in the image information The target text information is displayed in the target font and the target font size above.

Specifically, the font size setting instruction may be generated by the AR device according to receiving the font size setting operation input by the user for the target text in the image information; it may also be generated by the AR device after recognizing the text information referred to by the text in the image information. , triggering the generated font size setting instruction, specifically, the AR device can preset the target font size for text display. Please refer to FIG. 5 , which is a schematic structural diagram of an implementation manner of a font size setting operation provided by an embodiment of the present invention. The font size setting operation may be that the user displays the text 52 shown in the dotted box in the display interface of the image information 51 of the current scene, and after the selected operation is input for the target text 521 "Lotus Pond Moonlight", the font size column in the menu bar 53 is displayed. 531 Selects the target font size. The AR device displays the target text information in the target font and the target font size on the image information according to the font conversion instruction, the font size setting instruction, and the target text information indicated by the target text.

Optionally, after step S130, the information display method further includes: the AR device sends a retrieval request to the server using the target text information as a keyword, so that the server returns a retrieval result after receiving the retrieval request. ; and then the AR device receives and displays the retrieval result.

Specifically, the AR device can preset an application program, such as a browser, through the built-in search engine window of the browser, input keywords, that is, target text information, to generate a retrieval request, the AR device sends the retrieval request to the server, and the server After receiving the retrieval request, the retrieval result is returned to the AR device. For example, if the keyword is "Moonlight on the Lotus Pond", the AR device calls the browser, and enters "Moonlight on the Lotus Pond" in the Baidu search interface to perform a search. The Baidu server can send the search results of the keyword "Moonlight on the Lotus Pond" to the AR device. The AR device receives and displays the retrieval result. Optionally, the retrieval result may be the information with the highest matching degree with the keyword among the retrieved information. Please refer to FIG. 6 . FIG. 6 is a schematic structural diagram of a retrieval result display interface provided by an embodiment of the present invention. The AR device may The search result is displayed on the target text information display interface. It can be understood that the preset application may be a default application of the AR device, or an application preset by a user.

It should be noted that the AR device can also send a retrieval instruction including the keyword information to a mobile terminal that is in a communication connection with the AR device, and the mobile terminal sends a retrieval request to the server, so that the server receives the retrieval request. After the request, the search result is sent to the mobile terminal, and then the mobile terminal sends the search result to the AR device.

Optionally, the keyword further includes location information; the location information is the acquired current location; and the retrieval result is the information with the highest matching degree with the keyword among the retrieved information. Among them, the AR device can obtain the current location of the AR device through satellite navigation systems such as GPS (Global Positioning System, Global Positioning System), BDS (BeiDou Navigation Satellite System, China Beidou Satellite Navigation System), for example, the current location is "Shanghai Nanjing West Road" No. 1", the AR device search keywords include "No. 1 Nanjing West Road, Shanghai" and "Lotus Pond Moonlight", send a search request to the server, and the server returns the search result.

In this embodiment of the present invention, when it is detected that the image information of the current scene includes text, the AR device recognizes the text information that the text refers to; receives a font conversion instruction for the target text in the image information, and the font conversion instruction uses Instructing to convert the font of the target text in the image information into the target font; and according to the font conversion instruction and the target text information that the target text refers to, displaying the target font on the image information. The target text information can realize the font conversion of the text contained in the image information, help the user to recognize the text in the image information more clearly, and improve the user experience.

Please refer to FIG. 7. FIG. 7 is a schematic structural diagram of an AR device provided by an embodiment of the present invention. As shown in FIG. 8 , the AR device may include: a processing unit 710, a receiving unit 720, and a display unit 730, wherein:

a processing unit 710, configured to identify the text information referred to by the text when it is detected that the image information of the current scene includes text;

A receiving unit 720, configured to receive a font conversion instruction for the target text in the image information, where the font conversion instruction is used to instruct to convert the font of the target text in the image information into a target font;

The display unit 730 is configured to display the target text information in the target font on the image information according to the font conversion instruction and the target text information referred to by the target text.

Optionally, the processing unit 710 is further configured to: remove the target text in the image information;

The display unit 730 is further configured to: display the target text in the target font at the position corresponding to the target text in the image information according to the font conversion instruction and the target text information referred to by the target text information.

Optionally, the receiving unit 720 is further configured to: receive a font size setting instruction input for the target text in the image information, where the font size setting instruction is used to set the font size of the target text as the target font size;

The display unit 730 is further configured to: use the target font and the target font size on the image information according to the font conversion instruction, the font size setting instruction and the target text information referred to by the target text. The target text information is displayed.

Optionally, please refer to FIG. 8. FIG. 8 is a schematic structural diagram of another AR device provided by an embodiment of the present invention. In addition to the units shown in FIG. 7, the AR device described in FIG. 8 may further include:

A sending unit 740, configured to send a retrieval request to the server using the target text information as a keyword, so that the server returns a retrieval result after receiving the retrieval request;

The receiving unit 720 is further configured to: receive and display the retrieval result.

Optionally, the keyword further includes location information; the location information is the acquired current location; and the retrieval result is the information with the highest matching degree with the keyword among the retrieved information.

It should be noted that the functions of the processing unit 710 , the receiving unit 720 , the display unit 730 , and the sending unit 740 in the AR device in each embodiment of the present invention can be specifically implemented according to the methods in the above method embodiments, and the specific implementation process can refer to The relevant descriptions of the foregoing method embodiments are not repeated here.

Please refer to FIG. 9. FIG. 9 is a schematic structural diagram of another AR device provided by an embodiment of the present invention. The AR device is used to cooperate with the implementation of the above scheme. The AR device provided by the embodiments of the present invention can be used to implement the methods implemented by the embodiments of the present invention shown in FIG. 2 . For the convenience of description, only the parts related to the embodiments of the present invention are shown, and the specific technical details are not disclosed. , please refer to the various embodiments of the present invention shown in FIG. 2 . The AR device shown in FIG. 9 may include: a processor 901 and a memory 902 connected to the processor 901 , an input module 903 , an output module 904 and a communication module 905 , for example, the processor 901 may be connected to the memory 902 through a bus 906 , an input module 903, an output module 904, a communication module 905, and so on.

The input module 903 is used to realize the interaction between the user and the AR device and/or the input of information into the AR device. For example, the input module 903 may receive numerical or character information input by the user to generate signal input related to user setting or function control. In the specific embodiment of the present invention, the input module 903 may be a touch panel, or other human-computer interaction interfaces, such as physical input keys, a microphone, etc., or other external information capturing devices, such as a camera. A touch panel, also known as a touch screen or touch screen, collects the actions of a user touching or approaching it. For example, the user uses any suitable object or accessory, such as a finger, a stylus, or an operation action on the touch panel or a position close to the touch panel, and drives the corresponding connection device according to a preset program.

The output module 904 may include, but is not limited to, an image output unit, a sound output unit, and a tactile output unit. The video output unit is used to output text, pictures and/or videos. The image output unit may include a display panel. Although in FIG. 9, the input module 903 and the output module 904 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the input and output functions of the mobile terminal may be The touch panel is integrated with the display panel to realize the input and output functions of the mobile terminal.

The memory 902 can be used to store software programs and modules, and the processor 901 executes various functional applications of the AR device and implements data processing by running the software programs and modules stored in the memory 902 . The memory 902 mainly includes a program storage area and a data storage area, wherein the program storage area can store an operating system, an application program required for at least one function, such as a sound player program, an image player program, etc.; data (such as audio data, phone book, etc.) In a specific embodiment of the present invention, the memory 902 may include volatile memory, such as non-volatile dynamic random access memory (Nonvolatile RandomAccess Memory, NVRAM for short), phase change random access memory (Phase Change RAM, PRAM for short), Magnetoresistive random access memory (Magetoresistive RAM, MRAM for short), etc., may also include non-volatile memory, such as at least one disk storage device, Electronically Erasable Programmable Read-Only Memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM) ), flash memory devices such as NOR flash memory or NAND flash memory.

The communication module 905 is used for establishing a communication channel, enabling the AR device to connect to the communication peer through the communication channel, and to exchange data with the communication peer through the communication channel. The communication module 905 may include a wireless local area network (Wireless Local Area Network, wireless LAN for short) module, a Bluetooth module, a near field communication (Near Field Communication, NFC for short), a baseband (Base Band) module and other wireless communication modules and Ethernet. , Universal Serial Bus (Universal Serial Bus, USB for short), Lightning interface (Lightning, currently used by Apple for iPhone5/5s/5c and other devices) and other wired communication modules.

The processor 901 is the control center of the AR device, uses various interfaces and lines to connect various parts of the entire AR device, runs or executes the software programs and/or modules stored in the memory 902, and calls the data stored in the memory 902. , to do the following:

When it is detected that the image information of the current scene includes text, identifying the text information that the text refers to;

Receive a font conversion instruction for the target text in the image information through the input module 903, where the font conversion instruction is used to instruct to convert the font of the target text in the image information into the target font;

According to the font conversion instruction and the target text information referred to by the target text, the output module 904 displays the target text information in the target font on the image information.

Optionally, the processor 901 is further configured to execute:

removing the target text in the image information;

The processor 901 executes the text information referred to by the font conversion instruction and the target text, and displaying the target text information in the target font on the image information through the output module 904 includes:

According to the font conversion instruction and the target text information indicated by the target text, the output module 904 displays the target text information in the target font at the position corresponding to the target text in the image information.

Optionally, after the processor 901 performs the process of recognizing the text information referred to by the text when it is detected that the image information of the current scene includes text, the processor 901 is further configured to perform:

Receive, through the input module 903, a font size setting instruction input for the target text in the image information, where the font size setting instruction is used to set the font size of the target text as the target font size;

The processor 901 executes the text information referred to by the font conversion instruction and the target text, and displaying the target text information in the target font on the image information through the output module 904 includes:

According to the font conversion instruction, the font size setting instruction and the target text information indicated by the target text, the output module 904 displays the target text in the target font and the target font size on the image information information.

Optionally, the processor 901 executes the text information referred to according to the font conversion instruction and the target text, and after the output module 904 displays the target text information in the target font on the image information, the processor 901 is also used to perform:

Send a retrieval request to the server through the communication module 905 with the target text information as a keyword, so that the server returns a retrieval result after receiving the retrieval request;

The retrieval result is received and displayed through the communication module 905 .

Optionally, the keyword further includes location information; the location information is the acquired current location; and the retrieval result is the information with the highest matching degree with the keyword among the retrieved information.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. During execution, the processes of the embodiments of the above-mentioned methods may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM) or the like.

The above disclosure is only a preferred embodiment of the present invention, and of course, it cannot limit the scope of rights of the present invention. Those of ordinary skill in the art can understand that all or part of the process for realizing the above-mentioned embodiment can be realized according to the rights of the present invention. The equivalent changes required to be made still belong to the scope covered by the invention.

Claims (9)

1. An information display method applied to an AR device including an image sensor, the method comprising:

acquiring image information of a current scene through the image sensor, and detecting whether the image information of the current scene comprises characters or not;

when detecting that the image information of the current scene comprises characters, identifying the character information referred by the characters;

receiving a font conversion instruction for a target character in the image information, wherein the font conversion instruction is used for indicating that the font of the target character in the image information is converted into the target font, the font conversion comprises simplified conversion of the Chinese font, the character conversion instruction is generated by receiving a font conversion operation input by a user for the target character in the image information, or the character conversion instruction is generated by triggering after the AR equipment identifies character information referred by the character in the image information;

the target characters are all or part of the characters included in the image information, and the font conversion operation comprises the operation of selecting the target characters by a user in a display interface of the image information of the current scene and a target font in a font option pull-down menu in a menu bar;

displaying the target character information in the target font on the image information according to the font conversion instruction and the target character information referred by the target character, including: removing the target characters in the image information; rendering the background color of the image information to the region from which the target characters are removed; and displaying the target character information in the position corresponding to the target character in the image information by using the target font.

2. The method according to claim 1, wherein after identifying the text information to which the text refers when it is detected that the image information of the current scene includes the text, the method further comprises:

receiving a word size setting instruction input aiming at a target word in the image information, wherein the word size setting instruction is used for setting the word size of the target word as a target word size;

the displaying the target character information on the image information in the target font according to the font conversion instruction and the character information referred by the target character comprises:

and displaying the target character information on the image information according to the target font and the target character size according to the font conversion instruction, the character size setting instruction and the target character information referred by the target character.

3. The method according to claim 1, wherein after displaying the target text information in the target font on the image information according to the font conversion instruction and the text information to which the target text refers, the method further comprises:

sending a retrieval request to a server by taking the target character information as a keyword so that the server returns a retrieval result after receiving the retrieval request;

and receiving and displaying the retrieval result.

4. The method of claim 3, wherein the keywords further comprise location information; the position information is the acquired current position; and the retrieval result is the information with the highest matching degree with the keyword in the retrieved information.

5. An AR device, the AR device comprising an image sensor, comprising:

the processing unit is used for acquiring image information of a current scene through the image sensor, detecting whether characters are included in the image information of the current scene or not, and identifying character information indicated by the characters when the fact that the image information of the current scene includes the characters is detected;

a receiving unit, configured to receive a font conversion instruction for a target character in the image information, where the font conversion instruction is used to instruct to convert a font of the target character in the image information into the target font, where the font conversion includes a simplified conversion of a Chinese font, and the text conversion instruction is generated by receiving a font conversion operation input by a user for the target character in the image information, or is generated by triggering, by the AR device, text information indicated by the character in the image information after being identified;

the target characters are all or part of the characters included in the image information, and the font conversion operation comprises the operation of selecting the target characters by a user in a display interface of the image information of the current scene and a target font in a font option pull-down menu in a menu bar;

a display unit, configured to display, according to the font conversion instruction and target text information referred by the target text, the target text information in the target font on the image information, where the display unit includes: removing the target characters in the image information; rendering the background color of the image information to the region from which the target characters are removed; and displaying the target character information in the position corresponding to the target character in the image information by using the target font.

6. The AR device of claim 5,

the processing unit is further to: removing the target characters in the image information;

the display unit is further configured to: and displaying the target character information in the target font at the position corresponding to the target character in the image information according to the font conversion instruction and the target character information indicated by the target character.

7. The AR device of claim 5,

the receiving unit is further configured to: receiving a word size setting instruction input aiming at a target word in the image information, wherein the word size setting instruction is used for setting the word size of the target word as a target word size;

the display unit is further configured to: and displaying the target character information on the image information according to the target font and the target character size according to the font conversion instruction, the character size setting instruction and the target character information referred by the target character.

8. The AR device of claim 5, wherein the AR device further comprises:

the sending unit is used for sending a retrieval request to a server by taking the target character information as a keyword so that the server returns a retrieval result after receiving the retrieval request;

the receiving unit is further configured to: and receiving and displaying the retrieval result.

9. The AR device of claim 8, wherein the keyword further comprises location information; the position information is the acquired current position; and the retrieval result is the information with the highest matching degree with the keyword in the retrieved information.

Images