CN103680223A - Auxiliary reading equipment, auxiliary reading system and auxiliary reading method - Google Patents

Abstract

An auxiliary reading device, comprising a text image acquisition module, a text recognition module, a text-to-speech conversion module, and a first communication module connected in sequence; a text image acquisition module, used to acquire image information of reading content; a text recognition module, used to identify Text information in the image information; a text-to-speech conversion module, used to convert the text information into voice information; a first communication module, used to send the voice information. The above-mentioned auxiliary reading device adopts a portable text image acquisition module, a text recognition module, and a text-to-speech conversion module to quickly convert the text information of the reading content into voice information, and then send the voice information through the first communication module to assist reading. The reading speed is fast and the reading efficiency is high. The invention also provides an auxiliary reading system and an auxiliary reading method.

Description

Auxiliary reading device, auxiliary reading system and auxiliary reading method

technical field

The invention relates to the field of information technology, in particular to an auxiliary reading device, an auxiliary reading system and an auxiliary reading method.

Background technique

Traditional auxiliary reading devices, such as magnifying glasses, glasses and other optical devices, achieve the purpose of clear recognition by enlarging fonts, but this auxiliary reading device is only suitable for the visually impaired, and the reading speed is slow and the reading efficiency is low during use. With the development of science and technology, some books are scanned into e-books and displayed on computers, and some auxiliary reading software for computers emerges at the historic moment, such as audiobook software, font magnifiers, etc. However, these devices rely heavily on computers and networks, and readers cannot read various texts anytime and anywhere.

Contents of the invention

Based on this, it is necessary to provide an auxiliary reading device and an auxiliary reading system that has a fast reading speed, high reading efficiency and can perform real-time reading for the problems of slow reading speed, low reading efficiency, and incapable of real-time reading of traditional auxiliary reading devices.

In addition, an auxiliary reading method is also provided.

An auxiliary reading device, comprising a sequentially connected text image acquisition module, a text recognition module, a text-to-speech conversion module, and a first communication module; the text image acquisition module is used to acquire image information of reading content; the text recognition module , used to identify text information in the image information; the text-to-speech conversion module is used to convert the text information into voice information; the first communication module is used to send the voice information.

In one of the embodiments, the first communication module includes at least one of a human body communication module, a Bluetooth module, a Zigbee module, a WiFi module, and an RFID module; the human body communication module is used for communicating with the human body as a medium, sending the voice information.

In one of the embodiments, the first communication module includes a human body communication module, and the human body communication module includes a human body communication transceiver, a communication interface and electrodes; the text-to-speech conversion module and the human body communication transceiver pass through the The communication interface is connected, the human body communication transceiver is connected with the electrodes, and the human body communication transceiver is used to receive the voice information transmitted by the text-to-speech conversion module, and send the voice information through the electrodes.

An auxiliary reading system, including an auxiliary reading device and a receiving device; the auxiliary reading device includes a character image acquisition module, a character recognition module, a text-to-speech conversion module and a first communication module connected in sequence;

The text image acquisition module is used to acquire the image information of the reading content;

The character recognition module is used to recognize text information in the image information;

The text-to-speech conversion module is used to convert the text information into voice information;

The first communication module is configured to send the voice information;

The receiving device is configured to receive and play the voice information sent by the first communication module.

In one of the embodiments, the receiving device includes a playback interface and a second communication module capable of communicating with the first communication module, the second communication module is used to receive the voice information sent by the first communication module , the playback interface is used to play the voice information.

In one of the embodiments, both the first communication module and the second communication module include at least one of a human body communication module, a Bluetooth module, a Zigbee module, a WiFi module, and an RFID module; The voice information is sent for medium communication.

In one of the embodiments, both the first communication module and the second communication module include a human body communication module, and the human body communication module includes a human body communication transceiver, a communication interface and electrodes, and the human body communication transceiver is respectively connected to the The communication interface is connected to the electrodes;

The human body communication transceiver of the first communication module is connected to the text-to-speech conversion module through the communication interface, and the human body communication transceiver of the first communication module is used to receive the voice information transmitted by the text-to-speech conversion module, and sending the voice information through the electrodes;

The human body communication transceiver of the second communication module is used to receive the voice information, and transmit the voice information to the playback interface.

In one of the embodiments, the playback interface is a cochlear interface or an earphone interface.

A reading aid method, comprising the following steps:

Obtain the image information of the reading content;

identifying text information in the image information;

converting said text information into voice information;

send said voice message; and

The voice information is received and played.

In one of the embodiments, the step of sending the voice information includes:

The voice information is sent through at least one of a human body communication module, a bluetooth module, a Zigbee module, a WiFi module and an RFID module.

In one of the embodiments, the sending the voice information through the human body communication module includes:

Using the human body as a communication medium, transmitting the voice information in the human body;

The step of receiving the voice information and playing it comprises:

Receive and play the voice information transmitted in the human body.

The above-mentioned auxiliary reading device, auxiliary reading system and auxiliary reading method adopt a portable text image acquisition module, a text recognition module, and a text-to-speech conversion module to quickly convert the text information of the reading content into voice information, and then through the first communication module, Send voice information to assist in reading, with fast reading speed and high reading efficiency. And through the receiving device, receiving the voice information sent by the first communication module can help the handicapped readers to recognize and understand.

Description of drawings

FIG. 1 is a schematic structural view of an auxiliary reading device according to an embodiment;

Fig. 2 is a schematic structural diagram of an assisted reading system in an embodiment;

Fig. 3 is a flow chart of an assisted reading method in an embodiment.

Detailed ways

In order to make the above objects, features and advantages of the present invention more comprehensible, specific implementations of the present invention will be described in detail below in conjunction with the accompanying drawings. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, the present invention can be implemented in many other ways different from those described here, and those skilled in the art can make similar improvements without departing from the connotation of the present invention, so the present invention is not limited by the specific implementations disclosed below.

Please refer to FIG. 1 , an auxiliary reading device 10 according to an embodiment includes a text and image acquisition module 110 , a text recognition module 120 , a text-to-speech conversion module 130 and a first communication module 140 connected in sequence.

Wherein, the character image acquisition module 110 is used to acquire image information of the reading content.

Specifically, the character image acquisition module 110 includes an image sensor 112 and a light source 114 . The image sensor 112 is connected to the character recognition module 120, and acquires the image information of the reading content by means of photographing and inputting. The image sensor 112 may be a CCD (Charge Couple Device, charge coupled device) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor, metal oxide semiconductor element) image sensor. The image sensor 112 can use image acquisition devices such as cameras, industrial cameras, digital cameras, and video cameras. The light source 114 is an LED (Light-Emitting Diode, light emitting diode) or an incandescent lamp or a fluorescent lamp.

The character recognition module 120 is configured to recognize text information in the above image information.

Specifically, the character recognition module 120 uses character recognition software, such as OCR (Optical Character Recognition, optical character recognition), to recognize the text information in the above image information. In other embodiments, other software can be used for character recognition.

It can be understood that the above identified text information is meaningful to the overall text.

The text-to-speech conversion module 130 is configured to convert the above text information into voice information.

Specifically, the text-to-speech conversion module 130 uses text-to-speech software TTS (Text-To-Speech) or self-recorded voice clips to convert the above text information into voice information.

The first communication module 140 is configured to send the above voice information.

In this embodiment, the first communication module 140 includes a human body communication module 142 . The body communication module 142 includes a body communication transceiver 1402 , a communication interface 1404 and electrodes 1406 . The text-to-speech conversion module 130 is connected to the human body communication transceiver 1402 through a communication interface 1404 . The body communication transceiver 1402 is connected to the electrodes 1406 . The human body communication transceiver 1402 is used to receive the voice information transmitted by the text-to-speech conversion module 130 and send the voice information through the electrodes 1406 .

Wherein, the electrode 1406 may be in the shape of a handle, which is convenient to hold and carry out human body communication.

It can be understood that, in other implementation manners, the first communication module 140 may also include at least one of a human body communication module, a Bluetooth module, a Zigbee module, a WiFi module and an RFID module.

The above-mentioned auxiliary reading device adopts a portable text image acquisition module, a text recognition module, and a text-to-speech conversion module to quickly convert the text information of the reading content into voice information, and then send the voice information through the first communication module to assist reading. .

In addition, it adopts human body communication, Bluetooth, Zigbee, WiFi, RFID and other near-end communication modes, which have the advantages of low power consumption, good confidentiality, and high communication bandwidth. Readers can read anytime and anywhere without the need for computers or the Internet. In addition, through the first communication module, the auxiliary reader can read information such as barcodes, and download and read multimedia.

Please refer to FIG. 2 , an auxiliary reading system 20 of an embodiment includes an auxiliary reading device 210 and a receiving device 220 .

Wherein, the auxiliary reading device 210 includes a text and image acquisition module 212 , a text recognition module 214 , a text-to-speech conversion module 216 and a first communication module 218 which are sequentially connected.

Specifically, the character image acquisition module 212 includes an image sensor 2102 and a light source 2104 . The image sensor 2102 is connected with the character recognition module 214, and acquires the image information of the reading content by means of photographing and inputting. The image sensor 2102 may adopt a CCD image sensor or a CMOS image sensor. The image sensor 2102 can use image acquisition devices such as cameras, industrial cameras, digital cameras, and video cameras. The light source 2104 is an LED.

The character recognition module 214 is configured to recognize text information in the above image information.

Specifically, the character recognition module 214 uses character recognition software, such as OCR, to recognize the text information in the above image information.

It can be understood that the above identified text information is meaningful to the overall text.

The text-to-speech conversion module 216 is configured to convert the above text information into voice information.

Specifically, the text-to-speech conversion module 216 uses speech synthesis software TTS or a self-recorded speech segment to convert the above text information into speech information.

The first communication module 218 is configured to send the above voice information.

In this embodiment, the first communication module 218 includes a human body communication module 2180 . The body communication module 2180 includes a body communication transceiver 2182 , a communication interface 2184 and electrodes 2186 . The text-to-speech conversion module 216 is connected to the human body communication transceiver 2182 through a communication interface 2184 . The body communication transceiver 2182 is connected to the electrodes 2186 . The human body communication transceiver 2182 is used to receive the voice information transmitted by the text-to-speech conversion module 216 and send the voice information through the electrodes 2186 .

Wherein, the electrode 2186 can be in the shape of a handle, which is convenient to hold and carry out human body communication.

It can be understood that, in other implementation manners, the first communication module may also include at least one of a human body communication module, a Bluetooth module, a Zigbee module, a WiFi module and an RFID module.

The receiving device 220 includes a playback interface 222 and a second communication module 224 capable of communicating with the above-mentioned first communication module 218 . The second communication module 224 is configured to receive the voice information sent by the above-mentioned first communication module 218 . The playback interface 222 is used to play the above-mentioned voice information.

In this embodiment, the second communication module 224 includes a human body communication module 2240 . The body communication module 2240 includes a body communication transceiver 2242 , a communication interface 2244 and electrodes 2246 . The human body communication transceiver 2242 is connected to the communication interface 2244 and the electrodes 2246 respectively. The human body communication transceiver 2242 of the second communication module 224 is used to receive the above-mentioned voice information, and transmit the voice information to the playback interface 222 .

It can be understood that, in other implementation manners, the second communication module may also include at least one of a human body communication module, a Bluetooth module, a Zigbee module, a WiFi module and an RFID module.

The above-mentioned assisted reading system uses a portable text image acquisition module, a text recognition module, and a text-to-speech conversion module to quickly convert the text information of the reading content into voice information, and then send the voice information through the first communication module to assist reading. . Then through the receiving device, the voice information sent by the first communication module can be received, which can help the handicapped readers to recognize and understand.

In addition, it adopts human body communication, Bluetooth, Zigbee, WiFi, RFID and other near-end communication modes, which have the advantages of low power consumption, good confidentiality, and high communication bandwidth. Readers can read anytime and anywhere without the need for computers or the Internet.

Please refer to Fig. 3, an assisted reading method of an embodiment, comprising the following steps:

S310. Acquire image information of the read content.

S320. Identify text information in the image information.

S330. Convert the text information into voice information.

S340. Send the voice information.

Specifically, the step of sending the voice information includes: sending the voice information through at least one of a human body communication module, a Bluetooth module, a zigbee module, a WiFi module and an RFID module.

Preferably, sending the voice information through the human body communication module includes: using the human body as a communication medium, and propagating the voice information in the human body.

S350. Receive and play the voice information.

Preferably, the step of receiving and playing the voice information includes: receiving and playing the voice information propagating in the human body.

The above-mentioned assisted reading method converts text information into voice information, and then sends the voice information to the corresponding receiving device for receiving and playing through human body communication, Bluetooth, Zigbee, WiFi, RFID and other near-end communication modes. The reading speed is fast and the reading efficiency is high. . Readers can read anytime and anywhere without the need for computers or the Internet.

The above-mentioned embodiments only express several implementation modes of the present invention, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present invention. It should be pointed out that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent for the present invention should be based on the appended claims.

Claims (11)

1. an aid reading equipment, is characterized in that, comprises successively connected character image acquisition module, word identification module, text-to-speech modular converter and first communication module; Described character image acquisition module, for obtaining the image information of reading content; Described word identification module, for identifying the text message of described image information; Described text-to-speech modular converter, for being converted to voice messaging by described text message; Described first communication module, for sending described voice messaging.

2. aid reading equipment as claimed in claim 1, is characterized in that, described first communication module comprises at least one in human body communication module, bluetooth module, zigbee module, WiFi module and RFID module; Described human body communication module, for take human body as medium communicates, sends described voice messaging.

3. aid reading equipment as claimed in claim 1, is characterized in that, described first communication module comprises human body communication module, and described human body communication module comprises human body communication transceiver, communication interface and electrode; Described text-to-speech modular converter is connected by described communication interface with described human body communication transceiver, described human body communication transceiver is connected with described electrode, the voice messaging that described human body communication transceiver transmits for receiving described text-to-speech modular converter, and described voice messaging is sent by described electrode.

4. an aid reading system, is characterized in that, comprises aid reading equipment and receiving equipment; Described aid reading equipment comprises successively connected character image acquisition module, word identification module, text-to-speech modular converter and first communication module:

Described character image acquisition module, for obtaining the image information of reading content;

Described word identification module, for identifying the text message of described image information;

Described text-to-speech modular converter, for being converted to voice messaging by described text message;

Described first communication module, for sending described voice messaging;

Described receiving equipment, the described voice messaging sending for receiving described first communication module, and play.

5. aid reading system as claimed in claim 4, it is characterized in that, described receiving equipment comprises playback interface and the second communication module that can communicate by letter mutually with described first communication module, the voice messaging that described second communication module sends for receiving described first communication module, described playback interface is used for playing described voice messaging.

6. aid reading system as claimed in claim 5, is characterized in that, described first communication module and second communication module include at least one in human body communication module, bluetooth module, zigbee module, WiFi module and RFID module; Described human body communication module, for take human body as medium communicates, sends described voice messaging.

7. aid reading system as claimed in claim 5, it is characterized in that, described first communication module and second communication module include human body communication module, described human body communication module comprises human body communication transceiver, communication interface and electrode, and described human body communication transceiver is connected with electrode with described communication interface respectively;

The human body communication transceiver of described first communication module is connected with described text-to-speech modular converter by described communication interface, the voice messaging that the human body communication transceiver of described first communication module transmits for receiving described text-to-speech modular converter, and described voice messaging is sent by described electrode;

The human body communication transceiver of described second communication module is used for receiving described voice messaging, and described voice messaging is passed to described playback interface.

8. aid reading system as claimed in claim 5, is characterized in that, described playback interface is cochlear implant interface or earphone interface.

9. an aid reading method, comprises the following steps:

Obtain the image information of reading content;

Identify the text message in described image information;

Described text message is converted to voice messaging;

Send described voice messaging; And

Receive described voice messaging and play.

10. aid reading method as claimed in claim 9, is characterized in that, the step that sends described voice messaging comprises:

By at least one in human body communication module, bluetooth module, zigbee module, WiFi module and RFID module, send described voice messaging.

11. aid reading methods as claimed in claim 10, is characterized in that, describedly by human body communication module, send described voice messaging and comprise:

Take human body as communication media, described voice messaging is propagated at human body;

The described voice messaging of described reception the step of playing comprise:

Be received in the voice messaging that human body is propagated, and play.

Images