CN105050034A

CN105050034A - Method, device and system for implementing voice service based on Bluetooth connection

Info

Publication number: CN105050034A
Application number: CN201510528318.1A
Authority: CN
Inventors: 王阳; 姜史哲; 杨杰; 高越松; 哈达; 陈本东; 宋治云; 张钊
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2015-08-25
Filing date: 2015-08-25
Publication date: 2015-11-11
Anticipated expiration: 2035-08-25
Also published as: CN105050034B

Abstract

The invention provides a method, a device and a system for implementing voice service based on Bluetooth connection. The method comprises the following steps of: building link layer connection with a Bluetooth device, wherein the link layer connection comprises a private wireless link and a Bluetooth standard link; through the link layer connection, receiving information sent by the Bluetooth device, wherein the information comprises voice service information, and/or Internet of Thins control information; performing data layer, service layer and application layer processing on the information to obtain the processed information; and sending the processed information to the Bluetooth device through the link layer connection to provide corresponding service to the Bluetooth device. The method can realize intelligentization of the Bluetooth device.

Description

Voice service implementation method, device and system based on Bluetooth connection

Technical Field

The invention relates to the technical field of voice service, in particular to a method, a device and a system for realizing voice service based on Bluetooth connection.

Background

At present, the number of peripheral electronic devices in wireless connection is huge, most of the peripheral electronic devices have voice functions, and the voice functions comprise recording by a microphone and playing voice by an earphone or a loudspeaker. One type of peripheral electronic device with voice functionality is a bluetooth-based audio device, such as a bluetooth headset, a bluetooth speaker, an in-vehicle bluetooth hands-free device, and the like.

However, at present, such bluetooth devices cannot be bound with specific software, and basically belong to "non-intelligent devices", and the non-intelligent devices refer to products whose hardware includes all functions provided by the hardware, and have no software value-added service.

Disclosure of Invention

The present invention is directed to solving, at least to some extent, one of the technical problems in the related art.

Therefore, an object of the present invention is to provide a method for implementing a voice service based on bluetooth connection, which can implement the intelligence of a bluetooth device.

Another object of the present invention is to provide a voice service implementing device based on bluetooth connection.

Another objective of the present invention is to provide a voice service implementation system based on bluetooth connection.

In order to achieve the above object, an embodiment of the first aspect of the present invention provides a method for implementing a voice service based on bluetooth connection, including: establishing a link layer connection with a Bluetooth device, the link layer connection comprising: a private wireless link and a bluetooth standard link; receiving information sent by the Bluetooth equipment through the link layer connection, wherein the information comprises: voice service information, and/or internet of things control information; processing the information by a data layer, a service layer and an application layer to obtain processed information; and sending the processed information to Bluetooth equipment through the link layer connection so as to provide corresponding service for the Bluetooth equipment.

In the method for implementing a voice service based on bluetooth connection according to the first aspect of the present invention, by establishing a private wireless link, it is possible to implement interaction between a bluetooth device and a specific voice service program on a gateway device, and bind the bluetooth device and the specific voice service program, so that the specific voice service program can provide a voice service for the bound bluetooth device, thereby implementing intellectualization of the bluetooth device. In addition, when the voice service program and the Bluetooth equipment interact the control information of the Internet of things, the Internet of things between the voice service program and the Bluetooth equipment or between the Bluetooth equipment can be realized.

In order to achieve the above object, an embodiment of a second aspect of the present invention provides a method for implementing a voice service based on bluetooth connection, including: establishing a link layer connection with a preset voice service program on the gateway equipment, wherein the link layer connection comprises: a private wireless link and a bluetooth standard link; carrying out data layer processing on the acquired information to obtain information to be sent, wherein the information to be sent comprises: voice service information, and/or internet of things control information; sending information to be sent to a voice service program through the link layer connection, and receiving feedback information sent by a preset voice service program through the link layer connection, wherein the feedback information is obtained after the preset voice service program processes the information to be sent; and feeding back the feedback information to the user through a human-computer interaction layer of the Bluetooth equipment.

The method for implementing the voice service based on the bluetooth connection according to the embodiment of the second aspect of the present invention can implement interaction between the bluetooth device and the specific voice service program on the gateway device by establishing the private wireless link, and bind the bluetooth device and the specific voice service program, so that the specific voice service program can provide the voice service for the bound bluetooth device, thereby implementing intellectualization of the bluetooth device. In addition, when the voice service program and the Bluetooth equipment interact the control information of the Internet of things, the Internet of things between the voice service program and the Bluetooth equipment or between the Bluetooth equipment can be realized.

In order to achieve the above object, a voice service implementation apparatus based on bluetooth connection according to a third aspect of the present invention includes: a connection module, configured to establish a link layer connection with a bluetooth device, where the link layer connection includes: a private wireless link and a bluetooth standard link; a transmission module, configured to connect through the link layer and receive information sent by a bluetooth device, where the information includes: voice service information, and/or internet of things control information; the processing module is used for processing the information by a data layer, a service layer and an application layer to obtain processed information; and the feedback module is used for sending the processed information to the Bluetooth equipment through the link layer connection so as to provide corresponding service for the Bluetooth equipment.

The voice service implementation apparatus based on bluetooth connection according to the third aspect of the present invention may implement interaction between a bluetooth device and a specific voice service program on a gateway device by establishing a private wireless link, and bind the bluetooth device and the specific voice service program, so that the specific voice service program may provide a voice service for the bound bluetooth device, thereby implementing intellectualization of the bluetooth device. In addition, when the voice service program and the Bluetooth equipment interact the control information of the Internet of things, the Internet of things between the voice service program and the Bluetooth equipment or between the Bluetooth equipment can be realized.

In order to achieve the above object, a voice service implementation device based on bluetooth connection according to a fourth aspect of the present invention includes: a connection module, configured to establish a link layer connection with a preset voice service program on a gateway device, where the link layer connection includes: a private wireless link and a bluetooth standard link; a processing module, configured to perform data layer processing on the acquired information to obtain information to be sent, where the information to be sent includes: voice service information, and/or internet of things control information; the transmission module is used for transmitting information to be transmitted to the voice service program through the link layer connection and receiving feedback information transmitted by a preset voice service program through the link layer connection, wherein the feedback information is obtained after the preset voice service program processes the information to be transmitted; and the human-computer interaction module is used for feeding the feedback information back to the user through a human-computer interaction layer of the Bluetooth equipment.

The voice service implementation apparatus based on bluetooth connection according to the fourth aspect of the present invention may implement interaction between a bluetooth device and a specific voice service program on a gateway device by establishing a private wireless link, and bind the bluetooth device and the specific voice service program, so that the specific voice service program may provide voice service for the bound bluetooth device, thereby implementing intellectualization of the bluetooth device. In addition, when the voice service program and the Bluetooth equipment interact the control information of the Internet of things, the Internet of things between the voice service program and the Bluetooth equipment or between the Bluetooth equipment can be realized.

In order to achieve the above object, a voice service implementation system based on bluetooth connection according to an embodiment of a fifth aspect of the present invention includes: the device provided by the embodiment of the third aspect of the invention and the device provided by the embodiment of the fourth aspect of the invention.

The voice service implementation system based on bluetooth connection according to the fifth aspect of the present invention can implement interaction between the bluetooth device and the specific voice service program on the gateway device by establishing the private wireless link, and bind the bluetooth device and the specific voice service program, so that the specific voice service program can provide voice service for the bound bluetooth device, thereby implementing intellectualization of the bluetooth device. In addition, when the voice service program and the Bluetooth equipment interact the control information of the Internet of things, the Internet of things between the voice service program and the Bluetooth equipment or between the Bluetooth equipment can be realized.

Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.

Drawings

The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a flowchart illustrating a method for implementing a voice service based on a bluetooth connection according to an embodiment of the present invention;

fig. 2 is a schematic diagram of a protocol framework on the gateway device side in the embodiment of the present invention;

fig. 3 is a flowchart illustrating a method for implementing a voice service based on bluetooth connection according to another embodiment of the present invention;

fig. 4 is a schematic diagram of a protocol framework on the gateway device side in the embodiment of the present invention;

fig. 5 is a flowchart illustrating a method for implementing a voice service based on bluetooth device connection according to another embodiment of the present invention;

fig. 6 is a schematic structural diagram of a voice service implementation apparatus based on bluetooth device connection according to another embodiment of the present invention;

fig. 7 is a schematic structural diagram of a voice service implementation apparatus based on bluetooth device connection according to another embodiment of the present invention;

fig. 8 is a schematic structural diagram of a voice service implementation apparatus based on bluetooth device connection according to another embodiment of the present invention;

fig. 9 is a schematic structural diagram of a voice service implementation apparatus based on bluetooth device connection according to another embodiment of the present invention;

fig. 10 is a schematic structural diagram of a voice service implementation system based on bluetooth device connection according to another embodiment of the present invention.

Detailed Description

Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar modules or modules having the same or similar functionality throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention. On the contrary, the embodiments of the invention include all changes, modifications and equivalents coming within the spirit and terms of the claims appended hereto.

Fig. 1 is a schematic flowchart of a method for implementing a voice service based on bluetooth connection according to an embodiment of the present invention, which is implemented by a gateway device as an example. The method comprises the following steps:

s11: establishing a link layer connection with a bluetooth device, the link layer connection comprising: a private wireless link connection and a bluetooth standard link connection.

For example, private wireless links can be divided into: a private control link and a private audio link, and the bluetooth standard link can be divided into: a Synchronous Connection Oriented (SCO) link and a bluetooth audio distribution profile (A2 DP) link for playing music.

The private audio link is used for transmitting voice data to be recognized and corresponding voice recognition results between the Bluetooth device and the voice service program. The SCO link is used to transmit speech data to be recognized and corresponding speech recognition results, and the A2DP link is used to transmit music audio data.

It is to be understood that the private wireless links may not be distinguished, and that both the control instructions and the voice data may be transmitted in the same private wireless link. In addition, when the private control links are distinguished, different control instructions can be transmitted in the same private control link, and different control instructions can also be transmitted in different private control links.

In the case of the private wireless link and the bluetooth standard link as shown above, the protocol framework of the gateway device (e.g., a handset) includes, as shown in fig. 2: the link layer may specifically include: a private control link module, a private audio link module, an SCO link module, and an A2DP link module.

The private control link module is used for establishing a private control link between the Bluetooth device and a preset voice service program on the gateway device, and the private control link is used for transmitting a control instruction of interaction between the Bluetooth device and the preset voice service program. The control instructions include, for example: instructions, voice recognition customized information, internet of things sensor data and the like in the process of establishing and controlling the audio link. The private control link adopts RFCOMM or SPP connection similar to serial port communication, which can ensure that the Bluetooth device only interacts with the preset voice service program and can not be hijacked by other application programs.

The private audio link module is used for establishing a private audio link between the Bluetooth device and a preset voice service program on the gateway device, and the private audio link is used for audio data interacted between the Bluetooth device and the preset voice service program. The audio data includes, for example: and voice data to be recognized and a corresponding voice recognition result, so that the transmission of audio uplink/downlink data is realized. The link uses RFCOMM or SPP connections similar to serial port communication.

In addition, the private audio link may use an asynchronous mode with an error retransmission mechanism. Compared with an SCO audio link based on synchronous transmission in the Bluetooth standard, the method has the advantages that the voice instruction is uploaded (to the gateway) by using the private asynchronous link, and the stable transmission of the voice can be exchanged by more error retransmission times when the signal is unstable and the packet loss is frequent, so that the voice recognition rate is improved. Compared with a music playing A2DP/AVRCP protocol in the Bluetooth standard, the method reduces the coupling between the protocols, has better compatibility in practical application, and can avoid music false triggering caused by improper AVRCP instruction processing. Meanwhile, the private audio link and the SCO link can coexist, so that voice recognition and broadcasting can be performed when people make calls (in the states of incoming call ringing, conversation, external call and the like), and the application scene of voice services is expanded.

The SCO link module is used to establish a SCO link, which is generally used as a wireless audio link during a call and can also be used for transmission of uplink/downlink voice data in a voice service. The SCO link may be implemented using the bluetooth standard audio protocol.

The A2DP link module is used to establish the A2DP link, and the A2DP link is generally used as a wireless audio link for the gateway to push a unidirectional audio stream to the bluetooth terminal when listening to music, and can also be used for the transmission of downlink voice data in voice service. The A2DP link may be implemented using the bluetooth standard audio protocol.

S12: receiving information sent by the Bluetooth equipment through the link layer connection, wherein the information comprises: voice service information, and/or internet of things control information.

Wherein, the voice service information comprises: voice data to be recognized and/or scene information of the Bluetooth device.

The voice data to be recognized can be transmitted through a private wireless link or an SCO link, and the scene information and the control information of the Internet of things can be transmitted through the private wireless link.

The bluetooth standard audio protocol does not involve scene information, and therefore, voice customization cannot be realized.

In the embodiment, the voice customization can be realized through the scene information. Voice service customization is a basic requirement for the differential design of intelligent devices. It is easy to understand that the user instructions faced by a vehicle-mounted hands-free Bluetooth device loaded in a vehicle are mainly related to navigation and routes; and a bluetooth speaker fixedly placed in the living room faces a user instruction, and music playing is more likely to be faced. Similarly, for route navigation, an onboard bluetooth hands-free device can inquire driving routes by default after receiving the inquiry of a user, and a bluetooth headset needs to judge whether the user intends to walk, ride public transport or drive. These all require voice service customization.

In addition, the internet of things is not supported in the bluetooth standard audio protocol, and in the embodiment, after the private wireless link is established, the internet of things control information can be transmitted through the private wireless link, so that the internet of things between the bluetooth device and the preset voice service program and between the bluetooth device is established.

S13: and processing the information by a data layer, a service layer and an application layer to obtain the processed information.

Wherein the data layer processing may include at least one of:

audio stream management, voice signal processing, voice recognition information management, internet of things information management, service discovery, authentication and equipment management.

Correspondingly, referring to fig. 2, the protocol framework on the gateway side further includes: a data layer, the data layer comprising: the system comprises an audio stream management module, a voice signal processing module, a voice recognition information management module, an internet of things information management module, a service discovery module and an authentication and equipment management module.

The audio stream management module is used for audio stream management and has the following functions: the method comprises the steps of carrying out coding and decoding operations on transmitted and received audio data, managing each audio link, providing a uniform audio interface for an upper layer, and selecting, establishing and maintaining a proper audio link when the upper layer calls.

The voice signal processing module is used for processing voice signals and is responsible for carrying out various preprocessing operations on voice data to be recognized, such as echo cancellation, adaptive volume control, vehicle-mounted noise cancellation, wind noise cancellation, microphone array voice enhancement and the like.

The voice recognition information management module is used for managing voice recognition information, is responsible for collecting and managing various scene information in the Bluetooth terminal equipment and user behaviors, and is used as input information of service customization processing such as voice recognition, voice broadcasting and the like.

The internet of things information management module is used for internet of things information management and is responsible for collecting and managing internet of things control related information such as various sensors and controllers on the Bluetooth terminal equipment. The information is transmitted to the upper layer through the private control/data link of the link layer, and is reported to the application layer (gateway side) and the man-machine interaction layer (Bluetooth terminal side) after being processed by the module.

The service discovery module is used for service discovery, defines a set of service discovery interaction flow and corresponding data format, is used for discovering device capabilities among different Bluetooth terminal devices and gateway programs and can be used for backward compatible extension.

The authentication and equipment management module is used for authentication and equipment management, and defines a set of authentication method for confirming the legality of the Bluetooth terminal equipment/gateway equipment accessing the service. Meanwhile, the module is responsible for managing the equipment, such as online upgrading of the equipment, online statistical analysis of the equipment and the like.

The service layer processing includes at least one of:

and acquiring information from the voice technology platform and acquiring information through a third-party service interface.

The application layer processing comprises the following steps: and determining an application scene according to the scene information sent by the Bluetooth device through the private wireless link.

For example, referring to fig. 2, the protocol framework on the gateway side further includes: the service layer comprises: a voice technology platform and a third party service interface. The application layer includes a plurality of application scenarios. The voice technology platform provides various technologies required by voice services, including but not limited to voice recognition, semantic understanding, voice synthesis, deep question answering, voiceprint recognition, and the like. The third-party service interface is used for providing various non-voice basic technical services required by the user in various scenes. For example, in a road asking scene, a user needs to use a map and navigation services; in a song listening scenario, the user needs a music service, etc. An application scenario is a collection of services, interactions, based on user needs. The gateway-side program functions are composed of a plurality of application scenarios. And cutting different application scene sets to obtain the realization of different gateway side programs, thereby realizing the customization of the service.

S14: and sending the processed information to Bluetooth equipment through the link layer connection so as to provide corresponding service for the Bluetooth equipment.

For example, after the preset voice service program processes the voice service information, such as the current weather condition of beijing obtained according to the voice data "beijing weather", the current weather condition of beijing may be sent to the bluetooth device through the link layer connection, so as to provide the voice service to the bluetooth device. Or,

for example, after the preset voice service program processes the internet of things control information, the processing result is sent to the bluetooth device through the link layer connection, so that the internet of things service is provided for the bluetooth device.

Accordingly, the process executed by the bluetooth device can be referred to fig. 3, fig. 3 is a schematic flowchart of a method for implementing a voice service based on bluetooth connection according to another embodiment of the present invention, and this embodiment is implemented by the bluetooth device as an example. The method comprises the following steps:

s31: establishing a link layer connection with a preset voice service program on the gateway equipment, wherein the link layer connection comprises: private wireless links and bluetooth standard links.

For example, private wireless links can be divided into: a private control link and a private audio link, and the bluetooth standard link can be divided into: a Synchronous Connection Oriented (SCO) link and a bluetooth audio transmission model profile (A2 DP) link that plays music.

In the case of the private wireless link and the bluetooth standard link as shown above, as shown in fig. 4, the protocol framework of the bluetooth device includes: the link layer may specifically include: a private control link module, a private audio link module, an SCO link module, and an A2DP link module.

The link layer of the bluetooth device is consistent with the link layer of the gateway device, and specific functions of each module of the link layer may be referred to the related description of the gateway side.

S32: carrying out data layer processing on the acquired information to obtain information to be sent, wherein the information to be sent comprises: voice service information, and/or internet of things control information.

Wherein the data layer processing may include at least one of:

Accordingly, referring to fig. 4, the protocol framework of the bluetooth device further includes: a data layer, the data layer comprising: the system comprises an audio stream management module, a voice signal processing module, a voice recognition information management module, an internet of things information management module, a service discovery module and an authentication and equipment management module.

The link layer of the bluetooth device is consistent with the data layer of the gateway device, and the specific functions of each module of the data layer may be referred to the related description of the gateway side.

In addition, the present embodiment may further include:

processing and collecting information through a human-computer interaction layer, wherein the human-computer interaction layer processing comprises at least one of the following items:

key interaction management, display interaction management, audio interaction management and sensor interaction management.

For example, referring to fig. 4, the bluetooth device further includes: the human-computer interaction layer, the human-computer interaction layer includes: the device comprises a key interaction management module, a display interaction management module, an audio interaction management module and a sensor interaction management module. For example, the key interaction management module is used for the bluetooth device to learn the operation generated by the user through the key, for example, the user triggers voice recognition, the user ends voice input, and the like. The display interaction management module is used for displaying the result to the user through a display, for example, a route map of the voice recognition result is displayed to the user through an LED. The audio interaction management module is configured to perform audio interaction with a user, for example, obtain information input by the user in an audio manner, for example, voice data to be recognized input by the user in a voice mode, or play a prompt tone to the user, or play a voice recognition result to the user. The sensor interaction management module is used for acquiring sensor information, and the sensor information comprises internet of things control information, so that the internet of things is established between the Bluetooth equipment and the voice service program or the Bluetooth equipment.

The man-machine interaction layer of the Bluetooth device corresponds to the service layer and the application layer of the gateway device.

S33: and sending the information to be sent to a preset voice service program through the link layer connection, and receiving feedback information sent by the preset voice service program through the link layer connection, wherein the feedback information is obtained after the preset voice service program processes the information to be sent.

After the Bluetooth device acquires the information, the information can be sent to a preset voice service program through link layer connection. For example, voice data, scene information, and internet of things control information may be transmitted through a private wireless link, or voice data may also be transmitted through an SCO link.

In addition, after receiving the information sent by the bluetooth device, the preset voice service program can perform data layer processing on the received information, and send the processing result as feedback information to the bluetooth device through link layer connection. For example, the preset voice service program performs voice recognition processing or internet of things control processing, and the specific content may refer to the above embodiment, which is not described herein again.

S34: and feeding back the feedback information to the user through a human-computer interaction layer of the Bluetooth equipment.

For example, after receiving feedback information sent by a preset voice service program, the bluetooth device may feedback to the user in a corresponding interactive manner according to the type of the feedback information, for example, if the feedback information received by the bluetooth device is a navigation route map, the bluetooth device may display the navigation route map to the user in an LED form through processing by the display interaction management module of the man-machine interaction layer, or if the feedback information received by the bluetooth device is voice broadcast, the bluetooth device may play the voice broadcast to the user in a voice form through processing by the audio interaction management module of the man-machine interaction layer.

In this embodiment, by establishing the private wireless link, it is possible to implement interaction between the bluetooth device and the specific voice service program on the gateway device, and bind the bluetooth device and the specific voice service program, so that the specific voice service program can provide voice service for the bound bluetooth device, thereby implementing intellectualization of the bluetooth device. In addition, when the voice service program and the Bluetooth equipment interact the control information of the Internet of things, the Internet of things between the voice service program and the Bluetooth equipment or between the Bluetooth equipment can be realized.

Fig. 5 is a flowchart illustrating a method for implementing a voice service based on bluetooth device connection according to another embodiment of the present invention, where the embodiment takes the bluetooth device and a predetermined voice service program to establish a private wireless link and provide a voice service as an example. The method comprises the following steps:

s51: the Bluetooth device and a preset voice service program establish a private wireless link and keep the private wireless link in a normally open state.

It is understood that the private wireless link between the bluetooth device and the preset voice service program may include one for transmitting the control command and the voice data, or the private wireless link may be divided into two types, one for transmitting the control command and the other for transmitting the voice data. In this embodiment, the method is divided into two types, one is called a private control link, and the other is called a private audio link. Of course, it is understood that the private control link may be a single link for transmitting various control commands, or the private control link may be divided into a plurality of links for transmitting different control commands. In this embodiment, for example, a plurality of control commands are transmitted in one private control link.

For example, if the predetermined voice service program registers and listens to the feature information of the wireless link with the operating system of the gateway device, such as registering a specific UUID, and additionally, the same UUID is configured on the bluetooth device, the bluetooth device may initiate a request of a private wireless link using the UUID, and since only the predetermined voice service program registers and listens to the UUID, the predetermined voice service program may establish the private wireless link with the bluetooth device. In addition, two different UUIDs may be employed in establishing the private control link and the private audio link.

Specifically, when the private wireless link includes a private control link and a private audio link, the bluetooth device and the preset voice service program may establish a corresponding private control link and a corresponding private audio link through the private control link module and the private audio link module.

S52: after learning that the user triggers voice recognition, the Bluetooth device plays a prompt tone locally, and sends a voice recognition request to the voice service program through the private wireless link.

The Bluetooth device can learn that the user triggers voice recognition through the key interaction management module. For example, a button for triggering voice recognition is arranged on the bluetooth device, and after the bluetooth device receives a pressing instruction of a user on the button, the user is informed of triggering voice recognition.

Thereafter, in one aspect, the Bluetooth device may play an alert tone locally. For example, the prompt tone is played through the audio interaction management module.

On the other hand, the bluetooth device may transmit a voice recognition request to a preset voice service program through a private wireless link. When the voice recognition request is sent to the preset voice service program, the preset voice service program can be activated, so that the preset voice service program can provide voice service for the Bluetooth device.

It can be understood that, in this embodiment, for example, when the user triggers voice recognition, a prompt tone may also be played before link establishment or in the link establishment process, where the link may specifically refer to a private wireless link or an SCO link according to a difference in a link for transmitting voice data to be recognized.

S53: and the Bluetooth equipment collects the voice data to be recognized generated by the user after hearing the prompt tone.

After hearing the prompt tone played by the Bluetooth device, the user can speak, and the Bluetooth device records the voice spoken by the user, so that voice data to be recognized are acquired. For example, the bluetooth device collects voice data to be recognized through the audio interaction management module.

Optionally, after the private wireless link is disconnected, the private wireless link may be reestablished, and the voice data before reestablishment of the private wireless link may be cached by a cache locally provided in the bluetooth device.

For example, when the private audio link is disconnected for various reasons, a buffer is added to a bottom layer (DSP processing layer) on the bluetooth device side, so that voice data of a user before the private audio link is not established is locally stored by the bluetooth device, and after the private audio link is established, all data is quickly transmitted to the mobile phone end by asynchronous transmission.

S54: the Bluetooth device sends the voice data to be recognized to a preset voice service program through a private wireless link.

For example, the bluetooth device sends the voice data to be recognized to the preset voice service program through the private audio link.

S55: the Bluetooth device sends the scene information to a preset voice service program through a private wireless link.

The bluetooth device may be configured with corresponding context information from the factory, where the context information indicates, for example: the Bluetooth device is a vehicle-mounted Bluetooth device or a Bluetooth device belonging to an intelligent home. Therefore, the bluetooth device can acquire scene information according to the factory configuration information of the bluetooth device. Of course, it can be understood that a sensor may be further disposed in the bluetooth device, and the sensor detects the surrounding environment of the bluetooth device, so as to obtain the scene information.

After acquiring the scene information, the bluetooth device may specifically send the scene information to the preset voice service program through the private control link.

S56: and when the Bluetooth equipment learns that the user finishes the voice input operation, the Bluetooth equipment sends a user voice finishing instruction to the voice recognition program through the private wireless link.

The Bluetooth device can know that the user finishes the voice input operation through the key interaction management module. For example, the bluetooth device adopts man-machine interaction in an interphone mode, a user can speak after pressing a preset button after starting voice recognition, the bluetooth device records voice of the user and transmits the voice to a voice service program, when the user releases the preset button, the user finishes voice input, and when the bluetooth device detects that the user releases the preset button, the user can know that the user finishes voice input operation.

When knowing that the user finishes the voice input operation, the bluetooth device can specifically send a user voice finishing instruction to the preset voice service program through the private control link.

S57: and after receiving the voice ending instruction of the user, the preset voice service program starts to perform voice recognition on the voice data to be recognized, and acquires feedback information according to the recognition result and the scene information.

The voice service program in this embodiment can more quickly know to start voice recognition, which is equivalent to a voice endpoint detection mode, so as to accelerate the voice recognition speed.

After voice recognition, the voice service program can obtain text data corresponding to the voice data, and then can perform voice service processing according to the text data and the scene information to obtain corresponding feedback information.

For example, the scene information indicates that the bluetooth device is an onboard bluetooth device, and the feedback information may specifically be a driving route related to acquiring the voice data, and the like.

Voice service customization is a basic requirement for the differential design of intelligent devices. It is easy to understand that the user instructions faced by a vehicle-mounted hands-free Bluetooth device loaded in a vehicle are mainly related to navigation and routes; and a bluetooth speaker fixedly placed in the living room faces a user instruction, and music playing is more likely to be faced. Similarly, for route navigation, an onboard bluetooth hands-free device can inquire driving routes by default after receiving the inquiry of a user, and a bluetooth headset needs to judge whether the user intends to walk, ride public transport or drive. These all require voice service customization.

When the preset voice service program provides voice service, the preset voice service program can determine a corresponding application scene according to the received scene information, acquire corresponding service layer information according to the application scene, and perform voice recognition according to the service layer information, for example, acquire a third-party map.

S58: the preset voice service program sends the feedback information to the Bluetooth device through the private wireless link.

S59: and the Bluetooth equipment plays or displays feedback information to the user through the man-machine interaction layer.

For example, when the feedback information is voice broadcast, the feedback information may be played to the user through the audio interaction management module, or the feedback information may be information such as a route map, and may be displayed through the display interaction management module by using an LED.

It can be understood that, in this embodiment, the voice recognition request, the scene information, and the user voice end instruction may be specifically transmitted in the private control link, for example, the voice data to be recognized may be specifically transmitted in the private audio link, or the above information may be transmitted in the same private wireless link. In addition, when the voice recognition request, the scene information, and the user voice end instruction are transmitted in the private control link, they may be transmitted in the same private control link or in different private control links.

In addition, in some embodiments, the bluetooth device may further transmit internet of things control information through a private wireless link to establish an internet of things between the bluetooth device and a preset voice service program or the bluetooth device, wherein the internet of things control information may be collected through a sensor interaction module of the bluetooth device. In addition, in some embodiments, software can be upgraded through the processing of the authentication and device management module, so that the degree of intelligence is increased.

In addition, after the Bluetooth equipment collects voice data, the Bluetooth equipment can firstly process voice signals and then send the voice signals to a preset voice service program, and the preset voice service program can also firstly process the voice signals and then carry out voice recognition after receiving the voice data. Speech signal processing such as noise cancellation, signal enhancement, etc.

In this embodiment, by establishing a private wireless link between the bluetooth device and the preset voice service program, it can be ensured that the voice recognition request is sent to the preset voice service program, so as to implement binding of the voice service and the preset voice service program, and facilitate presetting the voice service program, the bluetooth device, and the user. In addition, scene information is sent to a preset voice service program through the Bluetooth device, and customization of voice recognition service can be achieved. Through when knowing the user at bluetooth equipment and triggering speech recognition, play the warning sound at bluetooth equipment is local, can reduce the user and trigger speech recognition and hear the time delay between the warning sound to speech recognition speed promotes user experience. Furthermore, the Bluetooth device sends a user voice ending instruction to the voice service program, so that the voice service program can start voice recognition more quickly, and the voice recognition speed is further increased.

Fig. 6 is a schematic structural diagram of an apparatus for implementing a voice service based on bluetooth device connection according to another embodiment of the present invention, where the apparatus may be located on a gateway device, and the apparatus 60 includes:

a connection module 61, configured to establish a link layer connection with a bluetooth device, where the link layer connection includes: a private wireless link and a bluetooth standard link;

A transmission module 62, configured to receive, through the link layer connection, information sent by a bluetooth device, where the information includes: voice service information, and/or internet of things control information;

In some embodiments, when the received information is voice service information, the voice service information includes: a voice recognition request and voice data to be recognized, the bluetooth standard link comprising: the SCO link, the transmission module 62 is specifically configured to:

when the voice service information is a voice recognition request, receiving the voice recognition request sent by the Bluetooth equipment through the private wireless link;

and when the voice service information is voice data to be recognized, receiving the voice data to be recognized sent by the Bluetooth equipment through the private wireless link or the SCO link.

And the processing module 63 is configured to perform data layer, service layer, and application layer processing on the information to obtain processed information.

Wherein the data layer processing may include at least one of:

The service layer processing includes at least one of:

And a feedback module 64, configured to send the processed information to the bluetooth device through the link layer connection, so as to provide a corresponding service to the bluetooth device.

In some embodiments, referring to fig. 7, the apparatus further comprises:

the voice recognition module 65 is configured to receive a user voice end instruction sent by the bluetooth device through the private wireless link, where the user voice end instruction is sent after the bluetooth device learns that the user has finished the voice input operation; and after receiving the user voice ending instruction, starting voice recognition on the voice data to be recognized.

Fig. 8 is a schematic structural diagram of an apparatus for implementing a voice service based on bluetooth device connection according to another embodiment of the present invention, where the apparatus may be located on a bluetooth device, and the apparatus 80 includes:

a connection module 81, configured to establish a link layer connection with a preset voice service program on the gateway device, where the link layer connection includes: a private wireless link and a bluetooth standard link;

A processing module 82, configured to perform data layer processing on the acquired information to obtain information to be sent, where the information to be sent includes: voice service information, and/or internet of things control information;

Wherein the data layer processing may include at least one of:

In some embodiments, referring to fig. 9, the apparatus 80 further comprises:

an acquisition module 85, configured to process acquisition information through a human-computer interaction layer, where the human-computer interaction layer processing includes at least one of the following:

The transmission module 83 is configured to send information to be sent to the voice service program through the link layer connection, and receive feedback information sent by a preset voice service program through the link layer connection, where the feedback information is obtained after the preset voice service program processes the information to be sent.

And the human-computer interaction module 84 is used for feeding the feedback information back to the user through a human-computer interaction layer of the Bluetooth device.

In some embodiments, when the information is voice service information, the voice service information includes: a voice recognition request and voice data to be recognized, the bluetooth standard link comprising: the SCO link, the transmission module 83 is specifically configured to:

when the voice service information is a voice recognition request, sending the voice recognition request to a voice service program through the private wireless link;

and when the voice service information is voice data to be recognized, sending the voice data to be recognized to a voice service program through the private wireless link or the SCO link.

In some embodiments, referring to fig. 9, the apparatus 80 further comprises:

the playing module 86 is configured to play an alert tone locally at the bluetooth device when it is known that the user triggers voice recognition, or before or during establishment of the link layer connection, so that the user starts speaking after hearing the alert tone.

For example, a button for triggering voice recognition is arranged on the bluetooth device, and after the bluetooth device receives a pressing instruction of a user on the button, the user is informed of triggering voice recognition.

In some embodiments, referring to fig. 9, the apparatus 80 further comprises:

and the sending module 87 is configured to send a user voice end instruction to the voice service program through the private wireless link after knowing that the user ends the voice input.

For example, the bluetooth device adopts man-machine interaction in an interphone mode, a user can speak after pressing a preset button after starting voice recognition, the bluetooth device records voice of the user and transmits the voice to a voice service program, when the user releases the preset button, the user finishes voice input, and when the bluetooth device detects that the user releases the preset button, the user can know that the user finishes voice input operation.

Fig. 10 is a schematic structural diagram of a voice service implementation system based on bluetooth connection according to another embodiment of the present invention, where the system includes: an apparatus 101 located on the bluetooth device and an apparatus 102 located on the gateway device, where the apparatus 101 located on the bluetooth device may be as shown in fig. 6 or fig. 7, and the apparatus 102 located on the gateway device may be as shown in fig. 8 or fig. 9.

It should be noted that the terms "first," "second," and the like in the description of the present invention are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Further, in the description of the present invention, the meaning of "a plurality" means at least two unless otherwise specified.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.

It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.

In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.

Claims

1. A method for realizing voice service based on Bluetooth connection is characterized by comprising the following steps:

establishing a link layer connection with a Bluetooth device, the link layer connection comprising: a private wireless link and a bluetooth standard link;

receiving information sent by the Bluetooth equipment through the link layer connection, wherein the information comprises: voice service information, and/or internet of things control information;

processing the information by a data layer, a service layer and an application layer to obtain processed information;

and sending the processed information to Bluetooth equipment through the link layer connection so as to provide corresponding service for the Bluetooth equipment.

2. The method of claim 1, wherein data layer processing comprises at least one of:

3. The method of claim 1, wherein service layer processing comprises at least one of:

4. The method of claim 1, wherein application layer processing comprises: and determining an application scene according to the scene information sent by the Bluetooth device through the private wireless link.

5. The method according to any one of claims 1 to 4, wherein when the received information is voice service information, the voice service information comprises: a voice recognition request and voice data to be recognized, the bluetooth standard link comprising: the SCO link is connected through the link layer and receives information sent by the Bluetooth equipment, and the SCO link comprises the following steps:

6. The method of claim 5, further comprising:

receiving a user voice ending instruction sent by the Bluetooth equipment through the private wireless link, wherein the user voice ending instruction is sent after the Bluetooth equipment learns that the user ends voice input operation;

and after receiving the user voice ending instruction, starting voice recognition on the voice data to be recognized.

7. A method for realizing voice service based on Bluetooth connection is characterized by comprising the following steps:

establishing a link layer connection with a preset voice service program on the gateway equipment, wherein the link layer connection comprises: a private wireless link and a bluetooth standard link;

carrying out data layer processing on the acquired information to obtain information to be sent, wherein the information to be sent comprises: voice service information, and/or internet of things control information;

sending information to be sent to a preset voice service program through the link layer connection, and receiving feedback information sent by the preset voice service program through the link layer connection, wherein the feedback information is obtained after the preset voice service program processes the information to be sent;

and feeding back the feedback information to the user through a human-computer interaction layer of the Bluetooth equipment.

8. The method of claim 7, wherein the data layer processing comprises at least one of:

9. The method of claim 7, further comprising:

10. The method according to any one of claims 7 to 9, wherein when the information is voice service information, the voice service information includes: a voice recognition request and voice data to be recognized, the bluetooth standard link comprising: the SCO link is connected through the link layer and sends information to be sent to the voice service program, and the information comprises:

11. The method of claim 10, further comprising:

when the user is informed to trigger voice recognition, or before or during the link layer connection establishment, an alert tone is played locally on the Bluetooth device, so that the user starts speaking after hearing the alert tone.

12. The method of claim 10, further comprising:

and after the user finishes the voice input, sending a user voice finishing instruction to the voice service program through the private wireless link.

13. A voice service implementation device based on Bluetooth connection is characterized by comprising:

a connection module, configured to establish a link layer connection with a bluetooth device, where the link layer connection includes: a private wireless link and a bluetooth standard link;

a transmission module, configured to connect through the link layer and receive information sent by a bluetooth device, where the information includes: voice service information, and/or internet of things control information;

the processing module is used for processing the information by a data layer, a service layer and an application layer to obtain processed information;

and the feedback module is used for sending the processed information to the Bluetooth equipment through the link layer connection so as to provide corresponding service for the Bluetooth equipment.

14. A voice service implementation device based on Bluetooth connection is characterized by comprising:

a connection module, configured to establish a link layer connection with a preset voice service program on a gateway device, where the link layer connection includes: a private wireless link and a bluetooth standard link;

a processing module, configured to perform data layer processing on the acquired information to obtain information to be sent, where the information to be sent includes: voice service information, and/or internet of things control information;

the transmission module is used for transmitting information to be transmitted to the voice service program through the link layer connection and receiving feedback information transmitted by a preset voice service program through the link layer connection, wherein the feedback information is obtained after the preset voice service program processes the information to be transmitted;

and the human-computer interaction module is used for feeding the feedback information back to the user through a human-computer interaction layer of the Bluetooth equipment.

15. A voice service implementation system based on Bluetooth connection, comprising:

the apparatus of claim 13; and the number of the first and second groups,

the apparatus of claim 14.