CN117412084B

CN117412084B - Device control method, device, electronic device and computer readable storage medium

Info

Publication number: CN117412084B
Application number: CN202310125161.2A
Authority: CN
Inventors: 袁靖凌; 曾庆忠
Original assignee: Shenzhen TCL New Technology Co Ltd
Current assignee: Shenzhen TCL New Technology Co Ltd
Priority date: 2023-02-10
Filing date: 2023-02-10
Publication date: 2024-12-03
Anticipated expiration: 2043-02-10
Also published as: WO2024164789A1; CN117412084A

Abstract

The embodiment of the application discloses a device control method, a device, an electronic device and a computer readable storage medium, wherein the method comprises the steps of establishing a universal attribute protocol connection with opposite-end equipment, and establishing an audio transmission link with the opposite-end equipment based on the universal attribute protocol connection; the method comprises the steps of obtaining a voice service identifier broadcasted by opposite terminal equipment, establishing connection of voice service corresponding to the voice service identifier through universal attribute protocol connection, receiving audio control information transmitted by the opposite terminal equipment through an audio transmission link based on the voice service, and executing control operation corresponding to the audio control information. When the voice service of the opposite terminal equipment is connected, the low-power consumption audio transmission link can be used for realizing the low-power consumption transmission of the audio data based on the voice service.

Description

Device control method, device, electronic device and computer readable storage medium

Technical Field

The embodiment of the application relates to the technical field of computers, in particular to a device control method and device, electronic equipment and a computer readable storage medium.

Background

With the popularization and development of intelligent devices, it is possible to perform audio control on the intelligent devices by using voice, for example, audio control on the intelligent devices is achieved through a bluetooth headset, but a conventional bluetooth connection headset transmits audio through a bluetooth audio transmission model protocol (A2 DP), voice transmission needs to pass through a hands-free protocol (HFP), and there is a problem in that transmission power consumption is high.

With the popularization and diversification of smart devices, such as the interconnection of multiple smart home in a family, a solution for audio transmission with lower power consumption is needed.

Disclosure of Invention

The embodiment of the application provides a device control method, a device, electronic equipment and a computer readable storage medium, which can reduce the power consumption of audio transmission.

The embodiment of the application provides a device control method, which is applied to current devices and comprises the following steps:

Establishing a universal attribute protocol connection with opposite terminal equipment, and establishing an audio transmission link with the opposite terminal equipment based on the universal attribute protocol connection;

acquiring a voice service identifier broadcasted by the opposite terminal equipment, and establishing connection of a voice service corresponding to the voice service identifier through the universal attribute protocol connection;

Receiving audio control information transmitted by the opposite terminal equipment through the audio transmission link based on the voice service;

and executing the control operation corresponding to the audio control information.

Correspondingly, the embodiment of the application also provides a device control device, which comprises:

The attribute service connection module is used for establishing a universal attribute protocol connection with the opposite terminal equipment and establishing an audio transmission link with the opposite terminal equipment based on the universal attribute protocol connection;

The voice service connection module is used for acquiring the voice service identifier broadcasted by the opposite terminal equipment and establishing connection of the voice service corresponding to the voice service identifier through the universal attribute protocol connection;

The audio transmission module is used for receiving the audio control information transmitted by the opposite terminal equipment through the audio transmission link based on the voice service;

And the action execution module is used for executing the control operation corresponding to the audio control information.

Optionally, in some embodiments of the present application, the peer device includes at least two, and the voice service connection module includes:

the voice service connection unit is used for respectively establishing the connection of the voice service corresponding to the voice service identifier broadcasted by each opposite terminal device through the universal attribute protocol connection established with each opposite terminal device;

The action execution module comprises:

a selecting unit, configured to select target audio control information from the audio control information corresponding to each of the peer devices;

and the execution unit is used for executing the control operation corresponding to the target audio control information.

Wherein, in some embodiments of the present application, the selecting unit includes:

the analysis subunit is used for analyzing the audio control information aiming at each piece of audio control information to obtain an audio control instruction and opposite-end equipment state information;

A selecting subunit, configured to select a target audio control instruction from the audio control instructions according to the state information of each opposite terminal device;

The execution unit includes:

and the execution subunit is used for executing the control operation corresponding to the target audio control instruction.

In some embodiments of the present application, the state information of the peer device includes activation state information, and the selecting subunit is specifically configured to:

If the activation state information of at least two opposite terminal devices describes that the corresponding opposite terminal devices are in an activation state, acquiring signal strength values of audio transmission links corresponding to the at least two opposite terminal devices;

taking the opposite terminal equipment corresponding to the maximum signal intensity value in at least two signal intensity values as target opposite terminal equipment;

and taking the audio control instruction corresponding to the target opposite terminal equipment as a target audio control instruction.

In some embodiments of the present application, the opposite terminal device includes a remote controller and an earphone, and the selecting subunit is further specifically configured to:

If the activation state information of the remote controller and the earphone describe that the remote controller and the earphone are in the activation state, acquiring in-ear state information of the earphone;

if the in-ear state information describes that the earphone is in an in-ear state, acquiring a first signal intensity value of the remote controller and a second signal intensity value of the earphone;

if the first signal intensity value is larger than the second signal intensity value, the remote controller is used as target opposite-end equipment;

if the first signal intensity value is smaller than the second signal intensity value, the earphone is used as target opposite-end equipment;

And if the first signal intensity value is equal to the second signal intensity value, randomly selecting one opposite terminal device from the remote controller and the earphone as a target opposite terminal device.

Wherein, in some embodiments of the present application, the audio transmission module comprises:

An intensity value determining unit for determining a target signal transmitting power value according to an expected signal receiving intensity value of the current device;

an intensity value transmitting unit, configured to transmit the target signal transmission power value to the peer device;

and the audio receiving unit is used for receiving the audio control information transmitted by the opposite terminal equipment based on the target signal transmission power value through the audio transmission link based on the voice service.

Wherein, in some embodiments of the present application, the apparatus further includes a sending module, where the sending module includes:

the system comprises an acquisition unit, a microphone and a receiving unit, wherein the acquisition unit is used for acquiring audio information to be broadcasted, and the audio information to be broadcasted comprises an application carried on the opposite terminal equipment and generated after responding to the operation of a user or generated after receiving the audio of the user through the microphone;

An audio sending unit, configured to, for each peer device, transmit, based on connection with a voice service of the peer device, the audio information to be broadcasted to the peer device through an audio transmission link established with the peer device.

In a third aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the computer program when executed by the processor implements the steps in the device control method described above.

In a fourth aspect, an embodiment of the present application further provides a computer readable storage medium, where a computer program is stored, where the computer program when executed by a processor implements the steps in the device control method described above.

In a fifth aspect, embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions to cause the computer device to perform the methods provided in the various alternative implementations described in the embodiments of the present application.

The embodiment of the application establishes a universal attribute protocol connection with the opposite terminal equipment, establishes an audio transmission link with the opposite terminal equipment based on the connection, establishes the connection of the voice service corresponding to the voice service identifier through the universal attribute protocol connection after acquiring the voice service identifier broadcasted by the opposite terminal equipment, receives the audio control information transmitted by the opposite terminal equipment through the audio transmission link based on the voice service, and executes the control operation corresponding to the audio control information. When the voice service of the opposite terminal equipment is connected, the low-power-consumption audio transmission link can be used for realizing the low-power-consumption transmission of the audio data based on the voice service. After receiving the audio control information sent by the opposite terminal device and responding, the current device can execute corresponding actions to realize audio control of the device.

Drawings

In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic view of a scenario of an apparatus control method provided in an embodiment of the present application;

Fig. 2 is a schematic flow chart of a device control method according to an embodiment of the present application;

Fig. 3 is a schematic flow chart of audio transmission between a television and a headset according to an embodiment of the present application;

fig. 4 is a schematic flow chart of voice transmission by connecting a google voice service with a bluetooth headset according to an embodiment of the present application;

FIG. 5 is a flow chart of a multi-device voice control strategy provided by an embodiment of the present application;

Fig. 6 is a schematic structural diagram of an apparatus control device according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made more apparent and fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the application are shown. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to fall within the scope of the application.

The embodiment of the application provides a device control method, a device, an electronic device and a computer readable storage medium. Specifically, the embodiment of the application provides a device control device suitable for electronic equipment, wherein the electronic equipment comprises a terminal, and the terminal comprises a computer, a tablet personal computer, a sound box, a Bluetooth sound box, a mobile phone or a television, an intelligent refrigerator, an intelligent air conditioner and other devices.

Referring to fig. 1, taking a control method of a television execution device as an example, the specific execution process is as follows:

The television 10 establishes a generic attribute protocol connection with the opposite terminal device 11, establishes an audio transmission link with the opposite terminal device 11 based on the connection, establishes a connection with a voice service corresponding to the voice service identifier in the opposite terminal device 11 through the generic attribute protocol connection after acquiring the voice service identifier broadcasted by the opposite terminal device 11, receives audio control information transmitted by the opposite terminal device 11 through the audio transmission link based on the voice service, and then, the television 10 performs a control operation corresponding to the audio control information.

It will be appreciated that in embodiments of the present application, the peer device 11 may comprise a truly wireless stereo (TWS, true Wireless Stereo) headset, bluetooth headset, hearing aid, bluetooth voice remote control, or the like.

The following will describe in detail. It should be noted that the following description order of embodiments is not a limitation of the priority order of embodiments.

Referring to fig. 2, fig. 2 is a flow chart of a device control method according to an embodiment of the application. The specific flow of the equipment control method is as follows:

101. and establishing a universal attribute protocol connection with the opposite terminal equipment, and establishing an audio transmission link with the opposite terminal equipment based on the universal attribute protocol connection.

It will be appreciated that in embodiments of the present application, the peer device is a voice interaction enabled device, including a truly wireless stereo (TWS, true Wireless Stereo) headset, a bluetooth headset, a hearing aid, a bluetooth voice remote control, and the like.

It should be noted that the generic attribute protocol (GATT, generic Attribute Profile) defines a service framework using the attribute protocol, which defines the procedures and formats of the service and its features, and the defined procedures include discovery, reading, writing, notification and indication features, and broadcasting of configuration features. The GATT protocol is used by the application layer and other protocols, so that clients can communicate with servers.

It will be appreciated that in embodiments of the present application, the audio transmission link is a link responsible for audio data transmission, such as a CIS link, which enables transmission of audio data by transmitting ISO packets.

It can be appreciated that the establishment of the bluetooth low energy audio transmission link is achieved after the establishment of the generic attribute protocol connection and the establishment of the audio transmission link with the peer device in accordance with the generic attribute protocol connection.

Correspondingly, in the actual operation process, before the universal attribute protocol connection is established with the opposite terminal equipment, a physical link connection (such as an asynchronous link connection) and a logical link connection are also required to be established with the opposite terminal equipment, wherein the physical link and the logical link are responsible for logical link control and data transmission. Specifically, the physical link connection includes an asynchronous link connection (ACL, asynchronous Connectionless) that implements ACL link connection through a control interface HCI connected to the bluetooth chip. Correspondingly, the protocol content supported by the opposite terminal device is acquired through a service discovery (SDP, service Discovery Protocol) service, and a logic link (L2 CAP) connection is established with the opposite terminal device.

Subsequently, a communication connection between the bluetooth specification (profile) and the service is realized by an attribute protocol (ATT, attribute Protocol). Based on the attribute protocol (ATT, attribute Protocol), a generic attribute protocol (GATT, generic Attribute Profile) connection is established with the peer device.

102. And acquiring the voice service identifier broadcasted by the opposite terminal equipment, and establishing connection of the voice service corresponding to the voice service identifier through the universal attribute protocol connection.

It should be noted that the voice service identifier is an identifier corresponding to a voice service, where the identifier may be an identifier, such as a universal unique identifier (UUID, universally Unique Identifier), and each voice service corresponds to a corresponding unique identifier, and based on the unique identifier, a corresponding service may be obtained from the services supported by the peer device.

For example, in an embodiment of the present application, the voice service identification may be represented as ATV Voice Service

[ATVV_SERVICE_UUID AB5E0001-5A21-4F05-BC7D-AF01F617B664]。

It will be appreciated that by establishing a connection with the voice service of the peer device, audio transmissions between the current device and the peer device may be made based on the voice service.

103. And receiving the audio control information transmitted by the opposite terminal equipment through the audio transmission link based on the voice service.

It will be appreciated that when voice service support exists between the devices, then the transmission of audio data may be performed by the corresponding audio transmission link, i.e. the transmission of voice-related data is effected.

It is understood that the audio control information is information of existence control attributes or control commands, such as audio data corresponding to a section of control sentence. The audio control information is received from the opposite terminal device, so that the current device can be controlled by using the audio control information, and the audio control of the device is realized.

For example, after the current device is paired with the peer device and the connection is completed, the current device sends a command to the peer device to obtain the voice input capability (capabilities) of the peer device, the command is sent through ATVV _char_tx feature, and the peer device, after receiving the command, should reply to the voice input capability information of the peer device through ATVV _char_ctl notification.

Correspondingly, the opposite terminal device is used as an audio input device, a microphone is arranged in the opposite terminal device, voice searching is initialized when the opposite terminal device is controlled by using a touch key, and the opposite terminal device sends a key event (HID: page 0x0C, key value: 0x 221) to the current device.

At the same time, the peer device sends a data (content: 0x 08) to the current device via ATVV _char_ctl notification, and when the current device is ready to begin receiving data from the peer device, it sends a mic_open () command via ATVV _char_tx feature, which then transmits audio data via the audio transmission link. For example, the peer device starts transmitting after receiving ATVV _CHAR_CTL command (e.g., content: 0x 04), and ends receiving when ATVV _CHAR_CTL (data 0x 00) is received.

Correspondingly, when the opposite terminal equipment stops voice input, the opposite terminal equipment can send a timeout message to the current equipment, when the current equipment receives the timeout message, the current equipment can send an MIC_CLOSE instruction to the opposite terminal equipment, and meanwhile, the opposite terminal equipment does not reply correspondingly any more.

It should be noted that, during the AUDIO transmission, an AUDIO synchronization (audio_sync) message is periodically sent for a period of time, so as to maintain synchronization between the current device and the peer device.

104. And executing the control operation corresponding to the audio control information.

It can be understood that the remote voice control of the current device and the opposite device is realized by executing the control operation corresponding to the audio control information.

Accordingly, in the embodiment of the present application, after the current device receives the audio control information of the peer device, the audio data may be decoded using the coding format of the bluetooth low energy audio mandatory codec (LC 3), so that the audio quality is improved while the low bit rate is transmitted. Similarly, the peer device may also encode the audio data using the encoding format of the bluetooth low energy audio mandatory codec (LC 3) prior to transmitting the audio data.

It may be understood that, in the embodiment of the present application, a generic attribute protocol connection is established with a peer device, and an audio transmission link with the peer device is established based on the connection, after a voice service identifier broadcasted by the peer device is acquired, a connection of a voice service corresponding to the voice service identifier is established through the generic attribute protocol connection, and based on the voice service, audio control information transmitted by the peer device is received through the audio transmission link, and a control operation corresponding to the audio control information is performed. When the voice service of the opposite terminal equipment is connected, the low-power-consumption audio transmission link can be used for realizing the low-power-consumption transmission of the audio data based on the voice service. After receiving the audio control information sent by the opposite terminal device and responding, the current device can execute corresponding actions to realize audio control of the device.

Optionally, the current device may respectively establish a generic attribute protocol connection with a plurality of peer devices, and respectively establish a connection with a voice service of the corresponding peer device based on each generic attribute protocol connection, that is, optionally, in some embodiments of the present application, the peer devices include at least two peer devices, and the step of "establishing a connection of a voice service corresponding to the voice service identifier through the generic attribute protocol connection" includes:

and respectively establishing connection of voice services corresponding to the voice service identifiers broadcasted by the opposite terminal equipment through the universal attribute protocol connection established with the opposite terminal equipment.

It can be understood that the universal attribute protocol connection is respectively established with other opposite terminal devices, and the connection is respectively established with the voice service of each opposite terminal device based on each universal attribute protocol connection, so that the current device can respectively establish low-power-consumption audio transmission links for each opposite terminal device, and the connection between the current device and a plurality of other devices is realized. Wherein the plurality of other devices can all be used as input devices to simultaneously input audio data to the current device.

Similarly, after the current device establishes a connection with the voice services of the other devices, the current device may also be used as input of the other devices, that is, the audio data generated by the current device may be shared with the other devices, that is, optionally, in some embodiments of the present application, the step of "establishing, through the generic attribute protocol connection established with each of the peer devices, a connection of the voice service corresponding to the voice service identifier broadcasted by each of the peer devices" respectively, and then the method further includes:

Acquiring audio information to be broadcasted, wherein the audio information to be broadcasted comprises applications carried on the opposite terminal equipment, which are generated after responding to the operation of a user or are generated after receiving the audio of the user through a microphone;

For each opposite terminal device, transmitting the audio information to be broadcasted to the opposite terminal device through an audio transmission link established with the opposite terminal device based on the connection of the voice service of the opposite terminal device.

The other opposite terminal devices are used as receiving devices of the current device, and can conveniently send audio instructions to other devices simultaneously by using the current device.

The design of audio transmission based on the low-power-consumption audio transmission link and the voice service accords with linkage control of multiple intelligent furniture such as families, and the low-power-consumption transmission can reduce energy consumption and equipment use cost. Meanwhile, in the embodiment of the application, the LC3 coding format is used for coding and decoding the audio data, and the audio quality is improved at the same time of low bit rate transmission.

It can be understood that, compared with the related art that audio is transmitted through bluetooth audio transmission model protocol (A2 DP), voice transmission needs to pass through a plurality of processes such as hands-free protocol (HFP), etc., the embodiment of the application simplifies the interaction process in the audio transmission process and reduces the transmission power consumption based on the universal attribute protocol and the link established based on the universal attribute protocol.

Optionally, in the embodiment of the present application, when the output of a plurality of peer devices is used as the input of the current device, there may be a case that a plurality of input audio data are received at the same time, and in order to ensure the validity and accuracy of the audio control of the device, valid target audio control information may also be selected from a plurality of audio control information of a plurality of devices, and the current device is controlled based on the target audio control information, that is, optionally, in some embodiments of the present application, the step of "executing a control operation corresponding to the audio control information" includes:

selecting target audio control information from the audio control information corresponding to each opposite terminal device;

and executing the control operation corresponding to the target audio control information.

It will be appreciated that the selection of the target audio control information may promote the effectiveness and accuracy of the audio control of the device, and thus, the selection of the target audio control information determines the quality of the audio control of the device.

Optionally, in the embodiment of the present application, the target audio control information may be selected from the corresponding audio control information according to the device status of each peer device, that is, optionally, in some embodiments of the present application, the step of "selecting the target audio control information from the audio control information corresponding to each peer device" includes:

analyzing the audio control information aiming at each piece of audio control information to obtain an audio control instruction and opposite-end equipment state information;

And selecting a target audio control instruction from the audio control instructions according to the state information of each opposite terminal device.

It should be noted that, the audio control instruction is used to instruct the current device to perform a corresponding action, for example, an instruction of playing video, playing audio, closing video, turning off, and the like.

The state information of the opposite device is used to describe the state of the opposite device, for example, an active state, an in-ear state, and the like.

It can be understood that the state information of the opposite terminal equipment is generated after being detected by the opposite terminal equipment, and the state information of the opposite terminal equipment is coded into the audio control information, so that the audio control information is conveniently transmitted to the current equipment, and further, after the current equipment receives the audio control information, the state information of the opposite terminal equipment corresponding to each audio control information can be obtained through analysis.

The audio control instructions are filtered according to the state information of the opposite terminal equipment, so that the filtered audio control instructions can meet the state requirements of the opposite terminal equipment, for example, when the state information of the opposite terminal equipment describes that the opposite terminal equipment is in an activated state, namely in a normal communication state, the audio control instructions corresponding to the opposite terminal equipment are used as target audio control instructions.

Accordingly, after the audio control instruction in the audio control information is obtained by parsing and the target audio control instruction is obtained by screening from the audio control instruction, the current device may execute the control operation corresponding to the target audio control instruction, that is, optionally, in some embodiments of the present application, the step of "executing the control operation corresponding to the target audio control information" includes:

and executing the control operation corresponding to the target audio control instruction.

It can be understood that the current device performs audio control by using the peer device after performing the corresponding control operation.

It should be noted that, if the plurality of devices are in the active state, a target peer device needs to be selected from the plurality of devices in the active state, and then an audio control instruction corresponding to the target peer device is used as the target audio control instruction.

In this embodiment of the present application, when a plurality of devices are in an active state, a target audio control instruction may be selected from corresponding audio control instructions according to signal intensities of audio transmission links established between each device and a current device, that is, optionally, in some embodiments of the present application, the state information of the peer device includes active state information, and the step of selecting, according to the state information of each peer device, the target audio control instruction from the audio control instructions includes:

taking the opposite terminal equipment corresponding to the maximum signal receiving intensity value in the at least two signal receiving intensity values as target opposite terminal equipment;

It should be noted that, the signal strength value of the audio transmission link reflects the signal strength of the link, for example, for a link constructed by using the bluetooth technology, the bluetooth signal strength reflects the transmission quality of the signal, the signal strength value affects the transmission quality of the signal, that is, affects the quality of the received audio control instruction, and the audio received by the link with a larger signal strength value is clearer, and the voice recognition is more accurate, so that the opposite terminal device corresponding to the larger signal strength value can be selected as the target opposite terminal device, so as to ensure that the selected target audio control instruction is more effective and more accurate.

Accordingly, in the embodiment of the present application, for a specific device, corresponding device state information may be further introduced, where the device state information describes whether the device is in an available state, so as to reflect validity of audio information transmitted based on the device, for example, for an earphone device, whether the earphone is worn may also be determined by in-ear state information of the earphone, so as to determine whether the audio information transmitted through the earphone is valid and clearly available, that is, optionally, in some embodiments of the present application, the opposite terminal device includes a remote controller and an earphone, and the step of "if the activation state information of at least two opposite terminal devices describes that the corresponding opposite terminal devices are in an activated state, obtaining signal strength values" of audio transmission links corresponding to the at least two opposite terminal devices includes:

The step of using the opposite terminal device corresponding to the largest signal intensity value of the at least two signal intensity values as the target opposite terminal device includes:

Wherein the remote controller refers to a remote controller capable of voice input, for example, a bluetooth voice remote controller.

It will be appreciated that when the device is in the active state, it is not necessarily said that the device is in use or the user desires to use, for example, for headphones, even if the headphones are in the active state, if the headphones are not in the worn state or in-ear state, it is said that the user does not really want to use the headphones for speech, and therefore, for the corresponding device, a targeted state determination is also required. For another example, with respect to the remote controller, it may also be determined whether the audio data transmitted by the remote controller is generated by a user operation according to whether the remote controller is in a handheld state.

It should be noted that in-ear status information reflects in-ear condition of the earphone, and the status information can be obtained through in-ear detection. In general, the earphone in the in-ear state indicates that the user is using the earphone, and the earphone has a higher priority, so when both the remote controller and the earphone are in an active state and the earphone is in the in-ear state, a relevant condition can be introduced to make a device screening judgment, for example, a target opposite device can be screened through the signal strength of an audio transmission link formed by the remote controller and the earphone. Similarly, when the link with high signal strength transmits audio, the audio quality can be ensured, so that the validity and accuracy of the target audio control instruction selected based on the target opposite terminal equipment can be ensured by selecting the target opposite terminal equipment according to the signal strength.

It will be appreciated that for the current device to receive audio data from the peer device, the current device may then be understood as a receiver, and for the receiver, the performance of the receiver may be optimized only if the signal strength falls within a certain area that is not too strong or too weak. For example, the signal is not saturated because of being too strong, and the decoding error is not generated because of being too weak.

Thus, in the embodiments of the present application, the transmitting power of the signal sent by the peer device may be adjusted according to the appropriate signal strength when the current device receives the signal, so as to ensure that the current device receives the audio data with a desired and appropriate signal strength, that is, optionally, in some embodiments of the present application, the step of "receiving, based on the voice service, the audio control information transmitted by the peer device through the audio transmission link" includes:

Determining a target signal transmitting power value according to the expected signal receiving intensity value of the current equipment;

Transmitting the target signal transmitting power value to the opposite terminal equipment;

and receiving audio control information transmitted by the opposite terminal equipment based on the target signal transmission power value through the audio transmission link based on the voice service.

In the embodiment of the present application, the expected signal receiving strength value is an optimal signal strength value of a signal received by the current device, where the optimal signal strength value may be obtained by initializing the current device when leaving the factory, or comprehensively configured according to relevant hardware parameters of the current device.

The transmitting power of the signal sent by the opposite terminal equipment is determined according to the expected signal receiving intensity value, so that the opposite terminal equipment can enable the current equipment to be in the best or better receiving state when transmitting the signal according to the transmitting power, and stability and accuracy of audio data transmission are improved.

It can be understood that the design of audio transmission based on the low-power-consumption audio transmission link and the voice service accords with the linkage control of multiple intelligent furniture such as families, the low-power-consumption transmission can reduce the energy consumption and the equipment use cost, and meanwhile, the LC3 coding format is used for coding and decoding the audio data, so that the audio quality is improved while the low-bit rate transmission is carried out.

Correspondingly, under the linkage scene of multi-equipment input, target opposite-end equipment can be selected from the opposite-end equipment according to the activation state, the in-ear state and the signal intensity of the corresponding link of each equipment, so that the selection of target audio control instructions is realized, and a solution for selecting main control equipment from the scene of a plurality of input equipment is constructed.

Referring to fig. 3, fig. 3 is a schematic flow chart of audio transmission between a television and an earphone according to an embodiment of the application, wherein the specific flow chart of audio transmission includes:

201. the television establishes physical link connection with the earphone according to the Bluetooth control interface;

It should be noted that the control interface includes an interface provided by the bluetooth chip, such as an interface (HCI, host Controller Interface), and the physical link includes an asynchronous link (ACL, asynchronous Connectionless).

202. The television acquires the service supported by the earphone according to the service discovery service, and selects the corresponding service to establish logic link connection with the earphone;

The service discovery service includes a service corresponding to the (SDP, service Discovery Protocol) protocol.

203. The television establishes attribute protocol service connection and general attribute protocol service connection with the earphone;

Note that, the attribute protocol service includes a service corresponding to an attribute protocol (ATT, attribute Protocol), and the generic attribute protocol service includes a service corresponding to a generic attribute protocol (GATT, generic Attribute Profile).

204. The television receives a voice service identifier broadcasted by the earphone and establishes connection with a voice service corresponding to the voice service identifier;

In the embodiment of the application, the voice service identifier can be expressed as ATV Voice Service

[ATVV_SERVICE_UUID AB5E0001-5A21-4F05-BC7D-AF01F617B664]。

205. The television respectively establishes an audio transmission link with a left earphone and a right earphone of the earphone according to the universal attribute protocol service connection;

the audio transmission link CIS transmits audio data by transmitting isochronous broadcast (ISO) packets.

206. The television forms a connection synchronization group by the audio transmission links of the left earphone and the right earphone;

207. After the earphone inputs the voice, the audio data corresponding to the voice is encoded according to the encoding format of the low-power Bluetooth audio forced codec to obtain encoded audio data;

208. the earphone transmits the encoded audio data in the form of isochronous broadcast data packets through an audio transmission link connected with a synchronous group based on voice service;

209. After receiving the encoded audio data, the television decodes the encoded audio data according to the encoding format of the low-power Bluetooth audio forced encoder/decoder to obtain decoded audio data;

210. And the television responds to the audio control instruction corresponding to the decoded audio data and executes the responding action.

The Audio transmission link is established between the television and the earphone through the universal attribute protocol service, so that the Bluetooth low-power-consumption Audio (BLE Audio) transmission link is established, and compared with the prior art that the Audio transmission between the television and the earphone needs to pass through a Bluetooth Audio transmission model protocol (A2 DP), the voice transmission needs to pass through a complex interaction flow such as a hands-free protocol (HFP), and the like, the embodiment of the application can simplify the interaction flow and reduce the power consumption, and meanwhile, in the embodiment of the application, the LC3 coding format is used for coding and decoding the Audio data, so that the Audio quality is improved while the Audio is transmitted at a low bit rate.

Correspondingly, the mode of establishing the audio transmission link based on the universal attribute protocol service supports the condition of multi-equipment access, for example, equipment such as a Bluetooth earphone, a hearing aid, a Bluetooth voice remote controller and the like, can respectively establish universal attribute protocol connection with the television, respectively establish corresponding audio transmission links, and establish a scheme of connecting the television with other multiple equipment. The television can be used as an output device, audio can be shared with other devices connected with the television through audio transmission links of the other devices, and correspondingly, the other devices can also send audio data to the television through the corresponding audio transmission links.

Referring to fig. 4, fig. 4 is a schematic flow chart of voice transmission by connecting a google voice service to a bluetooth headset according to an embodiment of the present application, specifically:

221. The television searches the Bluetooth headset and initiates binding connection;

222. The television establishes physical link connection and logical link connection with the Bluetooth headset;

223. the television establishes attribute protocol connection and general attribute protocol connection with the Bluetooth headset;

224. The television acquires a voice service identifier corresponding to google voice service broadcasted by the Bluetooth headset, and establishes connection with the google voice service of the Bluetooth headset according to the voice service identifier;

225. The television receives a command sent by the Bluetooth headset through ATVV _CHAR_CTL characteristics, and opens a voice assistant;

226. the television reads the voice input of the Bluetooth headset through ATVV _CHAR_RX features;

227. until the Bluetooth headset stops voice input.

The Bluetooth headset is connected with the Google voice service, so that the link established by the television and the Bluetooth headset can transmit audio data.

Correspondingly, when a plurality of devices send audio data to the television at the same time, the television can screen the audio data of the plurality of devices according to the factors such as the activation state, the in-ear state, the handheld state or the signal strength of the corresponding link of the other plurality of devices, select one of the audio data to be responded as the audio data, and further execute corresponding actions corresponding to the single audio data. Specifically, as shown in fig. 5, fig. 5 is a schematic flow chart of a multi-device voice control strategy according to an embodiment of the present application. The multi-equipment voice control strategy specifically comprises the following steps:

231. the television is connected with the voice remote controller and the Bluetooth headset;

232. judging whether an instruction for opening the voice assistant is received, if yes, executing step 234, and if not, executing step 233;

233. performing voice control on the television through far-field voice recognition control instructions;

Far-field voice refers to the realization of the pickup of a built-in microphone of a television.

234. Judging whether the Bluetooth headset is worn or not through in-ear detection, if so, executing step 235, and if not, executing step 237;

235. judging whether the Bluetooth headset signal strength is stronger than that of the voice remote controller, if so, executing step 236, and if not, executing step 237;

236. the voice control of the television is carried out through the Bluetooth earphone;

237. and the voice control of the television is carried out through the voice remote controller.

The device state of the multiple devices can be analyzed for the condition that the output of the multiple devices is taken as the input of the television, and then a single device for controlling the television is selected from the multiple devices, wherein the device state can be classified and judged according to different device types, and the purpose of the device is to judge whether the device is in an effective use state or not, namely, the reliability of audio data sent by the device is analyzed and judged.

In order to facilitate better implementation of the device control method, the application also provides a device control device based on the device control method. Where the meaning of the terms is the same as in the above-described device control method, specific implementation details may be referred to in the description of the method embodiments.

Referring to fig. 6, fig. 6 is a schematic structural diagram of an apparatus control device according to an embodiment of the present application, where the apparatus control device may specifically be as follows:

The attribute service connection module 301 is configured to establish a generic attribute protocol connection with a peer device, and establish an audio transmission link with the peer device based on the generic attribute protocol connection;

the voice service connection module 302 is configured to obtain a voice service identifier broadcasted by the peer device, and establish connection of a voice service corresponding to the voice service identifier through the generic attribute protocol connection;

an audio transmission module 303, configured to receive, based on the voice service, audio control information transmitted by the peer device through the audio transmission link;

and the action execution module 304 is configured to execute a control operation corresponding to the audio control information.

Optionally, in some embodiments of the present application, the peer device includes at least two, and the voice service connection module 302 includes:

the action execution module 304 includes:

The execution unit includes:

Wherein, in some embodiments of the present application, the audio transmission module 303 comprises:

In the embodiment of the application, a universal attribute protocol connection with a peer device is established by an attribute service connection module 301, an audio transmission link with the peer device is established based on the universal attribute protocol connection, then a voice service identifier broadcasted by the peer device is acquired by a voice service connection module 302, a connection of a voice service corresponding to the voice service identifier is established through the universal attribute protocol connection, then audio control information transmitted by the peer device is received by an audio transmission module 303 based on the voice service through the audio transmission link, and then a control operation corresponding to the audio control information is executed by an action execution module 304.

When the voice service of the opposite terminal equipment is connected, the low-power-consumption audio transmission link can be used for realizing the low-power-consumption transmission of the audio data based on the voice service. After receiving the audio control information sent by the opposite terminal device and responding, the current device can execute corresponding actions to realize audio control of the device.

In addition, the present application further provides an electronic device, as shown in fig. 7, which shows a schematic structural diagram of the electronic device according to the present application, specifically:

The electronic device may include one or more processing cores 'processors 401, one or more computer-readable storage media's memory 402, power supply 403, and input unit 404, among other components. It will be appreciated by those skilled in the art that the electronic device structure shown in fig. 7 is not limiting of the electronic device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components. Wherein:

The processor 401 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 402, and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device. Optionally, the processor 401 may include one or more processing cores, and preferably the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application program, etc., and the modem processor mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by executing the software programs and modules stored in the memory 402. The memory 402 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), etc., and a storage data area that may store data created according to the use of the electronic device, etc. In addition, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

The electronic device further comprises a power supply 403 for supplying power to the various components, preferably the power supply 403 may be logically connected to the processor 401 by a power management system, so that functions of managing charging, discharging, and power consumption are performed by the power management system. The power supply 403 may also include one or more of any of a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

The electronic device may further comprise an input unit 404, which input unit 404 may be used for receiving input digital or character information and generating keyboard, mouse, joystick, optical or trackball signal inputs in connection with user settings and function control.

Although not shown, the electronic device may further include a display unit or the like, which is not described herein. In this embodiment, the processor 401 in the electronic device loads executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 401 executes the application programs stored in the memory 402, so as to implement the steps in any device control method provided in the embodiment of the present application.

The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.

Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.

To this end, the present application provides a computer-readable storage medium having stored thereon a computer program that can be loaded by a processor to perform the steps of any of the device control methods provided by the present application.

The computer readable storage medium may include, among others, read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disks, and the like.

Because the instructions stored in the computer readable storage medium can execute any step in the control of the device provided by the present application, the beneficial effects that can be achieved by any method for controlling the device provided by the present application can be achieved, and detailed descriptions of the foregoing embodiments are omitted herein.

The foregoing describes in detail a device control method, apparatus, electronic device and computer readable storage medium, and specific examples are provided herein to illustrate the principles and embodiments of the present application and to assist in understanding the method and core ideas thereof, and meanwhile, the present disclosure should not be construed as limiting the application to any extent by those skilled in the art, depending on the ideas of the present application.

It should be noted that, in the specific embodiment of the present application, related data such as audio control data, device model information, related protocols and services related to device connection establishment and the like generated for a voice control intelligent device are related, and when the above embodiment of the present application is applied to specific products or technologies, user permission or consent needs to be obtained, and collection, use and processing of related data need to comply with related laws and regulations and standards of related countries and regions.

Claims

1. A device control method, applied to a current device, comprising:

Executing control operation corresponding to the audio control information;

The opposite terminal equipment comprises a remote controller and an earphone, and the executing the control operation corresponding to the audio control information comprises the following steps:

If the first signal intensity value is larger than the second signal intensity value, the remote controller is used as target opposite terminal equipment, and if the first signal intensity value is smaller than the second signal intensity value, the earphone is used as target opposite terminal equipment;

And executing control operation corresponding to the audio control information of the target opposite terminal equipment.

2. The method of claim 1, wherein the peer device includes at least two, and wherein the establishing a connection for the voice service corresponding to the voice service identifier through the generic attribute protocol connection includes:

respectively establishing connection of voice service corresponding to voice service identifiers broadcasted by the opposite terminal equipment through universal attribute protocol connection established with the opposite terminal equipment;

the executing the control operation corresponding to the audio control information includes:

3. The method according to claim 2, wherein selecting the target audio control information from the audio control information corresponding to each of the peer devices includes:

Selecting a target audio control instruction from the audio control instructions according to the state information of each opposite terminal device;

the executing the control operation corresponding to the target audio control information includes:

4. The method of claim 3, wherein the peer device status information includes activation status information, wherein the selecting a target audio control instruction from the audio control instructions based on the respective peer device status information includes:

5. The method of claim 1, wherein the receiving, based on the voice service, the audio control information transmitted by the peer device over the audio transmission link comprises:

6. The method according to claim 2, wherein after the connection of the voice service corresponding to the voice service identifier broadcasted by each of the peer apparatuses is respectively established through the generic attribute protocol connection established with each of the peer apparatuses, the method further comprises:

7. An apparatus control device, comprising:

the action execution module is used for executing the control operation corresponding to the audio control information;

8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps in the device control method according to any one of claims 1-6 when the computer program is executed.

9. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, realizes the steps in the device control method according to any one of claims 1 to 6.