CN113067755A

CN113067755A - Method and system for remotely controlling intelligent household equipment through voice

Info

Publication number: CN113067755A
Application number: CN201911294820.5A
Authority: CN
Inventors: 袁海; 张继东; 储颖; 褚海飞
Original assignee: Tianyi Smart Family Technology Co Ltd
Current assignee: Tianyi Digital Life Technology Co Ltd
Priority date: 2019-12-16
Filing date: 2019-12-16
Publication date: 2021-07-02

Abstract

The invention provides a method and a system for remotely controlling an intelligent home through voice. Set up SIP voice communication module in intelligent audio amplifier, the user dials preset's telephone number through landline telephone or cell-phone, calls out and connects intelligent audio amplifier, through the identity authentication back, and the calling telephone issues control command through the speech mode, realizes long-range control to the intelligent household equipment in the family to promote intelligent household control's flexibility, convenience.

Description

Method and system for remotely controlling intelligent household equipment through voice

Technical Field

The invention relates to intelligent household equipment control, in particular to a method and a system for remotely controlling intelligent household equipment through voice.

Background

At present, management and control of intelligent home devices generally involve accessing various intelligent home devices to a network through modes such as WIFI, Zigbee and bluetooth, and connecting the various intelligent home devices to a unified intelligent home device management platform, so that associated management and control of the intelligent home devices are achieved. The user can realize the remote control to intelligent household equipment through the APP on the terminal (for example, cell-phone, iPAD, portable computer etc.), for example connect the long-range intelligent desk lamp of opening at home through cell-phone APP connection internet. In addition, the user can also control the intelligent household equipment in the near-field range of the family residence and the like through voice, for example, the intelligent desk lamp is turned off through the voice control of the intelligent sound box at home.

The two modes are now popular implementation modes for controlling the intelligent household equipment. However, voice-controlled smart homes are limited by the pickup distance of a voice-controlled access device (e.g., a microphone), and cannot be controlled beyond a certain range. Remote control via the APP on the terminal relies on network connectivity, limited by network conditions. Therefore, when a user is not at home, uses a terminal that cannot be installed with an APP, or the terminal cannot be networked due to network abnormality, it is difficult to implement smart home device control by the existing method.

Therefore, it is desirable to provide a scheme capable of remotely controlling the smart home devices through voice.

Disclosure of Invention

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

The invention provides a method and a system for remotely controlling intelligent household equipment by voice. Set up SIP voice communication module in intelligent audio amplifier, the user dials preset's telephone number through landline telephone or cell-phone, calls out and connects intelligent audio amplifier, through the identity authentication back, and the calling telephone issues control command through the speech mode, realizes long-range control to the intelligent household equipment in the family to promote intelligent household control's flexibility, convenience.

According to an embodiment of the present invention, there is provided a method implemented at a smart speaker for remotely controlling smart home devices, the method including: establishing a connection with the calling end equipment based on the IMS network to connect an incoming call from the calling end equipment; if the identity authentication of the calling party equipment is successful, acquiring a voice signal sent by the calling party, wherein the voice signal can be converted into a control instruction to control the intelligent household equipment; and if the identity authentication of the calling user is unsuccessful, interrupting the voice control connection with the calling terminal equipment.

According to an embodiment of the present invention, there is provided a smart speaker including: a memory; a processor; an input device; an output device; a voice communication module based on SIP protocol, the voice communication module configured to communicate with the calling end device through the IMS network; the voice acquisition module is configured to acquire a voice signal sent by a calling user of the calling terminal equipment.

According to an embodiment of the present invention, there is provided a system for voice-controlling smart home devices, the system including: the intelligent sound box is as above; the voice semantic platform receives a user voice signal sent by the intelligent sound box and carries out voice semantic recognition on the received user voice signal so as to generate a control instruction corresponding to the user voice signal; and the intelligent home control platform is configured to receive the control instruction from the voice semantic recognition platform and forward the control instruction to the intelligent home equipment intelligent home control platform appointed in the control instruction.

By adopting the method and the system disclosed by the invention, the telephone initiates a voice call to the household intelligent sound box, and the fixed telephone and the mobile phone can be used as calling parties, so that the limits of distance and range are broken through, and the remote control of the voice mode of the intelligent household equipment is realized.

These and other features and advantages will become apparent upon reading the following detailed description and upon reference to the accompanying drawings. It is to be understood that both the foregoing general description and the following detailed description are explanatory only and are not restrictive of aspects as claimed.

Drawings

So that the manner in which the above recited features of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only some typical aspects of this invention and are therefore not to be considered limiting of its scope, for the description may admit to other equally effective aspects.

Fig. 1 is a schematic flow chart illustrating a method for controlling an intelligent home device by using voice calls according to an embodiment of the present invention;

FIG. 2 is a block diagram illustrating a schematic structure of a smart sound box 200 according to an embodiment of the present invention;

fig. 3 is a block diagram illustrating a structure of a system 300 for controlling smart home devices through voice according to an embodiment of the present invention.

Detailed Description

The present invention will be described in detail below with reference to the attached drawings, and the features of the present invention will be further apparent from the following detailed description.

The invention connects the intelligent sound box in the house through telephone calling such as a fixed telephone, a mobile phone and the like, and then issues a control instruction in a voice mode, thereby realizing remote control of the intelligent household equipment in the house. Compared with the prior art, the method breaks through the limitation that voice can only control the smart home within the near-field range, and can control the smart home in a voice mode even if a user is not at home. Meanwhile, the method for remotely controlling the smart home by the terminal such as the mobile phone is supplemented, and when the user does not have the smart phone or the mobile phone does not have a network, the smart home can still be controlled in a telephone voice mode.

Fig. 1 is a flowchart illustrating a method 100 for controlling a smart home device through voice according to an embodiment of the present invention. In step S1, the calling user dials a predetermined phone number to call the smart speaker. Through this telephone call, the calling party can communicate with the smart speaker. According to one embodiment, based on an IMS network, an SIP voice communication module is arranged in the intelligent sound box, and a telephone number is preset. The calling user can dial the preset telephone number through a calling terminal device (such as a fixed telephone or a mobile phone) to establish communication connection with the intelligent sound box.

In step S2, the calling user selects the smart home device control function. And when the intelligent sound box is connected with the call, playing a voice prompt to the calling user. The voice prompt prompts the calling user to select among a plurality of options. The plurality of options include, for example: (1) selecting an incoming call to answer; (2) selecting voice control, etc. The calling user may make the selection by a key press or voice input. When the calling user selects 'incoming call answering', the smart sound box sends out a ringing tone, so that a home user nearby the smart sound box is informed of an incoming call, and the home user can answer the call to communicate with the calling user. When the caller selects "voice control," the smartspeaker does not sound a ringing tone, and method 100 proceeds to step S3.

According to an embodiment of the present invention, step S2 is optional. The smart speaker may be preset to default to incoming call answering (e.g., no other smart home devices in the user's home, only using the smart speaker as a phone) or to default to voice control (e.g., no other members in the user's home), so that the user may not have to make a selection every time.

After the caller selects voice control, the caller is authenticated at step S3. If the authentication is successful, the smart speaker prompts the calling user to issue a voice control instruction (such as the smart speaker prompts "authentication is successful, please speak a control instruction"). If the identity authentication is unsuccessful, the intelligent sound box can prompt the calling user that the calling is failed and interrupt the voice control connection of the calling terminal equipment. According to one embodiment of the invention, the identity authentication can be implemented by the smart speaker. According to another embodiment of the present invention, the identity authentication function may be implemented by a smart speaker management platform connected to the smart speaker.

The identity authentication of the calling subscriber can be performed in a number of ways. According to one embodiment of the invention, voiceprint information in telephone voice can be compared and matched with the voiceprint information of the calling party which is recorded or registered in advance, if the matching is successful, the identity authentication of the calling party is successful, and the calling party is allowed to enter a voice control link; if the matching fails, the calling user is prompted to call failure, and the voice control connection of the calling terminal equipment is interrupted. For example, voiceprint information in telephone speech can be extracted from one of: (1) voice input made by the calling user in step S2; (2) the caller responds to the voice input (such as the smart speaker prompting "please say the control instruction", the caller says "please turn on the rice cooker") which is made by the smart speaker prompting the caller to perform the identity authentication in a voice manner.

According to yet another embodiment of the present invention, the calling user may be prompted to provide the "Account + password" combination information by a telephone push button or voice input. The "account + password" combination information can be compared and matched with the account information pre-recorded or registered by the calling user. If the matching is successful, the identity authentication of the calling user is successful, and the calling user is allowed to enter a voice control link; if the matching fails, the calling user is prompted to call failure, and the voice control connection of the calling terminal equipment is interrupted.

According to another embodiment of the present invention, the number information of the calling party can be bound with the smart speaker in advance. When the identity authentication is carried out on the calling user, the number information of the calling telephone is compared and matched with the number information bound in advance. If the matching is successful, the identity authentication of the calling user is successful, and the calling user is allowed to enter a voice control link; if the matching fails, the calling user is prompted to call failure, and the voice control connection of the calling terminal equipment is interrupted. In one embodiment, after matching the number information of the calling phone with the pre-bound number, the calling user is required to input a preset password through a phone key or voice to improve the accuracy of authentication.

If the identity authentication is successful, the method 100 proceeds to step S4. In step S4, the voice control instruction from the calling user collected in step S3 is recognized to generate a control instruction. According to one embodiment of the invention, the smart sound box may send (such as through a network) the collected voice signal to the voice semantic platform, and the voice signal is recognized by the voice semantic platform and corresponding control instructions are generated.

In step S5, the generated control command is sent to the smart home management platform to control the smart home device to work. According to one embodiment of the invention, the voice semantic platform sends the generated control instruction to the intelligent home management platform (for example, through a network), and the intelligent home management platform sends the control instruction to the intelligent home equipment specified in the control instruction through the network, so as to control the intelligent home equipment to work. For example, after receiving a control instruction of "opening an electric cooker" sent by a user, the smart home management platform transmits the control instruction to the electric cooker, so that the electric cooker is opened.

Through the method 100, a user can call to connect to a home smart speaker through a telephone, and then send an instruction through voice to remotely control home smart home devices.

Fig. 2 is a block diagram illustrating a schematic structure of a smart sound box 200 according to an embodiment of the present invention. Any components in smart sound box 200 may communicate with any other components, but not all connections are shown for ease of illustration.

The smart sound box 200 is provided with a voice communication module 201 based on the SIP protocol, and can communicate with a general telephone through an IMS network. The voice communication module 201 sends the voice instruction of the user to the voice acquisition module 202 in the smart sound box 200, and the voice acquisition module continuously performs voice acquisition and sends the voice instruction to the voice semantic recognition platform for voice recognition to generate a control instruction.

Optionally, smart sound box 200 may further include an identity authentication module 203 to authenticate the identity of the calling user, such as by one or more of voiceprint recognition, account number + password verification, bound number + password verification, and the like.

Smart sound box 200 may include memory 204. Memory 204 may be used to store data and/or code for use by smart sound box 200. For example, memory 204 may store pre-registered or recorded voiceprint information of the calling user, a pre-registered account and password of the calling user, a phone number pre-bound to smart sound box 200, and other information.

Smart sound box 200 may also include a controller or processor 205 (e.g., a signal processor, microprocessor, ASIC, or other control and processing logic circuitry) for performing various tasks such as signal encoding, data processing, input/output processing, power control, and/or other functions. Smart sound box 200 may support one or more input devices 206, such as a touch screen, a microphone (e.g., for picking up voice information of a home user), a camera, and/or physical keys or a keyboard, and one or more output devices 207, such as a speaker (e.g., for playing an incoming ringtone, etc.) and a display.

Fig. 3 shows a block diagram illustrating a structure of a system 300 for controlling smart home devices by voice according to an embodiment of the present invention. Referring to fig. 3, the system 300 may include one or more of a smart sound box 302, a smart sound box management platform 305, a speech semantic recognition platform 307, a smart home control platform 308, and a smart home device 309.

According to an embodiment of the present invention, a landline or mobile phone may be used as the calling-end device 301. Smart sound box 302 is provided with a voice communication module 303 based on SIP protocol, and can communicate with calling end device 301 (such as a normal telephone) through an IMS network.

According to one embodiment of the invention, the user dials the preset telephone number of the smart sound box 302 through the calling device 301, calls the smart sound box, and establishes a communication connection with the smart sound box. After the voice communication module 303 in the smart speaker 302 is connected to a call, a voice prompt is played, so that a calling user can select "answer the incoming call" or "voice control" by pressing a key or inputting voice. In the case where the caller selects "answer by listening", smart sound box 302 can play a ring tone to prompt the family members to answer the call. Through the voice communication module 303, the family member can perform telephone communication with the calling user.

In the case where the caller selects "voice control" smart home device, smart speaker 302 sends the caller telephone information to smart speaker management platform 305. Smart speaker management platform 305 includes an identity authentication module 306 to authenticate the identity of the calling user, such as by one or more of voiceprint recognition, account number + password verification, bound number + password verification, and the like. As described above with reference to fig. 2, if smart sound box 302 itself includes an identity authentication function, then caller phone information need not be sent to smart sound box management platform 305.

After the identity authentication is successful, the calling party is prompted to send a voice control instruction, and the voice acquisition module 304 in the smart sound box 302 is responsible for continuously acquiring the voice signal sent by the calling party. After the caller completes inputting the voice signal, the smart sound box 302 sends the voice signal collected by the voice collection module 304 to the voice semantic platform 307 (e.g., via a network), and the voice semantic platform 307 performs semantic recognition on the received voice signal to generate a corresponding control instruction.

The voice semantic recognition platform 307 or the smart sound box 302 sends the generated control instruction to the smart home management platform 308 through the network. The smart home management platform 308 forwards the received control instruction to the smart home device 309 specified in the control instruction, thereby implementing control over the smart home device 309.

In summary, the invention provides that an SIP voice communication module is arranged in an intelligent sound box to realize the voice connection between a telephone and the intelligent sound box; and the intelligent sound box is used as an intermediate node to receive, recognize and transmit voice instructions, so that remote control over the intelligent home is realized, and the limitation that voice can only control the intelligent home in a near-field range is broken through. In addition, a method for remotely controlling the smart home is provided for people using non-smart phones such as children and the old, so that wider people can conveniently use the smart home equipment. Meanwhile, effective emergency measures are provided for special conditions that the smart phone network is abnormal and the smart home equipment cannot be connected with the network, and the smart home equipment can be remotely controlled through telephone voice under the condition that the smart phone network does not exist.

Although the various aspects of the present invention have been described thus far with reference to the accompanying drawings, the above-described methods, systems, and apparatuses are merely examples, and the scope of the present invention is not limited to these aspects but only by the appended claims and equivalents thereof. Various components may be omitted or may be replaced with equivalent components. In addition, the steps may also be performed in a different order than described in the present invention. Further, the various components may be combined in various ways. It is also important that as technology develops that many of the described components can be replaced by equivalent components appearing later.

Claims

1. A method implemented at a smart speaker for remotely controlling smart home devices, comprising:

establishing a connection with a calling end device based on an IMS network to connect an incoming call from the calling end device;

if the identity authentication of the calling party equipment is successful, acquiring a voice signal sent by the calling party, wherein the voice signal can be converted into a control instruction to control the intelligent household equipment; and

and if the identity authentication of the calling user is unsuccessful, interrupting the voice control connection with the calling terminal equipment.

2. The method of claim 1, wherein the calling device comprises a landline or a cell phone.

3. The method of claim 1, wherein the method further comprises: when the smart speaker is connected to the incoming call, prompting the calling user to select among smart home device control functions, the control functions including: (1) answering the incoming call; (2) and (5) voice control.

4. The method of claim 3, wherein the method further comprises: if the calling user selects to answer the incoming call, the intelligent sound box sends a ringing tone; and if the calling user selects voice control, performing identity authentication on the calling user.

5. The method of claim 4, wherein authenticating the identity of the calling user is accomplished by one or more of: (1) comparing the voiceprint characteristics of the calling user with the pre-recorded voiceprint information of the calling user; (2) comparing the account number and the password input by the calling user with pre-recorded information; (3) and comparing the number information of the calling user with the number information pre-bound to the intelligent sound box.

6. The method of claim 1, wherein the method further comprises: and sending the collected voice signals to a voice semantic platform for voice semantic recognition so as to generate control instructions corresponding to the voice signals, wherein the voice semantic platform sends the generated control instructions to an intelligent home management platform so as to control the intelligent home equipment appointed in the control instructions.

7. A smart sound box, comprising:

a memory;

a processor;

an input device;

an output device;

a voice communication module based on SIP protocol, the voice communication module configured to communicate with a calling end device through an IMS network; and

a voice acquisition module configured to acquire a voice signal emitted by a calling user of the calling end device.

8. The smart sound box of claim 7, wherein the calling end device comprises a landline telephone or a cellular telephone.

9. The smart sound box of claim 7, further comprising: an identity authentication module configured to authenticate the identity of the calling user.

10. A system for voice-controlling smart-home devices, comprising:

the smart sound box of claim 8;

the voice semantic platform receives the user voice signal sent by the intelligent sound box and carries out voice semantic recognition on the received user voice signal so as to generate a control instruction corresponding to the user voice signal; and

an intelligent home control platform configured to receive the control instructions from the speech semantic recognition platform and forward the control instructions to the intelligent home devices specified in the control instructions.