CN110890094A - Internet of things device voice control method and voice server - Google Patents

Abstract

The invention discloses a voice control method and a voice server of an Internet of Things device. In the method, a voice control request determined based on the main control device of the Internet of Things is obtained, and the voice control request includes a voice message, target device user information and target device area configuration information; a target device list corresponding to the target device user information is determined, and the target device The device list includes multiple controlled device information under multiple device area configuration information for the target device user information; the target controlled device information is determined from the target device list based on the target device area configuration information; based on the voice message, the target controlled device information is The target IoT controlled device corresponding to the controlled device information is controlled. Therefore, the controlled devices in different areas under the user can be separately controlled by voice, which expands the application scenarios of the voice control scheme.

Description

Internet of things device voice control method and voice server

technical field

The invention belongs to the technical field of the Internet of Things, and in particular relates to a voice control method of an Internet of Things device and a voice server.

Background technique

With the continuous development of voice processing technology and Internet technology, using voice to control devices (especially Internet of Things devices) to improve user experience has become a major trend in current technological development.

At present, for the control operation of IoT devices, all IoT (Internet of Things, IoT) smart devices under the user account are generally controlled by analyzing the user's voice message processing operations, and it is impossible to control different IoT devices of the same user. Take personal control. However, in some application scenarios (such as a hotel smart home scenario), it may be necessary to independently control the IoT devices in multiple rooms under the hotel user.

For the above problems, there is currently no better solution in the industry.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a voice control method and a voice server for an Internet of Things device, which are used to solve at least one of the above technical problems.

In a first aspect, an embodiment of the present invention provides a voice control method for an IoT device, which is applied to a voice server. The method includes: acquiring a voice control request determined based on an IoT master control device, where the voice control request includes a voice message , target device user information and target device area configuration information; determine a target device list corresponding to the target device user information, and the target device list includes multiple device area configuration information for the target device user information. information of a controlled device; determine target controlled device information from the target device list based on the target device area configuration information; based on the voice message, determine the target controlled device information corresponding to the target controlled device equipment is controlled.

In a second aspect, an embodiment of the present invention provides a voice server, including: an obtaining unit configured to obtain a voice control request determined based on a master control device of the Internet of Things, where the voice control request includes a voice message and target device user information and target device area configuration information; the user equipment determination unit is configured to determine a target device list corresponding to the target device user information, where the target device list includes configuration information in multiple device areas for the target device user information a plurality of controlled device information under the target controlled device; a target controlled device determination unit is configured to determine target controlled device information from the target device list based on the target device area configuration information; a manipulation unit is configured to be based on the The voice message is used to control the target IoT controlled device corresponding to the target controlled device information.

In a third aspect, an embodiment of the present invention provides an electronic device, comprising: at least one processor, and a memory communicatively connected to the at least one processor, wherein the memory stores information that can be used by the at least one processor Executable instructions that are executed by the at least one processor to enable the at least one processor to perform the steps of the above-described method.

In a fourth aspect, an embodiment of the present invention provides a storage medium on which a computer program is stored, and when the program is executed by a processor, implements the steps of the above method.

The beneficial effect of the embodiment of the present invention is that: the voice server obtains the voice control request from the main control device of the Internet of Things, calls the corresponding device list through the user information of the target device in the voice control request, and configures the area of the target device through the voice control request. The information determines the controlled device information in the corresponding area from the device list, and then controls the IoT controlled device indicated by the controlled device information. Therefore, the user can perform voice control on the controlled devices in different areas under the user. The application scenarios of the voice control scheme are presented. In addition, there is no need to include region information in the user's voice message, which improves the user's voice control experience.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

1 shows a flowchart of an example of a method for voice control of an Internet of Things device applied to a voice server according to an embodiment of the present invention;

FIG. 2 shows a signal flow diagram of an example of a voice control method for an IoT device according to an embodiment of the present invention;

FIG. 3 shows a signal flow diagram of an example of a voice control method for an IoT device according to an embodiment of the present invention;

4 shows a flowchart of an example of a process for determining a device list according to an embodiment of the present invention;

FIG. 5 shows a flowchart of an example of a method for voice control of an IoT device according to an embodiment of the present invention;

FIG. 6 shows a structural block diagram of an example of a voice server according to an embodiment of the present invention.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

It should be noted that the embodiments in the present application and the features of the embodiments may be combined with each other in the case of no conflict.

The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, elements, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including storage devices.

In the present invention, "module", "system" and the like refer to a related entity applied to a computer, such as hardware, a combination of hardware and software, software or software in execution, and the like. In detail, for example, an element may be, but is not limited to, a process running on a processor, a processor, an object, an executable element, a thread of execution, a program, and/or a computer. Also, an application program or script program running on the server, and the server can be a component. One or more elements may be in a process and/or thread of execution and an element may be localized on one computer and/or distributed between two or more computers and may be executed from various computer readable media . Elements may also pass through a signal having one or more data packets, for example, a signal from one interacting with another element in a local system, in a distributed system, and/or with data interacting with other systems through a network of the Internet local and/or remote processes to communicate.

Finally, it should also be noted that, in this text, the terms "comprising" and "comprising" include not only those elements, but also other elements not explicitly listed, or also include such process, method, article or elements inherent to the device. Without further limitation, an element defined by the phrase "comprises" does not preclude the presence of additional identical elements in a process, method, article, or device that includes the element.

FIG. 1 shows a flowchart of an example of a method for voice control of an IoT device applied to a voice server according to an embodiment of the present invention. Here, on the one hand, the voice server can refer to a server that only provides voice recognition services, and on the other hand, it can also refer to a server that integrates voice recognition services and other services (such as IoT control or operation services).

As shown in FIG. 1, the voice control method 100 of the Internet of Things device includes:

Step 110: Acquire a voice control request determined based on the main control device of the Internet of Things. Here, the voice control request includes a voice message, target device user information, and target device area configuration information. Exemplarily, the speaker object may speak a voice message to the IoT master device to expect to control the corresponding IoT controlled device. It should be understood that, in some application scenarios, the IoT controlled device may also be the IoT master device itself, which should not be limited here. In addition, target device user information (eg, "XX Hotel", and the IoT master device in a room in the hotel can be controlled independently) and target device area configuration information (eg, "Room 102", thereby Only the devices in the room 102 are controlled) may be pre-configured on the IoT master device and integrated with the received voice messages to generate corresponding voice control requests.

It should be noted that the voice server can directly receive the voice control request from the main control device of the Internet of Things, or it can also obtain the voice control request from other devices (for example, the Internet of Things operator), and both belong to the protection of the present invention. within the range.

Step 120: Determine a target device list corresponding to the user information of the target device. Here, the target device list includes a plurality of controlled device information under a plurality of device area configuration information for the target device user information. For example, the device list for "Hotel A" has controlled device information ( For example, device physical address, etc.).

In an example of this embodiment, at least one device list may be stored at the voice server, so that the target device list for the user information of the target device may be locally determined. In another example of this embodiment, the voice server may also acquire the controlled device information from other devices (for example, an IoT operator).

Step 130: Determine the target controlled device information from the target device list based on the target device area configuration information. For example, device information in the room may be determined based on "room 101".

Step 140: Control the target IoT controlled device corresponding to the target controlled device information based on the voice message. Specifically, the voice control intent information corresponding to the voice message (for example, turning off the light) can be determined, and the target IoT controlled device corresponding to the target controlled device information can be controlled according to the voice control intent information. In some application scenarios, the voice control intent information may be "turn off the light" corresponding to the voice message, and the user can directly operate the light (for example, in the XX room) without saying "turn off the light in the XX room". Improved user experience.

In an example of this embodiment, the voice server may directly control the target IoT controlled device. In another example of this embodiment, the voice server may also send a control command to a central control device (eg, an operation server), so that the central control device controls the target IoT controlled device.

As shown in FIG. 2 , the signal flow of the voice control method for an IoT device according to an embodiment of the present invention involves signals between the speaker, the IoT master control device 10 , the IoT controlled device 20 and the voice server 30 . interactive process.

Specifically, in step 201, the speaker speaks to the main control device 10 of the Internet of Things.

In step 202, after the IoT master device 10 receives the voice message, the voice control request may be determined according to the voice message, target device user information and target device area configuration information. Here, the target device user information and the target device area configuration information may be pre-configured in the IoT master device (eg, pre-configured by a user).

In step 203 , the Internet of Things main control device 10 sends the voice control request to the voice server 30 .

In step 2041, the voice server 30 may determine the voice control intention information corresponding to the voice message. For example, it can be determined that the voice control intention information corresponding to the voice message is "turn off the lights".

In step 2042, the voice server 30 may determine the target controlled device information. Specifically, the voice server 30 can realize the target controlled device information corresponding to the target device area by combining the operations described in FIG. 1 .

In step 205, the voice server 30 may control the target IoT controlled device corresponding to the target controlled device information according to the voice control intention information. Exemplarily, the voice server 30 may send a manipulation instruction (eg, an instruction to turn off the lights) to the IoT controlled device 20 (eg, the lights in the room 102 ).

As shown in FIG. 3 , a signal flow of a voice control method for an IoT device according to an embodiment of the present invention is shown. In step 301, the speaker sends a voice message to the IoT master device 10.

Next, in step 302, the IoT master device 10 determines a voice control request.

Next, in step 303 , the IoT main control device 10 sends a voice control request to the voice server 30 .

Next, in step 304, the voice server determines the voice control intention information corresponding to the voice message.

For the operations of steps 301 to 304, reference may be made to the operations described in the other embodiments above, which will not be repeated here.

Next, in step 305 , the voice server 30 sends the user information of the target device to the IoT operator 40 . Here, multiple device lists are stored at the IoT operator, for example, each user may register for each IoT controlled device in different areas managed by the user. Moreover, the IoT operator 40 may query the corresponding target device list.

Next, in step 306 , the voice server 30 receives a target device list corresponding to the user information of the target device from the IoT operator 40 . For example, the IoT operator 40 may call the target device list by traversing the query.

Next, in step 307, the voice server 30 determines the corresponding target controlled device information based on the target device list and the target device area configuration information.

Next, in step 308 , the voice server 30 determines a control request instruction for indicating the voice control intention information and target controlled device information, and sends the control request instruction to the IoT operator 40 . Here, the control request instruction conforms to the communication protocol for the IoT operator 40, for example, the communication protocol agreed upon by the implementation.

Next, in step 309, the IoT operator 40 sends a manipulation instruction to the IoT controlled device 20 to control the target IoT controlled device according to the control request instruction.

FIG. 4 shows a flowchart of an example of a process for determining a device list according to an embodiment of the present invention.

As shown in FIG. 4, in step 410, a plurality of IoT controlled device information corresponding to the device user information of the device list to be configured is determined. For example, the Internet of Things controlled device information of each hotel (hotel A, hotel B) is configured on the voice server. When the voice server constructs a request for the device list of hotel A, hotel A (ie, device user information) can be determined. Corresponding information of each IoT controlled device. Here, the IoT controlled device information corresponding to the device user information can be obtained from the IoT controlled device service provider.

In some embodiments, each IoT-controlled device under the user, such as lamps and curtains in Hotel A, may be of different brands. In this case, authorization from multiple IoT-controlled device service manufacturers may be required to determine the corresponding Device List. Specifically, each manufacturer's IoT controlled device information set may be acquired based on each manufacturer's information interface provided by each device manufacturer. Here, the manufacturer's IoT controlled device information set includes the IoT controlled device information for the manufacturer's device type corresponding to a plurality of user information. Further, a plurality of Internet of Things controlled device information corresponding to the device user information may be determined based on the acquired information sets of each user Internet of Things controlled device.

Here, when determining the device list, it is necessary to perform operations on each IoT master device under Hotel A, for example, on the master speakers in each room in Hotel A. Moreover, operations such as steps 420 to 440 may be performed for each IoT master device under the device user information.

In step 420, an area configuration request for the IoT master device is obtained, where the area configuration request includes device area configuration information. Exemplarily, the voice server receives an area configuration request for one of the master speakers of Hotel A (for example, the speaker located in room 301), and the area configuration request includes device area configuration information "room 301".

In step 430, a selection instruction for at least one of the pieces of IoT-controlled device information is obtained. Exemplarily, a hotel manager may select "room 301" (ie, area configuration information) for each piece of IoT-controlled device information corresponding to Hotel A.

In step 440, it is determined that the selected at least one device area configuration information corresponds to the device area configuration information in the area configuration request. Exemplarily, each IoT-controlled device (eg, lamps, curtains, etc.) and the main control device under Hotel A may be configured for the device area configuration information.

In step 450, a device list for the device user information is determined based on the device area configuration information corresponding to each IoT controlled device information. Illustratively, a list of devices for Hotel A may be obtained. Thus, the device list can be used to perform voice control on the IoT-controlled devices in a specific area corresponding to a specific user.

In an example of this embodiment, the IoT master device may send device user information, device area configuration information, and corresponding IoT controlled device information to the voice server, so as to construct at least one device list on the voice server . In another example of this embodiment, the IoT master device may send device user information, device area configuration information, and corresponding IoT controlled device information to the IoT operator, so as to construct at least the IoT operator A list of devices.

FIG. 5 shows a flowchart of an example of a method for voice control of an IoT device according to an embodiment of the present invention.

As shown in FIG. 5, in step 510, the user configures the controlled area. Exemplarily, the user can configure the controlled area information, such as "living room", "bedroom" and so on, on the speaker with screen or the APP.

In step 520, the speaker may issue a voice command to the speaker.

In step 530, the speaker can upload the user's audio to the intelligent voice platform, together with the area information previously set by the user.

In step 540, after the audio request is made by the intelligent voice platform, a request for obtaining a list of all controllable devices of a specific user is sent to the IOT intelligent device platform, and the user information (TOKEN) is attached.

In step 550, the intelligent voice platform filters the acquired device list according to the area information corresponding to the previous voice command, and finds the device to be controlled from the filtered list.

In step 560, the intelligent voice platform sends the control instruction of the specific device to the IOT intelligent device platform according to the format agreed in the smart home protocol.

In step 570, the IOT smart device platform completes the control of the smart device and returns a response.

In step 580, the intelligent voice platform returns the result to the intelligent speaker according to the response result, so that the speaker performs the broadcasting operation.

In the embodiment of the present invention, the Internet of Things devices in a specific area can be controlled without the need for the speaker to include specific location information in the speech, which has better user experience. Moreover, it is especially applicable in some application scenarios, such as restricting the control of only devices in a certain room, while the devices in other rooms of the user cannot be controlled. Exemplarily, in a children's education scenario, there is a master smart speaker in the whole house that can control the devices in the whole house, and there is a tablet computer in the children's room, which is only allowed to control the devices in the children's room. In addition, in the hotel scene, each room in the hotel is equipped with a smart speaker, and each speaker can only control the smart devices in its own room.

As shown in FIG. 6 , a voice server 600 according to an embodiment of the present invention includes an acquisition unit 610 , a user equipment determination unit 620 , a target controlled device determination unit 630 , and a manipulation unit 640 .

The obtaining unit 610 obtains a voice control request determined based on the main control device of the Internet of Things, where the voice control request includes a voice message, target device user information and target device area configuration information.

The user equipment determining unit 620 determines a target device list corresponding to the target device user information, where the target device list includes multiple controlled device information under multiple device area configuration information for the target device user information.

The target controlled device determining unit 630 determines target controlled device information from the target device list based on the target device area configuration information.

The control unit 640 controls the target IoT controlled device corresponding to the target controlled device information based on the voice message.

The voice server and the Internet of Things main control device of the above embodiments of the present invention can be used to execute the corresponding method embodiments of the present invention, and correspondingly achieve the technical effects achieved by the above method embodiments of the present invention, which will not be repeated here.

In the embodiment of the present invention, the relevant functional modules may be implemented by a hardware processor (hardware processor).

On the other hand, an embodiment of the present invention provides a storage medium on which a computer program is stored, and the program is executed by a processor to execute the steps of the above method for voice control of an Internet of Things device.

The above product can execute the method provided by the embodiments of the present application, and has functional modules and beneficial effects corresponding to the execution method. For technical details not described in detail in this embodiment, reference may be made to the methods provided in the embodiments of this application.

The clients of the embodiments of the present application exist in various forms, including but not limited to:

(1) Mobile communication equipment: This type of equipment is characterized by having mobile communication functions, and its main goal is to provide voice and data communication. Such terminals include: smart phones (eg iPhone), multimedia phones, feature phones, and low-end phones.

(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has the characteristics of mobile Internet access. Such terminals include: PDAs, MIDs, and UMPC devices, such as iPads.

(3) Portable entertainment equipment: This type of equipment can display and play multimedia content. Such devices include: audio and video players (eg iPod), handheld game consoles, e-books, as well as smart toys and portable car navigation devices.

(4) Other electronic devices with data interaction function.

The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

From the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, and certainly can also be implemented by hardware. Based on this understanding, the above-mentioned technical solutions can be embodied in the form of software products in essence, or the parts that make contributions to related technologies, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic disks , optical disc, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the methods described in various embodiments or some parts of the embodiments.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions recorded in the foregoing embodiments, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (9)

1. A voice control method of Internet of things equipment is applied to a voice server and comprises the following steps:

acquiring a voice control request determined based on the Internet of things master control equipment, wherein the voice control request comprises voice messages, target equipment user information and target equipment area configuration information;

determining a target device list corresponding to the target device user information, wherein the target device list comprises a plurality of pieces of controlled device information under a plurality of pieces of device area configuration information aiming at the target device user information;

determining target controlled device information from the target device list based on the target device zone configuration information;

and controlling the target Internet of things controlled equipment corresponding to the target controlled equipment information based on the voice message.

2. The method of claim 1, wherein the controlling, based on the voice message, the target internet-of-things controlled device corresponding to the target controlled device information comprises:

determining voice control intention information corresponding to the voice message;

and controlling the target Internet of things controlled equipment corresponding to the target controlled equipment information according to the voice control intention information.

3. The method of claim 1, wherein the determining the target device list corresponding to the target device user information comprises:

sending the target equipment user information to an Internet of things operation terminal so as to be used for the Internet of things operation terminal to inquire a corresponding target equipment list, wherein the Internet of things operation terminal stores a plurality of equipment lists corresponding to a plurality of equipment user information;

receiving the target device list corresponding to the target device user information from the internet of things operator.

4. The method of claim 2, wherein controlling the target internet-of-things controlled device corresponding to the target controlled device information according to the voice control intention information comprises:

determining a control request instruction for indicating the voice control intention information and the target controlled equipment information, wherein the control request instruction conforms to a communication protocol for an operation terminal of the Internet of things;

and sending the control request instruction to the Internet of things operation terminal so that the Internet of things operation terminal controls the target Internet of things controlled equipment according to the control request instruction.

5. The method of claim 1, wherein before determining the target device list to which the target device user information corresponds, the method further comprises:

determining a plurality of pieces of controlled equipment information of the internet of things corresponding to the equipment user information;

for each internet of things master device under the device user information,

obtaining a region configuration request about the IOT master device, wherein the region configuration request comprises device region configuration information,

obtaining a selection instruction for at least one of the plurality of internet of things controlled device information,

determining that the selected at least one device zone configuration information corresponds to the device zone configuration information in the zone configuration request;

and determining an equipment list aiming at the equipment user information based on the equipment area configuration information corresponding to the controlled equipment information of each Internet of things.

6. The method of claim 5, wherein the plurality of Internet of things controlled device information corresponds to a plurality of different device service vendors, the determining the plurality of Internet of things controlled device information corresponding to device user information comprising:

acquiring an internet of things controlled device information set of each manufacturer based on each manufacturer information interface provided by each device service manufacturer, wherein the internet of things controlled device information set of each manufacturer comprises internet of things controlled device information corresponding to a plurality of user information and aiming at manufacturer device types;

and determining a plurality of pieces of controlled equipment information of the Internet of things corresponding to the equipment user information based on the acquired information sets of the controlled equipment of the Internet of things of each user.

7. A voice server, comprising:

the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is configured to acquire a voice control request determined based on the Internet of things master control equipment, and the voice control request comprises voice messages, target equipment user information and target equipment area configuration information;

a user equipment determining unit configured to determine a target equipment list corresponding to the target equipment user information, where the target equipment list includes a plurality of pieces of controlled equipment information under a plurality of pieces of equipment area configuration information for the target equipment user information;

a target controlled device determination unit configured to determine target controlled device information from the target device list based on the target device area configuration information;

and the control unit is configured to control the target Internet of things controlled equipment corresponding to the target controlled equipment information based on the voice message.

8. An electronic device, comprising: at least one processor, and a memory communicatively coupled to the at least one processor, wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the method of any of claims 1-6.

9. A storage medium on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.

Images