CN105810194B - Speech-controlled information acquisition methods and intelligent terminal under standby mode - Google Patents

Abstract

The invention discloses a method and an intelligent terminal for acquiring voice control information in a standby state. The method comprises the following steps: collecting voice data according to sampling frequencies in different time periods specified in a voice collecting scheme; configuring data according to preset voice commands Perform feature matching on the voice data to determine whether the voice data is a voice command; in response to a voice command corresponding to the voice data, obtain content information of the type corresponding to the voice command; Voice broadcast of content information. Through the processing of the present invention, the user can obtain information through personalized voice control when the intelligent terminal is in a standby state, which reduces energy consumption and improves the user's human-computer interaction experience and life and work efficiency of voice control.

Description

Voice control information acquisition method and smart terminal in standby state

technical field

The present invention relates to the technical field of voice control, and in particular, the present invention relates to a method for acquiring voice control information in a standby state and an intelligent terminal.

Background technique

With the development of voice recognition technology and intelligent control technology and the popularization of intelligent terminals, as well as people's diverse and personalized needs for human-computer interaction experience, as well as the need to improve life and work efficiency, voice control technology has made great progress. Speech recognition technology, generally implemented by statistical pattern matching technology, is the basic component of speech control technology. Voice control technology, that is, using voice to control the operation of equipment, is faster and more convenient than manual control, and can be used in many fields such as industrial control, voice dialing systems, smart home appliances, and voice-activated smart toys. Voice control technology brings not only changes in human-computer interaction methods and experiences, but more importantly, changes in lifestyles and improvements in work productivity. Voice control has turned the traditional machine operation, which was originally labor-intensive, labor-intensive and time-consuming, into a simple and interesting thing. The maturity of related technologies has also led to the emergence of a series of new intelligent terminals, which make people's work and life more convenient. Its application range And the prospects are getting brighter.

In the prior art, the voice control of the smart terminal requires the user to manually wake up the smart terminal, and then perform the human-computer interaction of the voice control. The voice control of the smart terminal requires the user to open the relevant application or press and hold a function button before voice recognition can be performed to realize voice control. In addition, the intelligent terminal requires the user to input the voice data according to the format and content provided by the intelligent terminal, in order to recognize the voice data, thereby realizing the human-computer interaction of voice control.

However, there are at least the following problems in the prior art: First, the user needs to make the smart terminal in an awake state, manually open a related application or press and hold a function button, in order to perform voice control. This results in that when the user is busy and has no time to manually operate the smart terminal and the terminal is in a standby state, the human-computer interaction of voice control cannot be performed on the terminal; Voice-controlled human-computer interaction experience and life and work efficiency. Secondly, the intelligent terminal can only recognize the voice data input by the user according to the identification and content provided by the intelligent terminal, which reduces the flexibility of voice control and the efficiency of life and work, and it is difficult to meet the growing demand for personalized experience of users.

SUMMARY OF THE INVENTION

The purpose of the present invention is to provide a method for acquiring voice control information in a standby state and an intelligent terminal in view of at least one of the above shortcomings, so that the user can perform voice control on the intelligent terminal when the intelligent terminal is in the standby state, and the user can Customize the logo and content of language instructions to achieve personalized voice control and improve life and work efficiency.

In order to realize this purpose, the present invention adopts following technical scheme:

In a first aspect, an embodiment of the present invention provides a method for acquiring voice control information in a standby state, which is characterized in that it includes the following steps:

Collect voice data according to the sampling frequencies in different time periods specified in the voice collection scheme;

Perform feature matching on the voice data according to preset voice command configuration data, and determine whether the voice data is a voice command;

In response to the voice command corresponding to the voice data, obtain the content information of the corresponding type of the voice command;

A voice broadcast associated with the content information is performed according to the content information.

In conjunction with the first aspect, in the first implementation manner of the first aspect, the present invention further includes the following pre-steps:

In the power-on state, a user interface is displayed for editing the configuration data of the voice command, and the pre-setting of the configuration data is completed accordingly.

With reference to the first aspect or the first implementation manner of the first aspect, in the second implementation manner of the first aspect of the present invention, the voice command configuration data includes the identifier and content of the voice command, and the corresponding content of the voice command. Type of information.

With reference to the first aspect or the first implementation manner of the first aspect, in a third implementation manner of the first aspect of the present invention, the preset is completed by the user through input or selection of voice or text.

In conjunction with the first aspect, in the fourth implementation manner of the first aspect of the present invention, the voice collection scheme specifies the sampling frequency of the voice collected by the intelligent terminal under each time period, and the formulation process of the voice collection scheme comprises the following steps:

Calculate the interaction index of the user in different time periods based on the time distribution of the interaction between the user and the smart terminal;

According to the preset threshold range satisfied by the interaction index of each time period, the sampling frequency corresponding to the threshold range is specified in each time period, and the formulation of the voice collection scheme is completed accordingly.

With reference to the fourth implementation manner of the first aspect, in the fifth implementation manner of the first aspect of the present invention, the interaction behavior includes: the user's manipulation behavior in the wake-up state of the intelligent terminal, the displacement of the intelligent terminal and/or Rotation, the user's voice control behavior when the smart terminal is in standby.

With reference to the fourth implementation manner of the first aspect, in the sixth implementation manner of the first aspect of the present invention, the formulation process of the voice collection scheme further includes: displaying a user interface in a power-on state for setting the threshold range and the sampling frequency corresponding to each threshold range, so as to complete the preset setting of the threshold range.

With reference to the fourth implementation manner of the first aspect, in the seventh implementation manner of the first aspect of the present invention, the intelligent terminal controls the collection of the voice data through a DSP processor.

In combination with the first aspect, in an eighth implementation manner of the first aspect of the present invention, the feature matching process includes:

Retrieve whether the voice data contains the identification in the voice command configuration data, if the identification is not contained, then the voice data is not a voice command, and the retrieval is terminated;

If the identification is contained, then search whether the voice data contains the content in the voice command configuration data, if the voice data is contained, the voice data is a voice command, and the information type corresponding to the content contained in the voice data is determined; If the content is not included, the voice data is not a voice command.

With reference to the eighth implementation manner of the first aspect, in the ninth implementation manner of the first aspect of the present invention, in the process of feature matching, when the voice data and the voice command configuration data are identified or the content is different. When the matching rate is greater than the preset threshold, it is determined that the voice data contains the identification or content; otherwise, it is determined that the voice data does not contain the identification or content.

With reference to the first aspect, in a tenth implementation manner of the first aspect of the present invention, the method for acquiring the content information includes: acquiring the type of content information from an intelligent terminal by invoking a corresponding system command.

In conjunction with the first aspect, in the eleventh implementation manner of the first aspect of the present invention, the method for obtaining the content information further includes: by calling a corresponding interface or communication protocol, a corresponding software or a webpage or a server in the server is executed. One or more kinds of content information of the type are obtained.

In a second aspect, an embodiment of the present invention provides an intelligent terminal, and the intelligent terminal has the function of implementing the method for sending information of one card with multiple numbers in the first aspect. The functions can be implemented by hardware, or can be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

In one possible design, the structure of the smart terminal includes:

Pickup unit: used to collect voice data according to the sampling frequencies in different time periods specified in the voice collection scheme;

Recognition unit: configured to perform feature matching on the voice data according to preset voice command configuration data, and determine whether the voice data is a voice command;

Obtaining unit: used to obtain the content information of the corresponding type of the voice command in response to the voice command corresponding to the voice data;

Broadcasting unit: according to the content information, perform a voice broadcast associated with the content information.

In conjunction with the second aspect, in the first implementation manner of the second aspect, the present invention further includes a preset unit:

It is configured to display a user interface in a power-on state for editing voice command configuration data, and completes the pre-setting of the configuration data accordingly.

In conjunction with the first implementation manner of the second aspect, in the second implementation manner of the second aspect of the present invention, the preset unit is configured to: the voice command configuration data includes the identification and content of the voice command, and the content the corresponding information type.

In conjunction with the first implementation manner of the second aspect, in a third implementation manner of the second aspect of the present invention, the preset unit is configured to: the preset unit is configured by the user through input or selection of voice or text. Finish.

With reference to the second aspect, in a fourth implementation manner of the second aspect of the present invention, in the voice pickup unit, the voice collection scheme specifies the sampling frequency of the voice collected by the intelligent terminal in each time period, and the voice collection scheme The formulation process includes the following steps:

Calculate the interaction index of the user in different time periods based on the time distribution of the interaction between the user and the smart terminal;

According to the preset threshold range satisfied by the interaction index of each time period, the sampling frequency corresponding to the threshold range is specified in each time period, and the formulation of the voice collection scheme is completed accordingly.

With reference to the third implementation manner of the second aspect, in the fifth implementation manner of the second aspect of the present invention, in the sound pickup unit, the interaction behavior includes: the user's manipulation behavior in the wake-up state of the smart terminal, The displacement and/or rotation of the smart terminal, and the user's voice control behavior when the smart terminal is in standby.

With reference to the first implementation manner of the second aspect, in a sixth implementation manner of the second aspect of the present invention, the preset unit is further configured to: display a user interface in a power-on state, so as to set the threshold range and the sampling frequency corresponding to each threshold range, so as to complete the preset setting of the threshold range.

With reference to the third implementation manner of the second aspect, in a seventh implementation manner of the second aspect of the present invention, the sound pickup unit controls the collection of the voice data through a DSP processor.

With reference to the second aspect, in an eighth implementation manner of the second aspect of the present invention, in the identifying unit, the feature matching process includes:

Retrieve whether the voice data contains the identification in the voice command configuration data, if the identification is not contained, then the voice data is not a voice command, and the retrieval is terminated;

If the identification is contained, then search whether the voice data contains the content in the voice command configuration data, if the voice data is contained, the voice data is a voice command, and the information type corresponding to the content contained in the voice data is determined; If the content is not included, the voice data is not a voice command.

With reference to the sixth implementation manner of the second aspect, in the ninth implementation manner of the second aspect of the present invention, in the identification unit, during the feature matching process, when the voice data is configured with the voice command When the matching rate of the identification or content of the data is greater than a preset threshold, it is determined that the voice data contains the identification or content; otherwise, it is determined that the voice data does not contain the identification or content.

With reference to the second aspect, in a tenth implementation manner of the second aspect of the present invention, the acquiring unit is configured to acquire the type of content information from the smart terminal by invoking a corresponding system instruction.

In conjunction with the second aspect, in an eleventh implementation manner of the second aspect of the present invention, the obtaining unit is configured to: by invoking the corresponding interface or communication protocol, one of corresponding software or webpage or server or Several types of content information are obtained.

In a third aspect, an embodiment of the present invention provides an intelligent terminal, which includes:

Touch-sensitive display, used to display the information editing interface and realize human-computer interaction;

one or more processors;

memory;

one or more application programs, wherein the one or more application programs are stored in memory and configured to be executed by the one or more processors;

The one or more programs are used to drive the one or more processors to construct a unit for executing the method for acquiring voice control information in a standby state in the first aspect.

Compared with the prior art, the technical solution provided by the present invention has at least the following advantages:

The present invention makes full use of the characteristics provided by the intelligent terminal and its operating system, firstly, the voice data is collected according to the sampling frequencies in different time periods specified in the voice collection scheme, so that the intelligent terminal can collect the voice data and perform voice recognition in the standby state, and , wherein the voice collection scheme effectively controls the energy consumption by intelligently specifying the voice collection frequency according to the interaction between the user and the intelligent terminal, and improves the energy efficiency of the voice control. On this basis, the present invention further performs feature matching on the voice data according to the preset voice command configuration data to determine whether the voice data is a voice command, so that the user can use diversified and personalized voices to realize voice control. Further, in response to the voice command corresponding to the voice data, the intelligent terminal obtains the content information of the corresponding type of the voice command, and performs a voice broadcast associated with the content information according to the content information, bringing the user a convenient and efficient voice Control the information acquisition experience.

In a nutshell, the implementation of the present invention solves the problem of realizing voice control in the standby state of the intelligent terminal when the user uses the intelligent terminal to obtain voice control information, the problem of energy consumption control, and the inability of the intelligent terminal to carry out personalized voice control. The problem is that the user can obtain information by performing personalized voice control when the smart terminal is in a standby state, which improves the user's human-computer interaction experience and life and work efficiency when performing voice control. However, the book is not exhausting, additional aspects and advantages of the present invention will be set forth in part in the following description, which will be apparent from the following description, or learned by practice of the present invention.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

1 is a schematic flowchart of an embodiment of a method for acquiring voice control information in a standby state according to the present invention;

2 is a schematic flowchart of an embodiment of a method for acquiring voice control information in a standby state in the present invention;

3 is a schematic structural diagram of an embodiment of an intelligent terminal in the present invention;

FIG. 4 is a schematic structural diagram of an embodiment of an intelligent terminal in the present invention.

Detailed ways

In order for those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.

In some of the processes described in the description and claims of the present invention and the above-mentioned drawings, various operations are included in a specific order, but it should be clearly understood that these operations may not be in accordance with the order in which they appear herein. Executed or executed in parallel, the sequence numbers of the operations, such as S10, S11, etc., are only used to distinguish different operations, and the sequence numbers themselves do not represent any execution order. Additionally, these flows may include more or fewer operations, and these operations may be performed sequentially or in parallel. It should be noted that the descriptions such as "first" and "second" in this document are used to distinguish different messages, devices, modules, etc., and do not represent a sequence, nor do they limit "first" and "second" are different types.

It will be understood by those of ordinary skill in the art that the singular forms "a," "an," "said," and "the" as used herein can also include the plural forms unless expressly stated otherwise. It should be further understood that the word "comprising" used in the description of the present invention refers to the presence of stated features, integers, steps, operations, elements and/or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components and/or groups thereof. It will be understood that when we refer to an element as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Furthermore, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combination of one or more of the associated listed items.

It will be understood by one of ordinary skill in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It should also be understood that terms, such as those defined in a general dictionary, should be understood to have meanings consistent with their meanings in the context of the prior art and, unless specifically defined as herein, should not be interpreted in idealistic or overly formal meaning to explain.

Those of ordinary skill in the art can understand that the "terminal" and "smart terminal" used here include both a device of a wireless signal receiver, a device that only has a wireless signal receiver without transmission capability, and a device of receiving and transmitting hardware. A device having receive and transmit hardware capable of bidirectional communication over a bidirectional communication link. Such equipment may include: cellular or other communication equipment, which has a single-line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which can combine voice, data Processing, fax and/or data communication capabilities; PDA (Personal Digital Assistant), which may include a radio frequency receiver, pager, Internet/Intranet access, web browser, notepad, calendar and/or GPS (Global Positioning System) receiver; conventional laptop and/or palmtop computer or other device having and/or including a conventional laptop and/or palmtop computer or other device with a radio frequency receiver. As used herein, "terminal", "smart terminal" may be portable, transportable, mounted in a vehicle (air, marine and/or land), or adapted and/or configured to operate locally, and/or In distributed form, run at any other location on Earth and/or in space. The "terminal" and "smart terminal" used here can also be intelligent terminals, Internet terminals, music/video playback terminals, such as PDA, POS (Point of Sales, sales terminal), MID (Mobile Internet Device, mobile Internet device) and/or a mobile phone with music/video playback function, or smart TV, set-top box and other devices.

Those of ordinary skill in the art can understand that the meanings of the terms involved in the present invention at least include:

Speech Recognition: Also known as Automatic Speech Recognition (ASR), its goal is to convert the lexical content of human speech into computer-readable input, such as keystrokes, binary codes, or character sequences. Including specific person speech recognition system, non-specific person speech recognition system and multi-person recognition system, the method is mainly pattern matching method, the fields involved include: signal processing, pattern recognition, probability theory and information theory, vocal mechanism and auditory mechanism , artificial intelligence, etc.

Voice control: Support natural language voice data input, and control the operation of the device through voice recognition. In smart terminals, voice control can call the time, weather and other information in the terminal, which is faster and more convenient than manual control. Voice control has been used in fields such as industrial control, voice dialing systems, smart home appliances, and voice-activated smart toys.

User Interface (UI): It is the medium for interaction and information exchange between the system and users, which realizes the conversion between the internal form of information and the form acceptable to humans. The user interface is the software designed to communicate with each other between the user and the hardware. The purpose is to enable the user to operate the hardware conveniently and efficiently to achieve two-way interaction and complete the work they want to complete with the help of the hardware. The user interface has a wide range of definitions. It includes human-computer interaction and graphical user interface. User interfaces exist in all fields that participate in the exchange of information between humans and machines, such as preset data editing interfaces.

Standby state: Refers to a smart terminal (such as a mobile phone or computer and other electronic equipment) that is turned on, but does not have any interaction with the user, or does not perform any substantive work (ie, does not perform various operations on files and programs). state, or refers to the screen-off state (on but the screen is off) of the smart terminal. In the present invention, the standby state of the smart terminal includes the sleep/sleep state of the mobile phone. In an embodiment of the Android system, #echo mem>/sys/power/state can be called to make the system enter a sleep state. In the standby state, the smart terminal will have a longer battery life.

Wake-up state: refers to the state in which an intelligent terminal (such as an electronic device such as a mobile phone or a computer) interacts with the user when it is turned on, or the screen is turned on. In an embodiment of the Android system, the #echo on>/sys/power/state command can be invoked to wake up the smart terminal from the standby state and enter the wake-up state. In addition, the following wake-up mechanisms are also included: Wake_Lock wake-up lock mechanism; Early_Suspend Pre-suspend mechanism; Late_Resume late wake-up mechanism.

Interactive behavior: refers to the two-way information transmission and feedback behavior between the user and the intelligent terminal. The user inputs information and operates the intelligent terminal through voice, displacement and/or rotation, text input, operation on the interactive interface, etc.; Provide information to users by means of voice, image, video, text, etc. For example: the user's manipulation behavior when the smart terminal is awake, the displacement and/or rotation of the smart terminal, and the user's voice control behavior when the smart terminal is in standby.

The method of the present invention is mainly applicable to terminals with communication functions such as smart phone terminals or smart tablet terminals, and is not limited to the type of operating system, which can be Android, IOS, WP, Symbian and other operating systems.

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, wherein the same or similar reference numerals represent the same or similar elements or elements with the same or similar functions. Obviously, the described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present invention.

As shown in FIG. 1, a method for acquiring voice control information in a standby state of the present invention includes the following steps S11-S14:

S11. Collect voice data according to the sampling frequencies in different time periods specified in the voice collection scheme. In order to effectively control energy consumption, prolong the standby time of intelligent terminals when collecting voice.

S12. Perform feature matching on the voice data according to preset voice command configuration data, and determine whether the voice data is a voice command. Thus, the intelligent terminal can quickly recognize the user's voice command from the voice data, so as to realize the voice control.

S13. In response to the voice command corresponding to the voice data, acquire content information of the type corresponding to the voice command. Make the smart terminal execute the voice command to obtain the content information.

S14. Perform a voice broadcast associated with the content information according to the content information. Enable users to obtain the required information and complete voice control.

in:

S11. Collect voice data according to the sampling frequencies in different time periods specified in the voice collection scheme.

In a possible embodiment of the present invention, the voice collection scheme specifies the sampling frequency of the voice collected by the intelligent terminal under each time period, and the formulation process of the voice collection scheme comprises the following steps:

First, the user's interaction index in different time periods is calculated based on the time distribution of the user's interaction with the smart terminal;

Secondly, according to the preset threshold range satisfied by the interaction index of each time period, the sampling frequency corresponding to the threshold range is specified in each time period, and the formulation of the voice collection scheme is completed accordingly.

In an embodiment, the interaction behavior includes: the user's manipulation behavior when the smart terminal is awake, the displacement and/or rotation of the smart terminal, and the user's voice control behavior when the smart terminal is in standby.

In a possible design, the smart terminal collects data of various user interaction behaviors at regular intervals (such as 5 minutes) to obtain the time distribution of the interaction behavior between the user and the smart terminal, and then calculates the user’s Interaction index under the time period.

The calculation includes one or more independent or associated models or algorithms, such as association rule mining algorithms and the like.

In one of the possible algorithms, the value of the interactive behavior is set to 1 when it occurs, and the value of 0 when it does not occur; the weight of the user's manipulation behavior (referred to as "manipulation") in the wake-up state of the smart terminal is 0.3, and the displacement of the smart terminal The weight of and/or rotation (referred to as "displacement") is 0.3, and the weight of the user's voice control behavior (referred to as "voice control") when the smart terminal is in standby is 1. The formula for calculating the interaction index is:

Interaction index = manipulation * 0.3 + displacement * 0.3 + sound control * 1;

If the user does not operate the smart terminal in the wake-up state of the smart terminal at the current collection moment, but moves the smart terminal and performs voice control while the smart terminal is in standby, the user's interaction index at the current collection moment is 0*0.3+1*0.3 +1*1=1.3. The calculation of the interaction index at other times is analogous. The time length of each time period is set by the user or preset by the intelligent terminal, and the interaction index of a time period is the average value of the interaction indexes of each collection moment in the time period. Then, the interaction index of the user in different time periods can be obtained.

In a possible embodiment, the interaction index of the user at each collection moment in the time period of 8:00-8:30 is shown in the following table:

Then in the time period of 8:00-8:30, the interaction index is 0.73.

Of course, in other embodiments of the present invention, other interaction behaviors may also be used as variables to calculate the interaction index.

In a possible embodiment, the voice collection scheme specifies the sampling frequencies of voice collection in different time periods of the intelligent terminal in the standby state as:

When the interaction index of a time period is less than 0.5, the sampling frequency of 22.05KHz is used in this time period;

When the interaction index of a time period is greater than or equal to 0.5 and less than 1.2, the sampling frequency of 44.1KHz is used in this time period;

When the interaction index of a time period is greater than or equal to 1.2, the sampling frequency of 48KHz is used in this time period.

Therefore, in a possible embodiment, the voice collection scheme is shown in the following table:

period Interaction Index Sampling frequency 08:00-08:30 0.73 44.1KHz 08:31-08:35 0.35 22.05KHz 08:36-10:15 1.47 48KHz 10:16-10:45 0.94 44.1KHz 10:46-13:00 1.53 48KHz 13:01-13:50 0.25 22.05KHz 13:51-18:27 1.19 44.1KHz 18:28-22:00 1.34 48KHz 22:00-23:50 0.61 44.1KHz 23:51-07:59 0.08 22.05KHz

Of course, in some possible embodiments of the present invention, the threshold range or its corresponding sampling frequency may also be based on the remaining power of the smart terminal, or based on the user's location information combined with the usage of the user's voice control function at the location , make corresponding adjustments to control the energy consumption of the intelligent terminal when it implements the voice control function, and prolong the standby time of the intelligent terminal.

In a possible embodiment, the process of formulating the voice collection scheme further includes displaying a user interface in a power-on state for setting the threshold range and the sampling frequency corresponding to each threshold range, so as to complete the threshold range preset.

The sampling frequency corresponding to each threshold range of the threshold range is set by the user or preset by the intelligent terminal. According to the preset threshold range satisfied by the interaction index of each time period, the intelligent terminal specifies that the sampling frequency corresponding to the threshold range is used in the time period.

In a possible embodiment of the present invention, the intelligent terminal controls the collection of the voice data through a DSP processor.

Digital Signal Processing (DSP) processor is a kind of hardware between fixed function hardware and high flexibility CPU, which is used to efficiently process tasks including audio and voice applications, image processing, video input, etc. It is responsible for part of the work that belonged to the CPU before, which can effectively reduce the energy consumption of the intelligent terminal. For example, the Hexagon DSP (low-power island) used in the Snapdragon 820 processor. The collection of the voice data is controlled by the DSP processor, so as to improve the energy efficiency of the voice control of the intelligent terminal in the standby state, and effectively reduce the energy consumption.

The voice collection solution specifies the corresponding sampling frequency in the voice collection of different time periods according to the interaction between the user and the smart terminal in different time periods, so as to effectively control the energy consumption and improve the voice collection of the smart terminal in the standby state. Efficiency and extended standby time.

S12. Perform feature matching on the voice data according to preset voice command configuration data, and determine whether the voice data is a voice command.

In a possible embodiment of the present invention, the feature matching process includes:

Retrieve whether the voice data contains the identification in the voice command configuration data, if the identification is not contained, then the voice data is not a voice command, and the retrieval is terminated;

If the identification is contained, then search whether the voice data contains the content in the voice command configuration data, if the voice data is contained, the voice data is a voice command, and the information type corresponding to the content contained in the voice data is determined; If the content is not included, the voice data is not a voice command.

The intelligent terminal first recognizes the identification of the voice command in the standby state, and then performs the next step of identification after identifying the identification, which improves the identification efficiency and reduces energy consumption.

In an embodiment, in the process of feature matching, when the matching rate between the voice data and the identification or content of the voice command configuration data is greater than a preset threshold, it is determined that the voice data contains the identification or the content. content; otherwise, it is determined that the voice data does not contain the identification or content.

The identification or content of the voice data and the voice command configuration data can be matched by methods based on phonetics and acoustics, pattern matching methods or neural network methods. For example, dynamic time warping (DTW), hidden Markov (HMM) theory, vector quantization (VQ) technology, etc. in the method of pattern matching.

The Markov Model is a statistical model widely used in speech recognition, automatic part-of-speech tagging, phonetic-word conversion, probabilistic grammar and other natural language processing applications. After long-term development, it is especially suitable for applications in speech recognition.

Through the method of presetting the voice command data and feature matching in the above embodiment, the intelligent terminal can quickly recognize the user's voice command from the voice data, so as to realize voice control.

S13. In response to the voice command corresponding to the voice data, acquire content information of the type corresponding to the voice command.

In a possible embodiment, the following two possible methods are preferred for obtaining the content information:

First, the content information of the type is acquired from the intelligent terminal by invoking the corresponding system command.

Second, by invoking a corresponding interface or communication protocol, one or more of corresponding software, web pages, or servers can acquire the type of content information.

In an embodiment of the Android system, the smart terminal can obtain the content information by calling the corresponding system command, for example, calling the SimpleDateFormat sDateFormat=newSimpleDateFormat("yyyy-MM-dd hh:mm:ss") command to obtain The date and time in the current system.

In an embodiment of the Android system, according to the type of information, by calling the corresponding API interface or protocols such as HTTP, POST, JSON, XML and other protocols in the WebService specification, the corresponding software or webpage or server can obtain the type of information described in the corresponding software or webpage or server. content information.

For example through the address http://wthrcdn.etouch.cn/weather_mini? city=Beijing, get weather data (JSON) according to the city name;

Or through the address http://wthrcdn.etouch.cn/weather_mini? citykey=101010100 Get weather data (JSON) by city id.

Of course, in some embodiments, the relevant information can also be obtained in combination with the positioning of the smart terminal.

S14. Perform a voice broadcast associated with the content information according to the content information.

After acquiring the content information, feedback corresponding information according to the content of the voice command. For example, in one embodiment, after obtaining the weather information, according to the content in the voice instruction "will it rain tomorrow", the voice broadcasts the weather conditions of tomorrow in the weather information, including whether it rains and other specific weather information.

Of course, in some embodiments, a carrier such as video, image, text, etc. may also be used to perform notification related to content information through a user interface or other means.

In a possible embodiment of the present invention, in order to meet the needs of user-defined voice commands, as shown in Figure 2, the following pre-steps are also included:

S10. Displaying a user interface in the power-on state for editing the configuration data of the voice command, and completing the pre-setting of the configuration data accordingly.

In an embodiment, the voice command configuration data includes an identifier and content of the voice command, and an information type corresponding to the content.

The identifier, the content and the type of information corresponding to the content can be flexibly set by the user as needed, so as to facilitate speech recognition and control to obtain information, for example, in a possible embodiment:

The identifiers include: "Hello", "Hello", etc., so that the voice command can be quickly detected in the voice recognition;

The content includes: "the current time", "what day of the week is today", "the current temperature", "will it rain tomorrow", "the weather the day after tomorrow", "the current Shanghai and Shenzhen stock indexes", etc.;

The information types include "time", "weather", "stock market index", etc.;

The corresponding relationship between the content and the information type is: the information type corresponding to "current time" and "what day of the week today" is "time"; "current temperature", "will it rain tomorrow" and "the weather the day after tomorrow" The corresponding information type is "weather"; the information type corresponding to "current Shanghai and Shenzhen stock index" is "stock market index" and so on.

Provide a user interface to enable the user to set the identity and content of the voice command, as well as the type of information corresponding to the content, so that the user can realize the personalized and diversified settings of the voice command, improve the experience of human-computer interaction and the convenience of life and work. efficiency.

In one embodiment, the preset setting is completed by the user through input or selection of voice or text. The user can set various voice commands individually, which improves the interest and practicability of the voice control function.

In addition, an embodiment of the present invention provides an intelligent terminal, as shown in FIG. 3 . For convenience of description, only the part related to the embodiment of the present invention is shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present invention. The terminal can be any intelligent terminal including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant, personal digital assistant), a POS (Point of Sales, a sales terminal), a vehicle-mounted computer, etc. Take the intelligent terminal as a mobile phone as an example:

FIG. 3 is a block diagram showing a partial structure of a mobile phone related to a smart terminal provided by an embodiment of the present invention. Referring to FIG. 3 , the intelligent terminal includes: a sound pickup unit 11 , an identification unit 12 , an acquisition unit 13 and a broadcast unit 14 . in:

The sound pickup unit 11 is used for collecting voice data according to the sampling frequencies in different time periods specified in the voice collecting scheme.

In a possible embodiment of the present invention, the voice collection scheme of the pickup unit 11 specifies the sampling frequency of the voice collected by the intelligent terminal under each time period, and the formulation process of the voice collection scheme comprises the following steps:

First, the user's interaction index in different time periods is calculated based on the time distribution of the user's interaction with the smart terminal;

Secondly, according to the preset threshold range satisfied by the interaction index of each said time period, the sound pickup unit 11 is specified to adopt the sampling frequency corresponding to the said threshold value range in each time period, and the voice collection scheme is completed accordingly. formulate.

In an embodiment, the interaction behavior includes: the user's manipulation behavior when the smart terminal is awake, the displacement and/or rotation of the smart terminal, and the user's voice control behavior when the smart terminal is in standby.

In a possible design, the smart terminal collects data of various user interaction behaviors at regular intervals (such as 5 minutes) to obtain the time distribution of the interaction behavior between the user and the smart terminal, and then calculates the user’s Interaction index under the time period.

The calculation includes one or more independent or associated models or algorithms, such as association rule mining algorithms and the like.

In one of the possible algorithms, the interactive behavior is assigned a value of 1 if it does not occur; the weight of the user's manipulation behavior (referred to as "manipulation") in the wake-up state of the intelligent terminal is 0.3, and the displacement of the intelligent terminal is assigned a value of 0. The weight of and/or rotation (referred to as "displacement") is 0.3, and the weight of the user's voice control behavior (referred to as "voice control") when the smart terminal is in standby is 1. The formula for calculating the interaction index is:

Interaction index = manipulation * 0.3 + displacement * 0.3 + sound control * 1;

If the user does not control the smart terminal when the smart terminal is awake at the current collection moment, but moves the smart terminal and performs voice control while the smart terminal is in standby, the user's interaction index at the current collection moment is 0*0.3+1*0.3 +1*1=1.3. The calculation of the interaction index at other times is analogous. The time length of each time period is set by the user or preset by the intelligent terminal, and the interaction index of a time period is the average value of the interaction indexes of each collection moment in the time period. Then, the interaction index of the user in different time periods can be obtained.

In a possible embodiment, the interaction index of the user at each collection moment in the time period of 8:00-8:30 is shown in the following table:

time manipulate displacement Sound control Interaction Index 08:00 1 1 0 0.6 08:05 1 0 0 0.3 08:10 0 0 0 0 08:15 1 0 1 1.3 08:20 0 1 0 0.3 08:25 0 1 0 1 08:30 1 1 1 1.6

Then in the time period of 08:00-08:30, the interaction index is 0.73.

Of course, in other embodiments of the present invention, other interaction behaviors may also be used as variables to calculate the interaction index.

In a possible embodiment, the voice collection scheme specifies the sampling frequencies of voice collection in different time periods of the intelligent terminal in the standby state as:

When the interaction index of a time period is less than 0.5, the sampling frequency of 22.05KHz is used in this time period;

When the interaction index of a time period is greater than or equal to 0.5 and less than 1.2, the sampling frequency of 44.1KHz is used in this time period;

When the interaction index of a time period is greater than or equal to 1.2, the sampling frequency of 48KHz is used in this time period.

Therefore, in a possible embodiment, the voice collection scheme is shown in the following table:

period Interaction Index Sampling frequency 08:00-08:30 0.73 44.1KHz 08:31-08:35 0.35 22.05KHz 08:36-10:15 1.47 48KHz 10:16-10:45 0.94 44.1KHz 10:46-13:00 1.53 48KHz 13:01-13:50 0.25 22.05KHz 13:51-18:27 1.19 44.1KHz 18:28-22:00 1.34 48KHz 22:00-23:50 0.61 44.1KHz 23:51-07:59 0.08 22.05KHz

Of course, in some possible embodiments of the present invention, the threshold range or its corresponding sampling frequency may also be based on the remaining power of the smart terminal, or based on the user's location information combined with the usage of the user's voice control function at the location , make corresponding dynamic adjustments to control the energy consumption of the intelligent terminal when it realizes the voice control function, and prolong the standby time of the intelligent terminal.

In a possible embodiment, the voice collection solution of the sound pickup unit 11 further includes: displaying a user interface in a power-on state for setting the threshold range and the sampling frequency corresponding to each threshold range, so as to complete the Preset threshold range.

The sampling frequency corresponding to each threshold range of the threshold range is set by the user or preset by the intelligent terminal. According to the preset threshold range satisfied by the interaction index of each time period, the intelligent terminal specifies that the sampling frequency corresponding to the threshold range is used in the time period.

In a possible embodiment of the present invention, the sound pickup unit 11 controls the collection of the voice data through a DSP processor.

Digital Signal Processing (DSP) processor is a kind of hardware between fixed function hardware and high flexibility CPU, which is used to efficiently process tasks including audio and voice applications, image processing, video input, etc. It is responsible for part of the work that belonged to the CPU before, which can effectively reduce the energy consumption of the intelligent terminal. For example, the Hexagon DSP (low-power island) used in the Snapdragon 820 processor. The collection of the voice data is controlled by the DSP processor, so as to improve the energy efficiency of the voice control of the intelligent terminal in the standby state, and effectively reduce the energy consumption.

The voice collection scheme specifies the corresponding sampling frequency of the pickup unit 11 in the voice collection of different time periods according to the interaction between the user and the smart terminal in different time periods, so as to effectively control the energy consumption and improve the intelligence in the standby state. The voice collection performance of the terminal.

The identification unit 12 is configured to perform feature matching on the voice data according to preset voice command configuration data, and determine whether the voice data is a voice command.

In a possible embodiment of the present invention, the feature matching process of the identification unit 12 includes:

Retrieve whether the voice data contains the identifier in the voice command configuration data. If the identifier is not included, the voice data is not a voice command, and the retrieval is terminated; the intelligent terminal first recognizes the identifier of the voice command in the standby state. After the identification is issued, the next step of identification is carried out, which not only improves the identification efficiency but also reduces the energy consumption.

If the identification is contained, then search whether the voice data contains the content in the voice command configuration data, if the voice data is contained, the voice data is a voice command, and the information type corresponding to the content contained in the voice data is determined; If the content is not included, the voice data is not a voice command.

In an embodiment, in the process of feature matching, when the matching rate between the voice data and the identification or content of the voice command configuration data is greater than a preset threshold, it is determined that the voice data contains the identification or the content. content; otherwise, it is determined that the voice data does not contain the identification or content.

The identification or content of the voice data and the voice command configuration data can be matched by methods based on phonetics and acoustics, pattern matching methods or neural network methods. For example, dynamic time warping (DTW), hidden Markov (HMM) theory, vector quantization (VQ) technology, etc. in the method of pattern matching.

The Markov Model is a statistical model widely used in speech recognition, automatic part-of-speech tagging, phonetic-word conversion, probabilistic grammar and other natural language processing applications. After long-term development, it is especially suitable for applications in speech recognition.

Through the method of presetting the voice command data of the preset unit 10 and the feature matching method of the recognition unit 12 in the above embodiment, the intelligent terminal can quickly recognize the user's voice command from the voice data to realize voice control.

The obtaining unit 13 is configured to, in response to the voice command corresponding to the voice data, obtain the content information of the type corresponding to the voice command.

In a possible embodiment, the obtaining unit 13 preferably has the following two possible methods for obtaining the content information:

First, the content information of the type is acquired from the intelligent terminal by invoking the corresponding system command.

Second, by invoking a corresponding interface or communication protocol, one or more of corresponding software, web pages, or servers can acquire the type of content information.

In an embodiment of the Android system, the smart terminal can obtain the content information by calling the corresponding system command, for example, calling the SimpleDateFormat sDateFormat=newSimpleDateFormat("yyyy-MM-dd hh:mm:ss") command to obtain The date and time in the current system.

In an embodiment of the Android system, according to the type of information, by calling the corresponding API interface or protocols such as HTTP, POST, JSON, XML and other protocols in the WebService specification, the corresponding software or webpage or server can obtain the type of information described in the corresponding software or webpage or server. content information.

For example through the address http://wthrcdn.etouch.cn/weather_mini? city=Beijing, get weather data (JSON) according to the city name;

Or through the address http://wthrcdn.etouch.cn/weather_mini? citykey=101010100 Get weather data (JSON) by city id.

Of course, in some embodiments, the obtaining unit 13 may also obtain relevant information in combination with the positioning of the smart terminal.

The broadcasting unit 14, according to the content information, performs a voice broadcasting associated with the content information.

After acquiring the content information, the broadcasting unit 14 feeds back corresponding information according to the content of the voice command. For example, in one embodiment, after obtaining the weather information, according to the content in the voice instruction "will it rain tomorrow", the voice broadcasts the weather conditions of tomorrow in the weather information, including whether it rains and other specific weather information.

Of course, in some embodiments, the broadcasting unit 14 may also use a carrier such as video, image, text, etc., to perform notification related to content information through a user interface or other means.

In a possible embodiment of the present invention, in order to meet the needs of user-defined voice commands, as shown in FIG. 4 , the following preset unit 10 is further included:

The presetting unit 10 is configured to display a user interface in a power-on state for editing the configuration data of the voice command, and complete the presetting of the configuration data accordingly.

In one embodiment, the voice command configuration data includes the identification and content of the voice command, and an information type corresponding to the content.

The identifier, the content and the type of information corresponding to the content can be flexibly set by the user as needed, so as to facilitate speech recognition and control to obtain information, for example, in a possible embodiment:

The identifiers include: "Hello", "Hello", etc., so that the voice command can be quickly detected in the voice recognition;

The content includes: "the current time", "what day of the week is today", "the current temperature", "will it rain tomorrow", "the weather the day after tomorrow", "the current Shanghai and Shenzhen stock indexes", etc.;

The information types include "time", "weather", "stock market index", etc.;

The corresponding relationship between the content and the information type is: the information type corresponding to "current time" and "what day of the week today" is "time"; "current temperature", "will it rain tomorrow" and "the weather the day after tomorrow" The corresponding information type is "weather"; the information type corresponding to "current Shanghai and Shenzhen stock index" is "stock market index" and so on.

The preset unit 10 provides a user interface to enable the user to set the identity and content of the voice command, and the type of information corresponding to the content, so that the user can realize the personalized and diversified settings of the voice command and improve the experience of human-computer interaction. and life-work efficiency.

In one embodiment, the presetting of the presetting unit 10 is completed by inputting or selecting voice or text. The user can set various voice commands individually, which improves the practicability and interest of the voice control function.

The embodiment of the invention also provides an intelligent terminal, including:

Touch-sensitive displays for displaying user interfaces for human-computer interaction;

one or more processors;

memory;

one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors;

The one or more programs are used to drive the one or more processors to construct a unit for executing the above-mentioned method for acquiring voice control information in a standby state. The unit includes: a preset unit 10 , a sound pickup unit 11 , an identification unit 12 , an acquisition unit 13 and a broadcast unit 14 .

The smart terminal is a mobile phone as an example:

The intelligent terminal can communicate with the network and other devices through wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access) Access, CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (Short Messaging Service, SMS) and the like.

The memory is used to store software programs and modules, and the processor executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory. The memory can mainly include a stored program area and a stored data area, wherein the stored program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required for at least one function; data (such as audio data, phone book, etc.) Additionally, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

A touch-sensitive display may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor, and can receive commands from the processor and execute them. Additionally, touch-sensitive displays can be implemented using resistive, capacitive, infrared, and surface acoustic wave types.

The touch-sensitive display can be used to display information entered by or provided to the user as well as various menus of the mobile phone, such as an information editing interface and the like. The touch-sensitive display may include a display panel, and optionally, the touch-sensitive display may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, when the touch sensitive display detects a touch operation on or near it, it is transmitted to the processor to determine the type of the touch event, and then the processor provides corresponding visual output on the touch sensitive display according to the type of the touch event.

A mobile phone includes an audio input and output system or device, including a microphone, bluetooth, headphones (connection jack), amplifiers, etc.

The cell phone may also include at least one sensor, such as a gravity sensor, a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the touch-sensitive display according to the brightness of the ambient light, and the proximity sensor may turn off the touch-sensitive display and/or when the mobile phone is moved to the ear. or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when it is stationary. games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. Repeat.

The processor is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone, and executes various functions of the mobile phone by running or executing the software programs and/or modules stored in the memory and calling the data stored in the memory. functions and process data to monitor the phone as a whole. Optionally, the processor may include one or more processing units; preferably, the processor may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc. The demodulation processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor.

The mobile phone also includes a power source (such as a battery) for supplying power to various components. Preferably, the power source can be logically connected to the processor through a power management system, so that functions such as charging, discharging, and power consumption management can be implemented through the power management system.

The mobile phone may further include a camera, a Bluetooth module, and the like, which will not be repeated here.

In the embodiment of the present invention, the processor included in the intelligent terminal also has the following functions:

The voice data is collected according to the sampling frequencies in different time periods specified in the voice collection scheme.

In a possible embodiment of the present invention, the voice collection scheme specifies the sampling frequency of the voice collected by the intelligent terminal under each time period, and the formulation process of the voice collection scheme comprises the following steps:

First, the user's interaction index in different time periods is calculated based on the time distribution of the user's interaction with the smart terminal;

Secondly, according to the preset threshold range satisfied by the interaction index of each time period, it is specified that the sampling frequency corresponding to the threshold range is adopted in each time period.

In an embodiment, the interaction behavior includes: the user's manipulation behavior when the smart terminal is awake, the displacement and/or rotation of the smart terminal, and the user's voice control behavior when the smart terminal is in standby.

In a possible design, the data of various interaction behaviors of the user is collected at regular intervals (such as 5 minutes) to obtain the time distribution of the interaction behavior between the user and the smart terminal, and then calculate the user's interaction behavior in different time periods. The interaction index below.

The calculation includes one or more independent or associated models or algorithms, such as association rule mining algorithms and the like.

In one of the possible algorithms, the interactive behavior is assigned a value of 1 if it does not occur; the weight of the user's manipulation behavior (referred to as "manipulation") in the wake-up state of the intelligent terminal is 0.3, and the displacement of the intelligent terminal is assigned a value of 0. The weight of and/or rotation (referred to as "displacement") is 0.3, and the weight of the user's voice control behavior (referred to as "voice control") when the smart terminal is in standby is 1. The formula for calculating the interaction index is:

Interaction index = manipulation * 0.3 + displacement * 0.3 + sound control * 1;

If the user does not control the smart terminal when the smart terminal is awake at the current collection moment, but moves the smart terminal and performs voice control while the smart terminal is in standby, the user's interaction index at the current collection moment is 0*0.3+1*0.3 +1*1=1.3. The calculation of the interaction index at other times is analogous. The time length of each time period is set by the user or preset by the intelligent terminal, and the interaction index of a time period is the average value of the interaction indexes of each collection moment in the time period. Then, the interaction index of the user in different time periods can be obtained.

Of course, in other embodiments of the present invention, other interaction behaviors may also be used as variables to calculate the interaction index.

In a possible embodiment, the voice collection scheme specifies the sampling frequencies of voice collection in different time periods of the intelligent terminal in the standby state as:

When the interaction index of a time period is less than 0.5, the sampling frequency of 22.05KHz is used in this time period;

When the interaction index of a time period is greater than or equal to 0.5 and less than 1.2, the sampling frequency of 44.1KHz is used in this time period;

When the interaction index of a time period is greater than or equal to 1.2, the sampling frequency of 48KHz is used in this time period.

Of course, in some possible embodiments of the present invention, the threshold range or its corresponding sampling frequency may also be based on the remaining power of the smart terminal, or based on the user's location information combined with the usage of the user's voice control function at the location , make corresponding dynamic adjustments to control the energy consumption of the intelligent terminal when it realizes the voice control function, and prolong the standby time of the intelligent terminal.

In a possible embodiment, the process of formulating the voice collection scheme further includes displaying a user interface in a power-on state for setting the threshold range and the sampling frequency corresponding to each threshold range, so as to complete the threshold range preset.

The sampling frequency corresponding to each threshold range of the threshold range is set by the user or preset by the intelligent terminal. According to the preset threshold range satisfied by the interaction index of each time period, the intelligent terminal specifies that the sampling frequency corresponding to the threshold range is used in the time period.

In a possible embodiment of the present invention, the collection of the voice data is controlled by a DSP processor.

The voice collection solution specifies the corresponding sampling frequency in the voice collection of different time periods according to the interaction between the user and the smart terminal in different time periods, so as to effectively control the energy consumption and improve the voice collection of the smart terminal in the standby state. efficacy.

Feature matching is performed on the voice data according to preset voice command configuration data to determine whether the voice data is a voice command.

In a possible embodiment, a user interface is displayed in the power-on state for editing the configuration data of the voice command, and the pre-setting of the configuration data is completed accordingly.

In an embodiment, the voice command configuration data includes an identifier and content of the voice command, and an information type corresponding to the content.

The identifier, the content and the type of information corresponding to the content can be flexibly set by the user as needed, so as to facilitate speech recognition and control to obtain information, for example, in a possible embodiment:

The identifiers include: "Hello", "Hello", etc., so that the voice command can be quickly detected in the voice recognition;

The content includes: "the current time", "what day of the week is today", "the current temperature", "will it rain tomorrow", "the weather the day after tomorrow", "the current Shanghai and Shenzhen stock indexes", etc.;

The information types include "time", "weather", "stock market index", etc.;

The corresponding relationship between the content and the information type is: the information type corresponding to "current time" and "what day of the week today" is "time"; "current temperature", "will it rain tomorrow" and "the weather the day after tomorrow" The corresponding information type is "weather"; the information type corresponding to "current Shanghai and Shenzhen stock index" is "stock market index" and so on.

Provide a user interface to enable the user to set the identity and content of the voice command, as well as the type of information corresponding to the content, so that the user can realize the personalized and diversified settings of the voice command, improve the experience of human-computer interaction and the convenience of life and work. efficiency.

In one embodiment, the preset setting is completed by the user through input or selection of voice or text. The user can set various voice commands individually, which improves the practicability and interest of the voice control function.

In a possible embodiment of the present invention, the feature matching process includes:

Retrieve whether the voice data contains the identifier in the voice command configuration data. If the identifier is not included, the voice data is not a voice command, and the retrieval is terminated; the intelligent terminal first recognizes the identifier of the voice command in the standby state. After the identification is issued, the next step of identification is carried out, which not only improves the identification efficiency but also reduces the energy consumption.

If the identification is contained, then search whether the voice data contains the content in the voice command configuration data, if the voice data is contained, the voice data is a voice command, and the information type corresponding to the content contained in the voice data is determined; If the content is not included, the voice data is not a voice command.

In an embodiment, in the process of feature matching, when the matching rate between the voice data and the identification or content of the voice command configuration data is greater than a preset threshold, it is determined that the voice data contains the identification or the content. content; otherwise, it is determined that the voice data does not contain the identification or content.

The identification or content of the voice data and the voice command configuration data can be matched by methods based on phonetics and acoustics, pattern matching methods or neural network methods. For example, dynamic time warping (DTW), hidden Markov (HMM) theory, vector quantization (VQ) technology, etc. in the method of pattern matching.

Through the method of presetting the voice command data and feature matching in the above embodiment, the intelligent terminal can quickly recognize the user's voice command from the voice data, so as to realize voice control.

In response to the voice command corresponding to the voice data, content information of the type corresponding to the voice command is acquired.

In a possible embodiment, the following two possible methods are preferred for obtaining the content information:

First, the content information of the type is acquired from the intelligent terminal by invoking the corresponding system command.

Second, by invoking a corresponding interface or communication protocol, one or more of corresponding software, web pages, or servers can acquire the type of content information.

In an implementation manner of the Android system, the smart terminal can obtain the content information by invoking corresponding system instructions, such as invoking the SimpleDateFormat sDateFormat=new SimpleDateFormat("yyyy-MM-dd hh:mm:ss") instruction, Get the date and time in the current system.

In an embodiment of the Android system, according to the type of information, by calling the corresponding API interface or protocols such as HTTP, POST, JSON, XML and other protocols in the WebService specification, the corresponding software or webpage or server can obtain the type of information described in the corresponding software or webpage or server. content information.

For example through the address http://wthrcdn.etouch.cn/weather_mini? city=Beijing, get weather data (JSON) according to the city name;

Or through the address http://wthrcdn.etouch.cn/weather_mini? citykey=101010100 Get weather data (JSON) by city id.

Of course, in some embodiments, the relevant information can also be obtained in combination with the positioning of the smart terminal.

A voice broadcast associated with the content information is performed according to the content information.

After acquiring the content information, feedback corresponding information according to the content of the voice command. For example, in one embodiment, after obtaining the weather information, according to the content in the voice instruction "will it rain tomorrow", the voice broadcasts the weather conditions of tomorrow in the weather information, including whether it rains and other specific weather information.

Of course, in some embodiments, a carrier such as video, image, text, etc. may also be used to perform notification related to content information through a user interface or other means.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above may refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include But not limited to: any type of disk (including floppy disk, hard disk, optical disk, CD-ROM, and magneto-optical disk), ROM (Read-Only Memory, read-only memory), RAM (Random Access Memory, random access memory), EPROM (Erasable Memory) Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory, Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card or optical card.

Those of ordinary skill in the art can understand that all or part of the steps in the method of implementing the above embodiments can be completed by instructing the relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium can be a read-only memory, a magnetic disk or an optical disk, and the like.

A method for acquiring voice control information in a standby state and an intelligent terminal provided by the present invention are described above in detail. For those skilled in the art, without departing from the principles of the present invention, in the specific implementation and application There will be changes in the above. In summary, the content of this specification should not be construed as a limitation to the present invention.

Claims (23)

1. a method for acquiring voice control information in a standby state, comprising the steps of: Calculate the interaction index of the user in different time periods based on the time distribution of the interaction between the user and the smart terminal; According to the preset threshold range satisfied by the interaction index of each time period, it is stipulated that the sampling frequency corresponding to the threshold range is adopted in each time period, and the formulation of the voice collection scheme is completed accordingly; Collect voice data according to the sampling frequencies in different time periods specified in the voice collection scheme; Perform feature matching on the voice data according to preset voice command configuration data, and determine whether the voice data is a voice command; In response to the voice command corresponding to the voice data, obtain the content information of the corresponding type of the voice command; A voice broadcast associated with the content information is performed according to the content information. 2. method according to claim 1, is characterized in that, also comprises following pre-step: In the power-on state, a user interface is displayed for editing the configuration data of the voice command, and the pre-setting of the configuration data is completed accordingly. 3 . The method according to claim 1 or 2 , wherein the voice command configuration data includes an identifier and content of the voice command, and an information type corresponding to the content. 4 . 4. The method according to claim 1 or 2, wherein the preset setting is completed by the user through input or selection of voice or text. 5. The method according to claim 1, wherein the interactive behavior comprises: the user's manipulation behavior when the smart terminal is awake, the displacement and/or rotation of the smart terminal, the user's voice when the smart terminal is in standby Control behavior. 6. The method according to claim 1, wherein the formulating process of the voice collection scheme further comprises: displaying a user interface in a power-on state for setting the threshold range and the sampling frequency corresponding to each threshold range , to complete the preset threshold range. 7 . The method according to claim 1 , wherein the intelligent terminal controls the collection of the voice data through a DSP processor. 8 . 8. The method according to claim 1, wherein the feature matching process comprises: Retrieve whether the voice data contains the identification in the voice command configuration data, if the identification is not contained, then the voice data is not a voice command, and the retrieval is terminated; If the identification is contained, then search whether the voice data contains the content in the voice command configuration data, if the voice data is contained, the voice data is a voice command, and the information type corresponding to the content contained in the voice data is determined; If the content is not included, the voice data is not a voice command. 9. The method according to claim 7, wherein, in the process of feature matching, when the matching rate of the identification or content of the voice data and the voice command configuration data is greater than a preset threshold, then It is determined that the voice data contains the identification or content; otherwise, it is determined that the voice data does not contain the identification or content. 10. The method according to claim 1, wherein the method for obtaining the content information comprises: obtaining the content information of the type from an intelligent terminal by invoking a corresponding system instruction. 11. method according to claim 1, is characterized in that, the acquisition method of described content information also comprises: by invoking corresponding interface or communication protocol, by one or more in corresponding software or webpage or server acquisition The type of content information. 12. An intelligent terminal, characterized in that, comprising: Pickup unit: used to calculate the interaction index of the user in different time periods based on the time distribution of the interaction between the user and the smart terminal; respectively, according to the preset threshold range satisfied by the interaction index of each said time period, specify Adopt the sampling frequency corresponding to the threshold range in each time period, and complete the formulation of the voice collection scheme accordingly; collect voice data according to the sampling frequencies in different time periods specified in the voice collection scheme; Recognition unit: configured to perform feature matching on the voice data according to preset voice command configuration data, and determine whether the voice data is a voice command; Obtaining unit: used to obtain the content information of the corresponding type of the voice command in response to the voice command corresponding to the voice data; Broadcasting unit: according to the content information, perform a voice broadcast associated with the content information. 13. The intelligent terminal according to claim 12, further comprising a preset unit: It is configured to display a user interface in a power-on state for editing voice command configuration data, and completes the pre-setting of the configuration data accordingly. 14. The intelligent terminal according to claim 13, wherein the preset unit is configured to: the voice command configuration data includes the identification and content of the voice command, and the information type corresponding to the content. 15. The intelligent terminal according to claim 13, wherein the preset unit is configured to: the preset is completed by the user through input or selection of voice or text. 16. The intelligent terminal according to claim 12, wherein, in the sound pickup unit, the interaction behaviors include: manipulation behaviors of the user in the wake-up state of the intelligent terminal, displacement and/or rotation of the intelligent terminal, The user's voice control behavior when the smart terminal is in standby. 17 . The smart terminal according to claim 12 , wherein the preset unit is further configured to: display a user interface in a power-on state, so as to set the threshold range and the sampling frequency corresponding to each threshold range. 18 . , to complete the preset threshold range. 18 . The intelligent terminal according to claim 12 , wherein the sound pickup unit controls the collection of the voice data through a DSP processor. 19 . 19. The intelligent terminal according to claim 12, wherein, in the identifying unit, the feature matching process comprises: Retrieve whether the voice data contains the identification in the voice command configuration data, if the identification is not contained, then the voice data is not a voice command, and the retrieval is terminated; If the identification is contained, then search whether the voice data contains the content in the voice command configuration data, if the voice data is contained, the voice data is a voice command, and the information type corresponding to the content contained in the voice data is determined; If the content is not included, the voice data is not a voice command. 20. The intelligent terminal according to claim 19, wherein, in the identification unit, in the process of feature matching, when the matching rate of the voice data and the identification or content of the voice command configuration data is greater than When the preset threshold is reached, it is determined that the voice data contains the identification or content; otherwise, it is determined that the voice data does not contain the identification or content. 21. The intelligent terminal according to claim 12, wherein the acquisition unit is configured to acquire the content information of the type from the intelligent terminal by invoking corresponding system instructions. 22. intelligent terminal according to claim 12, is characterized in that, described acquisition unit is configured to: by invoking corresponding interface or communication protocol, by one or more in corresponding software or webpage or server to acquire the acquired data. content information of the type described. 23. An intelligent terminal, characterized in that, comprising: Touch-sensitive displays for displaying user interfaces for human-computer interaction; one or more processors; memory; one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors; The one or more programs are used to drive the one or more processors to construct a unit for performing the method of any one of claims 1 to 11.