CN106550132A

CN106550132A - A kind of mobile terminal and its control method

Info

Publication number: CN106550132A
Application number: CN201610941126.8A
Authority: CN
Inventors: 王艳伟
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2016-10-25
Filing date: 2016-10-25
Publication date: 2017-03-29

Abstract

The invention discloses a kind of mobile terminal, the mobile terminal can be based on first using carry out image acquisition, and the mobile terminal includes：Receiver module, for receiving first kind voice messaging；Identification module, for recognizing whether the first kind voice messaging meets predetermined registration operation information；Wherein, the predetermined registration operation information is to apply related voice operating order to first；Acquisition module, if meeting the predetermined registration operation information for the first kind voice messaging, obtains the shooting control instruction matched with the first kind voice messaging；Performing module, for performing the shooting control instruction based on the described first application.The present invention further simultaneously discloses a kind of method for controlling mobile terminal.

Description

Mobile terminal and control method thereof

Technical Field

The invention relates to a voice control technology in the field of terminals, in particular to a mobile terminal and a control method thereof.

Background

With the increasing functions of terminals (such as mobile phones, tablet computers, etc.), the terminals have become a part of life and work of users, and the dependence of users on the terminals is also increasing. Therefore, how to quickly, quickly and conveniently find the needed application becomes one of the key influencing factors for improving the user experience. For example, photographing is widely seen in our lives, and photographing has become an indispensable part of our lives. However, in the current terminal photographing process, the terminal is opened, the camera application is found, and the camera application is opened and a photographing button in the touch screen is touched to complete image acquisition. Therefore, the operation process is complicated, the operation process is too rigid and not convenient enough, and the time for manually operating the camera application by a user is prolonged. Meanwhile, when a photographing button in the screen is touched, the stability of the terminal lens is inevitably shaken to a certain degree, and the quality of the photos is influenced.

Disclosure of Invention

In view of this, the present invention is expected to provide a mobile terminal and a control method thereof, which can reduce manual operations of a user, customize a process and an operation command for using a terminal shooting function according to a use habit of the user, and improve use experience of the user.

In order to achieve the purpose, the technical scheme of the invention is realized as follows:

the embodiment of the invention provides a mobile terminal, which can collect images based on a first application, and comprises:

the receiving module is used for receiving the first type of voice information;

the recognition module is used for recognizing whether the first type of voice information accords with preset operation information or not; the preset operation information is a voice operation command related to a first application;

the acquisition module is used for acquiring a shooting control instruction matched with the first type of voice information if the first type of voice information accords with preset operation information;

and the execution module is used for executing the shooting control instruction based on the first application.

In the foregoing solution, optionally, the mobile terminal further includes:

a first customization module to:

when receiving an operation of pre-changing the existing preset operation information, determining a shooting control instruction corresponding to the pre-changed preset operation information;

collecting second-class voice information input in a preset time period; the second type of voice information is different from the first type of voice information;

analyzing the second voice information, and determining new preset operation information based on the analysis result;

and establishing a mapping relation between the new preset operation information and the shooting control instruction corresponding to the preset operation information which is changed in advance.

In the foregoing solution, optionally, the first customizing module is further configured to:

determining a training model which is adaptive to a shooting control instruction corresponding to the preset operation information which is changed in advance;

extracting feature information of the second type of voice information;

and training the extracted characteristic information based on the training model to obtain new preset operation information.

In the foregoing solution, optionally, the mobile terminal further includes:

a second customization module to:

receiving the operation of a voice operation command of a newly-built first shooting control instruction; the first shooting control instruction is a control instruction related to the first application, and preset operation information corresponding to the first shooting control instruction is not stored in the mobile terminal currently;

collecting third-class voice information input in a second preset time period; wherein the third type of voice information and the second type of voice information are different voice information;

analyzing the third type of voice information;

determining preset operation information corresponding to the first shooting control instruction based on an analysis result;

and establishing a mapping relation between the determined preset operation information corresponding to the first shooting control instruction and the first shooting control instruction.

In the foregoing solution, optionally, the mobile terminal further includes: a monitoring module to:

monitoring acquired data obtained by the sensor; wherein the collected data is data characterizing a user using the mobile terminal;

analyzing the collected data to obtain user state information;

automatically lighting a screen of the mobile terminal when the user state information is matched with the reference state information; the reference state information is used for representing a shooting function of a user for using the first application in advance.

The embodiment of the invention also provides a mobile terminal control method, wherein the mobile terminal can acquire images based on the first application, and the method comprises the following steps:

receiving first type voice information;

identifying whether the first type of voice information accords with preset operation information or not; the preset operation information is a voice operation command related to a first application;

if the first type of voice information accords with preset operation information, acquiring a shooting control instruction matched with the first type of voice information;

executing the shooting control instruction based on the first application.

In the foregoing scheme, optionally, the method further includes:

In the foregoing solution, optionally, the analyzing the second-class voice information and determining new preset operation information based on the analysis result includes:

extracting feature information of the second type of voice information;

In the foregoing scheme, optionally, the method further includes:

analyzing the third type of voice information;

In the foregoing solution, optionally, before receiving the first type of voice information, the method further includes:

monitoring acquired data obtained by the sensor; the collected data is data characterizing a user using the mobile terminal;

analyzing the collected data to obtain user state information;

The invention provides a mobile terminal and a control method thereof, wherein the mobile terminal receives first-class voice information; firstly, identifying whether the first type of voice information accords with a voice operation command related to a first application; if so, acquiring a shooting control instruction matched with the first type of voice information; executing the shooting control instruction based on the first application; therefore, the manual operation of the user is reduced to the maximum extent, the convenient shooting service is brought to the user, and the problems of poor picture stability, poor shooting effect and the like caused by manual touch of the shooting key on the screen of the mobile terminal are solved. In addition, the existing voice operation command and the voice operation command corresponding to the shooting control command which is not stored currently can be changed, the process of using the terminal shooting function and the operation command are customized according to the use habit of the user, and the use experience of the user is improved.

Drawings

Fig. 1 is a schematic hardware configuration diagram of an alternative mobile terminal implementing various embodiments of the present invention;

FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;

fig. 3 is a schematic diagram illustrating an implementation flow of a mobile terminal control method according to an embodiment of the present invention;

fig. 4 is a schematic flow chart illustrating a process of changing existing default operation information according to an embodiment of the present invention;

fig. 5 is a schematic flowchart of a process of creating new preset operation information according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.

Detailed Description

So that the manner in which the features and aspects of the embodiments of the present invention can be understood in detail, a more particular description of the embodiments of the invention, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings.

A terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the description of the embodiments of the present invention, and have no specific meaning in themselves. Thus, "module", "component" or "unit" may be used mixedly.

The terminal may be implemented in various forms. For example, the terminal described in the embodiments of the present invention may include terminals such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a Personal Digital Assistant (PDA), a tablet computer (PAD), a Portable Multimedia Player (PMP), a navigation device, and the like, and fixed terminals such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Fig. 1 is a schematic hardware configuration of a mobile terminal implementing various embodiments of the present invention.

The mobile terminal 100 may include an audio/video (a/V) input unit 120, a user input unit 130, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, and the like. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.

The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 1220, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium), and two or more cameras 1210 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.

The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification Module may store various information for authenticating a User using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.

In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The Display unit 151 may include at least one of a Liquid Crystal Display (LCD), a Thin Film Transistor LCD (TFT-LCD), an Organic Light-Emitting Diode (OLED) Display, a flexible Display, a three-dimensional (3D) Display, and the like. Some of these displays may be configured to be transparent to allow a user to see from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a Transparent Organic Light Emitting Diode (TOLED) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm unit 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 153 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (communicating communication) is received, the alarm unit 153 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 may also provide an output notifying the occurrence of an event via the display unit 151 or the audio output module 152.

The memory 160 may store software programs or the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, etc.) that has been output or is to be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.

The Memory 160 may include at least one type of storage medium including a flash Memory, a hard disk, a multimedia card, a card-type Memory (e.g., SD or DX Memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic Memory, a magnetic disk, an optical disk, etc. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.

The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, and an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.

Up to now, the mobile terminal has been described in terms of its functions. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.

A communication system in which a mobile terminal according to an embodiment of the present invention is operable will now be described with reference to fig. 2.

Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication System includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global System for Mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to fig. 2, the CDMA wireless communication system may include a plurality of Mobile terminals 100, a plurality of Base Stations (BSs) 270, a Base Station Controller (BSC) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that a system as shown in fig. 2 may include multiple BSCs 275.

Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).

The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.

As shown in fig. 2, a Broadcast Transmitter (BT) 295 transmits a Broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.

In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.

As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.

Based on the mobile terminal hardware structure and the communication system, in order to better serve a user, facilitate the user to quickly and rapidly find the first application, reduce manual operation of the user, and meet the requirements of customizing a process of using a terminal shooting function and an operation command according to the use habit of the user, the method and the device provided by the invention have various embodiments.

Fig. 3 is a schematic diagram of an implementation flow of a mobile terminal control method according to an embodiment of the present invention, where the mobile terminal control method in this example is applied to a mobile terminal, and the mobile terminal is capable of performing image acquisition based on a first application, as shown in fig. 3, the mobile terminal control method mainly includes the following steps:

step 301: a first type of voice information is received.

In this embodiment, the first application may refer to an application having an image capturing function, such as a camera application.

Here, the first type of voice information refers to standard information that is default to the system.

For example, the default standard information for opening the first application is four words "find camera" in mandarin chinese, and then step 302 is performed only when the four words are received by the mobile terminal and described by the user in mandarin chinese. That is, if the mobile terminal receives the three words "find camera", step 302 will not be executed; step 302 will not be executed if the mobile terminal receives "find camera" expressed in english, or "find camera" expressed in a dialect of the right of the country, such as southern min.

In an embodiment, the receiving the first type of voice information may include:

and receiving first-class voice information through voice acquisition equipment in the mobile terminal.

Here, the voice collecting device may be a microphone, a voice collector, or the like.

In one embodiment, the first type of voice information is sent directly to the mobile terminal by a user.

For example, when a user walks around a park, finds that surrounding scenery is beautiful, says that a handheld mobile phone finds four words of camera, and when the mobile phone receives voice information, generates a control instruction for finding a camera application according to the voice information, and executes corresponding operations based on the control instruction, such as finding the camera application in the mobile phone and opening the camera application.

In one embodiment, the first type of voice information is sent to the mobile terminal through a first device; here, the first device is a device connectable to the mobile terminal, such as a headset.

For example, when a user wants to take a self-timer while listening to a song played by a mobile phone through an earphone, the user aims at a microphone in the earphone to say four words of "find camera", and when receiving voice information, the mobile phone generates a control instruction of "find and open a camera application" according to the voice information, and executes corresponding operations based on the control instruction, such as finding the camera application in the mobile phone and opening the camera application.

Therefore, compared with the prior art that a user needs to manually find the camera application in the mobile terminal when wanting to take or record a picture, and then manually open the camera application, the manual operation of the user is simplified, and the searching time is saved.

Preferably, when the first type of voice information is received, the screen of the mobile terminal is in a lighting state.

Optionally, when receiving the first type of voice information, the method further includes:

detecting whether a screen of the mobile terminal is in a lighted state,

if the mobile terminal is not in the lighting state, automatically lighting the screen of the mobile terminal;

and if the mobile terminal is in the lighting state, the operation of automatically lighting the screen of the mobile terminal is not executed.

In an embodiment, before receiving the first type of voice information, the method further includes:

analyzing the collected data to obtain user state information;

Therefore, whether the user wants to use the first application or not can be judged according to the monitored acquisition data, if the user judges that the first application is used by the current user in advance, the screen of the mobile terminal is automatically lightened, the screen is not required to be lightened by pressing the power key every time, and the service life of the power key is relatively prolonged.

Wherein the collected data includes motion data, voice data, etc. of a user using the mobile terminal.

For example, the speech data characterizes the user uttering a word of favor for the current environment.

For example, the reference state information is to take a picture whenever the user issues a praise word to the current environment; for example, if the term "beautiful scene" is used, when the mobile terminal collects the voice data of the "beautiful scene", it is determined that the current user state information is the pre-use first application, and the screen of the mobile terminal is automatically lighted.

In this way, the screen can be automatically lit up according to the mood of the user.

For example, the motion data characterizes a user making a preset gesture intended to use a camera application.

For example, the reference state information is a shooting reminder whenever the user makes a preset gesture intended to use the camera application; for example, if the gesture is "scissors hand", when the mobile terminal collects motion data of "scissors hand", it is determined that the current user state information is the first application to be used, and the screen of the mobile terminal is automatically lit.

In this way, the screen can be automatically lit up according to the usage habit of the user.

Step 302: identifying whether the first type of voice information accords with preset operation information or not; the preset operation information is a voice operation command related to the first application.

In an embodiment, the recognizing whether the first type of speech information conforms to preset operation information includes:

and locally recognizing the received first-class voice information through a preset voice recognition engine to obtain a recognition result of whether the first-class voice information accords with preset operation information.

uploading the received first-class voice information to a server through a preset voice recognition engine, and receiving a recognition result whether the first-class voice information sent by the server meets preset operation information or not.

For example, the predetermined operation information is a voice operation command related to the first application, and the voice operation command includes "find camera", and then, when the received first type of voice information is "find camera", it is determined that the first type of voice information is the voice operation command related to the first application, that is, the first type of voice information conforms to the predetermined operation information.

Step 303: and if the first type of voice information accords with preset operation information, acquiring a shooting control instruction matched with the first type of voice information.

Wherein the shooting control instruction at least comprises: a shooting parameter setting instruction and a shooting action instruction.

For example, the shooting parameter setting instruction includes one or more of: an aperture value setting instruction, a focus mode setting instruction, an exposure compensation setting instruction, a shutter speed setting instruction, a sensitivity setting instruction, a flash setting instruction, a shooting mode setting instruction.

Wherein, shoot the action order and include: shooting immediately; delaying a q-second shot, wherein q is greater than 0; n is a positive integer greater than or equal to 2.

In one embodiment, the obtaining of the shooting control instruction matched with the first type of voice information includes:

and searching a shooting control instruction matched with the first type of voice information from a local database.

For example, the shooting control instruction includes a camera application control instruction which is searched and started, and an immediate shooting control instruction; when the mobile terminal receives first-class voice data, the voice data is 'i want to take a picture', then the mobile terminal recognizes that the voice data belongs to a voice operation command related to a camera application, a shooting control instruction corresponding to the voice operation command is searched, if the shooting control instruction corresponding to the voice data of 'i want to take a picture' is 'searching and starting the camera application', then the mobile terminal executes the shooting control instruction of 'searching and starting the camera application'; if the user sends a voice operation command of 'start taking a picture', the mobile terminal identifies that the voice data belongs to the voice operation command related to the camera application, then a shooting control command corresponding to the voice operation command is searched, and if the shooting control command corresponding to the voice data of 'start taking a picture' is found to be 'immediate taking picture', then the mobile terminal executes the shooting control command of 'immediate taking picture'.

Step 304: executing the shooting control instruction based on the first application.

In one embodiment, after the executing the shooting control instruction based on the first application, the method includes:

and storing the pictures or video files obtained after the shooting control instructions are executed.

Here, the storage order may be stored in chronological order or in a file size.

In the embodiment of the invention, a mobile terminal receives first-class voice information; firstly, identifying whether the first type of voice information accords with a voice operation command related to a first application; if so, acquiring a shooting control instruction matched with the first type of voice information; executing the shooting control instruction based on the first application; therefore, the manual operation of the user is reduced to the greatest extent, the user is provided with convenient shooting service, the problems of poor picture stability, poor shooting effect and the like caused by manual touch of the shooting key on the screen of the mobile terminal are avoided, and the use experience of the user is improved.

Fig. 4 is a schematic diagram illustrating a process for changing the existing preset operation information, and as shown in fig. 4, the process includes:

step 401: when receiving an operation of pre-changing the existing preset operation information, determining a shooting control instruction corresponding to the pre-changed preset operation information;

here, the operation of pre-changing the existing preset operation information may be a voice operation or a touch operation.

For example, when a user opens a preset operation information management interface, clicks and changes a column of existing preset operation information, the mobile terminal presents the existing preset operation information, and when the user selects one piece of preset operation information, the mobile terminal determines the piece of preset operation information selected by the user as the preset operation information to be changed.

Step 402: collecting second-class voice information input in a preset time period; the second type of voice information is different from the first type of voice information;

here, the difference may be a difference in voice or intonation. If the first type of speech information is mandarin chinese and the second type of speech information is local dialect.

Here, the difference may be a difference in words, phrases, or sentences. If the first type of voice information is a sentence composed of five characters, the second type of voice information is a verb composed of two characters.

Step 403: analyzing the second voice information, and determining new preset operation information based on the analysis result;

in an embodiment, the analyzing the second type of voice information and determining new preset operation information based on the analysis result includes:

extracting feature information of the second type of voice information;

The mobile terminal is stored with different training models corresponding to different shooting control instructions in advance.

For example, the training Model may be a Hidden Markov Model (HMM).

In one embodiment, analyzing the second type of voice information includes:

performing voice recognition on the second type of voice information to identify whether the second type of voice information is emitted by a specific user or a non-specific user; the specific user is an owner of the mobile terminal, and the unspecified user is a user other than the owner;

and analyzing the grammar of the second type of voice information.

The principle of the HMM algorithm is:

a. a set of L sound classes is defined for modeling. E.g. phoneme or vocabulary, defining a sound class V ═ V₁，V₂，...，V_L}；

b. For each class, accumulating a certain amount of known sets of tagged speech;

c. on the basis of the training set, the estimation problem is solved for each class V_iObtaining a best model lambdai;

d. in the recognition process, Pr (O | λ i) (i ═ 1, 2, …, L) is estimated for each unknown observation sequence O, and for each class V_iAnd determining the probability of generating the voice of O, wherein the maximum voice is the recognized voice.

In one embodiment, the classification is based on whether a particular speaker or a non-speaker is processed, whether a single vocabulary input or a continuous one sentence input is processed, and accurate recognition of the non-speaker, particularly of numbers or number sequences, can be easily achieved if the speaker inputs commands in a particular grammar with a higher recognition rate.

The mobile terminal manufacturer can cooperate with a third-party data dealer to use more language samples, such as languages of all countries in the world and dialects of all regions, so that the accuracy of the user in training the personalized commands can be improved, the training times can be reduced, and the training precision can be improved.

In an embodiment, before analyzing the second type of speech information, the method further includes: and performing denoising processing on the decoded second-class voice information.

Step 404: and establishing a mapping relation between the new preset operation information and the shooting control instruction corresponding to the preset operation information which is changed in advance.

In an embodiment, the establishing a mapping relationship between the new preset operation information and the shooting control instruction corresponding to the preset operation information that is pre-changed includes:

and replacing the preset operation information which is changed in advance with the new preset operation information.

Thus, to accommodate different populations and different languages, the capture control command associated with the first application may be trained by the user, i.e., the user may be customized to the private operating voice command based on the user's habits and language, and the default voice operating command of the system may be modified.

For example, a training mechanism is provided in a camera application, when a user first contacts and wants to set a voice command part, the user can input a desired voice operation command for himself multiple times, such as taking "camera, start taking picture" as a command, inputting "camera, start taking picture" by multiple times facing a microphone, train the characteristics of the command by HMM algorithm, and turn on the function of taking picture when the user later inputs a "start taking picture" command. The specific implementation steps are as follows: setting a training command interface in a camera application, wherein the training command interface comprises a plurality of training items, such as starting a camera to take a picture; then inputting the command of starting the camera for HMM algorithm training for many times, the advantage is that the command can be completely changed into 'finding the camera and taking a picture' according to the habit of the user, and can also be dialect and foreign language, and can be completely customized by the user.

Fig. 5 is a schematic diagram illustrating a flow of creating the preset operation information, and as shown in fig. 5, the flow includes:

step 501: receiving the operation of a voice operation command of a newly-built first shooting control instruction;

the first shooting control instruction is a control instruction related to the first application, and preset operation information corresponding to the first shooting control instruction is not stored in the mobile terminal currently.

Step 502: collecting third-class voice information input in a second preset time period; wherein the third type of voice information and the second type of voice information are different voice information;

here, the different shooting control commands are different from each other in the corresponding preset operation information, and therefore, the newly created preset operation information of the first shooting control command is inevitably different from the already existing preset operation information.

For example, the different voice messages may differ in voice or intonation, or in characters, words, or sentences.

Step 503: analyzing the third type of voice information, and determining preset operation information corresponding to the first shooting control instruction based on an analysis result;

in an embodiment, before analyzing the third type of speech information, the method further includes: and performing denoising processing on the decoded third-class voice information.

Step 504: and establishing a mapping relation between the determined preset operation information corresponding to the first shooting control instruction and the first shooting control instruction.

For example, the current mobile terminal does not store the preset operation information of the delayed shooting, and the user establishes a mapping relationship between the preset operation information corresponding to the delayed shooting control instruction, namely "please delay shooting", and the first shooting control instruction in a manner of newly creating the preset operation information.

Therefore, the voice operation command corresponding to the shooting control command which is not stored at present can be newly established, the process and the operation command for customizing the shooting function of the terminal according to the use habit of the user are met, and the use experience of the user is improved.

Fig. 6 is a schematic diagram of a composition structure of a mobile terminal according to an embodiment of the present invention, as shown in fig. 6, the mobile terminal includes a receiving module 61, an identifying module 62, an obtaining module 63, and an executing module 64; wherein,

a receiving module 61, configured to receive a first type of voice information;

the recognition module 62 is configured to recognize whether the first type of voice information conforms to preset operation information; the preset operation information is a voice operation command related to a first application;

an obtaining module 63, configured to obtain a shooting control instruction matched with the first type of voice information if the first type of voice information conforms to preset operation information;

an execution module 64, configured to execute the shooting control instruction based on the first application.

In one embodiment, the mobile terminal further includes:

a first fixing module 65 for:

In a specific embodiment, the first determining module 65 analyzes the second type of voice information, and determines new preset operation information based on the analysis result, including:

extracting feature information of the second type of voice information;

In one embodiment, the mobile terminal further includes:

a second customization module 66 for:

analyzing the third type of voice information;

In one embodiment, the mobile terminal further includes: a monitoring module 67 for:

analyzing the collected data to obtain user state information;

Those skilled in the art will understand that the implementation functions of each processing module in the mobile terminal shown in fig. 6 can be understood by referring to the related description of the control method of the mobile terminal. Those skilled in the art will appreciate that the processing modules in the mobile terminal shown in fig. 6 may be implemented by a program running on a processor, and may also be implemented by specific logic circuits.

The specific structures of the receiving module 61, the identifying module 62, the obtaining module 63, the executing module 64, the first customizing module 65, the second customizing module 66 and the monitoring module 67 in the mobile terminal described in the above embodiments may all correspond to a processor. The specific structure of the Processor may be an electronic component or a collection of electronic components having a Processing function, such as a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or a Programmable gate array (FPGA). The processor includes executable codes, the executable codes are stored in a storage medium, the processor can be connected to the storage medium through a communication interface such as a bus, and when the corresponding functions of the specific modules are executed, the executable codes are read from the storage medium and executed. The portion of the storage medium used to store the executable code is preferably a non-transitory storage medium.

The receiving module 61, the identifying module 62, the obtaining module 63, the executing module 64, the first customizing module 65, the second customizing module 66 and the monitoring module 67 may be integrated to correspond to the same processor, or correspond to different processors respectively; when the integration corresponds to the same processor, the receiving module 61, the identifying module 62, the obtaining module 63, the executing module 64, the first customizing module 65, the second customizing module 66 and the monitoring module 67 correspond to functions.

The mobile terminal can reduce manual operation of a user to the greatest extent, brings convenient shooting service for the user, and avoids the problems of poor picture stability, poor shooting effect and the like caused by manual touch of a shooting key on a screen of the mobile terminal. In addition, the mobile terminal of the embodiment can change the existing voice operation command and the voice operation command corresponding to the shooting control command which is not stored currently, so that the process and the operation command for using the terminal shooting function are customized according to the use habit of the user, and the use experience of the user is improved.

The technical schemes described in the embodiments of the present invention can be combined arbitrarily without conflict.

In the embodiments provided in the present invention, it should be understood that the disclosed method and intelligent device may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all the functional units in the embodiments of the present invention may be integrated into one second processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention.

Claims

1. A mobile terminal capable of image acquisition based on a first application, the mobile terminal comprising:

the receiving module is used for receiving the first type of voice information;

2. The mobile terminal of claim 1, wherein the mobile terminal further comprises:

a first customization module to:

3. The mobile terminal of claim 2, wherein the first customizing module is further configured to:

extracting feature information of the second type of voice information;

4. The mobile terminal of claim 1, wherein the mobile terminal further comprises:

a second customization module to:

analyzing the third type of voice information;

5. The mobile terminal of claim 1, wherein the mobile terminal further comprises: a monitoring module to:

analyzing the collected data to obtain user state information;

6. A mobile terminal control method, the mobile terminal can collect images based on a first application, the method is characterized by comprising the following steps:

receiving first type voice information;

executing the shooting control instruction based on the first application.

7. The mobile terminal control method according to claim 6, wherein the method further comprises:

8. The method according to claim 7, wherein the analyzing the second type of voice information and determining new preset operation information based on the analysis result comprises:

extracting feature information of the second type of voice information;

9. The mobile terminal control method according to claim 6, wherein the method further comprises:

analyzing the third type of voice information;

10. The method of claim 6, wherein before the receiving the first type of voice information, the method further comprises:

analyzing the collected data to obtain user state information;