CN104932697B - Gesture unlocking method and device - Google Patents
Gesture unlocking method and device Download PDFInfo
- Publication number
- CN104932697B CN104932697B CN201510374565.0A CN201510374565A CN104932697B CN 104932697 B CN104932697 B CN 104932697B CN 201510374565 A CN201510374565 A CN 201510374565A CN 104932697 B CN104932697 B CN 104932697B
- Authority
- CN
- China
- Prior art keywords
- gesture
- unlocking
- motion track
- image contour
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000033001 locomotion Effects 0.000 claims abstract description 110
- 230000009471 action Effects 0.000 claims abstract description 48
- 230000008569 process Effects 0.000 abstract description 14
- 238000004891 communication Methods 0.000 description 27
- 230000006870 function Effects 0.000 description 7
- 238000010295 mobile communication Methods 0.000 description 7
- 230000005236 sound signal Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 230000002441 reversible effect Effects 0.000 description 2
- 101150012579 ADSL gene Proteins 0.000 description 1
- 102100020775 Adenylosuccinate lyase Human genes 0.000 description 1
- 108700040193 Adenylosuccinate lyases Proteins 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Telephone Function (AREA)
Abstract
The invention discloses a gesture unlocking method and a gesture unlocking device, wherein the method comprises the following steps: detecting gesture actions and acquiring image outlines of the gesture actions; when the image contour is matched with the preset gesture, acquiring a motion track of a reference point of the image contour; when the motion track is matched with the motion track corresponding to the preset gesture, unlocking; otherwise, the unlocking is refused. The unlocking recognition is carried out only by judging whether the motion track of the reference point is matched with the motion track of the preset gesture, so that the process of modeling the gesture image is omitted, the recognition efficiency is improved, and the unlocking operation is more convenient and quicker. Moreover, the same preset gesture can correspond to different motion tracks, so that a user can set partial same passwords aiming at different unlocking authorities, namely different authorities can be obtained by using different motion modes of the same gesture during unlocking, password setting and unlocking operation are simpler and more convenient, and user experience is greatly improved.
Description
Technical Field
The invention relates to the technical field of communication, in particular to a gesture unlocking method and device.
Background
The unlocking mode of the mobile terminal is rich, the most common mode is touch unlocking, and the unlocking mode further comprises gesture unlocking, fingerprint unlocking, face unlocking and the like. For gesture unlocking, in the prior art, similarity comparison needs to be performed after gesture modeling, so that the complexity of an algorithm is improved, and the recognition efficiency is influenced.
Meanwhile, the existing mobile terminal operating system already supports multi-user permission, and when the password setting of the multi-user permission is carried out, a user prefers that a plurality of set passwords are partially the same and partially different, if the former part is the same, the latter part is slightly modified, so that the setting and the memorizing are easy. For the requirement, the modes such as fingerprint unlocking, face unlocking and the like can obviously not be met; touch unlocking is complicated.
Disclosure of Invention
The invention mainly aims to provide a gesture unlocking method and a gesture unlocking device, and aims to improve the recognition efficiency of gesture unlocking and enable unlocking operation to be more convenient and faster.
In order to achieve the above object, the present invention provides a gesture unlocking method, which includes the steps of:
detecting a gesture action, and acquiring an image outline of the gesture action;
when the image contour is matched with a preset gesture, acquiring a motion track of a reference point of the image contour;
when the motion track is matched with the motion track corresponding to the preset gesture, unlocking; otherwise, the unlocking is refused.
Preferably, the method further comprises:
prompting a user to input a gesture action;
acquiring an image contour of an input gesture and a motion track of a reference point of the image contour;
and storing the image contour and the motion trail, and taking the image contour as a preset gesture.
Preferably, the reference point is a highest point, a lowest point or a starting point of the image contour.
Preferably, at least two motion tracks corresponding to the preset gesture are provided, and different motion tracks correspond to different unlocking authorities.
Preferably, the detecting the gesture motion and acquiring the image outline of the gesture motion includes:
and detecting the gesture action through a camera to obtain the image outline of the gesture action.
The invention also provides a gesture unlocking device, which comprises:
the first acquisition module is used for detecting gesture actions and acquiring image outlines of the gesture actions;
the first judgment module is used for judging whether the image contour is matched with a preset gesture or not;
the second acquisition module is used for acquiring a motion track of a reference point of the image contour when the image contour is matched with a preset gesture;
the second judgment module is used for judging whether the motion track is matched with the motion track corresponding to the preset gesture;
the unlocking module is used for unlocking when the motion track is matched with the motion track corresponding to the preset gesture; otherwise, the unlocking is refused.
Preferably, the mobile terminal further comprises a setting module, wherein the setting module is used for: prompting a user to input a gesture action; acquiring an image contour of an input gesture and a motion track of a reference point of the image contour; and storing the image contour and the motion trail, and taking the image contour as a preset gesture.
Preferably, the reference point is a highest point, a lowest point or a starting point of the image contour.
Preferably, at least two motion tracks corresponding to the preset gesture are provided, and different motion tracks correspond to different unlocking authorities.
Preferably, the first obtaining module is configured to: and detecting the gesture action through a camera to obtain the image outline of the gesture action.
According to the gesture unlocking method, the image contour of the gesture action is firstly obtained, if the image contour is matched with the preset gesture, the motion track of the reference point of the image contour is further obtained, and only whether the motion track of the reference point is matched with the motion track of the preset gesture is judged to perform unlocking recognition, so that the process of modeling the gesture is omitted, the recognition efficiency is improved, and the unlocking operation is more convenient and faster. Moreover, the same preset gesture can correspond to different motion tracks, so that a user can set partial same passwords aiming at different unlocking authorities, namely different authorities can be obtained by using different motion modes of the same gesture during unlocking, password setting and unlocking operation are simpler and more convenient, and user experience is greatly improved.
Drawings
Fig. 1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention;
FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;
FIG. 3 is a flowchart of an embodiment of a gesture unlocking method of the present invention;
FIG. 4 is a flowchart illustrating setting a gesture password according to an embodiment of the present invention;
fig. 5 is a schematic block diagram of a gesture unlocking device according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.
Fig. 1 is a schematic hardware configuration of a mobile terminal implementing various embodiments of the present invention.
The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.
The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.
The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast-related information or receives a previously generated broadcast signal and/or broadcast-related informationThe related information is broadcasted and transmitted to the server of the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 may receive a broadcast signal by using a signal such as multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), forward link media (MediaFLO)@) A digital broadcasting system of a terrestrial digital broadcasting integrated service (ISDB-T), etc. receives digital broadcasting. The broadcast receiving module 111 may be constructed to be suitable for various broadcasting systems that provide broadcast signals as well as the above-mentioned digital broadcasting systems. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).
The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.
The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.
The short-range communication module 114 is used for supporting short-range communicationAnd (5) a message module. Some examples of short-range communication technologies include bluetoothTMRadio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbeeTMAnd so on.
The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.
The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 1220, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display module 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 1210 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.
The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display module 151 in the form of a layer, a touch screen may be formed.
The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device. The sensing unit 140 may include a proximity sensor 1410 as will be described below in connection with a touch screen.
The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.
In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display module 151, an audio output module 152, an alarm module 153, and the like.
The display module 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display module 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display module 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.
Meanwhile, when the display module 151 and the touch pad are stacked on each other in the form of layers to form a touch screen, the display module 151 may serve as an input device and an output device. The display module 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. The mobile terminal 100 may include two or more display modules (or other display devices) according to a particular desired implementation, for example, the mobile terminal may include an external display module (not shown) and an internal display module (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.
The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.
The alarm module 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm module 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm module 153 may provide an output in the form of a vibration, and when a call, a message, or some other incoming communication (incomingmunication) is received, the alarm module 153 may provide a tactile output (i.e., a vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm module 153 may also provide an output notifying the occurrence of an event via the display module 151 or the audio output module 152.
The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.
The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 1810 for reproducing (or playing back) multimedia data, and the multimedia module 1810 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.
The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.
Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.
A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.
Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.
Referring to fig. 2, the CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that a system as shown in fig. 2 may include multiple BSCs 2750.
Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).
The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.
As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.
In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.
As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.
Based on the above mobile terminal hardware structure and communication system, an embodiment of the gesture unlocking method of the present invention is provided. As shown in fig. 3, the method comprises the steps of:
and S11, detecting the gesture action and acquiring the image outline of the gesture action.
Specifically, the gesture action is detected through the camera, and the image outline of the gesture action is obtained.
And S12, comparing the image contour with a preset gesture, and judging whether the image contour is matched with the preset gesture. When the two match, step S13 is executed; when the two do not match, step S16 is performed.
Specifically, the acquired image contour is compared with a preset gesture, and whether the acquired image contour is matched with the preset gesture is judged. When the two are within a preset error range, judging that the two are matched; and when the two errors exceed the preset error range, judging that the two errors are not matched.
Taking the preset gesture as a "V" type gesture as an example, when a user writes a "V" in front of the camera left and right or up and down, it is determined that the image contour of the user matches the "V" type gesture, that is, it is determined that the left and right or up and down writing of the "V" gesture is the "V" type gesture.
And S13, acquiring the motion trail of the reference point of the image contour.
And when the acquired image contour is matched with the preset gesture, further acquiring the motion trail of the reference point of the image contour.
The reference point may be the highest point, the lowest point or the starting point of the image contour. Preferably, the present embodiment obtains a motion trajectory of the highest point of the image contour.
And S14, comparing the obtained motion track with a motion track corresponding to a preset gesture, and judging whether the two are matched. When the two match, step S15 is executed; when the two do not match, step S16 is performed.
The preset gesture may correspond to one motion trajectory. For example, assume that the preset gesture is a "V" type gesture, and the corresponding motion trajectory is "<". When a user writes a 'V' in front of the camera up and down, the motion track corresponding to the highest point of the image outline is a 'V', and is not matched with the motion track corresponding to the preset gesture; when a user writes 'V' in front of the camera left and right, the motion track corresponding to the highest point of the image outline is '<', and is matched with the motion track corresponding to the preset gesture.
The preset gesture can also correspond to at least two motion tracks, and different motion tracks correspond to different unlocking authorities. For example, assume that the preset gesture is a "V" type gesture, and the corresponding motion trajectory includes "V" and "<", where "V" corresponds to general user permission and "<" corresponds to super user (or administrator) permission. When a user writes a 'V' in front of the camera up and down, the motion track corresponding to the highest point of the image outline is a 'V' and is matched with the motion track of the general user authority corresponding to the preset gesture; when a user writes 'V' in front of the camera left and right, the motion track corresponding to the highest point of the image outline is '<', and is matched with the motion track of the super user authority corresponding to the preset gesture.
And S15, unlocking.
And unlocking when the gesture action input by the user is matched with the preset gesture and the motion track of the reference point is matched with the motion track corresponding to the preset gesture.
And when at least two motion tracks corresponding to the preset gesture exist, unlocking according to the unlocking authority of the matched motion track, and acquiring the corresponding management authority after unlocking.
And S16, refusing unlocking.
And when the gesture action input by the user is not matched with the preset gesture or the motion track of the reference point of the gesture action input by the user is not matched with the motion track corresponding to the preset gesture, refusing to unlock and prompting the user that the password is wrong.
In addition, as shown in fig. 4, when setting the gesture password, the method includes the following steps:
and S21, prompting the user to input gesture actions.
For example, a user creates a new user and sets a corresponding authority, after the new creation is completed, the system requires the user to set a password, and when the user selects a gesture password, the user is prompted to aim at the camera to input a gesture action.
And S22, acquiring an image contour of the input gesture motion and a motion track of a reference point of the image contour.
Specifically, an image contour of the input gesture motion is obtained through the camera, and a motion track of a reference point of the image contour is obtained.
And S23, storing the image contour and the motion trail, and taking the image contour as a preset gesture.
And finally, storing the acquired image contour and the acquired motion track, wherein the image contour is used as a preset gesture, and the motion track is a motion track corresponding to the preset gesture.
The gesture unlocking method of the invention comprises the following steps: a user establishes a new user and sets a corresponding authority, and after the establishment is finished, the system requires the user to set a password; the method comprises the steps that a user selects a gesture password, a gesture action is performed by aiming at a camera, after clicking is determined, the system displays a current gesture for the user in a terminal, and inquires whether the user uses the gesture as a terminal password, if clicking is determined, the terminal stores the gesture, the system stores a motion track of the gesture by using a reference point motion track storage algorithm, and the gesture and the track are stored; when the user unlocks, corresponding gesture actions are input in front of the camera according to corresponding authorities, and the system uses the reference point motion track unlocking algorithm again to judge whether corresponding gestures are met.
The flow of the reference point motion trajectory storage algorithm is roughly as follows: a user inputs a gesture action, and the system acquires an image of the gesture action through a camera; the system starts a sub-thread, the sub-thread acquires an input image profile through a camera and stores the profile; the system continuously acquires the image contour from the camera, the sub-thread acquires a reference point (such as the highest point) of the image contour, records the motion track of the reference point until the motion is finished, and finally acquires the image contour and the motion track of the reference point.
The flow of the reference point motion trajectory unlocking algorithm is roughly as follows: a user inputs a gesture action, and the system acquires an image of the gesture action through a camera; the system starts a sub-thread, and the sub-thread acquires an input image contour through a camera and compares the input image contour with a previously stored image contour; if the allowable error range is exceeded, informing the user that the gesture password is wrong; if the error is within the allowed error range, the sub-thread acquires the motion track of a reference point (such as the highest point) of the image outline, compares the motion track of the reference point with the motion track of the reference point corresponding to the unlocking authority, and unlocks if the error is within the allowed error range; and if the error exceeds the allowable range, informing the user that the password is wrong.
According to the gesture unlocking method, the image contour of the gesture action is firstly obtained, if the image contour is matched with the preset gesture, the motion track of the reference point of the image contour is further obtained, and only whether the motion track of the reference point is matched with the motion track of the preset gesture is judged to perform unlocking recognition, so that the process of modeling the gesture image is omitted, the recognition efficiency is improved, and the unlocking operation is more convenient and faster. Moreover, the same preset gesture can correspond to different motion tracks, so that a user can set partial same passwords aiming at different unlocking authorities, namely different authorities can be obtained by using different motion modes of the same gesture during unlocking, password setting and unlocking operation are simpler and more convenient, and user experience is greatly improved.
The invention further provides a gesture unlocking device which is applied to the mobile terminal. Based on the above-mentioned mobile terminal hardware structure and communication system, an embodiment of the gesture unlocking device of the present invention is provided. As shown in fig. 5, the apparatus includes a setting module, a first obtaining module, a first determining module, a second obtaining module, a second determining module, and an unlocking module, wherein:
setting a module: for setting a gesture password. The method specifically comprises the following steps: prompting a user to input a gesture action; acquiring an image contour of an input gesture action and a motion track of a reference point of the image contour; and storing the image contour and the motion trail, and taking the image contour as a preset gesture.
A first obtaining module: the gesture detection module is used for detecting gesture actions, acquiring image outlines of the gesture actions and sending the image outlines to the first judgment module.
Specifically, the first acquisition module detects gesture actions through the camera and acquires image outlines of the gesture actions.
A first judgment module: and the second acquisition module is used for judging whether the image contour is matched with the preset gesture or not and sending the judgment result to the second acquisition module.
A second obtaining module: and the second judging module is used for acquiring the motion trail of the reference point of the image contour when the image contour is matched with the preset gesture and sending the motion trail to the second judging module.
A second judging module: and the unlocking module is used for judging whether the motion track is matched with the motion track corresponding to the preset gesture or not and sending the judgment result to the unlocking module.
An unlocking module: the unlocking device is used for unlocking when the motion track is matched with the motion track corresponding to the preset gesture; otherwise, the unlocking is refused.
Wherein the reference point is the highest point, the lowest point or the starting point of the image contour. At least two motion tracks corresponding to the preset gesture are provided, and different motion tracks correspond to different unlocking authorities.
The gesture unlocking device and the gesture unlocking method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments in detail, and technical features in the method embodiments are correspondingly applicable in the device embodiments, and are not described herein again.
According to the gesture unlocking device, the image contour of the gesture action is firstly obtained, if the image contour is matched with the preset gesture, the motion track of the reference point of the image contour is further obtained, and the unlocking recognition is carried out only by judging whether the motion track of the reference point is matched with the motion track of the preset gesture, so that the process of modeling the gesture image is omitted, the recognition efficiency is improved, and the unlocking operation is more convenient and faster. Moreover, the same preset gesture can correspond to different motion tracks, so that a user can set partial same passwords aiming at different unlocking authorities, namely different authorities can be obtained by using different motion modes of the same gesture during unlocking, password setting and unlocking operation are simpler and more convenient, and user experience is greatly improved.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (6)
1. A gesture unlocking method is characterized by comprising the following steps:
detecting a gesture action, and acquiring an image outline of the gesture action;
when the image contour is matched with a preset gesture, acquiring a motion track of a reference point of the image contour, wherein the reference point is the highest point, the lowest point or the starting point of the image contour;
when the motion track is matched with the motion track corresponding to the preset gesture, unlocking; otherwise, refusing to unlock;
at least two motion tracks corresponding to the preset gesture are provided, and different motion tracks correspond to different unlocking authorities.
2. The gesture unlocking method according to claim 1, further comprising:
prompting a user to input a gesture action;
acquiring an image contour of an input gesture and a motion track of a reference point of the image contour;
and storing the image contour and the motion trail, and taking the image contour as a preset gesture.
3. The gesture unlocking method according to any one of claims 1-2, wherein the detecting a gesture action and acquiring an image outline of the gesture action comprises:
and detecting the gesture action through a camera to obtain the image outline of the gesture action.
4. A gesture unlocking device, comprising:
the first acquisition module is used for detecting gesture actions and acquiring image outlines of the gesture actions;
the first judgment module is used for judging whether the image contour is matched with a preset gesture or not;
the second acquisition module is used for acquiring a motion track of a reference point of the image contour when the image contour is matched with a preset gesture, wherein the reference point is the highest point, the lowest point or the starting point of the image contour;
the second judgment module is used for judging whether the motion track is matched with the motion track corresponding to the preset gesture;
the unlocking module is used for unlocking when the motion track is matched with the motion track corresponding to the preset gesture; otherwise, refusing to unlock;
at least two motion tracks corresponding to the preset gesture are provided, and different motion tracks correspond to different unlocking authorities.
5. The gesture unlocking device according to claim 4, further comprising a setting module configured to: prompting a user to input a gesture action; acquiring an image contour of an input gesture and a motion track of a reference point of the image contour; and storing the image contour and the motion trail, and taking the image contour as a preset gesture.
6. The gesture unlocking device according to any one of claims 4 to 5, wherein the first obtaining module is configured to: and detecting the gesture action through a camera to obtain the image outline of the gesture action.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510374565.0A CN104932697B (en) | 2015-06-30 | 2015-06-30 | Gesture unlocking method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510374565.0A CN104932697B (en) | 2015-06-30 | 2015-06-30 | Gesture unlocking method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104932697A CN104932697A (en) | 2015-09-23 |
| CN104932697B true CN104932697B (en) | 2020-08-21 |
Family
ID=54119887
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510374565.0A Active CN104932697B (en) | 2015-06-30 | 2015-06-30 | Gesture unlocking method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104932697B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105425945A (en) * | 2015-11-02 | 2016-03-23 | 深圳奥比中光科技有限公司 | Unlocking processing method and system, unlocking control system and display equipment |
| CN106384033A (en) * | 2016-09-29 | 2017-02-08 | 努比亚技术有限公司 | Screen off method and apparatus of terminal screen |
| CN106384032A (en) * | 2016-09-29 | 2017-02-08 | 努比亚技术有限公司 | Unlocking method and apparatus for terminal |
| US10120455B2 (en) | 2016-12-28 | 2018-11-06 | Industrial Technology Research Institute | Control device and control method |
| CN111880927B (en) * | 2017-12-05 | 2024-02-06 | 创新先进技术有限公司 | Resource allocation method, device and equipment |
| CN108668021B (en) * | 2018-04-25 | 2020-09-15 | 维沃移动通信有限公司 | An unlocking method and mobile terminal |
| CN108732975A (en) * | 2018-06-27 | 2018-11-02 | 北京小米移动软件有限公司 | Hand cleanser follower goes out hydraulic control method, apparatus and hand cleanser follower |
| EP4195628A4 (en) | 2020-08-31 | 2023-10-11 | Huawei Technologies Co., Ltd. | Electronic device, and response operating method of electronic device |
| CN112541175B (en) * | 2020-12-14 | 2025-04-11 | 珠海格力电器股份有限公司 | Parameter setting method and device for industrial control terminal, industrial control terminal and storage medium |
| CN114579950A (en) * | 2022-03-16 | 2022-06-03 | 湖北星纪时代科技有限公司 | Device unlocking method, device, electronic device and storage medium |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006040697A1 (en) * | 2004-10-12 | 2006-04-20 | Koninklijke Philips Electronics, N.V. | Ultrasound touchscreen user interface and display |
| CN101634925A (en) * | 2008-07-22 | 2010-01-27 | 联想移动通信科技有限公司 | Method for unlocking keypad through gestures |
| US9990112B2 (en) * | 2010-12-22 | 2018-06-05 | Thomson Licensing | Method and apparatus for locating regions of interest in a user interface |
| CN102609165B (en) * | 2011-01-24 | 2014-09-03 | 广州三星通信技术研究有限公司 | Mobile terminal having touch screen and mobile terminal mode control method |
| CN102236527B (en) * | 2011-07-15 | 2014-06-25 | Tcl集团股份有限公司 | Method and device for unlocking touch screen and touch screen terminal |
| KR20130045549A (en) * | 2011-10-26 | 2013-05-06 | 삼성전자주식회사 | Computing device and control method thereof |
| US20130191786A1 (en) * | 2012-01-19 | 2013-07-25 | Hsi-Lin Kuo | Method of performing a switching operation through a gesture inputted to an electronic device |
| CN103218067A (en) * | 2012-01-19 | 2013-07-24 | 群康科技(深圳)有限公司 | Touch device and gesture unlocking method thereof |
| CN102622087B (en) * | 2012-04-28 | 2015-01-21 | 上海华勤通讯技术有限公司 | Mobile terminal and unlocking method thereof |
| CN102722320B (en) * | 2012-05-21 | 2015-08-26 | 北京奇虎科技有限公司 | A kind of for the method and apparatus at the enterprising line operate of the touch-screen of electronic equipment |
| CN103246351B (en) * | 2013-05-23 | 2016-08-24 | 刘广松 | A kind of user interactive system and method |
| CN104424410B (en) * | 2013-09-05 | 2018-10-19 | 深圳市艾酷通信软件有限公司 | Mobile intelligent terminal divides the method and its system that safe class quickly starting is applied |
| CN103744506A (en) * | 2013-12-26 | 2014-04-23 | 乐视致新电子科技（天津）有限公司 | Electronic device and gesture unlocking method |
| CN104090725B (en) * | 2014-07-28 | 2017-05-10 | Tcl通讯（宁波）有限公司 | Method and system for unlocking touch screen of mobile terminal |
| CN104200144A (en) * | 2014-09-05 | 2014-12-10 | 可牛网络技术（北京）有限公司 | Method and system for improving safety of mobile terminal |
| CN104462907B (en) * | 2014-12-31 | 2018-12-28 | 北京智谷睿拓技术服务有限公司 | Solve lock control method and device, electronic equipment |
-
2015
- 2015-06-30 CN CN201510374565.0A patent/CN104932697B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN104932697A (en) | 2015-09-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104932697B (en) | Gesture unlocking method and device | |
| CN105468153B (en) | A kind of mobile terminal and its method for realizing control | |
| CN106130734A (en) | The control method of mobile terminal and control device | |
| CN104636030B (en) | Method, device and mobile terminal for starting application program | |
| CN105138260A (en) | Application switching method and terminal | |
| CN106778176B (en) | Information processing method and mobile terminal | |
| CN106529956A (en) | Terminal and verification method of terminal payment | |
| CN104992109A (en) | Method and device for password setting and method and device for password matching | |
| CN105099701B (en) | A kind of method of terminal and terminal authentication | |
| CN105100118A (en) | Authentication device and method | |
| CN106534560B (en) | Mobile terminal control device and method | |
| CN104866352A (en) | Method for starting application and mobile terminal | |
| CN106485163A (en) | Control method and control device that mobile terminal data storehouse accesses | |
| CN107133508B (en) | Application management method and mobile terminal | |
| CN106484534B (en) | Control method and control device for displayed mobile terminal | |
| CN105049612A (en) | Method of realizing recording and device of realizing recording | |
| CN106488035A (en) | A kind of mobile terminal and control method | |
| CN106412877B (en) | Activation method and activation device for mobile terminal SIM card | |
| CN105094598A (en) | Device and method for processing operational objects | |
| CN105045508B (en) | The setting device and method of system model | |
| CN105094733B (en) | Split screen display method and device | |
| CN105827981A (en) | Mobile terminal photographing method and device | |
| CN106488007A (en) | A kind of auth method and terminal | |
| CN106228043A (en) | Application icon hidden method and terminal | |
| CN106896988B (en) | Application icon alignment device, terminal and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200703 Address after: 210013, Gu Ping Gang 4, Gulou District, Jiangsu, Nanjing Applicant after: Edge Intelligence Research Institute Nanjing Co.,Ltd. Address before: 518000 Guangdong Province, Shenzhen high tech Zone of Nanshan District City, No. 9018 North Central Avenue's innovation building A, 6-8 layer, 10-11 layer, B layer, C District 6-10 District 6 floor Applicant before: NUBIA TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230724 Address after: 1501-2, Building B, Fenghuang Zhigu, No. 50 Tiezi Road, Gongle Community, Xixiang Street, Bao'an District, Shenzhen, Guangdong Province, 518000 Patentee after: Shenzhen Siyuxing Electronics Co.,Ltd. Address before: 210013 gulping 4, Gulou District, Nanjing, Jiangsu Patentee before: Edge Intelligence Research Institute Nanjing Co.,Ltd. |