KR102061567B1 - Method for providing standby mode for motion recognition and motion recognition apparatus using the same - Google Patents

Abstract

According to the present invention, a method for providing a standby mode for gesture recognition and a gesture recognition apparatus for the same are described. In particular, the motion recognition apparatus is recognized using an acceleration sensor, a gyro sensor, a geomagnetic sensor, an illuminance sensor, a proximity sensor, and the like. In this case, the sensor operation is not always turned on.In the idle state, the sampling rate of the sensors is increased, or the state of the motion recognition device is checked while the specific sensor is stopped. Only when the initial condition for the operation recognition of is satisfied, the sampling rate of the sensors may be readjusted to prevent unnecessary terminal battery consumption and terminal performance degradation. In addition, it may have a determinism capable of supporting motion recognition functions even in an idle state such as a home screen, a function of providing the most accessible screen, a background service, or a terminal screen.

Description

Method for providing standby mode for motion recognition and motion recognition apparatus using the same

The present invention relates to a motion recognition technology, and more particularly, to determine whether to enter the motion recognition standby mode according to a raw data range set for each of a plurality of sensors and priorities for each sensor prior to activation of the motion recognition mode. The present invention relates to a standby mode providing method for gesture recognition and a gesture recognition apparatus using the same.

Recently, with the introduction of an open operating system (Operating System), smart phones, which combine the high-performance features of personal computers (PCs) with mobile phones, have become popular, and various attempts have been made in the direction of utilizing high-performance and high-performance smartphones. ought.

In particular, with the development of micro fabrication technology, as advanced sensors become smaller and cheaper, more sensors can be mounted on smartphones, and many intelligent applications such as augmented reality and 3D games are used. Is being developed.

In addition, the sensors mounted on smartphones will evolve from a device that senses the surrounding environment to an intelligent sensor that takes into account changes in the user's body and emotional state, and will be able to play a key role in interacting with humans. As such, intelligent applications utilizing sensors are expected to grow further.

Sensors mounted on a smartphone include a camera (image) sensor, an acoustic sensor, a proximity sensor, an illumination sensor, a gravity sensor, a GPS (Global Positioning System) sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, and the like.

Among them, a camera (image) sensor detects light and converts the intensity of the light into digital image data. The camera (image) sensor can be used for face recognition and the like. As a sensor that converts into a conventional signal, it can be used for a voice recognition-based service, and the proximity sensor is not a detection method by a mechanical contact, but a non-contact method that determines the presence or absence of an object to be detected when the detector is in close proximity. As a sensor, it is usually used to turn off the screen automatically when the smartphone is placed close to the face or placed in a pocket for a call.

In addition, the ambient light sensor is a sensor for detecting the ambient brightness, and is usually used to set the brightness of the screen to increase the brightness in the bright place and lower the dark place to reduce the power consumption of the mobile terminal and reduce eye fatigue. It is a sensor that detects the direction of movement and detects the movement of the object.It is used to determine the display direction (horizontal and vertical) of the smartphone and automatically correct the screen orientation.

In addition, the GPS sensor is a sensor that can collect the time and location information of the object through the satellite positioning system, it is used in a variety of location-based services, the acceleration sensor detects the dynamic force changes, such as changes in the object speed per unit time, impact Recently, 3-axis accelerometer using MEMS (Micro Electro Mechanical Systems) technology has become commonplace, and even object movements such as tilt change and shake can be detected, and geomagnetic sensor detects azimuth angle like a compass by grasping the flow of the earth's magnetic field. Gyro sensor detects the inertia force of an object as an electric signal, and mainly detects the rotation angle, and can directly detect height, rotation, and inclination. Recognition is possible.

In order to accurately recognize various motions of the user, each sensor should be kept in an on state, and motion detection operations are performed by collecting sensor measurement values collected at quick intervals.

However, even when it is not the time and state of actually using the user's motion recognition, the sensor is always operated, causing a problem of wasting battery. For example, in order to enter the motion recognition standby mode, the state of the terminal (motion recognition device) must be placed in a specific position. Otherwise, the sensor is always operated to check the state of the terminal in real time and waits for motion recognition. It is determined whether to enter the mode.

In this case, even if the user does not intend to take action, the sensor always operates and collects sensor measurement values in real time, which causes terminal battery waste and decreases terminal performance and heat generation due to CPU operation. Cause. In addition, due to these limitations, the sensor can be operated in an idle state such as the most accessible screen such as a home screen of the terminal, a function of providing a background service, or a stop of the terminal screen (LCD, LED, etc.). There is no problem of scalability.

Korean Laid-Open Patent Publication No. 10-2010-0081552, published July 19, 2010 (Name: Motion detection device and method of a portable terminal)

In order to solve such a conventional problem, an object of the present invention is to recognize whether the operation to enter the operation recognition standby mode according to the low data range and priority per sensor set for each sensor prior to activation of the operation recognition mode It is intended to provide a standby mode providing method and a gesture recognition apparatus using the same.

That is, the sensors of the gesture recognition apparatus according to the present invention do not always measure the sensor values because they are always in operation, and in the idle state, increase the sampling rate of the sensors or recognize the motion with the operation of the specific sensor stopped. While checking the state of the device, it is possible to prevent the unnecessary terminal battery consumption and terminal performance deterioration by re-adjusting the sampling rate of the sensors only when the initial condition for the user's motion recognition is satisfied, and the home screen of the motion recognition device. It is intended to have a determinism that can support motion recognition functions even in an idle state such as a screen which is accessed most, a background service, and a terminal screen.

According to an embodiment of the present disclosure, a method for providing a standby mode for gesture recognition according to an embodiment of the present disclosure refers to a low data range of a plurality of sensors with reference to a parameter table of a gesture recognition standby mode in which a gesture recognition apparatus is predefined. Specifying, and adjusting, by the motion recognition apparatus, a sampling rate for each sensor value set in the low data range table according to the priority between the sensors in response to the first condition, and the motion recognition apparatus adjusting the first condition. Confirming each sensor value to which the adjusted sampling rate is reflected, and monitoring the operation change based on the result of the checking, and if the motion recognition apparatus satisfies the condition for entering the operation recognition standby mode, to match the first condition. Change the adjusted sampling rate by applying the basic conditions, and change the sampling rate with the basic conditions. Provided is a computer-readable recording medium having recorded thereon a program for executing the operation recognition standby mode reflected to each sensor.

In addition, in the method for providing a standby mode for motion recognition according to the present invention, the step of designating the motion recognition device may include the acceleration sensor and the raw data of the geomagnetic sensor among the sensors, and the x, y, z Provides a computer readable recording medium having recorded thereon a program for executing assignment of a calculated value for each axis.

In addition, in the method for providing a standby mode for motion recognition according to the present invention, the step of designating the motion recognition device executes specifying a value of a parameter as a low data range for a gyro sensor, a proximity sensor, and an illuminance sensor among the sensors. A computer readable recording medium having recorded thereon a program is provided.

In addition, in the method for providing a standby mode for gesture recognition according to the present invention, after the step of designating, in order to check the raw data as a condition for entering the gesture recognition standby mode, the sensor or the axis of each sensor Provided is a computer readable recording medium having recorded thereon a program that executes the steps of setting priorities.

Also, in the method for providing a standby mode for gesture recognition according to the present invention, the adjusting may include setting, by the gesture recognition apparatus, a sampling rate for a sensor value having the highest priority among priorities among the sensors according to a first condition. Reduce the ratio, adjust the sampling rate of the sensor value having the highest priority to the highest value that the sensor value can adjust according to the first condition, and stop the operation of the non-priority sensors. A computer readable recording medium having recorded thereon a program for executing the same is provided.

In addition, in the method for providing a standby mode for gesture recognition according to the present invention, the performing may include reflecting a first condition among values of the sensors when the gesture recognition apparatus satisfies a condition for entering the gesture recognition standby mode. A computer readout that records a program that adjusts the sampling rate to reflect the basic conditions so that the sampling rate matches the predefined low data range with respect to the adjusted sensor value, and reactivates the sensor's stopped motion. Provide possible recording media.

An apparatus for recognizing a motion according to an embodiment of the present invention refers to a parameter table of a predefined motion recognition standby mode, to specify a low data range of a plurality of sensors and to set priorities for each sensor or axis of each sensor. A sampling control module for adjusting a sampling rate for each sensor value set in a low data range table according to a first condition according to a priority between the sensors specified by the management module and the priority management module; When the sensor module is configured to check the values of the sensors to which the adjusted sampling rate is reflected and monitor the operation change based on the check result, and to satisfy the condition for entering the operation recognition standby mode, the sensor is adjusted to match the first condition. Change the sampling rate by applying the basic conditions, and change the sampling rate using the basic conditions. And a motion recognition module configured to reflect the sensor and perform the motion recognition standby mode.

In addition, in the motion recognition apparatus according to the present invention, a parameter table defining a motion recognition standby mode for each sensor, a table in which a row data range is defined for each sensor or axis of each sensor with reference to the parameter table, and a motion recognition standby mode It further comprises a storage module for storing a table defining the priority of each sensor or each axis for entering the sensor.

According to the present invention, when recognizing the motion of the gesture recognition apparatus using an acceleration sensor, a gyro sensor, a geomagnetic sensor, an illuminance sensor, a proximity sensor, etc., the sensor does not always turn on, and the sensor does not turn on. Increase the sampling rate of the device or check the state of the motion recognition device while the operation of a specific sensor is stopped, and then re-adjust the sampling rate of the sensors only when the initial condition for the user's motion recognition is satisfied. Battery consumption and terminal performance degradation can be prevented. In other words, the sensor is turned on by determining only low data values such as gravity acceleration, magnetic north, proximity, and illuminance of the motion recognition apparatus at predetermined time intervals. .

In addition, it may have a determinism capable of supporting motion recognition functions even in an idle state such as a home screen, a function of providing the most accessible screen, a background service, or a terminal screen.

In addition, the malfunction of the motion recognition may be reduced by adding the step of checking the state of the motion recognition device at low power before the operation recognition standby mode.

1 is a diagram illustrating a reference coordinate system and motion information for motion recognition according to an exemplary embodiment of the present invention.
2 and 3 are block diagrams showing the configuration of the gesture recognition apparatus according to the present invention.
4 is a flowchart illustrating a method for providing a standby mode for gesture recognition according to an exemplary embodiment of the present invention.
5 to 7 are diagrams showing an example of a table applied to the method for providing a standby mode for recognizing the motion of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, in the following description and the accompanying drawings, detailed descriptions of well-known functions or configurations that may obscure the subject matter of the present invention will be omitted. In addition, it should be noted that like elements are denoted by the same reference numerals as much as possible throughout the drawings.

The terms or words used in the specification and claims described below should not be construed as being limited to ordinary or dictionary meanings, and the inventors are appropriate as concepts of terms for explaining their own invention in the best way. It should be interpreted as meanings and concepts in accordance with the technical spirit of the present invention based on the principle that it can be defined. Therefore, the embodiments described in the present specification and the configuration shown in the drawings are only the most preferred embodiments of the present invention, and do not represent all of the technical ideas of the present invention, and various alternatives may be substituted at the time of the present application. It should be understood that there may be equivalents and variations.

In addition, terms including ordinal numbers, such as first and second, are used to describe various components, and are used only to distinguish one component from another component, and to limit the components. Not used. For example, without departing from the scope of the present invention, the second component may be referred to as the first component, and similarly, the first component may also be referred to as the second component.

In addition, when a component is referred to as being "connected" or "connected" to another component, it means that it may be connected or connected logically or physically. In other words, although a component may be directly connected or connected to other components, it should be understood that other components may exist in the middle, and may be connected or connected indirectly.

In addition, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In addition, the terms "comprises" or "having" described herein are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or the same. It is to be understood that the present invention does not exclude in advance the possibility of the presence or the addition of other features, numbers, steps, operations, components, parts, or a combination thereof.

In addition, the method for providing a standby mode for gesture recognition according to the present invention and a gesture recognition apparatus for the same may be applied to various fields such as user gesture recognition and robot control, but will be described below in the case of being applied to a user terminal (motion recognition device). Let's explain. In particular, the user terminal according to an embodiment of the present invention will be described as a representative example of the mobile communication terminal, but the user terminal is not limited to the mobile communication terminal, all information communication devices, multimedia terminals, wired terminals, fixed terminals and IP (Internet Protocol) ) It can be applied to various terminals such as a terminal. In addition, the terminal may be a mobile phone, a portable multimedia player (PMP), a mobile internet device (MID), a smart phone, a desktop, a tablet computer, a notebook, a net book. And a mobile terminal having various mobile communication specifications, such as an information communication device.

Motion recognition in the user terminal is used to control a specific function of the user terminal by detecting a predetermined specific movement (flip, shake in a specific direction, draw a specific pattern, user approach), the movement of the user terminal is Through the three-dimensional rectangular coordinate system as shown in FIG. 1, the azimuth, the pitch, and the roll may be represented.

That is, as illustrated in FIG. 1, when the horizontal direction of the user terminal (motion recognition device) 10 is referred to as the X axis, the vertical direction as the Y axis, and the width direction as the Z axis, the azimuth is the direction in which the user terminal is directed ( East, West, South, North) according to Z axis, 0 ~ 360 ° or -180 ° ~ 180 °, the pitch is the horizontal axis reference angle, -90 ° ~ 90 ° depending on the form of the user terminal The roll is a vertical axis reference rotation angle, and is represented by -180 ° to 180 ° depending on the shape of the user terminal.

Of course, in the recognition of the user's motion, the reference coordinate system and the expression method of the movement may be different, and the above definition is merely an example.

The present invention is to recognize the motion of the gesture recognition apparatus 10 by dividing it into detailed gestures, and in order to perform such a function, the gesture recognition apparatus 10 according to the present invention may be configured as shown in FIG. 2. have.

2 and 3 are block diagrams showing the gesture recognition apparatus 10 according to the present invention.

2 and 3, the gesture recognition apparatus 10 according to the present invention includes a sensor module 100, a sensor value collection module 200, a priority management module 300, a sampling control module 400, and a monitoring device. The module 500 may include a motion recognition module 600 and a storage module 700.

The sensor module 100 collects sensor values for detecting a change in position and motion through an acceleration sensor and a gyro sensor, and includes raw data of a x, y, and z axes, azimuth, roll, and the like. Provides information about the pitch.

In particular, the acceleration sensor can measure the value of the gravitational acceleration acting on the earth, thereby determining how the motion recognition device 10 is placed. For example, if the motion recognition apparatus 10 is lying on the ground, the z-axis is affected by gravity acceleration and outputs a value of about 1G (= 9.8 m / s ² ). By utilizing these characteristics, the absolute angles such as pitch (z-axis reference rotation angle) and roll (y-axis reference rotation angle) of the gesture recognition apparatus 10 may be determined.

Like the acceleration sensor, the gyro sensor measures the rotational angular velocity of the motion recognition apparatus 10 through three axes (x, y, z axes). Through the gyro sensor, it is possible to determine in which direction and at which speed the motion recognition device 10 rotates. In this case, the gyro sensor outputs a value that converges to 0 when the motion recognition device 10 does not move, and expresses the rotation degree as a value based on each axis when the motion recognition device 10 rotates. Through this, it may be determined whether the motion recognition apparatus 10 is actually rotated.

연산하여 현재 동작 인식 장치(10)가 위치하는 곳의 자기장 세기 및 자북 방향을 측정하는 나침반 기능을 제공한다.The geomagnetic sensor measures the strength of the magnetic field acting on the earth on the x, y and z axes, and measures the measured value.

It provides a compass function to calculate the magnetic field strength and magnetic north direction where the current motion recognition device 10 is located by calculating.

In addition, the sensor module 100 also utilizes an illumination sensor and a proximity sensor mounted in the gesture recognition apparatus 10 together. Here, the illumination sensor measures the amount of light (Lux) measured when looking at the screen of the gesture recognition apparatus 10, and the proximity sensor checks whether an object is close to the screen of the gesture recognition apparatus 10 or when the proximity sensor is close. Outputs the distance from the real object or zero.

In particular, the illuminance sensor detects a change in the value of a constant illuminance. In this case, when the screen of the gesture recognition apparatus 10 faces upward (sky direction), the illuminance is high, and when the gesture recognition apparatus moves, the illuminance difference is often clearly seen. Therefore, after measuring the average illuminance value, if a certain reference value change (delta) is detected according to the situation, the motion is determined.

As the proximity sensor 10 moves as the motion recognition device 10 moves, the proximity sensor also rotates together, thereby determining a nearby object to help detect a change in movement. In addition, the proximity sensor detects a change (delta) of the sensor value and determines a movement.

The sensor value collection module 200 is a component for collecting sensor values detected from the plurality of sensor modules 100. In this case, the sensor value collection module 200 may collect sensor values from one or more sensors of the plurality of sensor modules 100 at regular intervals, and the collected sensor values may have different units according to the sensors. For example, the sensor value of the illuminance sensor indicates the amount of illuminance (Lux), the sensor value of the proximity sensor indicates the distance and / or proximity to a nearby object, and the sensor value of the 3-axis acceleration sensor is 3 The sensor value of the 3-axis gyro sensor represents the angular velocity in the direction of the 3-axis (x, y, z), and the sensor value of the geomagnetic sensor is Indicates the direction.

The priority management module 300 designates a low data range of a plurality of sensors with reference to a parameter table of a predefined operation recognition standby mode. Here, the priority management module 300 is a low data of the acceleration sensor and the geomagnetic sensor of the sensor, and specifies the value calculated for each axis x, y, z through a rotation vector and a rotation matrix operation. Meanwhile, the priority management module 300 designates a parameter value as a low data range for the gyro sensor, the proximity sensor, and the illumination sensor among the sensors.

In addition, the priority management module 300 sets priority for each sensor or axis of each sensor to check the raw data as a condition for entering the operation recognition standby mode.

The sampling control module 400 adjusts a sampling rate according to priorities among the sensors. That is, the sampling control module 400 reduces the sensor value having the highest priority among the priorities among the sensors to a preset ratio, adjusts the sensor value of the next priority highest, and operates the sensors having no priority. Stop.

In detail, the sampling control module 400 adjusts the sampling rate for each sensor value set in the row data range table according to the priority between the specified sensors in response to the first condition. In this case, the sampling control module 400 reduces the sampling rate for the sensor value having the highest priority among the priorities among the sensors to a preset ratio according to the first condition. In addition, the sampling control module 400 adjusts the sampling rate for the sensor value of the next rank of the sensor value having the highest priority to the highest value that the sensor value can adjust according to the first condition. On the other hand, the sampling control module 400 stops the operation of the sensors that do not have a priority.

The monitoring module 500 monitors the operation change by reflecting the sampling rate adjusted through the sampling adjusting module 400. That is, the monitoring module 500 confirms each sensor value to which the sampling rate is adjusted by reflecting the first condition, and monitors the operation change based on the confirmation result.

When the motion recognition module 600 satisfies the condition for entering the motion recognition standby mode by reflecting the monitoring result of the monitoring module 500, the motion recognition module 600 readjusts the sampling rate and waits for the motion recognition by reflecting the re-adjusted sampling rate. Perform the mode. That is, when the motion recognition module 600 satisfies the condition for entering the motion recognition standby mode, the motion recognition module 600 changes the sampling rate adjusted to match the first condition by applying the basic condition, and changes the sampling rate to which the basic condition is applied. Performs the motion recognition standby mode by reflecting to the sensor.

In this case, the motion recognition module 600 needs to be interlocked with the sampling control module 400 to re-adjust the sampling rate. When the condition for entering the motion recognition standby mode is satisfied, the motion recognition module 600 has a higher priority among the sensors. In this case, the sampling rate is adjusted to match the adjusted sensor value to the predefined low data range, and the operation of the sensor is stopped.

The motion recognition module 600 may collect one or more sensor values collected and processed by the sensor value collection module 200, the priority management module 300, the sampling module 400, and the monitoring module 500 according to whether the user operates. Apply it to perform motion recognition.

The storage module 700 is a device for storing data. The storage module 700 includes a main memory device and an auxiliary memory device, and stores an application program required for a functional operation of the motion recognition device 10. The storage module 700 includes a parameter table 710 defining a motion recognition standby mode for each sensor, a table 720 defining a row data range for each sensor or axis of each sensor with reference to the parameter table, and a motion recognition wait. A table 730 defining the priority of each sensor or each axis for entering the mode is stored.

On the other hand, the gesture recognition apparatus 10 according to an embodiment of the present invention may include an input unit, a display unit and a communication unit as necessary. In particular, the input unit (not shown) receives various information such as numeric and character information, sets various functions, and receives a signal input in relation to the function control of the operation recognition apparatus 10 by the operation module 200 or the operation recognition module. Forward to 300. In addition, the display unit (not shown) displays information about a series of operation states and operation results generated while performing the function of the operation recognition apparatus 10. In addition, the display unit may display a menu of the gesture recognition apparatus 10 and user data input by the user. In addition, the communication unit (not shown) performs a function for transmitting and receiving data with other devices and servers through various communication networks.

In addition, the memory mounted in the gesture recognition apparatus 10 according to an embodiment of the present invention stores information in the device. In one embodiment, the memory is a computer readable medium. In one implementation, the memory may be a volatile memory unit, and for other implementations, the memory may be a nonvolatile memory unit. In one embodiment, the storage device is a computer readable medium. In various different implementations, the storage device may include, for example, a hard disk device, an optical disk device, or some other mass storage device.

Although the specification and drawings describe exemplary device configurations, the functional operations and subject matter implementations described herein may be embodied in other types of digital electronic circuitry, or modified from the structures and structural equivalents disclosed herein. It may be implemented in computer software, firmware or hardware, including, or a combination of one or more of them. Implementations of the subject matter described herein relate to one or more computer program products, ie computer program instructions encoded on a program storage medium of tangible type for controlling or by the operation of an apparatus according to the invention. It may be implemented as the above module. The computer readable medium may be a machine readable storage device, a machine readable storage substrate, a memory device, a composition of materials affecting a machine readable propagated signal, or a combination of one or more thereof.

A process of providing a standby mode for gesture recognition according to an embodiment of the present invention described above will be described in more detail with reference to FIGS. 4 to 7.

4 is a flowchart illustrating a method for providing a standby mode for gesture recognition according to an exemplary embodiment of the present invention, and FIGS. 5 to 7 are examples of a table applied to the method for providing a standby mode for gesture recognition according to an embodiment of the present invention. Figures shown.

4 and 7, the gesture recognition apparatus 10 that provides a standby mode for gesture recognition according to the present invention may refer to a parameter table of the gesture recognition standby mode previously defined in operation S11. Specifies the raw data range of the sensors. Here, the motion recognition apparatus 10 designates values calculated for each axis of x, y, and z through a rotation vector and a rotation matrix operation as the acceleration data among the sensors and the raw data of the geomagnetic sensor. Meanwhile, the gesture recognition apparatus 10 specifies a parameter value as a low data range for the gyro sensor, the proximity sensor, and the illuminance sensor among the sensors.

That is, the gesture recognition apparatus 10 defines a recognition waiting mode for a predetermined gesture. This is a process of recognizing which state the motion recognition device 10 enters into the motion recognition step with reference to the parameter table 710 managed in advance.

As shown in FIG. 5, the parameter table 710 defining the motion recognition standby mode is defined by a condition indicating each axis or sensor and a value of each sensor. For example, Pitch is A °, Roll is B °, Azimuth is C °, Velocity is less than D rad / sec, Proximity is less than E Cm, Light is managed by parameters such as F lux and more.

Meanwhile, as shown in FIG. 6, the row data range of the sensors is managed by the row data range table 720. That is, the gesture recognition apparatus 10 extracts the raw data of the sensor for actually creating the parameter value with reference to the parameter table 710 and stores the data as a separate table. For example, Pitch / Roll is collected for each of x, y, and z axes through an acceleration sensor, and a low data range is set for each axis. In addition, azimuth is collected for each of the x, y, and z axes through the ground sensor, and a low data range is set for each axis. On the other hand, the gyro sensor for detecting the velocity (Velocity), the proximity sensor for detecting the proximity (Proximity) and the illumination sensor for detecting the illumination (Light) does not perform a special extraction process, the data of the parameter table 710 Use it as it is.

In operation S13, the gesture recognition apparatus 10 sets priority for each sensor or axis of each sensor to check the raw data as a condition for entering the gesture recognition standby mode.

As shown in FIG. 7, the priority table 730 defines the priority for entering the motion recognition standby mode by checking the row data of each sensor. This is to determine which row data of a sensor should be considered first when checking a condition for entering the operation recognition standby mode of the gesture recognition apparatus 10. In the row data range table 720, the axis of each sensor is determined. You can set the star priority. On the other hand, the motion recognition apparatus 10 processes the non-priority sensors among the sensors to determine whether to enter the motion recognition standby mode, and thus NULL processing. For example, the x, y, and z axes of the acceleration sensor may be prioritized in order of 3, 2, 1 order, respectively, and the x, y, and z axes of the geomagnetic sensor are in order of 5, 4, 6 order, respectively. Priority may be specified. Meanwhile, the gyro sensor, the proximity sensor, and the illuminance sensor are not required to check whether the user enters the motion recognition standby mode, and thus are excluded from the priority object.

At this time, the motion recognition apparatus 10 clearly specifies the priority for each sensor. Since the priority of the acceleration sensor is higher than that of the geomagnetic sensor, the priority of each axis of the acceleration sensor is also equal to each axis of the geomagnetic sensor. Set higher than the star priority.

In operation S15, the gesture recognition apparatus 10 adjusts a sampling rate according to priorities among the sensors. That is, the gesture recognition apparatus 10 reduces the sensor value having the highest priority among the priorities among the sensors to a preset ratio, adjusts the sensor value of the next priority highest, and operates the sensors having no priority. Stop.

In detail, the gesture recognition apparatus 10 adjusts the sampling rate for each sensor value set in the row data range table in response to the first condition according to the priority among the designated sensors. At this time, the gesture recognition apparatus 10 reduces the sampling rate for the sensor value having the highest priority among the priorities among the sensors to a preset ratio according to the first condition. In addition, the gesture recognition apparatus 10 adjusts a sampling rate of a sensor value of a next rank of the sensor value having the highest priority to the highest value that the sensor value can adjust according to the first condition. On the other hand, the gesture recognition apparatus 10 stops the operation of the sensors having no priority.

For example, the gesture recognition apparatus 10 adjusts the sampling rate that the sensor can provide to half of the largest value with respect to a sensor (eg, an acceleration sensor) including a value of the first priority among all priorities. . Next, the gesture recognition apparatus 10 may select a sampling rate that the corresponding sensor may provide with respect to a sensor (eg, a geomagnetic sensor) including a priority other than the sensor including the first priority among the overall priorities. Adjust to the largest value. Finally, the motion recognition apparatus 10 stops the operation of the sensors before entering the motion recognition standby mode for the sensors (eg, gyro sensor, proximity sensor, illumination sensor) having a priority of NULL.

The gesture recognition apparatus 10 monitors the motion change by reflecting the sampling rate adjusted in step S17. That is, the gesture recognition apparatus 10 confirms each sensor value to which the sampling rate is adjusted by reflecting the first condition, and monitors the motion change based on the verification result. In operation S19, the gesture recognition apparatus 10 reflects the monitoring result and determines whether the condition for entering the gesture recognition waiting mode is satisfied.

When the condition for entering the operation recognition standby mode is satisfied, the operation recognition apparatus 10 re-adjusts the sampling rate and performs the operation recognition standby mode by reflecting the re-adjusted sampling rate (S21 to S23). In this case, the motion recognition apparatus 10 needs to be interlocked with the sampling control module 400 to re-adjust the sampling rate, and when the condition for entering the motion recognition standby mode is satisfied, the priority among the sensors is higher. In this case, the sampling rate is adjusted to match the adjusted sensor value to the predefined low data range, and the operation of the sensor is stopped.

That is, when the motion recognition apparatus 10 satisfies the condition for entering the motion recognition standby mode, the motion recognition apparatus 10 changes the sampling rate adjusted to match the first condition by applying the basic condition, and changes the sampling rate to which the basic condition is applied. Performs the motion recognition standby mode by reflecting to the sensor.

For example, the gesture recognition apparatus 10 may determine a value of a sensor (eg, an acceleration sensor) in which the value of the sampling rate is adjusted in half, and a sensor (eg, a geomagnetic sensor) in which the value of the sampling rate is adjusted in the maximum value. Readjust, and turn on the operation of the stopped sensors (eg, gyro sensor, proximity sensor, illuminance sensor).

If the condition for entering the operation recognition standby mode is not satisfied, the operation recognition apparatus 10 continues the monitoring process.

Through this, the present invention, when recognizing the motion of the motion recognition device using the acceleration sensor, gyro sensor, geomagnetic sensor, illumination sensor, proximity sensor, etc., does not always turn on the operation of the sensor, the sampling of the sensors in the idle state While checking the state of the motion recognition device while increasing the rate or stopping the operation of a specific sensor, it is unnecessary to adjust the sampling rate of the sensors only when the initial condition for the user's motion recognition is satisfied. Terminal battery consumption and terminal performance degradation can be prevented. In other words, the sensor is turned on by determining only low data values such as gravity acceleration, magnetic north, proximity, and illuminance of the motion recognition apparatus at predetermined time intervals. . In addition, it may have a determinism capable of supporting motion recognition functions even in an idle state such as a home screen, a function of providing the most accessible screen, a background service, or a terminal screen. In addition, the malfunction of the motion recognition may be reduced by adding the step of checking the state of the motion recognition device at low power before the operation recognition standby mode.

Computer-readable media suitable for storing computer program instructions and data include, for example, magnetic media such as hard disks, floppy disks, and magnetic tape, such as magnetic disks, compact disk read only memory (CD-ROM), and DVDs. Optical Media such as Digital Video Disk, Magnetic-Optical Media such as Floppy Disk, and Read Only Memory, RAM, Random Semiconductor memories such as access memory (EPM), flash memory, erasable programmable ROM (EPROM), and electrically erasable programmable ROM (EEPROM). The processor and memory can be supplemented by or integrated with special purpose logic circuitry. Examples of program instructions may include high-level language code that can be executed by a computer using an interpreter as well as machine code such as produced by a compiler. Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

Although the specification includes numerous specific implementation details, these should not be construed as limiting to any invention or the scope of the claims, but rather as a description of features that may be specific to a particular embodiment of a particular invention. It must be understood. Certain features that are described in this specification in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable subcombination. Furthermore, while the features may operate in a particular combination and may be initially depicted as so claimed, one or more features from the claimed combination may in some cases be excluded from the combination, the claimed combination being a subcombination Or a combination of subcombinations.

Likewise, although the operations are depicted in the drawings in a specific order, it should not be understood that such operations must be performed in the specific order or sequential order shown in order to obtain desirable results or that all illustrated operations must be performed. In certain cases, multitasking and parallel processing may be advantageous. Moreover, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products. It should be understood that it can.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples for clarity and are not intended to limit the scope of the present invention. It is apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

The present invention determines whether to enter the motion recognition standby mode according to the raw data range set for each of the plurality of sensors and the priority of each sensor before the motion recognition mode is activated. Accordingly, the present invention does not always turn on the operation of the sensor when recognizing the motion of the gesture recognition apparatus using an acceleration sensor, a gyro sensor, a geomagnetic sensor, an illuminance sensor, a proximity sensor, and the like. While checking the state of the motion recognition device while increasing the rate or stopping the operation of a specific sensor, the terminal battery consumption is normally consumed by re-adjusting the sampling rate of the sensors only when the initial condition for the user's motion recognition is satisfied. And terminal performance degradation. In other words, the sensor is turned on by determining only low data values such as gravity acceleration, magnetic north, proximity, and illuminance of the motion recognition device at predetermined time intervals. . In addition, it may have a determinism capable of supporting motion recognition functions even in an idle state such as a home screen, a function of providing the most accessible screen, a background service, or a terminal screen. In addition, the malfunction of the motion recognition may be reduced by adding the step of checking the state of the motion recognition device at low power before the operation recognition standby mode. This has industrial applicability because it is not only sufficient marketable or business possibility, but also practically evident.

10: motion recognition device 100: sensor module
200: sensor value acquisition module 300: priority management module
400: sampling control module 500: monitoring module
600: motion recognition module 700: storage module
710: parameter table 720: low data range table
730: priority table

Claims (8)

Specifying, by the gesture recognition apparatus, a raw data range of the plurality of sensors with reference to a parameter table of a predefined gesture recognition standby mode;
Setting, by the gesture recognition apparatus, priorities between the sensors;
Adjusting, by the gesture recognition apparatus, a sampling rate for each sensor value set in a row data range table according to the set priority according to a first condition;
Checking, by the motion recognition apparatus, each sensor value to which the sampling rate is adjusted by reflecting the first condition, and monitoring the motion change based on the result of the confirmation; And
When the gesture recognition apparatus satisfies a condition for entering the gesture recognition waiting mode, the sampling rate adjusted to match the first condition is changed by applying a basic condition, and the sampling rate at which the basic condition is applied is changed by each sensor. A computer-readable recording medium having recorded thereon a program for performing the step of performing the operation recognition standby mode in reflection of the data. The method of claim 1, wherein the designating step
The computer readable recording program that executes the motion recognition apparatus designating the values calculated for each of the x, y, and z axes through the rotation vector and the rotation matrix operation as the acceleration data among the sensors and the geomagnetic sensors. Record carrier. The method of claim 1, wherein the designating step
And a program for executing the motion recognition device to specify a value of the parameter in a low data range for a gyro sensor, a proximity sensor, and an illuminance sensor among the sensors. The method of claim 1, wherein the setting step
And a program configured to set a priority for each sensor or axis of each sensor to check the row data as a condition for the motion recognition apparatus to enter the motion recognition standby mode. The method of claim 1, wherein the adjusting step
The motion recognition apparatus reduces the sampling rate for the sensor value having the highest priority among the priorities among the sensors to a preset ratio according to the first condition, and the sensor value of the next priority of the sensor value having the highest priority. And a program that adjusts a sampling rate for the sensor to the highest value that the sensor value can adjust according to the first condition, and stops the operation of non-priority sensors. The method of claim 1, wherein the performing of the step
When the gesture recognition apparatus satisfies a condition for entering the gesture recognition waiting mode, the controller recognizes a row data range defined for a sensor value whose sampling rate is adjusted to reflect the first condition among the values of the respective sensors. And a program for adjusting the sampling rate to reflect the basic condition, and for reactivating the operation of the sensor where the operation of the sensor is stopped. A priority management module for specifying a row data range of a plurality of sensors and setting priorities for each axis of the sensor or each sensor by referring to a parameter table of a predefined motion recognition standby mode;
A sampling control module configured to adjust a sampling rate for each sensor value set in a row data range table according to a first condition according to a priority between the sensors designated through the priority management module;
A monitoring module for checking each sensor value to which the sampling rate adjusted by reflecting the first condition is applied and monitoring a change in operation based on the result of the checking; And
When the condition for entering the operation recognition standby mode is satisfied, the sampling rate adjusted to match the first condition is changed by applying a basic condition, and the sampling rate applying the basic condition is reflected on each sensor. An operation recognition module performing a recognition standby mode;
Motion recognition apparatus comprising a. The method of claim 7, wherein
A parameter table defining a motion recognition standby mode for each sensor, a table defining a low data range for each sensor or each axis of each sensor with reference to the parameter table, and each sensor or each sensor for entering the motion recognition standby mode A storage module for storing a table defining priority for each axis;
Motion recognition apparatus further comprising a.

Images