KR101036452B1 - Contactless keypad and its implementation method - Google Patents

Abstract

The present invention relates to a non-contact keypad device using a stereo camera, a physical keypad for visually showing the keypad shape, a stereo camera installed in the vicinity of the physical keypad to take a picture of the upper part of the physical keypad to generate a stereo image, the A storage unit for storing information about a physical keypad, information about a virtual keypad, conversion information for converting a virtual keypad area photographed by a stereo camera into an actual virtual keypad area, and detecting a touch area of a touch unit from the stereo image. And an image processor which determines a key of a virtual keypad corresponding to the position of the touch means.
According to the present invention as described above, the user can use without any physical contact with the input device, such as a terminal to prevent the disease (germs) transmission problems caused by indirect contact in places where a large number of mobile customers, such as hospitals, banks, marts, restaurants, etc. It can be solved, has a long service life, and improves security than a contact interface.

Description

Contactless keypad and its implementation {Contactless Keypad And Realization Method Thereof}

The present invention relates to a contactless keypad, and more particularly, when a user's finger touches an invisible virtual keypad surface formed on a physical keypad device, the user inputs the key value of the touched key as if the user touched the actual physical keypad. The present invention relates to a technology for preventing personal information exposure such as disease transmission or fingerprints caused by contact.

With the rapid development of electronic and information communication technology, there are no fields where electronic devices such as computers are not utilized, and the touch means (devices) of the electronic devices also vary.

Input devices, such as touch screens, keyboards, keypads, mice, push buttons, light pens, digital tablets, and trackballs, which are widely used at present, are a touch type in which a user inputs data through direct physical contact with the input device.

Keypad related to the present invention is used in various fields, such as digital door lock (ATM), automatic teller machine (ATM), credit authorization terminal (Credit Authorization Terminal), a button type and a touch screen using a physical button ( Touch screen) is used and all are touch type.

However, such a touch keypad 1) As a user enters data through physical contact with the keypad serves as a medium for transmitting diseases (germs) caused by indirect contact in places where many mobile customers such as hospitals, banks, marts, restaurants, etc. , 2) there is a risk of exposing information such as a password due to wear due to frequent mechanical contact, and 3) there is a problem of exposing personal information such as fingerprints of a user to the input device.

In relation to the contactless keypad, Korean Patent No. 10-0894544 projects an optical plane including a keypad pattern in the air, and when a finger is positioned at a specific position of the projected optical plane, the position of the finger using the IR light source unit and the IR receiver unit It is possible to use a small and semi-permanent use without a mechanical key input device by detecting the key input is made, and a technology that can be applied to a door lock (digital home appliance) keypad, etc. is disclosed, Figure 1 A schematic diagram is disclosed.

Referring to FIG. 1, the space touch screen device according to the registered patent includes a pattern projection unit 10, an IR light source unit 20, an IR sensing unit 30, a signal processing unit 40, and an optical plane 50. .

The pattern projection unit 10 generates a character or an image and displays it in the air, and the optical plane 50 is an image projected in the air through the pattern projection unit 10 to receive input from a user. It may be a keypad, a still image, or the like.

The IR light source unit 20 irradiates an IR optical signal to detect a touch signal provided from a user in the optical plane 50, and independently modulates IR light for each channel to correspond to each input button displayed on the optical plane 50. The signal is generated and provided to the optical plane 50, thereby maintaining the optical plane 50 in an input ready state.

The IR detector 30 amplifies and demodulates and demodulates the reflected IR optical signal generated by touching a hollow keypad and an image provided on the optical plane 50 to the signal processor 40, and the signal processor 40 transmits the IR signal. The IR optical signal transmitted from the sensing unit 30 is calculated and processed to find an input button touched by the user, and the output signal for the input signal is transmitted to the pattern projection unit 10.

The registered patent can be used semi-permanently because it does not require a mechanical key input device by providing a non-contact keypad, and can be applied to a door lock or a keypad of a digital home appliance, but a projection device for generating an optical plane 50 is required. In addition, since the number of IR light source units 20 and IR detectors 30 corresponding to each input button displayed on the optical plane 50 is required, the manufacturing cost is high and it is difficult to miniaturize.

The present invention has been made to solve the problems of the conventional contact keypad as described above, by using a virtual keypad configured using a stereo camera to enable data input to the keypad in a non-contact, such as disease transmission or fingerprint caused by contact The goal is to provide a way to prevent personal information disclosure.

According to an aspect of the present invention for achieving the above object, a physical keypad for visually showing the keypad shape, a stereo camera installed near the physical keypad to take a picture of the upper part of the physical keypad to generate a stereo image A storage unit storing information on the physical keypad, information on the virtual keypad area, conversion information between the virtual keypad area photographed by the stereo camera and the virtual keypad area, and the touch area of the touch unit from the stereo image. And an image processor configured to determine a key of the virtual keypad area corresponding to the touch area of the touch means.

Here, when the touched key on the virtual keypad area is determined by the image processor, an output unit for generating sound or light may be further included to give a key touch feeling.

In addition, it is more preferable that a dam having a height corresponding to the height of the virtual keypad is installed at one side of the physical keypad.

The virtual keypad area and the conversion information may be determined by detecting the marker from a stereo image photographed by a stereo camera while touching a plurality of points on the physical keypad using a calibration tool having a marker. And calculating the relative position or the relative angle of the stereo camera with respect to the virtual keypad area or the physical keypad using the detected marker information, and information of the marker when touching a plurality of points of the physical keypad with a calibration tool. And marker information extracted from the image information obtained from the stereo camera, to generate and store the conversion information.

According to another aspect of the present invention for achieving the above object, the step of defining a virtual keypad area located in a predetermined area on the physical keypad, the touch means based on the captured image of the stereo camera the virtual keypad area Detecting a touch area of the touch means when located within, converting to a touch location on the virtual keypad area based on the detected touch area of the touch means, and finding a key on the virtual keypad area closest to the touch location, When the distance between the touch position and the corresponding key is less than or equal to the reference value, it is determined that the corresponding key is selected and a key selection signal is generated.

Here, it is preferable to further include generating a sound or light to give a key touch feeling when the touched key on the virtual keypad is determined.

In addition, the step of defining a virtual keypad area located in a certain area above the physical keypad, the step of storing information about the physical keypad and each key on the physical keypad, a plurality of the physical keypad using a calibration tool formed with a marker Determining the information on the virtual keypad area by detecting the marker from the stereo image photographed by the stereo camera while touching two points, and using the information of the detected marker, the stereo camera on the virtual keypad area. Calculating a relative position or relative angle of the sensor; converting the marker information using marker information obtained by touching a plurality of points of the physical keypad using a calibration tool and marker information obtained from image information obtained from the stereo camera; Generating and creating More preferably, it includes storing the converted conversion information.

In addition, the position of each key of the virtual keypad may be calculated based on the correlation between the physical keypad and the virtual keypad area and information on the keys of the physical keypad.

The present invention can be used for a digital door lock keypad, an ATM (automatic teller machine) keypad, a credit authorization terminal, and the like.

1) The user can use it without any physical contact with the input device such as a terminal, and thus can solve the problem of infectious disease (infection) caused by indirect contact in places where many mobile customers such as hospitals, banks, marts and restaurants are used.

2) Longer service life than touch because there is no physical contact or dynamic part such as a button or stylus pen.

3) Since user information such as fingerprint is not left in the input device, security is enhanced than the contact interface.

1 is a block diagram of a space touch screen device according to Korean Patent No. 10-0894544.
2 is a block diagram of a contactless keypad device using a stereo camera according to the present invention.
3 is a two-dimensional block diagram of a contactless keypad device using a stereo camera according to the present invention.
4 is a flowchart illustrating a process of performing virtual keypad setting in a contactless keypad device using a stereo camera according to the present invention.
5 is a flowchart illustrating a process of performing a method of detecting a non-contact key input using a non-contact keypad device using a stereo camera according to the present invention.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

2 is a block diagram of a contactless keypad device using a stereo camera according to the present invention, Figure 3 is a two-dimensional block diagram of a contactless keypad device using a stereo camera according to the present invention.

2 and 3, the contactless keypad device using the stereo camera according to the present invention includes a physical keypad 100, a stereo camera 200, an interface unit 300, an image processing unit 400, and a storage unit 500. , An output unit 600 and a control unit 700 are configured.

The physical keypad 100 is for visually showing the keypad shape, and may be a physical key input device such as a physical button or an LCD screen. If the visual keypad is provided to the user, the physical keypad 100 may be printed in various forms such as paper with a keypad pattern printed thereon. Means are available.

The stereo camera 200 is installed on the upper portion of the physical keypad 100 to photograph an image of the upper portion of the physical keypad 100. The two cameras are combined to generate a stereo image.

The interface unit 300 is for connection with a server (not shown) connected with the keypad device.

The image processor 400 detects the position of the touch means such as the user's finger from the stereo image captured by the stereo camera 200, and the position of the touch means on the virtual keypad area 800 which describes the position of the detected touch means. It determines the key 810 corresponding to the.

The storage unit 500 may store the size of the physical keypad 100 and information on the keys 110, the virtual keypad 800 located in a predetermined area above the physical keypad 100, and the keys in the virtual keypad area 800. The location information of 810 and information for converting the virtual keypad area photographed by the stereo camera 200 into the actual virtual keypad area 800 are stored.

Here, the virtual keypad area 800 is a virtually defined area corresponding to the physical keypad 100 on the upper predetermined height h of the physical keypad 100 for detecting a contactless key input of the touch means. It is invisible.

The output unit 600 generates sound or light to give a key touch when the touched key 810 on the virtual keypad area 800 is determined by the image processor 500. When it is determined that a specific key 810 on the image is touched, a sound or light is generated to change the color or brightness of the key 110 on the corresponding physical keypad 100 or give a feeling of touch.

The control unit 700 is a part in charge of the overall control of the contactless keypad device using a stereo camera according to the present invention.

And, it is preferable that the dam 900 is installed at one side of the physical keypad 100 for stability of the background when the stereo image is acquired.

4 is a flowchart illustrating a process of performing virtual keypad setting in a contactless keypad device using a stereo camera according to the present invention.

Referring to FIG. 4, as shown, first, information of the physical keypad 100 is obtained and stored (S400). The physical keypad information may include the size of the physical keypad 100, location information of keys, and the like.

When the information of the physical keypad 100 is obtained, a marker is detected from a stereo image captured by the stereo camera 200 while touching a plurality of points of the physical keypad 100 using a calibration tool having a marker. Information about the keypad area 800 is determined and stored (S410).

Next, the spatial correlation of the stereo camera 200 with respect to the physical keypad 100 or the weather keypad area 800 is calculated and stored using the detected marker information (S420). Here, the spatial correlation may be a relative position or relative angle of the stereo camera 200 with respect to the virtual keypad area 800 or the physical keypad 100.

Finally, the conversion information is generated by using the marker information obtained by touching a plurality of points of the physical keypad 100 using the calibration tool and the marker information obtained from the image information acquired from the stereo camera 200. And store (S430). Here, the transform information is a matrix for transforming between the actual coordinate information and the coordinates when viewed by the stereo camera 200, and it is well known to those skilled in the art to generate a transform matrix and its inverse transform matrix, and thus detailed description thereof will be omitted. do.

5 is a flowchart illustrating a process of performing a method of detecting a non-contact key input using a non-contact keypad device using a stereo camera according to the present invention.

If a virtual keypad area 800 located in a predetermined area on the upper part of the physical keypad 100 is defined through the process of FIG. 4, a process of detecting a non-contact key input as shown in FIG. 5 is performed.

The image of the upper portion of the physical keypad 100 is continuously photographed by the stereo camera 200 to determine whether the touch means is detected.

If the touch means is detected, when the touch means is located in the virtual keypad area 800 based on the captured image of the stereo camera 200, the touch area of the touch means is detected (S500).

When the touch area of the touch means is detected (S500), the touch position on the virtual keypad area 800 is determined based on the detected area (S510).

Based on the detected position on the virtual keypad area of the touch means, the key 810 on the nearest virtual keypad area 800 is found (S520), and the distance between the touch position and the corresponding key 810 is compared and the distance is a reference value. If it is less than or equal to recognize the selected key (S530), by selecting the corresponding key to transmit a key signal to the server, in response to this process to change the color or brightness of the key 110 on the physical keypad 100 or touch Generates sound or light to give a feeling of (S540).

Although the present invention has been described in connection with the above-mentioned preferred embodiments, it is possible to make various modifications or variations without departing from the spirit and scope of the invention. Accordingly, the appended claims will cover such modifications and variations as fall within the spirit of the invention.

100: physical keypad 110: key
200: stereo camera 300: interface unit
400: image processing unit 500: storage unit
600: output unit 700: storage unit
800: virtual keypad area 810: keys
900: dam

Claims (8)

A physical keypad for visually showing the keypad shape;
A stereo camera installed near the physical keypad to generate a stereo image by capturing an area above the physical keypad;
A storage unit for storing information about the physical keypad, information about a virtual keypad area located in a predetermined area above the physical keypad, and conversion information for converting a virtual keypad area photographed by a stereo camera into an actual keypad area; And
And a video processing unit for detecting a touch area of the touch means from the stereo image and determining a key corresponding to the touch area of the touch means on the virtual keypad area.
The method of claim 1,
The contactless keypad device using a stereo camera, characterized in that further comprising an output unit for generating a sound or light to give a key touch when the touched key on the virtual keypad area is determined by the image processor.
The method of claim 1,
One side of the physical keypad is a contactless keypad device using a stereo camera, characterized in that the dam having a height corresponding to the height of the virtual keypad is installed.
The method of claim 1,
The virtual keypad area and the conversion information
A virtual keypad region is determined by detecting the marker from a stereo image captured by a stereo camera while touching a plurality of points on the physical keypad using a calibration tool having a marker formed thereon, and using the information of the detected marker. Calculate the relative position or angle of the stereo camera relative to the virtual keypad area or the physical keypad, and from the information of the marker and the image information obtained from the stereo camera when a plurality of points of the physical keypad are touched with a calibration tool. Non-contact keypad device using a stereo camera, characterized in that calculated by generating and storing the conversion information using the extracted marker information.
Defining a virtual keypad area located at a predetermined area above the physical keypad;
Detecting a touch area of the touch means when the touch means is located within the virtual keypad area based on the captured image of the stereo camera;
Determining a touch position on the virtual keypad area based on the detected touch area of the touch means; And
And finding a key on the virtual keypad area closest to the touch position, and determining that the key is selected when the distance between the touch position and the corresponding key is equal to or less than a reference value and generating a key selection signal. How to implement a contactless keypad.
The method of claim 5, wherein
And generating sound or light to give a key touch when the touched key on the virtual keypad is determined.
The method of claim 5, wherein
Defining a virtual keypad area located in a predetermined area above the physical keypad
Storing information for the physical keypad and for each key on the physical keypad;
Determining information on a virtual keypad area by detecting the marker from a stereo image captured by a stereo camera while touching a plurality of points of the physical keypad using a calibration tool having a marker formed thereon;
Calculating a relative position or relative angle of the stereo camera with respect to the virtual keypad area using the information of the detected marker;
Generating conversion information using marker information obtained from the touch information of the plurality of points of the physical keypad and the marker information obtained from the image information obtained from the stereo camera using a calibration tool; And
A method of implementing a contactless keypad using a stereo camera, comprising the step of storing the generated conversion information.
The method of claim 7, wherein
And a position of each key of the virtual keypad is determined based on the correlation between the physical keypad and the virtual keypad and information on the keys of the physical keypad.

Images