JP4827803B2 - User authentication method, user authentication apparatus, and image forming apparatus - Google Patents

Description

  In order to prevent the user ID and password from leaking when performing user authentication, in the method of performing user authentication by photographing a gesture pattern with an image input camera and determining its shape by an image processing unit, the same continuous value is used. The present invention relates to a technique for reducing the number of input strokes of a gesture pattern when inputting.

  As a conventional technique, when performing personal authentication, a hand is inserted into the authentication box and a series of operations such as goo, choki, and par are performed, and the image is taken by the camera device and registered in advance by the image processing unit and the determination unit. There has been a method of performing user authentication by seeking the relevance with the action of the authenticator's hand (see Patent Document 1).

  However, in this method, when the same value is input continuously, the continuous value cannot be counted unless a “separated” hand pattern is inserted between the continuous hand patterns. As a result, the number of input strokes of the hand is increased by a factor of approximately 2, and both the input pattern and the analysis thereof become complicated, which takes time.

JP 2002-150296 A

  The problem to be solved is that in the user authentication method using a gesture pattern, the number of input steps increases when consecutive values are input.

The user authentication method of the present invention includes an image input camera that captures a gesture pattern of a hand formed by the intention of the person to be authenticated, and a gesture pattern registered in advance by processing an image captured by the image input camera. An image processing determination unit that determines identity, and an authentication unit that performs user authentication using a plurality of hand gesture pattern patterns as a series based on the determination of the image processing determination unit. The determination unit includes, as the registered gesture pattern, a continuous pattern indicating that the hand gesture pattern is a sequence of the same gesture pattern, and the image processing determination unit includes one of the hand gesture patterns and the continuous pattern. Each time a pattern is judged, a pair of gesture patterns of the same hand is taken as continuous data. By the authentication unit, characterized in that made it possible to perform the user authentication a plurality of patterns as a set comprising a continuous gesture pattern of the same hand.

The user authentication device according to the present invention includes an image input camera that captures a gesture pattern of a hand formed by the intention of the person to be authenticated, an image captured by the image input camera, and a pre-registered gesture pattern . an image processing determination section for determining identity, a user authentication device having an authentication unit for performing user authentication, a plurality patterns as a set of gesture pattern hand based on the determination of the image processing determination section, the image The processing determination unit has a continuous pattern indicating that the hand gesture pattern is a sequence of the same gesture pattern as the registered gesture pattern, and the image processing determination unit includes one of the hand gesture patterns and Each time a continuous pattern is judged, a pair of gesture patterns of the same hand is used as continuous data. And force, by the authentication unit, characterized in that made it possible to perform the user authentication a plurality of patterns as a set comprising a continuous gesture pattern of the same hand.

  The image forming apparatus according to the present invention is characterized in that the user authentication device is provided.

The user authentication method of the present invention includes an image input camera that captures a gesture pattern of a hand formed by the intention of the person to be authenticated, and a gesture pattern registered in advance by processing an image captured by the image input camera. An image processing determination unit that determines identity, and an authentication unit that performs user authentication using a plurality of hand gesture pattern patterns as a series based on the determination of the image processing determination unit. The determination unit includes, as the registered gesture pattern, a continuous pattern indicating that the hand gesture pattern is a sequence of the same gesture pattern, and the image processing determination unit includes one of the hand gesture patterns and the continuous pattern. Each time a pattern is judged, a pair of gesture patterns of the same hand is taken as continuous data. Outputting, by the authentication unit, to characterized in that it possible to perform the user authentication a plurality of patterns as a set comprising a continuous gesture pattern of the same hand, the input stroke at the time of inputting the continuous values The number can be greatly reduced, and the user authentication method can be simplified and speeded up.

The user authentication device according to the present invention includes an image input camera that captures a gesture pattern of a hand formed by the intention of the person to be authenticated, an image captured by the image input camera, and a pre-registered gesture pattern . an image processing determination section for determining identity, a user authentication device having an authentication unit for performing user authentication, a plurality patterns as a set of gesture pattern hand based on the determination of the image processing determination section, the image The processing determination unit has a continuous pattern indicating that the hand gesture pattern is a sequence of the same gesture pattern as the registered gesture pattern, and the image processing determination unit includes one of the hand gesture patterns and Each time a continuous pattern is judged, a pair of gesture patterns of the same hand is used as continuous data. Force and, by the authentication unit, to characterized in that it possible to a plurality of patterns comprising a continuous gesture pattern of the same hand as a series perform the user authentication, the input stroke at the time of inputting the continuous values The number can be greatly reduced, and the user authentication method can be simplified and speeded up.

  Since the image forming apparatus according to the present invention has the user authentication device as the main feature, it is possible to greatly reduce the number of input steps when inputting continuous values, thereby simplifying user authentication. And speeding up.

  As an embodiment of the present invention, an example of an image forming apparatus including a user authentication device will be shown, and the user authentication method will also be described.

  In this example, using the hand as a part of the body of the person to be authenticated, changing the bending state of each finger according to the intention of the person to be authenticated, changing the rotation angle of the wrist, creating different shapes, A method for defining a corresponding number and performing user authentication by image input will be described.

[Constitution]
FIG. 1 is a front view of an image forming apparatus according to an embodiment of the present invention.

  The image forming apparatus 101 includes an input panel 111, an internal discharge port 113, an internal discharge tray 117, a lighting device 121, and an image input camera 123.

  FIG. 1 shows that the discharged paper 115 discharged from the internal discharge port 113 is placed on the internal discharge tray 117.

  The input panel 111 is used to operate the image forming apparatus 101, and also displays whether or not authentication has been performed during user authentication according to the present embodiment.

  The image input camera 123 is provided on the ceiling surface of the gap above the internal discharge tray 117 formed at the center of the main body of the image forming apparatus 101. The user (authenticated person) puts his hand 201 (FIG. 1) under the image input camera 123 on the discharge tray 117 to input a user ID / password, and photographs a gesture pattern corresponding to the user ID / password. . The image input camera 123 also has a role of a sensor that detects that the hand 201 is inserted.

  The gap on the internal discharge tray 117 is covered on the upper surface, the lower surface, and the side surface. Since a person stands on the front surface side, the possibility of gesture input by hand or voyeurism is very low. In the image forming apparatus 101 of the embodiment shown in FIG. 1, only one side surface with the internal discharge port 113 of the gap on the internal discharge tray 117 is covered and the opposite side surface is open. Walls may be provided on both sides in order to increase the height.

  Along with the image input camera 123, a lighting device 121 is mounted on the ceiling surface of the gap on the discharge tray 117. The image input camera 123 lights up to illuminate the hand 201 when shooting a hand gesture pattern. When the paper (discharged paper 115) discharged to the internal discharge tray is taken out, the light is turned on to illuminate the discharged paper 115.

  FIG. 2 shows a functional block diagram of the image forming apparatus.

  The image forming apparatus 101 includes functional blocks of an image processing determination unit 131, an authentication unit 133, a control unit 151, and a storage device 153, in addition to the input panel 111, the illumination device 121, and the image input camera 123 described in FIG.

  The image processing determination unit 131 processes an image photographed by the image input camera 123, and a gesture pattern (FIG. 3) registered in advance with the shape of the hand inserted in front of the image input camera based on the gesture pattern of the hand. ) And the shape is converted to a corresponding numerical value.

  The authentication unit 133 receives a user ID and a password based on a series of numerical inputs converted based on the hand gesture pattern determined by the image processing determination unit 131, and determines whether the user is a registered user. Make a decision and perform user authentication.

  The control unit 151 includes a CPU and a peripheral control circuit, and controls the entire apparatus, and also controls the lighting device 121 and the input reception and display control of the input panel 111.

  The storage device 153 includes a semiconductor memory and a magnetic disk, stores necessary data and programs in cooperation with the control unit 151, and holds data of a hand input pattern shape (described later in FIG. 3).

[Gesture pattern by hand]
FIG. 3 is a table showing hand gesture patterns used in this embodiment. In the present embodiment, the user ID and password are numerically input, and the hand gesture pattern corresponding to the numerical values is shown. An input code other than a numerical value is also shown.

  For example, the number “0” is indicated by a shape in which the palm side faces the upper surface and holds the hand. In addition, the number “1” is indicated by a shape in which the palm side faces the upper surface and the index finger is raised.

  In addition to the numerical shape, “start / end” indicating the start and end of the input (the shape with the palm side facing the bottom, thumb, forefinger, little finger) and “continuous” (the palm side facing the bottom, pointing the index finger, little finger) There is an input code.

  The “start / end” pattern is a gesture pattern used at the start and end of user authentication.

  “Continuous” pattern is “continuous” instead of the next “0” after the first “0” when the same numerical value is input continuously, for example, “0 · 0”. "Is a code for inputting a pattern and recognizing that there are multiple" 0 "s.

  Next, the use of a continuous pattern according to the present method will reduce the number of hand pattern inputs by using an example.

  In order to input a finger pattern, the user ID / password input reading starts when the “start / end code” is displayed first, and the printing press reads the hand pattern input from 0-9. In this embodiment, a hand pattern is used that represents a number with one hand (FIG. 3). When you have finished entering the final code, enter the “start / end code” again to confirm the numerical value. If a mistake is made, a “start / end pattern” is indicated, and the pattern is input again from the beginning.

  When the same number is continuous, the “continuous” pattern is input after the pattern to be continuous.

  In the following, an example in which the input “0001” is compared between the case where the “continuous” pattern is used and the input using the conventional method will be described. In the conventional method shown in the upper part of Table 1, when the same numerical value is input continuously, the input value is regarded as only one digit if the shape of the hand remains the same. As shown in Table 1, it was necessary to express the number of six strokes.

  However, when the “continuous” pattern is input, it is possible to reduce the number of strokes to 4 by assuming that the same value as the previous input value is input again. If “0000” continues four times, “0, continuous, 0, continuous” may be performed. In this way, it can be expressed only by the same number of input character strings.

[flowchart]
The operation flow will be described with reference to the flowchart of FIG.

  S11: It is determined whether or not the user's hand is in front of the image input camera. If the hand is in front of the camera, the operation proceeds to S15. If the hand is not in front of the camera, the operation proceeds to S13.

  S13: Since there is no hand in front of the image input camera, if the illumination is on, the light is turned off. Again, the operation shifts to the determination condition of S11.

  S15: Turns on if the lighting device is not turned on.

  S17: It is determined whether or not the user's hand can be recognized as the “start / end” pattern. When the “start / end” pattern is recognized, the operation proceeds to S19. If not recognized, the operation proceeds to the first S11.

  S19: It is determined whether or not the user's hand is in front of the camera. If there is no hand, the operation proceeds to S21. If there is a hand, the operation proceeds to S23.

  S21: Since the hand is out of the image range, the numerical value input is canceled and the operation is terminated.

  S23: It is determined whether or not the user's hand pattern can be recognized as a registered pattern (FIG. 3). If it can be recognized, the operation proceeds to S25. If it cannot be recognized, the operation proceeds to S19.

  S25: It is determined whether the image is the same as the previous pattern. Since the continuous pattern is inserted when the same input continues, it is determined that there is no new input if it is the same as the previous pattern. If it is the same as the previous pattern, the operation proceeds to S19. If they are not the same, it is determined that a new input has been entered, and the operation proceeds to S27.

  S27: It is determined whether the input pattern is the continuous pattern described in FIG. If it is a continuous pattern, the operation proceeds to S29. Otherwise, the operation proceeds to S31.

  S29: Since the continuous pattern is recognized, the same value as the previous numerical value is put in the buffer and the digit is advanced by one. Thereafter, the operation proceeds to S19.

  S31: It is determined whether the input pattern is a numerical pattern. If it is a numerical pattern, the operation proceeds to S33. Otherwise, the operation proceeds to S35.

  S33: Since the numerical pattern is recognized, the numerical value is put in the buffer and the digit is advanced by one. Thereafter, the operation proceeds to S19.

  S35: It is determined whether the input pattern is a start / end (FIG. 3) pattern. If it is a star and end pattern, the operation proceeds to S37. Otherwise, the operation proceeds to S19.

  S37: The contents of the buffer are determined as input numerical values.

  S39: The authentication unit collates the input numerical value determined in S37 with the registered user information and determines whether the user ID and the password match. If they match, the operation proceeds to S41. If they do not match, the operation is returned to S11 and input from the beginning is started.

  S41: Since the user ID and password are verified, an authentication process is performed to complete the operation.

  Thus, a series of operations is completed.

[Effect of Example]
In the image forming apparatus according to the embodiment of the present invention, when a continuous value is input by a hand gesture pattern, the number of input processes when the numerical value is continuous can be greatly reduced by introducing a “continuous” pattern. It has become possible.

  The image forming apparatus of the embodiment of the present invention includes an image input camera and a lighting device in a gap on the internal discharge tray, and performs a predetermined gesture pattern with a hand inserted into the gap, and shoots, User authentication can be performed based on the image. Image processing judgment unit is a method for judging based on movement to compare with a pre-registered hand shape based on different shapes by opening and closing fingers of the hand and making the palm side upside or masked Compared to, image processing can be determined relatively easily.

  When a user inserts a hand into the gap and makes a gesture, the gap is surrounded by the casing of the device, and the front side is closed by the body of the user inserting the hand, so the gesture pattern of the hand is There is no danger of being seen, and the confidentiality of user authentication information (user ID and password) is improved. Further, since the space on the internal discharge tray is provided in a normal image forming apparatus, it is not necessary to install a dedicated box for inserting a hand.

  Since the gesture pattern of the hand is illuminated by the lighting device, the sharpness of the captured image is increased and the accuracy of recognition is increased. In addition, it is possible to check whether the paper is being discharged to illuminate the paper discharged from the lighting device to the internal discharge tray, and to check whether it is the output paper that you output. It became easy.

  Whether or not the hand is inserted into the gap in the internal discharge tray is determined based on the detection of the hand shape by the image input camera, simplifying the device and reducing costs without requiring a special sensor for detection. Led to

  Since the authentication method according to the present invention is performed in a non-contact manner unlike input from a keyboard, there is no wear such as fatigue damage of mechanical parts such as a keyboard.

[Others]
In this embodiment, the determination is made based on the static image of the hand shape input as an image, but the body part of the person to be authenticated who inputs the image may be a part other than the hand. For example, the right hand 1 for the left hand, 2 for the left hand, 3 for the right elbow, and the like.

  Further, instead of static image input, it may be dynamic image input such as a movement from a state in which a hand is held to an open state, or a combination of dynamic and static image input. Good.

  In the present embodiment, the shape of the hand is associated with a numerical value, but many other shapes may be defined and associated with characters (for example, alphabets).

  In this embodiment, a method is used in which the previous value is repeated when a continuous pattern is input. However, a method of repeating the next pattern of the continuous pattern may be used.

1 is a front view of an image forming apparatus according to an embodiment of the present invention (Embodiment 1). 1 is a functional block diagram of an image forming apparatus according to an embodiment of the present invention (Embodiment 1). FIG. It is a graph which shows the gesture pattern of a hand (Example 1). 1 is a flowchart of an image forming apparatus according to an embodiment of the present invention (Embodiment 1).

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Image forming apparatus 111 Input panel 113 Internal discharge port 115 Discharged paper 117 Internal discharge tray 121 Illuminating device 123 Image input camera
131 Image processing judgment unit 133 Authentication unit 151 Control unit 201 User's hand (authenticated person's hand)

Claims (5)

An image input camera that captures a hand gesture pattern formed by the intention of the person to be authenticated;
An image processing determination unit that processes an image captured by the image input camera and determines the identity with a pre-registered gesture pattern;
An authentication unit for performing user authentication based on a determination of a plurality of hand gesture patterns based on the determination of the image processing determination unit;
The user authentication method performed by
The image processing determination unit has, as the registered gesture pattern, a continuous pattern indicating that the hand gesture pattern is a continuation of the same gesture pattern,
Each time the image processing determination unit determines one of the hand gesture patterns and a continuous pattern, it outputs a pair of the same hand gesture patterns as continuous data,
By the authentication unit, it is possible to perform the user authentication as a series of a plurality of patterns including a series of gesture patterns of the same hand.
The user authentication method characterized by the above-mentioned. The user authentication method according to claim 1, comprising:
The image processing determination unit uses a pair of the same hand gesture patterns as continuous data each time the continuous pattern is determined before or after the determination of one of the hand gesture patterns.
The user authentication method characterized by the above-mentioned. An image input camera that captures a hand gesture pattern formed by the intention of the person to be authenticated;
An image processing determination unit that processes an image captured by the image input camera and determines the identity with a pre-registered gesture pattern;
An authentication unit for performing user authentication based on a determination of a plurality of hand gesture patterns based on the determination of the image processing determination unit;
A user authentication device having
The image processing determination unit has, as the gesture pattern, a continuous pattern indicating that the gesture pattern of the hand is a continuation of the same gesture pattern,
Each time the image processing determination unit determines one of the hand gesture patterns and a continuous pattern, it outputs a pair of the same hand gesture patterns as continuous data,
By the authentication unit, it is possible to perform the user authentication as a series of a plurality of patterns including a series of gesture patterns of the same hand.
A user authentication device. The user authentication device according to claim 3,
The image processing determination unit uses a pair of the same hand gesture patterns as continuous data each time the continuous pattern is determined before or after the determination of one of the hand gesture patterns.
A user authentication device.   5. The user authentication device according to claim 3 or 4 is provided.
  An image forming apparatus.

Images