JP2024115004A - User terminal, program and payment system - Google Patents

Abstract

To provide a user terminal, a program, and a settlement system which implement a settlement based on biometric information of a user while suppressing introduction cost.SOLUTION: A user terminal 1 includes: a settlement information acquisition unit 22 which acquires, from a store terminal 8, settlement information including the amount to be settled and terminal information related to the store terminal 8; a ticket type acquisition unit 24 which acquires, from a ticket type information storage unit 34, ticket type information to be used for the acquired settlement information; a face image acquisition unit 25 which acquires, through a camera 36, an acquisition image which is face image data of a user; and an approval information transmission unit 26 which transmits approval information including the acquired settlement information, ticket type information, and acquisition image, to a settlement server 4 which performs settlement processing after face authentication.SELECTED DRAWING: Figure 2

Description

The present invention relates to a user terminal, a program, and a payment system.

Conventionally, when a product or the like is purchased at a store or the like, a payment process is performed using a POS (Point Of Sales) register or a payment terminal. A user who is a purchaser purchases a product or the like, for example, by cash, by electronic money, or by card payment such as a credit card. When making a payment by electronic money, the user needs to display a two-dimensional code of the electronic money to be used on a mobile terminal carried by the user. Also, when making a card payment such as a credit card, the user needs to present the card to be used.
Meanwhile, in recent years, biometric authentication technology such as face recognition has improved, and for example, a payment technology using face recognition has been disclosed (for example, Patent Literature 1).

Patent No. 7036300

In the system described in Patent Document 1, an authentication terminal installed in a store acquires biometric information (facial image) of a user, and performs payment if authentication is successful.
However, if a store were to implement a system similar to that described in Patent Document 1, it would require the purchase and installation of a payment terminal compatible with biometric information and face recognition equipment, which would require a capital investment on the part of the store, making it a high-threshold system.

The present invention aims to provide a user terminal, program, and payment system that makes it possible to realize payments using a user's biometric information while keeping implementation costs down.

The present invention solves the above problems by the following solving means.
A first invention is a user terminal comprising: a card type information storage unit which stores card type information used in payment processing; a payment information acquisition means which acquires payment information including a payment amount and terminal information related to the store terminal from the store terminal; a card type acquisition means which acquires from the card type information storage unit the card type information to be used for the payment information acquired by the payment information acquisition means; a facial image acquisition means which acquires an acquired image, which is facial image data of a user, via a photographing unit; and an approval information sending means which transmits approval information including the payment information acquired by the payment information acquisition means, the card type information acquired by the card type acquisition means, and the acquired image acquired by the facial image acquisition means to a payment device in which a comparison facial image, which is facial image data of the user, is stored in advance and which performs the payment processing after matching using the comparison facial image.
A second invention is a user terminal of the first invention, which is equipped with an approval result receiving means for receiving an approval result from the payment device, and an approval result output means for outputting the approval result received by the approval result receiving means to the store terminal in a manner that the store terminal can acquire it.
A third invention is a user terminal of the first or second invention, comprising a match image acquisition means for acquiring the match facial image via the photographing unit, an authentication information receiving means for accepting input of authentication information capable of authenticating the user at the payment device, a match image sending means for transmitting the match facial image acquired by the match image acquisition means and the authentication information accepted by the authentication information receiving means to the payment device, and an image deletion means for deleting the match facial image sent by the match image sending means from a memory unit.
A fourth invention is a user terminal of the third invention, which is equipped with a type of certificate receiving means for receiving the type of certificate information from the payment device, and a type of certificate registration means for registering the type of certificate information received by the type of certificate receiving means in the type of certificate information storage unit.
A fifth invention is a user terminal which, in any of the first to fourth inventions, is provided with a type of certificate output means which outputs the type of certificate information stored in the type of certificate information storage unit to a display unit, and the type of certificate acquisition means acquires the type of certificate information selected by the user from the type of certificate information output to the type of certificate output means.
A sixth invention is a user terminal according to any one of the first to fifth inventions, wherein the payment information acquisition means acquires the payment information from the store terminal after establishing communication with the store terminal.
A seventh invention is a user terminal in which, in any of the first to fifth inventions, the payment information acquisition means acquires the payment information from the store terminal by a reading unit reading a code of the payment information output to a display unit of the store terminal.
An eighth aspect of the present invention is a program for causing a computer to function as any one of the user terminals according to the first to seventh aspects of the present invention.
A ninth invention is a payment system comprising a store terminal, a user terminal, and a payment device which performs payment processing, wherein the store terminal comprises a payment information output means which outputs payment information including a payment amount and terminal information relating to the store terminal to the user terminal in a manner which the user terminal can acquire, and the user terminal comprises a card type information storage unit which stores card type information used in the payment processing, a payment information acquisition means which acquires the payment information from the store terminal, a card type acquisition means which acquires from the card type information storage unit the card type information to be used for the payment information acquired by the payment information acquisition means, a face image acquisition means which acquires an acquired image which is face image data of a user via a photographing unit, the payment information acquired by the payment information acquisition means, the card type information acquired by the card type acquisition means, and and an approval information sending means for sending approval information to the payment device, the approval information including the acquired image acquired by the facial image acquisition means, wherein the payment device comprises a match image memory unit storing a match facial image which is facial image data of the user, a facial image matching means for matching the acquired image included in the approval information received from the user terminal with the match facial image in the match image memory unit, and an approval result sending means for sending to the user terminal an approval result based on the card type information, the match result being the matching result by the facial image matching means, and the user terminal comprises an approval result receiving means for receiving the approval result from the payment device, and an approval result output means for outputting the approval result received by the approval result receiving means to the store terminal in a manner retrievable by the store terminal.
A tenth invention is a payment system according to the ninth invention, wherein the user terminal comprises: a match image acquisition means for acquiring the match face image via the photographing unit; an authentication information reception means for receiving an input of authentication information capable of authenticating the user in the payment device; a match image transmission means for transmitting the match face image acquired by the match image acquisition means and the authentication information received by the authentication information reception means to the payment device; and an image deletion means for deleting the match face image transmitted by the match image transmission means from a storage unit, and the payment device generates a user bill type recorder storing the bill type information for each user based on the authentication information received from the user terminal. a type of payment system comprising an authentication means for authenticating the user by referring to a user type of payment storage unit, a type of payment extraction means for extracting the type of payment information of the user stored in the user type of payment storage unit if authentication is successful by the authentication means, a registration means for registering the comparison face image received from the user terminal to the comparison image storage unit if authentication is successful by the authentication means, and a type of payment sending means for sending the type of payment information extracted by the type of payment extraction means to the user terminal, wherein the user terminal comprises a type of payment receiving means for receiving the type of payment information from the payment device, and a type of payment registration means for registering the type of payment information received by the type of payment receiving means in the type of payment information storage unit.

The present invention provides a user terminal, program, and payment system that enables payment using a user's biometric information while keeping implementation costs down.

1 is a diagram showing the overall configuration of a payment system according to an embodiment of the present invention. FIG. 2 is a diagram showing functional blocks of a user terminal according to the present embodiment. FIG. 2 is a diagram showing functional blocks of a payment server according to the present embodiment. 13 is a flowchart showing a match image registration process in the payment system according to the embodiment. 11A to 11C are diagrams illustrating an example of a screen transition in a user terminal according to the embodiment. 10 is a flowchart showing a payment process in the payment system according to the embodiment. 11A to 11C are diagrams illustrating an example of a screen transition in a user terminal according to the embodiment.

Below, a description will be given of an embodiment of the present invention with reference to the drawings. Note that this is merely an example, and the technical scope of the present invention is not limited to this example.

(Embodiment)
<Payment system 100>
FIG. 1 is a diagram showing the overall configuration of a payment system 100 according to this embodiment.
The payment system 100 is a system that realizes payment at a store by photographing the user's face using a user terminal 1 carried by the user instead of a store terminal 8 at the time of payment and performing face authentication using the photographed face image. Furthermore, in the payment system 100, the user can make payment by designating a payment method of his/her choice from the user terminal 1 carried by himself/herself.
The payment system 100 includes a user terminal 1, a payment server 4 (payment device), and a store terminal 8. The user terminal 1 and the payment server 4, and the payment server 4 and the store terminal 8 are communicatively connected via a communication network N. In addition, the user terminal 1 and the store terminal 8 communicate with each other using, for example, short-range wireless communication.

<User Terminal 1>
The user terminal 1 is a terminal used by a user who wishes to use a payment service using facial recognition when registering his/her own facial image. The user terminal 1 takes a photograph of the user's own facial image to be used for identity authentication at the time of payment in advance and sends it to the payment server 4. When making a payment using facial recognition at a store, the user terminal 1 obtains payment information from the store terminal 8, takes a photograph of the user's own face, and sends approval information together with the payment information to the payment server 4. Then, upon receiving an approval result from the payment server 4, the user terminal 1 outputs the approval result to the store terminal 8. In this way, the user terminal 1 performs part of the process related to approval at the time of payment between the store terminal 8 and the payment server 4.
The user terminal 1 is, for example, a mobile phone having a computer function, such as a smartphone. The user terminal 1 may also be a tablet, a personal computer (PC), or the like. The user terminal 1 is a portable terminal.

Next, the functional configuration of the user terminal 1 will be described.
FIG. 2 is a diagram showing functional blocks of the user terminal 1 according to this embodiment.
As shown in FIG. 2, the user terminal 1 includes a control unit 10 , a storage unit 30 , a camera 36 (photographing unit, reading unit), a touch panel display 37 (display unit), and a communication interface unit 39 .
The control unit 10 is a CPU (Central Processing Unit) that controls the entire user terminal 1. The control unit 10 appropriately reads and executes an operating system (OS) and various application programs stored in the storage unit 30, thereby cooperating with the above-mentioned hardware to realize various functions.
The control unit 10 includes a registration processing unit 11 and a payment processing unit 21 .

The registration processing unit 11 performs a process of acquiring a face image for verification, which is face image data of the user, before making a payment, and transmitting the acquired face image to the payment server 4 .
The registration processing unit 11 includes a note type designation unit 12, a match image acquisition unit 13 (match image acquisition means), an authentication information receiving unit 14 (authentication information receiving means), a match image transmission processing unit 15 (match image transmission means, image deletion means), and a note type registration processing unit 16 (note type receiving means, note type registration means).
The bill type designation unit 12 designates the bill type that the user wishes to register. For example, the bill type designation unit 12 may designate the bill type by outputting information on a plurality of bill types that can be registered in the payment system 100 to the touch panel display 37 and having the user select a bill type from the output information on the plurality of bill types.

The match image acquisition unit 13 acquires a match face image, which is facial image data of the user, by the user photographing his/her own face with the camera 36. The match face image is a facial image of the user that is used as a reference for matching when matching at the time of payment.
The authentication information receiving unit 14 receives input of authentication information capable of authenticating a user for the bill type specified by the bill type specifying unit 12. The authentication information receiving unit 14 receives input of, for example, a user name, a card number, an expiration date, etc. as authentication information. Note that the authentication information is not limited to this. For example, if the user already has a login ID (IDentification) for an application program (hereinafter, an application program is referred to as an application, an app, a program, etc.) provided by the payment server 4, the login ID, etc. may be used instead of the card number, etc. In other words, the authentication information may be any information that allows the payment server 4 to authenticate the user.

The match image transmission processing unit 15 transmits the match face image acquired by the match image acquisition unit 13 and the authentication information accepted by the authentication information acceptance unit 14 to the payment server 4. In addition, the match image transmission processing unit 15 deletes the match face image transmitted to the payment server 4 from the temporary storage area of the storage unit 30.
The card type registration processing unit 16 stores the card type information received from the payment server 4 in the card type information storage unit 34. Here, card type information is information related to the card type used in payment. Card type information includes information necessary for payment, such as card type name, card number (PAN), expiration date, etc. Note that card type names include, for example, credit card brands such as VISA (registered trademark) and MASTERCARD (registered trademark), QR code (registered trademark) payment brands such as XX Pay, and various card brands such as point cards, prepaid cards, and debit cards.

The payment processing unit 21 performs a part of the payment process at the time of payment.
The payment processing unit 21 includes a payment information acquisition unit 22 (payment information acquisition means), a bill type output unit 23 (billing type output means), a bill type acquisition unit 24 (billing type acquisition means), a facial image acquisition unit 25 (facial image acquisition means), an approval information transmission unit 26 (approval information transmission means), and an approval result receiving processing unit 27 (approval result receiving means, approval result output means).

The payment information acquisition unit 22 acquires payment information including the payment amount (payment sum) and terminal information related to the store terminal 8 from the store terminal 8. In the case where the store terminal 8 has, for example, a short-range communication function that enables communication with the user terminal 1, the payment information acquisition unit 22 acquires the payment information by receiving it from the store terminal 8 after establishing communication with the store terminal 8.
Here, the payment information is a message including the payment amount and terminal information of the store terminal 8. Furthermore, the terminal information is information that can uniquely identify the store in which the store terminal 8 is installed.

The denomination output unit 23 outputs the denomination information stored in the denomination information storage unit 34 to the touch panel display 37. The denomination output unit 23 outputs, for example, the denomination name as the denomination information.
The denomination acquisition unit 24 acquires the denomination information selected by the user from the denomination information outputted to the touch panel display 37 by the denomination output unit 23 .
The face image acquisition unit 25 acquires an acquired image, which is face image data of the user, via the camera 36 .

The approval information transmitting unit 26 transmits approval information including the payment information acquired by the payment information acquiring unit 22, the denomination information acquired by the denomination acquiring unit 24, and the acquired image acquired by the face image acquiring unit 25 to the payment server 4 corresponding to the acquired denomination information. The approval information is an authorization message.
The approval result reception processing unit 27 receives the approval result from the payment server 4. Then, the approval result reception processing unit 27 outputs the received approval result to the store terminal 8 in a form that can be acquired by the store terminal 8. For example, when the payment information acquisition unit 22 receives payment information using a communication function, the approval result reception processing unit 27 transmits the approval result to the store terminal 8 using the same communication function.

The storage unit 30 is a storage area such as a semiconductor memory element for storing programs, data, etc. required for the control unit 10 to execute various processes.
The memory unit 30 includes a program memory unit 31 and a denomination information memory unit 34 .
The program storage unit 31 is a storage area for storing various applications. The program storage unit 31 stores a registered payment application 32 and individual applications 33a, 33b, . . .

The registered payment application 32 and the individual applications 33a, 33b, . . . are downloaded to the user terminal 1, for example, by communicating with an application distribution server (not shown) via the communication network N.
The registration payment application 32 is a program for performing various functions executed by the control unit 10 of the user terminal 1. Note that the registration payment application 32 does not need to be a single application, and may be, for example, separate applications for the registration function and the payment function.

The individual applications 33a, 33b, ... are applications corresponding to the respective businesses that perform payment. The individual applications 33a and 33b are different businesses that perform payment. In the following, when the individual applications 33a, 33b, ... are not specified, they will be simply described as the individual applications 33.
The individual application 33 is called and executed by the registered payment application 32 based on, for example, the type of card designated by the user.
The denomination information storage unit 34 is a storage area that stores the denomination information received from the payment server 4 by the processing of the registration processing unit 11. The denomination information storage unit 34 is a storage area that can securely store the denomination information. "Securely storeable" means, for example, that the denomination information is stored in a dedicated chip called a secure element that is separated from the OS, or in a data storage location (area) where sufficient consideration is given to preventing leakage of the stored information.

The camera 36 is a photographing device that is provided on the side of the touch panel display 37 of the user terminal 1 and allows the user to take a selfie of his or her own face.
The touch panel display 37 functions as a display unit constituted by a liquid crystal panel or the like, and also functions as an input unit for inputting various operations using a user's finger.
The communication interface unit 39 is an interface for communicating with the payment server 4 via the communication network N. The communication interface unit 39 is also an interface for performing short-range wireless communication with the store terminal 8. The communication interface unit 39 serves as a transmitter and a receiver.

<Payment Server 4>
The payment server 4 is owned by each business operator, such as a credit card company that performs payment, a company that performs various payments, etc. In the case of payment by credit card, the payment server 4 is specifically a server that performs processing related to a payment network center, an acquirer, and an issuer.
Here, the payment network center refers to, for example, a payment agency that mediates credit card payments, mobile carrier payments, electronic money payments, code payments, etc. Also, the acquirer refers to the credit card affiliated store contract company, that is, the company that has a contract with the store, and the issuer refers to the credit card issuing company, that is, the company that has a contract with the user who has been issued the card.

In FIG. 1, the payment server 4 is shown as one server, but in reality, as described above, it is made up of multiple devices such as a payment network center, an acquirer, and an issuer.
The payment server 4 performs face authentication using the acquired image included in the approval information, and if authentication is successful, it confirms the ticket type information of the user and then approves the user. In addition, when the payment server 4 receives a sales message from the store terminal 8, it performs a payment process for the payment amount included in the sales message.

Next, the functional configuration of the payment server 4 will be described.
FIG. 3 is a diagram showing functional blocks of the payment server 4 according to this embodiment.
As shown in FIG. 3 , the payment server 4 includes a control unit 40 , a storage unit 60 , and a communication interface unit 69 .

The control unit 40 is a CPU that controls the entire payment server 4. The control unit 40 appropriately reads and executes the OS and various application programs stored in the storage unit 60, thereby cooperating with the above-mentioned hardware and executing various functions.
The control unit 40 includes a pre-processing unit 41 , a matching processing unit 51 , and a payment processing unit 55 .
The pre-processing unit 41 performs processing related to the registration of the comparison image received from the user terminal 1 .
The pre-processing unit 41 includes an authentication unit 42 (authentication means), a denomination extraction unit 43 (denomination extraction means), a match image registration unit 44 (registration means), and a denomination transmission unit 45 (denomination transmission means).

The authentication unit 42 authenticates the user by referring to the user type storage unit 62 based on the authentication information received from the user terminal 1. The authentication unit 42 performs a process for identifying the user.
If the authentication unit 42 has authenticated the user, the card type extraction unit 43 extracts the card type information of the user from the user card type storage unit 62 .
The match image registration unit 44 registers the match face image received from the user terminal 1 in the match image storage unit 63 .
The denomination transmitting unit 45 transmits the denomination information extracted by the denomination extracting unit 43 to the user terminal 1 .

The verification processing unit 51 performs processing related to approval of the approval information received from the user terminal 1 .
The matching processing unit 51 includes an approval information receiving unit 52, a face image matching unit 53 (face image matching means), and an approval result transmitting unit 54 (approval result transmitting means).
The approval information receiving unit 52 receives approval information from the user terminal 1 .
The facial image matching unit 53 matches the acquired image included in the approval information received by the approval information receiving unit 52 with the matching facial image in the matching image storage unit 63. In this case, the facial image matching unit 53 identifies the matching facial image based on the bill type information included in the approval information. The facial image matching unit 53 calculates, for example, the degree of match between the acquired image and the matching facial image as a score. Then, the facial image matching unit 53 determines that the acquired image and the matching facial image have been matched when, for example, the score is equal to or greater than a threshold value.

The approval result sending unit 54 sends an approval result based on the card type information, including the matching result by the facial image matching unit 53, to the user terminal 1. If matching is possible by the facial image matching unit 53 and the card type information is valid, the approval result sending unit 54 sends an approval result indicating approval.
The payment processing unit 55 performs processing related to payment. Specifically, the payment processing unit 55 performs sales processing of the payment amount received from the store terminal 8.

The storage unit 60 is a storage area such as a hard disk, a semiconductor memory device, etc. for storing programs, data, etc. required for the control unit 40 to execute various processes.
The memory unit 60 includes a program memory unit 61 , a user denomination memory unit 62 , and a match image memory unit 63 .
The program storage unit 61 is a storage area for storing various programs. The program storage unit 61 stores, for example, programs for performing various functions executed by the control unit 40 of the payment server 4, which will be described later.

The user denomination storage unit 62 is a storage area that stores denomination information for each user, etc. In addition to denomination information, the user denomination storage unit 62 stores, for example, account information of the user, and performs processes such as debiting the payment amount from the account of the account information during payment processing.
The match image storage unit 63 is a storage area for storing a face image for match. The match image storage unit 63 stores the face image for match in association with the user of the user type storage unit 62.
The communication interface unit 69 is an interface for communicating between the user terminal 1 and the store terminal 8 via the communication network N.

<Store terminal 8>
1 is, for example, a POS register or a payment terminal provided in each store. The store terminal 8 may be, for example, a general register equipped with a short-range communication function.
Although not shown, the store terminal 8 includes a control unit, a storage unit, a display unit, an input unit, a communication interface unit, and the like.

The communication network N is a network between various servers and various terminals, such as the Internet line or a mobile terminal communication network.
Here, a computer refers to an information processing device equipped with a control unit, a memory device, etc., and the user terminal 1, the payment server 4 and the store terminal 8 are each an information processing device equipped with a control unit, a memory device, etc., and are included in the concept of a computer.

Next, the processing of the payment system 100 will be described.
First, a process of registering matching information that is performed by a user in order to use face authentication at the time of payment will be described.
FIG. 4 is a flowchart showing the match image registration process in the payment system 100 according to this embodiment.
FIG. 5 is a diagram showing an example of a screen transition in the user terminal 1 according to this embodiment.

First, a user who wishes to use a service provided by the payment system 100 downloads to the user terminal 1 a registered payment app 32 that corresponds to the card type information to be used in payment. The user then performs an operation to launch the registered payment app 32 downloaded to the user terminal 1, and in step S (hereinafter, "step S" will be simply referred to as "S") 11 of FIG. 4, the control unit 10 of the user terminal 1 launches the registered payment app 32.

When the registration payment application 32 is started, for example, a service menu screen 70 shown in FIG. 5(a) is output to the touch panel display 37 of the user terminal 1. The screen 70 includes a button 70a for pre-registration and a button 70b for making a payment. When the user selects the button 70a on the screen 70, the control unit 10 of the user terminal 1 next outputs a screen 71 shown in FIG. 5(b), and then outputs a screen 72 shown in FIG. 5(c). The screen 71 in FIG. 5(b) is for selecting the type of payment, and the screen 72 in FIG. 5(c) is for selecting the bill type after selecting the type of payment. The screens 71 and 72 output the types of services that can be provided by the payment system 100. The user performs an operation to select the bill type to be registered according to the guidance on the screen. In this way, in S12 of FIG. 4, the control unit 10 (bill type designation unit 12) accepts the bill type designation.

When the control unit 10 accepts the designation of the bill type, it outputs a screen 73 shown in Fig. 5(d) to the touch panel display 37. The screen 73 is an input screen related to authentication information. The authentication information is information for authenticating the user, such as the user's own name and bill type information. The user inputs information according to the contents of the screen 73 and selects a button 73a to proceed to the next step.
In this way, in S13 of FIG. 4, the control unit 10 (authentication information receiving unit 14) receives the authentication information.

When the control unit 10 accepts the authentication information, it then outputs screen 74 shown in FIG. 5(e) to the touch panel display 37. The user then adjusts the position of the camera 36 of the user terminal 1 so that his or her face fits within the frame. Then, for example, when the user terminal 1 detects that the face fits within the frame, the user terminal 1 then outputs screen 75 shown in FIG. 5(f) to the touch panel display 37. Then, when the user blinks, in S14 of FIG. 4, the control unit 10 (match image acquisition unit 13) acquires an image of the user's face that is captured by activating the camera 36 after detecting the blink. When the acquired image is obtained, the control unit 10 outputs screen 76 shown in FIG. 5(g) to the touch panel display 37.

In S15, the control unit 10 (match image transmission processing unit 15) transmits the acquired face image of the user as a face image for matching together with the authentication information accepted in the process of S13 to the payment server 4, and requests registration.
In S16, the control unit 10 (match image transmission processing unit 15) deletes the matching face image temporarily stored in the storage unit 30. By doing so, the matching face image used in the registration process, which is temporarily stored in the storage unit 30 at the time of matching, is prevented from being used illegally.

On the other hand, when the control unit 40 (pre-processing unit 41) of the payment server 4 receives the face image for matching and the authentication information from the user terminal 1, in S21, the control unit 40 (authentication unit 42) of the payment server 4 performs authentication processing. Specifically, based on the authentication information received from the user terminal 1, the control unit 40 refers to the user type storage unit 62 and confirms the presence of a user who matches the authentication information.
In S22, the control unit 40 (authentication unit 42) judges whether or not authentication has been successful. If authentication has been successful (S22: YES), the control unit 40 shifts the process to S23. On the other hand, if authentication has not been successful, the control unit 40 shifts the process to S25.

In S23, the control unit 40 (card type extraction unit 43) extracts the card type information of the authenticated user from the user card type storage unit 62.
In S24, the control unit 40 (match image registration unit 44) registers the received match face image in the match image storage unit 63. At that time, the control unit 40 associates the record of the user in the user card type storage unit 62 extracted in S23 with the match face image.
In S25, the control unit 40 transmits the processing result to the user terminal 1. If the denomination information is extracted in the processing of S23, the control unit 40 (denomination transmission unit 45) transmits the processing result including the extracted denomination information.

In S26, the control unit 10 of the user terminal 1 receives the processing result. Then, if the processing result includes bill type information, the control unit 10 (bill type registration processing unit 16) registers the bill type information in the bill type information storage unit 34. The user terminal 1 outputs screen 77 shown in FIG. 5(h) to the touch panel display 37. Note that if authentication is not possible, the payment server 4 sends a message indicating that authentication was not possible as a processing result, and the control unit 10 outputs an error screen (not shown). Thereafter, the control unit 10 ends this process.

This process allows the user to register a facial image for verification used for authentication at the time of payment in the payment server 4 that corresponds to the bill type information used by the user for payment. In addition, the user terminal 1 can register the bill type information used for payment in the bill type information storage unit 34.

Next, the process at the time of payment will be described.
FIG. 6 is a flowchart showing the payment process in the payment system according to this embodiment.
FIG. 7 is a diagram showing an example of a screen transition in the user terminal 1 according to this embodiment.
When a user purchases a product or the like at a store where the service of the payment system 100 is available, the control unit of the store terminal 8 accepts the payment amount in S31 of Fig. 6. The payment amount can be obtained, for example, by reading a barcode attached to the product or the like.

In S32, the control unit of the store terminal 8 performs processing to transmit radio waves for establishing short-distance communication.
On the other hand, when the user performs an operation to launch the registered payment application 32 downloaded to the user terminal 1, the control unit 10 of the user terminal 1 launches the registered payment application 32 in S41.

When the registered payment application 32 is started, the touch panel display 37 of the user terminal 1 outputs the above-mentioned service menu screen 70 shown in FIG. 7(a), for example. When the user selects the button 70b on the screen 70, the control unit 10 of the user terminal 1 then outputs a screen 91 shown in FIG. 7(b). The screen 91 is a specification regarding a connection method with the store terminal 8. For example, by specifying short-distance wireless communication, the control unit 10 performs a process of receiving radio waves for establishing short-distance communication in S42 of FIG. 6. Here, examples of short-distance wireless communication include, but are not limited to, those using NFC (Near Field Communication) and Bluetooth (registered trademark). The control unit 10 outputs, for example, a screen 92 shown in FIG. 7(c) to the touch panel display 37 until short-distance communication is established.
Note that, when the button 70b is selected on the screen 70, if the control unit 10 performs control so as to be able to receive a plurality of short-range wireless communications, the screen 91 can be omitted.

When communication is established between the store terminal 8 and the user terminal 1, in S33, the control unit of the store terminal 8 sends payment information.
When the control unit 10 (payment information acquisition unit 22) of the user terminal 1 receives the payment information, in S43 of Fig. 6, the control unit 10 (note type output unit 23) outputs, for example, a note type information screen 93 shown in Fig. 7(d) on the touch panel display 37. The screen 93 outputs note type information stored in the note type information storage unit 34, for example, the note type name.
When the user selects the denomination of the note to be used for payment on screen 93, the control unit 10 (note denomination acquisition unit 24) accepts the selection of the note denomination in S44 of Fig. 6. Note that if only one note denomination information is registered in the note denomination information storage unit 34, the control unit 10 may output a note denomination confirmation screen such as "This note denomination will be used" instead of screen 93.

When the control unit 10 accepts the selection of the bill type, it outputs a screen 94 shown in FIG. 7(e) to the touch panel display 37. The user then adjusts the position of the camera 36 of the user terminal 1 so that their face fits within the frame. Then, for example, when the user terminal 1 detects that the face fits within the frame, the user terminal 1 next outputs a screen 95 shown in FIG. 7(f) to the touch panel display 37. Then, when the user blinks, in S45 of FIG. 6, the control unit 10 (face image acquisition unit 25) activates the camera 36 after detecting the blink and obtains an acquired image, which is an image of the user's face. When the acquired image is obtained, the control unit 10 outputs a screen 96 shown in FIG. 7(g) to the touch panel display 37.

In S46 of FIG. 6, the control unit 10 (approval information transmitting unit 26) transmits the approval information to the payment server 4.
When the control unit 40 (approval information receiving unit 52) of the payment server 4 receives the approval information sent by the user terminal 1, in S47, the control unit 40 (face image matching unit 53) performs a face image matching process to match the acquired image included in the received approval information with the matching face image in the matching image memory unit 63.

In S<b>48 , the control unit 40 (approval result transmission unit 54 ) transmits the approval result to the user terminal 1 .
In S49, when the control unit 10 (approval result receiving processing unit 27) of the user terminal 1 receives the approval result from the payment server 4, it sends out the received approval result. At that time, the control unit 10 outputs a screen 97 shown in FIG. 7(h) to the touch panel display 37.
When the control unit of the store terminal 8 receives the approval result, it sends a completion notification in S50 of Fig. 6. When the control unit 10 of the user terminal 1 receives the completion notification, it disconnects communication with the store terminal 8 and outputs a screen (not shown) indicating that the processing has been completed to the touch panel display 37. Thereafter, the control unit 10 ends this processing.

If the control unit of the store terminal 8 receives the approval result and the approval result indicates that approval has been granted, it sends a payment request to the payment server 4. When the control unit 40 (payment processing unit 55) of the payment server 4 receives the payment request (sales message) from the store terminal 8, it performs payment processing in the same way as in a general payment.

Thus, according to this embodiment, the payment system 100 has the following advantages.
(1) The user terminal 1 acquires payment information including the payment amount and terminal information related to the store terminal 8 from the store terminal 8, acquires card type information to be used for the acquired payment information from the card type information storage unit 34, acquires an acquired image which is image data of the user's face via the camera 36, and transmits approval information including the acquired payment information, card type information, and acquired image to the payment server 4.
The payment server 4 then compares the acquired image included in the approval information received from the user terminal 1 with a comparison face image, which is the user's facial image data in advance, and transmits an approval result based on the card type information, including the comparison result, to the user terminal 1.

Therefore, even if the store terminal 8 does not have a camera, a facial image for facial authentication at the time of payment can be obtained using the user terminal 1 equipped with the camera 36, and approval information including payment information together with the obtained image and ticket type information can be transmitted to the payment server 4. Then, the payment server 4 can perform facial authentication using the obtained image included in the approval information received from the user terminal 1.
As a result, it becomes unnecessary to install dedicated face capturing equipment such as a camera for face recognition payment at the store terminal 8, and payment using a user's face image can be realized inexpensively while keeping down the installation costs.
In addition, as long as the user has the user terminal 1, the user can conveniently make payments by simply photographing his or her face, without having to carry around cards such as credit cards or output two-dimensional codes for payment.

(2) The user terminal 1 receives the approval result from the payment server 4 and outputs the received approval result to the store terminal 8.
Therefore, the store terminal 8 can obtain the approval result corresponding to the payment information from the payment server 4 via the user terminal 1.

(3) The user terminal 1 acquires a facial image for matching via the camera 36, accepts input of authentication information that can authenticate the user at the payment server 4, and transmits the acquired facial image for matching and the accepted authentication information to the payment server 4.
The payment server 4 then authenticates the user using the authentication information, and if authentication is successful, extracts the user's card type information and transmits it to the user terminal 1, and registers the matching facial image in the matching image storage unit 63.
Therefore, a face image for matching can be registered in the payment server 4 using the user terminal 1 .
Furthermore, the user terminal 1 deletes the transmitted face image for matching from the storage unit 30 .
Therefore, the facial image for verification is not used as the acquired image at the time of payment, and fraudulent use can be avoided.

(4) When the user terminal 1 receives the denomination information from the payment server 4, it registers the received denomination information in the denomination information storage unit 34.
Therefore, when the face image for verification is registered, the bill type information received from the payment server 4 can be used at the time of payment.

(5) The user terminal 1 outputs the denomination information stored in the denomination information storage unit 34 to the touch panel display 37, and obtains the denomination information selected by the user from the outputted denomination information.
This is convenient for the user as he or she can specify the bill type to be used for payment from among the available bill types each time.

(6) After establishing communication with the store terminal 8, the user terminal 1 acquires payment information from the store terminal 8.
Therefore, by incorporating a communication function in the store terminal 8 that enables communication with a user terminal 1 located nearby, the service provided by the payment system 100 can be realized.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned embodiments. Furthermore, the effects described in the embodiments are merely a list of the most favorable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments. Note that the above-mentioned embodiments and the modified forms described below can be used in appropriate combinations, but detailed explanations will be omitted.

(Modifications)
(1) In the present embodiment, the matching process using the acquired image and the matching face image is performed by the payment server 4, but is not limited to this. The matching process itself may be performed by an image matching server or the like different from the payment server 4, and the payment server 4 may receive a score from the image matching server or the like. In addition, the matching result is obtained as a score indicating the degree of matching, but is not limited to this, and may be a result obtained by another method.

(2) In the present embodiment, the communication between the user terminal 1 and the store terminal 8 has been described using short-range wireless communication as an example, but is not limited to this. If the store terminal 8 does not have a short-range communication function with the user terminal 1, for example, information exchanged between the user terminal 1 and the store terminal 8 may be converted into a two-dimensional code or the like and then transferred.
More specifically, the user terminal 1 and the store terminal 8 are provided with a function for encoding and displaying information. Then, with the encoded payment information, for example a two-dimensional code, displayed on the display unit of the store terminal 8, the payment information acquisition means of the user terminal 1 reads the two-dimensional code via the camera 36 to acquire the payment information. Also, the approval result output means of the user terminal 1 outputs the encoded two-dimensional code of the approval result to the touch panel display 37, thereby causing the store terminal 8 to read the two-dimensional code.
Furthermore, the user terminal 1 and the store terminal 8 may be physically connected to each other to perform communication.

(3) In the present embodiment, the user terminal 1 outputs the approval result to the store terminal 8 in response to receiving it from the payment server 4, and if the approval result indicates approval, the store terminal 8 transmits a sales message to the payment server 4, but this is not limited to the above. The user terminal 1 may transmit approval information to the payment server 4, and if the approval result received from the payment server 4 indicates approval, then transmit a sales message to the payment server 4. In this case, the user terminal 1 sends the final payment result, including the sales processing, to the store terminal 8.

(4) In this embodiment, the card type output unit 23 outputs card type information stored in the card type information storage unit 34, and has been described as outputting, for example, the card type name. The card type name may have a function for the user to register an easy-to-understand name corresponding to the card type information in the card type information storage unit 34, and may be registered in the storage unit. For example, convenience is improved if a name that the user himself can immediately understand, such as "main card" or "for store X", is registered and output.

LIST OF SYMBOLS 1 User terminal 4 Payment server 8 Store terminal 10, 40 Control unit 11 Registration processing unit 12 Bill type designation unit 13 Matching image acquisition unit 14 Authentication information reception unit 15 Matching image transmission processing unit 16 Bill type registration processing unit 21 Payment processing unit 22 Payment information acquisition unit 23 Bill type output unit 24 Bill type acquisition unit 25 Face image acquisition unit 26 Approval information transmission unit 27 Approval result reception processing unit 30, 60 Memory unit 32 Registered payment application 33, 33a, 33b, ... Individual application 34 Bill type information memory unit 36 Camera 37 Touch panel display 41 Pre-processing unit 42 Authentication unit 43 Bill type extraction unit 44 Matching image registration unit 45 Bill type transmission unit 51 Matching processing unit 52 Approval information reception unit 53 Face image matching unit 54 Approval result transmission unit 55 Payment processing unit 62 User bill type storage unit 63 Matching image storage unit 100 Payment system

Claims (10)

a denomination information storage unit that stores denomination information used in payment processing;
a payment information acquiring means for acquiring payment information including a payment amount and terminal information related to the store terminal from the store terminal;
a denomination acquisition means for acquiring, from the denomination information storage unit, the denomination information to be used for the payment information acquired by the payment information acquisition means;
A facial image acquisition means for acquiring an acquired image, which is facial image data of a user, via an imaging unit;
an approval information transmitting means for transmitting approval information including the payment information acquired by the payment information acquiring means, the bill type information acquired by the bill type acquiring means, and the acquired image acquired by the face image acquiring means to a payment device in which a face image for comparison, which is face image data of the user, is stored in advance and which performs the payment process after matching using the face image for comparison;
A user terminal comprising: 2. The user terminal according to claim 1,
an approval result receiving means for receiving an approval result from the settlement device;
an approval result output means for outputting the approval result received by the approval result receiving means to the store terminal in a format that can be acquired by the store terminal;
A user terminal comprising: 2. The user terminal according to claim 1,
A collation image acquisition means for acquiring the collation face image via the photographing unit;
an authentication information receiving means for receiving an input of authentication information capable of authenticating the user in the payment device;
a verification image transmission means for transmitting the verification face image acquired by the verification image acquisition means and the authentication information accepted by the authentication information acceptance means to the payment device;
an image deleting means for deleting the face image for matching transmitted by the match image transmitting means from a storage unit;
A user terminal comprising: 4. The user terminal according to claim 3,
a denomination receiving means for receiving the denomination information from the settlement device;
a denomination registration means for registering the denomination information received by the denomination reception means in the denomination information storage unit;
A user terminal comprising: 2. The user terminal according to claim 1,
a denomination output means for outputting the denomination information stored in the denomination information storage unit to a display unit,
The denomination acquisition means is a user terminal that acquires the denomination information selected by the user from the denomination information outputted to the denomination output means. In a user terminal according to any one of claims 1 to 5,
The payment information acquisition means is a user terminal that acquires the payment information from the store terminal after establishing communication with the store terminal. In a user terminal according to any one of claims 1 to 5,
The payment information acquisition means is a user terminal that acquires the payment information from the store terminal by a reading unit reading a code of the payment information outputted to a display unit of the store terminal. Computer,
a payment information acquiring means for acquiring payment information including a payment amount and terminal information related to the store terminal from the store terminal;
a denomination acquisition means for acquiring denomination information to be used for the payment information acquired by the payment information acquisition means from a denomination information storage unit that stores the denomination information to be used in payment processing;
A facial image acquisition means for acquiring an acquired image, which is facial image data of a user, via an imaging unit;
an approval information transmitting means for transmitting approval information including the payment information acquired by the payment information acquiring means, the bill type information acquired by the bill type acquiring means, and the acquired image acquired by the face image acquiring means to a payment device in which a face image for comparison, which is face image data of the user, is stored in advance and which performs the payment process after matching using the face image for comparison;
A program to make it function as such. A payment system including a store terminal, a user terminal, and a payment device that performs payment processing,
the store terminal includes a payment information output means for outputting payment information including a payment amount and terminal information related to the store terminal to the user terminal in a format that can be acquired by the user terminal;
The user terminal,
a bill type information storage unit that stores bill type information used in the settlement process;
A payment information acquisition means for acquiring the payment information from the store terminal;
a denomination acquisition means for acquiring, from the denomination information storage unit, the denomination information to be used for the payment information acquired by the payment information acquisition means;
A facial image acquisition means for acquiring an acquired image, which is facial image data of a user, via an imaging unit;
an approval information transmitting means for transmitting approval information to the payment device, the approval information including the payment information acquired by the payment information acquiring means, the denomination information acquired by the denomination acquiring means, and the acquired image acquired by the face image acquiring means;
Equipped with
The payment device,
A matching image storage unit that stores a matching face image, which is face image data of the user;
a facial image matching means for matching the acquired image included in the approval information received from the user terminal with the facial image for matching stored in the matching image storage unit;
an approval result transmission means for transmitting an approval result based on the card type information, including the matching result by the face image matching means, to the user terminal;
Equipped with
The user terminal,
an approval result receiving means for receiving an approval result from the settlement device;
an approval result output means for outputting the approval result received by the approval result receiving means to the store terminal in a format that can be acquired by the store terminal;
A payment system comprising: 10. The payment system according to claim 9,
The user terminal,
A collation image acquisition means for acquiring the collation face image via the photographing unit;
an authentication information receiving means for receiving an input of authentication information capable of authenticating the user in the payment device;
a verification image transmission means for transmitting the verification face image acquired by the verification image acquisition means and the authentication information accepted by the authentication information acceptance means to the payment device;
an image deleting means for deleting the face image for matching transmitted by the match image transmitting means from a storage unit;
Equipped with
The payment device,
an authentication means for authenticating the user by referring to a user denomination storage unit that stores the denomination information for each user based on the authentication information received from the user terminal;
a denomination extraction means for extracting the denomination information of the user stored in the user denomination storage unit when authentication is successful by the authentication means;
a registration means for registering the face image for matching received from the user terminal in the match image storage unit when authentication is successful by the authentication means;
a denomination transmission means for transmitting the denomination information extracted by the denomination extraction means to the user terminal;
Equipped with
The user terminal,
a denomination receiving means for receiving the denomination information from the settlement device;
a denomination registration means for registering the denomination information received by the denomination reception means in the denomination information storage unit;
A payment system comprising:

Images