KR20150108576A - Method for electronic payment using recognition of pupil, apparatus therefor, and recording medium therefor - Google Patents

Abstract

Disclosed are a method for electronic payment using recognition of pupil, an apparatus therefor, and a recording medium therefor. Specifically, the present invention, in a terminal for supporting electronic payment using a communication network, comprises: an output unit for outputting one or more product; a first camera for acquiring image information of a pupil of the user including a pupil image and an iris image; and a control unit for outputting one or more product through the output unit, tracking the direction of the eyes of the user using the pupil image included in the image information when a first event has occurred for adding a product to a wish list by the image information acquired through the first camera, and identifying a product corresponding to the direction of the eyes of the user from among the one or more products and adding it to the wish list.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic payment method using pupil recognition, an apparatus therefor, and a recording medium therefor,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates generally to electronic commerce (E-commerce), and more particularly, to a method of selecting and paying for a product to be purchased by a user using a terminal, And recognizing the user's biometrics to identify and authenticate the user and perform settlement for purchasing goods, and an apparatus therefor.

2. Description of the Related Art [0002] Numerous terminals such as a personal computer, a cell phone, and the like have been implemented to perform more complex and diverse functions due to rapid development of information and communication technology.

For example, a user of a cellular phone can use an Internet connection, a web surfing, and the like through data communication beyond the use of a conventional voice call, and furthermore, while browsing the web, E-commerce services can be used.

On the other hand, biometrics is a method of extracting unique biometric information such as fingerprints, irises, sweat glands, blood vessels, and the like, which are different for each individual, and informing the biometric information. Personal identities such as face shape, voice, fingerprint, eyeball, etc. can not be used by theft or duplication of another person like a key or a password, and there is no danger of being changed or lost, and it is excellent in security field. In particular, since it is possible to trace the users afterwards, it is also possible to construct a secure system in terms of management. Examples of such biometrics are Finger scan, Vein recognition, Iris scan, Speech recognition, and Face recognition.

More specifically, iris recognition uses an iris pattern of an eye having unique characteristics for each person, and it is evaluated as an excellent security method in comparison with fingerprint or retina recognition in terms of data accuracy, stability, ease of use, and processing speed. The iris has a unique pattern within 1 or 2 years of life and does not change for a lifetime. The iris recognition enables identification of the user in a short time using the process of changing the iris wrinkle to frequency. In addition, the iris of a person to be subjected to iris recognition has a merit that it is less likely to be stolen because of slight tremors, and a non-contact method for recognizing a pattern at a certain distance from the camera is used, have.

Korean Patent Laid-Open No. 2001-0006976, Jan. 26, 2001 (Name: iris recognition system)

An object of the present invention is to provide an electronic payment method capable of detecting an event such as blinking of a user's eyes, enlargement or reduction of a pupil contained in image information of a user's eyeball, We propose a device for this.

It is another object of the present invention to provide an electronic payment method and an apparatus therefor, which can generate biometric information using an iris included in image information of a user's eye and conduct user authentication using the generated biometric information.

The technical objects to be achieved by the present invention are not limited to the above-mentioned technical problems and other technical subjects which are not mentioned are clarified to those skilled in the art to which the present invention belongs .

According to one aspect of the present invention, there is provided a terminal supporting electronic settlement using a communication network, the terminal supporting electronic settlement using a communication network, the terminal comprising: an output unit outputting one or more goods; A first camera for acquiring image information on an eyeball and a first event for outputting one or more goods through the output unit and for adding a product to a wish list according to image information acquired through the first camera, And a control unit for tracking the direction of the user's gaze using the pupil image included in the image information and identifying a product corresponding to the gaze direction of the user among the one or more products and adding the identified product to the wish list .

According to another aspect of the present invention, there is provided a service apparatus for supporting electronic settlement using a communication network, comprising: a service communication unit for transmitting and receiving data to and from a terminal and a settlement apparatus; a service storage unit for storing user settlement information related to a user's payment means; And a service communication unit for receiving user identification information for identifying the user from the terminal and product identification information for identifying a product and extracting the user payment information corresponding to the user identification information from the service storage unit And a controller for transmitting the user identification information, the product identification information, and the user payment information to the settlement apparatus through the service communication unit to request an electronic settlement, wherein the product identification information is acquired through a camera Using the pupil image included in the image information In that the open information for identifying the product corresponding to the track in the user's gaze direction is characterized.

According to another aspect of the present invention, there is provided a settlement apparatus for supporting electronic settlement using a communication network, the settlement communication unit transmitting and receiving data to and from a service apparatus, user identification information for identifying a user from the service apparatus through the settlement communication unit, The user identification information for identifying the user and the payment information related to the payment means of the user and the goods identification information for identifying the goods, Wherein the product identification information is information for identifying a product corresponding to the gaze direction of the user tracked using the pupil image included in the image information acquired through the camera included in the terminal .

According to another aspect of the present invention, there is provided a system for supporting electronic settlement using a communication network, the system including: a first event for adding a product to a wish list based on image information acquired through a first camera; A direction of a user's gaze direction is tracked using a pupil image included in the image information, an item corresponding to the user's gaze direction is identified and added to a wish list, and a product added to the wish list by the image information A terminal for requesting an electronic settlement by transmitting user identification information for identifying the user to the service device and product identification information for identifying a product included in the wish list when a second event for purchasing the electronic service is generated; Receiving the user identification information and the product identification information from the terminal, A service apparatus for extracting user payment information, requesting an electronic settlement by transmitting the user identification information, the product identification information, and the user settlement information to a settlement apparatus, and a control unit for transmitting the user identification information, And a settlement device which receives the goods identification information and processes payment for the user to purchase the goods according to the goods identification information by using the user payment information by the user according to the user identification information.

According to another aspect of the present invention, there is provided an electronic payment method for a terminal using a communication network, the method comprising: acquiring image information through the first camera; the method comprising the steps of: if the first event is generated as a result of the determination, the terminal tracks a direction of a user's gaze using a pupil image included in the image information; Wherein the terminal identifies a commodity corresponding to the direction of the user's gaze of one or more commodities, and the terminal adds the identified commodity to the wishlist.

The present invention provides an improved user experience (UX) using biometric information of a user by detecting an event included in image information of a user's eyeball and conducting electronic payment for a product that the user desires to purchase can do.

Particularly, biometric information is generated by using iris included in image information of the user's eye, and user authentication is performed using the generated biometric information, thereby excelling in accuracy and processing speed in authenticating a user for electronic settlement .

The effects obtained in the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description .

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the technical features of the invention.
FIG. 1 is a diagram illustrating a process of electronic settlement by a user using a terminal according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of an electronic payment system according to an embodiment of the present invention.
3 is a diagram illustrating a configuration of a terminal according to an embodiment of the present invention.
4 is a view illustrating a platform structure of a terminal according to an embodiment of the present invention.
5 is a diagram illustrating a configuration of a service apparatus according to an embodiment of the present invention.
6 is a diagram illustrating a configuration of a settlement apparatus according to an embodiment of the present invention.
7 is a diagram illustrating a method of using an electronic payment system of a terminal according to an embodiment of the present invention.
8 is another diagram illustrating a method of using an electronic payment system of a terminal according to an embodiment of the present invention.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following detailed description, together with the accompanying drawings, is intended to illustrate exemplary embodiments of the invention and is not intended to represent the only embodiments in which the invention may be practiced. The following detailed description includes specific details in order to provide a thorough understanding of the present invention. However, those skilled in the art will appreciate that the present invention may be practiced without these specific details.

In some instances, well-known structures and devices may be omitted or may be shown in block diagram form, centering on the core functionality of each structure and device, to avoid obscuring the concepts of the present invention.

Throughout the specification, when an element is referred to as "comprising" or " including ", it is meant that the element does not exclude other elements, do. Also, the terms " part, "" module," and " module ", etc. in the specification mean a unit for processing at least one function or operation and may be implemented by hardware or software or a combination of hardware and software have. Also, the terms " a or ", "one "," the ", and the like are synonyms in the context of describing the invention (particularly in the context of the following claims) May be used in a sense including both singular and plural, unless the context clearly dictates otherwise.

The specific terminology used in the following description is provided to aid understanding of the present invention, and the use of such specific terminology may be changed into other forms without departing from the technical idea of the present invention.

1 is a diagram illustrating a process in which a user makes an electronic payment using the terminal 110 according to an embodiment of the present invention.

Referring to FIG. 1, a user of the terminal 110 uses an electronic settlement through the terminal 110 to proceed with settlement of a product desired to be purchased.

In detail, the terminal 110 according to an embodiment of the present invention includes a first camera 113a. For example, the first camera 113a may be a front camera attached to the front surface of the terminal 110. [ The terminal 110 acquires image information about the user's eye 10 using the first camera 113a. Here, the eye 10 of the user includes the iris 11 and the pupil 12.

The iris (Iris) 11 is located in the ocular blood vessel layer constituting the eye 10 of the user and plays a role of regulating the size of the pupil 12 through contraction and relaxation of the tissue. The terminal 110 can generate authentication information for authenticating a user using the image information about the iris 11 acquired through the first camera 113a and use the generated authentication information for electronic payment.

The pupil 12 is an empty space in the center of the inner surface of the iris 11 and determines the amount of light entering the eye 10 according to the size thereof. For example, when the space in which the user is located becomes dark, the pupil 12 of the user becomes large in size through the iris 11 to allow more light to enter. On the other hand, if the space in which the user is located is brightened, the pupil 12 of the user is reduced in size through the iris 11 to allow less light to enter. The terminal 110 may track the direction of the user's gaze direction 13 using the image information of the pupil 12 acquired through the first camera 113a, It is possible to identify a product corresponding to the tracked sight direction 13 among the goods.

The terminal 110 according to an exemplary embodiment of the present invention may further include a second camera 113b. For example, the second camera 113b may be a rear camera attached to the rear surface of the terminal 110. [ The terminal 110 may acquire image information about one or more goods 20 using the second camera 113b. The terminal 110 may output the image information of the acquired at least one article 20 through the output unit 114. [

2 is a diagram illustrating a configuration of an electronic payment system 100 according to an embodiment of the present invention.

The electronic settlement system 100 according to the present invention uses the image information of the eye 10 of the user acquired by the terminal 110 through the first camera 113a to transmit the service information to the service apparatus 120 and the settlement apparatus 130. [ And supports electronic payment for a product that the user wants to purchase. The configuration of the electronic settlement system 110 shown in FIG. 1 shows functionally functioning functional elements, and any one or more configurations may be physically integrated with one another.

2, an electronic payment system 100 according to an exemplary embodiment of the present invention may include a terminal 110, a service device 120, a payment device 130, and a communication network 140.

The terminal 110 may acquire image information of the eye 10 of the user and may be connected to the service device 120 through the communication network 140 so as to support the electronic payment Any of which may be acceptable. For example, a smart phone, a tablet, a laptop, a portable multimedia player, a phablet, a personal digital assistant, an e-book Reader), but the present invention is not limited thereto. The specific configuration of the terminal 110 according to the present invention will be described later with reference to FIG.

The service apparatus 120 provides product detail information via the communication network 140 in response to a request from the terminal 110 and supports electronic settlement of the terminal 110 in cooperation with the settlement apparatus 130. [ A specific configuration of the service apparatus 120 will be described later with reference to FIG.

The payment apparatus 130 is for processing an electronic settlement through the communication network 140 in response to a request of the service apparatus 120. [ A specific configuration of the settlement apparatus 130 will be described later with reference to FIG.

The communication network 140 corresponds to a network for transmitting and receiving data between the terminal 110, the service device 120 and the settlement device 130. More preferably, the communication network 140 may be any one or more of Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), High Speed Packet Access (HSPA) (Digital Subscriber Line, xDSL), a hybrid fiber coax (HFC), and a mobile communication network such as a long term evolution (LTE), but the present invention is not limited thereto. A wired communication network such as a Fiber To The Home (FTTH), a wireless communication network such as a WiFi, a Wibro, a Wimax, an Ultra WideBand (UWB) Wireless communication networks such as Radio Frequency Identification (RFID), Zigbee, Near Field Communication (NFC), and the like.

Hereinafter, the terminal 110 will be described in more detail.

3 is a diagram illustrating a configuration of a terminal 110 according to an embodiment of the present invention. The configuration of the terminal 110 shown in FIG. 3 shows functional elements that are functionally separated, and any one or more configurations may be physically separated or integrated.

3, a terminal 110 according to an exemplary embodiment of the present invention includes a communication unit 111, an input unit 112, an image acquisition unit 113, an output unit 114, a storage unit 115, 116).

The communication unit 111 is for transmitting / receiving data to / from the service device 120 through the communication network 140. Specifically, the communication unit 111 transmits the user identification information, the user authentication information, and the product identification information to the service device 120 through the communication network 140. The communication unit 111 may receive the detailed product information or the like from the service device 120 via the communication network 140 and may transmit the received detailed product information to the control unit 116. [ Here, the user identification information is information for identifying the terminal 110 or the user, and is not limited to characters. The user authentication information is biometric information used by the user of the terminal 110 to authenticate whether the purchaser is the user himself or herself when purchasing the product. The product identification information is information for identifying one or more goods 20, and is not limited to characters. The product detail information is information for providing a more detailed description of a product that the user desires to purchase for one product 20. [

The input unit 112 receives data necessary for the operation of the terminal 110. Specifically, the input unit 112 may receive the user identification information and the product identification information from the user, and may transmit the user identification information and the product identification information to the control unit 116. The input unit 112 may include a keypad or a touchpad for generating an input signal according to a user's touch. In particular, the input unit 112 may include a touch screen It can also be configured to perform both input and output simultaneously. The input unit 113 may include input means such as a keyboard, a mouse, a gyro sensor, a joystick, and an accelerometer, as well as any type of input means that can be developed in the future .

The image acquiring unit 113 acquires image information about the outer world of the terminal 110 and transmits the acquired image information to the control unit 116. [ Preferably, the first camera 113a may include a first camera 113a for acquiring image information on an outer world, and further may include a second camera 113b for acquiring image information on a direction different from the first camera 113a, As shown in FIG. Specifically, the first camera 113a acquires image information on the eye including the pupil image and the iris image of the user, and transfers the acquired image information to the control unit 116. [ For example, the first camera 113a may be a front camera attached to the front surface of the terminal 110. [

The second camera 113b acquires image information for the reverse direction of the first camera 113a and transfers the acquired image information to the control unit 116. [ For example, the second camera 113b may be a rear camera attached to the rear surface of the terminal 110. [ In particular, the second camera 113b according to an embodiment of the present invention can be used to acquire image information about one or more goods.

The output unit 114 receives data required for the operation of the terminal 110 from the control unit 116 and outputs the received data. Specifically, output unit 114 may output information about one or more goods. In particular, the output unit 114 may output detailed product information for one product according to the user's selection. The output unit 114 may be a liquid crystal display (LCD), a light emitting diode (LED), an organic light emitting diode (OLED), an active matrix OLED ), A flexible display, a retina display, a speaker, and a vibration motor. At this time, when the output unit 114 is configured as a touch screen, the output unit 114 may perform some or all of the functions of the input unit 112. [

The storage unit 115 may receive data necessary for the operation of the terminal 110 from the control unit 116 and store the data, and may include a main storage unit and an auxiliary storage unit. Specifically, the storage unit 115 can be roughly divided into a program area and a data area. In particular, the storage unit 115 includes user information 115a, product information 115b, and a wish list 115c, and further includes an operating system (OS) The above program can be included.

The user information 115a includes user identification information, and may further include user authentication information and user payment information. Specifically, the user identification information is information for identifying the terminal 110 or the user, and is not limited to characters. The user authentication information is biometric information used by the user of the terminal 110 to authenticate whether the purchaser is the user himself or herself when purchasing the product. For example, the user authentication information according to an embodiment of the present invention may be iris information generated based on the image information acquired through the image acquisition unit 113, but is not limited thereto. The user payment information is information related to the means used by the user of the terminal 110 in payment for purchasing goods. For example, the user payment information according to an exemplary embodiment of the present invention may include credit card information, card password, and the like, but is not limited thereto.

The product information 115b includes product identification information, and may further include product detail information. Specifically, the product identification information is information for identifying one or more goods 20, and is not limited to characters. The item detail information is information for providing a more detailed explanation of the item 20 the user desires to purchase. For example, the detailed product information according to an exemplary embodiment of the present invention may include, but is not limited to, material, durability, performance, production site, sales floor, sales price,

The wish list 115c is a space for separately collecting and storing goods desired by the user. Specifically, the wish list 115c according to an exemplary embodiment of the present invention is configured such that when a first event is generated based on image information acquired through the image acquisition unit 113, The goods corresponding to the direction can be identified and stored. Here, the first event is generated by a preset user's eye 10 form for delivering it to the terminal 110 if the user of the terminal 110 wants to add a particular item to the wish list 115c Event.

The control unit 116 is configured to perform overall control of the terminal 110 and performs functions of the communication unit 111, the input unit 112, the image acquisition unit 113, the output unit 114, and the storage unit 115 To control the signal flow. At this time, the control unit 116 may be a processing device for driving each configuration of the terminal 110, for example, a central processing unit (CPU).

The control unit 116 includes an image analysis module 116a and a payment support module 116b in order to perform the functions of the terminal 110 more effectively. Specifically, the image analysis module 116a acquires image information through the image acquisition unit 113, and analyzes the acquired image information to determine whether a predetermined event has occurred. The payment support module 116b adds the commodity 20 desired by the user to the wish list 115c and provides the commodity detailed information about the commodity that the user desires to purchase and connects with the service apparatus 120 And performs electronic settlement.

The electronic settlement process through the image analysis module 116a and the settlement support module 116b will be described in more detail as follows.

The image analysis module 116a outputs one or more goods through the output 114. [ The image analysis module 116a according to an exemplary embodiment of the present invention transmits image information about one or more goods received through the communication unit 111 or image information about one or more goods stored in the storage unit 115 to an output unit 114 The image analysis module 116a according to another embodiment of the present invention may output the image information about one or more goods acquired through the second camera 113b of the image acquisition unit 113 to the output unit 114).

The image analysis module 116a acquires image information about the eye of the user of the terminal 110 through the first camera of the image acquisition unit 113. [ The image analysis module 116a analyzes the acquired image information to determine whether a predetermined event has occurred.

Here, the preset event may be distinguished from the first event to the third event. Specifically, the first event is caused by a pre-established user's eye 10 form for communicating this to the terminal 110 if the user of the terminal 110 wishes to add a particular item to the wish list 115c Event. The second event is an event generated by a predetermined form of the user's eye 10 for delivering the item to the terminal 110 when the user of the terminal 110 desires to purchase the item added to the wish list 115c to be. The third event is an event generated by a preset user's eye 10 form for communicating this to the terminal 110 when the user of the terminal 110 requests a detailed description of the specific item.

For example, the predetermined event is one or more consecutive blinks using one or more eyes of the user, identified by the image information of the user ' s eye acquired through the first camera of the terminal 110 image acquisition unit 113, But is not limited to, any one of crossing one or more blinks of one eye and another eye, enlarging or reducing a pupil image, or moving according to a preset trajectory of a pupil image.

More specifically, when the first event is generated, the image analysis module 116a calculates the pupil image of the user included in the image information on the eye of the user acquired through the first camera 113a of the image acquisition unit 113 And identifies a product corresponding to the direction of the user's gaze of one or more products output through the output unit 114. [ Then, the payment support module 116b adds the goods identified through the image analysis module 116a to the wish list 115c.

The payment support module 116b transmits the user identification information on the user of the terminal 110 stored in the storage unit 115 and the product identification information on the goods included in the wish list 115c to the communication unit 111 to the service device 120, thereby requesting electronic settlement of the goods included in the wish list 115c.

Particularly, before requesting the electronic settlement to the service apparatus 120 of the settlement support module 116c, the image analysis module 116a performs the image analysis of the user's eyes acquired through the first camera 113a of the image acquisition unit 113 The user authentication information can be generated using the iris image of the user included in the image information of the user. Here, the user authentication information is biometric information used by the user of the terminal 110 to authenticate whether the purchaser is the user himself or herself when purchasing the product. The payment support module 116b transmits the user authentication information generated through the image analysis module 116a to the service device 120 through the communication unit 111 so as to authenticate the terminal 110 using the user authentication information Can be requested.

When the third event is generated, the image analysis module 116a analyzes the pupil image of the user included in the image information of the eye of the user acquired through the first camera 113a of the image acquisition unit 113, And identifies a product corresponding to the direction of the user's gaze of one or more products output through the output unit 114 by tracking the gaze direction. The payment support module 116b transmits the product identification information for the goods identified through the image analysis module 116a to the service device 120 through the communication unit 111 to request the product detail information. The payment support module 116b receives product detail information from the service device 120 through the communication unit 111 and outputs the received product detail information through the output unit 114. [

4 is a diagram illustrating a platform structure of a terminal 110 according to an embodiment of the present invention.

Referring to FIG. 4, the terminal 110 may include terminal hardware 117 and a terminal operating system (OS) 118. Specifically, the terminal hardware 117 refers to a physical environment of the terminal 110 such as a central processing unit (CPU), a network interface card (NIC), and a memory of the terminal. The terminal hardware 117 includes a communication unit 111, 112, the image acquisition unit 113, the output unit 114, the storage unit 115, and the control unit 116 may correspond to the actual physical environment.

The terminal operating system 118 is responsible for the overall operation of the terminal 110 and may be installed by a terminal manufacturer or a communication service provider. 1 and 2 may exist in the form of one or more modules in the terminal operating system 118. [ The terminal operating system 118 provides an API (Application Programming Interface) for controlling the terminal hardware 117.

In addition, the platform of the terminal 110 according to an embodiment of the present invention may include a separate payment support platform 119 for supporting the electronic payment service provided by the service apparatus 120. Here, the payment support platform 119 may be created at the moment when the payment program 115d is stored in the terminal 110 or when the payment program 115d is activated. The payment support platform 119 supports control of the terminal hardware 117 of the payment program 115d using an interface (API) provided by the terminal operating system 118, and in particular, by using an application collection interface (API) The application can be collected and transmitted to the payment program 115d. Even if the platform of the terminal 110 according to another embodiment of the present invention is configured not to include the payment support platform 119, it is possible to receive the service from the service device 120 according to the interface (API) It is also possible to receive and output an application capable of receiving and outputting data.

5 is a diagram illustrating a configuration of a service apparatus 120 according to an embodiment of the present invention. The configuration of the service device 120 shown in FIG. 5 shows functional elements that are functionally separated, and any one or more configurations may be physically separated or integrated.

5, a service apparatus 120 according to an embodiment of the present invention includes a service communication unit 121, a service storage unit 122, and a service control unit 123.

The service communication unit 121 is for transmitting and receiving data to and from the terminal 110 and the payment apparatus 130 through the communication network 140. [ Specifically, the service communication unit 121 receives user identification information, user authentication information, and product identification information from the terminal 110 via the communication network 140, and transmits the user identification information and the product identification information to the service control unit 123. The service communication unit 121 transmits user identification information, user authentication information, product identification information, and user payment information to the payment apparatus 130 via the communication network 140. In addition, the service communication unit 121 transmits the item detail information to the terminal 130. [

The service storage unit 122 is for receiving data required for operation of the service device 120 from the service control unit 123 and storing the received data. Specifically, the service storage unit 122 includes user information 122a and product information 122b.

The user information 122a includes user identification information, user authentication information, and user payment information. Specifically, the user identification information is information for identifying the terminal 110 or the user, and is not limited to characters. The user authentication information is biometric information used by the user of the terminal 110 to authenticate whether the purchaser is the user himself or herself when purchasing the product. The user payment information is information related to the means used by the user of the terminal 110 in payment for purchasing goods.

The product information 122b includes product identification information and product detail information. Specifically, the product identification information is information for identifying one or more goods 20, and is not limited to characters. The item detail information is information for providing a more detailed description of a single item 20 desired by the user.

The service control unit 123 is configured to perform overall control of the service device 120 and to control the signal flow for performing the functions of the service communication unit 121 and the service storage unit 122.

Specifically, the service control unit 123 receives the user identification information and the product identification information from the terminal 110 through the service communication unit 121. The service control unit 123 extracts user payment information corresponding to the user identification information received from the terminal 110 from the service storage unit 122. [ The service control unit 123 transmits the user identification information and the product identification information received from the terminal 110 and the user payment information extracted from the storage unit 122 to the payment apparatus 130 through the service communication unit 121 , And requests electronic payment.

The service control unit 123 receives the user authentication information from the terminal 110 via the service communication unit 121 and transmits the received user authentication information to the service storage unit 130. [ And may perform user authentication by matching the user authentication information stored in the memory 122.

The service control unit 123 receives the product identification information from the terminal 110 via the service communication unit 121, extracts the product detail information corresponding to the received product identification information from the service storage unit 122, And transmits the detailed product information to the terminal 110 via the service communication unit 121.

6 is a diagram illustrating a configuration of a settlement apparatus 130 according to an embodiment of the present invention. The configuration of the settlement apparatus 130 shown in FIG. 6 represents functional elements that are functionally separated, and any one or more configurations may be physically separated or integrated.

6, the settlement apparatus 130 according to an embodiment of the present invention includes a settlement communication unit 131, a settlement storage unit 132, and a settlement control unit 133.

The settlement communication unit 131 is for transmitting and receiving data with the service device 120 through the communication network 140. [ Specifically, the settlement communication unit 131 receives user identification information, user authentication information, user settlement information, and product identification information from the service device 120 via the communication unit 140 and transfers the received user identification information, user settlement information, and product identification information to the settlement control unit 133. The settlement communication unit 131 can transmit the settlement processing result to the service apparatus 120 via the communication network 140. [

The settlement storage unit 132 is for receiving data necessary for the operation of the settlement apparatus 130 from the settlement control unit 133 and storing the received data. More specifically, the payment storage unit 132 includes user information 132a and product information 132b.

The user information 132a includes user identification information, user authentication information, and user payment information. Specifically, the user identification information is information for identifying the terminal 110 or the user, and is not limited to characters. The user authentication information is biometric information used by the user of the terminal 110 to authenticate whether the purchaser is the user himself or herself when purchasing the product. The user payment information is information related to the means used by the user of the terminal 110 in payment for purchasing goods.

The product information 132b includes product identification information. Specifically, the product identification information is information for identifying one or more goods 20, and is not limited to characters.

The settlement control unit 133 is configured to perform overall control of the settlement apparatus 130 and controls the signal flow for performing the functions of the settlement communication unit 131 and the settlement storage unit 132. [

Specifically, the payment control unit 133 receives user identification information, user payment information, and product identification information from the service device 120 through the payment communication unit 131. [ The payment control unit 133 processes the settlement for purchasing the commodity according to the received commodity identification information using the received payment information by the user according to the received user identification information. The settlement control unit 133 can transmit the settlement processing result to the service apparatus 120 through the settlement communication unit 131. [

7 is a diagram illustrating a method of using an electronic payment system of a terminal 110 according to an embodiment of the present invention.

Referring to FIG. 7, the terminal 110 obtains image information through the first camera (S701). Here, the first camera is for acquiring image information about the eye including the pupil image and the iris image of the user, and may be a front camera attached to the front surface of the terminal 110, for example.

The terminal 110 analyzes the acquired image information in step S701 and determines whether a preset first event has occurred (step S703). Here, the first event is generated by a preset user's eye 10 form for delivering it to the terminal 110 if the user of the terminal 110 wants to add a particular item to the wish list 115c Event.

As a result of the determination in step S703, if the first event is not generated, the terminal 110 ends the process without performing the following steps (S705).

If it is determined in step S703 that the first event has occurred, the terminal 110 tracks the eyeball invention of the user using the pupil image of the user included in the image information acquired in step S701, And identifies the product corresponding to the gaze direction (S707). Here, one or more goods according to an embodiment of the present invention may be one or more goods included in image information received from the service device 120 or the like, but one or more goods according to another embodiment of the present invention may be a second And may be one or more products included in the image information acquired through the camera.

Then, the terminal 110 adds the goods identified in step S707 to the wish list 115c (S709).

8 is another diagram illustrating a method of using an electronic payment system of the terminal 110 according to an embodiment of the present invention.

Referring to FIG. 8, the terminal 110 obtains image information through the first camera (S801). Here, the first camera may be a front camera attached to the front surface of the terminal 110, for example, to acquire image information about the eye including the pupil image and the iris image of the user.

The terminal 110 analyzes the acquired image information in step S801 and determines whether a preset first event has occurred (step S803). Here, the first event is generated by a preset user's eye 10 form for delivering it to the terminal 110 if the user of the terminal 110 wants to add a particular item to the wish list 115c Event.

If it is determined in step S803 that the first event has occurred, the terminal 110 tracks the eyeball invention of the user using the pupil image of the user included in the image information acquired in step S801, And identifies the product corresponding to the gaze direction (S805). Here, one or more goods according to an embodiment of the present invention may be one or more goods included in image information received from the service device 120 or the like, but one or more goods according to another embodiment of the present invention may be a second And may be one or more products included in the image information acquired through the camera.

Then, the terminal 110 adds the goods identified through the step S805 to the wish list 115c (S807).

If it is determined in step S803 that the first event is not generated, the terminal 110 analyzes the image information acquired in step S801 and determines whether a preset second event has occurred (step S809). Here, the second event is generated by a preset user's eye 10 form for delivering the item to the terminal 110 when the user of the terminal 110 desires to purchase the item added to the wish list 115c Event.

If it is determined in step S809 that the second event has occurred, the terminal 110 generates the user authentication information using the iris image of the user included in the image information acquired in step S801 (step S811). Here, the user authentication information is biometric information used by the user of the terminal 110 to authenticate whether the purchaser is the user himself or herself when purchasing the product.

The terminal 110 transmits the user authentication information generated in step S811 to the service device 120 to request authentication of the terminal 110 using the user authentication information (S813).

The terminal 110 transmits the goods identification information on the goods included in the wish list 115c to the service device 120 so as to request the electronic payment for the goods contained in the wish list 115c (S815).

If it is determined in step S809 that the second event is not generated, the terminal 110 analyzes the image information acquired in step S801 and determines whether a third event has occurred in step S817. Here, the third event is an event generated by a preset user's eye 10 form for delivering it to the terminal 110 when the user of the terminal 110 requests a detailed description of the specific commodity.

If it is determined in step S817 that the third event has occurred, the terminal 110 uses the pupil image of the user included in the image information acquired in step S801 to identify the product corresponding to the identified user's gaze direction And transmits the information to the service device 120, thereby requesting the detailed product information (S819).

The terminal 110 receives the item detail information from the service apparatus 120 (S821).

Then, the terminal 110 outputs the goods detail information received in step S821 (S823).

As a result of the determination in step S817, if the third event is not generated, the terminal 110 ends without performing steps S815 through S819.

The electronic payment system 100 according to the embodiment of the present invention detects an event such as blinking of a user's eyes and enlargement or reduction of a pupil included in image information about a user's eyeball, By conducting electronic settlement, it is possible to provide a user experience (UX) using a user's biometric information.

Particularly, the electronic payment system 100 according to the embodiment of the present invention generates biometric information using the iris included in the image information about the user's eye, performs user authentication using the generated biometric information, It is possible to exert an excellent effect on the accuracy, the processing speed, and the like in authenticating the user.

Embodiments in accordance with the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of hardware implementation, an embodiment of the present invention may include one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs) field programmable gate arrays, processors, controllers, microcontrollers, microprocessors, and the like.

In addition, in the case of an implementation by firmware or software, an embodiment of the present invention may be embodied in the form of a module, a procedure, a function, and the like for performing the functions or operations described above, Lt; / RTI > Here, the recording medium may include program commands, data files, data structures, and the like, alone or in combination. Program instructions to be recorded on a recording medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. For example, the recording medium may be an optical recording medium such as a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, a compact disk read only memory (CD-ROM), a digital video disk (DVD) Optical media such as a floppy disk and a hardware device specifically configured to store and execute program instructions such as ROM, RAM, flash memory and the like. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be apparent to those skilled in the art. Furthermore, although specific terms are used in this specification and the drawings, they are used in a generic sense only to facilitate the description of the invention and to facilitate understanding of the invention, and are not intended to limit the scope of the invention. Accordingly, the foregoing detailed description is to be considered in all respects illustrative and not restrictive. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

In addition, a device or terminal according to the present invention may be driven by instructions that cause one or more processors to perform the functions and processes described above. Such instructions may include, for example, interpreted instructions such as script commands, such as JavaScript or ECMAScript commands, or other instructions stored in executable code or computer readable media. Further, the apparatus according to the present invention may be implemented in a distributed manner across a network, such as a server farm, or may be implemented in a single computer device.

Further, a computer program (also known as a program, software, software application, script or code) that is embedded in the apparatus according to the present invention and which implements the method according to the present invention includes a compiled or interpreted language, a priori or procedural language , And may be deployed in any form including standalone programs or modules, components, subroutines, or other units suitable for use in a computer environment. A computer program does not necessarily correspond to a file in the file system. The program may be stored in a single file provided to the requested program, or in multiple interactive files (e.g., a file storing one or more modules, subprograms, or portions of code) (E.g., one or more scripts stored in a markup language document). A computer program may be deployed to run on multiple computers or on one computer, located on a single site or distributed across multiple sites and interconnected by a communications network.

Moreover, in describing the embodiments according to the present invention, operations are depicted in the drawings in a particular order, but it is to be understood that they should perform such operations in that particular order or sequential order shown in order to obtain the desired result, Should not be understood as being performed. In certain cases, multitasking and parallel processing may be advantageous. Also, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products It should be understood.

The system according to the present invention can provide an electronic payment service to a user using a terminal such as a smart phone, a laptop, a tablet, or a tablet. In addition, this is industrially applicable because it is not only possible to market or operate, but also can be practically and practically carried out.

100: Electronic payment system 110:
111: communication unit 112: input unit
113: image acquisition unit 114: output unit
115: storage unit 116: control unit
120: service apparatus 121: service communication section
122: service storage unit 123: service control unit
130: Payment device 131: Payment communication part
132: payment storage section 133: payment control section
140: Network

Claims (14)

1. A terminal for supporting electronic settlement using a communication network,
An output unit outputting one or more goods;
A first camera for acquiring image information on a user ' s eye including a pupil image and an iris image; And
When a first event for outputting one or more goods through the output unit and for adding a product to a wish list by the image information acquired through the first camera is generated, And a controller for identifying a commodity corresponding to the gaze direction of the user among the one or more commodities and adding the commodity to the wish list. The method according to claim 1,
Further comprising a communication unit for transmitting and receiving data to and from the service device,
The control unit
When a second event for purchasing a commodity added to the wish list is generated by the image information, user identification information for identifying the user to the service apparatus via the communication unit, and goods included in the wish list And transmits the goods identification information for identifying the goods to the electronic settlement requesting unit. 3. The method of claim 2,
The control unit
Generates user authentication information for authenticating the user using the iris image included in the image information, and transmits the user authentication information to the service device through the communication unit to request authentication. The method according to claim 1,
Further comprising a communication unit for transmitting and receiving data to and from the service device,
The control unit
When a third event for requesting a detailed description of a product is generated according to the image information, a product detail information for providing a detailed description of the product corresponding to the direction of the user's gaze to the service device through the communication unit And receives the item detail information from the service apparatus through the communication unit and outputs the item detail information through the output unit. The method according to claim 1,
Further comprising: a second camera for acquiring image information on the backward direction of the first camera,
The control unit
And outputs the image information acquired through the second camera through the output unit. The method according to claim 1,
The first event
One or more consecutive blinks using one or more eyes of the user identified by the image information, one or more alternating blinks of one eye and another eye, enlargement or reduction of the pupil image, or a preview of the pupil image And movement according to a set trajectory. A service apparatus for supporting electronic settlement using a communication network,
A service communication unit for transmitting and receiving data to and from the terminal and the settlement apparatus;
A service storage unit for storing user payment information related to the payment means of the user; And
Receiving service identification information for identifying the user and product identification information for identifying the user from the terminal through the service communication unit, extracting the user payment information corresponding to the user identification information from the service storage, And a control unit for transmitting the user identification information, the product identification information, and the user payment information to the settlement apparatus through the service communication unit to request electronic settlement,
The product identification information
Wherein the service information is information for identifying a product corresponding to the gaze direction of the user tracked using the pupil image included in the image information acquired through the camera included in the terminal. 8. The method of claim 7,
The service storage unit
Further storing user authentication information for authenticating the user,
The service control unit
Receives the user authentication information from the terminal through the service communication unit, and performs user authentication by matching the received user authentication information with the user authentication information stored in the service storage unit. 8. The method of claim 7,
The service storage unit
Further stores product detail information for providing a detailed description of the product,
The service control unit
Receives the product identification information from the terminal through the service communication unit, extracts the product detail information corresponding to the product identification information from the service storage unit, and transmits the extracted product detailed information to the terminal. A settlement apparatus for supporting electronic settlement using a communication network,
A settlement communication unit for transmitting and receiving data to and from the service device;
Wherein the payment communication unit receives user identification information for identifying a user from the service device, user payment information related to the payment means of the user, and product identification information for identifying a product through the payment communication unit, And a payment control unit for processing a payment for purchasing a commodity according to the commodity identification information using the user payment information,
The product identification information
And information for identifying a product corresponding to the gaze direction of the user tracked using the pupil image included in the image information acquired through the camera included in the terminal. A system for supporting electronic settlement using a communication network,
Wherein when a first event for adding a product to a wish list is generated by image information acquired through a first camera, a gaze direction of a user is traced using a pupil image included in the image information, The method comprising the steps of: identifying a product corresponding to a user's gaze direction and adding the product to the wish list; and when a second event for purchasing a product added to the wish list is generated by the image information, A terminal for requesting an electronic settlement by transmitting identification information and merchandise identification information for identifying a merchandise included in the wish list;
Receiving the user identification information and the product identification information from the terminal, extracting user payment information related to the payment means of the user, transmitting the user identification information, the product identification information, and the user payment information to the payment device A service device for requesting an electronic settlement; And
Receiving user identification information, user payment information, and merchandise identification information from the service apparatus, and allowing a user according to the user identification information to pay for purchasing a merchandise corresponding to the merchandise identification information using the user payment information And a payment device that processes the payment. An electronic settlement method of a terminal using a communication network,
The terminal acquiring image information through a first camera;
Determining whether a first event for adding a product to a wish list based on the image information has occurred;
If the first event is generated as a result of the determination, the terminal tracks the direction of the user's gaze using the pupil image included in the image information;
Identifying the product of the at least one item corresponding to the direction of the user's gaze; And
And the terminal adds the identified goods to the wish list. 13. The method of claim 12,
Determining whether a second event for purchasing a product added to the wish list is generated by the terminal based on the image information; And
If it is determined that the second event has occurred, the terminal transmits user identification information for identifying the user to the service device and product identification information for identifying the product included in the wish list, Further comprising the step of: A computer-readable recording medium storing a program for executing the electronic payment method according to claim 12 or claim 13.

Images