KR20120007300A - Method and system for e-commerce security using virtual input devices-based on augumented reality - Google Patents

Abstract

PURPOSE: A method for securing e-commerce by encoding a virtual input device based on augmented reality and a system thereof are provided to enable only a user to use a virtual input device based on augmented reality, thereby preventing keyboard input or memory hacking. CONSTITUTION: A virtual object coordinate generating unit(910) generates coordinates of the virtual objects. A transmission unit(920) transmits the coordinates of the virtual objects. A receiving unit(930) receives the coordinate of a virtual object selected based on the coordinates. A virtual object identifying unit(940) identifies the selected virtual object by referring to the coordinates. A virtual object coordinate generating unit randomly generates the coordinates of the virtual objects.

Description

Electronic transaction security method and system using augmented reality-based virtual input device encryption {METHOD AND SYSTEM FOR E-COMMERCE SECURITY USING VIRTUAL INPUT DEVICES-BASED ON AUGUMENTED REALITY}

Electronic transaction security method and system using augmented reality-based virtual input device encryption {METHOD AND SYSTEM FOR E-COMMERCE SECURITY USING VIRTUAL INPUT DEVICES-BASED ON AUGUMENTED REALITY}

Recently, as electronic transactions are activated through various communication networks such as Internet commerce, security-related accidents occur due to payment, and preventing such occurrences has emerged as an important problem. In particular, such problems are mostly caused by computer terminals used during electronic transactions, and the representative problems caused by computer terminals are personal information caused by hacking and derby site operations, and personal by acquaintances. Unauthorized use of information.

In the case of hacking, when the user's computer terminal is connected to a communication network such as the Internet, the computer security network is forcibly breached by a specific hacker and the user's data is stored in the hacker's computer terminal, or information being input through the computer terminal is hacker It is generated by collecting and using. Such information mainly includes cookies existing on a computer terminal or personal information unknowingly stored by a user. The information is easily collected by a hacker, and the user does not know whether or not to collect the information, thereby providing free space for use by the hacker. Done.

Similarly, dummy sites and virus programs can damage individuals. The dummy site is a site similar to the site used by the user. The user transmits the user's personal information to the dummy site, and the dummy site operator can collect the user's personal information and use it for hacking. In addition, virus programs are similarly hidden in the user's computer terminal and collect personal information at the moment the user enters personal information and supply it through a specific route on the Internet so that a third party can collect the user's personal information. That's how.

In addition, accidents caused by acquaintances are problems caused by family mainly children using electronic transactions without parental consent using the personal information of parents, and there are attempts to improve this by adding a personal verification process, but the incidence of accidents is still high. It becomes a problem.

These problems usually occur at the moment when a user enters personal information to use an electronic transaction, rather than aiming for a security program provided by a financial company or an electronic trading owner. Therefore, the situation with the user's attention is urgently required to devise a method for preventing this.

The present invention is to solve the above problems by inputting personal information using an encrypted virtual input device based on mobile augmented reality, even if important personal information such as password is leaked can ensure the safety of the user's electronic transactions It is to provide an electronic transaction security method and system.

It is still another object of the present invention to provide an electronic transaction security method that can securely protect a user's information even if the communication between the server and the terminal is leaked.

The present invention provides a virtual object coordinate generation unit for generating coordinates of a plurality of virtual objects, a transmission unit for transmitting the generated coordinates of the virtual objects to the terminal, from the terminal receives the coordinates of the virtual object selected by the user based on the coordinates It provides a server for the electronic transaction security comprising a receiving unit, and a virtual object identification unit for identifying the virtual object selected by the user with reference to the received coordinates.

According to an aspect of the present invention, a receiver for receiving coordinates of a plurality of virtual objects from a server, a camera unit for capturing an image, an augmented reality processor for displaying the virtual object on the photographed image with reference to the coordinates, the displayed virtual A user input receiver configured to receive information about a virtual object selected by a user based on the object; And a transmitter for transmitting the coordinates of the virtual object selected by the user to the server.

According to another aspect of the present invention, a reference for generating a look-up table having a subset of key sets having randomly arranged elements as an input key value of a virtual input device. A codebook generator which generates coordinates of a table generator and a plurality of virtual objects corresponding to the elements, and configures a codebook with the coordinates of the generated virtual objects, and an indicator for designating a specific subset of the reference table and the reference table ( indicator; and a transmitter for transmitting the codebook to the terminal, a receiver for receiving coordinates of the virtual object selected by the user based on the codebook, the reference table and the reference table subset indicator, and the received virtual object. A server for electronic transaction security is provided that includes a virtual object identifier that identifies a virtual object selected by the user with reference to coordinates.

According to another aspect of the present invention, an indicator for designating a reference table and a specific subset of the reference table having a key set of an input key of the virtual input device as an element from the server and a randomly arranged key set as an element Receiving unit for receiving the codebook consisting of the coordinates of the plurality of virtual objects corresponding to the camera unit for photographing the image, the codebook, reference table and the indicator of the subset of the reference table to display the virtual object on the photographed image An augmented reality processing unit, a user input receiving unit for receiving the coordinates of the virtual object selected by the user with reference to the displayed virtual object, a terminal for electronic transaction security including a transmission unit for transmitting the coordinates of the virtual object selected by the user to the server Is provided.

According to another aspect of the present invention, generating a reference table having a key set of an input key value of a virtual input device as an element and a subset of a key set randomly arranged, wherein a plurality of virtual objects corresponding to the element are generated. Generating coordinates and constructing a codebook with the coordinates of the generated virtual objects, sending an indicator designating the reference table and a specific subset of the reference table and the codebook to a terminal, from the terminal to the codebook and the reference And receiving coordinates of the selected virtual object based on a table and a reference table subset indicator, and identifying the virtual object selected by the user with reference to the coordinates of the received virtual object.

According to yet another aspect of the present invention, an indicator for specifying a specific subset of a reference table and a reference table having an input key value of a virtual input device as an element from the server and a subset of a key set randomly arranged in the element, and the element; Receiving a codebook comprising coordinates of a plurality of corresponding virtual objects, photographing an image, displaying the virtual object on the photographed image by referring to the codebook and indicators of the reference table and a subset of the reference table, An electronic transaction security method is provided, comprising: receiving coordinates of a virtual object selected by a user with reference to the displayed virtual object, and transmitting coordinates of the virtual object selected by the user to the server.

According to the present invention, by using an augmented reality-based virtual input device, only the user can use the input device. Through this, it prevents transaction accidents such as computer keyboard input and memory hacking and prevents unauthorized use of user personal information by acquaintances, thereby ensuring the safety of users' electronic transactions.

According to the present invention, it is possible to prevent hacking that may occur during the transmission process between the server and the terminal, and to prevent hacking that may occur during the terminal keyboard input process. In addition, it is possible to prevent hacking that may occur due to the leakage of data stored in the terminal, it is possible to prevent the hacking of the leakage of personal information by the dummy site and acquaintances, the user can safely perform electronic transactions.

According to the present invention, a user familiar with the existing input device by providing a virtual input device similar to the existing input device can use the conventional key input method as it is and can easily learn a method of use.

1 is a diagram illustrating the concept of an electronic transaction security method according to the present invention.
2 is a diagram illustrating an electronic transaction security method using an augmented reality technique.
3 is a diagram illustrating the concept of a virtual input device according to the present invention.
4 is a diagram illustrating that a coordinate of a virtual object changes with time according to another embodiment of the present invention.
5 is a flowchart illustrating a step-by-step method for e-commerce security according to an embodiment of the present invention.
6 is a flowchart illustrating a step-by-step method for e-commerce security using a codebook and a reference table according to another embodiment of the present invention.
FIG. 7 illustrates mapping a virtual object using a codebook and a lookup table according to an embodiment of the present invention.
8 is a diagram illustrating a correspondence relationship between a reference table indicator and a codebook.
9 is a block diagram showing the structure of a server that does not use a look-up table in accordance with one embodiment of the present invention.
10 is a block diagram showing the structure of a server using a lookup table according to another embodiment of the present invention.
11 is a block diagram showing the structure of a terminal according to an embodiment of the present invention.
12 is a flowchart illustrating a step-by-step method for securing an electronic transaction of a server that does not use a reference table according to an embodiment of the present invention.
13 is a flowchart illustrating a step-by-step method for securing an electronic transaction of a terminal that does not use a reference table according to another embodiment of the present invention.
14 is a flowchart illustrating a step-by-step method for e-commerce security of a server using a look-up table according to another embodiment of the present invention.
15 is a flowchart illustrating a step-by-step method for electronic transaction security of a terminal using a reference table according to another embodiment of the present invention.

1 is a diagram illustrating the concept of an electronic transaction security method according to the present invention.

The electronic transaction security system according to the present invention includes a server for electronic transaction security and a terminal for electronic transaction security. Hereinafter, in the present specification, simply referred to as 'server' and 'terminal'.

The server may encode the number or character 111 into the coordinates 112 by using an encoder, that is, an encoder 110. For example, the server may encode the number '1' as the coordinates '1, -2, 3', or encode the letter 'ㄱ' as the coordinates '-2, -1.5, -0.5'. The relationship may be expressed as in Equation 1 below.

[Equation 1]

는 입력된 문자에 대한 좌표를 나타낸다.In Equation 1

Indicates the coordinates for the entered character.

Equation 1 represents an embodiment in which the encoder converts input characters to generate coordinates for the characters, but according to another aspect of the present invention, the encoder 110 may perform a similar operation with respect to numbers and alphabets.

The server sends the coordinates 112 to the terminal, not the numbers or letters 111. The terminal receives the coordinates 121. According to one side, the terminal may display a number or letter 111 corresponding to the coordinates 112 on the screen of the terminal using an augmented reality technique.

According to another aspect, the server may transmit a codebook including an indicator designating a specific subset of the lookup table having the input key value of the virtual input device as an element and the coordinates of the plurality of virtual objects to the terminal. In addition, the server may additionally transmit the lookup table to the terminal. The terminal may display the virtual objects on the screen of the terminal in the form of a virtual input device using an augmented reality technique using a reference table, a subset indicator of the reference table, and a codebook. In this case, the terminal may map a virtual object having a specific number or a specific character to coordinates by referring to a subset corresponding to the indicator, and display the virtual object having a specific number or a specific character by referring to the mapped coordinate.

The user of the terminal selects at least one virtual object from among the virtual objects displayed on the screen of the terminal using the augmented reality technique. The terminal transmits the coordinates of the virtual object selected by the user to the server.

The server receives the coordinates of the virtual object selected by the user, and a number or letter corresponding to the virtual object selected by the user in the coordinates 121 of the virtual object encoded using the decoder, that is, the decoder 120. Decode at 122.

The server decodes the coordinates 121 into numbers or letters 122 using the decoder 120. The relationship may be expressed as in Equation 2 below.

[Equation 2]

는 문자에 대한 좌표를 나타낸다.In Equation 2,

Represents the coordinates for the character.

Equation 2 represents an embodiment in which the decoder decodes the encoded coordinates for the character to restore the character. However, according to another aspect of the present invention, the decoder 120 may perform a similar operation with respect to numbers and alphabets.

According to the present invention, the terminal and the server transmit the coordinates 112 and 121 corresponding to the numbers 111 and 122 instead of the specific numbers 111 and 122. Therefore, even if the hacker hacks the coordinates 112 and 121, if the hacker does not know the correspondence between the numbers 111 and 122 and the coordinates 112 and 121 in detail, the hacker cannot know the number transmitted by the terminal. Therefore, the user can transmit the numbers safely without fear of hacking.

In addition, when the terminal and the server use the reference table, the terminal uses the reference table to configure the virtual input device. That is, if the hacker does not have a reference table, the hacker cannot construct a virtual input device. In this case, the hacker cannot correctly enter an ID or password for hacking the user's personal information. Therefore, even if the user's ID and password are exposed, safety in electronic transactions is ensured.

2 is a diagram illustrating an electronic transaction security method using an augmented reality technique.

According to an embodiment, the terminal 200 receives the coordinates of the virtual object 250 from the server. The terminal 200 may display the virtual object 250 on the screen 290 in consideration of the position, the direction of the terminal 200, the position of the marker 240, the coordinates of the virtual object 250, and the like.

(260), 마커(240)로부터 가상 객체(250)까지의 방향 벡터를

(270), 단말기(200)로부터 가상 객체(250)까지의 방향 벡터를

(280)라고 한다면, 세 벡터들 간에는 하기 수학식과 같은 관계가 성립한다.
The direction vector from the marker 240 to the terminal 200

260, the direction vector from the marker 240 to the virtual object 250

270, the direction vector from the terminal 200 to the virtual object 250

If (280), the relationship between the three vectors, such as the following equation holds.

[Equation 3]

The terminal 200 may calculate the coordinates of the virtual object according to Equation 3 and calculate a position on the screen 290.

According to an embodiment, the terminal 200 captures a screen around the marker 240. The terminal 200 calculates the distance and direction between the terminal 200 and the marker 240. The terminal 200 calculates the position of the marker 240 on the screen in consideration of the distance and the direction 260 between the terminal 200 and the marker 240.

The terminal 200 displays the virtual objects 293 and 292 on the screen 290 using the coordinates of the virtual object 250. According to one side, the coordinates of the virtual object received by the terminal 200 may be the coordinates of the virtual object 250 based on the marker 240 or the coordinates of the virtual object 250 based on the terminal 200. have.

According to another embodiment, the terminal 200 may receive a lookup table from the server. The lookup table is a set of virtual objects constituting the virtual input device, and the lookup table includes information on a mapping relationship between the virtual object and the coordinates of the virtual object. The terminal 200 may receive the coordinates of the virtual object and determine the value of the virtual object with reference to the reference table. In this case, the terminal 200 may display the virtual object having the determined value in the coordinates of the received virtual object. A codebook is a set having an element corresponding to a coordinate corresponding to a virtual object included in a reference table as a codeword.

3 illustrates a concept of a virtual input device according to an embodiment of the present invention.

3A is a diagram of an embodiment in which a reference table is not used.

The terminal receives the coordinates of the virtual objects 320, 321, 322, and 323 from the server.

The terminal may photograph an environment around the terminal using a camera.

The terminal may select a marker from the captured images. 3A illustrates an embodiment in which a coin 310 is selected as a marker among images captured by the terminal.

The terminal maps the coordinates of the received virtual objects 320, 321, 322, and 323 to the values of the virtual objects 320, 321, 322, and 323 by using a method agreed with the server. For example, the terminal may map the coordinates of the first received virtual object to the value '0' of the virtual object, and map the coordinates of the second received virtual object to the value '1' of the virtual object. have.

The terminal may display the virtual object having the mapped value in the coordinates of the received virtual object.

According to an embodiment, the coordinates of the virtual objects 320, 321, 322, and 323 are three-dimensional coordinates and may be displayed in a rectangular coordinate system, a cylindrical coordinate system, a spherical coordinate system, and the like. In addition, the position of each virtual object 320, 321, 322, 323 may be displayed in a two-dimensional coordinate system or the like indicating the horizontal or vertical of the screen. In this case, in order to display the virtual object on the screen of the terminal, the terminal may calculate the position on the screen of the virtual object based on the coordinates of the virtual object.

For example, the coordinates of the virtual objects 320, 321, 322, and 323 that the terminal 300 receives from the server may be relative coordinates based on the marker 320. The terminal calculates a position on the screen of the virtual objects 320, 321, 322, and 323 using the relative coordinates of the virtual objects 320, 321, 322, and 323. If the coordinates of the virtual object 323 are lower than the eye height of the user, the virtual object 323 may be located at the bottom of the screen as shown in FIG.

3B illustrates an embodiment in which the terminal maps the coordinates of the virtual object and the value of the virtual object using a reference table.

The terminal may select a marker from the captured images. In FIG. 3B, an example in which the terminal photographs the reference table 330 and selects the reference table 330 as a marker is illustrated.

The terminal receives the coordinates of the virtual objects 340, 341 and 342 from the server, and the terminal refers to the reference table and sets the coordinates of the virtual objects 340, 341 and 342 to the values of the virtual objects 340, 341 and 342. Map it. In this case, since each user may refer to a different reference table, even when different users receive the same coordinates, values of different virtual objects 340, 341, and 342 may be mapped.

Even if a hacker hacks the communication between the terminal and the server, you must refer to the reference table to know the communication between the terminal and the server. Therefore, even when the coordinates of the virtual objects 340, 341, and 342 between the terminal and the server are hacked, if the reference table is not exposed, the user's communication contents are kept confidential.

According to one side, the terminal may play the reference table and analyze the photographed screen to recognize the contents of the reference table. According to one side, the reference table may describe binary information in a form that the terminal can recognize, such as a QR code. The terminal may recognize the contents of the reference table based on the binary information described in the reference table.

Referring to FIG. 3B, the server generates coordinates of the virtual object in the form of an input device such as a keyboard and a keypad, and the terminal refers to the coordinates of the virtual object and the reference table of FIG. A virtual input device such as). The user selects at least one or more virtual objects by manipulating the virtual input device.

According to one side, the user may select a virtual object by pressing a finger or a stylus pen on the position where the virtual objects 320, 321, 322, 323, 340, 341, and 342 are displayed on the screen. Alternatively, the terminal may photograph a user's finger movement with a camera and analyze the photographed image to determine whether the user selects a specific virtual object.

The terminal may transmit the coordinates of the virtual object selected by the user to the server.

4 is a diagram illustrating that a coordinate of a virtual object changes with time according to another embodiment of the present invention.

In FIG. 4, seven virtual objects 431, 432, 433, 434, 435, and 436 are displayed on the screen 410 of the terminal 400 based on the marker 420. According to an embodiment, the terminal 400 receives only initial coordinates of the virtual objects 430, 431, 432, 433, 434, 435, and 436 from the server, and the virtual objects 430, 431, The coordinates of 432, 433, 434, 435, and 436 may be changed. In this case, the terminal 400 may change the coordinates of each virtual object 430, 431, 432, 433, 434, 435, 436 according to a predetermined rule.

If the coordinates of each virtual object 430, 431, 432, 433, 434, 435, 436 are changed, the position on the screen 410 of each virtual object 430, 431, 432, 433, 434, 435, 436 Is also changed.

As a simple example, the virtual objects 430, 431, 432, 433, 434, 435, and 436 displayed on the screen may rotate about the marker once per minute.

The terminal 400 may transmit the time point at which the user selects the virtual object and the coordinates of the virtual object selected by the user at the time point to the server. If the coordinates of the virtual objects 430, 431, 432, 433, 434, 435, 436 are changed according to a predetermined rule, the server may select the virtual object at the time when the user selects the virtual object 430, 431, 432, Based on the coordinates 433, 434, 435, and 436, the initial coordinates of the virtual object selected by the user may be inverted. The server may identify the virtual object selected by the user based on the initial coordinates of the inverted virtual object.

According to the embodiment shown in FIG. 4, the coordinates of each virtual object virtual object 430, 431, 432, 433, 434, 435, 436 are changed over time. In this case, the server may determine whether the coordinates of the virtual object transmitted from the terminal 400 are hacked by determining whether the point of time when the user selects the virtual object and the coordinates of the virtual object at that time correspond to each other. . For example, when the coordinates of the virtual object received by the server do not correspond to the point in time at which the user selects the virtual object, the server may determine that the authentication request by the hacker does not perform authentication for the user. In addition, the server may change the rules for initial coordinates and coordinate changes of the virtual object each time. Therefore, the stability of user authentication is further improved.

5 is a flowchart illustrating a step-by-step method for e-commerce security according to an embodiment of the present invention.

In operation 530, the server 520 generates coordinates of the virtual object to be displayed on the screen of the terminal 510. For example, when three virtual objects are displayed on the screen of the terminal 510, the server 520 may set the coordinates of the first virtual object to {x1, y1, z1} and the coordinates of the second virtual object to {x2. , y2, z2}, and coordinates of the third virtual object may be generated as {x3, y3, z3}.

In operation 531, the server 520 transmits coordinates of the virtual object to the terminal 510.

In operation 540, the terminal 510 photographs an image around the terminal 510 using a camera. In addition, the terminal 510 displays the virtual object on the screen of the terminal using an augmented reality technique. That is, the terminal 510 sets a specific position as a marker among the captured images and calculates the position of the virtual object on the terminal screen by referring to the coordinates of the virtual object received from the server 520. The terminal 510 displays the virtual object at a specific position on the screen of the terminal 510.

In operation 550, the user selects a virtual object displayed on the screen of the terminal 510. According to one side, the user may select a virtual object displayed on the touch screen of the terminal 510 using a finger, a stylus pen, or the like. According to another aspect, the terminal 510 may recognize and track a movement of a user's finger using a camera. When the user's finger reaches a specific position in the air corresponding to the virtual object, the terminal 510 may determine that the user selects the specific virtual object.

The terminal 510 receives information about the virtual object selected by the user. For example, when the user selects the first virtual object, the terminal 510 may receive a location on the screen of the first virtual object and identify that the virtual object selected by the user is the first virtual object.

In operation 551, the terminal 510 transmits the coordinates of the virtual object selected by the user to the server 520. For example, when the user selects the first virtual object, the terminal 210 may transmit the coordinates {x1, y1, z1} to the server 520.

The server 520 identifies the virtual object selected by the user using the coordinates of the virtual object transmitted by the terminal 510. That is, when the server 520 receives the coordinates of {x1, y1, z1} from the terminal, the server 520 may determine that the user has selected the first virtual object.

According to an embodiment, the server 520 may authenticate the user and the personal information of the user by using the identified virtual object. For example, the server 520 is connected to a subscriber database that stores personal information such as user ID (ID), password, social security number, i-pin, phone number, etc. registered by the user when the user registers at the transaction site, and the identified virtual The objects can be compared with the user's personal information (eg, a password). If the identified virtual objects match the user's personal information, the server 520 may authenticate the user and the user's personal information. According to the present invention, the server 520 and the terminal 510 transmit the coordinates of the virtual object, not the virtual object itself. When the present invention is applied to electronic commerce or the like, the coordinates of the virtual object may be randomly generated whenever the user performs electronic commerce. That is, the coordinates of the virtual object may be different each time.

According to the present invention, even when a hacker hacks data transmission between the server 520 and the terminal 510, only the coordinates of the virtual object are leaked, not the virtual object. Since the coordinates of the virtual object are newly generated each time, the leaked virtual object is no longer useful. Therefore, the user can authenticate himself or perform e-commerce with confidence without the risk of hacking by a hacker.

6 is a flowchart illustrating a step-by-step method for e-commerce security using a codebook and a reference table according to another embodiment of the present invention.

In operation 630, the server 620 generates a reference table having an input key value of the virtual input device as an element. According to one side, the reference table may have input key values of the plurality of virtual input devices as elements. In this case, the input key values of the specific virtual input device included in the reference table may be divided into one subset. According to an embodiment, input key values included in a specific subset may be arranged in a random order.

The lookup table includes information on the mapping relationship between the coordinates of the virtual object transmitted by the server 620 and the value of the virtual object. The value of the virtual object may be an input key value of the virtual input device. A mapping relationship between the coordinates of the virtual object and the value of the virtual object will be described in detail later with reference to FIG. 7.

In operation 640, the server 620 generates coordinates of at least one or more virtual objects, and constructs a codebook using the generated virtual objects. According to one side, the server 620 may randomly generate the coordinates of the virtual objects.

In operation 641, the server 620 transmits the codebook to the terminal 610. In addition, the server 620 may transmit to the terminal 610 an indicator for specifying a subset to be used by the terminal 610 and the server 620 to map a virtual object among a plurality of subsets included in the lookup table. . The server 620 may transmit a lookup table to the terminal 610.

In step 650 the terminal 610 receives the codebook and the indicator of the particular subset from the server 620. According to one side, the user of the terminal 610 may hold a reference table in the form of a security card. In this case, the terminal 610 may photograph the reference table by using the camera and recognize the reference table by analyzing the photographed image. According to one side of the reference table may store the contents of the reference table in a binary form that can be recognized by the terminal 610, such as a QR code.

According to one side, the terminal 610 may receive a reference table from the server 620.

According to another aspect, the reference table may be issued directly to the user of the terminal 610. The user may receive a lookup table in the form of a security card from a bank or the like. The terminal 610 may photograph the reference table in the form of a security card, and recognize the reference table by analyzing the photographed image. In this case, the terminal 610 may use the reference table in the form of a security card as a marker for displaying the virtual object.

In operation 660, the virtual object is displayed using an augmented reality technique. According to one side, the terminal 610 captures an image, and displays the virtual object in the captured image by referring to the codebook, the reference table and the subset indicator of the reference table. A configuration in which the terminal 610 displays the virtual object in the captured image with reference to the codebook and the reference table and the subset indicator of the reference table will be described in detail with reference to FIG. 7.

In operation 661, the user selects a virtual object displayed on the screen of the terminal 610, and the terminal 610 receives coordinates of the virtual object selected by the user.

In operation 662, the terminal 610 transmits the coordinates of the virtual object selected by the user to the server 620.

In operation 670, the server 620 receives the coordinates of the virtual object selected by the user.

In step 680, the server 620 identifies the coordinates of the virtual object selected by the user with reference to the reference table and the codebook.

In the embodiment illustrated in FIG. 6, the terminal 610 maps coordinates of the virtual object to input key values of the virtual input device with reference to the reference table. In addition, the server 620 identifies the value of the virtual object mapped to the virtual object selected by the user with reference to the reference table. Therefore, the server 620 and the terminal 610 should have the same reference table.

If the hacker hacks the coordinates of the virtual object transmitted between the server 620 and the terminal 610, and there is no reference table, the hacker may input the value or the virtual input device of the virtual object transmitted between the server 620 and the terminal 610. The input value of cannot be identified. Therefore, even when the coordinates of the virtual object transmitted between the terminal 610 and the server 620 are hacked, the contents of the data to be transmitted by the user are guaranteed to be confidential.

FIG. 7 illustrates mapping a virtual object using a codebook and a lookup table according to an embodiment of the present invention.

In the embodiment illustrated in FIG. 7, the order of coordinates included in the codebook and the value of the virtual object correspond at random. The terminal and the server store the order of the coordinates and the value of the virtual object in the reference table, and determine the value of the virtual object corresponding to the coordinate by referring to the reference table.

The vertical axes 760, 770, and 780 of the reference table indicate the indicators of the subsets 710, 720, and 730 used by the terminal and the server, and the horizontal axis of the reference table indicates the order of the coordinates. According to an embodiment of the present disclosure, the server may determine a subset to be used in an electronic transaction, and transmit an indicator indicating the determined subset to the terminal.

If the server and the terminal use the first subset 760, the terminal can refer to the first row 760 of the lookup table. When the server transmits the first coordinate 711 of the first codebook 710, the terminal refers to the reference table that the value of the virtual object corresponding to the first coordinate 711 is '1'. It can be seen that the value of the virtual object corresponding to the two coordinates 712 is '2' and the value of the virtual object corresponding to the transmitted third coordinate 713 is '3'.

The terminal may display the virtual object corresponding to the coordinate in the coordinates of the virtual object received from the server. That is, the terminal displays the value '1' of the virtual object at the position of the first coordinate 711, displays the value '2' of the virtual object at the position of the second coordinate 712, and displays the third coordinate 713. The value '3' of the virtual object may be displayed at the position of. The virtual objects displayed at each location may constitute a virtual input device as shown in (b) of FIG. 3. The value of the virtual object corresponds to the input value of the virtual input device. That is, when the user tries to input '1', the user may select a virtual object located at the first coordinate 711. The terminal receives the first coordinate 711 and transmits the received first coordinate 711 to the server. The server may know that the user has selected a virtual object representing '1' by referring to the reference table.

In the case where the server and the terminal use the second subset 770, the terminal may refer to the second row 770 of the lookup table. When the server transmits the first coordinates 721 of the second codebook 720, the terminal may know that the value of the virtual object corresponding to the first coordinates 721 is '6' with reference to the reference table. Referring to the first row 770 of the lookup table, the value of the virtual object corresponding to the transmitted second coordinate 722 is' 2 ', and the value of the virtual object corresponding to the transmitted third coordinate 723 is' 5 '.

In the case where the server and the terminal use the third subset 780, the terminal may refer to the third row 780 of the lookup table. In this case, the value of the virtual object corresponding to the first coordinate 731 of the third codebook 730 is '3', and the value of the virtual object corresponding to the second coordinate 732 is '2', The value of the virtual object corresponding to three coordinates 733 is '4'.

In the case where the server and the terminal use the first subset 760 and the second codebook 720, the terminal refers to the first row 760 of the lookup table and the coordinates 721, 722, of the second codebook 720. 723 is mapped to virtual objects of '1', '2', and '3', respectively. Even if the same virtual object is used, the terminal can reinforce security by frequently changing coordinates mapped according to the transmitted codebook. In this case, the server may identify which codebook the coordinates received from the terminal belong to to identify the virtual object corresponding to the received coordinates. Accordingly, the server may receive codebook indicator information on the codebook to which the corresponding coordinate belongs from the terminal.

According to one side, the terminal may determine a subset to be used for electronic transaction security, from the reference table. For example, if the terminal uses the second subset 770 and the first codebook 710, the terminal refers to the second row 770 of the lookup table, and the coordinates 711, of the first codebook 710. 712 and 713 are mapped to virtual objects of '6', '2' and '5', respectively.

That is, even though this is the same virtual object coordinate, the mapped virtual object value may change from time to time according to the transmitted subset indicator, thereby enhancing security. In this case, since the server needs to know which virtual object belonging to which subset the coordinates received from the terminal are mapped, the server can also receive indicator information of the subset to which the virtual object mapped to the corresponding coordinate belongs.

Referring to FIG. 7, even if a hacker or acquaintance wants to acquire and use user's personal information, if the user does not have a reference table, the virtual input device may not be configured as augmented reality correctly according to the element arrangement of the subset determined by the server. . Therefore, the coordinates of the virtually mapped virtual object are transmitted to the server, and authentication may be rejected. According to the present invention, even if the user's personal information is leaked because the other person can not use the safety of the electronic transaction is guaranteed at the source.

8 is a diagram illustrating a correspondence relationship between a lookup table indicator and a codebook indicator.

The server may generate a lookup table 810 including a plurality of subsets, and generate a codebook with reference to the generated lookup table. According to one side, the server may generate one of the codebooks 821, 822, 823 with reference to a reference table among the plurality of codebooks 820 that can be generated.

The server selects any subset from the lookup table, and transmits an indicator indicating the selected subset and information on the generated codebook to the terminal.

The terminal may generate a virtual input device using information on the subset and codebook selected by the server, and receive an input from a user using the generated virtual input device.

According to one side, various virtual input devices may be generated according to a combination of a subset and a codebook selected by the server. For example, when the first subset 811 and the first codebook are used, the terminal may generate the Hangul keyboard shown in FIG. 3B as a virtual input device. According to another aspect, when the second subset 812 and the first codebook 821 are used, the terminal generates an English keyboard as a virtual input device, and the third subset 813 and the first codebook 821 are generated. When used, the terminal can generate a Japanese keyboard as a virtual input device.

According to another aspect, when the first subset 811, the second codebook 822, or the third codebook 823 are used, the terminal virtually inputs the 2-Bul Hangul keyboard shown in FIG. 3B. Can be created with the device. That is, the terminal may generate the same virtual input device using different combinations of the subset and the codebook. For example, when the first subset 811 and the third codebook 823 are used, the terminal uses a Korean keyboard having a key arrangement different from that of the Korean keyboard shown in FIG. 3B as a virtual input device. Can be generated. For example, when the first subset 811 and the first codebook 821 are used, the input values of the second column of the Hangul keyboard are 'ㅂ, ㅈ, c, a, ...' or the first subset 811 When the third codebook 823 is used, the input values of the second column of the Hangul keyboard may be 'ㅂ, ㅈ, c, a, ....

In this case, the coordinates of the virtual object having the same input value are different. Therefore, even when the terminal receives the same input value from the user, the coordinates of the virtual object transmitted by the terminal to the server may be different from the Korean keyboard when the first subset 811 and the first codebook 821 are used. Can be.

According to another aspect, when the first subset 811 and the second codebook 822 are used, the terminal uses the virtual keypad shown in FIG. 3A or the third subset 813 and the second. In the case where the codebook 822 is used, the terminal may generate a keypad of a form that changes according to time illustrated in FIG. 4 as a virtual input device.

Referring to the embodiment shown in Figure 8, the terminal has the same reference table as the server, and generates a virtual input device based on the codebook generated by the server. The terminal, in particular, receives an indicator designating a particular subset from the server and selects a subset containing information on the key array of the particular virtual input device according to the indicator. Therefore, even if the hacker hacks the communication content between the terminal and the server and recognizes the contents of the indicator and the codebook, the hacker cannot create the virtual input device if the reference table is not known.

If the hacker cannot create the virtual input device, even if the hacker knows the specific person's password, the coordinates of the virtual object corresponding to the password cannot be determined. That is, unless the reference table is disclosed to the hacker, even if the contents of the indicator or codebook transmitted from the server to the terminal are hacked, the contents of the data to be transmitted by the user are kept confidential.

9 is a block diagram showing the structure of a server according to an embodiment of the present invention. The server 900 according to the present invention includes a virtual object coordinate generator 910, a transmitter 920, a receiver 930, a virtual object identifier 940, and a user authenticator 950.

The virtual object coordinate generator 910 generates coordinates of the plurality of virtual objects. According to an embodiment, the coordinates of the virtual objects are three-dimensional coordinates and may be any one of a rectangular coordinate system, a cylindrical coordinate system, and a spherical coordinate system.

According to an embodiment, the virtual object coordinate generator 910 may randomly generate new coordinates of the virtual object whenever the server 900 authenticates the user.

The transmitter 920 transmits the coordinates of the generated virtual objects to the terminal 960.

The terminal 960 displays the virtual objects on the screen of the terminal using the coordinates of the virtual objects. According to an embodiment, the terminal may photograph an image using a camera and display the virtual object on the screen with reference to the coordinates of the virtual objects. The user selects a virtual object displayed on the screen. The terminal transmits the coordinates of the virtual object selected by the user to the server 800.

The receiver 930 receives the coordinates of the virtual object selected by the user.

The virtual object identification unit 940 identifies the virtual object selected by the user by referring to the coordinates of the received virtual object. For example, the virtual object identification unit 940 may determine that the virtual object selected by the user is '1' when the coordinate of the virtual object selected by the user is {x1, y1, z1}.

The user authenticator 950 authenticates the user based on the virtual object selected by the user. For example, the user authenticator 950 may store a password for the user. When the virtual object selected by the user matches the password for the user, the user authenticator 950 may authenticate the user.

According to another embodiment, the virtual object coordinate generator 910 may determine a rule for changing the coordinates. For example, the virtual object coordinate generator 910 may generate a rule for changing the coordinates so that each virtual object rotates clockwise around the marker once per minute.

In this case, the transmitter 920 may additionally transmit a rule for changing the coordinates of the virtual object to the terminal 960. The terminal 960 may change the coordinates of the virtual object according to a rule and change the position of the virtual object on the screen according to the changed coordinates.

The user selects a virtual object to change the location, and the terminal transmits the point of time when the user selects the virtual object and the coordinates of the virtual object to the server 900 at that time.

The virtual object identification unit 940 may authenticate the user based on a time point at which the user selects the virtual object and the coordinates of the virtual object at that time. According to an embodiment, the time point at which the user selects the virtual object and the coordinates of the virtual object at that time point may not correspond to each other. For example, according to the coordinate change rule determined by the virtual object coordinate generator 910, the virtual object may move from the first coordinate to the second coordinate when the user selects the virtual object. However, as received from the terminal 860, the virtual object may remain at the first coordinate. Alternatively, the virtual object may move to the third coordinate. In this case, the virtual object identification unit 940 may determine that the authentication request is caused by a hacker, and may ignore the authentication request from the terminal 960.

10 is a block diagram showing the structure of a server for electronic transaction security using a look-up table according to another embodiment of the present invention. The server 1000 according to the present invention uses a lookup table generator 1010, a codebook generator 1020, a transmitter 1030, a receiver 1040, a virtual object identification unit 1050, and a user authentication unit 1060. Include.

The lookup table generator 1010 generates a lookup table having a subset of a key set having an input key value of a virtual input device as an element. The lookup table may consist of a plurality of key sets. In this case, input key values of each virtual input device may be divided into respective subsets. That is, the input key values included in the specific subset may constitute a specific virtual input device. In this case, the reference table generator 1010 may determine a subset to be used when performing a specific electronic transaction. According to an embodiment, the input key values included in the reference table may be arranged in a random order.

For example, the first key set (first subset) of the plurality of key sets included in the reference table includes input key values in the order of {1,2,3,4 ..}, and the second key set ( The second subset) may include input key values in the order of {6,2,5,1 ...}.

The lookup table contains information on the mapping relationship between the coordinates of the virtual object sent by the server and the value of the virtual object. The value of the virtual object may be an input key value of the virtual input device illustrated in FIG. 3B.

The codebook generator 1020 generates coordinates of at least one or more virtual objects with reference to the reference table, and configures the codebook with the generated virtual objects. The codebook generator 1020 may generate coordinates of the virtual objects by using the encoder described with reference to FIG. 1. According to one side, the codebook generator 1020 may randomly determine the coordinates of the virtual objects included in the codebook for every electronic transaction.

The transmitter 1030 transmits an indicator to the terminal 1070 which designates a codebook and a subset to be used for a specific electronic transaction. Also, the transmitter 1030 may transmit the reference table to the terminal 1070.

The terminal 1070 may display the virtual input device on the screen using a codebook and an indicator. The virtual input device configured with the plurality of virtual objects may be displayed using an augmented reality technique.

According to one side, the transmission unit 1030 transmits a reference table to the terminal 1070, the terminal 1070 may use the reference table received from the server 1000.

According to another aspect, the user may have a reference table in the form of a bank's security card. In this case, the terminal 1070 may photograph the reference table, recognize the photographed image, and use the reference table. In addition, the terminal 1070 may use a reference table in the form of a security card as a marker for displaying the virtual object.

The user inputs data into the terminal using the displayed virtual input device using the augmented reality technique. The user may select a virtual object included in the virtual input device and input data.

The receiver 1040 receives the coordinates of the virtual object selected by the user from the terminal 1070.

The virtual object identification unit 1050 identifies the virtual object selected by the user by referring to the coordinates of the received virtual object. The virtual object identification unit 1050 may identify the virtual object by referring to the lookup table and the subset indicator.

The user authenticator 1060 may authenticate the user or the personal information of the user by using the identified virtual object. The user authentication unit 1060 may compare the value of the identified virtual object with the user's ID, password, social security number, i-pin, phone number, etc., and authenticate the user according to the comparison result.

According to the present invention, the server 1000 and the terminal 1070 transmit the coordinates of the virtual object, not the virtual object itself. Thus, even if a hacker hacks the coordinates of a virtual object, the secret about the data the user wants to transfer is maintained.

In addition, even if the hacker hacks the coordinates of the virtual object transmitted between the server 1000 and the terminal 1070, the hacker cannot identify the value of the virtual object or the input value of the virtual input device if there is no reference table. Therefore, as long as the reference table is not disclosed to the hacker, even if the coordinates of the virtual object transmitted between the terminal 1070 and the server 1000 are hacked, the contents of the data to be transmitted by the user are guaranteed to be confidential.

11 is a block diagram showing the structure of a terminal according to an embodiment of the present invention. The terminal 1100 according to the present invention includes a receiver 1110, a camera unit 1120, an augmented reality processor 1130, a transmitter 1130, a user input receiver 1140, and a transmitter 1150.

The terminal 1100 illustrated in FIG. 11 may perform an electronic transaction using a reference table or may perform an electronic transaction without using a reference table.

First, the operation of the terminal when the electronic transaction is performed without using the reference table will be described.

The receiver 1110 receives coordinates of the virtual objects from the server 1160. According to an embodiment, whenever the server 1160 authenticates a user, the server 1160 may randomly generate virtual object coordinates.

The camera unit 1120 photographs an image around the terminal.

The augmented reality processor 1130 displays the virtual object on the captured image by referring to the coordinates of the virtual object. According to an embodiment, the augmented reality processor 1130 selects a marker from the captured images. The augmented reality processor 1130 calculates positions of the virtual objects in the captured image by referring to the coordinates of the virtual object. According to an embodiment, the coordinates of the virtual object are three-dimensional coordinates and may be displayed in a rectangular coordinate system, a cylindrical coordinate system, a spherical coordinate system, and the like. In addition, the position of each virtual object means a width or length on the terminal screen and may be displayed in a two-dimensional coordinate system or the like.

The augmented reality processor 1130 displays the virtual object on the captured image by using the calculated position.

The user selects a virtual object displayed on the screen of the terminal.

The user input receiver 1140 receives information about the virtual object selected by the user. According to an embodiment, the information about the virtual object received by the user input receiver 1140 may be a location on the screen of the virtual object selected by the user. Alternatively, the user input receiver 1140 may receive the coordinates of the virtual object as information on the virtual object.

The transmitter 1150 transmits the coordinates of the virtual object selected by the user to the server 1160. The server 1160 may identify the virtual object selected by the user using the coordinates of the virtual object selected by the user. The server 1160 may authenticate the user by using the virtual object selected by the user.

According to an embodiment, the receiver 1110 may receive a rule for changing a coordinate of a virtual object. In this case, the augmented reality processor 1130 changes the coordinates of the virtual object according to the rule for changing the coordinates, and changes the position of the virtual object on the screen according to the changed coordinates.

The user input receiver 1140 receives a time point at which the user selects the virtual object, and the transmission unit 1150 transmits a time point at which the user selects the virtual object to the server 1160.

The server 1160 may determine whether the point in time at which the user selects the virtual object and the coordinates of the virtual object correspond to each other according to a rule for changing the coordinates of the virtual object, and may authenticate the user according to the determination result.

Hereinafter, an operation of the terminal when performing an electronic transaction using a reference table will be described.

The receiver 1110 receives an indicator from the server 1160 that designates a specific subset of codebooks and lookup tables. According to one side, the receiver 1110 may receive a reference table from the server 1160.

The lookup table contains the input key value of the virtual input device as an element. When the reference table has input key values of the plurality of virtual input devices as elements, the input key values constituting each virtual input device may be divided into different subsets. That is, the first codebook and the first subset may include input key values constituting the first virtual input device, and the second codebook and second subset may include input key values constituting the second virtual input device. The first codebook and the second subset may include input key values constituting the third virtual input device, and the second codebook and first subset may include input key values constituting the fourth virtual input device.

The codebook also includes the coordinates of the plurality of virtual objects. According to one side, the coordinates of the virtual objects included in the codebook received by the receiver 1110 may be randomly generated whenever an electronic transaction is made.

The camera unit 1120 captures an image.

The augmented reality processor 1130 displays the virtual object on the captured image by referring to the indicators of the subset of the codebook and the reference table.

According to another aspect, the augmented reality processor 1130 may select a marker from the captured image and calculate positions of the virtual objects based on the selected marker.

According to one side, the terminal may play the reference table and analyze the photographed screen to recognize the contents of the reference table. According to one side, the reference table may include binary information in the form that the terminal can recognize, such as a QR code. The terminal may recognize the contents of the reference table based on the binary information included in the reference table.

According to one side, the augmented reality processing unit 1130 refers to the indicator to determine which subset of the reference table to use. The augmented reality processor 1130 maps a virtual object having a specific value to coordinates included in the codebook by referring to a specific subset of the reference table.

The augmented reality processor 1130 may calculate the positions of the virtual objects on the terminal screen with reference to the coordinates of the virtual object.

The augmented reality processor 1130 may display the virtual object on the captured image by using the calculated position. The augmented reality processor 1130 may display the plurality of virtual objects on the screen of the terminal such that the plurality of virtual objects constitute the virtual input device illustrated in FIG. 3B.

The user selects at least one virtual object from among a plurality of virtual objects constituting the virtual input device by referring to the virtual object displayed on the screen.

The user input receiver 1140 receives the coordinates of the virtual object selected by the user.

The transmitter 1150 transmits the coordinates of the virtual object selected by the user to the server 1160.

12 is a flowchart illustrating a step-by-step method for securing an electronic transaction of a server that does not use a reference table according to an embodiment of the present invention.

In step 1210, the server generates the coordinates of the virtual objects. According to an embodiment, whenever the server performs user authentication, the server may randomly determine the coordinates of the virtual objects.

In operation 1220, the server transmits the coordinates of the determined virtual objects to the terminal.

The terminal displays the virtual objects on the screen of the terminal using the coordinates of the virtual objects. According to an embodiment, the terminal may photograph an image using a camera and display the virtual object on the screen with reference to the coordinates of the virtual objects. The user selects a virtual object displayed on the screen of the terminal.

In operation 1230, the server receives coordinates of the virtual object selected by the user from the terminal.

In operation 1240, the server identifies the virtual object selected by the user with reference to the coordinates received from the terminal.

The server may authenticate the user based on the identified virtual object. According to an embodiment, the server may store the user's password. The server may determine whether the identified virtual object and password match, and authenticate the user if the virtual object and password match each other.

According to another embodiment, in step 1210, the server determines a rule for changing the coordinates of the virtual object as well as the coordinates of the virtual object, and in step 1220, the server may change the rule for changing the coordinates of the virtual object to the terminal. .

The terminal changes the coordinates of the virtual object according to a rule for changing the coordinates of the virtual object and moves the position of the virtual object on the screen.

In operation 1230, the server receives information about a time point when the user selects the virtual object and coordinates of the virtual object selected by the user.

In operation 1240, the server may determine whether there is an intrusion from the hacker based on the information about the time when the user selects the virtual object and the coordinates of the virtual object selected by the user. For example, when the user selects a virtual object and the coordinates of the virtual object do not correspond to each other according to the rules for changing the coordinates of the virtual object, the server determines that the user authentication request is caused by a hacker intrusion, and authenticates the user. You can stop it.

FIG. 13 is a flowchart illustrating a method for securing an electronic transaction of a terminal that does not use a reference table according to another embodiment of the present invention.

The terminal may receive an input related to a user authentication request from a user. In this case, the terminal sends a user authentication request to the server. The server creates a virtual object for user authentication according to the user authentication request.

In operation 1310, the terminal receives coordinates of the plurality of virtual objects from the server. According to an embodiment, the server may randomly generate the coordinates of the virtual objects at every user authentication.

In operation 1320, the terminal photographs an image.

In operation 1330, the terminal selects a marker from the captured images.

In operation 1240, the terminal calculates a position in the images of the virtual objects by referring to the coordinates of the virtual objects. According to an embodiment, the coordinates of the virtual object are three-dimensional coordinates and may be displayed in a rectangular coordinate system, a cylindrical coordinate system, a spherical coordinate system, and the like. In addition, the position of each virtual object means a width or length on the terminal screen and may be displayed in a two-dimensional coordinate system or the like.

In operation 1350, the terminal displays the virtual object on the captured image by using the calculated position.

The user selects at least one virtual object from among the plurality of virtual objects displayed on the image of the terminal.

In operation 1360, the terminal receives information about the virtual object selected by the user. For example, the terminal may receive a location on the screen of the virtual object selected by the user. Alternatively, the terminal may receive the coordinates of the virtual object selected by the user.

In operation 1370, the terminal may transmit the coordinates of the virtual object selected by the user to the server. The server may use the virtual object selected by the user to authenticate the user.

14 is a flowchart illustrating a step-by-step method for e-commerce security of a server using a look-up table according to another embodiment of the present invention.

In step 1410, the server generates a lookup table having an input key value of the virtual input device as an element. According to one side, the reference table may have input key values of the plurality of virtual input devices as elements. In this case, the input key values of the specific virtual input device included in the reference table may be divided into one subset. According to an embodiment, input key values included in a specific subset may be arranged in a random order.

The lookup table contains information on the mapping relationship between the coordinates of the virtual object sent by the server and the value of the virtual object. Since the mapping relationship between the coordinates of the virtual object and the value of the virtual object has been described with reference to FIG. 7, a detailed description thereof will be omitted.

In operation 1420, the server generates coordinates of at least one or more virtual objects, and constructs a codebook using the generated virtual objects. According to one side, the server may randomly generate the coordinates of the virtual objects.

In step 1430, the server transmits the codebook to the terminal. In addition, the server may transmit to the terminal an indicator designating a reference table and a subset of the reference table to be used by the terminal and the server to map the virtual object among the plurality of subsets included in the reference table.

The terminal displays the virtual object on the terminal screen using augmented reality technique using a codebook, a reference table, and a reference table indicator. According to one side, the terminal may implement a virtual input device with a plurality of virtual objects. The user may select at least one virtual object from among a plurality of virtual objects included in the virtual input device.

In step 1440, the server receives the coordinates of the virtual object selected by the user. If the terminal frequently changes the codebook for use in electronic transaction security among the plurality of codebooks, or if the reference table indicator is changed from time to time, the server, along with the coordinates of the virtual object, the codebook indicator of the codebook to which the coordinate belongs, or It can also receive lookup table indicators.

In operation 1450, the server identifies the virtual object selected by the user based on the received coordinates of the virtual object. According to one side, the server may identify the virtual object selected by the user with reference to the codebook and the reference table. In addition, when the terminal changes the codebook to perform electronic transaction security, the server may identify the virtual object selected by the user with reference to the indicator of the codebook used for the electronic transaction security.

In step 1460, the server may authenticate the user based on the identified virtual object. According to one side, the server may determine whether the identified virtual object matches the user's ID, password, social security number, i-pin, etc., and authenticate the user according to the determination result.

15 is a flowchart illustrating a step-by-step method for e-commerce security using a reference table according to another embodiment of the present invention.

In operation 1510, the terminal receives, from the server, a codebook including an indicator designating a specific subset among the plurality of subsets included in the lookup table and coordinates of the plurality of virtual objects. The terminal may also receive a codebook from the server.

The subset has input key values of the plurality of virtual input devices as elements, and includes information on a mapping relationship between the coordinates of the virtual object and the input key values of the virtual input device. In this case, the codebook includes coordinates of virtual objects corresponding to input key values of the virtual input device included in the reference table. According to one side, the coordinates of the virtual objects included in the codebook may be randomly generated every time the electronic transaction is performed.

In operation 1520, the terminal photographs an image using a camera.

In operation 1530, the terminal displays the virtual object using an augmented reality technique. According to one side, the terminal may select a marker from the captured image, and calculate the position of the virtual objects based on the selected marker.

According to one side, the terminal refers to the indicator to determine which subset of the reference table to use. The terminal may map a virtual object of a specific value to coordinates included in the codebook by referring to a specific subset of the reference table. The terminal may calculate the positions of the virtual objects on the screen of the terminal by referring to the coordinates of the virtual object.

The terminal may display the virtual object on the captured image by using the calculated position. According to one side, the terminal may display the plurality of virtual objects on the screen of the terminal such that the plurality of virtual objects constitute the virtual input device shown in FIG.

The user selects at least one virtual object from among a plurality of virtual objects constituting the virtual input device by referring to the virtual object displayed on the screen.

In operation 1540, the terminal receives the coordinates of the virtual object selected by the user.

In operation 1550, the terminal transmits coordinates of the virtual object selected by the user to the server. The server refers to the lookup table and codebook to identify the virtual object selected by the user. The identified virtual object can be used to authenticate the user or the user's personal information.

Method according to an embodiment of the present invention is implemented in the form of program instructions that can be executed by various computer means may be recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

200: terminal
210: terminal screen
220: marker
230, 231, 232, 233, 234, 235, 236: virtual objects

Claims (21)

A virtual object coordinate generator which generates coordinates of the plurality of virtual objects;
A transmitter for transmitting the generated coordinates of the virtual objects to the terminal;
A receiver configured to receive coordinates of the virtual object selected by the user based on the coordinates from the terminal;
A virtual object identification unit for identifying the virtual object selected by the user with reference to the received coordinates
Server for e-commerce security comprising a. The method of claim 1,
The virtual object coordinate generator is a server for randomly generating the coordinates of the virtual objects. The method of claim 1,
The terminal displays the virtual object by referring to the coordinates of the virtual objects in an image photographed using a camera, and receives information on the virtual object selected by the user based on the displayed virtual object. server. Receiving unit for receiving the coordinates of the plurality of virtual objects from the server;
Camera unit for taking an image;
An augmented reality processor configured to display the virtual object on the captured image by referring to the coordinates;
A user input receiver configured to receive information on a virtual object selected by a user based on the displayed virtual object;
Transmitter for transmitting the coordinates of the virtual object selected by the user to the server
Terminal for electronic transaction security comprising a. The method of claim 4, wherein the augmented reality processing unit,
A marker selector for selecting a marker from the photographed image;
A virtual object position calculator configured to calculate a position in the image of the virtual objects with reference to the marker;
An image display unit for displaying the virtual object on the image using the calculated position
Terminal for electronic transaction security comprising a. The method of claim 4, wherein
The virtual object position calculation unit changes the coordinates over time, calculates the position based on the changed coordinates,
The transmission unit is a terminal for electronic transaction security for transmitting the information on the time when the user selected the virtual object to the server. A look-up table generator for generating a look-up table having a key set of randomly arranged elements of the input key value of the virtual input device as a subset;
A codebook generation unit generating coordinates of a plurality of virtual objects corresponding to the element and constituting a codebook with the generated virtual objects coordinates;
An indicator for designating the reference table and a specific subset of the reference table, and a transmitter for transmitting the codebook to the terminal;
A receiver configured to receive coordinates of a virtual object selected by the user based on the codebook, the reference table, and a subset indicator of the reference table from the terminal; And
Virtual object identification unit for identifying the virtual object selected by the user by referring to the coordinates of the received virtual object
Server for e-commerce security, including The method of claim 7, wherein
The codebook generator is a server for e-commerce security to randomly generate the coordinates of the virtual objects. The method of claim 7, wherein
The terminal displays the virtual object by referring to the codebook, the reference table, and the indicators of the reference table on an image photographed using a camera, and receives information on the virtual object selected by the user based on the displayed virtual object. server. The method of claim 7, wherein
User authentication unit for authenticating the user based on the virtual object selected by the user
The server further includes. A reference table having an input key value of a virtual input device as an element, a subset of a key set randomly arranged as an element, an indicator designating a specific subset of the reference table, and coordinates of a plurality of virtual objects corresponding to the element Receiving unit for receiving the codebook from the server;
Camera unit for taking an image;
An augmented reality processor configured to display the virtual object on the photographed image by referring to indicators of the codebook, the reference table, and a subset of the reference table;
A user input receiver configured to receive coordinates of the virtual object selected by the user with reference to the displayed virtual object; And
Transmitter for transmitting the coordinates, reference indicators and codebook indicators of the virtual object selected by the user to the server
Terminal for electronic transaction security, including The method of claim 11,
The coordinates of the virtual objects included in the codebook are randomly generated. The method of claim 11,
The virtual object position calculator changes the coordinates over time, calculates the position based on the changed coordinates,
The transmitter is a terminal for transmitting information about the time when the user selected the virtual object to the server. Generating coordinates of the plurality of virtual objects;
Transmitting coordinates of the generated virtual objects to a terminal;
Receiving coordinates of a virtual object selected by the user based on the coordinates from the terminal; And
Identifying the virtual object selected by the user by referring to the received coordinates
Electronic transaction security method comprising a. Receiving coordinates of the plurality of virtual objects from a server;
Taking an image;
Displaying the virtual object on the captured image by referring to the coordinates;
Receiving information on a virtual object selected by a user based on the displayed virtual object;
Transmitting coordinates for the virtual object selected by the user to the server
Electronic transaction security method comprising a. Generating a reference table having an input key value of a virtual input device as an element and a subset of a key set in which the elements are randomly arranged;
Generating coordinates of a plurality of virtual objects corresponding to the element and constructing a codebook with coordinates of the generated virtual objects;
Transmitting the reference table and an indicator designating a specific subset of the reference table and the codebook to a terminal;
Receiving, from the terminal, a coordinate, a codebook indicator and a reference indicator of a virtual object selected by the user based on the codebook and the codebook indicator and a subset indicator of the reference table and the reference table; And
Identifying the virtual object selected by the user by referring to the received virtual object coordinates, codebook indicator, and reference table indicator
E-commerce security methods, including The method of claim 16,
The configuring of the codebook may include generating randomly the coordinates of the virtual objects. A reference table having an input key value of a virtual input device as a element from a server and a randomly arranged key set as a subset, an indicator for designating a specific subset of the reference table, and a plurality of virtual objects corresponding to the elements of the subset Receiving a codebook consisting of coordinates;
Taking an image;
Displaying the virtual object on the captured image by referring to the codebook and the codebook indicator and indicators of the reference table and a subset of the reference table;
Receiving coordinates of the virtual object selected by the user with reference to the displayed virtual object; And
Transmitting coordinates, codebook indicators, and lookup table indicators of the virtual object selected by the user to the server.
E-commerce security methods, including The method of claim 18,
The coordinates of the virtual objects included in the codebook is randomly generated electronic transaction security method. The method of claim 18, wherein displaying the virtual object comprises:
Selecting a marker from the photographed image;
Calculating a position in the image of the virtual objects based on the marker with reference to the coordinates of the virtual objects; And
Displaying the virtual object on the image using the calculated position
User authentication method comprising a. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 14 to 20.

Images