KR102349682B1 - A safe service method using an augmented reality and a mobile terminal providing the same - Google Patents

Abstract

A safe service method using augmented reality according to an embodiment of the present invention comprises the steps of generating location information of a mobile terminal, determining a location of the safe based on the location information of the mobile terminal, and placing the location of the safe. creating a safe; displaying the safe on a screen of the mobile terminal; and transmitting the creation location of the safe and the public key of the safe to the server.
A mobile terminal providing a safe service using augmented reality according to an embodiment of the present invention generates location information of the mobile terminal, determines a location to create a safe based on the location information of the mobile terminal, and generates the safe A safe may be created at a location, the safe may be displayed on the screen of the mobile terminal, and the location of the safe and the public key of the safe may be transmitted to a server.

Description

A safe service method using an augmented reality and a mobile terminal providing the same {A safe service method using an augmented reality and a mobile terminal providing the same}

The present invention relates to a safe service using augmented reality, and more particularly, to a safe service method using augmented reality and a mobile terminal providing the same.

In the prior art, it is possible to use a personal PC or a cloud service to store important data. In the case of a PC, data leakage is prevented by using an encryption program, and in the case of a cloud service, access to the data can be blocked through id and password. However, in the case of the personal PC or the cloud service, since the storage space is known to the outside, it is impossible to fundamentally block the access of others to the storage itself. That is, the data is put in the safe and locked, but there is a disadvantage in that the location of the safe itself is exposed to others.

In addition, in the case of an id, there is a problem that an individual can be easily inferred or specified on the Internet.

In the present invention, it is possible to propose a safe service method using augmented reality and a mobile terminal providing the same.

More specifically, by using a technology called augmented reality to store digital data in an arbitrary location in the real world, it is possible to block others from easily accessing the data storage location. In this way, it is possible to more safely protect important digital data from external access.

Accordingly, the present invention is to provide a data storage method with enhanced security by preventing others from easily recognizing the data storage location itself by storing important personal data in an arbitrary location that exists in reality using a technology called augmented reality. can do.

In addition, the purpose of this is to provide personal anonymity by classifying the safe, which is a data storage stored in a specific location in reality, using the individual's public key, not the id.

The problems of the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

In order to solve the above technical problems, a safe service method using augmented reality includes generating location information of a mobile terminal, determining a location of a safe based on the location information of the mobile terminal, and generating location of the safe creating a safe in a safe, displaying the safe on a screen of the mobile terminal; and transmitting the creation location of the safe and the public key of the safe to the server.

In addition, in order to solve the above technical problem, a mobile terminal that provides a safe service using augmented reality generates location information of the mobile terminal, determines the location of the safe based on the location information of the mobile terminal, and the A safe may be created at a location where the safe is created, the safe may be displayed on the screen of the mobile terminal, and the location of the safe and the public key of the safe may be transmitted to a server.

A safe service method using augmented reality according to the present invention and the effect of a mobile terminal providing the same will be described as follows.

First, it makes it difficult for others to access by placing the safe in an arbitrary location in reality. This has the advantage of providing an enhanced data protection method.

Second, there is an advantage of providing anonymity by protecting personal privacy by making the classification of safes as public keys.

Third, there is an advantage of providing convenience of use through a simplified authentication procedure.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be.

1 is a block diagram of a safe service device according to an embodiment of the present invention.
2 is a flowchart illustrating a method for generating a safe according to an embodiment of the present invention.
3 is a flowchart illustrating a flow of using a safe according to an embodiment of the present invention.
4 is an exemplary diagram illustrating an authentication method according to an embodiment of the present invention.
5 is an exemplary view showing an authentication method of a safe according to an embodiment of the present invention.
6 is an exemplary view showing the outline of a safe according to the first embodiment of the present invention.
7 is an exemplary diagram illustrating an outline of using a safe according to a second embodiment of the present invention.

Hereinafter, an apparatus and various methods to which embodiments of the present invention are applied may be described in more detail with reference to the drawings. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves.

In the description of the embodiment, in the case of being described as being formed in "above (above) or below (below)", "before (front) or after (rear)" of each component, "above (above) or below" "(below)" and "before (front) or after (rear)" may include both the two components are in direct contact with each other, or one or more other components are disposed between the two components to be formed. .

In addition, in describing the components of the present invention, terms such as first, second, A, B, (a), (b), etc. may be used. These terms are only for distinguishing the elements from other elements, and the essence, order, or order of the elements are not limited by the terms. When it is described that a component may be “connected”, “coupled” or “connected” to another component, the component may be directly connected or connected to the other component, but between each component It should be understood that another component may be “connected”, “coupled” or “connected to”.

In addition, terms such as "comprises", "comprises" or "have" described above mean that the corresponding component may be inherent, unless otherwise specified, excluding other components. Rather, it may be construed as being capable of including other components further. All terms, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs, unless otherwise defined. Terms commonly used, such as those defined in the dictionary, should be interpreted as being consistent with the contextual meaning of the related art, and are not interpreted in an ideal or excessively formal meaning unless explicitly defined in the present invention.

Embodiments of the present invention may support a user who uses an augmented reality safe to directly manufacture a safe, and allow the safe manufactured by the user to be shared with each other. To this end, a mobile terminal for creating or printing a safe, a mobile terminal for providing a safe service using augmented reality including a server for supporting sharing of the safe made in the mobile terminal, and a method of using the system may be included. .

1 is a block diagram of a safe service device according to the present invention.

Referring to FIG. 1 , the safe service device may include a mobile terminal 100 and a server 200 .

The mobile terminal 100 may be various types of terminals, but for convenience and clarity of explanation, it is assumed that a smartphone is used. The mobile terminal 100 may include a module for providing wired/wireless communication, and may communicate with the server 200 .

The mobile terminal 100 may create at least one safe through the safe application.

When the safe application is first executed, a user's own private key and public key may be automatically generated as a pair.

The public key may be identification data that identifies a specific user of the safe application. The public key may be the same concept as an existing ID (identity). The public key may be shareable with others. The public key can be used to encrypt data in the safe. The public key may be an encryption-only key used to encrypt data in the safe.

The private key can be used to decrypt data encrypted with the public key. The private key may be a dedicated key used to decrypt data in the safe.

After the key generation is completed, the mobile terminal 100 may designate a location where the safe is created. A safe can be created at the location where the safe is created when the safe box is created after being reflected on the camera screen of the mobile terminal 100 at the location where the safe is created. The mobile terminal 100 may display the safe using augmented reality.

The mobile terminal 100 can register the safe with the server 200, the mobile terminal 100 can transmit the safe itself to the server 200, and for this purpose, the location information of the mobile terminal 100 can be transferred to the safe server ( 200) can be provided to the safe application.

In the mobile terminal 100, a safe is created (Example 1) and can be accessed by receiving safe information from the server 200 (Embodiment 2). Hereinafter, specific examples will be described in detail.

Example 1 (when the mobile terminal creates a safe)

The mobile terminal 100 may transmit the safe to the server 200 . Here, the safe may be a database for individually storing data of the mobile terminal 100 .

The mobile terminal 100 may install a dedicated application for the safe, create a safe using a predetermined application programming interface (API), and provide it to the server 200 .

The server 200 may manage the safe based on the location information of the safe received from the mobile terminal 100 and the public key of the safe.

Example 2 (When the mobile terminal uses a safe)

The mobile terminal 100 may access the individual safe by operating the safe application at the location where the safe is created. In this case, a plurality of safes may be displayed on the mobile terminal 100 at the location where the safe is created.

The mobile terminal 100 may request authentication to use the safe from the server 200 . The authentication request may include location information and public key information of the mobile terminal 100 .

The mobile terminal 100 and the server 200 may perform an authentication process.

When the user wants to access the server 200 through the mobile terminal 100 , the server 200 may approve the mobile terminal 100 so that the user can access the server 200 with a preset public key and a private key.

The server 200 may determine whether to approve the login using the login information stored in the safe deposit box information. The safe deposit box information includes login information including the user's public key, private key, and serial number of the mobile terminal 100, access information about the record of the user accessing the server 200, files uploaded to the user safe, etc. may include

The safe information can be stored by matching the safe share key and location information in each of these safes.

The mobile terminal 100 may acquire the safe use authentication through the authentication process.

The server 200 may perform a procedure with the mobile terminal 100 to determine whether use of the safe can be authenticated. The server 200 may decrypt the encrypted safe or perform an authentication procedure for confirming that the user is a user of the safe.

A public key may be set in the safe, and the public key may be received from the mobile terminal 100, and the safe may be accessed only when they are compared and matched with each other.

For example, when the server 200 compares the public key, the mobile terminal 100 transmits the public key and location information to the server 200 when a safe transmission request is made, and the server 200 receives the transmitted location. The safe can be searched using the information, and the retrieved safe box information can be transmitted to the mobile terminal 100 only when the public key set in the searched safe box and the public key received from the mobile terminal 100 are compared with each other and matched.

When the mobile terminal 100 receives the authentication value of the safe from the server 200, the mobile terminal 100 can upload and download files through the safe application.

2 is a flowchart illustrating a method of creating a safe according to an embodiment of the present invention.

Referring to FIG. 2 , the method for creating a safe according to an embodiment of the present invention includes the steps of executing a safe application (S110), taking a photo-realistic image (S120), specifying a location for creating a safe (S130), and receiving the location of the safe (S140). , generating the safe (S150), displaying the safe (S160), transmitting safe information (S170), and registering the safe (S180).

In the safe application execution step ( S110 ), when the safe application is first executed, a user's own private key and public key may be generated. The safe may use a public key encryption method.

In the live-action shooting step (S120), it is possible to obtain a live-action through the camera installed in the mobile terminal (100).

In the step (S130) of specifying the location of the safe deposit box, the mobile terminal 100 may display a safe box generation button on the screen. After the user presses the safe creation button, it is possible to select a region of the real-world in the real-world, and to designate the safe creation location.

In the safe location receiving step (S140), the mobile terminal 100 receives the location information of the mobile terminal 100 from a sensor such as GPS and WiFi, and based on the location information of the mobile terminal 100, the You can receive location information of the safe.

Also, the mobile terminal 100 may receive direction information of the mobile terminal 100 from a displacement sensor, a sensor such as Bluetooth, and the direction information of the mobile terminal 100 may be included in the location information of the safe.

In the safe creation step ( S150 ), when the user presses the displayed safe creation of the mobile terminal 100 at the location where the safe is to be created, a safe may be created at the corresponding location.

In the safe display step ( S160 ), the safe may be displayed on the screen of the mobile terminal 100 together with a live image. In the safe box display step ( S160 ), the safe box may be displayed as an icon on the screen of the mobile terminal 100 . The icon may be displayed on the live-action screen in response to augmented reality technology. A public key indicating whose safe it is may be displayed at the top of the safe. It is possible to display a public key indicating whose safe it is on the safe that matches the due diligence.

In the safe box information transmission step ( S170 ), the safe, location information of the safe, and a public key may be output to the server 200 .

In the safe registration step ( S180 ), the server 200 may register the safe, location information, and public key received from the mobile terminal 100 in the server 200 .

3 is a flowchart illustrating a flow of using a safe according to an embodiment of the present invention.

Referring to FIG. 3 , the method of using a personal safe includes a safe application execution step (S210), a location information provision step (S220), a safe search step (S225), a safe box information provision step (S230), a safe box display step (S240), It may include a safe selection step (S250), an authentication procedure step (S260), and a safe use step (S270).

In the safe application execution step ( S210 ), the safe application may be executed through the mobile terminal 100 .

In the location information providing step ( S220 ), the mobile terminal 100 may output the current location information to the server 200 .

In the safe deposit box search step ( S225 ), when a safe box transmission request is received along with location information from the mobile terminal 100 , a safe box corresponding to the location information received from the mobile terminal 100 may be searched.

In the safe box information providing step ( S230 ), the server 200 may transmit a safe box search result to the mobile terminal 100 in response to the current location information. The safe search result may include a safe corresponding to the location information and a public key corresponding to the searched safe.

In the safe display step (S240), the safe may be displayed on the screen of the mobile terminal 100 together with a live image. In the safe box display step ( S210 ), the safe box may be displayed as an icon on the screen of the mobile terminal 100 . The icon may be displayed on the live-action screen in response to augmented reality technology. A public key indicating whose safe it is may be displayed at the top of the safe. It is possible to display a public key indicating whose safe it is on the safe that matches the due diligence.

In the safe selection step S250 , the user may select a safe displayed on the mobile terminal 100 .

In the authentication procedure ( S260 ), the mobile terminal 100 may request the server 200 to authenticate the use of the selected safe. The request information may include a public key and location information of the selected safe.

The server 200 encrypts a random character string based on the public key of the selected safe, the mobile terminal 100 decrypts the encrypted character string using the private key, and the random character string and the decrypted character string It can be determined whether they match.

The server 200 may output an authentication value according to the authentication execution determination result.

In the safe use step ( S270 ), when the authentication is successful, the mobile terminal 100 may upload and download files using the authenticated safe. This will be described in detail below with reference to FIG. 5 .

4 is an exemplary diagram illustrating an authentication procedure according to an embodiment of the present invention.

As shown in Fig. 4, the authentication procedure of the safe includes an authentication request step 310, an encryption step S320, an encrypted data transmission step S330, a decryption step S340, a decrypted data transmission step S350, It may include a data determination step (S360).

In the authentication request step ( S310 ), the mobile terminal 100 may request use authentication from the server 200 using the public key of the safe and location information of the safe.

In the encryption step ( S320 ), the server 200 may encrypt an arbitrary character string with the public key for which the authentication request is received.

In the ciphertext data transfer step (S330), the server 200 may transmit the encrypted character string to the mobile terminal 100 to request confirmation of the ciphertext.

In the decryption step (S340), the mobile terminal 100 may decrypt the received ciphertext with its own private key.

In the decrypted data transfer step ( S350 ), the decrypted character string may be transferred to the server 200 .

In the decryption data determination step ( S360 ), the server 200 may determine whether the decrypted character string and an arbitrary character string generated by the server 200 match.

When the character strings match, the server 200 may output an authentication value corresponding to authentication success to the safe application (S370).

If the character strings do not match, the server 200 may block access from the corresponding IP (S380). The server 200 may output an authentication value corresponding to the authentication failure to the safe application (S390).

5 is an exemplary view illustrating a method of using a safe according to an embodiment of the present invention.

As shown in Figure 5 (a), the file upload method of the safe includes an upload file selection step (S411), an upload button selection step (S413), an encryption step (S415), an uploading step to the server 200 (S417), It may include an upload completion step (S419).

In the upload file selection step ( S411 ), when the mobile terminal 100 accesses the safe, the mobile terminal 100 may display a screen in the form of a searcher. The screen in the form of the explorer may display a folder or a file of the mobile terminal 100 . The displayed folder or file of the mobile terminal 100 may be selected.

In the upload button selection step (S413), the mobile terminal 100 may display an upload button at the bottom of the mobile terminal 100 when the folder and the file are selected.

In the encryption step (S415), the selected upload file may be encrypted with a public key.

In the server 200 uploading step ( S417 ), the file encrypted with the public key may be uploaded to the safe server 200 .

In the upload completion step ( S419 ), when the file upload is completed, the upload result may be displayed on the screen of the mobile terminal 100 .

As shown in Fig. 5(b), the file download method of the safe is a download file selection step (S421), a download selection step (S423), a file download step (S425), a decryption step (S427), and a download completion (S429) ) may be included.

In the download file selection step ( S421 ), when the mobile terminal 100 accesses the safe, the mobile terminal 100 may display a screen in the form of a searcher. The screen in the form of the explorer may display a folder or file of the server 200 . A folder or file of the displayed server 200 may be selected.

In the download selection step (S423), the mobile terminal 100 may display a download button at the bottom of the mobile terminal 100 when the folder and the file are selected.

In the file download step S425 , the selected folder and file of the server 200 may be downloaded to the mobile terminal 100 .

In the decrypting step (S427), the mobile terminal 100 may decrypt the downloaded file with a private key.

In the download completion ( S429 ), when the file download is completed, the download result may be displayed on the screen of the mobile terminal 100 .

6 is an exemplary view showing an outline of a safe according to the first embodiment of the present invention.

Referring to FIG. 6( a ), the mobile terminal 100 may photograph a location where a safe is to be made in a live-action 610 . The creation location 620 of the safe may designate one area of the actual image displayed on the mobile terminal 100 . When selecting with the finger (H), when one area of the actual image is selected, a creation icon 630 capable of creating a safe may be output at the bottom of the mobile terminal 100 .

When one area of the actual image is designated, the mobile terminal 100 may create a safe 640 at a location where the safe is created. When the safe 640 is created, the state of the safe may be selected as “public/private”, and the default state may be “private”.

Referring to FIG. 6B , the mobile terminal 100 may output the icon to the live-action screen through augmented reality technology.

A public key 650 of the safe may be displayed on the top of the safe 640 . If the safe 640 is private, the safe is only visible in the creator's safe application. When the safe 640 is public, all users of the safe application at the location may display the safe corresponding to the location on the mobile terminal 100 .

7 is an exemplary diagram illustrating an outline of using a safe according to a second embodiment of the present invention.

Referring to FIG. 7A , in order to use the safe, the safe must be opened first, and the safe can be opened through the following procedure.

The mobile terminal 100 may execute a safe application at the location where the safe is created. It is possible to shoot a live image through the mobile terminal (100). At this time, the display screen of the mobile terminal 100 may display the photographed live-action.

When the user uses the safe application to photograph the location where the safe 640 is located, the mobile terminal 100 may display the public key 650 of the safe and the safe icon together on the screen through the safe application. .

If the safe is selected with a finger (H), the safe can be used. The selection of the finger (H) is an actual authentication, and may perform the same role as login through an id and password of a general safe application.

7 (b) is an exemplary view showing a method of using a safe according to an embodiment of the present invention.

Referring to FIG. 7B , when the mobile terminal 100 can use the safe 640 , upload and download of files may be provided in the safe application. The file may be data included in the mobile terminal.

When the safe 640 is used, the main screen of the safe application may be displayed in the form of an explorer 710 capable of uploading and downloading files.

Data of the mobile terminal 100 and the server 200 may be displayed on the mobile terminal.

When a file displayed on the mobile terminal is selected, upload and download icons may be created at the bottom of the screen of the mobile terminal 100 .

When uploading the file, the mobile terminal 100 may encrypt the file before uploading and output it to the server.

When a file is downloaded from the server 200, the mobile terminal 100 may decrypt and store the file of the server.

The method according to the above-described embodiment may be produced as a program to be executed on a computer and stored in a computer-readable recording medium. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic There are tapes, floppy disks, and optical data storage systems. The computer-readable recording medium is distributed in network-connected computer systems, so that the computer-readable code can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the above-described method can be easily inferred by programmers in the art to which the embodiment pertains.

100: mobile terminal
200 : server

Claims (18)

generating location information of the mobile terminal;
determining a location of a safe based on location information of the mobile terminal;
creating a safe at the location of the safe;
displaying the safe on the screen of the mobile terminal;
transmitting the creation location of the safe and the public key of the safe to a server;
receiving, by the mobile terminal, a location of the safe and a public key of the safe from a server;
displaying a safe corresponding to a safe creation location and a public key of the safe received from the server on the screen of the mobile terminal;
selecting a safe displayed on the screen of the mobile terminal;
performing an authentication procedure of the selected safe; and
A safe service method using augmented reality, comprising the step of uploading or downloading a file to the safe for which the authentication procedure is successful. The method of claim 1,
The step of determining the location of the safe on the basis of the location information of the mobile terminal
generating direction information corresponding to the location of the safe;
A safe service method using augmented reality further comprising a. The method of claim 1,
When creating a safe for the first time,
generating a user's own private key and the public key as a pair;
A safe service method using augmented reality further comprising a. The method of claim 1,
The step of displaying the safe on the screen of the mobile terminal
displaying the safe and the public key together;
A safe service method using augmented reality further comprising a. delete The method of claim 1,
The step of performing the authentication procedure of the selected safe is
requesting, by the mobile terminal, authentication of the selected safe from the server;
receiving, by the mobile terminal, an arbitrary character string encrypted with the public key from the server;
decrypting, by the mobile terminal, the encrypted random string with a private key;
transmitting, by the mobile terminal, the decrypted character string to the server; and
receiving, by the mobile terminal, an authentication value corresponding to whether the decrypted character string and the arbitrary character string match from the server;
A safe service method using augmented reality further comprising a. 7. The method of claim 6,
receiving, by the mobile terminal, an authentication value corresponding to authentication success from the server when the character strings match;
A safe service method using augmented reality further comprising a. The method of claim 1,
The step of executing the file upload is
selecting files to upload;
encrypting the selected file with the public key; and
uploading the encrypted file to a server;
A safe service method using augmented reality comprising a. The method of claim 1,
The step of executing the file download is
selecting files to download;
downloading the selected file; and
decrypting the downloaded file;
A safe service method using augmented reality comprising a. create location information of the mobile terminal,
Determining the location of the safe on the basis of the location information of the mobile terminal,
creating a safe at the location of the safe;
Display the safe on the screen of the mobile terminal,
Transmitting the creation location of the safe and the public key of the safe to the server,
The mobile terminal is
receiving the creation location of the safe and the public key of the safe from the server;
a safe corresponding to the location of the safe and the public key of the safe received from the server is displayed on the screen of the mobile terminal;
Select the safe displayed on the screen of the mobile terminal,
performing the authentication procedure of the selected safe;
Execute file upload or download to the safe where the above authentication process has been successful
A mobile terminal that provides a safe service using augmented reality. 11. The method of claim 10,
The mobile terminal
generating direction information corresponding to the location of the safe
A mobile terminal that provides a safe service using augmented reality. 11. The method of claim 10,
The mobile terminal
When creating a safe for the first time,
A user's own private key and the public key are generated in pairs
A mobile terminal that provides a safe service using augmented reality. 11. The method of claim 10,
The mobile terminal
displaying the safe together with the public key;
A mobile terminal that provides a safe service using augmented reality. delete 11. The method of claim 10,
The authentication process is
The mobile terminal requests authentication of the selected safe from the server,
The mobile terminal receives an arbitrary string encrypted with the public key from the server,
The mobile terminal decrypts the encrypted random string with a private key,
The mobile terminal transmits the decrypted character string to the server,
The mobile terminal receives an authentication value corresponding to whether the decrypted character string and the arbitrary character string match from the server
A mobile terminal that provides a safe service using augmented reality. 16. The method of claim 15,
The mobile terminal
When the character string matches, the mobile terminal receives an authentication value corresponding to authentication success from the server
A mobile terminal that provides a safe service using augmented reality. 11. The method of claim 10,
The mobile terminal
Select the file you want to upload,
encrypting the selected file with the public key,
Uploading the encrypted file to the server
A mobile terminal that provides a safe service using augmented reality. 11. The method of claim 10,
The mobile terminal
select the file to download,
Download the selected file,
Decrypting the downloaded file
A mobile terminal that provides a safe service using augmented reality.

Images