KR102364562B1 - Augmented reality apparatus having security function - Google Patents

Abstract

An augmented reality device having a security function is disclosed.
A camera unit capable of recognizing and photographing an actual subject; an augmented reality unit for generating an augmented target by superimposing additional information on a target that can be recognized and photographed through the camera unit; a display unit for displaying the augmented object generated by the augmented reality unit; a memory unit in which an object that can be recognized and photographed through the camera unit is stored; a USB interface unit for transmitting and receiving USB type data; a wireless LAN communication unit performing wireless LAN communication; a power applying unit for applying power to each component constituting the augmented reality device; And when power is applied, the function is automatically executed and a function that can be recognized and photographed through the camera unit is stored in the memory unit according to a security policy, a data transmission/reception function through the USB interface unit, and a communication function through the wireless LAN communication unit are blocked It is preferable to include; a security setting unit to set.

Description

Augmented reality device with security function {AUGMENTED REALITY APPARATUS HAVING SECURITY FUNCTION}

The present invention relates to an augmented reality device having a security function, and more particularly, to an augmented reality device having a security function allowing limited use only in a limited place.

Augmented Reality (AR) is a technology that superimposes a 3D virtual image on a real image or background and displays it as a single image, and it is a technology that helps users to acquire information more intuitively.

With the development of information technology, augmented reality is being applied to various fields such as games, marketing, medical care, education, military, and defense industries.

In the field of military and defense industries, for efficient training on equipment operation and maintenance, educational contents using augmented reality have been developed and used for education.

As such, when using augmented reality devices in the military and defense industries, security settings to prevent information leakage are essential.

To this end, conventionally, a separate application for stopping the camera function in the augmented reality device is installed in order to strengthen the security of the augmented reality device.

The application for stopping the camera function is executed or executed by a user operation, and while it is being executed, the camera recognition and photographing function is forcibly blocked, and the camera recognition and photographing function is normally performed while it is not executed.

As described above, conventionally, a separate application for stopping the camera function is installed in the augmented reality device to block information leakage, but the camera recognition and shooting function is stopped only while the corresponding application is operating, and the camera function is stopped. Since information cannot be prevented from being leaked only by itself, there is a problem in that it is vulnerable to security.

Korean Patent Publication No. 10-2015-0013203 (published on February 4, 2015)

The present invention has been devised to solve this problem, and it enables the augmented reality device to be operated only in limited places, and when power is applied, a security application is automatically executed to block image storage, data transmission, and the like. The purpose is to provide an apparatus.

Augmented reality device having a security function according to an embodiment of the present invention for achieving the above object, a camera unit capable of recognizing and photographing an actual object (including image and video recording); an augmented reality unit for recognizing through the camera unit and superimposing additional information on the photographed target to generate an augmented target; a display unit for displaying the augmented object generated by the augmented reality unit; a memory unit for recognizing through the camera unit and storing the photographed object; a USB interface unit for transmitting and receiving USB type data; a wireless LAN communication unit performing wireless LAN communication; a power applying unit for applying power to each component constituting the augmented reality device; And when power is applied, the function is automatically executed and recognized through the camera unit according to the security policy, and a function of storing a photographed object in the memory unit, a data transmission/reception function through the USB interface unit, and a communication function through the wireless LAN communication unit are blocked It is preferable to include; a security setting unit to set.

In an embodiment of the present invention, it is preferable to further include a short-range wireless communication unit for performing short-range wireless communication, wherein the security setting unit sets the communication function through the short-range wireless communication unit to be blocked.

In an embodiment of the present invention, a screen mirroring unit for transmitting the same mirroring screen as the screen displayed on the display unit to a synced device; further comprising, wherein the security setting unit blocks the mirroring function through the screen mirroring unit It is desirable to set it so that

In an embodiment of the present invention, further comprising a GPS receiver for measuring the location of the augmented reality device, wherein the security setting unit, based on the location information measured by the GPS receiver, when the augmented reality device is outside the permitted area , it is desirable to switch the augmented reality device to a locked state.

The augmented reality device having a security function of the present invention enables the augmented reality device to be operated only in a limited place, and when power is applied, a security application is automatically executed to block image storage, data transmission, etc., thereby strengthening security for the augmented reality device. be able to

1 is a diagram schematically showing the configuration of an augmented reality device having a security function according to an embodiment of the present invention.
2 is a processing diagram illustrating a method of driving an augmented reality device having a security function according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] Reference is made to the accompanying drawings, which show by way of illustration specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein with respect to one embodiment may be implemented in other embodiments without departing from the spirit and scope of the invention. In addition, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the following detailed description is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all scope equivalents to those claimed. Like reference numerals in the drawings refer to the same or similar functions throughout the various aspects.

Hereinafter, an augmented reality device having a security function and a driving method thereof according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram schematically showing the configuration of an augmented reality device having a security function according to an embodiment of the present invention.

The augmented reality device 100 having a security function according to the present invention includes a camera unit 110 , an augmented reality unit 115 , a display unit 120 , a memory unit 125 , a USB interface unit 130 , and a mobile communication unit ( 135), wireless LAN communication unit 140, short-range wireless communication unit 145, screen mirroring unit 150, GPS receiving unit 155, gyro sensor unit 160, power applying unit 165, security setting unit 170 and the like.

The camera unit 110 shoots an actual object (image, still image, and video).

The augmented reality unit 115 recognizes an object included in the recognized and photographed object through the camera unit 110 , and recognizes additional information retrieved in response to the recognized object through the camera unit 110 , and the photographed object Creates an augmentation target by superimposing it on

Here, the additional information may be information necessary for equipment operation and maintenance training.

The display unit 120 displays the augmentation target generated by the augmented reality unit 115 .

The display unit 120 may be implemented as a liquid crystal display (LCD), light emitting diodes (LED), organic LED (OLED), etc., and is preferably implemented as a touch screen provided with a touch sensor.

The memory unit 125 stores an object to be photographed and recognized through the camera unit 110 .

The memory unit 125 stores additional information corresponding to a program, application, or data required for augmented reality implementation, and each object.

The USB interface unit 130 transmits/receives data to and from a terminal or a storage device connected through a Universal Serial Bus (USB) port.

The mobile communication unit 135 communicates with an external device through a mobile communication network such as 3G, 4G (LTE), or 5G.

The wireless LAN communication unit 140 communicates with an external device according to a wireless LAN communication method.

The wireless LAN communication unit 140 may be implemented as a WIFI module, a WLAN module, or the like.

The short-range wireless communication unit 145 communicates with an external device according to a short-range wireless communication method.

The short-range wireless communication unit 145 may be implemented as a Zigbee module, a Bluetooth module, a Radio Frequency Identification (RFID) module, a Near Field Communication (NFC) module, a Z-wave module, or the like.

The screen mirroring unit 150 transmits the same mirroring screen as the screen displayed on the display unit 120 to the synced device.

The GPS receiver 155 receives GPS positioning information from a Global Positioning System (GPS) satellite and tracks the current location of the augmented reality device 100 .

The gyro sensor unit 160 measures posture information of the augmented reality device 100 as a posture positioning device.

The power applying unit 165 supplies power required for operation to each of the components 110 , 115 , ..., 160 , 170 constituting the augmented reality device 100 .

The security setting unit 170 is automatically executed when power is applied, and according to the security policy, the function of recognizing through the camera unit 110 and storing the photographed object in the memory unit 125 , through the USB interface unit 130 . A data transmission/reception function, a communication function through the wireless LAN communication unit 140 , a communication function through the short-range wireless communication unit 145 , a mirroring function through the screen mirroring unit 150 are set to be blocked.

In addition, the security setting unit 170 is based on the current location information of the augmented reality device 100 measured in real time through the GPS receiver 155 when the augmented reality device 100 is outside the permitted area, the augmented reality device 100 ) to a locked state (eg, screen lock, etc.). The function of the augmented reality device 100 may be completely disabled.

The security setting unit 170 may be implemented as H/W, but may be implemented as a software program, an application, or the like to perform a security setting function.

When the security setting function is implemented as a software program or application and mounted on the augmented reality device 100, the application is loaded as a default application and the application is not deleted even if there is a request for deletion or factory reset from the user. It is desirable that it be executed so that it can perform the security setting function.

In addition, in order to release the security setting function, access to the augmented reality device 100 in administrator mode may be implemented so that a separate setting value is input to be released.

When a setting value is input through the administrator mode, the security setting unit 170 may prevent the security setting function from being performed.

In addition, the security setting function may be controlled so that only some of the security functions are performed according to the setting value of the security module.

The manager mode is a mode used for content upgrade and security application update, etc. by a content (eg, augmented reality application for military education) developer, not an operator (user).

The augmented reality device 100 having the configuration as described above may be implemented as a smartphone, a tablet PC, or the like.

2 is a processing diagram illustrating a method of driving an augmented reality device having a security function according to an embodiment of the present invention.

First, when power is applied (ON) according to a user's manipulation who wants to drive the augmented reality device 100 , the power applying unit 165 is configured to each component 110 and 115 constituting the augmented reality device 100 . Power is applied to , ..., 160, 170 (S10).

When power is applied through the step S10, the security setting unit 170 is automatically executed, and the GPS receiver 155 is automatically executed to measure the current location of the augmented reality device 100 (S20).

The security setting unit 170 automatically executed through the above step S20 performs a security policy in real time interlocking with the GPS receiving unit 155, but the current location of the augmented reality device 100 measured in real time through the GPS receiving unit 155 Based on the information, it is checked whether the augmented reality device 100 is operated in a permitted area, that is, a security area (S30).

When automatically executed, the security setting unit 170 automatically executed through the above-described step S20 checks whether a separate security setting value for canceling the security function exists, and if there is a separate security setting value, the security setting function may not be performed.

In addition, the security setting function may be controlled so that only some of the security functions are performed according to the setting value of the security module.

As a result of the confirmation of step S30, if the augmented reality device 100 is outside the permitted area, that is, the security area, the augmented reality device 100 is automatically switched to a locked state (eg, screen locked state) It cannot be used outside the area, that is, the security area (S40).

In the embodiment of the present invention, when the augmented reality device 100 is outside the permitted area, that is, the security area, it is implemented to automatically switch the augmented reality device 100 to the locked state, but this is done outside the permitted area, i.e., the security area. In this case, it may be implemented so that the power is automatically turned off, or it can be implemented so that input through a UI (User Interface) is blocked.

On the other hand, as a result of the confirmation of the step S30, when the augmented reality device 100 is located in the permitted area, that is, within the security area, the security setting unit 170 performs a security function according to the security policy (S50).

Specifically, in step S50 described above, the security setting unit 170 may set the function to be recognized through the camera unit 110 and stored in the memory unit 125 according to the security policy to be blocked. Accordingly, the object recognized and photographed through the camera unit 110 is displayed on the display unit 120 only, and can be used only to recognize the object.

In addition, in step S50, the security setting unit 170 sets the data transmission/reception (input/output) function through the USB interface unit 130 to be blocked according to the security policy, and the communication function through the wireless LAN communication unit 140 (eg, For example, WIFI) can be set to be blocked.

In addition, in step S50, the security setting unit 170 may set the communication function (eg, ZigBee, Bluetooth, RFID, NFC, Z-wave, etc.) through the short-range wireless communication unit 145 to be blocked according to the security policy. there is.

In addition, in step S50, the security setting unit 170 may set to block the mirroring function (screen transmission function) through the screen mirroring unit 150 according to the security policy.

After the security function is set by the security setting unit 170 according to the security policy through the above-described step S50, the augmented reality device 100 performs the augmented reality function according to the user's operation (S60).

The method of driving an augmented reality device having a security function in an embodiment of the present invention may be implemented as an application or implemented in the form of program instructions that may be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination.

The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, and may be known and available to those skilled in the computer software field.

Examples of the computer-readable recording medium include a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM and DVD, and a magneto-optical medium such as a floppy disk. media), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.

Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for carrying out the processing according to the present invention, and vice versa.

Although the above has been described with reference to the embodiments, those skilled in the art will understand that various modifications and changes can be made to the present invention without departing from the spirit and scope of the present invention described in the claims below. will be able

110. Camera unit, 115. Augmented reality unit,
120. display unit, 125. memory unit;
130. USB interface unit, 135. Mobile communication unit;
140. wireless LAN communication unit, 145. short-range wireless communication unit;
150. Screen mirroring unit, 155. GPS receiving unit,
160. Gyro sensor unit, 165. Power supply unit;
170. Security Settings

Claims (1)

a camera unit capable of recognizing and shooting an actual subject;
Recognized through the camera unit and augmented by superimposing additional information on the photographed object
Augmented reality unit to generate a target;
a display unit for displaying the augmented object generated by the augmented reality unit;
a memory unit for recognizing through the camera unit and storing the photographed object;
a USB interface unit for transmitting and receiving USB type data;
a wireless LAN communication unit performing wireless LAN communication;
a short-range wireless communication unit for performing short-range wireless communication;
a screen mirroring unit for transmitting the same mirroring screen as the screen displayed on the display unit to the synced device;
GPS receiver for measuring the location of the augmented reality device;
a power applying unit for applying power to each component constituting the augmented reality device; and
It is automatically executed when power is applied, and based on the location information of the augmented reality device measured in real time through the GPS receiver, when the augmented reality device is outside the permitted area, the security zone is automatically switched to the locked state. When the augmented reality device is located in a security area that is a permitted area, the object recognized by the camera unit according to the security policy and photographed is displayed only on the display unit and displayed in the memory unit. The function to be stored is set to be blocked, while at least one of a data transmission/reception function through the USB interface unit, a communication function through the wireless LAN communication unit, a communication function through the short-range wireless communication unit, and a mirroring function through the screen mirroring unit is blocked and a security setting unit that prevents the security setting function from being performed when a separate setting value for canceling the security setting function is input through the administrator mode; and
The additional information is information necessary for operation and maintenance training of equipment, an augmented reality device having a security function.

Images