KR101757884B1 - Apparatus for providing circumstance information based on battlefield situation awareness and method thereof - Google Patents

Abstract

According to an embodiment of the present invention, there is provided a situation information providing apparatus for providing surrounding information on a region of interest of a user, the apparatus comprising: a camera unit for photographing an actual image of the region of interest; An image capturing information analyzing unit receiving image data from the camera unit and analyzing surrounding information based on an actual image of the area of interest; Based on sensing information received from one or more sensor nodes disposed in or around the ROI, target intrusion information, target motion information, target movement path, target movement speed, target feature information, A sensing information analyzer for analyzing target information including at least one of position information or appearance possibility information of a target for each position; And an augmented reality display unit that displays an augmented reality image in which a virtual target image that is predicted according to an actual image received from the camera unit and target information received from the sensing information analysis unit is superimposed, / RTI >

Description

[0001] APPARATUS FOR PROVIDING CIRCUMSTANCE INFORMATION BASED ON BATTLEFIELD SITUATION AWARENESS AND METHOD THEREOF [0002]

The present invention relates to an apparatus and method for providing situation information based on a long-range situation, and more particularly, to an apparatus and method for providing situation information based on a long- To a method and server for providing accurate and highly utilized situation information to a user by analyzing various information about the surrounding situation based on the collected shooting information and sensing information .

Conventionally, one - dimensional information collected from sensors was used as information for surveillance and scouting for the purpose of national defense such as battlefield situation.

However, this one - dimensional information alone is insufficient to utilize the military equipment which requires efficiency, speed and accuracy of information collection.

Recently, the technology that utilizes the two-dimensional map through mobile terminal operation and the location indication of the enemy army has been developed. However, since the technology can be used only on the operating terminal such as PDA and PRE, the application range is extremely limited .

In addition, there is also a limitation that the scheme of the existing surveillance scouting situation can only be limited by the schematics and the enemy's location marking technology for the garrison in the command and control room.

Korean Patent Laid-Open No. 10-2009-0040626 (Prior Art 1) discloses a target counting method for improving the accuracy of the surveillance and reconnaissance technique. In this case, however, only one- It is impossible to analyze and provide the situation information corresponding to the change of time or place in real time, and there is still a problem that the utilization is limited to a large extent.

In addition, since the monitoring and reconnaissance technology has been implemented through the terminal under the control of the central control center, it is difficult to utilize the technology independently on the terminal from the central control center and it is not possible to provide information promptly, I was not able to use the technology without receiving it.

Prior Art 1: Korean Patent Laid-Open No. 10-2009-0040626 (Apr. 27, 2009)

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems of the prior art, and it is an object of the present invention to provide accurate and efficient surveillance and reconnaissance information by analyzing and providing various situation information about an actually located interest area.

Another object of the present invention is to predict the position of a target that can not be obtained in an actual photographed image and display it on an actual image so that a user can quickly respond to the target.

Another object of the present invention is to improve the accuracy of the surveillance and reconnaissance information by analyzing the situation information using sensing information of the sensor node, photographing information of the camera, and situation information on a wide area of the central control server, Thereby improving the efficiency of the system.

According to an aspect of the present invention, there is provided a context information providing apparatus for providing context information on a user's interest area, the apparatus comprising: A camera unit; An image capturing information analyzing unit receiving image data from the camera unit and analyzing surrounding information based on an actual image of the area of interest; Based on sensing information received from one or more sensor nodes disposed in or around the ROI, target intrusion information, target motion information, target movement path, target movement speed, target feature information, A sensing information analyzer for analyzing target information including at least one of position information or appearance possibility information of a target for each position; And an augmented reality display unit that displays an augmented reality image in which a virtual target image that is predicted according to an actual image received from the camera unit and target information received from the sensing information analysis unit is superimposed, / RTI >

The photographing information analyzing unit may extract, based on the actual image, spatial information of the ROI, information about objects existing in the ROI, location information of the ROI, location information of the ROI, Or if there is a target photographed in the actual image, analyzes surrounding information including one or more pieces of the motion information of the photographed target.

The status information including at least one of the surrounding information analyzed by the shooting information analyzing unit, the target information analyzed by the sensing information analyzing unit, the status information of the other area of interest received from the central control server or the control command information, A situation information providing apparatus is provided which includes a situation information display unit.

The context information display unit displays status information on the ROI through one or more of a method of displaying a figure or picture on the augmented reality image, a method of numerically displaying the context information, Is displayed on the display unit.

And a user authentication unit for verifying whether or not the user is authorized to use the situation information providing apparatus through at least one of ID, password authentication, fingerprint authentication, or iris authentication method of the user / RTI >

The importance information or the severity of the circumstance of the ROI is determined based on the situation information analyzed by the shooting information analyzing unit or the sensing information analyzing unit and whether or not the status information data is stored in its own storage or transmitted to the central control server And a detection result processing unit for determining a detection result processing unit.

And a sound information transmitting and receiving unit for receiving the user command through voice recognition of the user or providing the status information by voice.

According to another embodiment of the present invention, there is provided a situation information providing system for providing surrounding situation information on a user's area of interest, the system comprising: an intrusion detection unit for detecting an intrusion through motion detection sensing, One or more sensor nodes; A gateway for collecting one or more pieces of sensing information through the one or more sensor nodes and the wireless sensor network and transmitting the collected sensing information to a situation information providing device or a central control server outside the wireless sensor network; A situation information providing device for capturing an actual image around the ROI and analyzing the actual image and sensing information of the sensor node to provide context information about the ROI; And analyzing the surrounding situation for a wide area by collecting the situation information data for one or more interested areas from one or more situation information providing devices and providing the situation information providing device with the situation information about another interested area, And a central control server for transmitting a control command to the sensor node or the situation information providing apparatus.

Wherein the one or more sensor nodes are arranged within the ROI or around the ROI.

Wherein the gateway collects delimiter information for each of the sensor nodes or arrangement information of the sensor nodes and transmits the collected information to the status information providing apparatus or the central control server, Wherein the sensing information analyzing unit analyzes the sensing information based on the delimiter information or the arrangement information of each sensor node received from the sensor node so as to grasp accurate positional information or movement route information of the target .

According to another embodiment of the present invention, there is provided a method for providing context information on a region of interest of a user, the method comprising the steps of: (a) receiving, from one or more sensor nodes Collecting sensed information of at least one sensed time; (b) capturing actual image data including photographing information of the ROI by photographing the ROI; (c) analyzing the shooting information or the sensing information and analyzing the situation information on the ROI; (d) generating and providing augmented reality image data by superimposing the imaging information and virtual target image data predicted from the sensing information analysis; And (e) spatial information of the ROI obtained through the analysis of the photographing information, information about objects existing in the ROI, location information of the ROI, location information of the ROI, The motion information of the target obtained through the sensing information analysis, the motion information of the target, the moving path of the target, the moving speed of the target, the characteristic information of the target, the expected appearance position information of the target, And providing context information for the region of interest that includes the above.

Confirming whether or not the user has the right to use the situation information providing apparatus through at least one of the ID, password authentication, fingerprint authentication, or iris authentication method of the user before the step (a) , And a situation information providing method are provided.

The method may further include receiving at least one piece of status information or control command information of another area of interest from the central control server before step (e), wherein the status information provided in step (e) And the status information of the other area of interest received from the central control server or the control command information.

According to an embodiment of the present invention, accurate and efficient surveillance and reconnaissance information can be provided since the user analyzes and provides various situation information with respect to an actually located interest area.

According to an embodiment of the present invention, sensing information can be collected through one or more sensor nodes disposed on the periphery of a user's interest area, and a position of a target that can not be acquired in an actual photographic image can be predicted. A rapid response can be performed.

In addition, according to an embodiment of the present invention, context information in various aspects is analyzed using sensing information of a sensor node and photographing information of a camera, as well as context information of a wide area of a central control server, It is possible to improve the accuracy and improve the efficiency of the countermeasure operation.

It should be understood that the effects of the present invention are not limited to the above effects and include all effects that can be deduced from the detailed description of the present invention or the configuration of the invention described in the claims.

1 is a schematic configuration diagram of a situation information providing system according to an embodiment of the present invention.
2 is a configuration diagram of a situation information providing apparatus according to an embodiment of the present invention.
FIG. 3 is a flowchart illustrating a method for providing context information based on a battlefield situation recognition according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 4 is a diagram illustrating an augmented reality image and a virtual target image display screen of a situation information providing apparatus according to an embodiment of the present invention. Referring to FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "indirectly connected" . Also, when an element is referred to as "comprising ", it means that it can include other elements, not excluding other elements unless specifically stated otherwise.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic configuration diagram of a situation information providing system according to an embodiment of the present invention.

Referring to FIG. 1, the situation information providing system may include at least one sensor node 100, a gateway 200, a situation information providing apparatus 300, and a central control server 400 that can communicate with each other through a communication network.

First, the communication network is composed of various communication networks such as a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN), regardless of the communication modes such as wired and wireless. And is preferably implemented in a wireless communication manner. The communication between the one or more sensor nodes 100 and the gateway 200 according to an embodiment of the present invention can be applied to a wireless sensor network.

The sensor node 100 senses various ambient conditions such as temperature, sound, and pressure, and transmits the sensed information to the gateway 200, the situation information providing device 300, or the central control server 400.

According to an embodiment of the present invention, the one or more sensor nodes 100 disposed in the area where the situation information is to be provided may include a sensor such as an ID for each sensor node 100 for identifying each sensor node 100, It can have a node delimiter.

It is also possible to store the placement information such as the placement position and the placement direction of each sensor node 100 or to transmit the information to the gateway 200, the situation information providing device 300 or the central control server 400.

The sensor node 100 according to an exemplary embodiment of the present invention can detect movement direction of a target or an intrusion signal for confirming occurrence of an intruder by performing motion detection in a sensing area.

In addition, according to one embodiment, the sensor node 100 may transmit a sensing mode, a sensing condition, or a sensing operation activation / sensing operation according to a command of the gateway 200, the status information providing device 300, or the central control server 400. [ It can be controlled whether it is inactivated or not.

As described above, the sensing information such as the motion sensing information, the target movement direction, or the intrusion signal information sensed by each of the one or more sensor nodes 100 is transmitted together with the sensor node identifier information or the sensor node placement information of each sensor node 100 And may be transmitted to the gateway 200 and provided to the situation information providing apparatus 300 or the central control server 400.

1, one or more sensor nodes 100 communicate with the status information providing apparatus 300 or the central control server 400 via the gateway 200. However, according to another embodiment of the present invention, The node 100 directly transmits sensing information, delimiter information of each sensor node and sensor node arrangement information to the situation information providing apparatus 300 or the central control server 400, The server 400 may directly receive the sensor node control command.

The gateway 200 collects sensor node data such as sensing information, sensor node identifier information, and sensor node placement information transmitted from one or more sensor nodes 100. The gateway 200 may transmit the collected sensor node data to a device or server outside the wireless sensor network such as the status information providing device 300 or the central control server 400. [

The gateway 200 according to an exemplary embodiment of the present invention may be a gateway sensor node. That is, the gateway sensor node can perform the function of the sensor node and the gateway 200 at the same time.

The situation information providing apparatus 300 may provide context information on a user's area of interest.

According to an exemplary embodiment of the present invention, the situation information providing apparatus 300 may be connected to a sensor node 100, a gateway (not shown), and the like through a network, such as a mobile phone, a smart phone, a PDA (Personal Digital Assistant), a PMP Based wireless communication device that can be connected to an external device or an external server such as a central control server 200 and a central control server 400 as well as to a network such as a wearable device, Such as the sensor node 100, the gateway 200, and the central control server 400, or various types of devices capable of communicating with an external server.

The situation information providing apparatus 300 according to an exemplary embodiment can collect actual environment information of the current location through the camera-based surrounding environment recognition, and can collect sensor node data received from the sensor node 100 or the gateway 200 And generates context information data by analyzing the context information to provide real-time context information on the actual environment information.

That is, the situation information providing apparatus 300 according to an exemplary embodiment generates an actual image of a corresponding location, which is collected through a camera or an acoustic transmission / reception module, as well as an analysis result of the sensed information from one or more sensor nodes 100 By providing the virtual situation information, it is possible to provide accurate and efficient situation information using the augmented reality.

The situation information providing apparatus 300 analyzes the sensor node data collected from the sensor node 100 or the gateway 200 to generate the situation information data such as the movement characteristics of the target and the possibility of appearance of the target with respect to the current position And may store the generated status information data or transmit the status information data to the central control server 400.

The central control server 400 according to an embodiment receives and stores sensor node data or situation information data through communication with one or more sensor nodes 100, a gateway 200, and one or more status information providing apparatuses 300 .

When the central control server 400 collects the sensor node data or the situation information data for one or more regions of interest, the central control server 400 searches the sensor node 100 for a wide area outside the sensing region of the sensor node 100 or the sensing region of the situation information providing apparatus 300 The situation information providing apparatus 300 can provide context information on the other area of interest through the analysis of the movement of the target or the surrounding situation severity according to the area of interest and the operation of the sensor node 100 or the situation information providing apparatus 300 And may transmit a command for controlling.

Such a situation information providing system can be used in a technical field requiring accurate situation analysis and quick judgment for a specific area. In one embodiment, the intrusion detection of enemy forces, the movement of enemy forces, It can be applied to industrial fields. For example, the intrusion of the enemy group is detected from the sensing information of the sensor nodes 100 disposed in the anticipated enemy intrusion area, the movement path of the enemy group is grasped, and before the enemy group arrives before, It is possible to anticipate the appearance of an enemy group through the analysis of data gathered by the situation information providing apparatus 300 or the central control server 400, thereby enabling an effective allied tactical operation through the identification of the enemy tactics.

2 is a configuration diagram of an apparatus 300 for providing situation information according to an embodiment of the present invention.

2, an apparatus 300 for providing status information according to an exemplary embodiment includes a user authentication unit 310, a camera unit 320, an analysis unit 330, a display unit 340, a detection result processing unit 350, An acoustic information transmitting and receiving unit 360, a control unit 370, and a communication unit 380.

The user authentication unit 310 according to an exemplary embodiment may identify the user of the context information providing apparatus 300 and determine whether the user is authorized.

The user authentication unit 310 can confirm whether or not the usage right of the situation information providing device 300 is authorized through ID and password authentication or biometric authentication such as fingerprint recognition and iris recognition by the user.

When the user performs the authority authentication procedure, the user authentication unit 310 verifies whether or not the user authority is verified through comparison with the stored user information, and when the user corresponds to the user who has the authority to use the situation information providing apparatus 300, The user information can be retrieved.

The user authentication unit 310 according to an embodiment not only enhances the security of using the situation information providing apparatus 300 through a user authentication procedure but also grasps the characteristics or capabilities of the user through user information confirmation Thereby enabling the situation information providing device 300 or the central control server 400 to transmit situation information or transmit control commands corresponding thereto. In addition, the user may retrieve data related to the stored user information, the predetermined usage mode for the user, or the usage history of the situation information providing apparatus 300 through the user authentication.

The camera unit 320 according to an embodiment provides actual image information such as a still image or a moving image with respect to an external subject through a camera.

That is, the camera unit 320 captures an actual image of the area of interest outside the context information providing apparatus 300, and transmits the actual image data of the captured area of interest to the analysis unit 330 or the display unit 340, As shown in FIG.

The analysis unit 330 may include an imaging information analysis unit 331 and a sensing information analysis unit 332 according to an embodiment of the present invention.

The photographing information analyzing unit 331 analyzes the photographed image data around the circumstance information providing apparatus 300 received from the camera unit 320 to analyze the surrounding environment for a region of interest.

Specifically, the photographing information analyzing unit 331 obtains, based on the photographed image data, spatial information on the area where the user is located, information on objects existing at the location, or motion information such as a target captured in the photographed image In addition, through this, it is possible to analyze and provide the user with the elements that can utilize the surrounding environment at the current location, that is, the location utilization information.

For example, the photographing information analyzing unit 331 according to an embodiment of the present invention analyzes characteristics of a region of interest, i.e., a user, through image data photographed by the camera unit 320, The optimum route of the user, or the utilization method of surrounding objects at the location, etc. When the motion of the target is photographed, it is possible to analyze the distance, speed, or anticipated route from the user of the target .

The photographing information analyzing unit 331 can analyze the position of the situation information providing apparatus 300, that is, the location information of the user through the photographed image data, as well as a separate Global Positioning System (GPS) module By mounting it, the position can be measured.

The sensing information analyzing unit 332 according to an embodiment receives and analyzes sensing information sensed from one or more sensor nodes disposed in the vicinity of the situation information providing apparatus 300 from a sensor node or a gateway.

The one or more sensor nodes may be disposed not only inside the photographable area of the camera unit 320 of the situation information providing device 300, that is, inside and outside the visible area. Therefore, information that is not directly recognized by the situation information providing device 300 can be collected through the sensing information of the sensor node.

The sensing information analyzer 332 receives sensor node identifier information or sensor node allocation information of each sensor node along with sensing information such as motion sensing information, target movement direction, or intrusion signal information from a plurality of sensor nodes, Based on the position and orientation of each sensor node, the position of the real-time target, the distance from the user, the movement path of the target, or the movement speed of the target can be analyzed and grasped.

Since the sensing information analyzing unit 332 collects sensing information from a plurality of sensor nodes, it is possible to accurately analyze the movement of the target as described above, Based on the result, it is possible to confirm whether the malfunction is occurred or not.

The display unit 340 may include an augmented reality display unit 341 and a situation information display unit 342. [

The augmented reality display unit 341 according to an exemplary embodiment may provide an image showing an actual peripheral image photographed by the camera unit 320 and position information of a target predicted according to the movement of the target sensed by the sensor node have.

That is, the augmented reality display unit 341 may superimpose the virtual target position image of the target that is not within the visible region in the actual image around the circumstance information providing apparatus 300, and provide the virtual target position image to the user. Therefore, the user can acquire information about a target existing outside the visible range, and can perform quick and accurate correspondence.

In addition, the augmented reality display unit 341 may notify that the target has reached a point recognizable by the camera unit 320 of the situation information providing apparatus 300 by differentiating the display method of the actual image and the virtual image .

For example, when the target motion is captured from the sensor nodes and the augmented reality display unit 341 displays the target motion according to the position of the sensor nodes that sensed the motion of the target, a target is displayed with a white point And when the target reaches the photographable area of the situation information providing device 300, the white point is modified to be a red point so that the user can recognize that the movement of the target is near.

The augmented reality display unit 341 according to another embodiment may generate a virtual image of the guitar sensing information sensed by the sensor node in addition to the movement of the target to provide an augmented reality image superposed with the actual image.

The augmented reality display unit 341 according to the embodiment of the present invention may display not only an augmented reality image in which an actual image and a virtual image are superimposed but also an actual peripheral image photographed by the camera unit 320, It is possible to separately provide each of the virtual target images analyzed based on the sensing information of the target.

The situation information display unit 342 displays information analyzed based on actual surrounding images photographed from the camera unit 320, information analyzed based on sensing information, or a situation information providing apparatus based on command information from a central control server It is possible to provide all information about the environment of the mobile terminal 300.

Specifically, as described above, the shooting information analyzing unit 331 determines whether or not the user is in a suitable place for hiding his or her body, the optimal moving line of the user, The analyzed information may be provided to the user through the status information display unit 342. [

In addition, the situation information display unit 342 can display the position of the target captured by the sensing information analysis unit 332, the distance from the user, the movement path of the target, the movement speed of the target, And the likelihood of appearance of targets by location. In addition, it is also possible to provide optimal user countermeasure information according to the target information.

The status information display unit 342 may receive the control command from the central control server 400 or may provide such information when the status information for the other area is received.

According to an embodiment of the present invention, the context information display unit 342 may provide a variety of context information to a user. The context information may include at least one of an actual peripheral image, Or an optimal movement path of the user through a point or a line on an augmented reality image superimposing the actual peripheral image and the virtual target image may be displayed and the motion information of the target, Probability of appearance of the target can be expressed numerically.

In summary, the augmented reality display unit 341 can superimpose an actual peripheral image of the current user position and a virtual target image representing the movement of the target predicted from the sensing information of one or more sensor nodes, The situation information display unit 342 can provide information about the surrounding situation analyzed from the analysis unit 330 and information received from the central control server.

The detection result processing unit 350 according to an embodiment determines the importance or severity of the current surrounding environment based on the information photographed or analyzed by the situation information providing apparatus 300, and, based on the determined importance or severity, To the other situation information providing device or the central control server.

In addition, the detection result processing unit 350 may record the countermeasure information of the user for each situation, so that the user can utilize the corresponding information of the user and the result information corresponding thereto when the similar situation information is later detected.

The acoustic information transceiver 360 according to an embodiment not only can receive a user's command through voice recognition of a user but also can provide context information to a user through voice.

In addition, the user may transmit and receive voice information to the user of the other situation information providing device 300 or the central control server 400 through the sound information transmitting and receiving unit 360.

The acoustic information transceiver 360 according to one embodiment may include a voice input or output module such as a microphone and an earphone.

The control unit 370 includes a user authentication unit 310, a camera unit 320, an analysis unit 330, a display unit 340, a detection result processing unit 350, an acoustic information transceiver 360, And a function of controlling the flow of data between the communication units 380 can be performed. That is, the control unit 370 according to the present invention includes a user authentication unit 310, a camera unit 320, an analysis unit 330, a display unit 340, a detection result processing unit 350, an acoustic information transceiver unit 360, And the communication unit 380, respectively.

The communication unit 380 according to one embodiment enables communication between the situation information providing apparatus 300 and an external apparatus. Specifically, the situation information providing apparatus 300 enables communication with the sensor node 100, the gateway 200, and the central control server 400.

FIG. 3 is a flowchart illustrating a method for providing context information based on a battlefield situation recognition according to an exemplary embodiment of the present invention. Referring to FIG.

When the user who intends to use the situation information providing apparatus 300 performs user authentication through a user ID and a password input method or a biometric authentication method, the situation information providing apparatus 300 compares user information (S310).

Meanwhile, the sensor node 100 collects sensing information such as an intrusion signal or motion information of a target by sensing surrounding sounds, operations, pressures, etc. (S320).

According to one embodiment, the sensor node 100 transmits sensor node data including the sensing information, sensor node identification information such as a separator of the sensor node 100 or sensor node identification information, to the gateway 200 To the situation information providing apparatus 300 (S330).

The sensor node 100 according to another embodiment of the present invention may transmit the sensor node data directly to the situation information providing apparatus 300 without going through the gateway 200. [

The situation information providing apparatus 300 collects actual image data of a video image of the vicinity of the apparatus (S340).

In operation S350, the situation information providing device 300 analyzes the sensing information of the sensor node data received in operation S330 and the image sensing information of the image data collected in operation S340, and generates the context information data.

Through the sensing information analysis, the situation information providing device 300 can predict the presence or absence of the intrusion signal detected in the vicinity of the area of interest, the movement of the target, the number of the targets, the movement path of the target or the moving speed of the target, Through the analysis, it analyzes the location information of the user, the spatial information, the information about the objects in the corresponding location, the location utilization information of the corresponding location, or the motion information of the target captured in the captured image can do.

The situation information providing device 300 generates the augmented reality image data by superimposing the virtual target image data representing the motion information of the target among the actual image data collected at S340 and the sensing information collected through the sensor nodes, And provides the user with the augmented reality image (S360).

According to an embodiment of the present invention, the central control server 400 may transmit a control command to each situation information providing apparatus 300 (S370). The central control server 400 transmits sensing information or photographing information or the like for one or more areas of interest through communication with one or more sensor nodes 100, one or more gateways 200 and one or more status information providing apparatuses 300 And may transmit the situation information about the other area outside the area of interest of the situation information providing device 300 to the situation information providing device 300. [ In addition, it is possible to transmit a user control command according to situation information of the other area to the situation information providing device 300.

The situation information providing apparatus 300 can provide various status information on the ROI generated in step S350, context information of another ROI received from the central control server 400, or control command information to the user (S380 ).

Then, the situation information providing device 300 determines the importance or severity of the situation information data and, in the case of the situation information data having the importance or severity higher than a certain standard, (S390), and transmits the detection result to the central control server (400) (S400).

Accordingly, if the user subsequently detects similar situation information, the user can perform a more efficient response based on the previously stored detection result data, i.e., the previous situation information data and the existing user response result information.

4 is a diagram illustrating an augmented reality image and a virtual target image display screen of the situation information providing apparatus 300 according to an embodiment of the present invention.

4A shows an image of an actual user's surroundings obtained through a camera module of the situation information providing device 300 carried by the user, sensing information sensed by the sensor nodes, or information received from the central control server A scene of the situation information providing apparatus 300 on which an augmented reality image in which a virtual target image superimposed on the predicted target position or movement is displayed is displayed.

Referring to FIG. 4A, the target is represented by a white circular point, which corresponds to a target of a position that can not be detected through the camera module of the situation information providing apparatus 300. When any one of the targets is located at a place where the camera module of the situation information providing device 300 can detect the target, the user recognizes that the target exists in the photographable area, i.e., the visible distance , The white circle point representing the target may be changed to another color or other form.

4B shows a screen of the situation information providing apparatus 300 showing only a virtual target image except the actual surrounding image data.

The virtual target image according to one embodiment can be provided in the form of a radar screen as shown in FIG. 4 (b). By dividing the virtual target image into a certain region according to the orientation and the distance, have.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included within the scope of the present invention.

100: sensor node
200: Gateway
300: situation information providing device
310:
320:
330: Analytical Department
331: photographing information analyzing unit
332: Sensing information analysis section
340:
341: Augmented reality display section
342: Situation information display section
350: detection result processing unit
360: Acoustic information transmission /
370:
380:
400: central control server

Claims (13)

A situation information providing apparatus for providing surrounding situation information on a user's interest area,
A camera unit for photographing a real image of the area of interest;
An image capturing information analyzing unit receiving image data from the camera unit and analyzing surrounding information based on an actual image of the area of interest;
Based on sensing information received from one or more sensor nodes disposed in or around the ROI, target intrusion information, target motion information, target movement path, target movement speed, target feature information, A sensing information analyzer for analyzing target information including at least one of position information or appearance possibility information of a target for each position; And
An augmented reality display unit for displaying an augmented reality image in which a virtual target image predicted according to an actual image received from the camera unit and target information received from the sensing information analysis unit is superimposed,
The photographing information analyzing unit,
The method according to any one of claims 1 to 3, further comprising the steps of: generating, based on the actual image, spatial information of the ROI, information on objects existing in the ROI, location information of the ROI, And analyzes surrounding information including at least one piece of motion information of the photographed target when the target is present. delete The method according to claim 1,
The status information including at least one of the surrounding information analyzed by the shooting information analyzing unit, the target information analyzed by the sensing information analyzing unit, the status information of the other area of interest received from the central control server or the control command information, And a status information display unit for displaying the status information. The method of claim 3,
The situation information display unit displays,
And displaying context information about the ROI through one or more of a method of displaying a figure or figure on the ARP image, a method of numerically displaying the character information, The status information providing device. The method according to claim 1,
And a user authentication unit for verifying whether the user is authorized to use the situation information providing apparatus through one or more of ID, password authentication, fingerprint authentication, or iris authentication method of the user. The method according to claim 1,
The importance information or the severity of the circumstance of the ROI is determined based on the situation information analyzed by the shooting information analyzing unit or the sensing information analyzing unit and whether or not the status information data is stored in its own storage or transmitted to the central control server And a detection result processing unit for determining the detection result processing unit. The method according to claim 1,
And an acoustic information transceiver for performing reception of a user command through speech recognition of the user or providing of the context information by voice. A situation information providing system for providing surrounding situation information on a user's interest area,
One or more sensor nodes for generating intrusion detection or motion detection of a target through motion detection sensing to generate sensing information;
A gateway for collecting one or more pieces of sensing information through the one or more sensor nodes and the wireless sensor network and transmitting the collected sensing information to a situation information providing device or a central control server outside the wireless sensor network;
A situation information providing device for capturing an actual image around the ROI, and providing context information about the ROI by analyzing the actual image and sensing information of the sensor node; And
The information processing apparatus according to any one of claims 1 to 3, further comprising: a status information collecting unit for collecting status information data for one or more interested areas from one or more status information providing apparatuses, And a central control server for transmitting a control command to the node or the situation information providing device,
The at least one sensor node comprises:
Wherein the location information is located within the area of interest or around the area of interest. delete 9. The method of claim 8,
The gateway comprises:
Wherein the sensor node collects delimiter information for each of the sensor nodes or arrangement information of the sensor nodes and transmits the collected information to the status information providing device or the central control server,
The situation information providing apparatus includes:
Wherein the sensing information analyzing unit analyzes the sensing information based on the delimiter information or the layout information of each sensor node received from the gateway so as to grasp accurate positional information or movement route information of the target. A method for providing context information on a region of interest of a user, the method comprising:
(a) collecting at least one sensing information sensed from one or more sensor nodes disposed within the ROI or the ROI;
(b) capturing actual image data including photographing information of the ROI by photographing the ROI;
(c) analyzing the shooting information or the sensing information and analyzing the situation information on the ROI;
(d) generating and providing augmented reality image data by superimposing the imaging information and virtual target image data predicted from the sensing information analysis; And
(e) information on the object in the ROI, information on the location of the ROI in the ROI, information on the location of the ROI in the ROI, The target motion information, the movement path of the target, the movement speed of the target, the characteristic information of the target, the expected position of the target, or the possibility of appearance of the target by each position, And providing context information for the region of interest,
Before the step (a)
And checking whether the user has the right to use the situation information providing apparatus through one or more of ID, password authentication, fingerprint authentication, or iris authentication method of the user. delete 12. The method of claim 11,
Prior to step (e)
And receiving from the central control server one or more pieces of information of status information or control command information of another area of interest,
The status information provided in the step (e)
And the status information of the other area of interest or the control command information received from the central control server.

Images