KR20220100245A - Life safety management system using augmented reality technology - Google Patents

Abstract

The present invention relates to a life safety management system using augmented reality technology. The life safety management system according to the present invention comprises: a data collection device installed in the city to collect safety-related data in an installation area; an integrated control server for collecting the data from the data collection device and performing city control; a user terminal connected to the integrated control server and installed with a user safety application for performing data communication with the integrated control server; and a manager terminal connected to the integrated control server and installed with a manager safety application for performing data communication with the integrated control server. The integrated control server transmits an augmented reality element associated with a location of an event to the user terminal and manager terminal within a predetermined radius from the location where an event occurred when the event containing a risk factor is detected from the data collection device. The user safety application and the manager safety application display the augmented reality elements transmitted from the integrated control server on each display screen. Accordingly, information related to citizen safety can be provided to citizens using augmented reality technology.

Description

Life safety management system using augmented reality technology {LIFE SAFETY MANAGEMENT SYSTEM USING AUGMENTED REALITY TECHNOLOGY}

The present invention relates to a life safety management system using augmented reality technology, and more particularly, to a life safety management system using augmented reality technology that functions so that city citizens can lead a safe life.

Recently, each local government in the country applies smart city-related projects from the planning when constructing new cities to develop a smart city. A smart city is a city in which infrastructure such as transportation, environment, housing, and facilities induced in city life using advanced information and communication technology (ICT) is connected to every corner of the city like a human neural network, and citizens enjoy a convenient and pleasant life. It means a "smart city" that allows you to enjoy

In a city where many people live in a limited space and various activities occur, urban problems such as lack of infrastructure and aging, traffic congestion, increased energy consumption, environmental pollution, crime, and disasters are occurring. However, as the problem solving through physical methods such as the supply of new infrastructure has reached its limit, smart city is emerging as a new alternative, and it aims to solve urban problems and improve the quality of life of citizens through technology.

A smart city begins with the construction of a city control system that combines smart technology, IoT technology including CCTV, and an integrated control room that manages it. In general, various smart devices such as hazardous facility safety management system, special school, safety care for children and the elderly, smart intersection notification, parking stop enforcement system, unauthorized dumping monitoring, flood management system, underground facility management, fine dust notification, snow removal vulnerable area service, etc. The business is operated from the integrated control room.

However, since the currently operating smart city focuses on integrated control, the information obtained from the integrated control room is not provided to the citizens composing the city. have.

Augmented reality technology is a technology that superimposes virtual objects such as text or graphics on the real world and displays them as one image. Augmented reality technology was in the R&D and test application stage until the mid-2000s, but has recently entered the commercialization stage as the technological environment has been established. In particular, with the recent emergence of smartphones and the development of Internet technology, augmented reality technology has begun to attract attention.

The most common method of implementing augmented reality is to take a picture of the real world using the camera of a smartphone and overlay and output computer graphics generated thereon, thereby making the user feel as if virtual and reality are mixed. In this method, most augmented reality applications are being implemented in smartphones because the user can easily acquire a real image using the camera of the smartphone and computer graphics can also be easily implemented through the computing function of the smartphone.

Such augmented reality technology refers to a technology that shows a virtual object on top of the real world projected by the camera. By simultaneously providing content related to the image of the real world input by the camera, the user can use a more realistic service, and it has the advantage of being able to accurately deliver a lot of useful information to the user.

As described above, the present invention can provide citizens with information related to citizens' lives, particularly information related to citizens' safety, among the information obtained from the integrated control room that operates the smart city in connection with the smart city using augmented reality technology. An object of the present invention is to provide a life safety management system using augmented reality technology.

According to one aspect of the present invention to achieve the above object, there is provided a life safety management system using augmented reality technology. The life safety management system includes: a data collection device that is installed in a city and collects safety-related data of an installed area; an integrated control server that collects data from a data collection device and performs city control; a user terminal connected to the integrated control server and installed with a user safety application for performing data communication with the integrated control server; and a manager terminal connected to the integrated control server and installed with a manager safety application for performing data communication with the integrated control server, wherein the integrated control server detects an event containing a risk factor from the data collection device. The augmented reality element associated with the event location is transmitted to the user terminal and the manager terminal within a predetermined radius from the location, and the user safety application and the manager safety application are configured to display the augmented reality element transmitted from the integrated control server on each display screen. .

In the above aspect, the user safety application includes a dangerous situation determination module for determining the user's dangerous situation, the dangerous situation determination module analyzes the detection data from the acceleration and angular velocity sensors provided to the user terminal, and the user's movement is detected If not, it is considered a dangerous situation.

Also in the above aspect, the user safety application includes an emergency call module configured to notify the integrated control server of a rescue request together with the user's current location information if the user's movement is not detected in the dangerous situation determination module.

In addition, in the above aspect, the emergency call module is manually operable by the user, and when the user manually operates the emergency call module, the emergency call module notifies the integrated control server of the rescue request together with the user's current location information. is composed

In addition, in the above aspect, the user safety application further includes a location inquiry module, the location inquiry module integrates one or more of the location information where the event occurred, the location information where the CCTV is installed, and the location information where the emergency bell is installed. is configured to request, the integrated control server transmits the augmented reality element corresponding to the location information requested by the user to the location inquiry module of the user's terminal, and the location inquiry module displays the received augmented reality element on the display of the user terminal is composed

Also in the above aspect, the user safety application further comprises an augmented reality navigation module, the augmented reality navigation module acquires the current user's position and direction information through the compass module and the accelerometer and gyroscope module installed in the user terminal, and augmented The reality navigation module transmits the current location information and direction information of the user terminal to the integrated control server, receives an augmented reality element corresponding to the location and direction of the user terminal from the integrated control server, and the received augmented reality element is the user terminal is displayed on the display unit of the user terminal together with the image frame taken at the position and direction of

According to the present invention, augmented reality technology that can provide citizens with information related to citizens' lives, particularly information related to citizens' safety, among information obtained from an integrated control room that is connected to a smart city and operates a smart city using augmented reality technology It is possible to provide a life safety management system using

1 is a view showing the overall configuration of a life safety management system using augmented reality technology according to the present invention;
Figure 2 is a view for explaining the data collected between the data collection device, the gateway and the integrated control server in the life safety management system using the augmented reality technology according to the present invention;
3A is an explanatory diagram for explaining a process of receiving DGPS location information from a user terminal (or a manager terminal) in the life safety management system according to the present invention;
3B is an explanatory diagram for explaining a process of receiving RTK GPS location information from a user terminal (or a manager terminal) in the life safety management system according to the present invention;
4 is a block diagram schematically showing a functional structure of a user application in the life safety management system according to the present invention;
5 is a view for explaining a method used for allocating a manager in charge when an emergency event occurs in the life safety management system according to the present invention;
6 is a view for explaining a location inquiry function provided to a user safety application in the life safety management system according to the present invention; and
7 is a view for explaining the AR navigation function provided to the user safety application in the life safety management system according to the present invention.

Advantages and features of the present invention, and methods of achieving them, will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various different forms.

In the present specification, the present embodiment is provided to complete the disclosure of the present invention, and to completely inform those of ordinary skill in the art to which the present invention pertains to the scope of the present invention. And the invention is only defined by the scope of the claims. Accordingly, in some embodiments, well-known components, well-known operations, and well-known techniques have not been specifically described in order to avoid obscuring the present invention.

Like reference numerals refer to like elements throughout. In addition, the terms used (mentioned) herein are for the purpose of describing the embodiments and are not intended to limit the present invention. In this specification, the singular also includes the plural, unless specifically stated otherwise in the phrase. In addition, elements and operations referred to as 'include (or include)' do not exclude the presence or addition of one or more other elements and operations.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. Also, terms defined in commonly used dictionary are not to be interpreted ideally or excessively unless defined.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a view showing the overall structure of a life safety management system (1) using augmented reality technology according to the present invention. As shown in Fig. 1, the life safety management system 1 using augmented reality according to the present invention is installed in the city and is a data collection device (or IoT device) 10 for collecting safety management data, a data collection device ( 10) an integrated control server 50 for receiving data from the big data and performing integrated control services based thereon; It includes a user terminal 20 and a manager terminal 30 for receiving safety management information from the integrated control server (50).

The data collection device 10 may refer to an IoT device installed in a city to collect various types of information and a gateway connected thereto, as shown in FIG. 2 . IoT device may mean, but is not limited to, a sensor that detects specific data or events, and includes CCTV installed in a city, smoke detection sensor, fire detection sensor, motion detection sensor, illuminance detection sensor, quantity or water level detection sensor, and various sensors such as a parking detection sensor and the like.

The data collection device 10 composed of various sensors is connected to the gateway 100 in order to transmit the collected data to the integrated control server 50, for example, the gateway and several IoT devices 10 communicate with Zigbee. , Bluetooth communication, RF443MHz communication, RF447MHz communication, Wifi communication, RFID (radio frequency identification) communication, Ethernet communication, USB communication, serial communication, etc. can communicate with each other. The communication method between the gateway and the IoT devices is not limited to the above exemplified method, and various communication methods may be used within a range obvious to those skilled in the art.

Data collected from the data collection device 10 is transmitted to the integrated control server 50, and the transmitted various data is classified and stored in a database.

The user terminal 20 is configured to access the integrated control server 50 to receive and display IoT device-related data on the screen. The user terminal 20 may include not only a smartphone, but also various devices capable of receiving data by accessing the integrated control server 50 , for example, a desktop PC, a tablet PC, a wearable device, a notebook computer, and the like.

For convenience of description, the user terminal 20 is shown as one, but the user terminal 20 may be a plurality, and the user terminal 20 has a dedicated application to receive the service provided from the integrated control server 50 . This can be installed.

The application installed in the user terminal is operated to generate information about its current location and to perform a safety service based on data related to its current location. For location information in the user terminal 20 , any one of a GPS method, more preferably an RTK GPS or a DGPS method, may be used.

3A is an explanatory diagram for explaining a method for receiving a DGPS-based location in the user terminal 20 . As shown in Fig. 3A, the DGPS receiver 20a is designed to be able to communicate with a GPS satellite 20b and a DGPS reference station 20c to obtain GPS coordinates.

The GPS satellite 20b may be presented for military and civilian purposes such as weapon guidance, navigation, surveying, cartography, geodetic, time synchronization, etc., as is currently known, and in this embodiment, location information and navigation information to the user It is natural that it is applied as a private use that can provide

The DGPS reference station 20c is configured to calculate an error amount included in the measured GPS pseudorange using location information of a known reference point, and transmit the calculated error information to the user.

For reference, the user can improve the positional accuracy with an error of several tens of centimeters to several meters by using the received error information by the data transmitted from the DGPS reference station 20c. In particular, the DGPS calculates the difference between the pseudorange of the reference station receiver and the pseudorange calculated based on the location of the reference station, and provides the value to the user for each satellite.

The user can calculate a more accurate position by removing the error of the user-side receiver using the received correction information. As for these DGPS reference stations, the Ministry of Oceans and Fisheries is currently providing NDGPS (Nation-Wide DGPS) service to 11 coastal reference stations and 6 inland reference stations nationwide.

The DGPS receiver 20a operates as a device for providing location information and navigation information to the user terminal 20 . The DGPS receiver 20a calculates the current position coordinates by using the GPS data and the DGPS correction data received through the GPS satellite 20b and the DGPS reference station 20c, and uses the calculated position coordinates for the application of the user terminal 20 is configured to be sent to

The application of the user terminal 20 is configured to perform the safety management service from the integrated control server 50 using the current location information received from the DGPS receiver 20a.

3B is an explanatory diagram for explaining a method of receiving an RTK GPS-based location in the user terminal 20 . As shown in FIG. 3B , the user terminal 20 is configured to communicate with the GPS satellite 20b and the GPS base 30a to obtain GPS coordinates.

The GPS satellite 20b may be presented for military and civilian purposes such as weapon guidance, navigation, surveying, cartography, geodetic, time synchronization, etc., as is currently known, and in this embodiment, location information and navigation information to the user It is natural that it is applied as a private use that can provide

The GPS base 30a operates as a reference point that knows its latitude/altitude/longitude location information in advance. Since the GPS base 30a knows its location/altitude/longitude information in advance, it compares the location information received from the GPS satellites 20b with its own location information (reference information) known in advance and receives GPS error is calculated.

The GPS base 30a transmits the calculated GPS error information to a nearby GPS terminal, ie, the user terminal 20, through wireless communication such as an RF method, for example, a network, UHF RF, or WIFI.

The user's terminal 20 can calculate a more accurate position by removing the error of the user's receiver using the received GPS error information.

As shown in FIG. 3B , the GPS bases 30a and 30b may be installed one by one for each zone in the smart city. Each of the GPS bases 30a and 30b is designed to have respective coverage and some coverage may overlap. The user terminal or the GPS receiver 20 receives GPS error information through wireless communication with the GPS bases 30a and 30b having high signal strength, and corrects the error of its own GPS information so that accurate current location information can be confirmed. do.

The GPS bases 30a and 30b can be applied to street lights installed in smart cities, and are typically configured to have an RF communication radius between 100m and 200m. In the present invention, the GPS bases 30a and 30b are installed at regular intervals, the user's location can be more accurately specified through the improved location information based on the RTK GPS, and various services as described below can be provided. be able to

4 is a functional block diagram illustrating the main functions of the safety application 200 that is installed in the user terminal 20 and communicates with the integrated control server 50 as described above. As shown in Figure 4, the safety application 200 is a GPS transceiver module 210 for transmitting location information to the integrated control server 50; In the dangerous situation determination module 220, the dangerous situation determination module 220 for determining a dangerous situation from data collected from a sensor installed in the user terminal 220 or a sensor provided to a user wearable device (for example, a smart watch) an emergency call module 225 for generating an emergency signal based on the result; A screen sharing module 230 for sharing a screen with a control room or an administrator terminal, a location inquiry module 240 and a location inquiry module for inquiring the location of a predetermined location or a place where a dangerous event occurs, such as a CCTV or emergency bell It includes an AR navigation module 245 for executing the augmented reality-based navigation to the place inquired in 240 .

The GPS transmission/reception module 210 is configured to transmit DGPS or RTK GPS-based location information to the integrated control server 50 when necessary, as described above. The location information is transmitted by a request from the integrated control server 50, or when the emergency call module 225 is used, the location inquiry module 240 is used, and the AR navigation module 245 is used when the integrated control server 50 is used. It may be transmitted automatically, or it may be configured to periodically update the user's current location by automatically transmitting it to the server at predetermined time intervals.

The dangerous situation determination module 220 receives detection data from various sensors installed in the user terminal 20 or a user wearable device such as a smart watch, for example, an acceleration and angular velocity sensor (IMU sensor), a heart rate sensor, and a motion detection sensor. Analyze and when it is determined that the user is in a dangerous situation, it is configured to transmit it to the emergency call module 225 .

For example, the IMU sensor refers to one integrated sensor unit consisting of an accelerometer capable of measuring movement inertia, a gyrometer capable of measuring rotational inertia, and a magnetic field capable of measuring an azimuth, and the IMU sensor is a three-dimensional Each sensor (acceleration, gyro, geomagnetic field) consists of 3 axes to measure free movement in space, and the acceleration and angular velocity on the user's posture state (3 axes (x-axis, y-axis, z-axis) are detected. do.

값(SMV값)이 3.85보다 크며, 50 프레임 안에 5번 이상일 경우 그리고 5번의 간격의 표준편차가 0.1보다 낮을 경우 위험 상황 판단 모듈(220)은 비상호출 모듈(225)에 이를 통보하도록 구성된다. 이는 3축 가속도 값 (x,y,z)를 기반으로 SMV 값을 계산하였을 때, 피크 값은 최소 3.85로 나타났고, 또한 50프레임 안에 5번 이상으로 지정한 이유는 피크값 간의 간격이 약 10프레임으로 조사되었기 때문이다. The dangerous situation determination module 220 is configured to detect a state in which the user has lost consciousness, from the IMU sensor on three axes.

When the value (SMV value) is greater than 3.85, more than 5 times within 50 frames, and when the standard deviation of the interval of 5 times is lower than 0.1, the dangerous situation determination module 220 is configured to notify the emergency call module 225 of this. When the SMV value was calculated based on the 3-axis acceleration value (x, y, z), the peak value was at least 3.85, and the reason why it was designated as 5 or more times within 50 frames is that the interval between the peak values is about 10 frames. because it was investigated.

Also, in the case of SMV of angular velocity, when there is no motion, a positive real value close to 0 appears, and when motion occurs, that is, when rotation of the device occurs, the value increases as the rotation speed increases. If the SMV of the angular velocity is greater than 5.5 deg/s, it is considered to be in motion, whereas if the SMV of the angular velocity is less than 5.5 deg/s, it may be considered as motionless. However, when the actual user moves, the device rotation is momentarily small, so the SMV of the angular velocity is less than 5.5 deg/s, which can be considered as no movement. To prevent this, an intermediate counter variable is added. If the SMV of the angular velocity is greater than 5.5, 1 is added to the counter variable. Conversely, if the SMV of the angular velocity is less than 5.5, the counter variable is decremented by 1. The counter variable has a range from 0 to 20, and when the counter variable is less than 3, it is considered that there is no movement, and the dangerous situation determination module 220 may consider that the user is in a state of no movement.

The dangerous situation determination module 220 determines the user's risk based on the SMV value based on the 3-axis acceleration value (x, y, z) as described above, or determines the user's risk based on the value of the angular velocity Alternatively, a combination of both can be used to more accurately determine the user's risk.

The emergency call module 225 is automatically executed when it is determined that the dangerous situation is in a dangerous situation by the dangerous situation determination module 220 to transmit a rescue request signal together with the user's current location information to the integrated control server 50 . When a rescue request signal is received from the user, the integrated control server 50 displays an emergency rescue signal including the user's location information on the control monitor of the integrated control room, and at the same time displays the user's location information and the user's location information on the manager terminal 30 closest to the user's location information. It transmits a rescue command or transmits a rescue command to the manager terminal 30 located in the vicinity of the user's location information (eg, within a radius of 500 m) so as to rescue the user's dangerous situation.

The emergency call module 225 may be automatically executed according to the determination result of the dangerous situation determination module 220, but the present invention is not limited thereto, and occurs even when the user directly clicks the emergency call button provided on the screen of the safety application It can be configured to be

It is provided for use when exposed to risks from relatively vulnerable groups such as children, the elderly, and women. When the user clicks the emergency call button, the emergency call module generates a rescue request signal along with the user's current location information as in the previous automatic execution, which is immediately transmitted to the integrated control server 50 and the integrated control server A rescue command is transmitted along with the user location information to the manager terminal 30 near the user.

The safety application according to the present invention also includes a screen sharing module 230 . The screen sharing module 230 is configured to transmit a screen image captured by a camera driving function provided to the safety application to the integrated control server 50, and the integrated control server 50 transmits the screen image transmitted from the user to the control room. Based on the control monitor and the location information of the user, it operates to share the video to the manager terminal 30 located close to the user who has transmitted the video.

The screen sharing function by such a screen sharing module prevents accidents in advance or serious property and The advantage of reducing human casualties can be obtained.

When the integrated control server 50 detects a problem through CCTV installed in the city, receives an emergency call signal received from a user's application, or receives a problem by a screen sharing module, an event occurs in one or more administrator terminals close to the event location configured to transmit a signal.

5 is an explanatory diagram for explaining the manager call function based on the priority in the integrated control server (50). As shown in FIG. 5 , when an event occurs in place A, the integrated control server 50 first determines the point location (coordinate) for the event location and determines the event location. After the event occurrence location is determined, the integrated control server 50 first searches for a manager terminal in the vicinity of the event occurrence location (eg, a radius of 500m). In the exemplary screen of FIG. 5 , the first to third manager terminals are found within a radius of 500 m (arrival time to the event location: within 5 minutes). In the case of the fourth manager terminal, since it does not exist within a predetermined radius, it is excluded from the target for event processing.

Thereafter, the integrated control server 50 inquires the work history of the first to third manager terminals. If the first manager terminal is currently moving to the location B to process another event, the first manager terminal is excluded from the event processing target and the work history of the second to third manager terminals is inquired. If the second manager terminal is currently performing other event processing or is moving for other event processing, the integrated control server 50 determines the third manager terminal located the farthest as a terminal for event processing, and determines the location information for the point A and They are ordered to go to the place together.

On the other hand, if the first to third manager terminals are moving to another event occurrence location or are currently processing other events, the integrated control server 50 searches a wider radius (for example, a radius of 750 m) and searches for other manager terminals (first 4 manager terminal), and if there is, instructs the fourth manager terminal to go to the corresponding place together with location information for point A.

If the fourth manager terminal does not exist within the extended radius, the integrated control server 50 compares the currently ongoing event details of the first to third manager terminals with the newly generated event details and reassigns priorities. That is, if the currently generated event has a risk of leading to a major accident such as a fire or gas leak, or if an emergency is required such as lifesaving, the integrated control server 50 sends an event to the first manager terminal closest to the point A. After mobilizing to location A first, it is re-instructed to mobilize to event location B.

If the event B currently being performed by the first manager terminal has a higher priority or the same priority as the newly generated event A, the integrated control server 50 searches for another manager terminal and is configured to change the event processing based on the priority. .

In addition, the screen sharing module 230 provided for the safety application according to the present invention is configured to allow multi-user screen sharing. When the screen image captured by the screen sharing module 230 is transmitted to the integrated control server 50, the integrated control server 50 transmits the screen image transmitted from the user to the control monitor of the control room, and is located close to the image transmission user. In addition to performing sharing to the manager terminal 30, it may be set to share it on the screen of a user who uses the same safety application in the vicinity of the user.

When a problem is found in the city, when the user shares it through the screen, the integrated control server 50 receives it and allows application users around the user to participate, thereby helping to make better decisions. In the case of an emergency patient, by allowing doctors located in the vicinity to participate in one channel, the advantage of being able to solve problems through collective intelligence including the recognition and cooperation of multiple users can be obtained.

In addition, as a function implemented by the screen sharing module, it is possible to solve problems that always exist in the city, for example, illegal parking, illegal dumping of garbage, and damage to public property. For example, when a user discovers a vehicle that is illegally parked, the user may report it directly to the control center through the screen sharing module 230, or report a crime scene to the control center in real time through the screen sharing module. The advantage that there is can also be obtained.

The location inquiry module 240 may be configured to inquire a predetermined location in the city center or an event occurrence location generated by the emergency call module 225/screen sharing module 230 .

The location inquiry module 240 is configured to inquire location information such as a predetermined location, for example, a CCTV location in the city, an emergency bell location in the city, a location of a tourist attraction in the city, etc. through the integrated control server.

For example, when the user wants to inquire the location of the CCTV in the city center as shown in FIG. 6 , the location inquiry module 240 integrates control of the CCTV location inquiry request together with its own location information through the GPS transmission/reception module 210 . It is transmitted to the server, and the integrated control server 50 displays the CCTV location around the user based on the user's location using a virtual reality icon.

The location inquiry module 240 is a GPS module, object-based recognition module, compass module, accelerometer and gyroscope module, camera, etc. hardware will be used.

The camera module captures the surrounding image and displays it on the user's display screen, and the GPS transceiver module 210 is used to determine the user's current location. The compass module is used to identify the orientation of the mobile device, and the accelerometer and gyroscope module are used to check the tilt of the mobile device and distribute icons in space.

AR technology is used by integrating information including camera data, location data, and sensor data (magnetic field, accelerometer, rotation vector), etc. For example, Google's Android mobile operating system API (application programming) that provides this information interface) components may be employed.

Location-based information/services functionality encompasses a general class of computer program-level services used to include specific control over location and time data as control features of computer programs and mobile applications.

In one embodiment, location-based information and related services are components of a mobile application. In one embodiment, the location-based service component includes the following Google's Android mobile operating system API components: (1)Access_Fine_Location, (2) Location Provider, (3)Location Listener, (4) Location Updates, (5) This can be done by incorporating Reverse GeoCodings.

Object-based recognition involves finding a specified object in an image or video sequence in computer vision. In one embodiment, object-based recognition is an algorithm that performs the following operations: (1) extracting details/features from a continuous live view stream, (2) comparison with an existing photo database, and (3) immediate delivery of results. This can be done by using

The present invention is implemented using a location-based information module, and the location inquiry module acquires location information of the object of interest (CCTV) from the integrated control server.

Meanwhile, in another embodiment of the present invention, when an object-based recognition module is used, the location inquiry module discovers each POI as a designated object in the physical location image. While running the location lookup module, this function continues to extract features and attributes, and after running a comparison search against an existing image database, the function “recognizes” the POIs and calls a label to identify the location of each POI. can

In addition, in the present invention, when an accident such as a fire, earthquake, traffic accident, or explosion occurs in the city by the data collection device in the integrated control center, the integrated control server 50 determines the location of the accident and is within a certain range from the location of the accident. configured to transmit incident location information to safety application users.

From the user's point of view, the accident location is received through the safety application, and the user can identify the accident location through the virtual reality icon through the location inquiry module, and movement to the accident location can be prevented.

Also, the location inquiry module 240 may be used to share its current location with other users. In addition, the location inquiry module 240 is configured to allow the user to check the current location of another user. This can be used between users who are allowed to share their location through the application.

The user can be implemented by entering the ID of the user who wants to allow location sharing through the application and remembering it in the assignment server. For example, the first user who wants to share the location registers the ID of the second user who wants to share the location with the integrated control server 50 .

Thereafter, the integrated control server 50 checks whether to share the GPS information with the first user through the second user's application, and when the location sharing is confirmed from the second user, the first user's GPS value of the second user It may be implemented by transmitting to the terminal, and transmitting the GPS value of the second user to the terminal of the first user.

Such a location sharing function makes it possible to more precisely search for a desired user's location in the current city, and may also be used to find young children and elderly people with dementia when they are lost or unable to locate them.

In addition, in the present invention as described above, since the location of the user can be specified, citizen participation can be activated by using the application in case of an emergency. After the user is issued an ID from the integrated control server through the application, the current location information can be shared with the integrated control server, thereby enabling more citizen participation.

For example, when an emergency occurs in a specific place, for example, when an event such as a citizen collapse is detected through CCTV, the integrated control server searches for the current location of the user who shared the location with the integrated control server and searches for users within a certain distance. By notifying the location information of the place where the event occurred to the user, the user can know the status of the event and can participate more actively.

In addition, when the user moves to the event location, the AR navigation module 245 may be used, which will be described later.

7 is a view for explaining the AR navigation module 245 using the augmented reality icon. As shown in FIG. 7 , the AR navigation module 245 provides directions to a specific location where the event occurred, a specific location designated by the user, or a specific location inquired through the location inquiry module 240 by the augmented reality guide. configured to perform

The AR navigation module 245 of the user terminal 20 processes image data (image frame) captured at the current location and direction of the user terminal in the route guidance mode or the shooting mode. The processed image frame may be displayed on the display unit of the user terminal 20 .

The GPS transmission/reception module 210 of the user terminal acquires the user's GPS location information, and the current user's location and direction information (eg, azimuth or geomagnetic information) through the compass module and the accelerometer and gyroscope module installed in the user terminal. acquire

The AR navigation module 245 of the user terminal 20 transmits the current location information and direction information of the user terminal to the integrated control server through the wireless communication unit, and receives AR information corresponding to the location and direction from the server to the user terminal. The received AR information may be displayed on the display unit of the user terminal together with the image frame captured at the location and direction. Such an operation is repeatedly performed until the user terminal 20 reaches the destination, and when the destination is reached, the AR navigation module ends the navigation.

The navigation function using AR information like this can be used when a manager unfamiliar with on-site geographic information is dispatched to the site of an accident, or a citizen who wants to help the site by receiving an emergency call signal generated through an application goes to the site. It can be very useful as it provides very quick directions when you want to approach.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible from the above description by those skilled in the art. For example, the described techniques are performed in an order different from the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims should be construed as falling within the scope of the following claims.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible from the above description by those skilled in the art. For example, the described techniques are performed in an order different from the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims should be construed as falling within the scope of the following claims.

10: data collection device 20: user terminal
30: administrator terminal 50: integrated control server
200: user application 210: GPS transceiver module
220: dangerous situation determination module 225: emergency call module
230: screen sharing module 240: location inquiry module
245: AR navigation module

Claims (6)

In the life safety management system using augmented reality technology,
a data collection device installed in the city to collect safety-related data in the installation area;
an integrated control server that collects data from the data collection device and performs city control;
a user terminal connected to the integrated control server and installed with a user safety application for performing data communication with the integrated control server; and
A manager terminal connected to the integrated control server and installed with a manager safety application for performing data communication with the integrated control server,
When the integrated control server detects an event including a risk factor from the data collection device, the augmented reality element associated with the event location is transmitted to the user terminal and the manager terminal within a predetermined radius from the location where the event occurred,
The user safety application and the manager safety application, characterized in that configured to display the augmented reality element transmitted from the integrated control server on each display screen
Life safety management system using augmented reality technology.
The method of claim 1,
The user safety application includes a dangerous situation determination module for determining the user's dangerous situation,
The dangerous situation determination module analyzes the detection data from the acceleration and angular velocity sensors provided to the user terminal and determines that the user's movement is in a dangerous situation if no movement is detected.
Life safety management system using augmented reality technology.
3. The method of claim 2,
The user safety application includes an emergency call module configured to notify the integrated control server of a rescue request along with the user's current location information if the user's movement is not detected in the dangerous situation determination module
Life safety management system using augmented reality technology.
4. The method of claim 3,
The emergency call module is manually operable by a user, and when the user manually operates the emergency call module, the emergency call module is configured to notify the integrated control server of a rescue request together with the user's current location information.
Life safety management system using augmented reality technology.
4. The method of claim 3,
The user safety application further comprises a location inquiry module,
The location inquiry module is configured to request one or more of the location information where the event occurred, the location information where the CCTV is installed, and the location information where the emergency bell is installed, to the integrated control server,
The integrated control server transmits the augmented reality element corresponding to the location information requested by the user to the location inquiry module of the user's terminal,
The location inquiry module is configured to display the received augmented reality element on the display of the user terminal.
Life safety management system using augmented reality technology.
6. The method of claim 5,
The user safety application further comprises an augmented reality navigation module,
The augmented reality navigation module acquires the current user's location and direction information through the compass module and the accelerometer and gyroscope module installed in the user terminal,
The augmented reality navigation module transmits the current location information and direction information of the user terminal to the integrated control server,
Receive an augmented reality element corresponding to the location and direction of the user terminal from the integrated control server,
The received augmented reality element is displayed on the display unit of the user terminal together with the image frame taken from the location and direction of the user terminal.
Life safety management system using augmented reality technology.

Images