KR101968607B1 - System and method for broadcating real-time disaster using mobile device - Google Patents

Abstract

Disclosed are a real-time disaster broadcasting system using a mobile device, and a method thereof. According to the present invention, the real-time disaster broadcasting system using a mobile device comprises: a slave terminal for generating a photographed image; a master terminal for generating a broadcasting channel for providing a broadcasting image for the slave terminal, displaying a library for the photographed image received from the slave terminal connected to the same broadcasting channel, and transmitting any one of a plurality of photographed images configuring the library, selected by control of a user as the broadcasting image; and a management server for controlling the broadcasting image to be streamed to the slave terminal, controlling to change the photographed image photographed by the slave terminal positioned at the closet to a place where event information is generated, into the broadcasting image when the event information on a disaster situation or an emergency situation is confirmed as generated, and controlling to display an augmented reality object indicating an evacuation path and an evacuation place on the changed broadcasting image.

Description

TECHNICAL FIELD [0001] The present invention relates to a system and method for real-time disaster broadcasting using a mobile device,

The present invention relates to a real-time disaster broadcasting system and method using a mobile device, and more particularly, to a real-time disaster broadcasting system and a real-time disaster broadcasting system using a mobile device for streaming to a viewer using an image captured by a terminal located in a disaster or an emergency scene .

Recently, information providing technology for streaming multimedia data through the Internet has been actively used, and streaming service using such information providing technology has been widening the range of services in connection with wireless networks targeting mobile communication terminals. Streaming technology is being actively used because most users do not have a fast connection line to download large multimedia files instantly. Streaming technology allows a user's browser or plug- Data can be output, so that even if there is no quick access line, multimedia files can be used immediately. In recent years, techniques for providing group school excursions, events of local governments, or site conditions in disaster areas have been studied using streaming technology.

Especially, the disaster management technology that provides the situation of the disaster area using the streaming technology is very effective and efficient in the technology where the IT infrastructure such as Korea is well established, It is attracting attention in terms of. However, the existing disaster management technology is inconvenient in using the location and form of the disaster generated only by giving information to the person in an unprocessed state. As a result, studies are being conducted to use disaster management technology more conveniently and efficiently, and to provide disaster information more accurately.

Korean Patent No. 10-1377184 Korean Patent Publication No. 10-2016-0008336

One aspect of the present invention provides a real-time disaster broadcasting system and method using a mobile device that broadcasts a disaster situation in real time using a mobile device and provides a user's evacuation route guidance service at a disaster site.

The technical problem of the present invention is not limited to the technical problems mentioned above, and other technical problems which are not mentioned can be understood by those skilled in the art from the following description.

A real-time disaster broadcasting system using a mobile device according to an embodiment of the present invention includes a slave terminal for generating a shot image, a slave terminal for generating a broadcast channel for providing a broadcast image to the slave terminal, A master terminal for displaying a library of photographed images received from the slave terminal and sending out one of the plurality of photographed images constituting the library to the broadcast image selected by the user's control, If the event information is found to be generated in the event of a disaster or an emergency, control is performed so that the shot image photographed by the slave terminal located closest to the place where the event information is generated is changed to the broadcast image , Evacuation route and evacuation site The indicating includes a management server for controlling to display an augmented reality objects to the changed broadcasting image.

The management server may control the broadcasting image to be streamed to an associated terminal that is interlocked with a slave terminal located closest to the place where the event information is generated.

The management server may display an outline of the evacuation place included in the broadcast image as an augmented reality object or display an evacuation path for moving to the evacuation place as an augmented reality object.

The at least one of the outline of the evacuation site indicated by the augmented reality object and the evacuation path may vary in color and thickness according to the distance from the current position on the broadcasting screen.

Wherein the management server analyzes location information of the master terminal and the slave terminal connected to the same broadcast channel and confirms that the master terminal and the slave terminal are not located within a reference radius centering on a place where the event information is generated , It is possible to control that a broadcast image of a channel belonging to another master terminal or another slave terminal located within the reference radius is streamed to a terminal connected to the broadcast channel.

The management server periodically collects the location information of the master terminal and the slave terminal connected to the same broadcast channel and controls the broadcast image to change in real time when event information is generated.

In addition, a real-time disaster broadcasting method using a mobile device according to an embodiment of the present invention includes generating a broadcast channel for providing a broadcast image according to a request of a master terminal, A library of photographed images is provided to the master terminal, and one of the photographed images selected by the master terminal is controlled to be streamed to a broadcast image. When it is confirmed that event information on a disaster situation or an emergency is generated, The control unit controls the photographed image photographed by the slave terminal located closest to the place where the information is generated to be changed to the broadcast image and displays the augmented reality object representing the evacuation route and the evacuation place on the changed broadcast image.

And controlling the streaming of the broadcast image to a local terminal connected to a slave terminal located closest to the place where the event information is generated.

Displaying the augmented reality object representing the evacuation route and the evacuation place on the changed broadcast image may be performed by displaying an outline of the evacuation place included in the broadcast image as an augmented reality object or enhancing a evacuation route for moving to the evacuation place It may be displayed as a real object.

The outline of the evacuation site indicated by the augmented reality object and the evacuation path may vary in color and / or thickness depending on the distance from the current position on the broadcasting screen.

The control of changing the photographed image photographed by the slave terminal located closest to the place where the event information is generated is changed to the broadcast image by analyzing the location information of the master terminal and the slave terminal connected to the same broadcast channel If it is determined that the master terminal and the slave terminal are not positioned within a reference radius around the place where the event information is generated, the broadcast image of the channel to which another master terminal or another slave terminal located within the reference radius belongs, And controlling to stream to a terminal connected to the broadcast channel.

Controlling the change of the photographed image photographed by the slave terminal located at a position closest to the place where the event information is generated to the broadcast image is performed by periodically checking the location information of the master terminal and the slave terminal connected to the same broadcast channel And controls the broadcast image to be changed in real time when event information is generated.

According to an aspect of the present invention, a broadcast image of a location where a disaster occurs can be quickly streamed, and a user located at a disaster site can receive an evacuation route using an augmented reality, Can be provided.

FIG. 1 is a diagram showing a schematic configuration of a real-time disaster broadcasting system using a mobile device according to an embodiment of the present invention.
2 is a block diagram showing a specific configuration and function of the user terminal of FIG.
3 is a block diagram showing a specific configuration and functions of the management server of FIG.
4 is a diagram illustrating an example of image information output to a screen of the user terminal of FIG.
5 to 8 are views showing a specific embodiment of changing a broadcast screen using the system of FIG.
9 is a diagram illustrating an example of an augmented reality object reflected in a broadcast image.
FIG. 10 is a flowchart showing a schematic flow of a real-time disaster broadcasting method using a mobile device according to an embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

FIG. 1 is a diagram showing a schematic configuration of a real-time disaster broadcasting system 1 using a mobile device according to an embodiment of the present invention.

The real-time disaster broadcasting system 1 using the mobile device according to the embodiment of the present invention includes the user terminal 100 including the slave terminal 101 and the master terminal 102 and the management server 200 And the like.

The user terminal 100 may be an electronic device carried by the user. The user terminal 100 may be in the form of a smart phone, a PC, a tablet PC, a wearable device, or the like, which is capable of wired or wireless communication with other electronic devices and is capable of inputting, outputting, and processing information.

The user terminal 100 may be provided with an application for receiving various services according to the real-time disaster broadcasting system 1 using the mobile device of the present invention. When it is confirmed that the application is driven under the control of the user, the user terminal 100 accesses the management server 200 through the application and transmits / receives data to the real-time disaster broadcasting system 1 using the mobile device of the present invention Various services can be provided.

The user terminal 100 may include a slave terminal 110 and a master terminal 120.

The slave terminal 101 can be defined as a terminal carried by a viewer for viewing a broadcast image transmitted by the master terminal 102. [ The slave terminal 101 can log in to the management server 200 through the above-described application. The slave terminal 101 can access the broadcast channel generated by one of the master terminals 102 through the management server 200. [

The slave terminal 101 can generate a photographed image to be provided to the master terminal 102. [ To this end, the user terminal 100 may be provided with a camera module for capturing an image and a microphone module for recording sound. A viewer who possesses the slave terminal 101 can generate a photographed image which is a video image of the surroundings while the camera module and the microphone module are activated through the application. The slave terminal 101 transmits the generated photographed image to the management server 200 in real time and the management server 200 transmits the photographed image to the master terminal 102 of the broadcast channel connected to the slave terminal 101 .

The master terminal 102 may be defined as a terminal carried by a sender who wants to provide a broadcast image to a viewer. The master terminal 102 can also log into the management server 200 through an application for receiving various services according to the real-time disaster broadcasting system 1 using the mobile device of the present invention.

The master terminal 102 may communicate with the management server 200 to generate a broadcast channel for broadcasting broadcast video. The master terminal 102 can receive a photographed image from the slave terminal 101 connected to the generated broadcast channel. The master terminal 102 can transmit any one of the photographed images selected by the user (sender) among the plurality of received photographed images as a broadcast image. That is, according to the present invention, it is possible to change the photographed image sent out as a broadcast image in real time according to the selection of a sender among a plurality of shot images provided from viewers connected to the same broadcast channel.

In summary, the user terminal 100 can be divided into either the slave terminal 101 or the master terminal 102, and can be either a role of the slave terminal 101 or a role of the master terminal 102 Can play a role. For example, the user terminal 100 may serve as a slave terminal 101 when accessing a broadcast channel generated by another user terminal. At this time, when the user terminal 100 creates a new broadcast channel after terminating the connection of the broadcast channel, the master terminal 102 may perform the role of the slave terminal 101 instead of the role of the slave terminal 101.

The management server 200 controls the login process of the user terminal 100 and communicates with the logged-in user terminal 100 to provide a service according to the real-time disaster broadcasting system 1 using the mobile device according to the present invention have.

Specifically, the management server 200 divides the logged-in user terminal 100 into either the slave terminal 101 or the master terminal 102, and assigns a role corresponding thereto. The management server 200 can control the broadcast image determined by the master terminal 102 to be streamed to the slave terminal 101 in real time. In addition, the management server 200 can detect a disaster situation or an emergency situation and control the broadcast image outputted to the user terminal 100 to be forcibly changed when a disaster situation or an emergency situation is confirmed to have occurred. The management server 200 can select any one of the evacuation sites included in the changed broadcast image and generate an object for expressing the path for moving to the evacuation site and the evacuation site as an augmented reality. The specific configuration and functions of the management server 200 will be described later with reference to FIG.

FIG. 2 is a block diagram showing the specific configuration and functions of the user terminal 100 of FIG.

The user terminal 100 including the slave terminal 101 and the master terminal 102 according to an embodiment of the present invention includes a user terminal communication unit 110, a user terminal memory unit 120, a user terminal input / (130) and a user terminal control unit (140).

The user terminal communication unit 110 can communicate with the management server 200 to exchange data or exchange data. The user terminal communication unit 110 may form a communication network with the management server 200 using any one of various known wired / wireless communication techniques.

The user terminal memory unit 120 may store applications (hereinafter referred to as applications) for providing various services according to the real-time disaster broadcasting system 1 using the mobile device according to the present invention. The user terminal memory unit 120 may store data generated during a process of using the application and a process of communicating with the management server 200.

The user terminal input / output unit 130 may include a user terminal input unit 131, a user terminal output unit 132, and a user terminal photographing unit 133.

The user terminal input unit 131 can receive an input signal of a user required in the process of using the application. For example, the user terminal input unit 131 may receive information on an ID and a password necessary for a user's login process from a user. Also, the user terminal input unit 131 may receive a user's control signal for controlling the application. To this end, the user terminal input unit 131 may include at least one of a touch pad, a keyboard, a mouse, and a microphone.

The user terminal output unit 132 can output the service according to the application usage to at least one of sound information, image information, and vibration information to the user. As a specific example, the user terminal output unit 132 can output the execution result of the application as image information, as shown in Fig. 4A is an example of image information displayed on the master terminal 102. The user terminal output unit 132 includes a broadcast image currently being transmitted, a library of photographed images received from the slave terminal 101, A user list connected to the broadcast channel generated by the terminal 102 and a chat history between users can be output as image information represented by UI (User Interface), UX (User Experience) or GUI (Graphical User Interface) have. 4 (b) is an example of image information displayed on the slave terminal 101. As shown in Fig. The user terminal output unit 132 may generate a broadcast screen for streaming the broadcast image transmitted from the master terminal 102 if the user terminal 100 is confirmed to be the slave terminal 101, The library of the broadcast channel, the list of other users connected to the entered broadcast channel, and the chat history between the users.

In addition, the user terminal output unit 132 may output a data processing process and a result controlled by the user terminal control unit 140 to notify the user.

The user terminal photographing section 133 can photograph an image according to a user's operation. The user terminal photographing unit 133 may include a camera module for photographing an image and a microphone module for recording sound. The user terminal photographing unit 133 photographs the photographed image Can be generated.

The user terminal control unit 140 may control the overall operation of the user terminal 100. [ The user terminal control unit 140 may periodically collect location information of the user terminal 100 by controlling the user terminal communication unit 110. The user terminal control unit 140 may control the application to be executed or terminated according to the control of the user inputted through the user terminal input unit 131. [ The user terminal control unit 140 reflects the augmented reality object according to the event information and the event information about the emergency situation or the emergency situation received from the management server 200 on the broadcast image and outputs the augmented reality object through the user terminal output unit 132 can do.

The user terminal control unit 140 determines whether the user connected to the management server 200 is a viewer or a sender based on the result of communication with the management server 200. When the user terminal 100 is connected to the slave terminal 101 or the master terminal 102 in order to perform the functions of the master terminal 102 and the master terminal 102.

For example, when the user terminal 100 determines that the user terminal 100 is the master terminal 102, the user terminal control unit 140 may control to display a library of a plurality of photographed images received from the management server 200. [ In addition, when it is confirmed that the user selects one of the photographed images constituting the library from the user (sender), the user terminal control unit 140 can control the selected photographed image to be transmitted as a broadcast image.

The user terminal control unit 140 may control the user terminal capturing unit 133 to generate a captured image when the user terminal 100 is determined to be the slave terminal 101. [ The user terminal control unit 140 may control the broadcast image transmitted from the management server 200 to be streamed in real time through the user terminal output unit 132.

On the other hand, when the user terminal control unit 140 receives event information from the management server 200 indicating that a disaster situation or an emergency has occurred, the user terminal control unit 140 may control the event information output through the user terminal output unit 132 to be output. When the user terminal control unit 140 receives the event information, the user terminal control unit 140 may control the broadcast server 100 to forcibly output the broadcast image photographed at the disaster scene or the emergency scene changed by the management server. At this time, the user terminal control unit 140 may control the output of the broadcast image reflecting the augmented reality object by reflecting the augmented reality object received from the management server 200 on the changed broadcast image.

In addition, the user terminal 100 may further include additional components such as a user terminal battery unit (not shown) for supplying power.

3 is a block diagram showing the specific configuration and functions of the management server 200 of FIG.

Specifically, the management server 200 may include a management server communication unit 210, a management server memory unit 220, and a management server control unit 230.

The management server communication unit 210 may communicate with the user terminal communication unit 110 to transmit and receive data. The management server communication unit 210 may form a communication network with the user terminal communication unit 110 using any one of various well-known wire / wireless communication techniques.

The management server communication unit 210 may receive the photographed image from the slave terminal 101 and transmit the photographed image to the master terminal 102. The management server communication unit 210 may transmit the broadcast image selected by the master terminal 102 to the slave terminal 101. [ The management server communication unit 210 may transmit event information on the emergency situation or the emergency situation generated by the management server 200 to the slave terminal 101 and the master terminal 102.

The management server memory unit 220 may be provided with software or application programs for providing services according to the real-time disaster broadcasting system using the mobile device according to the present invention. In addition, the management server memory unit 220 can manage various data generated or collected by the management server 200.

The management server control unit 230 can control the overall operation of the management server 200. [ The management server control unit 230 can divide the user terminal 100 connected to the management server 200 into either the slave terminal 101 or the master terminal 102. [ As described above, when it is confirmed that the user terminal 100 generates a broadcast channel, the management server control unit 230 divides the corresponding user terminal 100 into a master terminal 102, It is possible to distinguish the user terminal 100 as the slave terminal 101. The management server control unit 230 manages the list of the generated broadcast channels and transmits the list of the slave terminals 101 connected to the specific broadcast channel to all the user terminals 100 connected to the corresponding broadcast channel. Thereafter, the management server control unit 230 transfers the photographed image received from the slave terminal 101 to the master terminal 102 of the broadcast channel to which the master terminal 102 belongs, As shown in FIG. The management server control unit 230 can relay voice, images, messages, and the like generated from the user terminal 100 connected to the same broadcast channel.

In particular, when it is determined that an emergency situation such as a disaster situation or an emergency situation has occurred, the management server control unit 230 controls the streaming of the captured image in an emergency situation in real time, And can provide information for inducing evacuation. The management server control unit 230 includes an event information collection unit 231, a location information management unit 232, a broadcast image management unit 233, an augmented reality object generation unit 234, and a notification unit 235.

The event information collecting unit 231 may receive event information about occurrence of an emergency situation such as a disaster situation or an emergency situation. The event information collecting unit 231 may determine that an emergency situation has occurred when the emergency signal is received from the user terminal 100. [ Alternatively, the event information collecting unit 231 may receive event information from an external server such as the Korea Meteorological Administration, the Ministry of Land Transport and Transportation, or the National Disaster Management Center.

The location information management unit 232 may periodically collect location information of the user terminal 100 connected to the management server 200. [ The location information confirmation unit 232 may reflect the current location of the user terminal connected to the broadcast channel and the place where the event information is generated in the map data.

The broadcast video management unit 233 can refer to the map data managed by the location information management unit 232 and select the user terminal 100 located at a position closest to the place where the event information is generated. Specifically, the broadcast image management unit 233 analyzes the location information of the slave terminals 101 connected to the same broadcast channel and selects one of the slave terminals 101 located at a position closest to the place where the event information is generated .

Referring to FIGS. 5 and 6 together, the broadcast image management unit 233 can control the broadcast image to be transmitted as an image taken by one of the slave terminals 101 selected. 5, in a general situation where an emergency situation does not occur, the broadcast video management unit 233 controls the streaming of the selected video image by the user (sender) of the master terminal 102 to the broadcast video can do. In the illustrated embodiment, the master terminal 102 acquires different photographed images (photographed images 1, 2, and 3) from three slave terminals 101_1, 101_2, and 101_3 connected to the same broadcast channel through the management server 200 ) Can be provided. At this time, the master terminal 102 can transmit any one of the taken images (shot image 3 in this embodiment) selected by the user (sender) out of the three received images as a broadcast image. In this case, the three slave terminals 101_1, 101_2, and 101_3 can be streamed to the broadcast video image of the shot image (shot image 3) shot by the third slave terminal 101_3. That is, in a general situation in which no emergency occurs, the broadcast image can be determined by the selection of the master terminal 102. [

However, when an emergency situation such as a disaster situation or an emergency occurs, the broadcast image can be forcibly controlled by the broadcast image management unit 233. [ 6, the broadcast video management unit 233 of the management server 200 receives event information indicating that an event has occurred from the user terminal 100 or an external server (not shown) can do. In this case, the broadcast image management unit 233 can compare the location of the accident site according to the event information and the location information of each of the slave terminals 101_1, 101_2, and 101_3 connected to the same broadcast channel. The broadcast image management unit 233 can select the photographed image 1 as the photographed image received from the first slave terminal 101_1 which is the terminal closest to the accident scene according to the event information. Then, the broadcast image management unit 233 can control the broadcast screen for the shot image (shot image 3) selected by the master terminal 102 to change to the broadcast screen for the shot image 1. That is, when event information such as a disaster situation or an emergency occurs, the broadcast image determined by the master terminal 102 can be forcibly changed by the broadcast image management unit 233 of the management server 200. [ The broadcast image management unit 233 controls the streaming of the photographed image received from the slave terminal 101 located at the closest position to the emergency situation site to the slave terminal 101 so as to enable rapid broadcasting to the emergency re- can do.

7, in the process of selecting the user terminal 100 located at a position closest to the place where the event information is generated, the broadcast image management unit 233 determines that the selected user terminal 100 has the event information It can be confirmed whether it is located within the reference radius around the generated place.

The first slave terminal 101_1 and the second slave terminal 101_2 are connected to the first broadcast channel generated by the first master terminal 102_1 and the third slave terminal 101_2 is connected to the first broadcast channel generated by the first master terminal 102_1, And the fourth slave terminal 101_4 may be connected to the second broadcast channel generated by the second master terminal 102_2. The management server 200 determines that the broadcast image selected by the first master terminal 102_1 of the photographed images provided from the first slave terminal 101_1 and the second slave terminal 101_2 is connected to the first broadcast channel It can be controlled to be streamed to one of the slave terminals 101_1 and 101_2.

At this time, if it is determined that the event information is generated, the broadcast image management unit 233 of the management server 200 can select the slave terminal closest to the accident scene according to the event information among the slave terminals connected to the same broadcast channel. In the illustrated embodiment, the broadcast image management unit 233 can select the first slave terminal 101_1 of the first broadcast channel and the third slave terminal 101_3 of the second broadcast channel, respectively.

Here, the broadcast image management unit 233 can confirm whether the selected slave terminal 101_1 or 101_3 is located within the reference radius. Specifically, when it is confirmed that the third slave terminal 101_3 selected for the second broadcast channel is located within the reference radius, the broadcast image management unit 233 determines that the photographed image photographed by the third slave terminal 101_3 is the second It can be controlled to be streamed to the broadcast image of the broadcast channel.

On the other hand, if it is determined that the first slave terminal 101_1 selected for the first broadcast channel is out of the reference radius, the broadcast image managing unit 233 controls the broadcast image of the other broadcast channel to be streamed to the broadcast image of the first broadcast channel can do. That is, the broadcast image management unit 233 can change the broadcast image of the first broadcast channel based on the photographed image received from the slave terminal 101_3 of another broadcast channel located within the reference radius.

8, the broadcast image management unit 233 may control different broadcast images to be streamed according to the location of the user terminal 100 connected to the same broadcast channel.

Here, the different broadcast images include a picked-up image selected by the master terminal 102 and a picked-up image selected by the broadcast-image managing unit 233 when event information is generated. Hereinafter, for convenience of description, a broadcast image determined by the master terminal 102 is defined as a general image, and a broadcast image determined by the management server 200, that is, the broadcast image management unit 233, is defined as a disaster image, .

The broadcast image management unit 233 can determine the type of the broadcast image to be streamed to the user terminal 100 connected to the same broadcast channel. Specifically, the broadcast image management unit 233 can control the streaming of the disaster image to the user terminals 101_1, 101_2, and 102 located within a preset danger radius based on the place where the event information is generated. The broadcast video management unit 233 can control the general video to be streamed to the user terminal 101_3 located outside the critical radius. Here, the danger radius may be characterized by being larger than the reference radius described above.

In addition, the broadcast image management unit 233 may generate guide information for real-time position updates of the user terminals 101_1, 101_2, and 102 located within the critical radius and the distance between the real time locations, and may reflect the disruption image. Therefore, a user located within a critical radius can be provided with real-time location of another user located within a critical radius, and can be used as information for escape or structure.

On the other hand, when it is determined that the master terminal 102 is located within a predetermined risk radius, the broadcast video management unit 233 assigns authority of the temporary master terminal to any one slave terminal 101 connected to the same broadcast channel . At this time, the broadcast video manager 233 can set the slave terminal 101_3, which is farthest from the place where the event information is generated, to be a temporary master terminal. The slave terminal 101_3 set as the provisional master terminal can be granted the authority of the master terminal and accordingly can select the photographed image to be transmitted as a general image. Thereafter, the broadcast video management unit 233 can set the temporary master terminal to the slave terminal 101_3 if it is confirmed that the master terminal 102 is out of the danger radius.

The augmented reality object generation unit 234 can generate an augmented reality object to be reflected in the broadcast image changed by the broadcast image management unit 233 when the event information is generated.

9 is an example in which an augmented reality object is reflected on a broadcast image output to the user terminal 100. [ As shown in the figure, the augmented reality object generation unit 234 can classify the objects of the evacuation facility included in the broadcasting screen and emphasize the divided objects or provide information on the evacuation path for moving to the classified objects And can be generated as an augmented reality object.

To this end, the augmented reality object generation unit 234 can request a database on the building structure. Specifically, the augmented reality object generation unit 234 may be provided with the location information of the slave terminal 101 that provides the photographed image selected from the location information management unit 232 as a broadcast screen. Also, the augmented reality object generation unit 234 can receive the building structure image corresponding to the position information of the slave terminal 101 from the management server memory unit 220. [ In the management server memory unit 220, information on the location and kind of the facilities included in the building structure image and the image of the indoor structure of the specific building may be constructed in advance in the database. Accordingly, the augmented reality object generation unit 234 can compare the database of the building structure with the image of the building, thereby distinguishing the objects included in the image.

The augmented reality object generation unit 234 can extract an object of a retreat place among the objects included in the photographed image. The augmented reality object generation unit 234 can detect an outline of the object with respect to the detected evacuation place. The augmented reality object generation unit 234 can generate an augmented reality object that emphasizes the outline of the detected object. In addition, the augmented reality object generation unit 234 can generate an augmented reality object for the movement path for moving to the evacuation place.

At this time, the augmented reality object generation unit 234 may set the augmented reality object expression method differently according to the current position in the broadcast image and the distance between the objects. For example, the augmented reality object generation unit 234 can control the increase of the thickness of the outline as the distance between the current position in the broadcast image and the evacuation site approaches. Alternatively, when two different evacuation sites exist in the broadcast image, the augmented reality object generation unit 234 emphasizes the outline of the evacuation place relatively close to the current position in the broadcast image, . Alternatively, the augmented reality object generation unit 234 can control only the outline of the evacuation place closest to the current position in the broadcast image to be displayed as the augmented reality. In this case, emphasized display means that the thickness or color of the outline is set differently. The current position in the broadcast image can be set to the position of the center of the bottom of the broadcast image.

In some other embodiments, the augmented reality object generator 234 may generate an augmented reality object for the set position from the user terminal. As a specific example, the augmented reality object generation unit 234 can receive an input signal for a position or an area on a changed broadcast screen from any one master terminal 102 or slave terminal 101 connected to the same broadcast channel. In other words, the sender or the viewer can select one point or a specific area on the broadcast screen through the user terminal 100, and such an input signal can be generated, for example, by touching a touch screen outputting a broadcast screen .

The augmented reality object generation unit 234 may generate an object for the received input signal. The augmented reality object generation unit 234 can generate a virtual object according to the position and the area of the input signal on the screen. The augmented reality object generation unit 234 can extract an outline of the generated object and generate an augmented reality object for an outline that emphasizes the extracted outline. In addition, the augmented reality object generation unit 234 may generate an augmented reality object for the movement path for moving to the generated object. According to the augmented reality object generation unit 234 according to another embodiment of the present invention, even if there is no building data to be compared with a broadcast image, an evacuation place identified from a user in a broadcast channel is referred to as an object . ≪ / RTI >

The augmented reality object generation unit 234 may apply the generated augmented reality object to the broadcast image changed by the broadcast image management unit 233 and transmit the applied augmented reality object to the user terminal 100. [ Alternatively, the augmented reality object generation unit 234 transmits the generated augmented reality object to the user terminal 100, and the user terminal 100 processes the augmented reality object so that the augmented reality object is reflected on the broadcast screen through the application of the present invention .

The notification unit 235 may provide the user terminal 100 with information related to the event information. Specifically, the notification unit 235 can generate a message, voice, alarm, vibration, image, and the like that can notify the event information to the user terminal 100. Particularly, when the user terminal 100 is positioned within the reference radius from the accident site in accordance with the event information, the notification unit 235 informs the user terminal 100 of a preset terminal (for example, a protector, a friend, ). ≪ / RTI >

FIG. 10 is a flowchart showing a schematic flow of a real-time disaster broadcasting method using a mobile device according to an embodiment of the present invention.

The management server 200 may generate a broadcast channel for providing a broadcast image according to a request of the master terminal 102 (910). The slave terminal 101 connected to the broadcast channel associated with the master terminal 102 can generate the photographed image through the application installed in advance.

The management server 200 may transmit the photographed image received from the slave terminal 101 connected to the broadcast channel to the master terminal 102 (920). The master terminal 102 can output a library of a plurality of photographed images as image information.

The master terminal 102 transmits (930) any of the plurality of photographed images constituting the photographed image library to the broadcast image selected by the user, and the management server 200 transmits the photographed image to the master terminal 102 Can be controlled to be streamed to another slave terminal 101 connected to the same broadcast channel.

In this process, when the management server 200 receives the event information for the emergency situation, it can select any one of the slave terminals 101 closest to the place where the emergency occurred. The management server 200 can change the broadcast image selected by the master terminal 102 to the captured image generated by the slave terminal 101 selected by the management server 200 in operation 950.

Thereafter, the management server 200 may generate an augmented reality object for the evacuation path included in the changed broadcasting screen and a evacuation path for moving to the evacuation place (960). The management server 200 can control so that the augmented reality object generated on the changed broadcasting screen is reflected and streamed.

Such a technique for providing a real-time disaster broadcasting method using a mobile device can be implemented in an application or can be implemented in the form of program instructions that can be executed through various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination.

The program instructions recorded on the computer-readable recording medium may be ones that are specially designed and configured for the present invention and are known and available to those skilled in the art of computer software.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like.

Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for performing the processing according to the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

100: user terminal
101: Slave terminal
102: Master terminal
200: management server

Claims (15)

A slave terminal for generating a photographed image;
A library for a shot image received from a slave terminal connected to the same broadcast channel is displayed, and a user of the plurality of shot images constituting the library is controlled A master terminal for transmitting any one of the photographed images selected by the master terminal to the broadcast image; And
If it is determined that the broadcast image is to be streamed to the slave terminal, if it is confirmed that event information about a disaster situation or an emergency situation is generated, the captured image photographed by the slave terminal located closest to the place where the event information is generated And a management server for controlling to change to the broadcast image, and to display the augmented reality object representing the evacuation route and the evacuation place on the changed broadcast image,
The management server includes:
Wherein the location information of the master terminal and the slave terminal connected to the same broadcast channel is periodically collected to control the broadcast image to be changed in real time when event information is generated.
The method according to claim 1,
The management server includes:
The slave terminal located nearest to the place where the event information is generated is located within a reference radius around the place where the event information is generated, The control unit controls the broadcast image of the broadcast channel to which the other slave terminal belonging to the slave terminal located within the reference radius is streamed to the terminal connected to the broadcast channel.
The method according to claim 1,
The management server includes:
Wherein the control unit controls the streaming unit to stream any one of a general image, which is a broadcast image determined by the master terminal, and a disaster image, which is a broadcast image determined by the management server,
The slave terminal or the master terminal located within a critical radius centering on the place where the event information is generated is controlled to stream the disaster image so that the general image is streamed from a slave terminal or a master terminal located outside the critical radius Real - time disaster broadcasting system using mobile device.
The method of claim 3,
The management server includes:
Real-time position and distance information of the slave terminal or the master terminal located within the critical radius are displayed in real time,
And controls the streaming of the disaster image reflecting the guide information to the slave terminal or the master terminal located within the critical radius.
The method of claim 3,
Wherein the management server sets any of the slave terminals connected to the same broadcast channel as a provisional master terminal if it is determined that the master terminal exists within the critical radius,
Wherein the slave terminal set as the temporary master terminal is a slave terminal that is distantly spaced apart from a place where the event information is generated among a plurality of slave terminals connected to the same broadcast channel. system.
6. The method of claim 5,
The management server includes:
And releases the temporary master authority of the slave terminal set as the temporary master terminal if it is determined that the master terminal is out of the danger radius.
The method according to claim 1,
The management server includes:
Displays an outline of an evacuation place included in the changed broadcast image as an augmented reality object or displays a evacuation path for moving to the evacuation place as an augmented reality object.
8. The method of claim 7,
Wherein at least one of a color and a thickness of the outline of the evacuation location indicated by the augmented reality object and the evacuation path varies in accordance with a distance from the current location on the changed broadcast image, system.
delete Generates a broadcast channel for providing a broadcast image according to a request from the master terminal,
Providing a library of photographed images photographed by a slave terminal connected to the same broadcast channel to the master terminal,
The control unit controls the streaming of any one selected image selected by the master terminal to a broadcast image. If it is determined that event information for a disaster situation or an emergency situation is generated, the slave terminal, which is located closest to the place where the event information is generated, And displays the augmented reality object representing the evacuation route and the evacuation site on the changed broadcast image,
And controlling the change of the photographed image photographed by the slave terminal located at a position closest to the place where the event information is generated to the broadcast image,
And periodically collecting location information of the master terminal and the slave terminal connected to the same broadcast channel, and controlling the broadcast image to change in real time when event information is generated.
11. The method of claim 10,
Further comprising: controlling the streaming of the broadcast image to a local terminal connected to a slave terminal located closest to a place where the event information is generated.
11. The method of claim 10,
Displaying the augmented reality object representing the evacuation route and the evacuation place on the changed broadcast image,
Displaying an outline of an evacuation place included in the broadcast image as an augmented reality object or displaying a evacuation path for moving to the evacuation place as an augmented reality object.
13. The method of claim 12,
Wherein at least one of a color and a thickness of the outline of the evacuation site indicated by the augmented reality object and the evacuation path is variable according to the distance from the current position on the broadcast image.
11. The method of claim 10,
And controlling the change of the photographed image photographed by the slave terminal located at a position closest to the place where the event information is generated to the broadcast image,
The master terminal and the slave terminal connected to the same broadcast channel are analyzed and if it is determined that the master terminal and the slave terminal are not located within a reference radius around the place where the event information is generated, And controlling the streaming of a broadcast image of a channel belonging to another master terminal or another slave terminal located in the broadcast channel to a terminal connected to the broadcast channel.
delete

Images