KR101237414B1 - Digital emergency broadcasting system using video and location and broadcasting method thereof - Google Patents

Digital emergency broadcasting system using video and location and broadcasting method thereof Download PDF

Info

Publication number
KR101237414B1
KR101237414B1 KR1020120057358A KR20120057358A KR101237414B1 KR 101237414 B1 KR101237414 B1 KR 101237414B1 KR 1020120057358 A KR1020120057358 A KR 1020120057358A KR 20120057358 A KR20120057358 A KR 20120057358A KR 101237414 B1 KR101237414 B1 KR 101237414B1
Authority
KR
South Korea
Prior art keywords
emergency
information
controller
broadcasting
image
Prior art date
Application number
KR1020120057358A
Other languages
Korean (ko)
Inventor
강원식
주형진
Original Assignee
강원식
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 강원식 filed Critical 강원식
Priority to KR1020120057358A priority Critical patent/KR101237414B1/en
Application granted granted Critical
Publication of KR101237414B1 publication Critical patent/KR101237414B1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H20/00Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/53Arrangements specially adapted for specific applications, e.g. for traffic information or for mobile receivers
    • H04H20/59Arrangements specially adapted for specific applications, e.g. for traffic information or for mobile receivers for emergency or urgency
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed circuit television systems, i.e. systems in which the signal is not broadcast

Abstract

PURPOSE: A digital emergency broadcasting system and a method using image information and location information are provided to offer emergency broadcasting including CCTV(Closed Circuit Television) images and specific and accurate information about the location of an emergency situation, through an AV(Audiovisual) system in an emergency. CONSTITUTION: A PA(Public Address) controller(150) outputs emergency broadcasting contents in an emergency. An AV controller(230) manages an AV device. The AV controller generates emergency broadcasting contents using location information about the emergency situation and CCTV image information about the corresponding location information received in the emergency. The AV controller delivers the generated emergency broadcasting contents to a local display through the AV device. The AV controller provides control information corresponding to the emergency situation and emergency broadcasting audio contents to the PA controller. [Reference numerals] (110) Sound source; (120) Amplifier & mixer; (130) Emergency warning unit; (140) Channel controller; (150) Public address controller; (160) Public address network; (210) AV source; (220) AV processor; (230) AV controller; (240) AV transmission network; (AA) Emergency alarm; (BB) External image/external information; (CC) Emergency information

Description

Digital emergency broadcasting system using video and location and broadcasting method

The present invention relates to a digital emergency broadcasting system and method using image information and location information. In particular, by using an existing system installed in a building or an area, the image information provides accurate emergency information as A / V information in an emergency situation. A digital emergency broadcasting system and method using location information.

Basically, in case of emergency, buildings or public places over a certain size are required to inform the public of the occurrence of emergency situation by emergency signal or audio announcement.

Although audio information such as emergency bells and sirens are effective for the purpose of announcing the occurrence of such an emergency, such simple notification of an emergency may cause confusion due to the lack of accurate information.

On the other hand, buildings with a certain size or more are equipped with public address system to enable broadcasting through a variety of audio sources, if necessary, is configured to notify the emergency announcements by audio guide broadcast. However, in this case, too, it is difficult to accurately transmit necessary information because it provides a guide broadcast prepared in advance for an emergency situation or a manager guides an emergency situation by nurturing. In addition, if the surrounding noise becomes loud due to confusion caused by the emergency situation notification, if the administrator's pronunciation is incorrect, the contents may not be clearly heard depending on the sound of the audio output or the audio status, so it is difficult to accurately identify the situation. Only anxiety is aggravated, causing unintended damage during the evacuation process.

In addition, in case of an emergency radio wave based on such an audio signal, if the hearing impaired person or hearing problem is not known, the emergency situation may not be known and effective response may be difficult.

However, most of them still rely on audio emergency broadcasting through such public address system.

In the case of PA system used as the conventional emergency broadcasting system as described above, the sound source is connected to the amplifier and the panel through analog wiring, and it is transmitted to the terminal through the relay group and output through the speaker. Control via PC

Figure 1 shows the configuration of a general public address system, it is configured to provide an emergency broadcast using audio while providing a guide voice or background music as shown.

The illustrated configuration provides the output of the sound source input unit 1 for amplifying and mixing various sound source sources or providing an alarm in an emergency situation to a desired zone-specific amplifier among the signal amplification units 3 under the control of the channel control unit 2. If so, the amplifier amplifies the transmitted sound source and outputs it through the speaker 4. The channel control unit 2 includes a control computer and a channel controller for selecting an end of broadcast reception and delivering an audio broadcast signal.

In addition to the public address system, various security systems, CCTV video systems, A / V systems or IP-based A / V systems, or independent A / V systems such as auditoriums or performance halls, are located in buildings above the predetermined level. The system can be configured, but these systems simply share a part of the signal line or share the installation space or the manager's management space, and are not interlocked with each other. Therefore, various advanced information that can be obtained through each system in an emergency situation can be obtained. The response to the emergency situation is insufficient because it could not be delivered to the local manager or the public who should respond to the actual emergency situation.

On the other hand, the various systems configured in the building as described above may share some configurations, even in the case of public address system, IP-based public address system using an Ethernet network share or link some components with other types of systems. There is a case.

For example, an IP-based public address system may be configured to use an Ethernet network such as an IP-based A / V system. Patent No. 10-0917716 discloses a 'local broadcasting device of a public address system using a network' or a registered patent. No. 0923490 Public Address System using Network consists of an A / V system that provides public address and HD video using the same network. The existing public address system for sound source and video server for video source and local When configuring the broadcasting devices, the UDP packet is used to maintain the speed, and in case of an error, the TCP / IP packet is used to reduce the error. If the error is severe, the network error is transmitted through the redundant analog path. Audio emergency broadcasts are to be maintained during the event.

However, as we have seen, the system linkage technology for emergency broadcasting is merely a part of the network of IP-based public address system and A / V system, or it is only enough to maintain a separate analog channel for emergency situations. There is no linkage with surrounding systems for more effective emergency broadcasting. Accordingly, the emergency broadcasting to date is simply a system using the public address system or a system that manages a plurality of systems and informs the situation confirmed by other systems through the public address system. Inadequate information transmission can cause additional damage.

As a result, emergency situations can be achieved through interlocking with various security systems or video-related systems (CCTV systems, video surveillance / analysis systems, etc.) as well as A / V systems that can provide video and public address systems that can provide audio signals. By providing more specific information about the new system, it is possible to reduce the confusion caused by the existing emergency broadcasting confined to the audio information, to prevent the confusion or the damage caused by excessive fear, and to provide sufficient guidance for the hearing impaired. Emergency emergency broadcasting system is urgently needed.

Korean Patent Registration No. 10-0917716 Korea Patent Registration No. 10-0923490

An object of the embodiments of the present invention for improving the above-mentioned problems is to connect the security-related system or CCTV-related system configured in the building with the public address system and the A / V system to the CCTV image and the emergency occurrence position in an emergency situation. Digital emergency broadcasting system using image information and location information to provide emergency broadcasting with specific and accurate information through A / V system to reduce psychological disturbances and to prevent additional damage through safe evacuation. To provide.

Another object of the embodiments of the present invention after the A / V controller managing the A / V system that can provide the video content in conjunction with the security-related system or CCTV-related system to secure the emergency occurrence position and the corresponding CCTV image It is to provide a digital emergency broadcasting system using image information and location information that can generate and provide emergency broadcast contents that can be easily identified and used by the evacuator, and deliver audio contents among the generated contents to the public address system.

Still another object of the embodiments of the present invention is an image in which an A / V controller displays an emergency occurrence position in spatial information modeled by BIM (Building Information Modeling) technology or map information by Geographic Information System (GIS) technology. It is to provide a digital emergency broadcasting system using video information and location information that enables emergency broadcast contents including emergency CCTV contents including location images to be provided as emergency broadcasts so that clear situation identification and evacuation route can be confirmed.

Another object of the embodiments of the present invention is to allow the A / V controller configured to provide more accurate and more information by interworking with a security related system or a CCTV related system to integrate and manage the public address system in an emergency. It is to provide a digital emergency broadcasting system using image information and position information that can be used as an integrated broadcasting controller in an emergency situation.

In order to achieve the above object, the digital emergency broadcasting system using the image information and the location information according to an embodiment of the present invention is installed in a building or an area, the local A / V source is configured at one or more locations through the construction line An A / V device for delivering to the display; A public address device for transmitting an audio source to a building or an area through a component line; A public address controller for managing sound sources and broadcast conditions to be provided through the public address broadcast device and outputting emergency broadcast contents in an emergency situation; Manage the A / V device, generate emergency broadcast content by using the emergency situation location information received in an emergency situation and the CCTV image information of the corresponding location, and deliver the emergency broadcast content to the local display through the A / V device; And an A / V controller for providing control information and emergency broadcast audio content according to an emergency to the PA controller.

The A / V device may include an A / V generator corresponding to an A / V source, a switch for selecting one of emergency broadcasts and an output of the A / V generator, a local display provided with the output of the switch; It may include at least some of an amplifier and a local speaker for amplifying an audio signal of the output of the switch, and a line connecting the components.

In another configuration, the A / V device includes an A / V generator including a broadcast receiver, a modulator for modulating the output of the A / V generator, an emergency broadcast modulator for modulating an emergency broadcast, and the modulator output. And a switch for selecting one of the emergency broadcasts, a TV cable network providing the output of the switch to the local display, and at least some of the local display.

The public address broadcasting apparatus may include at least a portion of a sound source input unit corresponding to an audio source, a channel controller converting an output signal of the sound source input unit to a predetermined line, and a signal amplifier unit amplifying and outputting a signal through the channel controller to a speaker. It may include.

In another configuration, the public address apparatus may include at least some of a sound source input unit corresponding to an audio source, an amplifier, an emergency panel, and a relay group configured in a line connecting them and a terminal connected to a speaker.

The A / V controller may control the PA system together with the A / V device through control information and emergency broadcast audio content provided to the PA system in an emergency situation.

The A / V controller receives emergency location information from an external system or an administrator and displays it in 2D or 3D information about a pre-configured building or area to generate emergency broadcast content. In addition, the A / V controller may generate an emergency broadcast content by displaying the evacuation information on the 2D or 3D information for the building or the area based on the location of the emergency situation when the emergency situation occurs.

The A / V controller receives the location information of the camera providing the situation occurrence image from the external CCTV-related system and the image of the camera and displays the location information of the camera in 2D or 3D information of the building or the area, and the corresponding location Simultaneously or sequentially generating images displaying camera images for may be included in emergency broadcast content.

The A / V controller may receive emergency situation related information from an external security system or an external emergency situation related system and include it as text or video in emergency broadcast content. In addition, the A / V controller gives priority to at least one or more of evacuation route information, enclosed area information, and user status information of a building or area already provided based on the location information of the emergency situation according to the corresponding priority. Emergency broadcast content can be generated.

The PA system further includes a light emitting unit which is added to a speaker for outputting an audio broadcast or separately configured to indicate a direction, and a driving unit that selectively drives the same. The emergency light emitting unit emits light in an emergency under the control of the PA controller. Can guide. In addition, the A / V controller may provide control information on the operation of the light emitting unit to the public address broadcasting controller to control the operation of the light emitting unit according to the emergency broadcasting. By varying the light emission state of the light emitting unit corresponding to the speaker to be managed separately, the emergency level for each zone may be displayed.

In order to achieve the above object, the digital emergency broadcasting method using the image information and the position information according to another embodiment of the present invention is to provide the emergency situation location information and the CCTV image information of the corresponding location provided from the outside during an emergency situation. Receiving by the A / V controller; Generating emergency broadcast contents by the A / V controller using the received emergency situation location information and CCTV image information of a corresponding location; Delivering, by the A / V controller, the emergency broadcast content to the local display via an A / V device that delivers an A / V source to the local display; Providing, by the A / V controller, control information according to the emergency situation and emergency broadcast audio content according to the emergency broadcast content to the public address broadcasting controller; And outputting, by the PA controller, the emergency broadcast audio content through the PA installed in accordance with the control information.

Digital emergency broadcasting system using the image information and location information according to the embodiment of the present invention by interlocking the security-related system or CCTV-related system configured in the building with public address system and A / V system in case of emergency, CCTV image and emergency By providing emergency broadcasting with specific and accurate information on the location of the situation through the A / V system, it is possible to reduce psychological fluctuations in an emergency and prevent additional damage through safe evacuation.

In the digital emergency broadcasting system using the image information and the position information according to the embodiment of the present invention, an A / V controller managing an A / V system capable of providing video content generates an emergency situation in connection with a security related system or a CCTV related system. After securing the location and corresponding CCTV image, it creates and provides emergency broadcasting contents that can be easily identified and used by evacuators, and delivers the audio contents among the generated contents to public address system to provide integrated and efficient emergency broadcasting. There is an effect that can be provided.

In the digital emergency broadcasting system using the image information and the position information according to the embodiment of the present invention, the A / V controller displays an image of the emergency occurrence position and the corresponding position in the spatial information modeled by the BIM technology or the map information by the GIS technology. By providing emergency broadcast contents including the CCTV images for emergency broadcasting, it is possible to identify the clear situation and confirm the evacuation route, thereby inducing effective response.

Digital emergency broadcasting system using image information and location information according to an embodiment of the present invention is an A / V controller configured to provide more accurate and more information by interworking with security related systems or CCTV related systems. By using the integrated A / V controller as an integrated broadcast controller in an emergency situation, there is an effect that enables efficient emergency broadcasting while reducing the emergency management load of the manager.

1 is a block diagram showing an example of a conventional PA system.
2 is a block diagram of a digital emergency broadcasting system according to an embodiment of the present invention.
3 is a block diagram showing the configuration of the A / V controller according to an embodiment of the present invention.
4 is a conceptual diagram showing an operation example according to an embodiment of the present invention.
5 is an exemplary screen showing an example of emergency broadcast content according to an embodiment of the present invention.
Figure 6 is a specific illustration of a digital emergency broadcast system according to an embodiment of the present invention.
7 is a flow chart showing the operation sequence of the emergency broadcast according to an embodiment of the present invention.
8 and 9 are views showing the configuration of the light emitting unit applied to the PA system according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.

Public facilities such as history, government offices, hospitals, airports, subway stations, and other facilities such as movie theaters, shopping malls, exhibition halls, museums, performance halls, training centers, schools, academies, lodging facilities, large buildings, etc. Public address system for providing announcements or emergency broadcasts is configured so that it is possible to minimize the emergency situation. In addition, various types of A / V systems are generally constructed in such buildings or areas, and a system for providing A / V contents to a performance hall or an auditorium or providing appropriate contents to various local displays is configured. However, these A / V systems are currently used only for the purpose of installation and do not interwork with the PA system at all, and are often left unattended in emergency situations.

On the other hand, the above-mentioned building or zone is composed of a security system, CCTV video system, access control system, various emergency situation detection system, etc., in addition to the public address system or A / V system.

However, even if there are several systems configured to provide such various high-level information, in the case of various disaster situations such as fire, explosion, earthquake, collapse, tsunami, smoke, or emergency situation such as terrorism or crime, The system is used as an assistant by the manager, but provides limited emergency broadcasting through public address system to local managers or general people who need to evacuate.

Therefore, in the embodiment of the present invention, through the interworking between the digital A / V system and the digital PA system installed in the building or the area, it is possible to effectively provide the video information and the audio information for the emergency situation, as well as various external systems. Through interlocking, it provides comprehensive emergency information and information that can lead to the current situation and response, inducing effective response and preventing unnecessary secondary damage caused by excessive fear.

Figure 2 shows the configuration of a digital emergency broadcasting system according to an embodiment of the present invention, A is installed in the building or the area as shown, A to deliver the A / V source to the local display configured at one or more locations through the configured line / V devices (210, 220, 240, 250, 260), public address devices (110, 120, 130, 140, 160, 170) for delivering the audio source to the entire building or area through the configured track, Public address controller 150 for managing the sound source and broadcast state to be provided through the broadcast device and output the emergency broadcast content in an emergency situation, and selects the content to be provided through the A / V device, received during an emergency situation After generating emergency broadcast content using emergency location information and CCTV image information of the corresponding location, the emergency broadcast content is transmitted to the local display through the A / V device, and the control information and the non- emergency control information A / V controller 230 for providing broadcast broadcasting audio content to the PA.

In the illustrated configuration, the local displays 250 and 260 included in the A / V device are local displays 250 installed in an enclosed configuration where a relatively large number of people watch A / V content, such as a theater, a performance hall, an auditorium, or a conference room. The local display 260 may be installed in various open or closed places such as a waiting room, a lobby, a classroom, a small meeting room, an elevator, an individual place, and the like. Here, the local display may be a device that provides only an image, but may have a function of outputting an audio signal.

Meanwhile, the speaker 170 included in the PA system is installed in a ceiling, an outer wall, an external space of a building, and the like to deliver broadcasts to the entire building or area, and the PA system is divided into individual unit areas, areas, or By selecting the speaker to be output as a whole, you can provide audio announcement or emergency broadcast.

In the illustrated configuration, the A / V devices 210, 220, 240, 250, and 260 or the PA system 110, 120, 130, 140, 160, and 170 may be variously configured according to embodiments of the present invention. Therefore, while describing the present invention, these are regarded as one of the components constituting the various A / V system and the components constituting the PA system, and naturally, modifications, additions, and omissions are also possible.

The illustrated A / V devices 210, 220, 240, 250, and 260 may include an A / V source 210 representing various A / V content providing means as shown, and the A / V source 210. Converts the contents provided by the user to the desired form or provides them to the local display through the target local broadcasting apparatus. If necessary, the general broadcasting through the A / V source 210 and the emergency broadcasting provided by the A / V controller 230 are managed. A / V processing unit 220 having a switching means and an A / V delivery network that directly provides the output of the A / V processing unit 220 to a local broadcasting device or a local display connected to a local display through various types of lines. 240 and local displays 250 and 260 for receiving and outputting content provided through the A / V delivery network 240 or a signal including the corresponding content.

For example, the A / V device may have a form of a general digital network A / V system, in which case the A / V device may be configured to deliver outputs of an A / V generator, a video server, and the video server. Network (including network controllers) and local broadcast devices. In this case, the local broadcasting apparatus separates the content from the signal provided through the network and provides it to the local display.

As another example, the A / V device provides an A / V generator corresponding to an A / V source and a video signal of the A / V generator to a local display (projector, projector, screen, etc.) and amplifies the audio signal if necessary. It may be provided to the local speaker, and may include a switch for selecting one of the emergency broadcast and the output of the A / V generator.

As another example, the A / V device may be for providing A / V broadcasting using a TV cable network. In this case, the A / V device may include an A / V generator including a broadcast receiver, and the A A modulator for modulating the output of the / V generator, a TV cable network and a local display for providing the output of the modulator to a local display, an emergency broadcast modulator for modulating an emergency broadcast provided by the A / V controller 230; The apparatus may further include a switch configured to select one of the output of the modulator and the output of the emergency broadcast modulator. In this case, from a very general configuration such as a master antenna television (MATV), that is, a public hearing antenna system, to a configuration for sending various broadcasts and local content (local broadcasting, local guidance, etc.), embodiments of the present invention are various Can be applied to A / V devices.

On the other hand, the PA system 110, 120, 130, 140, 160, 170 as shown in the sound source source 110 corresponding to a variety of audio sources, and emergency broadcast audio content if the emergency broadcast is required or administrator An emergency alerting unit 130 for providing a voice guidance of the sound source, an amplifier 120 for amplifying an audio signal provided by the sound source source 110 or an audio signal provided by the emergency warning unit 130, and the amplifier 120 Channel controller 140 for providing audio content provided by the channel to a desired end through a line, and an amplifier for providing a speaker 170 with a signal containing the audio content or the audio content through the channel controller 140. The public address broadcast network 160 is included.

For example, the public address apparatus may include a sound source input unit corresponding to an audio source, an amplifier, an emergency panel, and a control unit for managing a terminal connected to a speaker and a relay group configured in a path connecting the same.

As another example, the public address broadcasting apparatus may include a sound source input unit corresponding to an audio source, a network controller for converting an output signal of the sound source input unit to a predetermined network, and separating a sound source from a signal through the network controller to a speaker. It may include a network signal amplifier for amplifying and outputting.

The public address broadcasting controller 150 is configured to be suitable for each type of public address broadcasting apparatus to manage a sound source and a broadcasting state to be provided through the public address broadcasting apparatus and manage to output emergency broadcast contents in an emergency situation.

In the embodiment of the present invention, the function of the A / V controller 230 to manage the broadcast path and the content in order to provide emergency broadcasts by effectively interworking the various types of A / V devices and public address broadcast apparatus described above as shown By expanding (adding additional programs or connecting a separate additional device) to provide an A / V emergency broadcast in an emergency situation through the A / V device, and by integrating the PA system through the PA controller 150. Manage it.

To this end, the A / V controller 230 receives external information such as CCTV information and external information from various preconfigured external systems, generates emergency broadcast contents including the same, and then generates the A / V device. It delivers to the local display through the A / V system, and provides a control signal to provide the emergency broadcast audio content generated when creating the emergency broadcast content to the public address controller 150, and to provide it to the emergency broadcast; Integrated management of PA system.

In particular, the A / V controller 230 receives emergency information from various external sources when an emergency occurs, for example, a signal for a traditional disaster alarm such as a fire alarm as emergency information or various sensors, Receive emergency information from security-related devices, disaster-related monitoring devices, administrator inputs, external disaster-related servers, etc., and check their contents. Accordingly, the A / V controller 230 selects or generates emergency broadcast contents. In this case, the A / V controller 230 not only provides and provides simple emergency broadcast contents, but also through the obtained emergency information or information provided by an external DVR or NVR. Emergency occurrence location information, emergency occurrence information, emergency occurrence situation, emergency information, etc. can be included in emergency broadcast contents, and emergency occurrences obtained through external CCTV video systems (DVR, NVR, CCTV video server, camera, etc.) An image of the location (of course, an image of the evacuation route, etc. can be additionally obtained) may be received and included in the emergency broadcast content.

On the other hand, using this more specific and a lot of emergency information, in addition to the emergency broadcast video content can be generated more specific emergency broadcast audio content, it is local display (and linked audio replay device) through the A / V device The emergency broadcast audio content is provided to the PA controller 150. Of course, if the public address controller 150 does not have a function of directly providing audio content to public address broadcasts, the corresponding audio content is provided through the emergency warning unit 130, and only public address control information for the public address broadcast controller 150 is provided. However, since it is the same as providing control signals and emergency broadcast audio contents that control the public address broadcast to the public address controller 150 in a comprehensive manner, such detailed modifications shall be included in the scope of the present invention. .

Here, the A / V controller 230 can obtain the emergency situation location information from an external signal source, for example, an emergency situation from an image analysis system capable of confirming an abnormal situation through image analysis and selecting the corresponding image. You can obtain a very specific information and video on the location of the occurrence, divided into zones and mapped to the location information for each zone, from the CCTV video system or DVR / NVR or CCTV video server equipped with these functions to the emergency zone Information and corresponding CCTV images can be obtained.

One example of a configuration for providing spatial information on the location of such an emergency situation is that the same applicant filed May 28, 2009 and registered on December 23, 2009, registered by the same applicant, using the registration number 10-0934978 You can refer to the configuration of the 'Crime prevention system'.

Meanwhile, the A / V controller 230 stores the spatial information on the location of the emergency situation received in this way in spatial information modeled by BIM (Building Information Modeling) technology or map information by GIS (Geographic information system) technology. By applying the video showing the location of the emergency situation, and creating the emergency broadcast content including the CCTV image of the location, and providing the emergency broadcast through the A / V device and PA system, the exact location information and Easily aware of the current situation information can effectively lead to evacuation.

Figure 3 shows an example of the configuration of the A / V controller 230 according to an embodiment of the present invention, as shown in the emergency signal receiver 233 for receiving emergency alarms from various emergency alarm providing source, camera or DVR Image collecting unit 231 for collecting the image received from the means for providing the space information and the corresponding image information corresponding to the various emergency occurrence location, including emergency information and emergency broadcast control information, An administrator interface 239 for receiving emergency occurrence location information, selection information on related images, an emergency broadcasting unit 236 for outputting emergency broadcasting in a preset format, and general A / V contents or emergency broadcasting A / V content management unit 237 that manages broadcasting for preconfigured A / V content, and an emergency situation obtained through the image collecting unit 231 or the manager interface 239. Based on the spatial information on the location of occurrence, the image displayed in the 2D / 3D information of the BIM or GIS-based building or area and the emergency-related CCTV image received through the image collection unit 231 at once or sequentially The image generating unit 234 for generating emergency broadcast content including the content provided by the control unit; and the audio content is separated from the emergency broadcast content generated by the image generating unit 234 to the public address broadcasting controller together with an interlocking control signal. The public address broadcast interworking unit 238 to transmit and a control unit 235 for controlling the respective components.

The image generator 234 displays basic contrast paths (2D / 3D information on a building or an area) in addition to an emergency occurrence location or a related CCTV image provided by the image collector 231 and the spatial information generator 232. ), Response tips, and various types of information on emergencies may be included in emergency broadcast contents.

According to the configuration of the control unit 235, the emergency broadcast through the A / V device or public address broadcast device can be managed by the administrator control through the manager interface 239, and additional information such as content selection or subtitle input The content may be provided to the image generator 234 to change contents of emergency broadcast content. In addition, the controller 235 analyzes the type of emergency alarm received by the emergency signal receiver 233 to generate information to provide for an emergency situation, and then provides the information to the image generator 234 to provide relevant information to the emergency. Can be added to the broadcast content. In particular, such an emergency alarm may be provided from an external emergency situation-related system, the control unit 235 receiving such content is included in the emergency broadcast content generated by the image generating unit 234 as a text or image You can.

On the other hand, the guidance according to the emergency situation can be determined in consideration of the high risk or urgent urgency in consideration of the preset information, the manager's selection, or the schedule through the interlocking system. Location may be determined.

For example, the controller 235 may interwork with a separate external system (service management server, reservation server, building use management server, etc.) based on the location information at which the emergency occurs, or input information input through the manager interface. Priority may be given to at least one or more of the evacuation route information, the closed area information, and the user status information obtained through the evacuation route information to generate emergency broadcast content so that evacuation guidance according to the priority is provided first. This can lead to effective evacuation by providing guidance to enclosed auditoriums, theaters, etc. earlier and more repeatedly than guidance to areas adjacent to emergency exits.

4 is a conceptual diagram showing an operation example according to an embodiment of the present invention, as shown in the case where the A / V controller 230 integrates and manages the public address system 100 and the A / V system 200. It is seen.

As described above with reference to FIGS. 2 and 3, the A / V controller 230 collects spatial information, CCTV image information, and emergency information about the location where an emergency situation occurs through various external means. The system 200 provides an emergency broadcast to the local display 250 and simultaneously controls the public address broadcast system 100 to provide an audio emergency broadcast linked with the emergency broadcast provided to the local display 250. Through this, the subjects who can access the A / V emergency broadcast can check specific facts information about the emergency situation (space and actual CCTV image) and status information about the emergency situation through the image 252, and the corresponding local display ( Audio emergency broadcasting may also be provided through the audio reproducing means provided at 250.

In this case, the audio emergency broadcast provided through the public address system configured in the corresponding space and the public address speaker 170 configured in the space where the corresponding local display cannot be seen differs from the audio emergency broadcast provided through the A / V system. In this case, confusion is caused and contents are difficult to transmit. As illustrated, the A / V controller 230 controls the A / V system 200 and the public address system 100 in an emergency situation to interlock emergency broadcasting. Management can provide effective guidance while avoiding this situation.

FIG. 5 is an exemplary view showing an example of emergency broadcast content according to an embodiment of the present invention. As shown in FIG. 5A, a basic content according to an emergency situation may be provided and guided. As shown in FIG. By providing information, a fire has occurred, but it is currently under suppression, so it is possible to estimate that it is safe to evacuate slowly due to the low urgent need for evacuation, and as shown in FIG. It may also make it easier to recognize clearer information that allows you to determine your direction of evacuation or urgency in light of your current location.

FIG. 6 is a diagram illustrating a specific example of a digital emergency broadcasting system according to an exemplary embodiment of the present invention, in which some of the above-described configurations are employed to design a school of a predetermined size. In the illustrated case, the PA and A / V controllers were integrated and configured in consideration of the size of the school (actually, the PA and A / V control programs were installed in a personal computer in an interlocked state. It may be configured to work together, or may be developed as an integrated program in the first place).

Referring to FIG. 2, the P / B system constituting the A / V public address integrated controller 230 ′ and the public address broadcasting system and the two types of A / V devices constituting the A / V system are basically described. You can check it.

First, the PA system includes a sound source source 110 'including various sound sources, an emergency warning unit 130', an amplification and mixer unit 120 ', a channel controller 140', and a speaker 170 '. Although not specifically specified, it also includes a public address network including a line interconnecting the public address broadcast devices and lines from the channel controller 140 'to each speaker 170' arranged separately for each zone. .

Meanwhile, in the illustrated configuration, the A / V system includes two types of A / V broadcasting systems using a TV cable network and independent A / V systems installed in an auditorium.

First, an A / V device applied to an A / V broadcasting system using a TV cable network is an A / V source 1 that modulates a broadcast received through various public antennas or an additional input broadcast to be transmitted through a TV cable network. '), An A / V processing unit 1 (220') including a switch for switching between the modulated broadcast and the emergency broadcast provided by the A / V public address integrated controller 230 ', and the A / V processing unit 1 (220). It consists of a local display (260 ') for receiving and playing broadcasts or emergency broadcasts provided through') through a cable network (corresponding to A / V delivery network). In the illustrated case, the switching control signal of the switch is provided by the A / V public address integrated controller 230 'via the channel controller 140' of the public address broadcast. Can be varied for system deployment efficiency.

Meanwhile, an A / V device applied to an independent A / V system installed in an auditorium includes an A / V source 2 (210 ") capable of providing multimedia content through the auditorium and audio provided by the A / V source 2 (210"). A signal interlocked with public address broadcast or provided through an amplifier and speaker separately provided, and selectively switching the video signal and audio signal with emergency broadcast provided by the A / V public address integrated controller 230 'through a switch. Local display 250 '(projector 251', screen) that receives the output of the / V processing unit 2 220 "and the output of the A / V processing unit 2 220" through a line (corresponding to the A / V transmission network). Is made of. Even when shown, the switching control signal of the switch is provided by the A / V public address integrated controller 230 'via the channel controller 140' of the public address broadcast. Various changes can be made for system deployment efficiency.

Accordingly, the exemplary configuration of FIG. 6 may be designed based on the configuration of FIG. 2 described above, and thus, in case of an emergency, the A / V PA integrated controller 230 'may integrate PA and various A / V broadcasts. When emergency broadcasts are generated, various emergency situations-related information, including CCTV images of emergency spaces, can be included and delivered through external video and external information, enabling efficient emergency response.

7 is a flowchart illustrating an operation sequence of emergency broadcasting according to an exemplary embodiment of the present invention, in which a controller operates an PA system and an A / V system, respectively, in a normal situation (S10), and emergency When the situation occurs (S20) the A / V controller receives the information on the emergency space and the image to check the emergency situation (S30) and in the building or the area having the emergency space information Applying to the spatial modeling information for the step of identifying the emergency occurrence position in the corresponding modeling information (S40), and generating the video / audio content for emergency broadcasting including the 2D / 3D modeling information in which the emergency occurrence position is displayed; Step S50 and the step of stopping the general A / V broadcast and transmitting the generated emergency A / V broadcast (S 60). Here, the generating of the video / audio content for the emergency broadcast (S50) may further include a CCTV image of the emergency generating space to generate the content for emergency broadcast, in addition to the various emergency situation related information Can be included.

On the other hand, when such an emergency occurs, the PA system receives the emergency occurrence information together with the A / V system through a conventional separate source, or the control information of the A / V controller that recognizes the emergency situation as the emergency occurrence information. Receiving the public address system to switch to the emergency broadcast mode (S70), and provides a predetermined audio alarm according to the emergency broadcast mode switching or audio emergency broadcast content of the emergency broadcast content generated by the A / V controller Receiving through the broadcast controller and providing an audio emergency broadcast containing more specific information in accordance with the current emergency situation, such as location information or evacuation information (S80).

8 and 9 illustrate a configuration of a light emitting unit applied to a PA system according to an exemplary embodiment of the present invention. As illustrated in FIG. 8, speakers 171 and 172 are controlled for respective zones in an existing PA system. ) Or separately configured light emitting units 173 and 174 and a driving unit (not shown) for selectively driving the light emitting units 173 and 174.

The light emitting units 173 and 174 may operate in an emergency under the control of a public address broadcasting controller, and guide the contrast path by light emission of the light emitting unit. That is, in addition to the local display, the light emitting unit may inform the visual emergency situation and provide additional information about the evacuation route.

The light emitting unit additionally constitutes a light emitting unit 311 indicating a specific direction to a part of the ceiling-embedded speaker 310, as shown in the example of FIG. 321 may be applied in an additional configuration. Of course, although not shown, it is obvious that the speaker and the light emitting unit may be configured separately.

Meanwhile, the A / V controller provides control information on light emission of the light emitting unit to the public address controller in an emergency and can control the operation of the light emitting unit according to emergency broadcasting. By varying the conditions, you can more effectively communicate the evacuation route in an emergency.

In addition, in the case of the public address system, the speaker for each zone can be selectively designated, and the information about each zone can be prepared by mapping in advance with the 2D / 3D spatial information so that the A / V controller can generate an emergency situation. In accordance with the public address controller may display the emergency level by changing the light emission state of the light emitting unit corresponding to the speaker managed for each zone. For example, it may be controlled to be distinguished from the case where the emergency situation occurs far away, such as when the flashing speed is faster or brightly displayed in red when the position near the emergency situation occurs.

In the above described and illustrated with respect to preferred embodiments according to the present invention. However, the present invention is not limited to the above-described embodiments, and various changes and modifications may be made by those skilled in the art without departing from the scope of the present invention. .

110: sound source 120: amplifier
130: emergency warning unit 140: network controller
150: public address controller 160: public address network
170: Speaker 210: A / V Source
220: A / V processing unit 230: A / V controller
240: A / V delivery network 250, 260: local display

Claims (22)

  1. An A / V device installed in a building or an area for delivering an A / V source to a local display configured at one or more locations via a construction line;
    A public address device for transmitting an audio source to a building or an area through a component line;
    A public address controller for managing sound sources and broadcast conditions to be provided through the public address broadcast device and outputting emergency broadcast contents in an emergency situation;
    Manage the A / V device, generate emergency broadcast content by using the emergency situation location information received in an emergency situation and the CCTV image information of the corresponding location, and deliver the emergency broadcast content to the local display through the A / V device; And an A / V controller for providing control information and emergency broadcast audio content according to an emergency to the PA controller,
    The emergency broadcast content,
    Includes emergency content, emergency situation, and emergency information,
    The emergency broadcast audio content,
    Audio content separated from the emergency broadcast content, and includes the emergency occurrence contents, emergency occurrence situation, emergency information,
    The A / V controller,
    Priority is given to evacuation route information, confined area information, and user status information of buildings or areas obtained by interlocking with a separate external system or input through the administrator interface based on the location information where an emergency occurred. Digital emergency broadcasting system using the image information and location information, characterized in that for generating the emergency broadcast content so that the evacuation guidance according to the priority.
  2. The method according to claim 1, The A / V device,
    An A / V generator corresponding to an A / V source, a switch for selecting one of an emergency broadcast and an output of the A / V generator, a local display provided with the output of the switch, and the output of the switch Image information and position information including an amplifier and a local speaker for amplifying an audio signal, and at least part of a line connecting the A / V generator, the switch, the local display, the amplifier and the local speaker. Digital emergency broadcasting system.
  3. The apparatus of claim 1, wherein the A / V device comprises an A / V generator including a broadcast receiver, a modulator for modulating the output of the A / V generator, an emergency broadcast modulator for modulating emergency broadcast, and the modulator. Digital emergency broadcasting system using image information and position information, characterized in that it comprises a switch for selecting one of the output and emergency broadcast, TV cable network for providing the output of the switch to the local display, local display .
  4. The apparatus of claim 1, wherein the PA system comprises: a sound source input unit corresponding to an audio source, a channel controller for converting an output signal of the sound source input unit, and transmitting the signal to a predetermined line; and a signal for amplifying and outputting a signal through the channel controller to a speaker. Digital emergency broadcasting system using image information and position information, characterized in that it comprises at least a part of the amplifier.
  5. The apparatus of claim 1, wherein the PA system comprises a terminal connected to a speaker and a relay group configured in a sound source input unit corresponding to an audio source, an amplifier, an emergency panel, and a line connecting the sound source input unit, the amplifier and the emergency panel. Digital emergency broadcasting system using the image information and location information, characterized in that it comprises at least a part of the control unit.
  6. The image of claim 1, wherein the A / V controller integrates and controls the public address broadcasting apparatus together with the A / V apparatus through control information and emergency broadcasting audio content provided to the public address broadcasting controller in an emergency situation. Digital emergency broadcasting system using information and location information.
  7. The image information of claim 1, wherein the A / V controller receives emergency location information from an external system or an administrator and displays the generated emergency broadcast content by displaying the 2D or 3D information on a pre-configured building or area. Emergency broadcasting system using information and location information.
  8. The image of claim 7, wherein the A / V controller generates an emergency broadcast content by displaying evacuation information in 2D or 3D information of the building or the area based on the location of the emergency situation when the emergency situation occurs. Digital emergency broadcasting system using information and location information.
  9. The method according to claim 1, wherein the A / V controller receives the location information of the camera and the image of the camera providing a situation occurrence image from an external CCTV-related system and the location information of the camera to the 2D or 3D information about the building or area Digital emergency broadcasting system using the image information and location information, characterized in that for generating and displaying the image of the camera image corresponding to the location at the same time or sequentially included in the emergency broadcast content.
  10. The system of claim 1, wherein the A / V controller receives emergency situation related information from an external security system or an external emergency situation related system and includes the received emergency situation related information as text or video in emergency broadcast contents. Digital emergency broadcasting system using image information and location information.
  11. delete
  12. The PA system of claim 1, wherein the PA system further comprises a light emitting unit which is added or separately configured to a speaker for outputting an audio broadcast and a driving unit which selectively drives the light emitting unit, and in case of emergency under the control of the PA controller. Digital emergency broadcasting system using the image information and location information, characterized in that the light emitting unit to guide the evacuation path by emitting light.
  13. 13. The digital apparatus of claim 12, wherein the A / V controller provides control information on the operation of the light emitting unit to the public address broadcasting controller to control the light emitting unit in accordance with emergency broadcasting. Emergency broadcast system.
  14. The image of claim 13, wherein the A / V controller displays the emergency situation level of each zone by changing the light emission state of the light emitting unit corresponding to the speaker managed by the public address controller according to the location of the emergency situation. Digital emergency broadcasting system using information and location information.
  15. Receiving, by the A / V controller, the emergency occurrence location information and the CCTV image information of the corresponding location provided from the outside in an emergency situation;
    Generating emergency broadcast contents by the A / V controller using the received emergency situation location information and CCTV image information of a corresponding location;
    Delivering, by the A / V controller, the emergency broadcast content to the local display via an A / V device that delivers an A / V source to the local display;
    Providing, by the A / V controller, control information according to the emergency situation and emergency broadcast audio content according to the emergency broadcast content to the public address broadcasting controller;
    And outputting, by the PA controller, the emergency broadcast audio content through an installed PA system according to the control information.
    The emergency broadcast content,
    Includes emergency content, emergency situation, and emergency information,
    The emergency broadcast audio content,
    Audio content separated from the emergency broadcast content, and includes the emergency occurrence contents, emergency occurrence situation, emergency information,
    Generating the emergency broadcast content,
    The A / V controller interlocks with a separate external system based on the location information where an emergency situation occurs, or provides information on evacuation route information, closed area information, and user status information of a building or area obtained through information input through an administrator interface. The emergency broadcasting content using the video information and location information, characterized in that for generating the emergency broadcast content to give priority to the evacuation guidance according to the priority.
  16. The method of claim 15, wherein the generating of the emergency broadcast content, the A / V controller receives the emergency situation location information from an external system or an administrator to display in the 2D or 3D information of the pre-configured building or area to the emergency broadcast content Digital emergency broadcasting method using the image information and location information comprising the step of generating a.
  17. The method of claim 16, wherein the generating of the emergency broadcast content comprises generating the emergency broadcast content by displaying the evacuation information on the 2D or 3D information of the building or the area based on the emergency occurrence position. Digital emergency broadcasting method using the image information and location information, characterized in that it further comprises a step.
  18. The method of claim 15, wherein the generating of the emergency broadcast content, the A / V controller receives the location information of the camera and the image of the camera to provide a situation occurrence image from an external CCTV-related system to build the location information of the camera Or generating emergency broadcast content to simultaneously or sequentially provide an image displaying a camera image of a corresponding location, and displaying the 2D or 3D information of an area. Digital emergency broadcast method.
  19. The method of claim 15, wherein the generating of the emergency broadcast content comprises receiving the emergency situation related information from an external security system or an external emergency situation related system and writing the received emergency situation related information to the emergency broadcast content. Digital emergency broadcasting method using the image information and location information comprising the step of including the image.
  20. delete
  21. The control system of claim 15, wherein the PA system further comprises a light emitting unit that is added to or configured separately from a speaker for outputting an audio broadcast to indicate an evacuation direction, and a driving unit that selectively drives the light emitting unit. And a step of guiding the evacuation route by emitting the light emitting part by the PA controller which has received the information.
  22. The digital emergency using the image information and the position information of claim 21, wherein the A / V controller provides control information on the operation of the light emitting unit to the public address broadcasting controller to control the operation of the light emitting unit according to emergency broadcasting. Broadcast way.
KR1020120057358A 2012-05-30 2012-05-30 Digital emergency broadcasting system using video and location and broadcasting method thereof KR101237414B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120057358A KR101237414B1 (en) 2012-05-30 2012-05-30 Digital emergency broadcasting system using video and location and broadcasting method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120057358A KR101237414B1 (en) 2012-05-30 2012-05-30 Digital emergency broadcasting system using video and location and broadcasting method thereof

Publications (1)

Publication Number Publication Date
KR101237414B1 true KR101237414B1 (en) 2013-02-27

Family

ID=47900225

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120057358A KR101237414B1 (en) 2012-05-30 2012-05-30 Digital emergency broadcasting system using video and location and broadcasting method thereof

Country Status (1)

Country Link
KR (1) KR101237414B1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101306826B1 (en) * 2013-04-17 2013-09-10 (주)디라직 Location system using public address
KR101588446B1 (en) * 2015-04-22 2016-01-26 주식회사 올인원 코리아 Monitoring system and method of emergency broadcasting which enables remote broadcasting
US9767228B2 (en) 2014-01-22 2017-09-19 Honeywell International Inc. Determining a deployment of an access control system
KR101891916B1 (en) * 2017-03-09 2018-08-29 주식회사 큐브인 Smart emergency broadcast system for correspond to disaster based on Ad Hoc network

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070024320A (en) * 2005-08-25 2007-03-02 베타웨이브 주식회사 Mobile terminal apparatus having emergency receipt service function and service method in mobile terminal apparatus
KR100761983B1 (en) * 2006-07-31 2007-09-28 정광(주) Security system
JP2008269563A (en) * 2007-03-27 2008-11-06 Business System Kk Security system for school
KR20100110596A (en) * 2009-04-03 2010-10-13 권영현 Image monitoring apparatus for information broadcasting

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070024320A (en) * 2005-08-25 2007-03-02 베타웨이브 주식회사 Mobile terminal apparatus having emergency receipt service function and service method in mobile terminal apparatus
KR100761983B1 (en) * 2006-07-31 2007-09-28 정광(주) Security system
JP2008269563A (en) * 2007-03-27 2008-11-06 Business System Kk Security system for school
KR20100110596A (en) * 2009-04-03 2010-10-13 권영현 Image monitoring apparatus for information broadcasting

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101306826B1 (en) * 2013-04-17 2013-09-10 (주)디라직 Location system using public address
US9767228B2 (en) 2014-01-22 2017-09-19 Honeywell International Inc. Determining a deployment of an access control system
KR101588446B1 (en) * 2015-04-22 2016-01-26 주식회사 올인원 코리아 Monitoring system and method of emergency broadcasting which enables remote broadcasting
KR101891916B1 (en) * 2017-03-09 2018-08-29 주식회사 큐브인 Smart emergency broadcast system for correspond to disaster based on Ad Hoc network

Similar Documents

Publication Publication Date Title
US10863317B2 (en) Interactive emergency visualization methods
US10171982B2 (en) Emergency evacuation service
US7881713B2 (en) System and method of wirelessly triggering portable devices
US7400249B2 (en) Networked personal security system
US9639098B2 (en) Thermostat and messaging device and methods thereof
US20150038109A1 (en) Emergency response system
KR101705753B1 (en) Evacuation path guidance system
US20150348220A1 (en) Method and system for managing evacuations using positioning systems
US8422987B2 (en) Prompting and directing users to safety during emergency situations
US9171446B2 (en) Shelter evacuation response system
US9565518B2 (en) Emergency response system operated on a bluetooth low energy network
AU2007246776B2 (en) Systems and methods for distributing emergency messages
US20030093789A1 (en) Systems for monitoring broadcast content and generating notification signals as a function of subscriber profiles and methods of operating the same
US7671730B2 (en) Automated computerized alarm system
US20140313014A1 (en) Digital signage system and emergency alerting method using same
US6518878B1 (en) Warning system
US8520674B2 (en) Campus audio-visual control and communication system
US20060161946A1 (en) Broadcast receiver receiving emergency alert signal and method of processing the emergency alert signal
US20050275549A1 (en) Network support for emergency smoke detector/motion detector
US7336169B2 (en) Method and real time emergency response surveillance system
US20040201470A1 (en) Premise evacuation system
US20110227730A1 (en) System and apparatus for locating and surveillance of persons and/or surroundings
Coleman et al. The history (and future) of tornado warning dissemination in the United States
US20020024424A1 (en) Civil defense alert system and method using power line communication
JP2004312695A (en) Remote monitoring system and remote monitoring method

Legal Events

Date Code Title Description
A201 Request for examination
A302 Request for accelerated examination
E902 Notification of reason for refusal
AMND Amendment
X091 Application refused [patent]
E601 Decision to refuse application
AMND Amendment
X701 Decision to grant (after re-examination)
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20151210

Year of fee payment: 4

FPAY Annual fee payment

Payment date: 20161212

Year of fee payment: 5

FPAY Annual fee payment

Payment date: 20171227

Year of fee payment: 6

FPAY Annual fee payment

Payment date: 20190110

Year of fee payment: 7

FPAY Annual fee payment

Payment date: 20191231

Year of fee payment: 8