KR102518190B1 - System for preventing unexpected situations of complainant - Google Patents

Abstract

The present invention relates to a system for preventing malicious civil petitioners in advance of unexpected situations, and more specifically, as a system for preventing unexpected situations in advance, comprising: a wearable camera device in the form of a neckband worn around the neck by a person in charge of civil affairs administration; A device used by the person in charge of the civil affairs administration, requesting recording and recording, and outputting the recording and recording status and real-time captured video; A civil petitioner device including a camera and a microphone, installed in the direction of the civil petitioner, outputting a message related to the recording and recording request requested by the person in charge device, displaying the recording and recording status, and outputting real-time video in which the face is masked; A data management device for storing the image and recorded sound recorded by the wearable camera device and the civil petitioner device according to the request of the person in charge device, and exporting the analyzed data when there is a request for export, wherein the data management device An image analyzer for detecting and masking a human face in real time from at least one of images captured by the wearable camera device and the civil petitioner device using an artificial intelligence-based object detection model; an image transmission unit for transmitting and outputting the masked real-time image to the civil petitioner's device; A signal generator for outputting a message including the purpose and laws of recording and recording to the civil petitioner's device at the request of the person in charge, receiving an approval signal for recording and recording from the civil petitioner's device and generating a storage signal; An emergency signal generating unit for outputting a message indicating that emergency recording and recording is in progress to the civil petitioner device and generating a storage signal when receiving an emergency recording and recording request from the person in charge device; a storage unit receiving the stored signal from the signal generator or the emergency signal generator and storing the image and sound masked by the image processor; A voice analysis unit that converts the voices of the civil petition administrator and the civil petitioner included in the sound stored in the storage unit into text using an artificial intelligence-based voice recognition model to generate a transcript; and a export unit exporting at least one of the masked video and audio stored in the storage unit and the transcript generated by the voice analysis unit when a export request is received.
According to the system for preventing malicious civil petitioners in advance of unexpected situations proposed in the present invention, through a system including a wearable camera device, a civil petition administrator device, a civil petition administrator device, and a data management device, a civil petition administrator receives approval from a civil petitioner or takes an unexpected action. By recording/recording the video taken by the wearable camera device and the civil petitioner's device at the time of occurrence, it is possible to protect public officials from abusive language or assault by malicious civil petitioners, secure evidence, and in case of emergency recording/recording, the civil petitioner's device provides visual In other words, an audible warning can be displayed to encourage civil petitioners to self-restrain themselves.
In addition, according to the system for preventing malicious civil petitioners in advance of unexpected situations proposed in the present invention, recordings are automatically generated by analyzing sound, and unexpected actions of civil petitioners are classified by analyzing videos and transcripts, and the number of occurrences and frequency of malicious civil complaints, etc. By creating a report that includes, it is possible to prepare the grounds for civil complaint operation and secure the standard data for responding to malicious civil complaints.

Description

System for preventing malicious complaints in advance {SYSTEM FOR PREVENTING UNEXPECTED SITUATIONS OF COMPLAINANT}

The present invention relates to a system for preventing malicious civil petitioners from unexpected situations in advance, and more particularly, to a system for preventing unexpected situations from malicious civil petitioners through recording and recording.

People's dissatisfaction and criticism about the so-called abuse of power in the public office society and the public service continues, such as public institutions employees using abusive language or high-handed attitude toward civil petitioners. Accordingly, in the case of the current 'Public Official Civil Complaint Response Manual', malignant complaints are defined as 'special civil complaints', and the manual includes specific civil complaint occurrence reports, written warning examples, and expressions that are considerate of civil petitioners. there is.

On the other hand, however, malicious civil complaints and unfair civil complaints by civilians are increasing, and the emotional labor problem of public officials and workers at public contact points is serious. However, as above, the 'Public Officials Complaint Response Manual' only suggests passive measures, and separately from this, the 'Malignant Civil Complaint Protection Ordinance' to protect public officials from abusive language or assault by civil petitioners, centered on local governments such as Ansan City and Yangju City. A movement towards enactment is beginning to emerge.

However, such efforts should be carried out in parallel with the standard operation after the standardization work of public affairs is given priority. Standardization is important because it can promote substantial improvement in public service for public officials and public institutions through the establishment (utilization) of standards, which are relatively more flexible and voluntary norms than the law, and the operation of certification systems. To this end, identify the status of emotional labor of government-related public civil complaint workers, malicious civil complaint work manual, identify the current status of workers' emotional labor resolution and support, develop a proactive prevention system to resolve and support emotional labor, standard for responding to malicious civil complaints, and support for emotional labor The main task is to propose a system.

In parallel with this, it is necessary to develop a technology that can protect public officials from abusive language or assault by civil petitioners and secure evidence.

On the other hand, as a prior art related to the present invention, Registration Patent No. 10-1898622 (Title of Invention: Method for Providing Corresponding to Malicious Consumers, Registration Date: September 07, 2018) has been disclosed.

The present invention is proposed to solve the above problems of the previously proposed methods, and through a system including a wearable camera device, a civil petition administrator device, a civil petition administrator device, and a data management device, the civil petition administrator approves the civil petitioner. By recording/recording images taken by wearable camera devices and civil petitioner devices in the event of an unexpected action or when an unexpected action occurs, public officials can be protected from verbal abuse or assault by malicious civil petitioners, and evidence can be obtained. In case of emergency recording/recording, Its purpose is to provide an emergency prevention system for malicious civil petitioners, which can induce civil petitioners to self-restrain by expressing visual and auditory warnings with civil petitioners' devices.

In addition, the present invention analyzes sound to automatically generate transcripts, analyzes videos and transcripts to classify sudden actions of civil petitioners, and prepares reports including the number and frequency of malicious civil complaints, thereby providing grounds for civil petition operation. Another purpose is to provide an emergency prevention system for malicious civil petitioners, which can prepare and secure standard data for responding to malicious civil complaints.

In order to achieve the above object, the unexpected situation prevention system of malicious civil petitioners according to the characteristics of the present invention,

As an emergency prevention system,

A wearable camera device in the form of a neckband worn around the neck by civil affairs administrators;

A device used by the person in charge of the civil affairs administration, requesting recording and recording, and outputting the recording and recording status and real-time captured video;

A civil petitioner device including a camera and a microphone, installed in the direction of the civil petitioner, outputting a message related to the recording and recording request requested by the person in charge device, displaying the recording and recording status, and outputting real-time video in which the face is masked; and

A data management device for storing the image and recorded sound recorded by the wearable camera device and the civil petitioner device according to the request of the person in charge device, and exporting the analyzed data when there is a request for export,

The data management device,

an image analyzer for detecting and masking a human face in real time from at least one of images captured by the wearable camera device and the civil petitioner device using an artificial intelligence-based object detection model;

an image transmission unit for transmitting and outputting the masked real-time image to the civil petitioner's device;

A signal generator for outputting a message including the purpose and laws of recording and recording to the civil petitioner's device at the request of the person in charge, receiving an approval signal for recording and recording from the civil petitioner's device and generating a storage signal;

An emergency signal generating unit for outputting a message indicating that emergency recording and recording is in progress to the civil petitioner device and generating a storage signal when receiving an emergency recording and recording request from the person in charge device;

a storage unit receiving the stored signal from the signal generator or the emergency signal generator and storing the image and sound masked by the image processor;

A voice analysis unit that converts the voices of the civil petition administrator and the civil petitioner included in the sound stored in the storage unit into text using an artificial intelligence-based voice recognition model to generate a transcript; and

It is characterized in that it includes a export unit that exports at least one of the masked video and sound stored in the storage unit and the transcript generated by the voice analysis unit when a export request is received.

Preferably, the person in charge device,

Recording and recording request button, emergency recording and recording request button, and recording and recording stop button are displayed. Regardless, it may have a function of requesting the data management device to record and record according to the sudden action of the civil petitioner.

Preferably, the civil petitioner device,

When recording and recording is requested using the recording and recording request button on the manager's device, a message including a notice of the purpose of recording and recording, laws and privacy protection is output, an approval or rejection button is displayed, and the above display Approval or rejection of recording and recording may be received and transmitted to the data management device through a button selection or voice recognition.

Preferably, the civil petitioner device,

A message indicating emergency recording and recording being received from the emergency signal generator may be output, but a visual emphasis effect may be added to the message and a warning sound may be output together, thereby suppressing the sudden action of the civil petitioner.

Preferably, the civil petitioner device,

The text converted by the voice analysis unit may be received and displayed on the display screen in real time.

Preferably, the data management device,

The image editing unit may further include an image editing unit that finds an unmasked face in the image masked by the image analysis unit and additionally performs masking processing.

Preferably, the data management device,

A report generating unit generating a report by generating statistical information including the number and frequency of emergency recording and recording requests received from the manager device may be further included.

More preferably, the report generation unit,

The video stored in the storage unit and the transcript generated by the voice analysis unit are analyzed to classify the types of sudden actions of civil petitioners, and the report can be prepared including the characteristics of the classified types, the number of occurrences, and the frequency.

According to the system for preventing malicious civil petitioners in advance of unexpected situations proposed in the present invention, through a system including a wearable camera device, a civil petition administrator device, a civil petition administrator device, and a data management device, a civil petition administrator receives approval from a civil petitioner or takes an unexpected action. By recording/recording the video taken by the wearable camera device and the civil petitioner's device at the time of occurrence, it is possible to protect public officials from abusive language or assault by malicious civil petitioners, secure evidence, and in case of emergency recording/recording, the civil petitioner's device provides visual In other words, an audible warning can be displayed to encourage civil petitioners to self-restrain themselves.

In addition, according to the system for preventing malicious civil petitioners in advance of unexpected situations proposed in the present invention, recordings are automatically generated by analyzing sound, and unexpected actions of civil petitioners are classified by analyzing videos and transcripts, and the number of occurrences and frequency of malicious civil complaints, etc. By preparing a report that includes, it is possible to prepare the grounds for civil complaint operation and secure the standard data for responding to malicious civil complaints.

1 is a diagram showing the overall configuration of a system for preventing an unexpected situation of a malicious civil petitioner according to an embodiment of the present invention.
Figure 2 is a view to explain the processing of malicious civil petitions using the system for preventing malicious civil petitioners in advance of unexpected situations according to an embodiment of the present invention.
Figure 3 is a view showing an example of a device in charge of a system for preventing malicious civil petitioners in advance of unexpected situations according to an embodiment of the present invention.
4 is a diagram showing a civil petitioner device of an unexpected situation prevention system for malicious civil petitioners according to an embodiment of the present invention, for example.
5 is a diagram showing a detailed configuration of a data management device in a system for preventing malicious civil petitioners in advance of an unexpected situation according to an embodiment of the present invention.
6 is a diagram illustrating a service flow when a civil petitioner approves recording/recording in a system for preventing a malicious civil petitioner in advance of an unexpected situation according to an embodiment of the present invention.
7 is a diagram illustrating a service flow when a civil petitioner refuses to record/record in the system for preventing an unexpected situation of a malicious civil petitioner according to an embodiment of the present invention.

Hereinafter, preferred embodiments will be described in detail so that those skilled in the art can easily practice the present invention with reference to the accompanying drawings. However, in describing a preferred embodiment of the present invention in detail, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. In addition, the same reference numerals are used throughout the drawings for parts having similar functions and actions.

In addition, throughout the specification, when a part is said to be 'connected' to another part, this is not only the case where it is 'directly connected', but also the case where it is 'indirectly connected' with another element in between. include In addition, 'including' a certain component means that other components may be further included, rather than excluding other components unless otherwise specified.

1 is a diagram showing the overall configuration of a system for preventing unexpected situations of malicious civil applicants according to an embodiment of the present invention, and FIG. It is a drawing shown to explain civil complaint processing. As shown in FIGS. 1 and 2, the system for preventing unexpected situations of malicious civil petitioners according to an embodiment of the present invention includes a wearable camera device 100, a manager device 200, a civil petitioner device 300, and data management It may be configured to include device 400 .

The wearable camera device 100 may be a camera device in the form of a neckband worn around the neck by a person in charge of civil affairs administration. The wearable camera device 100 may be a device in which a camera is installed to record the direction of the wearer's field of vision when worn by a civil affairs administrator on the neck, and has a microphone on one side to record the wearer's voice or the conversation between the wearer and the other party. can do. In addition, at least one of the manager device 200 and the data management device 400 may be connected to a wired or wireless network.

Here, the network is a wired network such as a Local Area Network (LAN), a Wide Area Network (WAN) or a Value Added Network (VAN), a mobile radio communication network, a satellite communication network, All technologies such as Bluetooth, Wibro (Wireless Broadband Internet), HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution), 3/4/5/6G (3/4/5/6th Generation Mobile Telecommunication), etc. It can be implemented as a kind of wireless network.

If the civil complaint administrator wears the wearable camera device 100 and takes a video when necessary while carrying out work, the civil complaint administrator can grasp the behavior or appearance of the civil petitioner looking at it, so that the civil complaint administrator feels You can get a clearer picture of the extent of the threat and the seriousness of the situation.

The manager device 200 is a device used by a person in charge of civil affairs administration, and can request recording and recording, and output recording and recording status and real-time captured images. Here, the manager device 200 may be implemented as a tablet PC, a desktop PC, a laptop PC, a netbook computer, or the like. In particular, the manager device 200 may be implemented by installing an application for a civil petition administrator to prevent an unexpected situation of a malicious civil petitioner in advance on a tablet PC. In this way, when the tablet PC is used as the person in charge device 200, the person in charge of civil affairs administration configures the person in charge device 200 as a device separate from the computer for civil affairs administration, and a high level of security is applied to record or Recording and recording can be performed smoothly without using the network of public institutions, which is difficult to share or install applications.

FIG. 3 is a diagram showing a manager device 200 of a system for preventing malicious civil petitioners in advance of an unexpected situation according to an embodiment of the present invention, for example. As shown in FIG. 3 , the manager device 200 of the system for preventing unexpected situations of malicious civil petitioners according to an embodiment of the present invention outputs an image captured by the wearable camera device 100 to a display screen in real time. can In addition, the manager device 200 may display a recording and recording request button, an emergency recording and recording request button, a recording and recording stop button, and the like. Here, the recording and recording request button (“recording / recording request” in the screen of FIG. 3) is the recording and recording according to the approval of the civil petitioner, the emergency recording and recording request button (“emergency recording / recording” in the screen of FIG. 3) Regardless of the civil petitioner's approval, it may have a function of requesting the data management device 400 to record and record according to the civil petitioner's sudden action.

The civil complaint administrator can work while wearing the wearable camera device 100 around the neck and keeping the person in charge device 200 around. can be recorded and transcribed. At this time, recording and recording are not done unless the complainant approves. Even in this case, if the complainant engages in an unexpected action such as abusive language or assault, the emergency recording and recording request button can be used to secure evidence related to the unexpected action.

The civil petitioner device 300 includes a camera and a microphone and is installed in the direction of the civil petitioner, outputs a message related to the recording and recording request requested by the person in charge device 200, and displays the recording and recording status and real-time video in which the face is masked can output That is, in order to protect personal information, a person's face is detected in at least one image among images captured by the wearable camera device 100 and the civil petitioner's device 300, and the detected face is masked to return to the civil petitioner's device 300. can be printed out.

Here, the civil petitioner device 300 may acquire and store video and audio data by providing a camera and a microphone in the direction of the civil petitioner. More specifically, the civil petitioner's device 300 is implemented as a tablet PC, etc., may be installed in the direction of the civil petitioner so that the civil petitioner can see the display screen adjacent to the civil petition window, and input signals by touch, stylus pen, voice command, etc. It may be a device capable of inputting. In particular, the civil petitioner's device 300 may be implemented by installing an application for civil petitioners to prevent unexpected situations of malicious civil petitioners in advance on a tablet PC.

More specifically, the civil petitioner device 300, when recording and recording is requested using the recording and recording request button on the manager device 200, a message including a notice of the purpose of recording and recording, laws and privacy protection It can output, display an approval or rejection button, receive approval or rejection for recording and recording through selection of the displayed button or voice recognition, and transmit it to the data management device 400. That is, when a civil petition administrator requests recording and recording, the civil petitioner can check the contents output on the civil petitioner's device 300 and approve or reject the recording and recording. At this time, the expression of approval or rejection can be done by touching the approval button displayed on the display screen of the civil petitioner's device 300, voice command, etc. can be recognized and converted into an input signal for approval or rejection.

On the other hand, the civil petitioner's device 300 outputs a message saying that emergency recording and recording is in progress received from the emergency signal generating unit 440, which will be described in detail later in FIG. In this way, it is possible to suppress the sudden behavior of civil petitioners.

4 is a diagram showing the civil petitioner device 300 of the system for preventing malicious civil petitioners in advance of unexpected situations according to an embodiment of the present invention as an example. As shown in FIG. 4, in the system for preventing unexpected situations of malicious civil petitioners according to an embodiment of the present invention, even if the civil petitioner refuses to record or record, when the civil affairs administrator requests emergency recording / recording, recording and recording are recorded. may be executed, and during emergency recording/recording, a message of “emergency recording/recording” may be output to the display screen of the civil petitioner's device 300. At this time, the “emergency recording/recording in progress” message can be output by adding a color with high visibility such as red and a meaning of warning and a visual highlighting effect such as blinking so that it can be easily identified. In addition, a warning sound may be output together through a speaker of the civil petitioner's device 300. At this time, the warning sound may be a sound that has a warning meaning, but “If you continue to use abusive language, it is difficult to do normal work. Please stop abusive language.", "I will record/record everything from now on, and legal action is possible accordingly.", "You may be subject to legal action for obstruction of justice, so please stop abusive language." It may also be a voice that explains the situation. Through these message contents, visual highlighting effects, warning sounds, etc., it is explicitly notified that the current civil petitioner is acting unexpectedly and that these contents are being recorded/recorded, so that the civil petitioner can be induced to refrain from acting on his or her own.

The data management device 400 stores the image and sound recorded by the wearable camera device 100 and the civil petitioner device 300 according to the request of the person in charge device 200, and analyzes the data when a carry-out request is made. can be returned Hereinafter, a detailed configuration of the data management device 400 will be described in detail with reference to FIG. 5 .

5 is a diagram showing a detailed configuration of a data management device 400 in the system for preventing malicious civil petitioners in advance of an unexpected situation according to an embodiment of the present invention. As shown in FIG. 5, the data management device 400 of the system for preventing unexpected situations of malicious civil petitioners according to an embodiment of the present invention includes an image analysis unit 410, an image transmission unit 420, and a signal generation unit. 430, an emergency signal generating unit 440, a storage unit 450, a voice analysis unit 460, and a export unit 490, and may include a video editing unit 470 and a report generation unit 480 It may be configured to further include.

The image analyzer 410 detects and masks a human face in real time from at least one image among images captured by the wearable camera device 100 and the civil petitioner device 300 using an AI-based object detection model. can That is, as shown in FIG. 4, it is possible to protect personal information by mosaic-processing a person's face in an image. Here, the image for which the image analyzer 410 performs the masking process may be an image captured by the wearable camera device 100 or an image captured by the civil petitioner's device 300, or both.

At this time, all other people other than the civil petitioner are masked, and the civil petitioner himself may or may not be masked according to the embodiment. In order to process masking except for the civil petitioner, the face of the civil petitioner is registered as a face to be excluded from masking, and if the face detected in the object detection model matches the face to be excluded from masking, masking may not be performed.

The image transmission unit 420 may transmit the masked real-time image to the civil petitioner's device 300 so as to be output. As shown in FIG. 4 , the civil petitioner's device 300 may output a masked real-time image received from the image transmission unit 420 . In this case, the image output from the civil petitioner's device 300 may be a masked image obtained from the civil petitioner's device 300 .

The signal generating unit 430 outputs a message including the purpose and laws of recording and recording to the civil petitioner's device 300 at the request of the person in charge device 200, and the civil petitioner's device 300 approves the recording and recording. A signal may be input and a storage signal may be generated. That is, if there is a request from the manager device 200 through the recording and recording request button, the data management device 400 outputs a message for obtaining consent to recording/recording from the civil petitioner device 300, and the civil petitioner device 300 ), when an approval signal is input through button selection or a voice command, etc., a recording/recording data storage signal can be generated and transmitted to the storage unit 450 to be described in detail later so that the data can be stored.

When receiving an emergency recording and recording request from the manager device 200, the emergency signal generating unit 440 may output a message indicating that emergency recording and recording is in progress to the civil petitioner's device 300 and generate a storage signal. That is, even if the civil petitioner does not approve the recording / recording, if there is a request through the emergency recording and recording request button in the manager device 200, the emergency signal generating unit 440 generates and stores a storage signal of the recording / recording data. It can be delivered to the unit 450. At this time, as shown in FIG. 4, a message indicating emergency recording and recording may be output to the civil petitioner's device 300.

The storage unit 450 may receive a stored signal from the signal generator 430 or the emergency signal generator 440 and store the image and sound masked by the image processor. Here, the sound stored in the storage unit 450 may be at least one of a sound input from a microphone provided in the wearable camera device 100 and a sound input from a microphone provided in the civil petitioner device 300 . Depending on the embodiment, the storage unit 450 may store not only the masked image but also the original unmasked image.

The voice analysis unit 460 may generate a transcript by converting voices of civil petition administrators and civil applicants included in the sound stored in the storage unit 450 into text using an artificial intelligence-based voice recognition model. At this time, the voice recognition model is a speaker-separated real-time STT (Sound To Text) model, which identifies and separates the voices of the person in charge of civil affairs administration and the civil petitioner to generate a transcript in the form of a conversation.

The voice analysis unit 460 may distinguish the voices of the civil petition administrator and the civil petitioner by using the fact that the volume of the recorded voice is different depending on the relative distance between the microphone position, the civil petition administrator, and the civil petitioner, and may generate a transcript. For example, in the sound input from the microphone provided in the wearable camera device 100, the voice of the civil petition administrator is identified, and in the sound input from the microphone provided in the civil petitioner device 300, the voice of the civil petitioner is identified and converted into text. can do. It is possible to create a transcript by synchronizing the recording time of each device and synchronizing the voices identified from different sound sources.

Meanwhile, the civil petitioner's device 300 may receive the text converted by the voice analysis unit 460 and display it on the display screen in real time. Therefore, it can help the hearing-impaired people in civil petition administration, and can help civil petitioners through output text even when voice is not accurately delivered to civil petitioners due to wearing masks and installing screens to prevent infectious diseases. In addition, the text converted by the voice analysis unit 460 may be output to the manager device 200 so that the person in charge of civil affairs administration can smoothly communicate with the civil petitioner.

The image editing unit 470 may find an unmasked face in the image masked by the image analysis unit 410 and perform additional masking processing. Since the image analyzer 410 automatically detects and masks faces, there may be faces that are not detected. Accordingly, the image editing unit 470 may provide a masking processing editing tool so that the manager of the data management device 400 or the person in charge of image processing can additionally perform masking processing for personal information protection prior to exporting the image. At this time, the image to be further masked by the image editing unit 470 is limited to the image to be exported by the exporting unit 490 to be described in detail later, thereby reducing the work of the manager of the data management device 400 or the person in charge of image processing. there is.

The report generating unit 480 may create a report by generating statistical information including the number and frequency of emergency recording and recording requests received from the manager device 200 . If emergency recording and recording were requested, it can be seen that there was an unexpected action by the civil petitioner. Therefore, by analyzing the number and frequency of emergency recording/recording for a certain period, the current status of occurrence of unexpected situations and the intensity of emotional labor of civil petition administrators can be objectively determined. can be figured out as

More specifically, the report generation unit 480 analyzes the transcripts generated by the video and audio analysis unit 460 stored in the storage unit 450 to classify the types of sudden behaviors of civil petitioners, the characteristics of the classified types, and the number of occurrences. Reports can be created including frequency and frequency. That is, the report generation unit 480 may classify the unexpected behavior type of the civil petitioner from the images stored in the storage unit 450 using an artificial intelligence-based behavior recognition model. For example, a skeleton can be extracted from the appearance of a civil petitioner in a video, and the behavior type of the civil petitioner can be classified through changes in the skeleton. In addition, by analyzing transcripts using a text mining model, the type of verbal abuse can be classified into insults, sexual harassment, and personal attacks. Based on this analysis, it is possible to classify the types of unexpected behaviors and prepare a report including characteristics such as gender and age of civil petitioners for each type, and the number and frequency of occurrences of each type of unexpected behavior.

The export unit 490 may export at least one of the masked video stored in the storage unit 450, the audio, and the transcript generated by the audio analysis unit 460 when there is a request for export. That is, when an unexpected situation continues and a report is made to the police or legal action is taken, the export unit 490 may provide video, audio, and transcripts at the request of the police or the like. At this time, export may mean processing and providing a downloadable form, and may include direct transmission to a server such as the police.

6 is a diagram illustrating a service flow when a civil petitioner approves recording/recording in the system for preventing an unexpected situation of a malicious civil petitioner according to an embodiment of the present invention. As shown in FIG. 6, in the system for preventing a malicious civil petitioner's unexpected situation according to an embodiment of the present invention, when a civil petitioner requests a consultation, a civil petition administrator requests recording/recording using the manager device 200, the civil petitioner Law notification, recording/recording purpose notification, personal information protection notification, etc. are made by the device 300, and the data management device 400 (NVR) can store the recording/recording data according to the civil petitioner's approval. The recording/recording state may be displayed on the screens of the manager device 200 and the civil petitioner device 300 as “recording” or the like. When the consultation ends, the person in charge of civil affairs administration requests recording/recording stop from the manager device 200, and accordingly, the data management device 400 can stop storing the recording/recording data.

7 is a diagram illustrating a service flow when a civil petitioner refuses recording/recording in the system for preventing an unexpected situation of a malicious civil petitioner according to an embodiment of the present invention. As shown in FIG. 7 , in the system for preventing malicious civil petitioners from unexpected situations according to an embodiment of the present invention, a civil petition administrator requests a recording/recording using the device 200 in charge, and the civil petitioner may reject the request. there is. If an unexpected action, such as assault or verbal abuse, occurs during consultation without recording/recording, the person in charge of civil affairs administration may request emergency recording/recording through the device 200 in charge. The data management device 400 stores recording/recording data, and an emergency recording/recording message and warning sound may be output to the civil petitioner device 300. At this time, a countermeasure for the civil petitioner's sudden action may be output to the device 200 in charge of requesting emergency recording/recording, and a menu for immediately reporting to the police or the like may be provided. When a situation such as an unexpected action ends, the storage of recording/recording data may be stopped by requesting recording/recording stop from the device in charge 200 .

As described above, according to the system for preventing malicious civil petitioners from unexpected situations proposed in the present invention, the wearable camera device 100, the manager device 200, the civil petitioner device 300, and the data management device 400. Through the system, by recording/recording the video taken by the wearable camera device 100 and the civil petitioner device 300 when a civil petition administrator receives approval from a civil petitioner or an unexpected action occurs, public officials are protected from verbal abuse or assault by malicious civil petitioners. In case of emergency recording/recording, a visual and audible warning can be expressed through the civil petitioner device 300 to induce the civil petitioner to self-restrain. In addition, it analyzes sound to automatically generate transcripts, analyzes videos and transcripts to classify unexpected behaviors of civil petitioners, and prepares a report that includes the number and frequency of malicious complaints, thereby providing grounds for civil complaint operation and malicious complaints. Data on civil complaint response standards can be obtained.

Meanwhile, the present invention may include a computer-readable medium including program instructions for performing operations implemented in various communication terminals. For example, computer-readable media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD_ROMs and DVDs, and floptical disks. It may include hardware devices specially configured to store and execute program instructions, such as magneto-optical media and ROM, RAM, flash memory, and the like.

Such computer-readable media may include program instructions, data files, data structures, etc. alone or in combination. At this time, program instructions recorded on a computer-readable medium may be specially designed and configured to implement the present invention, or may be known and usable to those skilled in computer software. For example, it may include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes generated by a compiler.

The present invention described above can be variously modified or applied by those skilled in the art to which the present invention belongs, and the scope of the technical idea according to the present invention should be defined by the claims below.

100: wearable camera device
200: person in charge device
300: civil petitioner device
400: data management device
410: image analysis unit
420: video transmission unit
430: signal generator
440: emergency signal generating unit
450: storage unit
460: voice analysis unit
470: video editing department
480: report generating unit
490: export unit

Claims (8)

As an emergency prevention system,
A wearable camera device 100 in the form of a neckband worn around the neck by a civil affairs administrator;
As a device used by the person in charge of civil affairs administration, a manager device 200 for requesting recording and recording, and outputting a recording and recording status and a real-time captured image;
A civil petitioner device including a camera and a microphone, installed in the direction of the civil petitioner, outputting a message related to the recording and recording request requested by the manager device 200, displaying the recording and recording status, and outputting a real-time image in which the face is masked ( 300); and
Including a data management device 400 for storing the image and recorded sound recorded by the wearable camera device 100 and the civil petitioner device 300 according to the request of the person in charge device 200,
The data management device 400,
An image analysis unit 410 for detecting and masking a human face in real time from at least one image among images captured by the wearable camera device 100 and the civil petitioner device 300 using an AI-based object detection model ;
an image transmission unit 420 for transmitting and outputting the masked real-time image to the civil petitioner device 300;
At the request of the person in charge device 200, a message including the purpose and laws of recording and recording is output to the civil petitioner device 300, and an approval signal for recording and recording is received and stored in the civil petitioner device 300. a signal generating unit 430 generating a signal;
When receiving an emergency recording and recording request from the person in charge device 200, an emergency signal generator 440 for outputting a message indicating that emergency recording and recording is in progress to the civil petitioner device 300 and generating a storage signal;
a storage unit 450 that receives the storage signal from the signal generator 430 or the emergency signal generator 440 and stores the image and sound masked by the image analyzer 410;
A voice analysis unit 460 for generating a transcript by converting the voices of the civil petition administrator and the civil petitioner included in the sound stored in the storage unit 450 into text using an artificial intelligence-based voice recognition model; and
Characterized in that it includes an export unit 490 that exports at least one of the masked video and audio stored in the storage unit 450 and the transcript generated by the voice analysis unit 460 when there is a request for export. A system for preventing malicious complaints in advance.
The method of claim 1, wherein the manager device 200,
Recording and recording request button, emergency recording and recording request button, and recording and recording stop button are displayed. A system for preventing unexpected situations of malicious civil applicants, characterized in that it has a function of requesting the data management device 400 for recording and recording according to the unexpected behavior of the civil petitioner regardless of the situation.
The method of claim 1, wherein the civil petitioner device 300,
When recording and recording is requested using the recording and recording request button on the manager device 200, a message including a notice of the purpose of recording and recording, laws and privacy protection is output, and an approval or rejection button is displayed, , A system for preventing unexpected situations of malicious civil petitioners, characterized in that the approval or rejection of recording and recording is received and transmitted to the data management device 400 through selection of the displayed button or voice recognition.
The method of claim 1, wherein the civil petitioner device 300,
Characterized in that the emergency recording and recording in progress message received from the emergency signal generating unit 440 is output, and a warning sound is output together with a visual emphasis effect added to the message to suppress the sudden action of the civil petitioner. A system for preventing malicious complaints in advance.
The method of claim 1, wherein the civil petitioner device 300,
Characterized in that the text converted by the voice analysis unit 460 is received and displayed on the display screen in real time, a system for preventing malicious civil petitioners from unexpected situations in advance.
The method of claim 1, wherein the data management device 400,
In the image masked by the image analysis unit 410, an image editing unit 470 that finds an unmasked face and additionally processes the masking, Characterized in that, the system for preventing malicious civil petitioners in advance of unexpected situations.
The method of claim 1, wherein the data management device 400,
Characterized in that it further comprises a report generating unit 480 for generating a report by generating statistical information including the number and frequency of emergency recording and recording requests received from the device in charge 200, the sudden situation of malicious civil petitioners Proactive system.
The method of claim 7, wherein the report generating unit 480,
Analyzing the video stored in the storage unit 450 and the transcript generated by the voice analysis unit 460 to classify the types of sudden behaviors of civil petitioners, and to create the report including the characteristics of the classified types, the number of occurrences, and the frequency Characterized in that, an unexpected situation prevention system for malicious civil petitioners.

Images