JP2018041166A - Notification system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a notification system with which, in the case of an emergency as when a guard is attacked by a robber, it is possible for a monitoring center to accurately grasp a situation around the guard by video and sound based data communication and avoid a break in the data communication for a fixed time or more.SOLUTION: Provided is a notification system equipped with a portable terminal device 70 and a server 60, comprising: emergency notification indication means provided in the portable terminal device 70, for indicating an emergency notification; an image acquisition unit 70d for acquiring a video in which a place of guard is imaged and which includes a sound when the emergency notification is indicated; an emergency notification transmission unit 70e for executing data communication that includes the video acquired by the image acquisition unit 70d between the portable terminal device 70 and the server 60; and a video conversation restart unit 60i and the emergency notification transmission unit 70e for avoiding a break in the data communication between the portable terminal device 70 and the server 60 for a fixed time or more by the emergency notification transmission unit 70e.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a notification system.

  Conventionally, in convenience stores, etc., security is entrusted to a security company. In this way, the security guards entrusted with security will introduce a reporting system that can report to the monitoring center of the security company by pressing the emergency button when an emergency such as illegal intrusion or robbery occurs. Then, the security company that received the report through the report system urges the guard to the spot and confirms the situation.

  When checking the situation at the site, the guards need to be prepared for unexpected situations such as being attacked by illegal intruders or robbery (hereinafter referred to as bandits). Therefore, conventionally, in preparation for an unexpected situation such as being attacked by a bandit, a security guard carries a mobile terminal device (mobile phone) having an imaging function for moving images and still images.

  In the event of an unforeseen event such as being attacked by a bandit, the guard sends a notification to the monitoring center by pressing a notification button on the mobile terminal device, and at the same time transmits surrounding images and sounds to the monitoring center. When an unforeseen situation such as being attacked by a bandit occurs in this way, it is easy to check the situation at the monitoring center by performing a video call that transmits surrounding video or sound to the monitoring center.

JP 2004-40733 A JP 2007-87148 A

  However, video calls such as those described above are various such as data network congestion, mobile terminal device radio wave intensity, mobile terminal device packet restrictions, video call server maintenance and performance degradation due to congestion, monitoring center side line conditions, etc. Depending on the factors, there are problems such as “cannot be connected”, “video and sound cannot be transmitted sufficiently even when connected”, “delay occurs”, and the communication stability is lower than that of voice call.

  The present invention has been made in view of the above, and in an emergency situation such as when a guard is attacked by a bandit, the monitoring center accurately determines the situation around the guard by data communication using video and sound. It is an object of the present invention to provide a notification system that can be grasped by the user and that the data communication can be prevented from being interrupted for a certain period of time.

  In order to solve the above-described problems and achieve the object, the present invention provides a notification system including a portable terminal device and a server. When the emergency call is instructed by the emergency call instruction means, the video acquisition means for acquiring the video including the sound that is an image of the security guard, and the data communication including the video acquired by the video acquisition means Video communication means executed between the mobile terminal device and the server, and communication maintaining means for avoiding interruption of the data communication between the mobile terminal device and the server by the video communication means for a predetermined time or more. It is characterized by providing.

  The notification system according to the present invention enables the monitoring center to accurately grasp the situation around the security guard through data communication using video and sound in an emergency situation such as when a security guard is attacked by a bandit. The data communication can be prevented from being interrupted for a certain period of time.

FIG. 1 is a diagram showing a schematic configuration of a notification system according to the first embodiment. FIG. 2 is a block diagram illustrating a hardware configuration of the security terminal and the monitoring server. FIG. 3 is a block diagram illustrating a hardware configuration of the mobile terminal device. FIG. 4 is a block diagram illustrating a functional configuration of the security terminal, the monitoring server, and the mobile terminal device. FIG. 5 is a flowchart showing a procedure of notification processing performed in the notification system. FIG. 6 is a block diagram illustrating a functional configuration of a security terminal, a monitoring server, and a mobile terminal device according to the second embodiment. FIG. 7 is a flowchart showing a procedure of notification processing performed in the notification system. FIG. 8 is a block diagram illustrating a functional configuration of a security terminal, a monitoring server, and a mobile terminal device according to the third embodiment. FIG. 9 is a block diagram illustrating a functional configuration of a security terminal, a monitoring server, and a mobile terminal device according to the fourth embodiment. FIG. 10 is a block diagram illustrating a functional configuration of a security terminal, a monitoring server, and a mobile terminal device according to the fifth embodiment. FIG. 11 is a flowchart showing a procedure of notification processing performed in the notification system.

  Embodiments of a notification system according to the present invention will be described below in detail with reference to the accompanying drawings.

(First embodiment)
Here, FIG. 1 is a diagram showing a schematic configuration of the notification system according to the first embodiment. A security destination entrusting security to a security company is, for example, a convenience store.

  As shown in FIG. 1, an emergency button 50 for reporting, a security terminal 53 to which the emergency button 50 is connected, and a reporting terminal 51 that shares a telephone line to which the telephone terminal 52 is connected are provided at the security destination. Installed. In addition, a security camera 54 that captures an image of the security guard and various sensors 55 that detect intruders of the security guard are installed at the security guard.

  The security terminal 53 is connected to the monitoring server 60 installed in the monitoring center of the security company via the network 56 and performs communication. The network 56 is, for example, a LAN (Local Area Network), Ethernet (registered trademark), or the Internet. When the emergency button 50 is pressed, the security terminal 53 notifies the monitoring server 60 via the network 56.

  The reporting terminal 51 is connected to a telephone terminal (police telephone terminal) possessed by the police and other telephone terminals via a telephone line.

  When the monitoring server 60 receives a report from the security terminal 53, the monitoring server 60 makes a request for dispatch to the mobile terminal device 70 owned by the security guard of the security company. The mobile terminal device 70 is, for example, a mobile phone or a smartphone. After receiving the request for dispatch, the security guard of the security company rushes to the site in response to the request for dispatch and checks the status of the site.

  The guards rushing to the scene call the monitoring center telephone from the scene and report it. The center member makes a situation determination based on the report in the voice call from the mobile terminal device 70. Then, based on the situation determination of the center member, the monitoring server 60 controls other guards' support requests and the security terminal 53 to cause the reporting terminal 51 to report to the police via the telephone line.

  By the way, when checking the situation at the site, the guards need to be prepared for an unexpected situation such as being attacked by an illegal intruder or a burglar (hereinafter referred to as a bandit). Therefore, the mobile terminal device 70 has a function of making an emergency call by a video call to the monitoring server 60 of the monitoring center only by performing a special operation.

  When there is a special operation by a security guard rushing to the scene, the center member makes a situation determination based on video (including still images) and sound in the video call of the mobile terminal device 70. Then, based on the situation determination of the center member, the monitoring server 60 controls other guards' support requests and the security terminal 53 to cause the reporting terminal 51 to report to the police via the telephone line.

  Next, in FIG. 1, only one security destination is shown, but there are a plurality of security destinations, and a plurality of security terminals 53 installed at each security destination are connected to the monitoring server 60. Is connected to the telephone line. In this case, guard destination identification information for identifying each is given to a plurality of guard destinations.

  Here, the hardware configuration of the security terminal 53, the monitoring server 60, and the mobile terminal device 70 will be described.

  Here, FIG. 2 is a block diagram showing a hardware configuration of the security terminal 53 and the monitoring server 60. As shown in FIG. 2, the security terminal 53 and the monitoring server 60 according to the present embodiment include a control unit 101 such as a CPU (Central Processing Unit) that controls the entire apparatus, and a ROM (Read that stores various data and various programs). Main memory 102 such as Only Memory (RAM) and Random Access Memory (RAM), auxiliary storage 103 such as HDD (Hard Disk Drive) and CD (Compact Disk) drive devices for storing various data and various programs, and the like A bus 104 to be connected is provided, which can be realized by a hardware configuration using a normal computer. The CPU has a time measuring function for measuring the current time. The security terminal 53 and the monitoring server 60 each exhibit unique functions of the security terminal 53 and the monitoring server 60 due to differences in programs stored in the auxiliary storage unit 103.

  Further, the control unit 101 includes a display unit 105 that displays information, an operation input unit 106 such as a keyboard and a mouse that accepts user instruction input, and a communication I / F (interface) 107 that controls communication with an external device. Are connected to each other by a bus 104.

  Further, the above-described monitoring camera 54 and various sensors 55 can be connected to the communication I / F 107 of the security terminal 53.

  The monitoring server 60 is connected to a telephone line, and can send and receive calls and voice messages.

  Next, the mobile terminal device 70 will be described. Here, FIG. 3 is a block diagram showing a hardware configuration of the mobile terminal device 70. As shown in FIG. 3, the mobile terminal device 70 of the present embodiment includes a control unit 201 such as a CPU that controls the entire device, a main storage unit 202 such as a ROM and RAM that stores various data and various programs, An auxiliary storage unit 203 such as a flash memory for storing various data and various programs, and a bus 204 for connecting them are provided. The mobile terminal device 70 according to the present embodiment can be realized by a hardware configuration using, for example, a smartphone. The CPU has a time measuring function for measuring the current time.

  Further, a display unit 205 that displays information and a communication interface (I / F) 206 that controls communication with the monitoring server 60 are connected to the control unit 201 via a bus 204. The mobile terminal device 70 performs voice calls with the monitoring center telephone via the communication I / F 206 and the voice line network 207 and video calls with the monitoring server 60 of the monitoring center via the communication I / F 206 and the data network 208. Is possible.

  In addition, the mobile terminal device 70 according to the present embodiment incorporates a camera 209 that captures an image. In addition, the mobile terminal device 70 of the present embodiment incorporates a microphone 210 that captures ambient sounds. A camera 209 and a microphone 210 are connected to the control unit 201 via a bus 204, respectively.

  The control unit 201 is connected to an operation input unit 211 such as a touch panel or a button that receives a user instruction input via the bus 204. The operation input unit 211 may be an earphone button connected to the mobile terminal device 70 or a wirelessly connected button such as Bluetooth (registered trademark).

  Next, various functions realized by the security terminal 53, the monitoring server 60, and the mobile terminal device 70 in such a hardware configuration will be described. Here, FIG. 4 is a block diagram illustrating a functional configuration of the security terminal 53, the monitoring server 60, and the mobile terminal device 70.

  First, various functions realized by the security terminal 53 will be described.

  The security terminal 53 includes an image acquisition unit 53a, a signal transmission unit 53b, and a signal reception unit 53c. These functions are realized when the control unit 101 of the security terminal 53 executes a program stored in the auxiliary storage unit 103. The auxiliary storage unit 103 such as the HDD of the security terminal 53 stores security destination identification information for identifying the security destination where the security terminal 53 is installed. The security destination identification information is, for example, a management number assigned to the security destination or a name of the security destination (for example, a store name of a convenience store). The voice message at the time of reporting indicates, for example, the name of the security guard, the fact that an abnormality has occurred, or the request for dispatch.

  The image acquisition unit 53a acquires an image captured by the monitoring camera 54 when the emergency button 50 for notification is pressed.

  The signal transmission unit 53b transmits an emergency signal indicating that the emergency button 50 for notification including the image signal representing the image acquired by the image acquisition unit 53a has been pressed and the guard server identification information to the monitoring server 60 via the network 56. Send through.

  Next, various functions realized by the monitoring server 60 will be described.

  The monitoring server 60 includes a signal reception unit 60a, a screen display control unit 60b, a signal transmission unit 60c, an emergency signal transmission unit 60d, an emergency call reception unit 60e, and a microphone OFF unit 60f. The functions of the signal receiving unit 60a, the screen display control unit 60b, the signal transmission unit 60c, the emergency signal transmission unit 60d, the emergency call reception unit 60e, and the microphone OFF unit 60f are controlled by the control unit 101 of the monitoring server 60 in the auxiliary storage unit 103. This is realized by executing a stored program.

  The auxiliary storage unit 103 such as the HDD of the monitoring server 60 stores guard destination information regarding the guard destination in which the guard terminal 53 connected to the monitoring server 60 is installed. The guard destination information indicates, for example, the name of the guard destination, a telephone number, and guard destination identification information.

  The signal receiving unit 60a receives an emergency signal from the security terminal 53 that includes an image signal and indicates that the emergency button 50 for notification has been pressed and also indicates the security destination identification information. The signal receiving unit 60a acquires the video managed by the security terminal 53 (including the real-time video captured by the monitoring camera 54 connected to the security terminal 53), which will be described in detail later. Also works.

  The screen display control unit 60b specifies a security destination using the security destination identification information included in the emergency signal received by the signal reception unit 60a, and causes the display unit 105 to display a notification confirmation screen.

  When the signal transmission unit 60c has an operation input indicating that it is necessary to report to the police via the operation input unit 106 on the notification confirmation screen displayed on the display unit by the screen display control unit 60b, The operation input is received, and a control signal instructing a report to the police is transmitted to the security terminal 53.

  The emergency signal transmission unit 60d includes an image signal representing the image acquired by the image acquisition unit 53a, indicates that the emergency button 50 for notification has been pressed, and sends an emergency signal to the mobile terminal device 70 indicating the security destination identification information. Transmission is performed via the line network 207 or the data network 208.

  The emergency call receiver 60e receives from the mobile terminal device 70 an emergency call by a video call including video and sound and current location information. Further, the emergency call receiving unit 60e receives types of “bandit warning” and “bandit discovery” which will be described later.

  The microphone OFF unit 60f automatically turns off the center-side microphone (not shown) connected to the monitoring server 60 when the types of “bandit warning” and “bandit discovery” described later are received.

  Next, various functions realized by the mobile terminal device 70 will be described.

  The mobile terminal device 70 includes a signal reception unit 70a, a screen display control unit 70b, a signal transmission unit 70c, an image acquisition unit 70d, an emergency call transmission unit 70e, a noise cancellation function unit 70f, and a function OFF unit 70g. And a position detector 70h. Each function of the signal receiving unit 70a, the screen display control unit 70b, the signal transmission unit 70c, the image acquisition unit 70d, the emergency call transmission unit 70e, and the function OFF unit 70g is controlled by the control unit 201 of the mobile terminal device 70. This is realized by executing a program stored in the memory. The noise cancellation function unit 70f is realized by a noise canceling circuit that is hardware. The position detection unit 70h that functions as a position detection unit includes a GPS (Global Positioning System) receiver and the like, detects the current position of the mobile terminal device 70 that is received from the antenna, and generates current position information.

  The signal receiving unit 70a receives from the monitoring server 60 an emergency signal including an image signal representing the image acquired by the image acquisition unit 53a and indicating that the emergency button 50 for notification has been pressed and including guard destination identification information. .

  The screen display control unit 70b specifies a security destination using the security destination identification information included in the emergency signal received by the signal reception unit 70a, and transmits a dispatch request for confirmation of the situation at the security destination to the security guard. A dispatch request screen is displayed on the display unit 205.

  The signal transmission unit 70c displays a call-out request screen on the display unit 205 by the screen display control unit 70b, and then when a predetermined operation is performed on the operation input unit 211 (touch panel or the like), a preset number (monitoring center) Phone number).

  The image acquisition unit 70d causes the screen display control unit 70b to display a call-out request screen on the display unit 205, and then the operation input unit 211 (such as an earphone button connected to the mobile terminal device 70 or a wirelessly connected button). When a special operation is performed, an image captured by the camera 209 built in the mobile terminal device 70 is acquired. That is, the image acquisition unit 70d functions as a video acquisition unit, and the operation input unit 211 (such as a button of an earphone connected to the portable terminal device 70 or a button connected wirelessly) instructs an emergency call. Functions as a means.

  In addition, the emergency call transmission unit 70e causes the screen display control unit 70b to display the call-out request screen on the display unit 205, and then the operation input unit 211 (an earphone button connected to the mobile terminal device 70 or a wireless connection). When there is a special operation of a button or the like, an emergency call by a video call including a video acquired by the image acquisition unit 70d is transmitted to the monitoring server 60 as an “emergency call ON state”. That is, the emergency call transmission unit 70e functions as a video communication unit that executes data communication between the mobile terminal device 70 and the monitoring server 60.

  Note that the special operation of the operation input unit 211 to be in the “emergency notification ON state” may be voice recognition by a keyword such as “emergency”, a change of the acceleration sensor when receiving a strong impact, or the like.

  In addition, a plurality of buttons and keywords related to special operations in the operation input unit 211 are prepared, and the types such as “fire”, “bandit warning”, “bandit discovery”, “first aid”, “accident” may be divided. good. In this case, the emergency call transmission unit 70e transmits the type together with the emergency call, and sets the requirements (“fire”, “bandit warning”, “bandit discovery”, “first aid”, “accident”) to the monitoring server 60 of the monitoring center. It may be displayed.

  In addition, the emergency call transmission unit 70e can transmit Bluetooth or Wi-Fi (registration) when the mobile terminal device 70 cannot transmit the emergency call by the video call to the monitoring server 60 via the data network 208 for reasons such as out of service area. (Trademark) or other wireless communication is used to connect to the nearest auxiliary device (security terminal 53, security robot, surveillance camera 54, etc.), and emergency notification by video call is monitored from the auxiliary device via the network 56 Send to server 60. By doing so, an emergency call can be transmitted to the monitoring server 60 of the monitoring center even in a place where the radio wave condition of the mobile terminal device 70 is bad.

  That is, even when the radio wave condition of the mobile terminal device 70 is poor, if the site is a security destination and the security terminal 53 is installed, the video is transmitted via the security terminal 53, the security robot, the monitoring camera 54, and the like. And sound can be confirmed at the monitoring center.

  The screen display control unit 70b of the mobile terminal device 70 does not display the “emergency notification ON state” on the display unit 205 even when there is a special operation of the operation input unit 211 that sets the “emergency notification ON state”. . That is, when the emergency call is instructed, the screen display control unit 70b of the mobile terminal device 70 does not notify that the video call is being executed.

  In addition, when the monitoring server 60 receives the types of “bandit warning” and “bandit discovery”, it automatically turns off the center-side microphone (not shown) connected to the monitoring server 60.

  Thereby, when the guard who rushed to the spot is hidden from the bandit, the mobile terminal device 70 and the monitoring server 60 can be set so that the sound transmitted from the monitoring center is not noticed by the bandit.

  In the present embodiment, the image acquisition unit 70d acquires the video captured by the camera 209 built in the mobile terminal device 70 as the video call video, but the present invention is not limited to this. For example, a wearable camera connected to the mobile terminal device 70, a drone (unmanned aerial vehicle) installed at a security guard or a security company with a security company, a camera installed at a security robot, an image of a security guard You may make it acquire the image | video image | photographed with either of the surveillance cameras 54 imaged, or the image | video which combined several image | video.

  Note that video transmission from a camera installed in a drone or a security robot or the surveillance camera 54 is not limited to transmission via the mobile terminal device 70 connected wirelessly. For example, the video from the camera installed on the drone or the security robot or the surveillance camera 54 may be transmitted using the network 56 not via the mobile terminal device 70 but via the Wi-Fi router or the like. good.

  The noise cancellation function unit 70f functions as noise cancellation means. The noise canceling function unit 70f analyzes ambient noise picked up by the microphone 210 (car driving sound, noise in the room, noise in the city, etc.), and generates a sound in reverse phase that cancels the analyzed noise in real time. And has a function to cancel noise. The noise canceling function unit 70f normally has the noise canceling function set to ON so that the sound picked up by the microphone 210 can be heard clearly without being disturbed by noise.

  On the other hand, in the situation determination of the center member by listening to the sound in the video call of the mobile terminal device 70, ambient noise picked up by the microphone 210 (car driving noise, indoor noise, noise in the city, etc.) is necessary. It may become. Therefore, the image acquisition unit 70d controls the function OFF unit 70g to turn off the noise cancellation function of the noise cancellation function unit 70f when there is a special operation of the operation input unit 211 in the “emergency notification ON state”.

  When the image acquisition unit 70d receives a signal for turning off the noise cancellation function transmitted from the monitoring server 60 via the signal reception unit 70a, the image acquisition unit 70d controls the function OFF unit 70g to control the noise of the noise cancellation function unit 70f. The cancel function may be turned off.

  By the way, the video call as described above may not be started when the radio wave condition is bad or the communication speed cannot be obtained sufficiently, or there may be a case where sufficient quality is not obtained even if the communication is started. Therefore, the emergency call transmission unit 70e stops the video call when the video call cannot be connected for a certain period of time, or when the video call is started but is disconnected halfway, and is preset by the signal transmission unit 70c. Switch to the transmission of the number (the telephone number of the telephone of the monitoring center) and start a voice call to the monitoring center. That is, the emergency call transmission unit 70e also functions as a voice call unit, a switching unit, and a communication maintaining unit.

  When the video call is stopped, the signal receiving unit 60a of the monitoring server 60 of the monitoring center is connected to the security terminal 53 or the security robot that is a video management device that manages the video of the security destination, and is managed by the security terminal 53. The captured video may be acquired, or the real-time video captured by the surveillance camera 54 connected to the security terminal 53 may be acquired.

  In addition, when it becomes impossible to avoid that the video call is interrupted for a certain time or more by the emergency call transmission unit 70e due to deterioration of radio wave conditions, the mobile terminal device 70 is an auxiliary storage unit that is video storage means in the mobile terminal device 70 Images may be stored in 203. In this case, the emergency call transmission unit 70e performs data communication (video call) of the video stored in the auxiliary storage unit 203 in the monitoring center at the timing when the radio wave condition is recovered.

  As a result, in a video call, there are various factors such as congestion of the data network 208, radio wave intensity of the mobile terminal device 70, packet limitation of the mobile terminal device 70, performance degradation due to maintenance and congestion of the monitoring server 60, line status on the monitoring center side Due to factors, it is possible to solve the problem that communication stability is low compared to voice calls, such as “cannot connect”, “video and sound are not transmitted sufficiently even when connected”, “delay occurs”, etc. .

  The position detection unit 70h generates current position information when the operation input unit 211 is set to “emergency notification ON state”. Then, the emergency notification transmission unit 70e transmits the generated current position information to the monitoring server 60 by including it in the emergency notification by the video call.

  Next, the procedure of notification processing performed by the notification system according to the present embodiment will be described. Here, FIG. 5 is a flowchart showing a procedure of notification processing performed in the notification system. At normal times, the security terminal 53 stands by until the emergency button 50 is pressed (step S1: No) or a control signal is received (step S26: No). The monitoring server 60 stands by until an emergency signal is received (step S3: No) or an emergency call is received (step S20: No). The portable terminal device 70 stands by until an emergency signal is received (step S8: No), until a predetermined operation is performed (step S10: No), or until a special operation is performed (step S12: No).

  In the security destination, when the emergency button 50 for notification is pressed (step S1: Yes), the security terminal 53 acquires an image captured by the surveillance camera 54 and includes an image signal representing the image for notification. An emergency signal indicating that the emergency button 50 has been pressed and indicating guard destination identification information is transmitted to the monitoring server 60 via the network 56 (step S2).

  When the monitoring server 60 receives the emergency signal from the security terminal 53 (step S3: Yes), the monitoring server 60 identifies the security destination using the security destination identification information included in the emergency signal, and displays it by the image signal included in the emergency signal. A notification confirmation screen for prompting the center member to confirm the necessity of reporting to the police is displayed on the display unit 105 using the image to be displayed (step S4).

  In the notification confirmation screen, when there is an operation input indicating that it is necessary to report to the police via the operation input unit 106 (step S5: Yes), the monitoring server 60 accepts the operation input, A control signal instructing reporting to the police is transmitted to the security terminal 53 via the network 56 (step S6).

  On the other hand, when there is no operation input indicating that it is necessary to report to the police (step S5: No), the monitoring server 60 does not send a control signal to the security terminal 53, and the center member An emergency signal for encouraging the guard to be dispatched to the guard specified by the tip identification information is transmitted to the mobile terminal device 70 via the network 56 (step S7). The emergency signal includes guard identification information.

  When the mobile terminal device 70 receives an emergency signal urging the guard to be dispatched to the guard specified by the guard destination identification information from the monitoring server 60 (step S8: Yes), the mobile terminal device 70 converts the emergency signal into an emergency signal. A guard destination is specified using the guard destination identification information included, and a dispatch request screen for transmitting a dispatch request for status confirmation at the guard destination to the guard is displayed on the display unit 205 (step S9). The name and address of the security guard are displayed on the dispatch request screen.

  Security guards of the security company rush to the site while checking the dispatch request screen displayed on the mobile terminal device 70, and confirm the status of the site.

  When there is a predetermined operation by a guard rushing to the site (step S10: Yes), the mobile terminal device 70 places a call to a number (telephone number of the monitoring center phone) set in advance by the signal transmission unit 70c. (Step S11).

  In addition, when there is a special operation by a security guard rushing to the site (Step S10: No, Step S12: Yes), the mobile terminal device 70 sets an “emergency call ON state” and performs an emergency by a video call including a video. The notification and current position information are transmitted to the monitoring server 60 (step S13). In this case, the mobile terminal device 70 does not notify that “the reporting state is ON”. Furthermore, the mobile terminal device 70 turns off the noise cancellation function (step S14).

  When the video call cannot be connected for a certain period of time, or when the video call is started but is disconnected in the middle (step S15: Yes), the mobile terminal device 70 stops the video call (step S16), and the signal transmission unit A call is made to a preset number (telephone number of the monitoring center) by 70c (step S17), and the process is terminated. This is because the video call may not be started when the radio wave condition is poor or the communication speed cannot be obtained sufficiently, or sufficient quality may not be obtained even if it is started.

  On the other hand, when the video call can be connected for a certain period of time (step S15: No), the mobile terminal device 70 waits for an emergency call canceling operation by a security officer rushing to the scene (step S18). That is, the portable terminal device 70 returns to step S15 when there is no emergency call canceling operation (step S18: No). When there is an emergency call cancel operation (step S18: Yes), the mobile terminal device 70 transmits a control signal instructing the emergency call cancel to the monitoring server 60 (step S19), and ends the process.

  When the monitoring server 60 receives an emergency call from the mobile terminal device 70 (step S20: Yes), the display unit 205 displays a screen for outputting video and sound for connecting to the mobile terminal device 70 and confirming the situation at the security destination. (Step S21). As a result, in an emergency such as when a guard is attacked by a bandit, the monitoring center can accurately grasp the situation around the guard by video and sound. And when the operation input which shows judgment that the report to the police is required is via the operation input part 106 (step S22: Yes), the monitoring server 60 receives the said operation input, and reports to the police. Is transmitted to the security terminal 53 via the network 56 (step S23), and the process proceeds to step S24. If there is no operation input indicating that it is necessary to report to the police (step S22: No), the monitoring server 60 proceeds directly to step S24.

  Moreover, the monitoring server 60 will disconnect a connection with the portable terminal device 70, if the control signal which instruct | indicates emergency call cancellation | release is received (step S24: Yes), and complete | finishes a process. Note that if the monitoring server 60 has not received a control signal instructing cancellation of the emergency call (step S24: No), the monitoring server 60 returns to step S21.

  When receiving the control signal (step S26: Yes), the security terminal 53 transmits a control signal instructing to report to the police to the reporting terminal 51 according to the control signal (step S27).

  When the reporting terminal 51 receives the control signal, the reporting terminal 51 calls the police telephone terminal via the telephone line using the telephone number stored in advance in accordance with the control signal, and the police telephone terminal When an incoming call is received, a pre-stored voice message is output to notify the police. In the police, telephone numbers and resident information such as addresses and store names are stored in advance in association with each other. For this reason, the police can automatically determine the address associated with the telephone number of the caller who has called the police telephone terminal for the caller who stores this resident information. It becomes possible to express at the address site.

  As described above, according to the present embodiment, operation of the operation input unit 211 (such as a button of an earphone connected to the mobile terminal device 70 or a button connected wirelessly) in the mobile terminal device 70, a keyword such as “emergency” If there is a special operation such as voice recognition by the sensor or a change in the acceleration sensor when subjected to a strong impact, it is determined that an unexpected situation such as a security guard being attacked by a bandit has occurred. An emergency call is made to the monitoring server 60 by a video call. As a result, in an emergency such as when a guard is attacked by a bandit, the monitoring center can accurately grasp the situation around the guard by video and sound.

  In addition, according to the present embodiment, the data communication between the mobile terminal device 70 and the monitoring server 60 is prevented from being interrupted for a predetermined time or more, so that the video call is more communicable than the voice call. The problem of low stability can be solved.

  In addition, according to the present embodiment, when there is a special operation, the center member by listening to the sound in the video call of the mobile terminal device 70 by turning off the noise cancellation function of the noise cancellation function unit 70f. In this situation determination, it is possible to hear the ambient noise picked up by the microphone 210 (car running noise, indoor noise, noise in the city, etc.).

(Second Embodiment)
Next, a second embodiment will be described. The same parts as those in the first embodiment described above are denoted by the same reference numerals, and description thereof is also omitted.

  The monitoring server 60 according to the present embodiment determines the quality of the video after the start of the video call from the mobile terminal device 70, and feeds back the quality value of the video to the mobile terminal device 70 as a report source. is there.

  Here, FIG. 6 is a block diagram illustrating a functional configuration of the security terminal 53, the monitoring server 60, and the mobile terminal device 70 according to the second embodiment. As shown in FIG. 6, the monitoring server 60 includes a quality determination unit 60g. The function of the quality determination unit 60g is realized by the control unit 101 of the monitoring server 60 executing a program stored in the auxiliary storage unit 103.

  The quality determination unit 60g functions as a quality determination unit. The quality determination unit 60g determines the quality of the video after the start of the video call from the mobile terminal device 70, and feeds back the quality value of the video to the mobile terminal device 70 that is the report source.

  Examples of the quality of the video to be determined include the frame rate, resolution, lack of sound, delay, and variation in luminance. The frame rate is the number of frames (the number of still images and the number of frames) processed per unit time in a moving image. When the frame rate is lowered, the movement is not smooth and the quality is lowered. The resolution is a numerical value indicating the pixel density in the bitmap image. If the resolution is low, the image becomes rough and the quality deteriorates.

  The above-described deterioration in video quality can occur when the communication speed is low or when a tape is attached to the camera.

  As illustrated in FIG. 6, the mobile terminal device 70 includes a call switching unit 70 i. The function of the call switching unit 70 i is realized when the control unit 201 of the mobile terminal device 70 executes a program stored in the auxiliary storage unit 203.

  When the quality value of the video fed back from the quality determination unit 60g of the monitoring server 60 is less than a certain value over a certain time, the call switching unit 70i cancels the video call and the number set in advance by the signal transmission unit 70c. Switch to voice call by calling (monitoring center phone number).

  Note that the call switching unit 70i may simultaneously connect the video call and the voice call when the video quality value fed back from the quality determination unit 60g of the monitoring server 60 exceeds a certain time and is below a certain value. good.

  Next, the procedure of notification processing performed by the notification system according to the present embodiment will be described. Here, FIG. 7 is a flowchart showing a procedure of notification processing performed in the notification system.

  As shown in FIG. 7, when there is a special operation by a guard rushing to the site (step S12: Yes), the mobile terminal device 70 sets “emergency notification ON state” and displays a video to the monitoring center. The emergency call by the video call including the current position information and the current position information are transmitted to the monitoring server 60, and the noise canceling function is turned off (steps S13 to S14).

  On the other hand, after the start of the video call from the mobile terminal device 70 (steps S20 to 21), the monitoring server 60 determines the quality of the video (step S31), and sets the quality value of the video to the mobile terminal device 70 that is the report source. Feedback is performed (step S32).

  The mobile terminal device 70 is connected to a video call for a certain time (step S15: No), and the quality value of the video fed back from the monitoring server 60 exceeds a certain time and is below a certain value (step S33: Yes), the video call is stopped, the voice transmission is switched to the voice call by calling the number (telephone number of the monitoring center phone) preset by the signal transmission unit 70c (step S34), and the process is terminated. The mobile terminal device 70 connects the video call and the voice call at the same time when the quality value of the video fed back from the monitoring server 60 exceeds a certain time and is below the certain value (step S33: No). Also good.

  Note that the mobile terminal device 70 is connected to the video call for a certain time (step S15: No), and the quality value of the video fed back from the monitoring server 60 is not less than a certain value over a certain time (step). (S33: No), it progresses to step S18.

  As described above, according to the present embodiment, the video quality on the monitoring center side in the video call can be kept constant.

(Third embodiment)
Next, a third embodiment will be described. In addition, the same part as 1st Embodiment mentioned above or 2nd Embodiment is shown with the same code | symbol, and description is also abbreviate | omitted.

  This embodiment is based on the assumption that a security guard of a security company has a plurality of mobile terminal devices 70. The monitoring server 60 of the present embodiment has the fastest data communication speed of video call (data communication) when a plurality of portable terminal devices 70 perform video call (data communication) to the monitoring center substantially simultaneously. A video call is started on the mobile terminal device 70.

  Here, FIG. 8 is a block diagram illustrating a functional configuration of the security terminal 53, the monitoring server 60, and the mobile terminal device 70 according to the third embodiment. As shown in FIG. 8, the monitoring server 60 includes a terminal device selection unit 60h. The function of the terminal device selection unit 60h is realized when the control unit 101 of the monitoring server 60 executes a program stored in the auxiliary storage unit 103.

  The terminal device selection unit 60h functions as a terminal device selection unit. When the emergency call receiving unit 60e receives the video call (data communication) from the plurality of portable terminal devices 70 substantially simultaneously, the terminal device selection unit 60h has the fastest data communication speed of the video call (data communication). The terminal device 70 is selected, and the emergency call receiving unit 60e starts a video call.

  As described above, according to the present embodiment, when there are a plurality of mobile terminal devices 70 possessed by the guard, when each mobile terminal device 70 performs data communication with the monitoring center at the same time, the data communication speed is the fastest. The mobile terminal device 70 can execute video transmission.

(Fourth embodiment)
Next, a fourth embodiment will be described. The same parts as those in the first to third embodiments described above are denoted by the same reference numerals, and description thereof is also omitted.

  In the present embodiment, it is assumed that the incoming call operation of the mobile terminal device 70 cannot be performed in response to the bandit when the video call is interrupted in the “emergency call ON state”. When the video call is interrupted when the emergency call is ON, the mobile terminal device 70 according to the present embodiment monitors in response to a video call start signal transmitted from the monitoring server 60 of the monitoring center or a telephone call. It automatically connects to the server 60 and resumes the video call.

  Here, FIG. 9 is a block diagram illustrating a functional configuration of the security terminal 53, the monitoring server 60, and the mobile terminal device 70 according to the fourth embodiment. As shown in FIG. 9, the monitoring server 60 includes a video call resuming unit 60i. The function of the video call resuming unit 60i is realized when the control unit 101 of the monitoring server 60 executes a program stored in the auxiliary storage unit 103.

  When the video call is interrupted in the “emergency call ON state”, the video call resuming unit 60i transmits a video call start signal or makes a call from the telephone of the monitoring center. That is, the video call resuming unit 60i also functions as a communication maintaining unit.

  When the video call is interrupted when the emergency call is in the “emergency call ON state”, the emergency call transmission unit 70e of the mobile terminal device 70 responds to the video call start signal transmitted from the monitoring server 60 of the monitoring center or the call origination. It automatically connects to the monitoring server 60 and resumes the video call.

  As described above, according to the present embodiment, even when the call is interrupted in the “emergency call ON state”, even when the incoming operation cannot be performed due to the response to the bandit, the video call starts from the monitoring center, Or it can be automatically connected to an outgoing call.

(Fifth embodiment)
Next, a fifth embodiment will be described. The same parts as those in the first to fourth embodiments described above are denoted by the same reference numerals, and description thereof is omitted.

  There is a case where the mobile terminal device 70 is taken away by the bandit and the emergency call by the video call is cut off, or the bandit threatens to cut it off. In the present embodiment, when the portable terminal device 70 is taken by a bandit, the “emergency notification ON state” is not canceled. The mobile terminal device 70 according to the present embodiment prevents the bandits from disconnecting the video call. More specifically, the mobile terminal device 70 of the present embodiment operates so as not to let the other party know that a video call is being performed.

  Here, FIG. 10 is a block diagram illustrating a functional configuration of the security terminal 53, the monitoring server 60, and the mobile terminal device 70 according to the fifth embodiment. As illustrated in FIG. 10, the mobile terminal device 70 includes a state maintaining unit 70j. The function of the state maintaining unit 70j is realized when the control unit 201 of the mobile terminal device 70 executes a program stored in the auxiliary storage unit 203.

  The state maintaining unit 70j functions as a state maintaining unit. Assuming that the mobile terminal device 70 has been taken away by a bandit, the state maintaining unit 70j controls the screen display control unit 70b as a disguise operation for changing the “emergency notification ON state” to the “emergency notification OFF state”. Require password input for. When there is a specific password input, the state maintaining unit 70j sets the “call end state” on the screen of the mobile terminal device 70, but continues the video call in the background.

  Next, another embodiment of the state maintaining unit 70j will be described. The mobile terminal device 70 of this example includes an “end button” for panic operation.

  Assuming the case where the mobile terminal device 70 is taken away by a bandit, the state maintaining unit 70j requests the operation of the “end button” as a disguise operation for changing the “emergency notification ON state” to the “emergency notification OFF state”. When the “end button” is operated, the state maintaining unit 70j sets the “call end state” on the screen of the mobile terminal device 70, but continues the video call in the background.

  Next, the procedure of notification processing performed by the notification system according to the present embodiment will be described. Here, FIG. 11 is a flowchart showing a procedure of notification processing performed in the notification system.

  As shown in FIG. 11, when there is a special operation by a security guard rushing to the site (step S12: Yes), the mobile terminal device 70 sets the “emergency notification ON state” to the monitoring center. The emergency call by the video call including the current position information and the current position information are transmitted to the monitoring server 60, and the noise canceling function is turned off (steps S13 to S14).

  In this state, as shown in FIG. 11, a video call can be connected for a certain period of time (step S15: No), and the quality value of the video fed back from the monitoring server 60 exceeds a certain period of time. If not (step S33: No), the mobile terminal device 70 performs the camouflage operation (panic operation) for changing the “emergency notification ON state” to the “emergency notification OFF state” (step S41: Yes). A panic signal is transmitted to the center monitoring server 60 (step S42), and the process proceeds to step S18. When receiving the panic signal, the monitoring server 60 notifies (displays) that a panic operation has occurred. In addition, when impersonation operation (panic operation) is not performed (step S41: No), the portable terminal device 70 progresses to step S18 as it is.

  When the camouflage operation (panic operation) for changing the “emergency call ON state” to the “emergency call OFF state” is executed, the mobile terminal device 70 is set to the “call end state” on the screen, but the video is displayed to the monitoring center. The emergency call and the current position information by the video call including "" are transmitted to the monitoring server 60 in the background (step S43), and the transmission is not notified.

  Thus, according to the present embodiment, the video call can be continued without being disconnected even when an unexpected situation occurs such as being attacked by a bandit.

  In each of the embodiments, for example, a reporting system using a convenience store as a security destination has been described, but the present invention is not limited to this. The notification system of the present embodiment is also applicable to emergency notification from a crew member to a monitoring center when a taxi, a bus, an airplane, etc. are taken over. Furthermore, the notification system according to the present embodiment is also applicable to an emergency notification from a user to a monitoring center when acting alone in a place with danger such as a mine shaft, a construction site, and mountain climbing.

  The program executed in the security terminal 53, the monitoring server 60, and the mobile terminal device 70 of the present embodiment is a file in an installable format or an executable format, and is a CD-ROM, a flexible disk (FD), a CD- The program is recorded on a computer-readable recording medium such as R and DVD (Digital Versatile Disk).

  In addition, the program executed by the security terminal 53, the monitoring server 60, and the portable terminal device 70 of the present embodiment is stored on a computer connected to a network such as the Internet and is provided by being downloaded via the network. You may comprise. Moreover, you may comprise so that the program run with the security terminal 53 of this Embodiment, the monitoring server 60, and the portable terminal device 70 may be provided or distributed via networks, such as the internet.

53 Security Terminal 54 Surveillance Camera 60a Signal Receiving Unit 60g Quality Judgment Unit 60h Terminal Device Selection Unit 60i Video Call Resumption Unit 70d Image Acquisition Unit 70e Emergency Call Transmission Unit 70f Noise Cancellation Function Unit 70h Position Detection Unit 70j State Maintenance Unit 203 Auxiliary Storage Unit 211 Operation input section

Claims (14)

In a reporting system comprising a mobile terminal device and a server,
An emergency call instruction means provided in the portable terminal device for instructing an emergency call;
When the emergency call is instructed by the emergency call instruction unit, a video acquisition unit that acquires an image including a sound that is an image of a security point;
Video communication means for executing data communication including the video acquired by the video acquisition means between the portable terminal device and the server;
Communication maintaining means for avoiding interruption of the data communication between the portable terminal device and the server by the video communication means for a certain period of time;
A reporting system comprising: The communication maintaining means, when the data communication is interrupted, sends an instruction to start the data communication from the server,
The video communication means executes the data communication between the portable terminal device and the server in response to an instruction to start the data communication from the server.
The notification system according to claim 1. The communication maintaining means includes
A voice call means for performing a voice call from the portable terminal device;
When it becomes impossible to avoid that the data communication is interrupted for a predetermined time or longer by the communication maintaining means, the switching means for stopping the data communication and switching to the voice call;
The notification system according to claim 1, further comprising: A video management device for managing the video of the security guard;
An acquisition means for connecting to the video management device from the server and acquiring the video managed by the video management device when switching to the voice call by the switching means;
The notification system according to claim 3, further comprising: Provided in the server is provided with quality determining means for determining the quality of the video after the start of the data communication from the mobile terminal device by the video communication means and feeding back the quality value of the video to the mobile terminal device. ,
The switching means, when the quality value fed back by the quality determination means exceeds a certain time and below a certain value, stops the data communication and switches to the voice call;
The notification system according to claim 3. Provided in the server is provided with quality determining means for determining the quality of the video after the start of the data communication from the mobile terminal device by the video communication means and feeding back the quality value of the video to the mobile terminal device. ,
The switching means switches to execute the voice call in addition to the data communication when the quality value fed back by the quality determination means exceeds a certain time and is not more than a certain value.
The notification system according to claim 3. When it becomes impossible to avoid that the data communication is interrupted for a predetermined time or longer by the communication maintaining unit, the image storage unit stores the video in the mobile terminal device,
The video communication means executes the data communication including the video stored by the video storage means after restoration.
The notification system according to any one of claims 1 to 6, wherein: Analyzing noise in the sound included in the video, comprising noise canceling means having a noise canceling function for generating a reverse phase sound that cancels the analyzed noise,
The video acquisition means does not cause the noise cancellation function by the noise cancellation means to function for the sound included in the acquired video;
The notification system according to any one of claims 1 to 7, characterized in that: When there is a specific password input, the portable terminal device informs that the data communication by the video communication means is terminated, but includes a state maintaining means for continuing the data communication.
The notification system according to any one of claims 1 to 8, wherein When there is a predetermined operation, the portable terminal device notifies that the data communication by the video communication unit has been completed, but includes a state maintaining unit that continues the data communication.
The notification system according to any one of claims 1 to 8, wherein When there are a plurality of portable terminal devices and each of the portable terminal devices performs the data communication with the server, the data communication is started with the one portable terminal device having the fastest data communication speed. A terminal device selection means for
The notification system according to any one of claims 1 to 10, wherein: When the video communication means cannot execute the data communication between the portable terminal device and the server, the video communication means communicatively connects the portable terminal device to an auxiliary device network-connected to the server, and the auxiliary device Performing the data communication to the server via
The notification system according to any one of claims 1 to 11, characterized in that: A position detecting means for detecting a current position of the mobile terminal device and generating current position information;
The video communication means includes the current position information generated by the position detection means in the data communication and transmits the information to the server.
The notification system according to any one of claims 1 to 12, wherein: When the emergency notification is instructed by the emergency notification instruction means, the mobile terminal device does not notify that the data communication by the video communication means is being executed,
The notification system according to any one of claims 1 to 13, characterized in that:

Images