JP6399172B2 - Management server and control method and program thereof - Google Patents

Description

  The present invention relates to a surveillance system using a plurality of surveillance cameras, and a control method and program technology thereof.

  In recent years, there is one that manages video captured by a monitoring camera on the management server side and distributes the video to a terminal application. With such a mechanism, it is possible to view the video of the surveillance camera from a mobile phone application.

  When the installer installs a surveillance camera for the first time in a store or the like, the terminal directly brought in for adjustment and the surveillance camera in front of it communicates directly, monitoring while watching the video of the surveillance camera in front The operation | work which adjusts the direction and angle of a camera using the terminal brought for work generate | occur | produces.

  At that time, in order to operate the monitoring camera in front of the eyes, it is necessary to first query the management server from the terminal and obtain the IP address of the monitoring camera in front of the eyes. When managing cameras, it is necessary to check the IP addresses of all of the many surveillance cameras in advance, so it is time and effort to select which surveillance camera is the surveillance camera installed in front of you. It takes time to do.

  Patent Document 1 discloses a technique for directly communicating between a wireless communication terminal and a monitoring camera in front using the base address information, but the network address information of each base is managed on the image distribution server side. There is a case where maintenance of base address information on the image distribution server side becomes complicated.

JP 2013-051678 A

  The present invention provides a mechanism that allows a mobile terminal that is in front of a surveillance camera but not yet connected to the surveillance camera to easily communicate with the surveillance camera in front of the eyes. For the purpose.

The present invention is a management server that is communicably connected to a mobile terminal and manages a plurality of monitoring cameras , the terminal identifying the mobile terminal transmitted from one monitoring camera of the plurality of monitoring cameras it includes a receiving unit that will receive information including the identification information, the identification information acquiring means for acquiring the terminal identification information by the information which the receiving means comprises said terminal identification information received, the terminal identification information Connection information transmitting means for transmitting information for communication connection with the monitoring camera that has transmitted the information to the mobile terminal that has acquired the terminal identification information .

Further, the identification information storage means for storing the terminal identification information, the authentication means for authenticating the acquired terminal identification information and the stored identification information, and the connection information transmission means are stored by the authentication means. The mobile terminal having the authenticated terminal identification information is transmitted with information for communication connection with the monitoring camera that has transmitted the information including the terminal identification information.

Further, the identification information storage means further stores the date and time when the management server received the terminal identification information in association with the terminal identification information received by the management server, and includes the terminal identification information Based on the date and time received by the management server and the acquired date and time, the validity period of the terminal identification information associated with the date and time received by the management server is determined. An effective period determination unit, and when the stored terminal identification information is determined not to be an effective period by the effective period determination unit, the connection information transmission unit is configured to store the storage information by the authentication unit. The mobile terminal whose terminal identification information is authenticated is not transmitted information for communication connection with the monitoring camera that has transmitted the information including the terminal identification information. It is characterized in.

  According to the present invention, there is provided a mechanism that allows a mobile terminal that is in front of a surveillance camera but not yet connected to the surveillance camera to easily communicate with the surveillance camera in front of the eyes. It becomes possible

It is a figure which shows the system configuration | structure of the whole monitoring system of this invention. It is a figure which shows the hardware constitutions of the mobile terminal of this invention, a management server, and an image delivery server. It is a figure which shows an example of the flowchart in the monitoring system of this invention. It is a figure which shows an example of the screen which the mobile terminal of this invention displays. It is a figure which shows an example of the camera connection information table of the database of this invention. It is a figure which shows an example of the identification code management table of the database of this invention. It is a figure which shows the flow of a process of the whole monitoring system of this invention.

Referring to FIG.
FIG. 1 is a system configuration diagram showing an example of the configuration of the monitoring system of the present invention.

  Reference numeral 100 denotes a management server, which is communicably connected to the mobile terminal 200, and can distribute video captured by a large number of monitoring cameras 201 and 206 to the mobile terminal 200 via the image distribution server 101. Furthermore, the video distributed by the monitoring camera 201 and transmitted to the image distribution server 101 can be stored in the image distribution server 101.

  Furthermore, the management server 100 is communicably connected to a plurality of monitoring cameras, a wireless LAN access point 202, and a mobile phone network base station 203 via a communication line (Internet line).

  The image distribution server 101 manages and distributes images taken by a plurality of monitoring cameras, and a plurality of monitoring cameras, a wireless LAN access point 202, and a base station of a mobile phone network via a communication line (Internet line). 203 is communicably connected.

  Reference numeral 200 denotes a mobile terminal, which can access an image distribution service provided by the image distribution server 101 via an application installed on the mobile terminal 200. As a communication method for accessing the image distribution service of the image distribution server 101 from the mobile terminal 200, a method using a 3G line for communication via the base station 203 of the mobile phone network, or a communication via the wireless LAN access point 202 is used. There is a method using Wi-Fi. The mobile terminal 200 may be, for example, a smartphone, a tablet terminal, or a mobile phone, and is a terminal capable of wireless communication with the wireless LAN access point 202.

Reference numerals 201 and 206 denote surveillance cameras, which are pan / tilt cameras that capture images at the installation location. The surveillance camera is also communicably connected to the image distribution server 101 via a communication line (Internet line). The surveillance camera is also called a network camera.
Reference numeral 202 denotes a wireless LAN access point. Wireless communication is performed with the mobile terminal 200 by Wi-Fi.

Reference numeral 203 denotes a mobile phone base station. The mobile terminal 200 communicates with a 3G line. Further, the mobile terminal 200 can perform Internet communication (3G line) via the mobile phone base station 203.
A relay device 204 is a router that relays network communication between the mobile terminal 200 and the monitoring camera A 206 and the management server 100.
Reference numeral 205 denotes a relay device, which is a router that relays network communication between the monitoring camera B 201 and the management server 100.
FIG. 2 will be described.
FIG. 2 is a diagram illustrating a hardware configuration of the management server 100, the image distribution server 101, and the mobile terminal 200.
In FIG. 2, 401 is a CPU that comprehensively controls each device and controller connected to the system bus 404.

  In the ROM 403 or the external memory 411, a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as OS), which is a control program of the CPU 401, or a function to be executed by each server or each PC is described later. Various programs to be stored are stored.

Reference numeral 402 denotes a RAM that functions as a main memory, work area, and the like for the CPU 401. The CPU 401 implements various operations by loading a program or the like necessary for execution of processing from the ROM 403 or the external memory 411 to the RAM 402, and reading and executing the loaded program.
Reference numeral 405 denotes an input controller that controls input from a keyboard (KB) 409 or a pointing device such as a mouse (not shown).

  A video controller 406 controls display on the display unit 410. Note that the display unit 410 is not limited to a CRT, but may be another display such as a liquid crystal display. These are used by the administrator as needed. Further, the display unit may include a touch panel function in which the user specifies a target position in the display screen with a finger, a pen, or the like.

  Reference numeral 407 denotes a memory controller, which is connected via an adapter to a hard disk (HD), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 411 such as a compact flash (registered trademark) memory.

  Reference numeral 408 denotes a communication I / F controller that is connected to and communicates with an external device via a network (communication line), and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 401 enables display on the CRT, for example, by executing outline font rasterization processing on a display information area in the RAM 402. In addition, the CPU 401 enables a user instruction with a mouse cursor (not shown) on the CRT.

Various programs to be described later for realizing the present invention are recorded in the external memory 411 and executed by the CPU 401 by being loaded into the RAM 403 as necessary. Further, a data file and a data table used when executing the program are also stored in the external memory 411, and detailed description thereof will be described later.
FIG. 3 will be described.
In step S <b> 101, the “camera image display / setting application” of the present invention is activated on the mobile terminal 200 in accordance with a user instruction.
Thereafter, a QR code (registered trademark) is generated from the identification ID for identifying the mobile terminal 200 in accordance with a user generation instruction in the “camera image display / setting application”.

That is, the mobile terminal 200 generates a QR code as display information including identification information (for example, terminal identification ID: 123435) in accordance with a QR code generation instruction by a user operation (QR code generation means).
In step S102, an identification ID is transmitted to the management server 100 as information for associating the mobile terminal 200 with the monitoring camera A206.

That is, the mobile terminal 200 uses identification information (for example, terminal identification ID: 123435) for identifying its own terminal that wants to establish a communication connection with the monitoring camera in front of the user using a communication line such as an Internet line or a portable radio wave. It transmits to the management server 100 (identification information transmission means).
In step S103, the management server 100 receives the identification ID.

  In step S104, the management server 100 assigns a management ID to the identification ID management table and stores the identification ID and the authentication start time in order to limit the time for performing the authentication of the QR code and the identification ID.

  In step S105, the mobile terminal 200 displays the QR code generated in S101 on the display screen of the mobile terminal 200 as shown in FIG. 4 according to the QR code display instruction by the user's operation.

  That is, the mobile terminal 200 displays the display information 501 including identification information (for example, terminal identification ID: 123435) in the QR code on the screen of the mobile terminal (display unit).

  The display information 501 is not limited to a QR code, and may be information such as a barcode. The display information 501 is converted into image information including identification information so that the monitoring information is not directly captured by the monitoring camera. Anything is acceptable. Furthermore, when the image information converted into a QR code or a barcode is analyzed on the management server 100 side when the image taken by the monitoring camera is analyzed, the identification information is displayed rather than analyzing the identification information displayed as characters. This also has the effect of improving the reading accuracy.

After that, the user displays the QR code as shown in FIG. 4 on the display screen, and directs the QR code displayed on the screen toward the photographing lens of the monitoring camera A206 in front of the user. The QR code is photographed by the monitoring camera A206 in FIG. At this time, it is preferable that the user approaches the close distance (for example, within 1 m) of the monitoring camera A206 and faces the screen of the mobile terminal so that the monitoring camera A206 can easily capture the QR code.
In step S <b> 106, the monitoring camera A 206 captures the QR code displayed on the screen of the mobile terminal 200.

In step S <b> 107, the monitoring camera B 201 always transmits video to the management server 100. Also, in other monitoring cameras other than the monitoring camera A 206 and the monitoring camera B 201, the captured video is constantly transmitted to the management server 100.
In step S <b> 108, the management server 100 always receives all the images taken by the monitoring camera from each monitoring camera.

That is, as shown in FIG. 7, the management server 100 receives an image including display information (QR code) captured by the monitoring camera A 206 via the image distribution server 101 (captured image receiving means). .
In step S109, the management server 100 analyzes the received video. Here, the management server 100 analyzes the images of all the monitoring cameras.
In step S110, the management server 100 determines whether a QR code is detected in the received video as a result of analyzing the video received in S109.

  If a QR code is detected on the management server 100 side, the process proceeds to step S114. If no QR code is detected, the process returns to step S108.

  Further, the management server 100 also acquires the date and time when the management server 100 received the image including the captured display information (QR code) (date acquisition means).

  In step S114, the management server 100 refers to the identification ID management table and acquires the authentication start time corresponding to the identification ID. Thereafter, the authentication start time (the date and time when the identification information is transmitted to the management server 100) and the current time (the date and time when the identification information is acquired from the QR code) are compared, and it is determined whether the authentication allowable time has elapsed.

  If the management server 100 determines that the allowable authentication time has elapsed, the process proceeds to step S115. If the authentication allowable time has not elapsed, the process proceeds to step S111.

  That is, the management server 100 determines the validity period of the identification information associated with the transmitted date and time based on the transmitted date and time (authentication start time) stored in the identification information management table and the date and time acquired in S110. (Effective period determination means).

  For example, if the validity period is set to 1 hour in advance, the time difference between the transmitted date and time (authentication start time) stored in the identification information management table and the date and time acquired in S110 should be within 1 hour. For example, it is determined that the identification information to be authenticated is within the valid period.

  When the date and time acquired in S110 exceeds the valid period, the identification information to be authenticated on the management server 100 side is invalidated to prevent the identification information to be authenticated from being used indefinitely in consideration of security. doing. In other words, in this case, in order to acquire the connection information of the monitoring camera, the mobile terminal 200 needs to return to S102 and retransmit the identification information to be authenticated to the management server.

  After that, when authenticating in S111, the identification information included in the display information in the received image and the stored identification information are authenticated within the effective period according to the result of the effective period determined here. Will be.

  In step S115, since it is determined that the authentication allowable time has been exceeded on the management server 100 side, an error indicating that connection information cannot be transmitted is returned to the mobile terminal 200.

  That is, as a result, the management server 100 notifies the mobile terminal whose identification information stored in S111 is authenticated that information for communication connection with the monitoring camera that has received the image is not transmitted (notification unit).

  As described above, when the allowable authentication time has passed, the process proceeds to step S115. When it is determined that the stored identification information is not the valid period, the identification information stored in S111 is eventually obtained. Even if the mobile terminal is authenticated, the connection information transmitting means performs control so as not to transmit information for communication connection with the monitoring camera that has received the image.

In step S111, the management server 100 analyzes the QR code detected in S110 included in the image received in S108 (QR code analyzing means) and stores it as identification information indicated by the analyzed QR code. It is determined whether the identification IDs match.
In this manner, identification information for authentication in S111 is acquired from the QR code analyzed on the management server 100 side (identification information acquisition means).
If it is determined that the management server 100 matches, the process proceeds to step S112. If they do not match, the process returns to step S108.

  That is, the management server 100 identifies the identification information (for example, terminal identification ID: 123435) included in the display information (QR code) in the image received in S108 and the identification information (for example, terminal) stored in the identification information management table. Identification ID: 123435, etc.) (authentication means).

  In step S112, the management server 100 refers to the camera connection information table, selects one connection information (IP address or port number) associated with the camera ID that is the monitoring camera that has detected the QR code, and selects the mobile terminal 200. Send to.

  That is, the management server 100 transmits information for communication connection with the monitoring camera A206 that has received the image in S108 to the mobile terminal whose identification information stored in S111 is authenticated (connection information transmitting means).

In step S116, the mobile terminal 200 receives the connection information of the monitoring camera A206, and in step S117, uses the received IP address / port number to make a connection request to the monitoring camera A206 camera in front of the user.
In step S118, the mobile terminal 200 determines whether the communication connection between the mobile terminal 200 and the monitoring camera A 206 has been successful.
If it is determined that the connection is successful, the process proceeds to step S119. If it is determined that the connection has failed, the process proceeds to step S129.
In step S119, the monitoring camera A206 receives the connection request transmitted from the mobile terminal 200.
In step S <b> 120, monitoring camera A <b> 206 transmits login screen information to mobile terminal 200.
In step S121, a login screen is displayed on the mobile terminal 200 side.
In step S122, the mobile terminal 200 transmits the user ID and password received from the management server 100 in step S116 to the monitoring camera A206.

In step S123, automatic login authentication processing is performed using the user ID and password received by the monitoring camera A206. In step S124, it is determined whether login authentication is successful.
If the login authentication is successful, the process proceeds to step S125. If the login authentication fails, the process proceeds to step S126.
In step S <b> 125, the monitoring camera A 206 transmits administrator screen information to the mobile terminal 200.
In step S <b> 126, the monitoring camera A 206 returns login error information to the mobile terminal 200.
In step S127, the mobile terminal 200 displays an administrator screen.
In step S128, the user performs camera operation (video display / setting) on the administrator screen displayed on the mobile terminal 200.
In step S129, the mobile terminal 200 displays an error login screen.
FIG. 5 will be described.

The management server stores the connection information transmitted to the mobile terminal 200 in S112 in association with the monitoring camera ID in the camera connection information table (connection information storage unit).
A camera ID 5001 is a surveillance camera ID, and is information for identifying one surveillance camera from among a large number of surveillance cameras.
The IP address 5002 is information for specifying an address on the network of one surveillance camera.
A port number 5003 is a number for specifying a program of a monitoring camera that is a communication destination when one monitoring camera and the mobile terminal 200 perform data communication.

  A user name 5003 is login information used when automatically logging in to a monitoring camera as a communication destination from the mobile terminal 200 side when one monitoring camera and the mobile terminal 200 perform data communication.

The password 5004 is login information used when automatically logging in to the monitoring camera that is the communication destination from the mobile terminal 200 side when one monitoring camera and the mobile terminal 200 perform data communication.
FIG. 6 will be described.

The management server stores the identification information transmitted from the mobile terminal 200 in S102 in association with the monitoring camera ID in the identification information management table (identification information storage unit).
A management ID 6001 is a surveillance camera ID, and is information for identifying one surveillance camera from among a large number of surveillance cameras.
An identification ID 6002 is a mobile terminal ID, and is information for identifying one mobile terminal from among a large number of mobile terminals.
The authentication start time 6003 is date / time or time information, and is information used as the start date / time of an effective period in which the identification ID can be authenticated.

  The authentication start time is the date and time when the identification ID is transmitted to the management server, and the date and time when the identification ID is transmitted to the management server corresponds to the identification ID transmitted from the mobile terminal in S102 in the identification information management table. It is remembered.

The program according to the present invention is a program that can be executed by the computer in the processing method of the flowchart shown in FIG. 3, and the storage medium according to the present invention is stored in an external memory as a program that can be executed by the computer. .

As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by executing reading.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk or the like can be used.

Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

The present invention may be applied to a system constituted by a plurality of devices or an apparatus constituted by one device. It goes without saying that the present invention can also be applied to a case where the invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention.
In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

100 management server 101 image distribution server 200 mobile terminal (smart phone)
201 surveillance camera 202 wireless LAN access point 206 surveillance camera

Claims (5)

A management server that is communicably connected to a mobile terminal and manages a plurality of surveillance cameras ,
Transmitted from one surveillance camera of the plurality of monitoring cameras, a receiving unit that will receive information including terminal identification information identifying the mobile terminal,
Identification information acquisition means for acquiring terminal identification information from information including the terminal identification information received by the reception means;
Connection information transmitting means for transmitting information for communication connection with the monitoring camera that transmitted the information including the terminal identification information to the mobile terminal that has acquired the terminal identification information ;
A management server comprising: Identification information storage means for storing the terminal identification information;
Authentication means for authenticating the acquired terminal identification information and the stored identification information ;
The connection information transmitting means transmits information for communication connection with the monitoring camera that has transmitted the information including the terminal identification information, to the mobile terminal for which the stored terminal identification information is authenticated by the authentication means. The management server according to claim 1. The identification information storage means further stores the date and time when the management server received the terminal identification information in association with the terminal identification information received by the management server,
Date and time acquisition means for acquiring the date and time when the information including the terminal identification information is received;
Effective period determination means for determining an effective period of terminal identification information associated with the date and time received by the management server based on the date and time received by the management server and the acquired date and time;
Further comprising
When the stored terminal identification information is determined not to be a valid period by the valid period determining means, the connection information transmitting means has authenticated the stored terminal identification information by the authenticating means. The management server according to claim 2, wherein information for communication connection with the monitoring camera that has transmitted the information including the terminal identification information is not transmitted to the mobile terminal. A control method of a management server connected to a mobile terminal so as to be communicable and managing a plurality of surveillance cameras,
A receiving step in which the receiving means of the management server receives information including terminal identification information for identifying the mobile terminal transmitted from one of the plurality of monitoring cameras;
An identification information acquisition step in which the identification information acquisition means of the management server acquires the terminal identification information from the information including the terminal identification information received in the reception step;
A connection information transmitting step in which the connection information transmitting means of the management server transmits information for communication connection with the monitoring camera that has transmitted the information including the terminal identification information, to the mobile terminal that has acquired the terminal identification information;
The control method characterized by including. A program that is communicably connected to a mobile terminal and can be read and executed by a management server that manages a plurality of surveillance cameras,
The management server
Receiving means for receiving information including terminal identification information for identifying the mobile terminal transmitted from one of the plurality of monitoring cameras;
Identification information acquisition means for acquiring terminal identification information from information including the terminal identification information received by the reception means;
Connection information transmitting means for transmitting information for communication connection with the monitoring camera that transmitted the information including the terminal identification information to the mobile terminal that has acquired the terminal identification information;
A program characterized by functioning as

Images