JP4830904B2 - Network system - Google Patents

Description

  The present invention relates to a system for performing authentication when entering or leaving a room or using a service.

  In a network system in which a plurality of surveillance cameras are installed, when monitoring a specific location (entrance / entrance, equipment, etc.), the surveillance camera that captures the location is identified, and the correspondence between the location and the surveillance camera is assigned to the system. It is necessary to register.

  Here, a system is known in which a button is installed on a monitoring camera and a monitored device, and the monitoring camera is associated with the monitored device by pressing the button of the monitored device after pressing the button of the monitoring camera. (See Patent Document 1).

JP 2005-301850 A

  According to Patent Literature 1, after a new installation or movement of a monitoring camera or device, whether or not the monitored device is within the shooting range of the monitoring camera and the correspondence between the monitored device and the monitoring camera are manually set. There is a problem that must be done through. Accordingly, an object of the present invention is to provide a system that associates a monitoring camera with a monitored device without human intervention.

  In order to solve the above problems, one of the desirable embodiments of the present invention is as follows.

  In a network system in which a device, a camera server that manages a camera that captures the device, and a management server that manages the device and the camera server are connected to each other, the device receives first information for identifying the device. The first notification is transmitted to the management server. When the management server receives the first notification, the management server stores the first information in its own storage device and also includes the second notification including the type of the image pattern. When the device receives the second notification, the device displays the image pattern in the second notification on its own display screen, and the management server searches for the image pattern displayed by the device. When the camera server receives the third notification, the camera server transmits a fourth notification for instructing shooting to the camera. 4, when the image pattern displayed by the device is captured, the captured image is transmitted to the camera server, and the camera server evaluates the captured image to identify the camera, And the 5th notification containing the result of the said evaluation is transmitted to a management server, and the management server will receive 1st information and 2nd information based on the result of evaluation, if the said 5th notification is received. Store in association.

  ADVANTAGE OF THE INVENTION According to this invention, the system which performs matching with a monitoring camera and a to-be-monitored apparatus without a manual intervention can be provided.

  Hereinafter, an embodiment of a network system will be described with reference to the drawings.

  FIG. 1 is a configuration diagram of a network system.

  This system includes a management server 1 connected to a LAN (local area network) 7, an entrance / exit management device 2 installed at the entrance / exit of each living room for performing user authentication and door opening / closing control, an office device 3, a PC 4, a plurality of It consists of a camera server 5 (5-1, 5-2) and a plurality of cameras 6 (6-1, 6-2, 6-3) connected to the camera server 5. Note that the functions of the management server 1 and the camera server 5 may be realized by the same device. Further, the functions of the camera server 5 and the camera 6 may be realized by the same device.

  The management server 1 manages the entrance / exit management device 2, the office equipment 3, and the PC 4, and information (equipment camera correspondence table) indicating the correspondence between each of the equipment 2 to 4 and the camera server 5, and the camera Information (camera server table) indicating correspondence between the server 5 and its IP address is held. Here, the information of the camera server table is set when the camera server is installed.

  FIG. 2 is a hardware configuration diagram of the entrance / exit management device 2.

  The entrance / exit management device 2 includes a CPU 201, a main memory 202, an EPROM 203 for storing a boot program, a peripheral control device 204, an RTC 205 for obtaining the current time, a non-volatile storage device 206 (magnetic disk, FROM, etc.), a LAN I / F 207. A card reader I / F 208 connected to the card reader 214, a biometric authentication I / F 209 connected to a biometric authentication device 215 (fingerprint authentication device, vein authentication device, iris authentication device, etc.), and an electronic connected to the electronic lock 216 It consists of a lock I / F 210, a display screen I / F 211 connected to the display screen 217, and a sensor I / F 212 connected to a sensor 218 (human sensor, door open / close sensor, tilt sensor, etc.). The communication lines such as the internal bus 213 are connected. Each I / F may be connected via USB or serial. In addition, although five (208 to 212) are described as I / F in the figure, the number is not limited to the number, and the number is increased or decreased depending on the number of authentication devices or control target devices.

  After the entry / exit management device 2 is activated, the CPU 201 executes the boot program of the EPROM 203, reads the OS kernel from the storage device 206 into the main memory 202 according to the contents of the boot program, and activates the OS. Thereafter, a program for controlling the entrance / exit management device 2 is read and executed.

  The storage device 206 stores a management client unit 2061 and a camera server table 2062. The management client unit 2061 is a program for communicating with the management server 1 and the camera server 5, controlling the display screen (display device such as a liquid crystal display or LED) 217, and the like.

  The peripheral control device 204 transmits / receives signals to / from the card reader 208, the biometric authentication I / F 209, the electronic lock I / F 210, the display screen I / F 211, and the sensor I / F 212, whereby the card reader 214 and the biometric authentication device 215. The electronic lock 216, the display screen 217, and the sensor 218 are controlled.

  Needless to say, the office device 3, the PC 4, the camera server 5, and the like also include hardware included in a normal computer, such as a CPU, a main memory, a storage device, and a display device. Further, similarly to the entrance / exit management device 2, the management client unit and the camera server table are stored in the storage devices of the office device 3 and the PC 4.

  The camera server 5 stores the camera imaging area table in its own storage device, and performs camera control and image recognition in accordance with instructions from the management server 1, the entrance / exit management device 2, the office device 3, the PC 4, and the like. The camera 6 is connected to the camera server 5 and takes an image according to an instruction from the camera server 5.

  FIG. 3 is a diagram showing a device camera correspondence table held by the management server 1.

  The device camera correspondence table is a table indicating the correspondence between each device and the camera 6 that captures each device, and includes a device ID 301, a device IP 302, a camera server ID 303, a camera number 304, and an evaluation value 305.

  The device ID 301 indicates a number uniquely assigned to a device (entrance / exit management device 2, office device 3, PC 4 or the like). The device IP 302 indicates an IP address assigned to each device. The camera server ID 303 indicates a number uniquely assigned to the camera server 5. The camera number 304 indicates a number uniquely assigned to the camera 6. The same camera number may be assigned to the cameras 6 connected to different camera servers. The evaluation value 305 indicates an index of device visibility when the device is photographed with a camera.

  FIG. 4 is a diagram illustrating a camera server table showing a list of camera servers.

  The camera server table includes a camera server ID 401 and a camera server IP 402. The camera server ID 401 is associated with the camera server ID 303 of the device camera correspondence table. The camera server IP 402 indicates an IP address assigned to each camera.

  FIG. 5 is a diagram showing a camera imaging area table that indicates the correspondence between each device, the camera that captures it, and its area.

  The camera imaging area table includes a device ID 501, a camera number 502, an X coordinate 503, a Y coordinate 504, a width 505, and a height 506. The device ID 501 is associated with the device ID 301 of the device camera correspondence table. The camera number 502 is associated with the camera number 304 in the device camera correspondence table. An X coordinate 503 indicates a start coordinate in the horizontal direction when an image acquired from the camera 6 is trimmed. A Y coordinate 504 indicates the start coordinate in the vertical direction when the image acquired from the camera 6 is trimmed. A width 505 indicates the length in the horizontal direction when an image acquired from the camera 6 is trimmed. A height 506 indicates the length in the vertical direction when an image acquired from the camera 6 is trimmed.

  FIG. 6 is a sequence diagram for associating a device (any one of the entrance / exit management device 2, the office device 3, and the PC 4) with the camera 6 that captures each. The device (CPU) executes the following processing by executing the management client unit stored therein.

  First, the device transmits a connection notification to the management server 1 (step 601). The connection notification is a notification for notifying that the device is newly connected to the network, restarted, setting information such as the device IP has been changed, and the like, and the device ID of the device, the device IP, and the device Includes the type of the image pattern corresponding to. Here, the type of image pattern includes blinking of LEDs at a certain cycle, LED specific colors (red, yellow, green, etc.), barcodes (may be two-dimensional barcodes), characters (may be numbers), etc. The device includes the information in the connection notification to notify the management server 1 which image pattern it can display. The bar code includes the device ID and the device IP, but may further include authentication information for the management server 1 to authenticate the device.

  Upon receiving the connection notification (step 602), the management server 1 registers the device ID and device IP in the connection notification in the device camera correspondence table and transmits a setting display notification to the device (step 603). The setting display notification is a notification for instructing the device to display a specific image pattern, and includes the type of image pattern. Note that, when there are a plurality of image pattern types in the connection notification, the management server 1 selects an image pattern based on a certain standard from among them, and includes the pattern in the setting display notification. For example, the management server 1 holds the priority order of image pattern types in advance. Barcode, 2. 2. characters 3. Specific color of LED It is assumed that the priority order is such that the LED blinks at a certain period. Then, when “character” and “specific LED color” are included in the connection notification, the management server includes “character” in the setting display notification.

  Upon receiving the setting display notification (step 604), the device generates the image pattern indicated in the setting display notification (step 605), and displays the image pattern on the display screen 217 (step 606).

  The management server 1 transmits a setting start notification to the camera server 5-1 (step 607). The setting start notification is a notification for instructing the camera server 5 to search for a specific image pattern in an image obtained from the camera 6 managed by the camera server 5. Includes IP and image pattern type.

  Upon receiving the setting start notification (step 608), the camera server 5-1 transmits a shooting instruction to the cameras 6-1 and 6-2 (step 609). The shooting instruction is a notification for instructing the camera 6 to take an image.

  The cameras 6-1 and 6-2 perform shooting according to the respective shooting instructions (steps 610-1 and 610-2), and transmit the shot images to the camera server 5-1 (step 611). -1, 611-2).

  Next, the camera server 5-1 checks whether there is an image pattern designated by the setting start notification from the images obtained in step 611, and if there is, evaluates the image pattern (step 612). Here, when the type of the image pattern is LED, the evaluation value is the brightness of the light spot, and a search for a light spot that blinks in a predetermined cycle is performed. When the type is a specific color, the evaluation value is the area of the specific color, and the specific color is extracted from the image. When the type is a specific pattern, the evaluation value is the area on the image of the specific pattern, and the specific pattern is extracted from the image (the position of the acquired image pattern on the image, the degree of inclination of the image, etc. are added to the evaluation value) Also good). When the type is barcode, the evaluation value is the size of the barcode on the image, and the barcode is read from the image (the read device ID and device IP are equal to the device ID and device IP included in the setting start notification). The evaluation value may be set to 0 if they are not equal, or the device is authenticated based on the read authentication information. If the authentication fails, the evaluation value may be set to 0).

  Next, the camera server 5 selects the camera 6 (step 613). For example, the camera 6 that captured the image with the highest evaluation value is selected. Then, the setting contents are registered in the camera imaging area table (step 614). The setting contents here are the device ID being notified of the setting start, the camera number selected in step 613, and the values (X coordinate / Y coordinate / width / height) representing the surrounding area including the image pattern.

  Next, the camera server 5-1 transmits a setting end notification to the management server 1 (step 615). The setting end notification is a notification for informing the presence or absence of an image pattern within the range photographed by the camera 6 managed by the camera server 5, and includes a camera server ID, a camera number, an evaluation value, and a device ID. If the evaluation value is 0, it means that the image pattern could not be acquired.

  Next, the management server 1 registers the setting contents in the device camera correspondence table (step 616). The setting contents here are a device ID, a camera server ID, a camera number, and an evaluation value included in the setting end notification.

  Next, the management server 1 transmits a setting completion notification to the device (step 617). The setting completion notification is a notification for notifying that the association between the device and the camera 6 that captures the device is completed, and includes a camera server ID and a camera server IP. The camera server ID is a camera server ID included in the setting end notification, and the camera server IP corresponds to the camera server ID in the camera server table.

  Finally, the device registers the setting contents in the camera server table (step 619). The settings here are the camera server ID and camera server IP included in the setting completion notification.

  Note that the management server 1 may transmit a setting start notification to the plurality of camera servers 5. In this case, setting completion notifications regarding a plurality of camera servers are received. Among all the setting completion notifications, for example, the one with the best evaluation value is registered in the device camera correspondence table. Also, here, the management server 1 is described as transmitting a setting display notification after receiving the connection notification. However, when confirming the installation location of the device, the management server 1 sends the setting display notification at an arbitrary timing. You may transmit with respect to one or more apparatuses. Thereby, an image can be displayed on an arbitrary device at an arbitrary timing. The camera server 5 issues a shooting instruction to the camera 6 only once. However, when the camera 6 is movable, it may be issued multiple times by adding a shooting direction and a zoom size to the shooting instruction. Furthermore, the device IP may be registered in the device camera correspondence table only at step 616. In that case, it is not necessary to perform steps 601 to 604 and 607, and the device IP information can be displayed on the display screen even if there is no specific instruction after starting the device. There is an effect that a device that acquires an image can be registered.

  FIG. 7 is a diagram illustrating a sequence in which the device instructs the camera server to record an image.

  First, the device reads the camera server IP in the camera server table (step 701), and transmits a recording instruction to the camera server 5 corresponding to the IP (step 702). The recording instruction is a notification for instructing recording of an image, and includes a device ID of the device, a photographing time, and a photographing time.

  Upon receiving the recording instruction (step 703), the camera server 5 reads the camera number corresponding to the device ID in the recording instruction from the camera imaging area table (step 704), and transmits an acceptance confirmation to the device (step 705). . Then, the device receives an acceptance confirmation from the camera server 5 (step 706). The acceptance confirmation is a notification for notifying whether or not recording according to the recording instruction is possible. Whether or not recording is possible is determined by whether or not there is a device ID corresponding to the device ID in the recording instruction in the camera imaging area table. Then, the photographing instruction is transmitted to the camera 6 corresponding to the camera number read out in step 704 (step 707). The shooting instruction here includes a shooting time and a shooting time. It may include an instruction on whether to shoot a still image or a moving image.

  Next, the camera 6 shoots according to the shooting instruction (step 708). When the shooting instruction is a past time, the camera 6 obtains from a past image buffered inside. Then, the captured image is transmitted to the camera server 5 (step 709).

  Next, the camera server 5 performs image processing on the captured image received from the camera 6 (step 710). Here, values (X coordinate / Y coordinate / width / height) representing the area around the location on the image corresponding to the device ID in the recording instruction are read from the camera imaging area table, and the image is read using these values. Trim. By storing only the necessary image, the recording capacity of the storage device in the camera server 5 can be reduced.

  Finally, the camera server 5 stores the processed image in the storage device (step 711). The shooting time, the device ID, the camera server ID, and the camera number may be associated and stored.

  FIG. 8 is a flowchart of the entrance / exit management device 2. The entrance / exit management device 2 (its CPU) executes the management client unit stored therein and performs the following processing. 8 to 10, the numbers in FIG. 6 or 7 are used for portions where the processing overlaps with FIG. 6 or 7.

  First, when activated, the entry / exit management device 2 initializes itself (including acquisition of the device IP) (step 801), and transmits a connection notification to the management server 1 (step 601). Next, it is checked whether or not a card is detected (whether or not the user holds the card over the card reader 214) (step 802). If a card is detected, card authentication processing is performed (step 803). That is, information such as an employee number and a company number is read from the card, and it is determined whether or not the owner of the card can pass through the door. This determination is made by holding numbers that may be passed in advance and determining whether there are numbers read from the card among these numbers. When biometric authentication is required by number, biometric authentication device 215 is used to strengthen user authentication.

  Next, an image showing the device ID, device IP, shooting time, user ID, and authentication result is displayed on the display screen (step 803). By this step, the user's image can be acquired by the camera 6, and the evidence that the user has operated correctly (or illegally) when confirming the user's history with the image can be strengthened. Further, if the authentication result and the photographing time are recorded in the storage device 206, they can be confirmed later.

  Next, when there is a camera server ID registered in step 617, a recording instruction is transmitted to the camera server 5 corresponding to the ID (step 804).

  Next, it is checked whether or not an acceptance confirmation has been received (step 706). Unless the receipt confirmation is received, it does not proceed to the next step.

  Next, device control is performed (step 806). For example, when the authentication is successful, the electronic lock 216 is unlocked. When the sensor 218 confirms the open state of the door, the electronic lock 216 is locked. When the door open state cannot be confirmed, the electronic lock 216 is locked after a predetermined time.

  Next, it is checked whether or not a setting display notification has been received (step 604). If no setting display notification has been received, the process returns to step 801. If it has been received, an image pattern corresponding to the type in the setting display notification is generated (step 605) and displayed (step 606).

  Next, it is checked whether or not a setting completion notification has been received (step 618). If not received, the process returns to step 606. If received, the setting contents are registered in the camera server table (step 619).

  The entrance / exit management device 2 may transmit a shooting instruction to the plurality of camera servers 5. Further, although the device is controlled after issuing the shooting instruction, the order may be changed, or the shooting instruction may be output during the device control. Further, although the photographing instruction is issued after the card authentication, the photographing instruction may be issued when the sensor is reacted, for example, even when the card authentication is not performed. As a result, it is possible to shoot even when authentication is not normally performed.

  Although the entrance / exit management apparatus 2 has been described with reference to FIG. 8, there is no processing in steps 802 to 804 in the case of the office device 3 or the PC 4. In step 805, the control of the entrance / exit management device 2 has been described. However, the contents are different in the case of the office device 3 or the PC 4.

  FIG. 9 is a flowchart when the management server 1 registers a device.

  First, the management server 1 checks whether or not a connection notification has been received (step 602). Unless it is received, it does not proceed to the next step. When the connection notification is received, it is checked whether or not there is a device ID in the connection notification in the device camera correspondence table (step 901). When there is no device ID, the type of the image pattern included in the connection notification is acquired, and a setting display notification is transmitted to the device (step 603). If there is a device ID, it is assumed that the device is already associated with the camera, and the process ends. When the management server 1 transmits a setting display notification at an arbitrary timing, the determination in step 901 is not performed.

  Next, it is determined whether there is a camera server IP in the camera server table (step 902). If the IP is present, a setting start notification is transmitted to the camera server 5 corresponding to the IP (step 607). At this time, the management server 1 increments the setting start notification transmission number. After the processing for each camera server IP, it is determined whether or not a setting completion notification has not been received, that is, whether or not the number of setting start notification transmissions is zero (step 903).

  If all setting completion notifications have not been received, it is checked whether a setting completion notification has been received (step 904). Unless the setting completion notification is received, the process does not proceed to the next step. When the setting completion notification is received, the setting start communication count is decremented, and the evaluation value corresponding to the device ID in the activation notification is read from the camera device correspondence table (step 905). Then, it is checked whether or not the evaluation value of the setting completion notification is higher than the evaluation value (step 906). If the evaluation value is not higher, the process returns to step 903. If the evaluation value is higher, the evaluation value and the setting content are updated (step 616). Here, the column corresponding to the device ID in the connection notification in the device camera correspondence table is updated to the camera server ID, camera number, and evaluation value included in the setting completion notification, respectively.

  If all setting completion notifications are received in step 903, the setting completion notification is transmitted to the device that is the source of the connection notification (step 617), and the process is terminated.

  FIG. 10 is a flowchart of the camera server 5.

  First, the camera server 5 checks whether a recording instruction has been received (step 703). If not received, the process proceeds to step 608. If received, it is checked whether or not the camera number corresponding to the device ID in the recording instruction is in the camera imaging area table (step 1001). If there is no camera number, an acceptance failure notification is transmitted to the device (step 1002). If there is a camera number, an acceptance confirmation is transmitted to the device (step 705), a shooting instruction is transmitted to the camera 6 corresponding to the camera number (step 707), image processing is performed (step 710), and the image is stored. Save to the device (step 711).

  Note that the reception disapproval notification is a notification for notifying that the camera server 5 cannot photograph the device corresponding to the device ID.

  After step 711 or step 1002, it is checked whether a setting start notification has been received (step 608). If the setting start notification has not been received, the process ends.

  When the setting start notification is received, it is determined whether there is a camera number in the camera imaging area table (step 1004). If there is no camera number, a setting end notification is transmitted to the management server 1 (step 615), and the processing is ended.

  If there is a camera number, a shooting instruction is transmitted to the camera 6 corresponding to the number (step 609), and the image pattern is evaluated (step 612).

  Next, the evaluation value of the held image pattern is read (step 1005). The held evaluation value is cleared when a setting start notification is received. Next, it is checked whether or not the evaluation value obtained in step 609 is higher than the evaluation value obtained in step 1005 (step 1006). If the evaluation value is high, the evaluation value and the coordinates on the image of the image pattern obtained in step 609 are updated (step 614). If the evaluation value is not high, the process returns to step 1004. Then, a setting completion notification including the updated evaluation value and the coordinates of the image pattern on the image is transmitted to the management server 1 (step 615).

  If there are a plurality of camera numbers in step 1004, the processes of steps 609, 612, 1005, 1006, and 614 are performed for each camera number.

  Although the example applied to the office in a building was demonstrated in the above Example, it is not limited to this, These can also be installed in a condominium and other facilities.

  The programs and data described in this embodiment may be stored in advance in a storage device, may be input from a storage medium such as a CD-ROM, or may be downloaded from another device via a network. Good. The functions realized by the program may be realized by dedicated hardware.

The block diagram of a security system. The hardware block diagram of an entrance / exit management apparatus. The figure which shows an apparatus camera corresponding | compatible table. The figure which shows a camera table. The figure which shows a camera imaging area table. FIG. 6 is a sequence diagram for associating a device with a camera. FIG. 6 is a sequence diagram in which a device instructs the camera server to record an image. The flowchart of an entrance / exit management apparatus. The flowchart at the time of apparatus registration of a management server. The flowchart of a camera server.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Management server, 2 ... Entrance / exit management apparatus, 3 ... Office equipment, 4 ... PC, 5 ... Camera server, 6 ... Camera

Claims (9)

In a network system in which a device, a camera server that manages a camera that captures the device, and a management server that manages the device and the camera server are respectively connected.
The device transmits a first notification including first information for specifying the device to the management server,
When the management server receives the first notification, the management server stores the first information in its own storage device and transmits a second notification including the type of the image pattern to the device.
When the device receives the second notification, the device displays the image pattern in the second notification on its own display screen,
The management server sends a third notification to the camera server to instruct a search for an image pattern displayed by the device;
Upon receiving the third notification, the camera server transmits a fourth notification for instructing shooting to the camera,
When the camera captures the image pattern displayed by the device in response to the fourth notification, the camera transmits the captured image to the camera server,
The camera server evaluates the captured image, transmits second information for specifying the camera, and a fifth notification including a result of the evaluation to the management server,
When the management server receives the fifth notification, the management server stores the first information and the second information in association with each other based on the result of the evaluation.   The network system according to claim 1, wherein the management server transmits a sixth notification indicating that the association between the first information and the second information is completed to the device. The device is an entrance / exit management device,
The entrance / exit management device, when performing user authentication, transmits a seventh notification for instructing recording of a captured image of the user to the camera server,
In response to the seventh notification, the camera server transmits an eighth notification for instructing the camera to shoot, to the camera,
When the camera captures the user in response to the eighth notification, the camera transmits the captured image to the camera server,
The network system according to claim 1, wherein the camera server stores the captured image in a storage device included in the camera server.   The camera server stores a location on the image when the camera captures the image pattern, and when the seventh notification is received, an area around the location on the image when the image pattern is captured The network system according to claim 3, wherein a value representing is stored. The second notification includes authentication information;
The device displays the authentication information on its own display screen,
The camera captures the authentication information displayed on the display screen,
The network system according to claim 1, wherein the camera server evaluates the captured image based on the authentication information.   The network system according to claim 1, wherein the management server instructs a plurality of devices managed by the management server to display an image pattern, and each device displays an image pattern.   The network system according to claim 3, wherein the entry / exit management device includes a sensor, and transmits the seventh notification to the camera server when the sensor detects the sensor. A first camera server and a second camera server;
The management server receives a fifth notification from each of the first and second camera servers, and stores a camera server to be stored in its own storage device based on a comparison of evaluation results included in each of the first and second camera servers. The network system according to claim 1, wherein the network system is determined. A first camera and a second camera;
The camera server receives the captured image from each of the first and second cameras, evaluates an image pattern of the captured image included in each, and based on the result of the evaluation, the second The network system according to claim 1, wherein the information is determined.

Images