JP4314369B2 - Monitoring system, monitoring control method, monitoring control program, and network system - Google Patents

Description

The present invention relates to a monitoring system for monitoring an image of a subject in a monitoring area. More specifically, the mutual monitoring system that a human community has so far has been strengthened according to modern society by using computer technology. The present invention relates to a monitoring system, a monitoring control method , a monitoring control program , and a network system that can be reproduced in a form.

In the old community, each individual sees the person who came in from the outside, and the information is stored as a memory of each individual. If there is a serious incident, each person's memory is stored in the community. The mechanism of providing crime prevention within the community has been widely functioning.
On the other hand, what is described in patent document 1 and patent document 2 is proposed as a crime prevention monitoring system using a communication network and a remote monitoring system using a surveillance camera.

In addition to the above system, many security surveillance camera systems already exist, for example, as shown below.
That is, as a first normal security camera system, there is one that records an image captured by a surveillance camera on a video tape. In addition, as a monitoring system using a network camera provided by a second private company, there is a system that transfers and stores the image to a server in the company when the monitoring image moves.

Furthermore, as a monitoring system using a third PC (personal computer) camera, when an image captured by a camera or the like moves, the image is transferred to a mobile phone or the like. In addition, like the fourth US (US) home guard system, network cameras are installed in important facilities that are likely to be targeted by more than 50,000 terrorists nationwide, and their images are constantly recruited from three or more US citizens. It is also known that registrants monitor with home PCs and notify authorities when a change is observed.
JP 2002-165511 JP2003-50628A

However, the crime prevention monitoring systems described in Patent Document 1 and Patent Document 2 and the first to third monitoring systems monitor images captured by the monitoring cameras individually and separately by each household. There was an inconvenience that the area was limited.
In addition, since it is cumbersome to continuously monitor images captured by the surveillance camera on the 365th, pay a fee (several thousand yen to 10,000 yen per month) for monitoring services, or Individuals needed to maintain the surveillance system fairly often.

  In addition, as described above, the fourth US home guard system is a large-scale project, and it is useful to connect a surveillance camera on the Internet, but the crime prevention target is not an individual home but an important facility. Because it is a public institution that owns and manages many parts of the system such as surveillance cameras, it has the inconvenience that it does not directly contribute to crime prevention in the community surrounding each household.

Against this background, the present invention uses PCs that have already penetrated homes around the world as they are to control surveillance images, installs cameras with little additional investment, and installs free surveillance control programs on PCs. Advanced security that can be used to prevent crime within the community by effectively utilizing information acquired and owned / managed by individual households in each monitoring area and information in other monitoring areas between networks. An object is to provide a monitoring system, a monitoring control method , a monitoring control program , and a network system .

  Furthermore, in the present invention, if the surveillance area is continuously expanded by increasing the number of surveillance systems owned and managed by each household in the network, regional crime prevention, regional security, criminal detection, terrorism In deterrence, etc., it will bring about a huge synergistic effect.

In order to solve the above problems and achieve the object of the present invention, a monitoring system of the present invention includes an image capturing unit that captures a subject image in an individual monitoring area of the own system, and an individual monitoring area captured by the image capturing unit. Image storage means for storing the subject image in the image storage unit of the own system according to the condition setting of the individual setting condition, and requesting the subject image in the individual monitoring area of the other system stored in the image storage unit of the other system via the network The image request means for receiving the subject image in the individual monitoring area of the other system transmitted from the other system of the image request destination via the network by performing the image request to be performed, and set individually in the own system Whether to send the image as a result of the image search, whether to send the time of the image, whether to send the name of the image capturing means Or, and images based number to the individual access conditions including the setting condition that defines whether to transmit the discrimination means the other system was an image request to determine whether it is permitted as an image request source And the image storage in response to a request for the subject image in the individual monitoring area of the own system from the other system determined to be permitted as the image request source by the determination unit via the network. The subject image in the individual monitoring area stored in the image storage unit of the own system is searched by the means, and the other system determined to be permitted as the image request source by the determination means via the network. And image search means for transmitting a search result in accordance with the set condition .

  The present invention uses a camera owned and managed by each person in place of each person's eyes, and a computer owned and managed by each person instead of each person's memory. By using and sharing and exchanging information through the network, the crime prevention function seen in the past can be reproduced in a form that has been greatly enhanced in accordance with the current situation. Each component (computer, camera, monitoring control program, and information such as acquired images) used in the system realized by the present invention is all owned and managed by the computer. However, it is quite different from what the traditional state is trying to manage.

According to the present invention, the following specific effects can be achieved.
In other words, a mutual monitoring system that existed in a community that was an old local community communicates with each other using computers and the Internet, and other monitoring areas in the network that are distant from one individual monitoring area By expanding the surveillance area to the point, it is possible to reproduce in modern society in a form that greatly expanded and strengthened the security range. As described above, according to the present invention, the always-on Internet connection environment that is rapidly penetrating into homes can be effectively used for home and social safety and crime prevention.

  In addition, according to the present invention, a PC that has already penetrated homes around the world is used as it is, a camera is installed with a small additional investment, and a monitoring control program, which is a monitoring software distributed free of charge, is introduced. This makes it possible for each household to own and manage an advanced monitoring system. Furthermore, when the number of monitoring systems owned and managed by each household according to the present invention increases and the monitoring area expands continuously, local crime prevention, local security, criminal detection, terrorism prevention, etc. , Will bring a huge synergistic effect.

Embodiments according to the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a hardware configuration of a system that is the basis of an embodiment according to the present invention. The embodiment according to the present invention includes a PC 10 that executes monitoring information processing as a basic unit by a monitoring control program, a sensor 11 such as a camera, and a communication line 12 such as a network for communicating with a PC of another system. In this system, information is exchanged with other systems in accordance with conditions (individual setting conditions) determined in advance by the manager / owner of this basic component.

  The PC 10 that executes monitoring information processing includes a ROM (Read Only Memory) 21 that stores various programs such as a monitoring control program, parameters, and the like, a CPU (Central Processing Unit) 23 that executes various programs, and various programs by the CPU 23. And a RAM (Random Access Memory) 20 used as a work area at the time of execution. Also, a keyboard 27 and mouse 26 for setting parameters, a display 25 for displaying various information such as image information, an HDD (hard disk drive) 22 for storing image data, and various information with other systems are displayed. A network interface 24 for replacement is provided.

  Image data can also be saved after being transferred to a PC of another system by using a network. The image data can be accessed through the network only when the individual setting conditions set by the individual (home) are satisfied. The monitoring control program, which is software that realizes management of the monitoring system, has a function of registering a person or object captured by the monitoring camera 11 in each home computer 10 or a management server permitted in advance, and the registered It has a function to connect a person or an object to a network under individual setting conditions individually set by the individual (home), between monitoring control programs that are the same kind of software of PCs of other systems, and the Internet By communicating through a network and operating in a coordinated manner, the individual monitoring areas can be expanded to other monitoring areas and a great synergistic effect can be exhibited.

  The monitoring control program, which is this software, is stored in a storage medium that is converted into information that can be read by the computer 10 and stored, for example, and introduced to the PC of each system, or each permitted system. Downloaded to the PC via the network.

For this reason, the following forms can be proposed in the monitoring system of the embodiment of the present invention.
First, a configuration using a network camera can be employed.
If the PC is a system in a home that is already in an always-connected environment to the network provided by the access service provider, the hardware preparation necessary to construct the system according to the present invention is to purchase and install a network camera. Only.

Further, a configuration using an inexpensive USB (Universal Serial Bus) camera can be employed.
When a USB camera (PC camera) is used, the camera can be installed in the immediate vicinity of the PC, and the monitoring system according to the present invention can be introduced at a very low cost. In particular, a USB camera is often sufficient for monitoring the inside of a room and monitoring from a window.

Further, a configuration using a CCD camera can be employed.
When a general CCD camera is used, an image board, a USB / VIDEO adapter, or the like is required when an image signal is taken into a PC. By using a commercially available USB / VIDEO adapter and a USB hub, video from many cameras can be handled by a single PC. As this CCD camera, a very wide variety of commercially available wired and wireless surveillance cameras can be used as they are. Further, when a USB / VIDEO adapter and a USB hub are used, the present invention can be applied at a low cost only by making a slight change to a surveillance camera system that has already been installed.

  In addition to the camera, information from a microphone, a heat detection sensor, and other sensors may be recorded simultaneously. Signals from microphones and heat sensors other than the camera can be used as image storage determination conditions. Of course, it is possible to use a monitoring camera in which a commercially available microphone, a thermal sensor, an infrared illumination device, or the like is incorporated.

  The basic configuration of the monitoring system according to the embodiment of the present invention includes a PC and a camera connected to a network as described above, and a monitoring control program that is software for controlling the PC and camera. This monitoring control program has a function of individually setting conditions (individual setting conditions) for handling “monitoring data” such as acquired images and sounds for each basic configuration installed in each home.

The individual setting conditions are, for example, firstly the acquired image storage condition (registration condition), secondly the storage image storage location (registration location), and thirdly the storage image (registered image) from another PC. There are setting of access rights, setting of conditions for accepting “requests” from other PCs, and fourthly, setting of conditions for sending “monitoring data” or analysis results to other PCs.
Of these, the third and fourth individual setting conditions are referred to as the individual access conditions described above.

As the first individual setting condition, for example, there is a setting condition of “save the image when a certain change is detected in the image captured by the monitoring camera”. Details are shown in the example of FIG.
As the second individual setting condition, for example, there is a setting condition of “transfer / save an image captured by a monitoring camera in each home to a recording device of a computer other than the home computer”. As a computer of a system other than the home, a PC of a system owned and managed by another household in the region, a PC of a system owned and managed by a friend's home, or a system owned and managed by a relative's home in another prefecture or foreign country There can be various examples such as a PC, a server installed in the police or city hall. Details are shown in the example of FIG.

As an example of the third individual setting condition, first, the PC of the system is divided into two according to whether or not it can be directly accessed from another external system.
When direct access from the outside is possible, such as when having a unique IP (Internet Protocol) address as No. 3-1, the partner's PC is authenticated and a predetermined access right is given. Details are shown in the examples of FIGS. 13, 14, and 15 to be described later.
If direct access from outside is not possible as No. 3-2, "request" is accepted by e-mail, authentication is performed with an ID (identification code) password attached to the e-mail, and predetermined according to it Grant access. Details are shown in examples of FIGS. 16, 17, and 18 to be described later.

If you cannot access directly from the outside as part 3-3, or if you have a unique IP address provided outside, use a PC that can be accessed directly from outside as a management server and use it as a message board Then, accept the “request”. Details are shown in the examples of FIGS. 19, 20, and 21 to be described later.
As for the fourth individual setting condition, for example, when sending an image, the image is processed / transferred according to the image quality deterioration condition / number limit condition set for each authenticated partner / situation.

FIG. 2 is a diagram illustrating an example of individual setting conditions. FIG. 2A is a storage amount and a storage location of a setting example related to image storage, and FIG. 2B is an operation according to a target of a setting example of operations permitted to other PCs. is there.
In FIG. 2A, a change amount 32 when each installed camera 31 stores an image, that is, a storage condition is defined, and a storage location 33 is also defined. For example, the amount of change that is a condition when the camera A with the change amount 32 is 100 stores an image is smaller than the amount of change that is a condition when the camera B with the change amount 32 is 200 stores an image. It indicates that a change is detected, and the change amount that is a condition when the camera B having the change amount 32 of 150 stores the image is in the middle. The storage location 33 is a storage file created in a storage unit such as the ROM 21 in the PC 10 of the system shown in FIG.

  In FIG. 2B, IDs (identification numbers) 35 of PCs of the system to be communicated are listed, and possible operations 34 of each PC to the PCs of the system are described. Other than the PCs described here, communication with the PC of the system is not possible. For example, as indicated by 34, the PC 5 indicated by 35 cannot browse the images of the PC of the system, but can search for images stored so far and images stored from now on. As indicated by 34, only the time of the image and the number of images are sent from the PC of the system as the search result. The PC of each system predetermines such setting conditions for the PC of the system to be communicated.

Hereinafter, specific embodiments according to the present invention will be described.
FIG. 3 is an explanatory diagram of a use state when the monitoring system of the present invention is used.
As shown in FIG. 3, PCs 10 a, 10 b, 10 c, 10 d, and 10 e constituting a system owned by a plurality of households are connected by a network 37. In the PCs 10a, 10b, 10c, 10d, and 10e of this system, information on the monitoring target 38 captured from the cameras 11a, 11b, 11-1c, 11-2c, 11d, 11-1e, and 11-2e is set according to individual setting conditions. It is remembered. Also, a monitoring control program, which is software that can output information stored in the storage unit such as the HDD 22 shown in FIG. 1 according to individual setting conditions, is installed only when a predetermined request signal is input from a PC of another system. ing. Accordingly, the PCs 10a, 10b, 10c, 10d, and 10e and the cameras 11a, 11b, 11-1c, 11-2c, 11d, 11-1e, and 11-2e function as a monitoring system.

FIG. 4 is an explanatory diagram of the system outline.
In FIG. 4, a basic structural unit 42 of a system is composed of a sensor 43 such as a camera and a PC and a monitoring control program 44 (hereinafter simply referred to as “monitoring control program”) which is monitoring system management software operating on the PC. Is configured. The basic structural unit 42 of this system is completely owned and managed by each household. A sensor 43 such as a camera of the basic structural unit 42 of this system detects a monitoring target (image movement, sound, heat, etc.) 41 by a physical signal (visible light, sound wave, electromagnetic wave, etc.) 46. The sensor 43 such as a camera performs communication 47 with the monitoring control program 44, and when there is a request from another system, the monitoring control program 44 passes through the external network 45 according to the individual setting condition. The request information is transmitted by communication 48.

Next, functions executed by the PC when the monitoring control program is installed in the PC of the system will be described with reference to the block diagrams shown in FIGS.
FIG. 5 is a functional block diagram of the individual system.
5, the system 51 includes an image storage block 52 that stores the subject image of the individual monitoring area captured by the camera 11 or the like shown in FIG. 1 in the image storage unit of the own system according to the condition setting of the individual setting conditions. Yes. Further, the system 51 requests the image of the subject in another individual monitoring area stored in the other system 55 via the network 37 shown in FIG. An image request block 53 for receiving an image of a subject in another individual monitoring area transmitted from 55 is provided.

  Further, the system 51 uses the image storage block 52 to store the individual monitoring area stored in the image storage unit of the own system in response to a request for the image of the subject in the individual monitoring area of the own system from the other system 56 via the network 37. An image search block 54 for searching for a subject image and transmitting it to the other system 56 of the image request source via the network 37 is provided. Then, the system 51 functions to connect the image search block 54 to the other system 56 of the image request source via the network 37 in correspondence with the condition setting of the individual setting condition.

FIG. 6 is a functional block diagram showing details of the image storage block 52 showing the system functions at the time of image storage shown in FIG.
6, the image storage block 52 includes an image acquisition unit 61 that acquires an image captured by the camera 11 illustrated in FIG. 1, an image change reference value storage unit 63 that stores a reference value of image change, and an image. Has an image change detection unit 62 for detecting that there is a change equal to or greater than a reference value, a storage condition setting unit 65 for setting individual setting conditions, and an image storage unit 64 for storing images by setting the conditions of the individual setting conditions. is doing. In addition, the image storage block 52 includes a transfer target setting unit 66 that sets a transfer target other than the image storage unit 64 in advance, and an image transfer storage unit 67 that transfers and stores an image to the transfer target.

  Further, the image storage block 52 includes a search target registration unit 68 for registering search targets from other systems permitted in advance, and a search target in which a change detection image by the image change detection unit 62 is registered in the search target registration unit 68. And a search target determination unit 69 for determining whether or not there is a search target. Then, the image storage block 52 functions to notify the other system when the change detection image is a search target and transfer the search target image to the other system by the image transfer storage unit 67 and store it. .

FIG. 7 is a functional block diagram showing details of the image request block 53 showing the system function at the time of image request shown in FIG.
In FIG. 7, an image request block 53 includes an image request target input unit 71 for inputting one or more other systems that are image request targets for requesting an image, and other individual monitoring areas corresponding to the request image by the other system. And an image request target discriminating unit 72 for discriminating whether or not the subject image is another system in which the subject image is stored.

  The image request block 53 includes a request target setting unit 74 that sets one or a plurality of other systems determined by the image request target determination unit 72 as a request target, and one or a plurality of sets set by the request target setting unit 74. And an image request transmitting unit 73 that transmits an image request to another system.

  Furthermore, the image request block 53 determines which requested image has been obtained from which other system based on the result of an image request previously made to one or more other systems that are image request targets. A request result determination unit 75 and a request target characteristic storage unit 76 that stores characteristics of one or a plurality of other system request images that are image request targets based on the determination result by the image request result determination unit 75. The image request block 53 functions so that the image request target determination unit 72 determines the image request target based on the characteristics of the request image of the image request target stored in the request target characteristic storage unit 76.

FIG. 8 is a functional block diagram showing details of the image search block 54 showing the system function at the time of image search shown in FIG.
In FIG. 8, an image search block 54 includes an image request receiving unit 81 that receives an image request from another system, and an individual image stored in the image storage unit 85 that is a request image of another system connected based on the individual setting condition. A request image search unit 84 that searches from the subject image in the monitoring area, and a request image transmission unit 86 that transmits the request image searched by the request image search unit 84 to another system.

FIG. 9 is a configuration diagram of the entire system.
9, from the first system image request block 91-1 of the first system 91 to the second system image search block 93-2 of the other second system 94-2,... An image request is transmitted to the n system image search block 94-n.
The first system image request block 91-1 of the first system 91 has the same configuration as that of the image request block described with reference to FIG. 7, and another system (for example, an image request received from the image request block 91-1) (for example, The second system 94-2) searches for the subject image stored in the image storage block 92-2 of the system through the image search block 93-2 in the system.

  Then, the image storage block 92-2 takes out the subject image requested by the first system 91 from the subject images stored in its own system, and the first image is received through the image search block 93-2. The image is sent to the image request block 91-1 of the system 91.

  Here, the other second systems 94-2 to n-th systems 94-n are requested from the first system 91 based on the determination result of the image request target determination unit 72 (see FIG. 7) of each system. It is determined whether a subject image corresponding to the captured image is stored. If the requested image is stored, the requested subject image is transmitted to the first system 91, and the system that determines that the subject image corresponding to the requested image is not stored is Do not send.

  In addition, the first system 91 uses the image request result determination unit 75 (see FIG. 7) in the first system 91 among the other second systems 94-2. Based on the characteristics of the requested image stored in the requested object characteristic storage unit 76 based on the determination result of the image request, a system that has a relatively accurate response to the image request and transmits many requested images. The image request is transmitted to the system, and the image request is not transmitted to a system that does not transmit the requested image because the response to the image request is relatively inaccurate. Here, the characteristics are characteristics such as the appropriateness of the storage setting of the PC and the appropriateness of the search with respect to the difficulty of the request. For example, the PC may be requested by discriminating the object according to the characteristics. Determine whether.

  The second system image search block 93-2 of the other second system 94-2 that has received the image request, the n-th system image search block 94-n of the n-th system 94-n is the second system 94- 2nd system image storage block 92-2,..., The requested image is searched for the nth system image storage block 92-n of the nth system 94-n, and the requested image of the search result is the first. Transmit to the first system image request block 91-1 of the system 91.

  As shown in FIG. 6, the second system image storage block 92-2 of the second system 94-2,..., The nth system image storage block 92-n of the nth system 94-n are shown in FIG. An image captured by the camera 11 or the like is acquired by the acquisition unit 61, and based on the reference value of the image change stored in the image change reference value storage unit 63, it is determined that the image has a change greater than the reference value. When detected by the detection unit 62, the image is stored in the image storage unit 64 by the condition setting of the individual setting conditions set in the storage condition setting unit 65. Further, the second system image storage block 92-2 of the second system 94-2,..., The n-th system image storage block 92-n of the n-th system 94-n transfers transfer objects other than the image storage unit 64. It is also possible to set in advance by the target setting unit 66 and to transfer and store the image as a transfer target by the image transfer storage unit 67.

  Further, the second system image storage block 92-2 of the second system 94-2,..., The n-th system image storage block 92-n of the n-th system 94-n is sent from the first system 91 that has been permitted in advance. The search target can be registered by the search target registration unit 68 and the search target determination unit 69 can determine whether or not the change detection image by the image change detection unit 62 is the search target registered in the search target registration unit 68. It is. The second system image storage block 92-2 of the second system 94-2,..., The n-th system image storage block 92-n of the n-th system 94-n is used when the change detection image is a search target. In addition to notifying the first system 91, the image to be searched can be transferred to the first system 91 by the image transfer storage unit 67 and stored.

  As shown in FIG. 8, the second system image search block 93-2 of the second system 94-2,..., The nth system image search block 94-n of the nth system 94-n includes the first system 91. The image request is received from the image request receiving unit 81, and the requested image of the first system 91 connected based on the individual setting condition is retrieved from the image of the subject in the individual monitoring area stored in the image storage unit 85. The request image is searched by the unit 84, and the request image searched by the request image search unit 84 is transmitted to the first system 91 by the request image transmission unit 86.

Here, the second system image search block 93-2 of the second system 94-2,..., The nth system image search block 94-n of the nth system 94-n are stored in the storage condition storage unit 83. Based on the individual setting conditions, the image request availability determination unit 82 determines whether or not the first system 91 is permitted as an image request target.
Further, the image request availability determination unit 82 determines whether the first system 91 is permitted to search for the requested image without restriction or with restriction based on the individual setting condition.

FIG. 10 is a flowchart showing the basic operation of the system.
In FIG. 10, the PC of this system receives information (signals from the monitoring target) from the camera (various sensors) in step S1, assigns a name based on time information, etc. to the image and saves it in step S2. To do. The image storage process in step S2 is executed by the image storage block shown in FIG. 6 of this system.
It is determined whether or not there is a request from another PC or the like for the image stored in step S3. If there is no request, this routine is terminated. The image request in step S3 is executed by the image request block shown in FIG.

  If there is a request in the determination step S3, it is determined in step S4 whether the image can be transmitted to the requesting PC, from the setting conditions. If it is not possible to determine that transmission is possible in the determination step S4, this routine is terminated. If it is determined in step S4 that the image may be transmitted, the image is transmitted in step S5, and the routine is terminated. The image search block shown in FIG. 8 of this system executes the transmission permission / inhibition determination for the image request in step S4 and the image transmission in step S5.

  This routine is performed every time an image is acquired. The supervisory control program that executes this supervisory information processing on the PC of the system communicates with the supervisory control program, which is the same kind of software executed on the PC of the other system, via a network such as the Internet, and cooperates. By operating, the system can be expanded from the individual monitoring area of this system to other monitoring areas of other systems in the network, and a great synergistic effect can be exhibited. In addition, a monitoring control program for executing monitoring information processing in this monitoring system can have various functions as shown in an example described later.

  Note that the PC may be any PC as long as it is a commercially available personal computer that has already spread throughout the country. Also, other electronic devices (for example, portable electronic notebooks, game devices, etc.) may be used as long as they can operate the monitoring control program that is software according to the present invention, not necessarily a PC. The OS (operating system) installed in the PC may be any commercially available OS. The camera may be any camera as in the above hardware configuration example. The network is preferably the Internet, but may be an intranet or the like.

  In this embodiment, each home PC stores all images acquired from a connected camera. Further, only images that satisfy appropriate conditions may be stored. As this condition, the magnitude of the cross-correlation value with the previous image as shown in an example of the image storage operation described later, a signal from a microphone or a thermal sensor that detects a signal above a certain level, etc. There is. In addition, it is also effective to collect the features of all the stored images in one file and sequentially record them in the image storage unit. The characteristics include various parameters such as the acquisition time, the correlation value of each color component (RGB) with the previous image, and the average brightness of each color component (RGB) of the image. Creating a file that summarizes the features of these images in a list format, for example, for each day means that the “request image response” function in this system can be used in response to an “image request request” from another system. It is effective to improve the efficiency in the realization. For example, for a request such as “an image in which a red object moves in a specific place and a specific time zone”, it is possible to perform “standard processing” by simply referring to the list file. That is. It is not necessary to read out the stored images from the recording device of the image storage unit one by one and perform image processing one by one.

  In addition, it is thought that the “mutual monitoring by each individual” seen in the old community also played an important function of “greet the person who met”, but this effect is incorporated into this system. It is also possible. For example, when it is detected that the camera is a structural requirement of the present invention move is, "Hello, here, is an automated system. Person of patronage, please press the doorbell." From the response part of the system "greeting" such as By generating the message, it can be expected that the person turns to the camera and a “good image” is obtained, and at the same time, “a warning is given to a person who tries to do something bad”. Many cameras with built-in microphones are commercially available, but by adding a speaker, this function can be realized immediately in terms of hardware.

FIG. 11 is a flowchart illustrating an example of the image storing operation.
FIG. 11 shows an example in which the image change detection unit 62 of the image storage block shown in FIG. 6 realizes the function of “storing the image when a certain change is detected in the image captured by the monitoring camera”. The flowchart of is shown. In step S11, the PC acquires an image from the camera. The image acquired in step S12 is temporarily stored as image A. Up to this point is the initial operation, and thereafter, steps S13 to S18 are repeated.

That is, an image is acquired from the camera in step S13, and the image is temporarily stored as image B in step S14. In step S15, the correlation between the images A and B is calculated, and it is determined in step S16 whether the correlation value is equal to or greater than a predetermined value. If the correlation value is greater than or equal to a certain value in the determination step S16, a name based on the time information is given to the image B in step S17 and stored, the image A is replaced with the image B in step S18, and the process returns to step S13. On the other hand, if the correlation value is not equal to or greater than the predetermined value in the determination step S16, the image A is immediately replaced with the image B in step S18, and the process returns to step S13.
As a result, it is possible to prevent a “waste image” having no movement from being stored.

  In this example, a “monitoring control program, which is a monitoring system management software”, is added to a hardware configuration in which a network camera is connected to a PC and the PC is connected to the Internet via a broadband connection by adding an image selection function based on the above flowchart. An experiment was conducted in a general private house. The network camera sends about one still image per second to the PC. Among them, the image is stored only when the cross-correlation value of the preceding and succeeding images exceeds a certain fixed value appropriately determined. As a result, an average of about 1000 images per day was stored for 30 days, and the storage capacity was about 30 megabytes per day and 1 gigabyte for 30 days. Since the PC used in this experiment is equipped with a hard disk of about 100 gigabytes, if about 60 gigabytes corresponding to 60% is used for image storage, it is possible to store images for about 5 years. become.

In the above example, the image is stored only when the cross-correlation value with the immediately preceding image becomes a certain value (= threshold) or more. In this case, for example, when an intruder appears in only one image, in addition to the image when the intruder appears, the image immediately after the intruder disappears is also saved. It will be. In order to prevent this, it is conceivable to store the image only when the following two conditions are satisfied.
For example, as condition 1, the cross-correlation value with the immediately preceding image is set to a certain value T1 or more, and as condition 2, the difference from some previously taken images is set to a certain value T2 or more. It may be set.
In addition, many existing techniques such as an existing image processing technique for detecting a moving object can be used instead of the cross-correlation.

FIG. 12 is an explanatory diagram of a transfer / save state of an acquired image.
12, the image transfer storage unit 67 of the image storage block shown in FIG. 6 “transfers and stores the image captured by each home monitoring camera to a recording device of a predetermined computer other than the home computer. An example of implementing the function is shown.
As a computer other than the PC 10a constituting the system owned by the household, the PC 10c, 10e owned and managed by another household in the area, the PC 10b owned and managed by a friend's family, or a relative's family in another prefecture or foreign country There may be various examples such as the PC 10d to be managed, and the servers 122 and 123 installed in the police station or city hall.
By using a plurality of storage locations, more reliable storage of acquired images is guaranteed. Moreover, it can be expected that the criminal deterrence of the monitoring target 38 increases the crime deterrent effect that the image storage location is not clear.

In the above example, as an example, the following images are transferred and stored.
The PCs 10a, 10b, 10c, 10d, and 10e of each individual system that received a request from the police are the monitoring targets 38 that are captured from the cameras 11a, 11b, 11-1c, 11-2c, 11d, 11-1e, and 11-2e. The image is transferred to the police station server (computer) 122 under a condition that the license is granted in advance, and the image is stored in the police station server 122. The reason why the police requests is that, for example, the area in the network 37 is a crime-prone area and requires constant monitoring. The conditions that the PCs 10a, 10b, 10c, 10d, and 10e of each individual system that receives a request from the police station server 122 permit in advance in addition to the transfer destination include limiting the day of the week and the time zone for transferring the image, There are conditions such as degrading the quality of the image, limiting the image viewing conditions and usage conditions, and limiting the image storage period.

  In addition, an image storage server 123 is installed at the city hall as part of the administrative service, and a storage device (such as a hard disk) having a certain capacity is allocated to each of the personal computers 10a, 10b, 10c, 10d, and 10e. Within that range, the images transferred from the PCs 10a, 10b, 10c, 10d, and 10e of each individual system are received and stored. When the capacity is exceeded, it is effective to overwrite the old images sequentially in time. The city hall server 123 may be provided with a message board function to act as an intermediary for sending and responding to “requests” of the following image requests.

  In addition, images from personal systems PCs 10a, 10b, 10c, 10d, and 10e of private contracted companies are sent to the server 121 of the private security company, and monitoring is performed by a monitoring control program that is software. When the security company detects a suspicious person or a dangerous situation, the security company takes measures as stipulated in the contract, such as dispatching guards. This is an example of using the powerful social infrastructure realized by this system for commercial purposes. For a security company, it is possible to provide a plus α service at low cost by using existing hardware without having to install hardware in each household. This is also preferable for the individual in the sense that the range of options widens.

Next, the image storage block shown in FIG. 6 and the image search block shown in FIG. 8 indicate that “the image request destination in accordance with the image request request from the computer of the image request source system that is permitted in advance by the individual setting condition” A specific example of a case where the computer of each home system searches for a video recorded in a recording device such as an image storage unit inside the system and returns the result is shown.
From the image request source system computer to each image request destination system computer in each image request source system computer, the image request source system computer shown in FIG. The image request is transmitted to the image search block shown in FIG. As this request, a request is made based on some selection items presented. The selection items include request destination, color, size, time, and processing method. The contents corresponding to this selection item include specifying the PC to be inquired, specifying the color to be searched, specifying the vertical and horizontal sizes of the object, the time of the image to be searched, and specifying the processing method after the search.

The request destination designates the PC of each home system of the image request destination to be inquired. Options include all PCs and individual PCs.
The color is selected from the colors prepared in advance. The request content is to search for an image in which the selected color has moved.
The time specifies the time when the image to be searched was recorded. It is possible to specify a specific time or to specify all the times.

  The processing method designates a processing method to be performed after the selected color is reflected and the PC checks the presence / absence of an image recorded at the designated time. First of all, the processing method option informs that there is no corresponding image when there is no such image. Secondly, if there is such an image, the fact that it is present is notified. Third, when there is an image of interest, the time is notified. Fourthly, when there is such an image, the image is transmitted. A plurality of these can be selected.

  Next, the search target registration unit 68 and the search target determination unit 69 of the image storage block shown in FIG. 6 indicate that “in response to a request for an image request from a computer that requested an image in advance according to the individual setting condition, The object is registered as a search target in the search target registration unit 68 of the image storage block of the computer of each home system of the image request destination, and each home computer of the image request destination monitors the registered person or object. A specific example of “when the camera captures a notification from the image storage unit to the computer of the image request source system and further records and transfers the image” is shown.

  From the image request source system computer to each image request destination system computer in each image request source system computer, the image request source system computer shown in FIG. The image request is transmitted to the image search block shown in FIG. Based on this request, the image search block shown in FIG. 8 of each computer of each home system of the image request destination registers the search target in the search target registration unit 68 of the image storage block shown in FIG. As this request, a request is made based on some selection items presented. The selection items include request destination, color, size, time, and processing method. As contents corresponding to the selection item, there are designated a PC to be inquired, a color to be searched, a vertical and horizontal size of an object, a time of an image to be searched, a processing method after searching, and the like.

The request destination designates the PC of the system to be inquired. Options include all system PCs and individual PCs.
The color is selected from color options prepared in advance. The request content is to search for an image in which the selected color has moved.
The time specifies the time when the image to be searched was recorded. It is possible to specify a specific time or to specify all the times.

  The processing method designates a processing method to be performed after the selected color is reflected and the PC checks the presence / absence of an image recorded at the designated time. First, if there is a corresponding image, the option informs that there is an option. Second, when there is a corresponding image, the time is notified. Third, if there is a corresponding image, the image is transmitted. A plurality of these can be selected.

When the search target determination unit 69 of the image storage block shown in FIG. 6 determines that the registered person or object corresponds to the search target request registered in the search target registration unit 68, the image storage is performed. The image is sent to the computer of the image request source system, and the image transfer storage unit 67 transfers the image to the computer of the image request source system for recording.
The requested PC of the image request source system transmits an end command to each PC of each image request destination home system when the search is completed.

  Next, an example in which each PC of an individual (home) system individually sets conditions, that is, a specific example of individual condition setting will be described. Regarding how to distribute images stored in each PC of each home system to each PC of another home system, the following settings can be made in each home.

First, it is possible to specify a time period during which image browsing is permitted and not permitted. Secondly, it is possible to specify the time for permitting and not permitting the retrieval of images. Thirdly, it is possible to designate a PC that permits and disallows browsing of images. Fourth, it is possible to specify a PC that permits and disallows image search. Fifth, the number of days for storing images can be set. Sixth, the time for recording an image can be specified.
The system PC is identified by using an IP address, a mail address, an ID assigned to the PC, or the like.

FIG. 13 is an explanatory diagram of a bidirectional communication state.
As an example of data exchange between PCs in each home system, a case is shown in which direct communication is performed between each PC in each home system without installing a server. In this case, as shown in FIG. 13, it is assumed that the PCs 10a, 10b, 10c, and 10d of each home system are accessible from PCs of other systems.

  The PCs 10a, 10b, 10c, and 10d in each home system wait for a search request from another PC at a predetermined communication port. For this reason, unlike mail communication or management server communication, confirmation to the mail server or management server is not performed at regular intervals. There are two types of search requests: search for images stored so far and search for images stored from now on.

  In FIG. 13, the PC 10a of a certain home system receives a search request L1 from the PC 10b of another home system via the network 37, and performs two-way communication L3 with the PCs 10c and 10D of other home systems. This is a state in which L5 is performed. The PC 10b in one home system transmits a search request L1 to the PC 10a in another home system via the network 37, and performs bidirectional communication L2 and L4 with the PCs 10c and 10d in the other home system. It is in a state. The PC 10c of a certain home system is in a state of performing bidirectional communication L2 and L3 with the PCs 10a and 10b of other home systems via the network 37. The PC 10d of a certain home system is in a state in which bidirectional communication L4, L5 is performed with the PCs 10a, 10b of other home systems via the network 37.

FIG. 14 is a flowchart illustrating an operation corresponding to a search request for a stored image.
FIG. 14 shows an outline of the operation when the search request transmission PC 141 issues a search request for images stored so far to the search request receiving PC 142.
In step S21, the PC 141 sends a search request for stored data to the PC 142. This request includes the range of stored data to be searched and the image information to be searched. The range of stored data is specified by time, and the image information to be searched is specified by color, size, and the like. The PC 142 receives the search request in step S22, and determines whether or not to accept the search request received in step S23 based on whether the PC 141 has search authority and system setting conditions.

  If the search request is not accepted in the determination step S23, the PC 142 notifies the PC 141 that the search request is not accepted, and this routine is terminated. When accepting the search request in the determination step S23, the PC 142 searches the stored data in step S24. After the search ends in step S24, the PC 142 transmits to the PC 141 if there is such an image in step S25, and transmits to the PC 141 that there is no image if there is no such image in step S25. In step S26, the PC 141 receives the search result from the PC 142, and ends this routine.

FIG. 15 is a flowchart showing an operation corresponding to a search request for a stored image and search end processing.
FIG. 15 shows an outline of the operation when the search request transmission PC 151 issues a search request for an image to be stored to the search request receiving PC 152. In step S31, the PC 151 sends a search request for images to be stored in the future to the PC 152. This request includes a search period and image information to be searched. Image information to be searched is specified by color, size, and the like. The PC 152 accepts the search request in step S32, and determines whether or not to accept the search request in step S33 based on the individual setting conditions for the PC 151 or the like.

  When the search request is not accepted in the determination step S32, the PC 152 notifies the PC 511 that the search request is not accepted, and this routine is finished. If the search request is accepted in the determination step S32, the PC 152 searches for the image stored in step S34, and if the stored image is relevant for the search, the PC 152 sequentially transmits the image to the PC 151. In step S35, the PC 151 receives images sequentially sent from the PC 152. Steps S34 and S35 are repeatedly performed during the search period indicated by the PC 151 in the search request in step S31.

  When the search period indicated by the search request in step S31 ends, this routine ends. In step S31, the PC 151 indicates the search period to the PC 152. If no search period is presented, the PC 152 continues to step S34, and the PC 151 continues to step S35. In this case, the PC 151 sends a search end command to the PC 152 in step S36, and the PC 152 receives the command in step S37 and ends this routine.

FIG. 16 is an explanatory diagram of a communication state via the mail server.
It is a chart.
As an example of data exchange between the PCs 10a, 10b, 10c, and 10d of each home system, a method of using mail via the mail servers 161, 162, and 163 as shown in FIG. In this method, an image search request to another PC and a result thereof are transmitted and received using mail via a mail server. Each PC is given an available e-mail address.

  In FIG. 16, the PC 10a of a home system transmits image requests L11, L12, and L13 to the PCs 10b, 10c, and 10d of other home systems via the network 37 and mail servers 162 and 163, and the network 37 and In this state, the search result L14 is received by mail from the PC 10c of another home system via the mail server 161.

The PC 10b of a certain home system is in a state of receiving the image request L11 by mail from the PC 10a of another home system via the network 37 and the mail server 162.
Further, the PC 10c of a certain home system transmits an image request L14 to the PC 10a of another home system via the network 37 and the mail server 161, and the other home system via the network 37 and the mail server 163. In this state, the search result L12 is received from the PC 10a by mail.

  Further, the PC 10d of a certain home system is in a state of receiving the image request L13 by mail from the PC 10a of another home system via the network 37 and the mail server 162.

FIG. 17 is a flowchart showing an operation corresponding to a stored image search request via the mail server.
FIG. 17 shows a routine when the search request transmission PC1 (personal computer) 171 transmits a search request for images stored so far to the search request reception PC2 (personal computer) 173. In step S41, the PC 1 (personal computer) 171 checks the mail server 172 for mail, and repeats this at regular intervals. The PC 2 (personal computer) 173 also checks the mail server 172 for mail in step S42, and repeats this at regular intervals. In step S43, the PC 1 (personal computer) 171 sends a search request addressed to the PC 2 (personal computer) 173 to the mail server 172 by mail. The search request in step S43 includes the range of images to be searched, the characteristics of the image to be searched, and the like. In step S44, the mail server 172 receives a mail addressed to the PC 2 (personal computer) 173. In step S45, the PC 2 (personal computer) 173 checks the mail server 172 for the presence or absence of a mail. In step S46, the mail server 172 delivers the mail to the PC 2 (personal computer) 173. In step S47, the PC 2 (personal computer) 172 receives the mail from the mail server 172.

  In step S48, the PC 173 receives a search request from the PC 1 (personal computer) 171 included in the mail, and determines whether to accept a search process for the search request from the PC 1 (personal computer) 171 received in step S49. Judgment is made based on setting conditions. If the PC 1 (personal computer) 171 is not authorized in the determination step S49, the PC 2 (personal computer) 173 notifies the PC 1 (personal computer) 171 that the search is not possible by mail, and the routine is terminated. If the PC 1 (personal computer) 171 has authority in the determination step S49, the image stored so far is searched in step S50, and the search result is transmitted to the mail server 172 by e-mail. In step S51, the mail server 172 is searched. Receives the search results by e-mail. The PC 1 (personal computer) 171 periodically checking the mail to the mail server 172 checks the mail from the PC 2 (personal computer) 173 in step S52, and in step S53 from the mail server 172 to the PC 1 (personal computer). ) The mail is delivered to 171. The PC 1 (personal computer) 171 can receive mail from the mail server 172 in step S54 and obtain a search result.

FIG. 18 is a flowchart showing an operation corresponding to a search request for a stored image via the mail server and search end processing.
FIG. 18 shows a routine when the search request transmission PC1 (personal computer) 181 makes a search request for an image to be stored to the search request reception PC2 (personal computer) 183 via the mail server.
In step S61, the PC 1 (personal computer) 181 checks the mail server 182 for mail, and repeats this at regular intervals. The PC 2 (personal computer) 183 also checks the mail server 182 for mail in step S62, and repeats this at regular intervals. In step S63, the PC 1 (personal computer) 181 transmits a search request addressed to the PC 2 (personal computer) 183 to the mail server 182 by mail. The search request in step S63 includes the search period and the characteristics of the image to be searched. In step S64, the mail server 182 receives a mail addressed to the PC2 (personal computer) 183. In step S65, the PC2 (personal computer) 183 checks whether there is a mail. In step S66, the mail server 182 delivers the mail to the PC 2 (personal computer) 183. In step S67, the PC 2 (personal computer) 183 receives the mail from the mail server 182.

  In step S68, the PC 2 (personal computer) 183 receives a search request from the PC 1 (personal computer) 181 included in the mail, and determines whether or not to accept search processing for the search request received in step S69. Judge based on. If the PC 1 (personal computer) 181 is not authorized in the determination step S69, the PC 2 (personal computer) 183 notifies the PC 1 (personal computer) 181 that the search cannot be performed by mail, and the routine is terminated. If it is determined in step S69 that the PC 1 has authority, the PC 2 (personal computer) 183 searches for an image to be stored in step S70, and if the stored image corresponds to the searched image, the image is stored. Is sent to PC1 (personal computer) 181 by mail. In step S71, the mail server 182 receives mail from the PC2 (personal computer) 183, and the PC1 (personal computer) 181 checks the mail to the mail server 182 periodically, but in step S72. The PC 1 (personal computer) 181 confirms the mail to the mail server 182, and the mail server 182 delivers the mail to the PC 2 (personal computer) 183 in step S 73. In step S74, the PC 2 (personal computer) 183 receives the search result from the mail server 182 by mail.

  The processing from step S70 to step S74 is executed every time an image is stored. When the search period is indicated, when the period ends, the PC 2 (personal computer) 183 ends the search. If the search period is not indicated, the PC 1 (personal computer) 181 sends a command for terminating the search to the PC 2 (personal computer) 183. Specifically, in step S75, the PC 1 (personal computer) 181 transmits an end of search by mail. In step S76, the mail server 182 receives the mail. The PC 2 (personal computer) 183 periodically checks whether or not there is a mail to the mail server 182. In step S 77, the mail is confirmed and the mail from the PC 1 (personal computer) 181 is confirmed. In step S78, the mail server 182 transmits a mail to the PC 2 (personal computer) 183, and in step S79, the PC 2 (personal computer) 183 receives the search end mail. The PC 2 (personal computer) 183 ends the search in step S80.

FIG. 19 is an explanatory diagram of a communication state via the management server.
FIG. 19 shows a case where a management server 191 is installed as an example of data exchange between home system PCs 10a, 10b, 10c, and 10d.
As shown in FIG. 19, the management server 191 sets a public IP address so that it can be accessed from the PCs 10a, 10b, 10c, and 10d of each home system. The PCs 10a, 10b, 10c, and 10d in each home system need not have public IP addresses.

  In FIG. 19, the outline of the search processing will be explained. The PCs 10a, 10b, and 10c of each home system access the management server 191 at regular intervals like L22, L23, and L24, and search from the PCs of other systems. Check if there is a request. When a search is requested, the search request is notified to the management server 191 as in L21. When there is an access from the PC 10d that is requested to search like L21, the management server 191 notifies the PC 10a, 10b, 10c of the search request like L25, L26, L27. Receiving the search request, the PCs 10a, 10b, and 10c perform a search, and notify the management server 191 of the results as in L28, L29, and L30. When there is an access from the PC 10d that requested the search, the management server 191 passes the search result to the PC 10d as in L31.

FIG. 20 is a flowchart illustrating an operation corresponding to a stored image search request via the management server.
FIG. 20 shows a search routine through the management server for images stored so far. The PC 1 (personal computer) 201 requesting the search notifies the management server 202 of the search request in step S81. This search request includes the search request destination PC 2 (personal computer) 203, the range of images to be searched, and the search conditions. In step S82, the management server 202 receives a search request. The PC 2 (personal computer) 203 periodically accesses the management server 202 and checks whether or not there is a notification related to itself, but accesses the management server 202 in step S83, finds that there is a search request, and in step S84. A search request is delivered from the management server 202 to the PC 2 (personal computer) 203, and the PC 2 (personal computer) 203 receives the search request in step S85.

  In step S86, the PC 2 (personal computer) 203 determines whether to accept a search process for the received search request based on the individual setting conditions. If the PC1 (personal computer) 201 is not authorized in the determination step S86, the PC2 (personal computer) 203 notifies the management server 202 that the search cannot be performed, and the management server 202 further communicates with the PC1 (personal computer) 201. This is notified and this routine is finished. If the PC1 (personal computer) 201 has authority in the determination step S86, the PC2 (personal computer) 203 searches the image stored so far in step S87, and the search result is stored in the management server 202 in step S88. Send to. In step S89, the management server 202 receives a search result from the PC 2 (personal computer) 203. The PC1 (personal computer) 201 periodically accesses the management server 202. In step S90, the PC1 (personal computer) 201 accesses the management server 202 and confirms that the search result is sent. In S 91, the management server 202 delivers the search result to the PC 1 (personal computer) 201. In step S 92, the PC 1 (personal computer) 201 receives the search result from the management server 202.

FIG. 21 is a flowchart illustrating an operation corresponding to a stored image search request via the management server and a search end process.
FIG. 21 shows a search routine for an image to be stored through the management server. The PC 1 (personal computer) 211 requesting the search notifies the management server 212 of the search request in step S101. The search request in step S101 includes the search request destination PC, the search period, and the search conditions. In step S102, the management server 212 receives a search request. The PC 2 (personal computer) 213 periodically accesses the management server 212 and checks whether there is a notification related to itself, but in step S103, the PC 2 (personal computer) 213 accesses the management server 212 and has a search request. In step S104, a search request is delivered from the management server 212 to the PC 2 (personal computer) 213. In step S105, the PC 2 (personal computer) receives the search request.

  In step S106, the PC 2 (personal computer) 213 determines whether or not to accept a search process for the received search request based on the individual setting condition or the like. If the PC 1 (personal computer) 211 is not authorized in the determination step S106, the PC 2 (personal computer) 213 notifies the management server 212 that the search cannot be performed, and the management server 212 further communicates with the PC 1 (personal computer) 211. A message to that effect is given and this routine is terminated. If the PC1 (personal computer) 211 has authority in the determination step S106, the PC2 (personal computer) 213 searches for an image to be stored in step S107. If there is an image corresponding to the search, the PC2 (personal computer) 213 searches for the image in step S108. The search result is sent to the management server 212. In step S109, the management server 212 receives the search result from the PC 2 (personal computer) 213. The PC1 (personal computer) 211 periodically accesses the management server 212. In step S110, the PC1 (personal computer) 211 accesses the management server 212 and confirms that the search result is sent. In S111, the management server 212 delivers the search result to the PC1 (personal computer) 211. In step S112, the PC1 (personal computer) 211 receives the search result.

  This search is performed every time an image is stored, and the processing from step S107 to step S112 is performed every time an image is stored. When the search period is instructed by the PC 1 (personal computer) 211, the search is ended when the period ends. If the search period is not instructed from the PC 1 (personal computer) 211, the PC 2 (personal computer) 213 continues the search until the PC 1 (personal computer) 211 instructs to end the search. When the search is to be ended, the end of the search is notified from the PC 1 (personal computer) 211 to the management server 212 in step S113, and the management server 212 receives an end command from the PC 1 (personal computer) 211 in step S114. The PC 2 (personal computer) 213 periodically accesses the management server 212. In step S115, the PC 2 (personal computer) 213 management server 212 is accessed to know that there is a search end command. The management server 212 sends an end command to the PC 2 (personal computer) 213 in step S116. In step S117, the PC 2 (personal computer) 213 receives an end command, and ends the search in step S118.

FIG. 22 is an explanatory diagram of a communication state due to operation of the management server program.
FIG. 22 shows a case in which the management server program is operated on the PC 10e of the home system as in the case of 221 among the cases where the server is installed as an example of data exchange between the PCs 10a, 10b, 10c, and 10d of the home system. Indicates. The PC 10e of the home system in which the management server program operates like 221 sets a public IP address so that it can be accessed from the PCs 10a, 10b, 10c, and 10d of each home system. The PCs 10a, 10b, 10c, and 10d in each home system need not have public IP addresses.

  The PCs 10a, 10b, 10c, and 10d in each home system have the management server program running at regular intervals in the same manner as the example of FIG. 19 described above. Access the PC 10e of the home system and check whether there is a request from the PC of another system. In addition, the PCs 10a, 10b, 10c, and 10d in each home system execute a search according to the request.

  In the PC 10e of the home system where the management server program is operating, the client program operating on the PC 10e of the system as in 222 communicates with the management server program, so that the home where the management server program is operating It is confirmed whether there is a request from the PC of another system to the PC 10e of the other system.

Thus, the difference between FIG. 22 and the example of FIG. 19 described above is that, in the PC 10e of the home system in which the management server program is operating, the management server program and the client inside the PC 10e of the system as indicated by 222. The communication program communicates and interacts with the functions of the PC of the normal system and the management server.
The information transmissions L41 to L51 shown in FIG. 22 correspond to the information transmissions L41 to L51 shown in FIG.
In this example, there is an advantage that it is not necessary to prepare a separate management server PC.

FIG. 23 is an explanatory diagram of a state when the system is mounted on an automobile.
FIG. 23 shows an example in which individual systems 10a and 10f owned and managed by individual persons (homes) according to the present invention are mounted on automobiles 234 and 235 such as private cars. In this case, it is suitable to use a mobile phone line for connection to the network (Internet) 37. In this example, one camera 11-1f, 11-2f, 11-1a, and 11-2a are installed before and after the automobiles 234 and 235, respectively. In addition, signals from operation units such as an accelerator, a brake, a steering wheel, a key, a signal from a GPS (global positioning system) sensor, a signal from a car speed sensor, a signal from a gyro, a signal from an acceleration sensor, By inputting a signal from a microphone to the PCs 10a and 10f, the operation status of the automobiles 234 and 235, position information, speed information, posture change information, acceleration information, an external sound field, and the like are recorded simultaneously with the image. It becomes possible.
The other configuration corresponds to the example of FIG.

Recording of signals from these sensors may be performed in the following cases, for example.
Specifically, firstly, while the brake is applied, secondly, when a loud sound is generated outside, thirdly, when a large acceleration is detected, fourthly, recording is performed with the hand switch. When commanded, fifth, when an unauthorized operation is detected, sixth, when a request is received from an external pre-authorized PC.
In addition, it is effective to record information from the sensor in two ways as follows.
First, a certain capacity is prepared as a “temporary storage area” in the memory (the RAM of the own PC and other PCs, hard disks, etc.), and all information from the sensor is the most within that capacity. Record in the form of overwriting the old information.
Second, when an event as described above occurs, sensor information for a certain period of time before and after the event is stored. Information before the event is read from the first “temporary storage area” and stored.

According to this example, the following merits can be expected for an individual (home) who has installed the system according to the present invention in a private car.
When an accident is encountered, evidence is recorded that proves in what circumstances the accident occurred. In other words, you can prove innocence when you are involved in an accident in a situation where you are not responsible.
Further, when unauthorized access due to theft or the like is detected, information before and after that is stored in its own PC and other PCs via the Internet.
In addition, the insurance premium may be reduced if it is statistically recognized that individuals (homes) equipped with this system drive safely and have a low probability of causing an accident.
In addition, information can be provided to the police for accidents and crimes that occurred nearby. (You can fulfill your responsibility as a citizen.)

Furthermore, since individuals (homes) equipped with the system according to the present invention in private cars are widely distributed throughout the country, the following merits can be expected socially.
It can be expected that a lot of objective evidence information can be obtained in the event of a traffic accident.
In addition, it can be expected that a lot of objective evidence information can be obtained to help control malicious traffic violations.
In addition, it can be expected that a lot of objective evidence information can be obtained that is useful for tracking and identifying violent criminals.
The PC may also be used as a computer that controls the basic configuration of an automobile such as an engine. It may also be used as an additional computer such as a car navigation system.

FIG. 24 is an explanatory diagram of the personal carrying state of the system.
FIG. 24 shows an example in which each individual 244, 245 wears each system 10a, 10f owned and managed by each individual (home) according to the present invention. In this case, the individual systems 10a and 10f may be centrally mounted on, for example, a mobile phone body or a portable information terminal. That is, the communication function with the network (Internet) 37, the sensing functions such as the cameras 11a and 11f, the microphone, and the GPS sensor, the information processing function, and the power source (battery) may all be mounted on the mobile phone body. Further, they may be incorporated in clothes or the like.
The other configuration corresponds to the example of FIG.

  As a result, as in the case of the on-vehicle type shown in FIG. 23, an individual carrying this system can expect to enjoy a great merit by expanding the monitoring area even while moving. Similarly, if such individuals spread throughout the country with high density, great benefits can be expected for society.

  Further, each of the image data stored by the system of the present invention does not require so much storage capacity, but since the storage capacity of the system is limited, it needs to be deleted sometime. Therefore, the deletion is automatically performed by the system, but the deletion is performed based on the setting of the individual who owns the image data. The setting items are firstly, the time from generation of the image data to deletion, second, the time from generation of the image data in the case of the search to deletion, third, For example, the time from generation of image data to deletion when the search is not performed.

  In addition, in the present invention, it is an object of the present invention to be a deterrent against crime and the like by monitoring the surroundings of each household with a PC of each household system, connecting them with a network, and exchanging information with each other. When a criminal is reflected in the image taken by the camera, it is a powerful information source for criminal investigation. In the present invention, a system for automatically transmitting an image showing a criminal to the police is also possible. It is also possible to construct a system so that the information provider is automatically rewarded.

  As can be understood from the description of the embodiment of the present invention described in detail above, the present invention can provide an effective monitoring system at low cost (less than about tens of thousands of yen per set). As a result, it is possible to simply and inexpensively implement “the entire area is put on a monitoring network using a camera that is always connected to each home”.

  In the embodiment according to the present invention, a plurality of locations such as an entrance and a road are monitored and photographed by a camera from a PC in a system in a house in an environment always connected to a network. The function of the monitoring control program installed on the PC of each home system saves the image on the PC of each home system or performs appropriate signal processing such as encryption when the subject moves. Then, the information is transferred together with time information, location information, and the like to a plurality of servers on a network permitted in advance. As a result, a person who enters and exits the area in the network is photographed at a plurality of places, and the images are transferred and recorded in a plurality of destination servers. Therefore, according to this system, a thief or the like can expect a crime deterrent due to the psychological effect of “it is difficult to get close to an area where a picture is not taken from where it is taken”.

  In addition, a server for storing images at the transfer destination can be freely selected from the PC of each home system, and one of them can use a public server such as a police station or city hall. In this case, the PC of each household system can easily introduce not only “image recording” but also monitoring and control program technology that is software such as “warning”, “alarm”, and “notification”. “Warning” warns an unexpected intruder. “Alarm” is a function for issuing an alarm in the home or area when an undesired intruder is detected, and “notification” is a function for notifying the police, a security company, or the like. Various functions such as a monitoring control program that is software for collating with arranged photographs and a monitoring control program that is software for detecting suspicious movements are selected as appropriate, and these are introduced into the system based on the present invention. You can also.

  The main components of the system according to the embodiment of the present invention are owned and managed by each individual, and only when a condition (individual setting condition) individually set by the individual (home) is satisfied. It is connected with. Therefore, it is considered that the extent of the problem is less with respect to the privacy issue than in the case of organizations such as local governments, police stations, and store associations.

  For this reason, the first feature of the monitoring system according to the embodiment of the present invention is that it is connected to a computer that performs control for monitoring information owned and managed by each household in the area by a monitoring control program and the computer. The computer stores the information of the surveillance camera in the individual surveillance area in the image storage block of its own system using the image storage block under the condition (individual setting condition) that each household individually sets. In order to provide the image of the subject in the individually monitored area correspondingly searched, the image search block is connected to another system of the image request source via the network under a condition (individual setting condition) that each household individually sets. It is.

  In this monitoring system, each home is connected to the network under the condition that the computer that it owns and manages is set by the individual (the condition that the individual (home) individually sets, that is, the individual setting condition), thereby reducing the cost. In addition, it is possible to construct a community security camera system with a high degree of freedom in cooperation with other systems. The main components of this system are “a computer owned and managed by each household and a surveillance camera connected to the computer”. By using PCs that are managed and owned by each household as they are, "rapid spread" can be expected. In addition, the “privacy problem” is greatly alleviated by each home managing and owning the camera. In addition, when each home manages and owns the “images” acquired by the camera, the “privacy problem” can be greatly reduced by saving the images under the conditions set individually by each home (individual setting conditions). Alleviated. Alternatively, how to use the “image” at the time of image search and the setting of the access right are left to independent judgment of each home according to the conditions (individual setting conditions) set individually by each home.

In the second feature, in addition to the first feature, when a certain change is detected in the image captured by the surveillance camera, the image is stored in the image storage unit of the own system by the image storage unit. is there.
All images sent from the camera are taken into the PC, and the images are stored only when the change is large compared to the previous images. The magnitude of the change can be easily checked by taking a correlation with respect to all the pixels. It is convenient to automatically generate the image name from the year / month / day / hour / minute / second location code. It is convenient that the holder to be stored is automatically generated based on the date and time. For example, the name of an image file taken with a location code abc at 15:16:17 of 2004.2.5 is 2004FEB05-151617-abc. jpg etc. The holder for storing the file is C: \ saveimage \ abc \ 2004 \ FEB \ 05 \ 15 \.

The third feature is that, in addition to the first and second features, an image captured by a monitoring camera in each home is stored in a computer of another predetermined system other than the image storage unit of the image storage block of the home computer. Transfer and save to the image storage unit.
In this system, more reliable storage of acquired images is ensured by using a plurality of storage locations. Moreover, it can be expected that the crime deterrent effect is enhanced for the criminal that the storage location of the image is not clear.

  According to the fourth feature, in addition to the first and second features, in response to a request from a computer of another system that is permitted in advance, the image search block of the computer of each home system can It is possible to search for an image recorded in the image storage unit and return the result.

  When the camera is connected to the PC of each home system via a network or a USB cable, and there is a motion in the video captured by the camera, the video is transferred to the image storage unit by the image storage block of the system PC. Saved. The image search block of the computer of the image request destination system searches for an image recorded in the image storage block of the image storage block of the own system in response to an image request from a computer of another system permitted in advance by the image request source. To do. The image search block of the computer of the image request destination system returns the search result to the computer of the other system permitted in advance of the image request source.

  This system supports various network environments, for example, when the IP address used by the PC of each home system is dynamically allocated, or when the Internet is used by using the address conversion function. Therefore, there is no method for accessing the PC of each home system from the management server, and communication is performed only by accessing the management server from the PC of each home system. For example, in order for a plurality of PCs in a home to use the Internet, an address conversion function is used in many homes. In this case, although it is not impossible for the PCs of the systems of each home to communicate directly, it is necessary to make settings for the network device that performs address conversion. This requires knowledge about the network and is not suitable for widespread use.

  Therefore, in this system, it is possible to cope with such a network environment by performing communication via the management server. When there is a search request such as searching for a person, an inquiry is transmitted from the PC of the system to the management server by the color of clothes. The PC of each home system accesses the management server at regular intervals in order to confirm whether there is an inquiry from the PC of another home system. When it is confirmed that there is an inquiry, the PC of each home system receives the contents of the inquiry and collates with the data stored in the PC of each system. The PC of each home system sends the collation result to the management server, and if there is a corresponding image, sends it to the management server. The PC of each home system that has inquired accesses the server at regular intervals, and receives the collation result from the PC of each home system if there is a collation result.

  For example, in a family, a grandfather (blind old man) wearing red clothes and an infant wearing blue clothes are missing. Then, from the PC of the home system to the PC of all the systems in the region (network), “What time and what is the red color? , What time and how many minutes are there? " Then, the PCs of all the systems in the region (network) search for images stored in the own system, and when there is a corresponding one, the images are sent to the PC of the system that issued the inquiry. When the functions of this system are executed, it is expected that it will take about a few minutes after a request is issued until an answer is returned. In a home system PC that searches for a grandfather, an inquiry is made and within a few minutes, many "images with red objects" are sent as search results. The search results include many misplaced images such as red cars, but when the searcher's family refers to the search results, he immediately finds a number of images showing the grandfather. We can expect to be able to. In addition, the time / location information of the photograph is attached to the photograph.

  In the fifth feature, in addition to the first to fourth features, a person or an object is registered as a search target in an image storage block of the computer of each home system from a computer of another system permitted in advance. When the surveillance camera captures a registered person or object, each home computer notifies the other system computer from the image storage block, and further records and transfers the image.

  When there is a search request such as searching for a person or object with a certain characteristic to see if he or she will pass near each home in the future, an inquiry is sent in advance from the PC to the management server based on the color of clothes. To do. Each home PC accesses the management server at regular intervals in order to confirm whether there is an inquiry from another home PC. When it is confirmed that there is an inquiry, each home PC receives the contents of the inquiry, and if a person or object having the characteristics relevant to the inquiry has moved to the image captured by each PC, the management server The image is transmitted to the inquired PC via. When the PC that has made the inquiry no longer needs such a search, the inquiry end is sent to the PC at each home via the management server.

  For example, let's say you have a grandfather (an elderly man) wearing red clothes going out for a walk in a family. If you can't take a walk, go to the management server in advance from your home PC to all the PCs in your area. Please contact us. " Then, when there are “red-colored” images to be copied in the future, all the PCs in the area send the images to the PC that issued the inquiry. This system makes it possible to grasp where the grandfather is in real time. A wide range of search conditions includes many misplaced items, such as red cars, but by narrowing down the search conditions, you can expect to find many images of your grandfather immediately. In addition, the time / location information of the photograph is attached to the photograph.

Embodiments according to the present invention have the above-described features, and are merely existing “individual (home) owns and manages information” or only “connects the information to the network”. Unlike the system, the novelty exists in that these two functions are combined under “conditions set individually by the individual (home)”. By using this combination, the following great effects can be expected.
First, ordinary citizens who already own and manage PCs that are already widely used in the country can introduce high-performance monitoring systems into their homes with a small additional investment.
Moreover, the crime prevention effect and the criminal identification effect increase synergistically as the number and density of the households introduced with this system increase.

In addition, since personal computers and cameras, which are the main components of the system, are owned and managed by individuals, and acquired images are also personal properties, privacy problems are unlikely to occur. Generally, in a monitoring system, a privacy problem is often a drag on the spread. It can be said that this system, which is designed to prevent the occurrence of privacy problems, has the property of being easily spread throughout the country and the whole world.
Furthermore, the connection conditions to the network are also such that each individual who is the owner / manager of the basic components and the images obtained thereby can be arbitrarily set in detail. This means that the problem can be completely avoided.

  Although the embodiment of the present invention has been described above, the monitoring information processing unit is preferably a computer owned by each home and individual, but may be a device provided with a dedicated processing unit. In addition, the present invention can be implemented in various other forms without departing from the spirit and main features thereof. Therefore, the above-described embodiment is merely an example and should not be interpreted in a limited manner. Further, all modifications and changes belonging to the equivalent scope of the claims are within the scope of the present invention.

It is a hardware block diagram of the monitoring system by this invention. FIG. 2A is a diagram illustrating an example of individual setting conditions, FIG. 2A is an operation according to a target of a setting example of operations permitted to other PCs, and FIG. FIG. It is a system outline explanatory drawing. It is a functional block diagram of an individual system. It is an image preservation | save block diagram which shows the system function at the time of an image preservation | save. It is an image request | requirement block diagram which shows the system function at the time of an image request | requirement. It is an image search block diagram which shows the system function at the time of an image search. It is a block diagram of the whole system. It is a flowchart which shows the basic operation | movement of a system. It is a flowchart which shows an example of an image preservation | save operation | movement. It is explanatory drawing of the transfer and preservation | save state of an acquired image. It is a bidirectional communication state explanatory drawing. It is a flowchart which shows the operation | movement corresponding to the search request | requirement of a stored image. It is a flowchart which shows the operation | movement corresponding to the search request | requirement of a stored image, and a search end process. It is communication state explanatory drawing via a mail server. It is a flowchart which shows the operation | movement corresponding to the search request | requirement of the stored image via a mail server. It is a flowchart which shows the operation | movement corresponding to the search request | requirement of the stored image via a mail server, and a search end process. It is communication state explanatory drawing via a management server. It is a flowchart which shows the operation | movement corresponding to the search request | requirement of the preservation | save image via a management server. It is a flowchart which shows the operation | movement corresponding to the search request | requirement of the preservation | save image via a management server, and a search end process. It is communication state explanatory drawing by management server program operation. FIG. It is a personal carrying state explanatory drawing of a system.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Monitoring information processing part (PC), 11 ... Sensor which takes in external information, such as a camera, Communication means (for example, networks, such as the internet) connected with other PC which performs 12 symbol information exchange

Claims (16)

Image capturing means for capturing a subject image in an individual monitoring area of the own system;
Image storage means for storing the subject image of the individual monitoring area imaged by the image imaging means in an image storage unit of the own system according to the condition setting of individual setting conditions;
By performing an image request for requesting a subject image in the individual monitoring area of the other system stored in the image storage unit of the other system via the network, the image transmitted from the other system of the image request destination via the network Image request means for receiving the subject image in the individual monitoring area of another system;
Whether or not to transmit an image as a result of image search individually set in the own system, whether or not to transmit the time of the image, whether or not to transmit the name of the image capturing means, and the number of images Determination means for determining whether the other system that requested the image is permitted as an image request source, based on an individual access condition including a setting condition that determines whether or not to transmit ,
In response to a request for a subject image in the individual monitoring area of the own system from the other system determined to be permitted as the image request source by the determination unit via a network, the image storage unit The subject system in the individual monitoring area stored in the image storage unit of the own system is searched, and the other system determined to be permitted as the image request source by the determination unit via the network , Image search means for transmitting search results according to setting conditions ;
Monitoring system with.   The image storage unit includes an image acquisition unit that acquires an image captured by the image capturing unit, an image change reference value storage unit that stores a reference value of a change in the image, and a change in the image that exceeds the reference value. An image change detection unit for detecting the presence of an image, a storage condition setting unit for setting the individual setting condition, and an image storage unit for storing the image according to the condition setting of the individual setting condition. Item 2. The monitoring system according to Item 1. The image storage unit includes a transfer target setting unit that presets a transfer target other than the image storage unit, and an image transfer storage unit that transfers and stores the image to the transfer target. Item 3. The monitoring system according to Item 2 . The image storage means is a search target registration unit for registering a search target from the other system permitted in advance, and the search target in which a change detection image by the image change detection unit is registered in the search target registration unit. A search target determination unit that determines whether or not
4. The system according to claim 3 , wherein the change detection image is notified to the other system when it is the search target, and the image to be searched is transferred to the other system and stored by the image transfer storage unit. The monitoring system described.   The image request means includes an image request target input unit that inputs one or more other systems that are image request destinations that request a subject image, and individual monitoring of the other system corresponding to the subject image requested by the other system. An image request target determining unit that determines whether or not the subject image of the area is stored is set, and one or a plurality of other systems determined by the image request target determining unit are set as image request destinations. A request target setting unit; and an image request transmission unit that transmits a request for the subject image to one or a plurality of other systems set by the request target setting unit via a network. The monitoring system according to claim 1. The image request means obtains any requested subject image from any other system based on the result of the request for the subject image previously made to one or a plurality of the other systems that are the image request destinations. An image request result determination unit for determining whether the image has been received, and a request target characteristic for storing characteristics for the requested subject image from the one or more other systems that are the image request destinations based on the determination result by the image request result determination unit A storage unit;
The image request target determination unit determines the image request destination based on characteristics of the requested image from the image request destination stored in the request target characteristic storage unit. 5. The monitoring system according to 5 .   2. The determination unit according to claim 1, wherein the determination unit is configured to determine whether the other system is permitted as the image request source without restriction or with restriction based on the individual access condition. Monitoring system. An image capturing step for capturing a subject image in an individual monitoring area of the own system;
An image storage step of storing the subject image of the individual monitoring area captured by the image capturing step in the image storage unit of the own system by setting the condition of the individual setting condition;
When requesting an image from another system, whether to transmit an image as a result of image search, which is individually set in the own system, whether to transmit the time of the image, and the name of the image capturing means And whether or not the other system that requested the image is permitted as an image request source based on an individual access condition including a setting condition that determines whether or not to transmit the number of images. A determination step;
The image storage step in response to a request for the subject image in the individual monitoring area of the own system from the other system determined to be permitted as the image request source in the determination step via the network By searching for the subject image in the individual monitoring area stored in the image storage unit of the own system, the other system determined to be permitted as the image request source in the determination step via the network An image search step for transmitting a search result according to the setting condition ;
At the time of an image request to the other system, by performing an image request for requesting the subject image in the individual monitoring area of the other system stored in the image storage unit of the other system via the network, An image requesting step of receiving the subject image of the individual monitoring area of the other system transmitted from the other system of the image request destination;
Including a monitoring control method. The image storage step includes a step of detecting that the image captured and acquired by the image capturing unit has a change equal to or larger than a reference value of the image change, and storing the image in the image storage unit according to the condition setting of the individual setting condition. The monitoring control method according to claim 8 , further comprising: The monitoring control method according to claim 9 , wherein the image storing step includes a step of setting a transfer target other than the image storage unit in advance, and transferring and storing the image to the transfer target. The image storing step registers a search target from the other system permitted in advance, determines whether the change detection image in which the image change is detected is the registered search target,
The monitoring according to claim 10 , further comprising: notifying the other system when the change detection image is the search target, and transferring and storing the image to be searched to the other system. Control method. In the image requesting step, when one or a plurality of the other systems which are image request destinations requesting the subject image are input, the other system subjects the subject in the individual monitoring area of the other system corresponding to the requested subject image. The image request destination is determined based on whether or not the image is stored in another system, and the determined one or more other systems are set as image request destinations, and the one or more of the above-described ones set via the network The monitoring control method according to claim 8 , wherein the subject image request is transmitted to another system. In the image requesting step, any requested subject image is obtained from any other system based on the result of the subject image request previously made to one or a plurality of the other systems that are the image request destinations. And stores characteristics of the requested subject image from the one or more other systems that are the image request destination from the determination result,
13. The monitoring control method according to claim 12 , wherein the image request destination is determined based on a characteristic of the requested subject image from the stored image request destination. 9. The monitoring control according to claim 8 , wherein the determining step determines whether or not the other system is permitted as the image request source without restriction or with restriction based on the individual access condition. Method. In order to control the subject image in the individual monitoring area captured by the image capturing unit that captures the subject image in the individual monitoring area of the own system,
On the computer,
A function of storing the subject image of the individual monitoring area captured by the image capturing unit in an image storage unit of the own system by setting a condition of an individual setting condition;
Sent from the other system of the image request destination via the network by making an image request for requesting the subject image of the individual monitoring area of the other system stored in the image storage unit of the other system via the network A function of receiving a subject image of the individual monitoring area of the other system;
Whether or not to transmit an image as a result of image search individually set in the own system, whether or not to transmit the time of the image, whether or not to transmit the name of the image capturing means, and the number of images A function for determining whether or not the other system that requested the image is permitted as an image request source based on an individual access condition including a setting condition that determines whether or not to transmit ,
Stored in the image storage unit of the own system in response to a request for the subject image in the individual monitoring area of the own system from the other system determined to be permitted as the image request source via the network A function of searching for a subject image in the individual monitoring area, and transmitting a search result to the other system determined to be permitted as the image request source via a network according to the setting condition ;
A supervisory control program to be executed. Image capturing means for capturing a subject image in an individual monitoring area, and image storage means for storing the subject image captured by the image capturing means in an image storage unit according to the condition setting of individual setting conditions, and each individually A plurality of monitoring systems in which access conditions can be set are network systems connected to each other via a network,
For each of the monitoring systems,
An image for receiving the subject image of the other system transmitted from the other system as the image request destination via the network by making an image request for requesting the subject image stored in the image storage unit of the other system. Request means;
Whether or not to transmit an image as a result of image search individually set in the own system, whether or not to transmit the time of the image, whether or not to transmit the name of the image capturing means, and the number of images Determination means for determining whether the other system that requested the image is permitted as an image request source, based on an individual access condition including a setting condition that determines whether or not to transmit ,
In response to a request for a subject image in the individual monitoring area of the own system from the other system determined to be permitted as the image request source by the determination unit via a network, the image storage unit The image of the subject in the individual monitoring area stored in the image storage unit of the own system is searched, and the other system determined to be permitted as the image request source by the determination unit via a network , Image search means for transmitting a search result according to the setting condition ;
Network system.

Images