JP6486744B2 - Regional monitoring server, providing terminal and system thereof - Google Patents

Description

  The present invention relates to a regional monitoring server, a providing terminal, and a system thereof.

  In recent years, with the widespread use of driving support devices, the number of vehicles equipped with image acquisition devices (cameras and videos such as drive recorders) and various sensors has been increasing. There is a system for monitoring a region by collecting videos taken by a vehicle equipped with an image acquisition device.

  For example, Patent Document 1 discloses a video collection system around an accident occurrence location that collects more video at the time of occurrence of each traffic accident and improves the analysis accuracy of the cause of the accident. According to this video collection system, when a vehicle has an accident, the vehicle transmits the accident occurrence time, location, etc. to the information center. In response to this, the information center immediately notifies the other vehicle of the occurrence of the accident, and the other vehicle was photographed around the location of the accident at the time of the accident from the other vehicle that received the notification. The situation of the accident is acquired based on the video from the viewpoint of the vehicle other than the accident vehicle (other vehicle) as well as the video from the viewpoint of the accident vehicle that is the party that caused the accident. Can be analyzed.

  However, the video collection system described in Patent Document 1 aims to increase the accuracy of analysis of individual accidents, and does not cover the collection of video for the entire region. If we can efficiently collect and effectively use a large amount of video data (still images, videos) taken while the vehicle is running, it should be very useful as a “watching eye” for local crime prevention and disaster prevention. It is. In addition to vehicles, there are many means in the city that can acquire image data, such as mobile terminal cameras and security cameras owned by humans, so image data obtained from them can be used more effectively. It is.

JP 2012-098105 A

  In view of the above problems, an object of the present invention is to provide an area monitoring server, a providing terminal, and a system for collecting area image data and constructing a virtual monitoring network.

  In order to solve the above problems, the regional monitoring server, the providing terminal, and the system thereof according to the present invention provide the following solution.

  A regional monitoring server for acquiring regional image information and performing surveillance within the region, wherein a plurality of terminals providing the regional image information are connected, and the region is divided into a predetermined range from the terminal The image data is required by the attribute data receiving means for receiving the attribute data of the image information in the area, the determination means for determining whether the image data corresponding to the attribute data is necessary, and the determination means. The image data receiving means for requesting the image data to the terminal, receiving the image data from the terminal and storing the image data in the image information storage means, and storing the image data relating to the image data provision request in the image information storage Image data extracting means for extracting from the means.

  Further, the image processing apparatus further includes a predicting unit that predicts an important monitoring area that needs to be monitored based on a past incident occurrence history in the area, and the photographing is performed in the important monitoring area based on a result of the predicting unit. The image data is received from the terminal.

  Further, the determination means receives image data of an area where image data in the area is insufficient from the terminal.

  In addition, when an incident occurs in the area, the determination unit preferentially receives image data of the area and the surrounding area from the terminal.

  The attribute data includes at least a shooting date and a shooting position of the image data, and the determination unit is configured to determine that the attribute data is substantially the same shooting date and time based on the attribute data of the image information received from the terminal. When the same shooting position is indicated, it is determined that the image data is unnecessary.

  Further, the attribute data includes a moving direction of the terminal and / or a shooting direction of the image data, and the determination unit is configured even when the attribute data indicates the same shooting date and time and the same shooting position. If either the moving direction or the photographing direction of the image data is different, it is determined that the image data is necessary.

  The moving direction includes start point position information when the terminal enters the area and end point position information when the terminal leaves the area.

  The terminal includes an in-vehicle terminal of a vehicle traveling in the region, a portable terminal possessed by a person in the region, a monitoring camera installed in the region, and a terminal mounted on an unmanned aircraft flying in the region. It is characterized by including.

  In another aspect of the present invention, the providing terminal is connected to a regional monitoring server for monitoring in a region and provides photographed image information, the area information in the region and an image photographed in the region. Area information storage means for storing information, and attribute data transmission means for transmitting attribute data of the stored image information to the area monitoring server when moving from the first area to the second area in the area. And image data transmission means for transmitting the photographed image data to the regional monitoring server based on an image data transmission instruction from the regional monitoring server.

  In another aspect of the present invention, there is provided a regional monitoring system that acquires regional image information and performs security monitoring in the region, and a plurality of first terminals that provide the regional image information; The second terminal requesting provision, the first terminal, and the second terminal are connected via a network, and image information in an area obtained by dividing the area by a predetermined range from the first terminal. If the image data is determined to be necessary by the means for receiving the attribute data, the means for determining whether the image data corresponding to the attribute data is necessary, and the determining means, the image data Means for requesting the first terminal to receive and store from the first terminal, means for receiving the provision request for the image data from the second terminal, and the provision request for the image data Image data And to means for extracting from the means for storing the image information, and means for transmitting the image data the extracted to the second terminal, and local monitoring server having, characterized in that it comprises a.

  According to the present invention, it is possible to provide an area monitoring server, a providing terminal, and a system for collecting area image data and constructing a virtual monitoring network.

It is an image figure showing a surveillance network of a regional surveillance system concerning an embodiment of the invention. It is the schematic of the flow of a process at the time of incident occurrence of the regional monitoring system which concerns on embodiment of this invention. It is a figure for demonstrating the selection method of required image data. It is a functional block diagram which shows the structure of the regional monitoring system which concerns on embodiment of this invention. It is a functional block diagram which shows the structure of the provision terminal which concerns on embodiment of this invention. It is a figure which shows an example of the data structure of the database memorize | stored in the memory | storage means of FIG. It is a flowchart which shows the processing operation of the provision terminal of FIG. It is the figure which showed the process of the area monitoring server of FIG. It is a flowchart which shows the processing operation of a regional monitoring server. It is a figure which shows an example of the screen displayed on the request | requirement terminal which acquired the image data at the time of incident occurrence.

  DESCRIPTION OF EMBODIMENTS Hereinafter, a mode for carrying out the present invention (hereinafter referred to as this embodiment) will be described in detail with reference to the accompanying drawings. In addition, the same number or code | symbol is attached | subjected to the same element through the whole description of embodiment.

  FIG. 1 is an image diagram showing a monitoring network of the regional monitoring system according to the present embodiment. FIG. 2 is a schematic diagram of a processing flow when an “incident” occurs in the regional monitoring system according to the embodiment of the present invention. Hereinafter, the above system will be referred to as “the present system”. Here, “incident” refers to, for example, an accident during traveling of a vehicle, information on a suspicious person in the area, a disaster, and the like, and includes events, situations, incidents and crises that may lead to an accident.

  This system provides image data when an incident occurs in a region by integrating various sensors and cameras with different performance and functions that are distributed throughout the region and building a virtual monitoring network. System.

  As shown in FIG. 1, there are various “monitoring eyes” (imaging means) that can acquire images and other information of the area in the area. For example, a camera on an in-vehicle device installed in a vehicle (passenger car, truck, bus, taxi, personal mobility, motorcycle, bicycle, etc.) traveling in a region, a mobile terminal (smartphone, tablet, etc.) possessed by a person moving in the region And fixed surveillance cameras installed in the area. In the near future, it is expected that unmanned aircraft called drones will fly around the city, and the cameras mounted on the drone will be added to the “surveillance eyes”.

By keeping a close eye on such surveillance, video pickup in the event of an accident (realization of quick initial action, prevention of hit and escape, analysis of the cause of the accident, etc.), discovery of a suspicious person (suspicious person in the area) , Tracking ahead, capturing suspicious individuals, etc.), and using in scenes such as summarizing the damage (such as understanding fires) during disasters (disasters that occur simultaneously in a wide area such as the earthquake) . However, it is necessary to consider the following background and issues.
-With the widespread use of driving support devices, the number of vehicles equipped with image acquisition devices (cameras and videos) and sensors is increasing.
-A large amount of image data is acquired for each vehicle, and by using the data of vehicles running in the entire city, various information of the entire city (area) is expected to be used.
-A mechanism for efficiently sharing information throughout is necessary.
-The data volume to be used is large and wireless communication such as a cellular phone network is not supported (moving images etc. in real time cannot be sent from the traveling vehicle to the network).
・ Necessary data cannot be judged (mainly selected) for individual vehicles that do not grasp the whole.

  Hereinafter, a camera equipped with a communication function and a terminal equipped with a camera and capable of providing (sending) image data to the outside are collectively referred to as a “providing terminal” (first terminal) for image data. . Needless to say, the image data includes still images and moving images. By using the image data from the viewpoint of these cameras, this system can collect regional image data from various angles, and by integrating them two-dimensionally and vertically, when an incident occurs Provide services that faithfully reproduce the situation.

  Here, a method for setting the monitoring target area provided by the service will be described. This system divides the service target area into a predetermined range (n × m) area (for example, 1 km square), and manages various information for each area. Of course, the entire area may be a single area. As shown in the lower part of FIG. 1, the area setting may be divided at equal intervals, or the prediction engine of this system determines the incident occurrence area and its incident according to the past incident occurrence information for each area. The periphery may be specified, and the area range may be variably set. For example, an area with a high incidence of incidents may be further subdivided, or an area with a low incidence of incidents may be integrated with a surrounding area. The area setting may be defined so that the boundary between the areas slightly overlaps because there is a possibility that the image cannot be collected near the boundary between the areas. The prediction engine can also determine the occurrence probability of an incident and predict a new incident.

  FIG. 2 is a schematic diagram of the processing flow of the present system when an incident occurs. Here, a vehicle equipped with an in-vehicle camera (camera for photographing outside the vehicle such as a drive recorder) will be described as an example of the providing terminal. First, as described above, the area monitoring server serving as the control center of the present system divides the area to be monitored in advance within a predetermined range, and transmits the divided area information (area boundary position) to each vehicle. In response to this, a vehicle traveling in the area passes through the point (target area end point) that has passed the area boundary (target area start point), that is, the first area in the area. When moving to the area 2, “attribute data” of image information (including at least the shooting date and time and the shooting position of the image data) is transmitted. In addition, the attribute data preferably transmits the moving direction of the vehicle and / or the shooting direction of the image data if it is a mobile terminal, a surveillance camera, or the like. Note that the moving direction includes start point position information when the vehicle enters the area and end point position information when the vehicle leaves the area. In the following, “image information” includes both image data (image itself) and attribute data (including at least shooting date / time and shooting location data, and other information associated with image data), When simply saying “image data”, attribute data is not included.

  When the attribute data is received from the vehicle, the regional monitoring server determines whether or not the image data corresponding to the attribute data provided from the plurality of providing terminals is image data necessary for monitoring. Specifically, the regional monitoring server specifies location information and time of the occurrence location when an incident occurs in the region. Subsequently, based on attribute data from a plurality of providing terminals received in advance, a vehicle that has been running near the place where the incident occurred is extracted. Then, the extracted vehicle is requested to transmit image data corresponding to the previously received attribute data.

  For example, as shown in FIG. 3, the regional monitoring server sets the range of the monitoring area. The area is set, for example, with a plurality of coordinate axes (latitude and longitude) as a range, and “target area start point” A and “target area end point” B are set. When the regional monitoring server needs image data between the incident occurrence times “10:02:31” to “10:05:13”, the incident occurrence time acquired from the providing terminal, and Then, image data corresponding to the shooting direction attribute data required for the points C to D and indicating the range of the incident occurrence location is extracted. The shooting direction includes information regarding the direction in which the camera of the providing terminal is facing (movement direction) and the viewing angle of the camera. Further, the moving direction is calculated from time-series latitude and longitude information.

  At this time, if there is image data at approximately the same date and time and approximately the same shooting position, the area monitoring server determines that it is not necessary in principle, and requests one selected vehicle without requesting duplicate image data. Only instruct to transfer the image data of the corresponding time zone. In this way, by avoiding the storage of duplicate image data, it is possible to effectively use the memory resources of the regional monitoring server and the providing terminal, and to reduce communication traffic related to transmission / reception of image data.

  On the other hand, the prediction engine of the regional monitoring server executes a statistical process for each area in the region or specifies a peripheral area where an incident occurrence is predicted by acquiring statistical data from the outside as a priority monitoring area. In the specified priority monitoring area, the priority of the image data taken from the providing terminal is increased and received. By controlling in this way, if an incident occurs in a region, communication traffic can be significantly reduced compared to receiving image data from all regions. It is possible to provide necessary image data smoothly.

  FIG. 4 is a functional block diagram showing the configuration of this system. As shown in FIG. 4, this system is a regional monitoring system for acquiring regional image information and performing security monitoring in the region, and provides a plurality of providing terminals 10 that provide regional image information (first A request terminal 20 (second terminal) for requesting provision of image information, and the providing terminal 10 and the request terminal 20 are connected to each other via a network.

  The external server 50 holds incident statistical information for each monitoring area, and if requested, provides the statistical information to the requesting regional monitoring server 30.

  The providing terminal 10 provides (transmits) regional image information to the regional monitoring server 30. For example, an in-vehicle terminal of a vehicle traveling in a region, a portable terminal possessed by a person in the region, a fixed surveillance camera for crime prevention installed in the region, and a terminal mounted on a drone are also included. When an incident occurs, an in-vehicle terminal, a portable terminal, a surveillance camera, and a drone may be linked. For example, a drone may identify vehicles in the vicinity of the incident occurrence location from the sky, and give instructions to adjust the position and angle for capturing images to those vehicles before receiving instructions from the server. Good. In addition, when a drone discovers a criminal, its vehicle, or a suspicious person, it notifies the server, alerts all around it, sounds a siren, flashes a light, You may make it inform.

  When an in-vehicle terminal is exemplified as the providing terminal 10, the regional monitoring server 30 acquires image data acquired from imaging means (camera or the like) installed in the vehicle and probe information obtained from a plurality of sensors or the like. The probe information generally includes, for example, position information by positioning means such as GPS (Global Positioning System), vehicle speed, acceleration, traffic congestion / congestion information estimated from the vehicle speed, weather information estimated from the movement of the wiper, It includes fuel consumption information calculated from the degree of depression of the brake, accelerator, etc., but may include data on surrounding road conditions acquired from an image capturing device (camera) / millimeter wave radar (millimeter wave scanner).

  As shown in FIG. 5, the providing terminal 10 typically includes a communication unit 11, an attribute data transmission unit 12, an image data transmission unit 13, a photographing unit 14, a regional information storage unit 15, and a control unit. 16. However, it is not limited to these structures.

  The communication unit 11 is a communication interface unit that performs wireless communication with the regional monitoring server 30.

  Based on the area information acquired from the regional monitoring server 30 stored in the regional information storage unit 15, the attribute data transmission unit 12 takes a picture within the area at a point that enters and exits the area. Among the image information, at least the shooting date and time and the shooting position of the image data are transmitted to the regional monitoring server 30 as attribute data of the image data. The image data itself is not transmitted. If the image data is a moving image, the shooting date / time and shooting location data are transmitted at regular intervals. In the case of a moving image, if at least one piece of time and place information desired by the requesting terminal 20 is included, the entire moving image or a part of the image data is transmitted. The attribute data preferably includes the moving direction and the shooting direction of the vehicle if it is a vehicle, and includes the shooting direction of the camera if it is a camera of a mobile terminal or a fixed camera for crime prevention.

  When receiving an image data transfer instruction from the regional monitoring server 30, the image data transmitting unit 13 transmits image data captured at the corresponding place and time to the regional monitoring server 30. The photographing means 14 is a camera that photographs the surrounding situation while traveling and stopping.

  The control means 16 plays a role of controlling the entire functional blocks 11 to 14 described above. The area information storage unit 15 stores area information obtained by dividing the area acquired from the area monitoring server 30 within a predetermined range and image information captured by the imaging unit 14.

  Returning to the description of FIG. The request terminal 20 requests the regional monitoring server 30 to provide image data when an incident occurs. Here, the request terminal 20 is, for example, a terminal of a public institution (police, Ministry of Land, Infrastructure, Transport and Tourism, municipal office, etc.), but is not limited thereto. When requesting image data, request side information such as the ID of the request terminal 20 may be transmitted to the server.

  The regional monitoring server 30 typically includes a communication unit 31, an attribute data reception unit 32, an image data reception unit 33, an image processing unit 34, a monitoring area generation unit 35, a determination unit 36, and image data. The provision request receiving unit 37, the image data extracting unit 38, the image data transmitting unit 39, the prediction unit 40, the control unit 41, and the storage unit 42 are provided. However, it is not limited to these structures.

  The communication unit 31 is a communication interface unit that performs wireless communication with the plurality of providing terminals 10, the request terminal 20, and the external server 50 registered in the present system.

  The attribute data receiving unit 32 receives attribute data that is a shooting date and a shooting position included in the image information for each area from the providing terminal 10. Further, the moving direction of the providing terminal 10 and / or the shooting direction of the image data is received.

  The image data receiving unit 33 receives the image data from the providing terminal 10 when the determining unit 36 determines that the image data is necessary.

  The image processing unit 34 performs image processing on the image data received from the plurality of providing terminals 10. Specifically, in order to provide image data to the requesting terminal 20, processing for unifying the resolution of different image data for each providing terminal 10 and processing for converting to a panoramic image based on a plurality of image data are performed. The image processing technique is a known technique and will not be described in detail here.

  The monitoring area generation unit 35 divides the monitoring area within a predetermined range and generates a virtual area. For example, the monitoring area is divided into 4 × 4 equal 16 parts, and image data is collected for each divided area.

  The determination unit 36 determines whether image data corresponding to the attribute data is necessary. Specifically, based on the attribute data of image information received from a plurality of providing terminals 10, if the attribute data indicates substantially the same date and time and the same location, it is determined that the image information is duplicated, Duplicate image data is not received. The determination unit 36 further determines whether image data is necessary using the moving direction of the providing terminal and / or the shooting direction of the image data. That is, even if the image data has attribute data indicating almost the same date and time and almost the same location, different information may be obtained if either the moving direction or the shooting direction is different. Is determined.

  The determination unit 36 receives preferentially the image data of the area where the image data is insufficient from the providing terminal 10. Specifically, the determination means 36 is in a case where there is a shortage of image information of the place and time that occurred at the time of the incident occurrence, or there are few past incidents, but there is a small amount of vehicle traffic, and there is a steady lack of image data If there is an area, the transmission instruction of the image data of the area is transmitted to another providing terminal 10 (a mobile terminal possessed by a person in the area, a surveillance camera installed in the area (a fixed camera for crime prevention)). The corresponding image data is received.

  In addition, when an incident occurs in the area, the determination unit 36 preferentially receives the image data in the area and the surrounding area from the providing terminal 10. Specifically, when an incident occurs, reception of image information outside the area is temporarily suspended, and image data in the surrounding area is preferentially acquired.

  The image data provision request receiving unit 37 receives an image data provision request from the requesting terminal 20.

  The image data extraction unit 38 extracts image data related to the image data provision request from the image data received from the providing terminal 10. Specifically, when an image data provision request is received from the request terminal 20, the corresponding image data is extracted from the attribute data acquired in advance from the plurality of provision terminals 10 based on the corresponding incident occurrence location and date / time.

  The image data transmitting unit 39 transmits the extracted image data to the requesting terminal 20.

  The predicting means 40 obtains the incident occurrence rate from the past incident occurrence history, and specifies the priority monitoring area that needs to be focused in the area based on the incident occurrence rate. Based on the result, the image data taken in the priority monitoring area is preferentially received from the providing terminal 10. Specifically, the predicting means 40 collects incident statistical information for each area from the external server 50, calculates an incident occurrence rate, and identifies an area with a high incident occurrence rate as a priority monitoring area. In the area identified as the priority monitoring area, the prediction means 40 further subdivides and analyzes the area and predicts the occurrence location, time zone, etc. of the incident, and the determination means 36 determines whether the incident occurs before the occurrence of the incident. The providing terminal 10 issues an instruction to acquire image data taken. Alternatively, the occurrence of an incident may be prepared in advance by increasing the frequency of acquiring image data on a daily basis or increasing the priority of acquisition. Note that the prediction unit 40 may acquire the incident occurrence rate from the external server 50 without calculating the incident occurrence rate by itself.

  The control means 41 plays a role of controlling the entire functional blocks 31 to 40 described above. The storage means 42 stores an image information DB 100 (image information storage means) and a regional information DB 200.

  As shown in FIG. 6A, an example of the data structure of the image information DB 100 is at least “image information ID” and “shooting date and time” assigned for each piece of image information provided by the providing terminal 10. The data items of “location information”, “movement direction”, “imaging direction”, “imaging terminal ID”, and “image data” of the photographed providing terminal are registered.

  As shown in FIG. 6B, an example of the data structure of the area information DB 200 is generated at least for each area obtained by dividing the area in a predetermined range by the monitoring area generating unit 35. In addition, data items of coordinates “referred to as first to fourth coordinates” at the four corners of the east, west, south, and north indicating the range of the area are registered.

  The functions and configuration of the present system described above are merely examples, and one functional block (database and function processing unit) may be divided, or a plurality of functional blocks may be configured as one functional block. Each function processing unit reads a computer program stored in a storage device such as a ROM (Read Only Memory), flash memory, SSD (Solid State Drive), or hard disk by a CPU (Central Processing Unit) built in the device This is realized by a computer program executed by the CPU. That is, in each function processing unit, this computer program reads and writes necessary data such as a table from a database (DB; Data Base) stored in a storage device or a storage area on a memory, and may be related in some cases. This is realized by controlling hardware (for example, an input / output device, a display device, and a communication interface device). In addition, the database in the embodiment of the present invention may be a commercial database, but it simply means a collection of tables and files, and the internal structure of the database itself does not matter.

  FIG. 7 is a flowchart showing the processing operation of the providing terminal 10 in this system. It is assumed that the providing terminal 10 subscribing to the service has acquired the IP address of the destination area monitoring server 30 in advance at some timing. As shown in FIG. 7, the area information storage means 15 of the providing terminal 10 receives the updated area information when the area information generated by the area monitoring server 30 is updated (step S11 “YES”). Information is stored (step S12). The area information is updated whenever the area of the monitored area is changed. For example, when the priority monitoring area is set by the prediction means 40 of the regional monitoring server 30, the area range is narrowed.

  Next, the control means 16 determines whether or not the target area start point in the area has been reached and the end point of the area has been passed (out of the area) during traveling in the area (step S13). . When passing the corresponding area (step S13 “YES”), the attribute data transmitting unit 12 transmits the attribute data of the image information captured in the area to the regional monitoring server 30 (step S14). The attribute data may be transmitted to the server in real time depending on the size of the area and the number of vehicles assumed to travel in the area. On the other hand, if the corresponding area has not been passed yet (step S13 “NO”), the attribute data of the image information photographed in the area is transmitted to the area monitoring server 30 to the area monitoring server 30 after a predetermined time has elapsed. Good. Here, after a certain time has elapsed, for example, when there is a car that moves only within the area, or there is a user's home that owns the vehicle in the area, or from outside the area, about several hours within the area This is because there are cases where there is no opportunity to reach the boundary point of the area, such as a parked business vehicle, or it may take time.

  Subsequently, when an image data transmission instruction is received from the regional monitoring server 30 (step S15 “YES”), the image data transmission unit 13 provides the image data to the user or the like who owns the providing terminal 10. Information for prompting presence / absence is transmitted (step S16). When the consent to provide the image data is received (step S16 “YES”), the image data transmitting unit 13 transmits the image data of the provided attribute data to the regional monitoring server 30 (step S17). Note that information on a requesting side that requests an image may be transmitted to the regional monitoring server 30. On the other hand, when there is no image data transmission instruction from the regional monitoring server 30 (step S16 “NO”), the regional information storage means 15 stores the image information for a certain period of time (step S18). When a certain period has elapsed (step S19 “YES”), the area information storage unit 15 deletes the corresponding image information (step S20). The image data may be deleted when a certain capacity is reached according to the capacity of a storage device such as a hard disk mounted on the providing terminal 10. The image information stored in the providing terminal 10 is basically deleted (overwritten) in order from the oldest when the capacity of the storage means becomes full. Because there is a risk that the necessary image data will be deleted because there is a risk that the necessary image data will be deleted, the vehicle that has not sent the attribute data for a certain period of time will voluntarily send the attribute data to the server. It is desirable to delete the stored image information after confirming that there is no request.

  Next, the process of the area monitoring server 30 will be described. As shown in FIG. 8, the regional monitoring server 30 includes an area information setting process, an area information transmission process, an incident information collection process, a priority monitoring area specifying process, an image information receiving process from the providing terminal 10, a request It has a function of image data request acceptance processing from the terminal 20. Each process is executed in parallel and independently as a multitask.

  In the area information setting process, the monitoring area generating unit 35 divides the area in a predetermined range and sets the area to be monitored. The area to be monitored may be divided into n × m areas at equal intervals, or an area with a high incident occurrence rate such as the priority monitoring area specified by the prediction means 40 may be set narrower. Also good.

  In the area information transmission process, the control unit 41 transmits the area information set by the monitoring area generation unit 35 to each providing terminal 10.

  In the incident information collection process, the prediction unit 40 collects incident information from the external server 50 for each area.

  In the priority monitoring area specifying process, as described above, the prediction means 40 calculates the incidence rate of incidents for each set area based on the collected incident information, and sets the area with a high occurrence rate as the priority monitoring area. Identify. In the priority monitoring area, the occurrence location and time zone of the incident are predicted, and the frequency of information collection for that purpose is increased.

  The image information receiving process will be described in detail with reference to FIG. As shown in FIG. 9A, the attribute data receiving unit 32 receives the monitoring area attribute data from the providing terminal 10 (step S21). In response, the determination unit 36 determines whether the image data is necessary based on the received attribute data (step S22). Specifically, based on the attribute data received from a plurality of providing terminals 10, it is determined whether or not there is a photographing position and photographing time that are substantially the same, and duplicate information is not received.

  If it is determined that the image data is necessary ("YES" in step S22), the image data receiving means 33 transmits an image data acquisition request to the providing terminal 10 holding the corresponding image data (step S23). Then, the image data is received from the providing terminal 10 that has received this acquisition request (step S24), and stored in the image information DB 100 (step S25).

  Next, the image data request acceptance process will be described in detail with reference to FIG. When the image data provision request receiving unit 37 receives the image data provision request from the requesting terminal 20 (step S31 “YES”), the image data extracting unit 38 extracts the image data of the monitoring area at the corresponding date and time from the image information DB 100. (Step S32). In response to this, the image processing means 34 performs image processing on the extracted plurality of image data (step S33). Note that the image processing executed here refers to processing for unifying a plurality of pieces of image data having different resolutions and processing for converting a panoramic image based on a plurality of pieces of image data. Then, the image data transmitting means 39 transmits the image data subjected to the image processing to the requesting terminal 20 (Step S34).

  For example, as illustrated in FIG. 10, image data that has been subjected to image processing acquired from a plurality of providing terminals 10 is displayed on the display screen of the request terminal 20. In this description, the image data of the time requested by the requesting terminal is displayed for each providing terminal, and by selecting the providing terminal, an image captured by the providing terminal is displayed large. In addition, a time setting field is displayed so that image data before and after the requested time can be viewed. In this way, it is possible to browse image data before and after the requested time. Further, by selecting a screen providing terminal, a photographing terminal ID for each providing terminal is displayed. For example, if the drone, the operator of the portable terminal A, the vehicle B, etc. are shown in the image taken by the vehicle A, it is possible to determine whether or not there is another providing terminal. By verifying each other, the validity of the image data can be claimed. By using the image data acquired from a plurality of providing terminals in this way, the request terminal 20 side can browse the image data of the field from various angles at the time of the incident occurrence. Field verification is possible.

(Effect of embodiment)
As described above, according to the area monitoring server 30 according to the present embodiment, when attribute data of image information in an area obtained by dividing an area by a predetermined range is received from the providing terminal 10, the attribute data corresponds to the attribute data. It is determined whether image data is necessary for monitoring. If image data is necessary, an instruction to transmit the image data is issued and received from the providing terminal 10. When the image data provision request is received from the request terminal 20, the image data related to the image data provision request is extracted from the image data received from the provision terminal 10, and the extracted image data is transmitted to the request terminal 20. In this way, only the image data necessary for regional security monitoring is acquired, and by avoiding the storage of duplicate image data, the memory resources of the regional monitoring server 30 and the providing terminal 10 are effectively utilized, Communication traffic related to transmission / reception of image data can be reduced.

  Further, the regional monitoring server 30 predicts a critical monitoring area that needs to be focused in the region, and based on the result, receives image data taken in the critical monitoring area from the providing terminal 10, Screen data can be provided promptly when an incident occurs.

  Further, the regional monitoring server 30 always compensates for the shortage of image data by preferentially receiving the image data of the region where the image data in the region is insufficient from the providing terminal. It is possible to provide image data even in an area with a small amount of traffic.

  In addition, when an incident occurs in a certain area, the regional monitoring server 30 preferentially receives the image data in the area and the surrounding area from the providing terminal, thereby reducing the processing time of receiving the image data, Image data can be provided quickly.

  Further, the attribute data includes at least the shooting date and time and the shooting position of the image data, and preferably includes the moving direction of the providing terminal and / or the shooting direction of the image data. By determining whether image data is necessary by using the direction and / or the shooting direction of the image data, it is possible to acquire image data in various shooting directions while avoiding acquiring duplicate image data. The situation at the time of incident occurrence can be grasped more accurately.

  In addition, the providing terminal 10 (first terminal) according to the present embodiment stores image information captured in the area, and when moving from the first area to the second area, the image data is transmitted to the area monitoring server. Send attribute data of. The providing terminal 10 then captures the captured image data based on an image data transmission instruction issued from the regional monitoring server 30 when the regional monitoring server 30 determines that image data corresponding to the attribute data is necessary. Send. As described above, the providing terminal 10 transmits the attribute data to the area monitoring server for each set section, thereby effectively using the memory resources of the area monitoring server 30 and the providing terminal 10, and communication related to transmission / reception of image data. Traffic can be reduced.

  In addition, although this system was made into incidents, such as an accident, a crime, and a disaster, as an area monitoring system, it can apply to the system which collects various image information of an area other than that. For example, in a system that collects and stores image information of local festivals and other events, image information of local landscapes and cityscapes at various positions, angles, time zones, seasons, etc. Application is possible.

  As mentioned above, although this invention was demonstrated using embodiment, it cannot be overemphasized that the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above embodiment. Further, it is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

10 Providing terminal (first terminal)
DESCRIPTION OF SYMBOLS 11 Communication means 12 Attribute data transmission means 13 Image data transmission means 14 Imaging means 15 Area information storage means 16 Control means 20 Request terminal (second terminal)
DESCRIPTION OF SYMBOLS 30 Area monitoring server 31 Communication means 32 Attribute data receiving means 33 Image data receiving means 34 Image processing means 35 Monitoring area generation means 36 Determination means 37 Image data provision request receiving means 38 Image data extracting means 39 Image data transmitting means 40 Predicting means 41 Control means 42 Storage means 50 External server 100 Image information DB
200 Regional Information DB

Claims (10)

A regional monitoring server for carrying out the land within the region of monitoring,
Is connected to a plurality of terminals for providing image information of said areas,
Attribute data receiving means for receiving, from the terminal, attribute data of image information in an area obtained by dividing the area by a predetermined range;
A predicting means for obtaining an incident occurrence rate from a past incident occurrence history in the region, and predicting an important monitoring area that requires monitoring based on the incident occurrence rate;
Determination means for determining whether image data corresponding to the attribute data is necessary;
When the determination means determines that the image data is necessary, the image data reception means requests the image data from the terminal, receives the image data from the terminal, and stores the image data in the image information storage means;
Image data extraction means for extracting from the image information storage means image data related to the provision request of the image data ,
The determination means determines that the image data photographed in the priority monitoring area predicted by the prediction means is necessary,
The image data receiving means is a regional monitoring server that receives the image data taken in the priority monitoring area from the terminal . A regional monitoring server for carrying out the land within the region of monitoring,
Is connected to a plurality of terminals for providing image information of said areas,
From the terminal, and attribute data receiving means for receiving attribute data of the image information,
Determination means for determining whether image data corresponding to the attribute data is necessary;
When the determination means determines that the image data is necessary, the image data reception means requests the image data from the terminal, receives the image data from the terminal, and stores the image data in the image information storage means;
Image data extraction means for extracting from the image information storage means image data related to the provision request of the image data ,
The attribute data includes a shooting date and time of the image data, a shooting position of the image data, a shooting direction of the image data, and a moving direction of the terminal,
The determination means, when the shooting date and time included in the attribute data includes an incident occurrence time, an image corresponding to the attribute data based on the shooting position, the shooting direction, and the moving direction included in the attribute data A regional monitoring server that determines whether data is needed . The area monitoring server according to claim 1 or 2, wherein when the image data in an area obtained by dividing the area by a predetermined range is insufficient, the determination unit determines that the image data of the area is necessary. . When the incident occurs in the area, the determination unit determines that the image data of the incident occurrence area and the surrounding area is necessary,
4. The regional monitoring server according to claim 1, wherein the image data receiving unit preferentially receives the image data of the incident occurrence area and the surrounding area from the terminal. 5. The attribute data includes photographing position of the photographing date and time and the image data of the image data,
The determination unit identifies the image data to which the photographing date and the photographing position are included in the plurality of the attribute data is duplicated, based on whether or not substantially the same, no need the image data overlapping the identified The regional monitoring server according to claim 1, wherein the regional monitoring server is determined as follows. The attribute data includes at least one of a shooting direction of the image data and a moving direction of the terminal,
Even if the shooting date and time and the shooting position included in a plurality of the attribute data are substantially the same , the determination unit is configured so that if at least one of the shooting direction and the moving direction is different, the plurality of the attribute data regional monitoring server according to claim 5 you determination require a plurality of the image data corresponding to each. The moving direction, regional monitoring server according the starting point position information, in claim 6 ing from the end position information when exiting from the area at which the terminal has entered the area. The terminal includes an in-vehicle terminal of a vehicle traveling in the region, a portable terminal possessed by a person in the region, a monitoring camera installed in the region, and a terminal mounted on an unmanned aircraft flying in the region. The regional monitoring server according to claim 1 or 2 . A providing terminal which Ru is connected to the regional monitoring server for monitoring in the area,
Area information storage means for storing area information in the area and image information photographed by the photographing means in the area;
Attribute data transmission means for transmitting attribute data of the image information stored in the area information storage means to the area monitoring server when the photographing means moves from the first area to the second area in the area. When,
Image data transmission means for transmitting the image data of the image information stored in the area information storage means to the area monitoring server based on an image data transmission instruction from the area monitoring server ;
The providing terminal includes a shooting date and time of the image data, a shooting position of the image data, a shooting direction of the image data, and a moving direction of the shooting unit . A regional monitoring system to carry out the land within the region of security monitoring,
A plurality of first terminals providing image information of the area;
A second terminal connected to the first terminal via a network and requesting image data of the image information;
Including
Means for receiving the attribute data of the image information from said first terminal,
Means for determining whether image data corresponding to the attribute data is necessary;
Means for requesting the image data from the first terminal, receiving the image data from the first terminal and storing it in the image information storage means when the determining means determines that the image data is necessary; ,
Means for receiving the image data provision request from the second terminal;
Means for extracting image data relating to the provision request of the image data from the image information storage means ;
A regional monitoring server comprising: means for transmitting the image data extracted from the image information storage means to the second terminal ;
The attribute data includes a shooting date and time of the image data, a shooting position of the image data, a shooting direction of the image data, and a moving direction of the first terminal,
The determination means corresponds to the attribute data based on the shooting position, the shooting direction, and the moving direction included in the attribute data when the shooting date and time included in the attribute data includes an incident occurrence time. A regional monitoring system that determines whether image data is required .

Images