JP2018107587A - Monitoring system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To cope with necessity of managing image processing calculation of images from a plurality of imaging apparatuses by a system, and outputting an optimum image processing result with limited system resources.SOLUTION: A monitoring system comprises: (a) an imaging apparatus including an image transmission unit for transmitting a picked-up image, a request reception unit for receiving a request, a motor control unit for applying the request in an imaging apparatus direction, and a field angle control unit for applying the request to an imaging apparatus field angle; and (b) a server device including an image processing calculation unit for performing calculation using images from the imaging apparatus, a database unit for storing a calculation result of the image processing calculation unit, a system operation support unit for spatially and temporally analyzing the calculation result stored in the database, and a request transmission unit for transmitting the request to the imaging apparatus on the basis of an analysis result of the system operation support unit.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to a monitoring system.

  Conventionally, video surveillance systems have been installed in facilities visited by an unspecified number of people such as large commercial facilities, event venues, airports, stations, and roads for the purpose of preventing accidents. This is because a person to be monitored is photographed by an imaging device such as a camera, and the video is transmitted to a monitoring center such as a management office or a security room, and the resident supervisor monitors it, and the purpose and necessity Depending on what you are careful with.

  Against this background, video surveillance systems having various functions for reducing the labor of the supervisor are becoming widespread. In particular, in recent years, video surveillance with advanced functions such as automatic detection of real-time occurrences of specific events in video using image processing technology, search for specific information stored in big data, etc. A system is emerging. In addition to pinpoint alerts, it is also beginning to be used for marketing and security staffing plans using stored data.

  The system has become more sophisticated year by year, but the image processing operations are becoming more complicated and the number of image pickup devices is also increasing. In supporting such a system, optimization of image processing calculation is an important issue.

Japanese Patent Laying-Open No. 2015-172850

It is necessary to manage the image processing operations from multiple imaging devices by the system and to output the optimal image processing results even with limited system resources due to the development and improvement of image processing technology and the dramatic evolution of imaging device resolution. Sex came out.
Other problems and novel features will become apparent from the description of the specification and the accompanying drawings.

The outline of a representative one of the present disclosure will be briefly described as follows.
That is, the monitoring system includes: (a) an image transmission unit that transmits a captured image; a request reception unit that receives a request; a motor control unit that applies the request in the direction of the imaging device; An angle-of-view control unit for application to an angle of view; an imaging device having the angle; an image processing calculation unit that performs an operation using an image from the imaging device; and an operation result of the image processing unit is accumulated. A database unit, a system operation support unit that spatially and temporally analyzes the calculation result stored in the database, and a request transmission unit that transmits the request to the imaging device based on the analysis result of the system operation support unit And a server device.

  According to the monitoring system, image processing can be performed efficiently.

It is a block diagram which shows the structure of the monitoring system which concerns on an Example. It is a flowchart for demonstrating operation | movement of the monitoring system which concerns on an Example. It is a flowchart for demonstrating operation | movement of the monitoring system which concerns on an Example. It is a figure explaining the optimal operation image for improving the event generation opportunity by image processing about the monitoring system which concerns on an Example. It is a flowchart for demonstrating operation | movement of the terminal device which concerns on an Example. It is a figure for demonstrating the coordinate matching screen of the terminal device which concerns on an Example. It is a figure for demonstrating the area map adjustment part and 3D process part of the terminal device which concern on an Example. It is a figure of the coordinate matching screen for demonstrating provision of the measurement point and rectangle of the terminal device which concerns on an Example. It is a figure for demonstrating the drawing on the measurement point and rectangular plane area of the terminal device which concerns on an Example, FIG. 8 (A) is a solid area map, FIG.8 (B) is a plane area map, FIG.8 (C) is FIG. Floor projection. It is a figure for demonstrating the geometric calculation concept of the coordinate matching between the camera image of the terminal device which concerns on an Example, and an area map, FIG. 9 (A) is a camera image, FIG.9 (B) is a floor projection. .

  The monitoring system according to the embodiment spatially captures the image processing information obtained from the imaging device and analyzes it on the time axis, that is, the result of the calculation performed by the plurality of image processing from the monitoring camera or the like. -By integrating the use of both aspects of time, the image processing efficiency in the surveillance system and the operation of each camera will be optimized.

  The monitoring system according to the embodiment includes an imaging device, a terminal device, and a server device. A software application is installed in the terminal device, and is operated by an external input device such as a keyboard / mouse and displayed on an external output device such as a display. The imaging device includes a camera that can receive a control command. The screen operation detection unit handles the exchange between the terminal device and the external input device. The server device manages the monitoring system.

  The imaging device includes an image transmission unit that transmits the captured video, a request reception unit that receives a request from the server device, a motor control unit that applies the requested content in the direction of the imaging device, and applies the requested content to the angle of view of the imaging device An angle-of-view control unit.

  The application of the terminal device is roughly divided into two functions, one is a function to visually grasp event occurrence information from the imaging device on an area map that represents the imaging target space as electronic map data, and the other is This is a function for visually grasping frequency information of occurrence events in each imaging device / area.

  The server device includes an image receiving unit that receives a video from the imaging device, an image processing calculation unit that performs an operation using the image, a relationship between the coordinates in the screen of the imaging device and the coordinates in the area map, and an image processing calculation result A database unit that stores data, a database management unit that manages the database, a system operation support unit that analyzes the database and optimally operates the video surveillance system, a request transmission unit that sends a request to the imaging device based on the result, and a monitoring system configuration A system integrated management unit that integrates and manages element settings and the like is provided.

  According to the embodiment, each feature is analyzed in an integrated manner from a plurality of types of image analysis, and even in a system with an insufficient number of cameras, camera operation that is much more effective than manual operation is possible. Furthermore, by performing analysis on the time axis, it is possible to change the contents of the image processing performed by the camera according to the time zone, and to perform optimal resource allocation. For example, considering the aspect of installed image processing, all the imaging devices in the system are all installed by applying entrance / exit detection processing to the entrance of a building, congestion judgment processing to a narrow passage, etc. Since the image processing is not performed and the integrated processing is not performed, system constraints can be reduced. Also, since the arrangement is not simply determined by human know-how, the loss of opportunity can be reduced and the monitoring system can be optimally operated.

  In the embodiment, a specific person detection (for example, JP 2012-124658 A (reference document 1)), a specific object search (for example, JP 2015-032133 (reference document 2)), and other image processing detection / When the search system is combined with this monitoring system, the number of people, objects, and actions in the field of view increases due to spatial and temporal analysis of the event occurrence frequency, and the camera is operated with fixed camera angle of view and functions. More effective operation becomes possible. This not only reduces the number of installed cameras and the monitoring effort, but also increases the system utilization opportunities and improves the event detection rate.

  In addition, it is desirable to use the embodiment in a situation where 3D area information and camera information are integrated and managed.

  Examples will be described below with reference to the drawings. However, in the following description, the same components may be denoted by the same reference numerals and repeated description may be omitted.

  First, the configuration of the monitoring system according to the embodiment will be described with reference to FIG. The monitoring system is configured such that an imaging device 101, a server device 201, and a terminal device 301 are connected to a network 100 and can communicate with each other. The network 100 is a communication unit that performs communication by connecting devices to each other, such as a dedicated network for data communication, an intranet, the Internet, and a wireless local area network (LAN). Furthermore, an external input device 401 and an external output device 402 are connected to the terminal device 301. A plurality of devices can be connected to each of the imaging device 101, the server device 201, and the terminal device 301.

  The imaging apparatus 101 includes an image transmission unit 102, a request reception unit 103, an angle of view control unit 104, and a motor control unit 105, and captures an object with an imaging unit such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) element. Then, the image capturing apparatus is a device such as a network camera or a monitoring camera that performs digital conversion processing on the captured image and outputs the converted image data to the recording device via the network 100.

  The image transmission unit 102 is a processing unit that outputs captured image data to the outside of the apparatus. The request receiving unit 103 is a processing unit that receives a request command from the outside of the apparatus, decodes the content, and transmits it to each processing unit in the apparatus. The angle-of-view control unit 104 is a processing unit that changes and applies the angle of view (pan / tilt / fisheye camera plane / cut-out area after elevational expansion) as required. The motor control unit 105 is a processing unit that changes and applies the height and direction (yaw / pitch / roll) of the imaging device as required.

  The server apparatus 201 includes processing units such as an image receiving unit 202, a system operation support unit 203, a request transmission unit 204, a system integration management unit 205, an image processing calculation unit 206, a database unit 207, and a database management unit 208.

  The image receiving unit 202 is a processing unit that inputs an image from outside the apparatus, and receives input image data from the imaging apparatus 101 via the network 100, for example. The system operation support unit 203 spatially and temporally analyzes each image processing result from the database unit 207, and uses the information to determine the angle of view and the imaging device for each imaging device of the plurality of imaging devices 101 in the system. It is a processing unit that creates instruction processing contents for the direction and other parameters of the imaging apparatus. The request transmission unit 204 is a processing unit that transmits the command content generated by the system operation support unit 203 to the imaging apparatus. The system integrated management unit 205 is a management unit for setting elements of the entire system such as a network configuration and various process settings. The image processing calculation unit 206 is a part that performs various image processing calculations on the received image. The database unit 207 is a part that stores (stores) image data and image processing calculation results in association (position) with position information and time information. The database management unit 208 is a processing unit that performs data input / output management between the database unit 207 and the terminal device 301.

  For example, an application implemented as client software on the terminal device 301 includes an area map display unit 302, a camera video display unit 305, an image reception unit 306, an image request unit 307, a calculation result request unit 308, a calculation result reception unit 309, and a calculation result. Each processing unit includes a display unit 310 and a screen operation detection unit 312.

  The area map display unit 302 is a processing unit that displays an area map read from the database unit 207 on a GUI (Graphical User Interface) application. The camera video display unit 305 is a processing unit that displays the image received by the image receiving unit 306 on the GUI application. The image receiving unit 306 is a processing unit having the same type of function as the image receiving unit 202 of the server device 201, and is a processing unit that inputs an image from the imaging device 101 or the like via the network 100. The image request unit 307 is a processing unit that requests image output to the outside of the apparatus, and requests image data from the imaging apparatus 101. The calculation result request unit 308 specifies a predetermined condition (location, time, etc., which can be specified continuously or intermittently with a width) to the database management unit 208 via the network 100 and performs a predetermined search. A processing unit that makes a request. The calculation result receiving unit 309 is a processing unit that acquires a calculation result corresponding to the request from the database unit 207. The calculation result display unit 310 is a processing unit that graphically displays the acquired calculation result on the GUI application. It is possible to perform layer management for the obtained plural types of calculation results. The screen operation detection unit 312 is a processing unit that receives an operation by the external input device 401.

  The external input device 401 is composed of a keyboard, a pointing device (mouse), and the like. The external output device 402 includes a display or the like.

  The server device 201 and the terminal device 301 may be realized by a general PC (personal computer) having a network function, or may be a dedicated high-performance terminal. In this configuration, load processing that requires constant driving and high load processing is distributed to the server device 201 and functions that require graphical elements are distributed to the terminal device 301. However, the configuration is not limited to this, and the configuration is realized in the same device. Also good.

  Next, the operation flow of the monitoring system will be described with reference to FIGS. 2A and 2B. FIG. 2A is a flowchart for explaining the operation of the monitoring system according to the embodiment. FIG. 2B is a flowchart of portions A and B of FIG. 2A.

  Step S10: Connect various devices before starting operation.

  Step S21: First, the server apparatus 201 sets, as initial settings, network configuration, various process settings, association information between camera positions and area maps, and the like in the system integration management unit 205. The association between the camera position and the area map will be described later.

  Next, the operation during actual operation will be described.

  Step S11: First, the imaging apparatus 101 transmits the image data 106 captured by the imaging unit from the image transmission unit 102 to the image reception unit 202 of the server apparatus 201 via the network 100.

  Step S22: The image receiving unit 202 of the server apparatus 201 receives the image data 106 captured by the imaging unit of the imaging apparatus 101.

  Step S <b> 23: The image processing calculation unit 206 performs a predetermined image processing calculation on the image data 106 received by the image receiving unit 202 and analyzes it, and outputs a calculation result (analysis result) to the database unit 207.

  Step S24: The database unit 207 stores (stores) the calculation result in association with the image data 106. Here, a plurality of image processing calculation units 206 are prepared for each image type, and all calculation results are collected in the database unit 207.

  The server apparatus 201 repeats this process, and accumulates the in-area position information (A), the measurement time (T), the image processing type (K), and the image processing calculation value (V) in the database unit 207. Here, in-area position information (A) assumes various cases such as point information that can be expressed in XYZ space coordinates, surface information that can be expressed by a combination of coordinate points, and vector data information combined with angle information.

  Step S25: The system operation support unit 203 performs an optimal operation calculation for each imaging apparatus, which performs an integrated calculation process on the image processing result that is the database information of the database unit 207 from the spatial information and the time information. A specific example will be described below.

As specific functions of image processing types, the following functions are implemented in the monitoring system.
(1) Face detection: A face area of a person is detected as rectangular information from within the angle of view of the imaging device.
(2) Specific person detection: A person who matches the person registered in advance in the apparatus is detected from within the angle of view of the imaging apparatus. (Reference 1)
(3) Stay detection: The degree of stay of an object is detected from each point within the imaging angle of view.
(4) Human flow detection: detecting the degree and vector of the flow rate of an object within the shooting angle of view.
(5) Abandoned object detection: Detects an object left in the shooting angle of view.
(6) Specific action detection: Detects a specific action such as a person falling or fighting from within the shooting angle of view.

  Among these, “face detection (1)”, “stagnation detection (3)”, “human flow detection (4)” are basic image processing, and “specific person face detection (2)” “leaving” is left on the information. There is a relation that applied image processing such as object detection (5) and specific action detection (6) is established. The operational flow is as follows.

  Step S26: The server device 201 feeds back the processing result from the applied image processing to the system operation support unit 203. Feedback information such as optimal angle-of-view information is sent to the imaging apparatus 101 via the request transmission unit 204 as a request (209).

  Step S12: The request receiving unit 103 of the imaging apparatus 101 determines whether there is a request (209) from the server apparatus 201. If yes, then continue with step S13, otherwise return to step S11.

  Step S13: The imaging apparatus 101 decodes the request content at the request receiving unit 103.

  Step S14: The imaging apparatus 101 further transmits a request regarding the physical position of the imaging apparatus to the motor control unit 105 and a request regarding the angle of view and video setting to the angle of view control unit 104. Each processing unit of the control unit 104 controls the imaging apparatus 101. As a result, the operation of the imaging apparatus 101 is optimized, thereby increasing the number of event detection opportunities for basic image processing and further increasing the number of event detection opportunities for applied image processing.

  As a specific situation, for example, as shown in FIG. 3, a plurality of pan-tilt-zoom compatible imaging devices 101a and fish-eye imaging devices 101b are installed in a building targeted by the system. On weekdays, there are many people flowing from the building entrance to the center of the building during the morning hours, there are few people in the daytime, and people from the center of the building toward the building entrance during the evening hours. There is a lot of flow. It is assumed that there is a characteristic that there is always little traffic on holidays.

  The above features are often unknown at the start of system operation. In addition, there is information that cannot be understood unless it is operated for a long time.

By starting system operation in this situation, frequent occurrence points of events by each image processing from basic image processing such as “face detection (1)”, “stay detection (3)”, “human flow detection (4)” I understand. Based on the analysis results, the following (a) to (d) can be used to increase the detection opportunities.
(A) The angle of view of the surrounding imaging device 101a is directed to an area where the frequency of stay detection (3) is high.
(B) The imaging apparatus 101a in the target area is operated at a high resolution such as 4K or 8K.
(C) Human flow detection The angle of view of the imaging device 101a is adjusted to the direction of the human flow vector detected by (4). This increases the opportunities for face detection (1).
(D) The developed view angle of the picked-up image of the fish-eye image pickup device 101b is developed on a flat surface during normal operation, and is operated with the stay detection (3) where the flat view angle (view angle looking down from the ceiling) is suitable. In the time zone / location where the occurrence frequency of the human flow detection (4) is suitable, the image processing is performed on the elevation.

Furthermore, the following (e) to (g) can be operated by temporal analysis, which leads to distribution of processing load and reduction of operation costs.
(E) Rotating the angle of view of the image pickup apparatus 101a in the direction of the person flow in the morning and evening (f) In the morning and evening on a weekday when the flow density is high, the resolution of the surrounding image pickup apparatus 101a is increased particularly in a high-density area. Minimize the operation of the imaging device during low-density holidays and daytime (the whole is covered with the fish-eye imaging device 101b)
As a result, it is expected that opportunities for detection of applied image processing such as “specific human face detection (2)”, “left object detection (5)”, and “specific behavior detection (6)” will increase. By feeding back to the system operation support unit 203 the points and time zones where each detection event occurred frequently, changing the imaging device angle of view to focus on those points further increases the chances of detection of applied image processing. I can also expect that.

  Hereinafter, operations during actual operation between the server apparatus 201 and the terminal apparatus 301 will be described with reference to FIGS. 2A and 2B.

  Step S31: An example of an implementation method using an application installed in the terminal device 301 will be described below. It is assumed that camera installation coordinates are already registered in the area map display unit 302 on the GUI application. It is assumed that information in which each camera installation coordinate of the imaging apparatus 101 is associated with the camera IP address is stored in the database unit 207 of the server apparatus 201. When a camera coordinate point on the area map is clicked with a mouse click (camera image display requested), the corresponding camera image is displayed on the camera image display unit 305. As the mechanism, when the camera coordinate point is clicked, the calculation result request unit 308 of the terminal device 301 inquires of the database management unit 208 of the server device 201 about the camera IP address of the corresponding coordinate position, and stores the address stored in the database unit 207 as The result is returned to the operation result receiving unit 309 at 301.

  Step S32: The image request unit 307 requests image data (transmits an image request (303)) to the imaging device 101 having the IP address received by the calculation result receiving unit 309 via the network 100.

  Step S15: Upon receiving the image request (303), the request receiving unit 103 of the imaging apparatus 101 determines whether there is an image request (303) from the terminal device 301. If YES, the image data captured by the imaging unit of the imaging apparatus 101 is sent to the image transmission unit 102, and the process proceeds to step S16. If NO, the process returns to step S11.

  Step S <b> 16: The image transmission unit 102 transmits the image data (107) captured by the imaging unit of the imaging device 101 to the image reception unit 306 of the terminal device 301 via the network 100.

  Step S33: The image receiving unit 306 receives the image 107 transmitted from the image transmitting unit 102 of the imaging apparatus 101 (receives a captured image), and transmits it to the camera video display unit 305.

  Step S34: The camera video display unit 305 displays the image 107 on the display of the external output device 402 (camera image display). By repeating this, it becomes a continuous video (moving image).

  Step S35: Also, various image processing calculation results by the server device 201 can be superimposed and displayed on the area map. For this purpose, the terminal device 301 determines whether there is a calculation result request. If yes, then continue with step S36, if no, return to step S31 or step S35.

  Step S36: The calculation result request unit 308 transmits a calculation result request (304) designating specific conditions (location / time) to the database management unit 208 of the server apparatus 201.

  Step S27: The database management unit 208 determines whether or not there is a calculation result request from the terminal device 301. If yes, then continue with step S28, otherwise, return to step S28.

  Step S <b> 28: The database management unit 208 reads out the search result of the corresponding calculation result from the database unit 207 and returns it to the calculation result receiving unit 309 of the terminal device 301 (transmission of the calculation result).

  Step S37: When the calculation result (108) is received by the calculation result receiving unit 309, the terminal device 301 causes the calculation result display unit 310 to superimpose and display (calculation result display) on the area map using the result.

  There are two types of display: short-term display and long-term display. In the short-term display, event occurrence information up to several minutes before the current time is expressed on the area. When an event occurs, an icon is displayed, and by selecting the event, the imaging device 101 having a recording function is requested to play back an image of the corresponding time and can be played back. It can be used to activate personnel at event points.

  The long-term display is a function that displays the frequency information of each event that occurred during that period by narrowing down the period you want to display (both continuous and intermittent), and visually grasp the locations where events occur frequently. is there. Furthermore, each event is layer-managed, and the combination of superimposing on the area can be freely changed by on / off switching, which can be used for analysis. This can be used for a person arrangement plan in a building.

  Next, the correspondence between the measurement point and the rectangle between the camera image and the area map will be described with reference to FIGS. FIG. 4 is a flowchart for explaining the operation of the terminal device according to the embodiment. FIG. 5 is a diagram for explaining a coordinate association screen of the terminal device according to the embodiment.

  Step S311: The terminal device 301 activates an installed GUI application.

  Step S312: The area map 2302 is displayed on the coordinate association screen 4001 of FIG. The area map 2302 is composed of line segments, and height information is linked (associated) with each line segment and the coordinates in the map.

  Step S313: In FIG. 5, the terminal device 301 superimposes the camera icon 4020 on the camera coordinate point of the area map 2302, and clicks the camera icon 4020 with the mouse of the external input device 401, whereby the IP address of the imaging device 101 (camera IP Address).

  After acquiring the camera IP address, the terminal device 301 proceeds to a phase in which the measurement point within the camera angle of view and the rectangle are associated with the area map.

  Step S314: The terminal device 301 selects an associated camera in the area map 2302 (selects a measurement point / rectangular camera). Since the calculation result request unit 308 causes the camera video display unit 305 to display the camera video, the IP address of the imaging device 101 corresponding to the camera coordinate point detected by the screen operation detection unit 312 is requested to the database management unit 208 of the server device 201. To do. The database management unit 208 reads the IP address stored (stored) in the database unit 207 and returns it to the calculation result receiving unit 309 of the terminal device 301.

  Step S315: The image requesting unit 307 requests the image request (303) from the imaging apparatus 101 having the IP address received by the calculation result receiving unit 309 via the network 100.

  Step S316: Upon receiving the image request (303), the request receiving unit 103 of the imaging device 101 determines that there is an image request (303) from the terminal device 301 (S15), and the image data captured by the imaging unit of the imaging device 101 is obtained. The image is sent to the image transmission unit 102. The image transmission unit 102 transmits the image data (107) captured by the imaging unit of the imaging device 101 to the image reception unit 306 of the terminal device 301 via the network 100.

  Step S317: Upon receiving the image data (107), the image receiving unit 306 of the terminal device 301 sends it to the camera video display unit 305. The camera video display unit 305 displays the image data (107) (still frame at the time of request).

  Next, operations of the area map adjustment unit and the three-dimensional (3D) processing unit of the terminal device according to the embodiment will be described with reference to FIGS. 4 and 6. FIG. 6 is a diagram for explaining the area map adjustment unit and the 3D processing unit of the terminal device according to the embodiment.

  Step S318: The terminal device 301 selects an area 5011 on the area map 2302 in FIG.

  Step S319: In the terminal device 301, the area map adjustment unit 303 performs area map enlargement, reduction, rotation, and clipping on the plane area 5100 in accordance with the operation of the mouse or the like of the external input device 401 with respect to the operation group 5010 (planar area deformation). .

  Step S320: Next, a 3D processing unit (not shown) of the terminal device 301 performs region three-dimensionalization in order to display the area map 5100 expressed in a two-dimensional plane in a three-dimensional manner.

  Step S321: The 3D processing unit of the terminal device 301 performs the adjustment (three-dimensional region modification / adjustment).

  Step S322: For example, the 3D processing unit of the terminal device 301 makes the 3D area map (5101) closer to the camera image in accordance with the operation of the pan / tilt and yaw / pitch / roll adjustment buttons (operation group) 5020. Perform fitting.

  Next, provision of measurement points and rectangles of the terminal device according to the embodiment will be described with reference to FIGS. 4 and 7. FIG. 7 is a diagram of a coordinate association screen for explaining the provision of measurement points and rectangles of the terminal device according to the embodiment.

  In FIG. 7, the terminal device 301 causes the camera image to be displayed in a floating 6001 and semi-transparent manner on the three-dimensional area map in the three-dimensional specific section, and performs the fitting 3008.

  Step S323: After the fitting is completed, the terminal device 301 draws the measurement points / rectangles on the camera image on the solid area map (giving measurement points / rectangles).

  Step S324: The terminal device 301 drops the drawing result onto the plane area map by geometric calculation (floor surface projection).

  For example, the terminal device 301 is provided with a measurement point icon 4002 and a measurement rectangle icon 4003 on the coordinate association screen 4001 in order to realize measurement point / rectangular drawing, and the measurement point icon 4002 is clicked with the mouse of the external input device 401. If the measurement point 6002 is clicked again on the area map after that, the measurement point 6002 is determined, and if the measurement rectangle icon 4003 is drawn 6003 on the area map after the mouse is clicked, the measurement rectangle is determined.

  Next, measurement points and drawing on the rectangular plane area (floor projection) of the terminal device according to the embodiment will be described with reference to FIG. 8A and 8B are diagrams for explaining the measurement points of the terminal device according to the embodiment and the drawing on the rectangular planar area. FIG. 8A is a three-dimensional area map, FIG. 8B is a planar area map, and FIG. C) is a floor projection.

  In FIG. 8, for example, the terminal device 301 displays an imaging device when a point / rectangle drawn on the three-dimensional area map in FIG. 8A is drawn on the vertical plane 7002 of the camera focal length in FIG. When the line 7004 connecting the center of the lens 101 and each point is extended to the floor surface, each point 7007 intersecting the floor is projected onto the plane area map. Although the camera depth direction is imaged in FIG. 8, it carries out similarly about the left-right direction.

  After the coordinate information is confirmed, the terminal device 301 transmits the coordinate information (311) from the coordinate information transmission unit 311 to the server device 201.

  The database unit 207 of the server apparatus 201 stores (stores) the received coordinate information (311).

  Next, a geometric calculation concept of coordinate association between the camera image and the area map of the terminal device according to the embodiment will be described with reference to FIG. 9A and 9B are diagrams for explaining a geometric calculation concept of coordinate correspondence between the camera image and the area map of the terminal device according to the embodiment. FIG. 9A is a camera image, and FIG. 9B is a floor surface. It is a projection.

  In FIG. 9, the terminal device 301 performs a yaw / pitch / roll angle with respect to an area map reference vector angle 8008 from a perpendicular vector angle 8007 extending vertically from the lens center point of the imaging device 101 at the time of fitting. The degree of pan / tilt is automatically geometrically calculated from each of the floor surface point distances 8006 corresponding to, and transmitted to the database unit 207 of the server apparatus 201.

  The database unit 207 of the server apparatus 201 stores (stores) the received pan / tilt degree.

  By applying the embodiment to the monitoring system and operating it, high-efficiency control of the entire system can be performed.

  In the monitoring system according to the embodiment, the imaging device, the terminal device, and the server device operate cooperatively, analyze the image processing calculation result based on the imaging device image from both the spatial information and the time information, and feed back to the imaging device in the system. As a result, an event occurrence opportunity in image processing within the imaging apparatus can be improved, and the efficiency of system operation can be improved.

  In the monitoring system according to the embodiment, each calculation result between the image processes performed by the imaging apparatus cooperates to synergistically improve an event occurrence opportunity in each image process.

  In the monitoring system according to the embodiment, the image processing calculation result by the imaging device image is made to correspond to the monitoring area map, and the short-term or long-term image processing calculation result is graphically displayed on the area map, thereby It can be used for internal personnel activation and personnel allocation planning.

  Although the invention made by the present inventor has been specifically described based on the embodiments and examples, the present invention is not limited to the above-described embodiments and examples, and various modifications can be made. Not too long.

DESCRIPTION OF SYMBOLS 100 ... Network, 101 ... Imaging device, 102 ... Image transmission part, 103 ... Request reception part, 104 ... View angle control part, 105 ... Motor control part, 201 ... Server apparatus, 202 ... Image reception part, 203 ... System operation support , 204 ... Request transmission unit, 205 ... System integrated management unit, 206 ... Image processing operation unit, 207 ... Database unit, 208 ... Database management unit, 301 ... Terminal device, 302 ... Area map display unit, 305 ... Camera video display unit 306: Image reception unit 307: Image request unit 308: Calculation result request unit 309: Calculation result reception unit 310: Calculation result display unit 312: Screen operation detection unit 401: External input device 402: External Output device

Claims (4)

An image transmission unit for transmitting a captured image, a request reception unit for receiving a request, a motor control unit for applying the request to the imaging device direction, and an angle of view for applying the request to the imaging device angle of view A control unit, an imaging device having,
An image processing operation unit that performs an operation using an image from the imaging device, a database unit that stores the operation result of the image processing operation unit, and the operation result stored in the database unit in terms of space and time A server apparatus having a system operation support unit that analyzes the request, and a request transmission unit that transmits the request to the imaging device based on an analysis result of the system operation support unit,
A monitoring system comprising: In claim 1,
Means for visually grasping event occurrence information from the imaging device on an area map representing the imaging target space as electronic map data; means for visually grasping frequency information of occurrence events in each imaging device and area; A terminal device having
The database unit is a monitoring system that accumulates relevance between in-screen coordinates and area map coordinates of the imaging apparatus. In claim 2,
The terminal device includes an image requesting unit that requests an image from the imaging device, an image receiving unit, a camera video display unit, a calculation result requesting unit that requests a calculation result specifying a predetermined condition from the server device, A result receiving unit and a calculation result display unit;
The request receiving unit transmits an image captured to the image receiving unit based on the image request,
The camera video display unit displays the image received by the image receiving unit,
The server device reads the calculation result from the database unit based on a request from the calculation result request unit, and transmits the calculation result to the calculation result reception unit.
The calculation result display unit superimposes and displays the calculation result received by the calculation result receiving unit on the area map. In claim 3,
The imaging device is a pan-tilt-zoom compatible imaging device and a fish-eye imaging device,
Based on the request, the motor control unit of the pan / tilt / zoom compatible imaging apparatus adjusts the angle of view in the direction of the human flow vector,
Based on the request, the angle-of-view control unit of the fish-eye imaging device develops a developed view angle of a captured image on a flat surface during normal operation, and is elevated in time zones and places where human flow detection occurs frequently. The monitoring system to deploy.

Images