WO2013145530A1 - Analysis system - Google Patents

Analysis system Download PDF

Info

Publication number
WO2013145530A1
WO2013145530A1 PCT/JP2013/000797 JP2013000797W WO2013145530A1 WO 2013145530 A1 WO2013145530 A1 WO 2013145530A1 JP 2013000797 W JP2013000797 W JP 2013000797W WO 2013145530 A1 WO2013145530 A1 WO 2013145530A1
Authority
WO
WIPO (PCT)
Prior art keywords
analysis
unit
target data
processing
data acquisition
Prior art date
Application number
PCT/JP2013/000797
Other languages
French (fr)
Japanese (ja)
Inventor
山田　洋志
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Publication of WO2013145530A1 publication Critical patent/WO2013145530A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/535—Tracking the activity of the user
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body

Definitions

  • the present invention relates to an analysis system, and more particularly to an analysis system in which a device that acquires data to be analyzed and a device that performs analysis processing are connected via a network.
  • the video monitoring system includes an object recognition unit, a recognition result analysis unit, a video processing control parameter determination unit, and a video processing control parameter setting unit.
  • the video surveillance system described in Patent Document 1 having the above-described configuration operates as follows. First, the object recognition unit recognizes an object from the video data of the camera, the recognition result analysis unit analyzes the recognition result, and the minimum size of the face in the video recognized by the object recognition unit from the received frame image, Find the moving speed. Then, the video processing control parameter determination unit determines a lower limit value of the frame rate and the resolution from the minimum face size and the moving speed. Thereafter, the determined frame rate and the lower limit value of the resolution are sent to the video processing control parameter setting unit to set the camera. As described above, in the technique described in Patent Document 1, the amount of data is reduced by reducing the frame rate of video data.
  • this video surveillance system is composed of a camera and a surveillance center, and the camera has a programmable internal module configuration.
  • the video surveillance system described in Patent Document 2 having the above-described configuration operates as follows. First, a camera and a monitoring center are connected via a network. Based on the video data to be monitored, the camera acquires, from the module management center, a program module that executes a recognition process for detecting an abnormality of the monitoring target and link information of the program module as necessary. As described above, in the technique described in Patent Document 2, the video data analysis processing is executed by the module on the camera side, and only the analysis processing result is transmitted to the monitoring center, thereby reducing the data amount. Yes.
  • the object of the present invention is the analysis system configured by connecting the data acquisition device that acquires the data to be analyzed and the analysis device that executes the analysis process, which is the above-described problem, via a network.
  • the object is to solve the problem that it is impossible to achieve both a reduction in the load on the network and a reduction in the performance of the device that acquires the analysis target data.
  • An analysis system is: An analysis target data acquisition device for acquiring analysis target data, connected to each other via a network, and an analysis processing device for executing a predetermined analysis process
  • the analysis target data acquisition device includes a first analysis unit that executes a predetermined analysis process on the acquired analysis target data, a data transmission unit that transmits data based on the acquired analysis target data to the analysis processing unit,
  • the analysis processing device includes second analysis means for executing a predetermined analysis process on the data transmitted from the analysis target data acquisition device,
  • the first analysis unit and the second analysis unit each include an analysis unit that executes an analysis process of equivalent content, Among the analysis units provided in the first analysis means and the second analysis means, respectively, provided with an analysis control means for controlling either one or both to operate,
  • the configuration is as follows.
  • the analysis object data acquisition device is An analysis target data acquisition device for acquiring analysis target data, connected to an analysis processing device that executes a predetermined analysis process, First analysis means for executing a predetermined analysis process on the acquired analysis target data; Data transmission means for transmitting data based on the acquired analysis target data to the analysis processing device,
  • the first analysis means includes another analysis unit that executes an analysis process having the same content as the analysis unit included in the analysis processing device, Among the analysis units provided in the first analysis means and the second analysis means, respectively, provided with an analysis control means for controlling either one or both to operate,
  • the configuration is as follows.
  • the program which is the other form of this invention is: To the analysis target data acquisition device that acquires the analysis target data connected to the analysis processing device that executes the predetermined analysis processing via the network, First analysis means for executing a predetermined analysis process on the acquired analysis target data; Data transmission means for transmitting data based on the acquired analysis target data to the analysis processing device; Analysis control means for controlling either one or both of the analysis units that perform analysis processing of equivalent contents respectively provided by the first analysis means and the second analysis means, It is a program for realizing.
  • an analysis processing method includes: In a communication system comprising an analysis target data acquisition device for acquiring analysis target data and an analysis processing device for executing a predetermined analysis process, which are connected to each other via a network,
  • the analysis target data acquisition device performs predetermined analysis processing on the acquired analysis target data, and transmits data based on the acquired analysis target data to the analysis processing device.
  • the analysis processing device performs a predetermined analysis process on the data transmitted from the analysis target data acquisition device,
  • the analysis target data acquisition device and the analysis processing device can each perform an analysis process of equivalent content, and either one or both of the analysis target data acquisition device and the analysis processing device analyze the equivalent content. Control to execute the process,
  • the configuration is as follows.
  • the present invention is configured as described above so that a data acquisition device that acquires data to be analyzed and an analysis device that executes analysis processing are connected via a network. It is possible to achieve both the reduction of the load and the performance reduction of the apparatus for acquiring the analysis target data.
  • Embodiment 1 of this invention It is a block diagram which shows the structure of the analysis system in Embodiment 1 of this invention. It is a flowchart which shows operation
  • FIG. 1 is a diagram for explaining the configuration of the analysis system in the present embodiment
  • FIGS. 2 to 3 are diagrams for explaining the operation of the analysis system.
  • the analysis system in this embodiment is a video surveillance system, and as shown in FIG. 1, a monitoring camera 1 (analysis target data acquisition device) that acquires video data to be analyzed and an analysis server 2 (analysis processing data acquisition device) Analysis processing device).
  • the monitoring camera 1 and the analysis server 2 are connected via a network 3 such as the Internet network or a LAN (Local Area Network).
  • the analysis system according to the present invention is not limited to the video surveillance system described below, and performs other analysis processing with an analysis target data acquisition device that acquires other analysis target data such as audio data.
  • the analysis processing apparatus may be configured to be connected via a network. Further, the network 3 may be any network regardless of wireless wired.
  • the monitoring camera 1 includes an arithmetic device and a storage device, and as shown in FIG. 1, a video acquisition unit 11, a first video analysis unit 12, a camera control unit 13, a first load determination unit 14, It has.
  • the first video analysis unit 12, the camera control unit 13, and the first load determination unit 14 are constructed by incorporating a program into the arithmetic device.
  • the video acquisition unit 11 includes a camera module that captures video, and also includes a processing unit that converts moving images and still images that are the captured video as video data. Then, the video acquisition unit 11 acquires video data by the operation being controlled by the camera control unit 13, and outputs the acquired video data to the first video analysis unit 12.
  • the first video analysis unit 12 executes analysis processing on the video data acquired by the video acquisition unit 11.
  • the first video analysis unit 12 includes one or more analysis modules (analysis units) that execute predetermined analysis processing, and executes all or only a part of the analysis modules.
  • the analysis module performs analysis processing such as processing for extracting a human face portion from video data and processing for extracting face feature data from a face image.
  • the first video analysis unit 12 may not perform any analysis processing by the analysis module.
  • the first video analysis unit 12 outputs the analysis result and / or the data before the analysis process to the camera control unit 13. The operation of the first video analysis unit 12 is controlled by the camera control unit 13.
  • At least one of the analysis modules included in the first video analysis unit 12 is equivalent to the analysis module (second substitutable analysis module) included in the second video analysis unit 22 included in the analysis server 2 described later. It is the 1st substitutable analysis module which performs analysis processing of contents.
  • the first substitutable analysis module and the second substitutable analysis module may be the same analysis module, and the same analysis result can be obtained by executing the analysis process of the same content.
  • the analysis module may be used.
  • the first load determination unit 14 (determination means) measures the load in the monitoring camera 1 and determines the load level. For example, the processing load of the entire arithmetic device equipped in the monitoring camera 1 may be measured, or the processing load of the first video analysis unit 12 may be measured. Then, the measured load level is determined based on a preset criterion. For example, when the low level reference value and the high level reference value are set as the reference value, and the measured load is lower than the low level reference value, the load level is determined to be low and measured. When the load is higher than the high level reference value, it is determined that the load level is a high level, and when it is not any, it is determined that the load level is other level. Then, the first load determination unit 14 outputs the determined load level to the camera control unit 13.
  • the 1st load determination part 14 in this embodiment demonstrates the case where the processing load of the arithmetic unit in the monitoring camera 1 is measured as a load of the said monitoring camera 1, it measures the load of the monitoring camera 1 by another method. Then, the load level may be determined. For example, the amount of memory used in the surveillance camera 1, the delay status of processing executed by the surveillance camera 1, the amount of data input / output to / from the surveillance camera 1, the status of the network to which the surveillance camera 1 is connected, etc. You may measure the load of the said monitoring camera 1 from the information showing the operating condition of the monitoring camera 1, and may determine the level based on the preset reference
  • the camera control unit 13 (analysis control unit, data transmission unit) controls the operation of the camera control unit 12 based on the load level of the monitoring camera 1 output from the first load determination unit 14. At the same time, the camera control unit 13 controls data communication with the analysis server 2.
  • the camera control unit 13 first performs control so that the analysis process by the analysis module preset by the first video analysis unit 12 and the analysis process by the first substitutable analysis module are executed in the normal state.
  • the analysis result data by the first video analysis unit 12 that is, the analysis result data by the first substitutable analysis module is transmitted to the analysis server 2 via the network.
  • the camera control unit 13 checks the load level of the monitoring camera 1 output from the first load determination unit 14 while executing the analysis process and the transmission process, and the load level is not “high load level”. In this case, the control is performed as it is.
  • the camera control unit 13 operates the analysis module operating in the first video analysis unit 12. Among these, control is performed to stop the operation of the first substitutable analysis module described above. Accordingly, the camera control unit 13 transmits data to be analyzed by the first substitutable analysis module to the analysis server 2 via the network. Further, the camera control unit 13 indicates that the operation of the first substitutable analysis module has been stopped, that is, the analysis server 2 executes analysis processing having the same content as the analysis processing by the first substitutable analysis module. The instruction is transmitted to the analysis server 2.
  • the camera control unit 13 indicates that the load level of the monitoring camera 1 output from the first load determination unit 14 is “when the operation of the first substitutable analysis module is stopped by the first video analysis unit 12.
  • the first video analysis unit 12 is controlled to resume the operation of the first substitutable analysis module stopped. Accordingly, the camera control unit 13 transmits the data of the analysis result by the first video analysis unit 12 to the analysis server 2 via the network.
  • the camera control unit 13 indicates that the operation of the first substitutable analysis module has been resumed, that is, the analysis server 2 stops the analysis processing having the same content as the analysis processing by the first substitutable analysis module. The instruction is transmitted to the analysis server 2.
  • the analysis server 2 is a general information processing device (analysis processing device) including an arithmetic device and a storage device, and is configured by one or a plurality of information processing devices. And the analysis server 2 is provided with the result output part 21, the 2nd image
  • the result output unit 21 outputs an analysis processing result by a second video analysis unit 22 described later via an output device such as a monitor or a printer.
  • the second video analysis unit 22 executes analysis processing on data transmitted from the monitoring camera 1 via the network 3.
  • the second video analysis unit 22 includes one or more analysis modules (analysis units) that execute predetermined analysis processing, and executes all or only a part of the analysis modules.
  • the analysis module performs analysis processing such as processing for extracting face feature data from a face image and processing for matching a specific face from face feature data.
  • the second video analysis unit 22 outputs the analysis result to the result output unit 21.
  • the operation of the second video analysis unit 22 is controlled by the server control unit 23.
  • At least one of the analysis modules included in the second video analysis unit 22 is equivalent to the analysis module (first substitutable analysis module) included in the first video analysis unit 12 included in the monitoring camera 1 described above. It is a 2nd substitutable analysis module which performs analysis processing of contents.
  • the second substitutable analysis module and the first substitutable analysis module may be the same analysis module, and an analysis process having the same content is executed to obtain an equivalent analysis result. It may be another analysis module that can be obtained.
  • the correspondence storage unit 41 stores information representing the correspondence between the second substitutable analysis module and the first substitutable analysis module, and is constructed in a storage device connected to the analysis server 2. ing. Specifically, the correspondence relationship storage unit 41 stores information for identifying the first substitutable analysis module and the second substitutable analysis module corresponding to each other in association with each other. Execution methods such as parameters set when executing the possibility analysis module are also stored. In addition, although the example of FIG. 1 has shown the case where the correspondence storage part 2 is equipped in the apparatus connected to the analysis server 2, it may be equipped in the analysis server 2, and other It may be equipped at the place.
  • the server control unit 23 (analysis control unit) controls the operation of the second video analysis unit 22 based on the information transmitted from the monitoring camera 1 and the information in the correspondence storage unit 41. At the same time, the server control unit 23 controls data communication with the monitoring camera 1.
  • the server control unit 23 first, in a normal state, analyzes data set in advance by the second video analysis unit 22 with respect to data transmitted from the monitoring camera 1, and a second alternative is possible.
  • the analysis process by the analysis module is controlled to be executed, and the analysis result is output to the result output unit 21.
  • the server control unit 23 performs the control as it is.
  • the server control unit 23 analyzes the same content as the analysis process from the monitoring camera 1 by the first substitutable analysis module as described above. Since an instruction to execute the process in the analysis server 2 is transmitted, control is performed so that the analysis process by the second substitutable analysis module is executed in accordance with the instruction. At this time, the server control unit 23 receives information specifying the first substitutable analysis module that has stopped the analysis processing on the monitoring camera 1 side from the monitoring camera 1 and corresponds to the first substitutable analysis processing module. The second substitutable analysis processing module is specified from the information in the correspondence storage unit 41 and controlled to be executed.
  • the server control unit 23 is configured as described above. As described above, the instruction to stop the second substitutable analysis module is received from the monitoring camera 1, and the analysis processing by the second substitutable analysis module is controlled to stop.
  • the first video analysis unit 12 of the analysis camera 1 performs analysis processing by the first substitutable analysis module, and the second substitutable analysis that performs analysis processing equivalent to this is performed.
  • the analysis process by the module is not executed by the second video analysis unit 22 of the analysis server 2.
  • the first load determination unit 14 determines the load of the monitoring camera 1 (step S1).
  • the determination timing may be set based on system requirements such as a fixed interval, a specific time, and a start / end timing of processing.
  • the camera control unit 13 is executed by the first video analysis unit 12.
  • the analysis process that can be stopped is selected (step S3), and the analysis server 2 is requested to execute the equivalent process (step S4).
  • the camera control unit 13 selects that the analysis process by the first substitutable analysis module executed in the first video analysis unit 12 can be stopped, and stops the first substitutable analysis module. Is sent to the analysis server 2.
  • the camera control unit 13 receives a notification from the analysis server 2 that analysis processing equivalent to that of the first substitutable analysis module can be executed (“OK” in step S5), the first substitutable analysis is performed.
  • the analysis process by the module is stopped (step S6).
  • the camera control unit 13 sends the data to be analyzed by the first substitutable analysis processing module to the analysis server 2 when the analysis processing is stopped by the first substitutable analysis module. Send to.
  • step S11 When the server control unit 23 receives a processing request from the monitoring camera 1 (step S11), the server control unit 23 performs processing according to the type (step 12, S13, S15). Specifically, as in step S4 in FIG. 2, when a request for execution of analysis processing equivalent to that of the first substitutable analysis module is received from the monitoring camera 1 ("execution of processing" in step S11), first, A second substitutable analysis module that is an analysis module that executes analysis processing equivalent to that of the first substitutable analysis module is specified from within the relationship storage unit 41.
  • step S12 it is determined whether or not the analysis process by the specified second substitutable analysis module can be executed by the analysis server 2 according to the situation of the analysis server 2 (step S12).
  • the analysis processing by the second substitutable analysis module is executed (step S13).
  • the analysis server 2 outputs the result of the analysis process by the 2nd image
  • step S2 an analysis process that can be executed is selected from the analysis processes stopped by the first video analysis unit 12 (step S7).
  • the camera control unit 13 selects that the analysis process by the first substitutable analysis module stopped by the first video analysis unit 12 can be started, and a process equivalent to the first substitutable analysis module. Is requested to the analysis server 2 to stop (step S8).
  • the camera control unit 13 receives a notification from the analysis server 2 that analysis processing equivalent to that of the first substitutable analysis module can be stopped (“OK” in step S9), the first substitutable analysis is performed.
  • the analysis process by the module is resumed (step S10).
  • the server control unit 23 receives a request to stop the analysis process equivalent to the first substitutable analysis module from the monitoring camera 1 (“process stop” in step S11), the server control unit 23 receives the analysis module executed by the analysis server 2 Among these, the second substitutable analysis module, which is an analysis module that executes an analysis process equivalent to that of the first substitutable analysis module, is specified from the correspondence storage unit 41. Then, the server control unit 23 stops the analysis process by the specified second substitutable analysis module (step S15). The analysis server 2 outputs the result of the analysis processing by the second video analysis unit 22 including the second substitutable analysis module from the result output unit 21 (step S14).
  • the analysis processing module that executes the analysis processing of the equivalent content according to the determination result of the load of the monitoring camera 1 by the first load determination unit 14 of the monitoring camera 1.
  • the specific analysis process according to is operated by either the monitoring camera 1 or the analysis server 2. For this reason, normally, when a specific analysis process is executed on the surveillance camera 1, only the result of the specific analysis process is transmitted to the analysis server 2 via the network N. It is reduced. On the other hand, when the load on the monitoring camera 1 is increased, the execution of the specific analysis process is switched from the monitoring camera 1 to the analysis server 2, and therefore the specific analysis process can be continued as the entire analysis system. . Accordingly, it is possible to reduce the performance of the monitoring camera 1 while reducing the load on the network 3, and to construct an analysis system that achieves both improvement in performance and reduction in equipment costs.
  • the camera control unit 13 and the server control unit 23 may control such that both perform analysis processing simultaneously. As a result, part of the data to be analyzed is analyzed by the monitoring camera 1 and the rest is analyzed by the analysis server 2, and load distribution in the entire system can be achieved.
  • FIG. 4 is a block diagram showing the configuration of the video analysis system in the present embodiment
  • FIG. 5 is a diagram showing an example of data stored in the video analysis system
  • FIG. 6 is a diagram for explaining the state of analysis processing by the video analysis system.
  • This embodiment shows an example of the specific configuration and operation of the video analysis system described in the first embodiment. For example, a person who has registered a video monitoring system in the video of the surveillance camera 1 is shown in the video. In this example, the system is applied to a registrant notification system in which an alarm is issued when an error occurs.
  • the video analysis system first performs face extraction processing 72 for extracting a human face portion on the video data 71 acquired by the monitoring camera 1, and outputs face image data 73. Subsequently, the video analysis system performs a facial feature extraction process 74 that extracts facial features such as the positions of eyes and noses on the facial image data 73, and outputs facial feature data 75. Further, the video analysis system collates the face feature data 75 with the data in the face database, performs face collation processing 76 for determining whether the person is registered in the face database, and outputs a collation result 77.
  • the first video analysis unit 12 of the monitoring camera 1 includes a face extraction module 12a that performs the above-described face extraction processing 72 as shown in FIG. And a facial feature extraction module 12b that performs 74 extraction processes.
  • the second video analysis unit 22 of the analysis server 2 includes a face feature extraction module 22a that performs the above-described face feature extraction processing 74 and a face matching module 22b that performs the above-described face matching processing 76.
  • the facial feature extraction module 12b included in the first video analysis unit 12 and the facial feature extraction module 22a included in the second video analysis unit 22 are analysis modules that perform analysis processing of equivalent contents, and are functional. Are the same.
  • the facial feature extraction modules 12b and 22a may be completely the same module, but are not necessarily the same.
  • the OS Operating System
  • the modules may correspond to the respective OSs or may be completely different modules.
  • the correspondence relationship between the face feature modules 12b and 22a is stored as data in the correspondence storage unit 41 shown in FIG.
  • the data in the correspondence storage unit 41 shown in FIG. 5 includes, for each monitoring camera 1 (for each camera ID), an analysis module (first substitutable analysis module) mounted on the monitoring camera 1. And an analysis module (second substitutable analysis module) mounted on the analysis server 2 that performs an analysis process having the same content as that in FIG. For example, in the second registered item from the top in FIG. 5 (see reference numeral 41a in FIG.
  • the “face feature extraction” module installed in the surveillance camera 1 (C1) is “ -mode 1 ”is executed with the parameter“ 20 ”, and the case where the“ face inspection ”module installed in the analysis server 2 is executed with the parameter“ 20 ”is registered in association with the analysis processing of the same content. Yes. That is, an equivalent analysis result can be obtained by performing any of the analysis processes associated with each other.
  • the correspondence storage unit 41 is installed in the analysis server 2, but may be installed at any position.
  • the face feature extraction process 74 shown in FIG. 6 can be executed by either the monitoring camera 1 or the analysis server 2.
  • the facial feature extraction process 74 is executed by the monitoring camera 1
  • the facial feature data 75 is transmitted from the monitoring camera 1 to the analysis server 2, but when the facial feature extraction process 74 is executed by the analysis server 2.
  • the face image data 73 is transmitted from the monitoring camera 1 to the analysis server 2.
  • the amount of data output from the monitoring camera 1 is smaller in the face feature data 75 than in the face image data 73, so that the face feature extraction process 74 is executed by the monitoring camera 1.
  • the load on 3 is reduced.
  • the facial feature extraction process 74 may be unable to be processed by the surveillance camera 1 when a large number of people are reflected because the load varies depending on the number of people shown in the video. Therefore, in the normal state, the facial feature extraction processing 74 is executed by the monitoring camera 1 to reduce the load on the network 3, and when the monitoring camera 1 reaches a high load level by the first load determination unit 14, A part or all of the feature extraction processing 74 can be requested to reduce the load on the monitoring camera 1.
  • the alarm display application 5 provides information to the user.
  • FIG. 7 is a block diagram showing the configuration of the video analysis system in the present embodiment
  • FIG. 8 is a diagram for explaining the state of analysis processing by the video analysis system.
  • this embodiment shows an example of a specific configuration and operation of the video analysis system described in the first embodiment.
  • the video monitoring system can be used to identify a person shown in the video data of the monitoring camera 1 by gender.
  • This example shows an application to a human video search system in which a search is performed by designating clothes and clothes.
  • the video analysis system performs face extraction processing 82 for extracting a human face portion on the video data 81 acquired by the monitoring camera 1, and outputs face image data 83. Subsequently, the video analysis system performs gender determination processing 84 for determining gender based on the face image data 83, outputs gender data 85, and performs information registration processing 86. In parallel with the above processing, the video analysis system performs a person extraction process 87 for extracting the whole body part of the person from the video data 81 acquired by the monitoring camera 1 and outputs the person image data 88. Subsequently, the video analysis system performs a clothing extraction process 89 for extracting information such as the type and color of clothes from the person image data 88 and performs an information registration process 86.
  • the first video analysis unit 12 of the surveillance camera 1 in this embodiment includes a face extraction module 12c for performing the face extraction processing 82 and the gender determination processing 84 as shown in FIG.
  • a gender determination module 12d that performs the above-described process
  • a person extraction module 12e that performs the person extraction process 87
  • a clothing extraction module 12f that performs the clothes extraction process 89.
  • the second video analysis unit 22 of the analysis server 2 includes a gender determination module 22 c that performs the gender determination process 84 and a clothing extraction module 22 d that performs the clothes extraction process 89.
  • the gender determination module 12d included in the first video analysis unit 12 and the gender determination module 22c included in the second video analysis unit 22 are analysis modules that perform analysis processing of equivalent contents, and are functionally Are the same.
  • the clothing extraction module 12f included in the first video analysis unit 12 and the clothing extraction determination module 22d included in the second video analysis unit 22 are analysis modules that perform analysis processing of equivalent contents, and are functionally Are the same.
  • the gender determination process 84 and the clothing extraction process 89 shown in FIG. 8 can be executed by either the monitoring camera 1 or the analysis server 2. Since the above two processes (gender determination process 84 and clothes extraction process 89) are independent, either one or both may be monitored camera 1 or analysis server 2 depending on the load state of monitoring camera 1 or analysis server 2. It may be executed with. Thereby, the load of the network 3 can be reduced and the performance of the surveillance camera 1 can be reduced.
  • the gender and clothes information which is the analysis result by the video analysis system, is output to the information registration / search application 6 and registered in the database. Thereby, the information registered in the database can be searched from the information registration / search application.
  • FIG. 9 is a block diagram showing the configuration of the video analysis system in the present embodiment.
  • the video analysis system according to the present embodiment has substantially the same configuration as the video analysis system according to the first embodiment described above.
  • the analysis server 2 includes a second load determination unit 24 (determination means).
  • the second load determination unit 24 measures the preset load in the analysis server 2 and determines the load level, similarly to the first load determination unit 14 described above. For example, the processing load of the entire arithmetic device provided in the analysis server 2 may be measured, or the processing load by the second video analysis unit 22 may be measured. Then, the measured load level is determined based on a preset criterion. Then, the second load determination unit 24 outputs the determined load level to the server control unit 23.
  • the second load determination unit 24 may measure the load of the analysis server 2 by another method and determine the load level. For example, the amount of memory used in the analysis server 2, the delay state of processing executed in the analysis server 2, the amount of data input / output to the analysis server 2, the state of the network to which the analysis server 2 is connected, etc. You may measure the load of the said analysis server 2 from the information showing the operating condition of the analysis server 2, and may determine the level based on the preset reference
  • the server control unit 23 in the present embodiment controls the operation of the second video analysis unit 22 based on the load level of the analysis server 2 output from the second load determination unit 24.
  • the server control unit 23 is a case where the camera control unit 13 of the monitoring camera 1 is instructed to execute the second substitutable analysis module when the monitoring camera 1 is at a high load level.
  • the monitoring camera 1 may be answered that the second substitutable analysis module cannot be executed.
  • the server control unit 23 can execute the second substitutable analysis module for the monitoring camera 1 when it is determined that the analysis server 2 is at the low load level, and the first alternative The monitoring camera 1 may be notified that the possibility analysis module may be stopped.
  • the server control unit 23 and / or the camera control unit 13 controls the execution of the second substitutable module in the second video analysis unit 22, One or both of the one substitutable analysis module and the second substitutable analysis module may be controlled to be executed.
  • the server control unit 23 and / or the camera control unit 13 determines the first substitutable analysis module and the second substitutable analysis in accordance with the determination results of the second load determination unit 24 and the first load determination unit 14. One or both of the modules may be controlled to be executed.
  • the analysis server 2 is equipped with the second determination unit 24 and performs analysis processing of equivalent contents in each of the video analysis units 12 and 22 in consideration of operating conditions such as the load of the analysis server 2.
  • the method for controlling the module is also applicable to the second and third embodiments.
  • FIG. 9 is a block diagram showing the configuration of the video analysis system in the present embodiment.
  • the video analysis system in the present embodiment has substantially the same configuration as the video analysis system in the fourth embodiment described above.
  • the first load determination unit 14 and the second load determination unit 24 use different methods from the above-described embodiment to check the operation status of the monitoring camera 1 and the analysis server 2. Measure and judge.
  • a method for measuring the load on the monitoring camera 1 by the first load determination unit 14 of the monitoring camera 1 will be described, but the same method can also be applied to the second load determination unit 24 of the analysis server 2. It is.
  • the first load determination unit 14 (operation status measurement means) in the present embodiment stores the history of the operation status of the monitoring camera 1 measured so far in the storage device as operation history information. For example, the processing load of the arithmetic device equipped in the monitoring camera 1 is stored together with time information. Then, the first load determination unit 14 predicts the processing load that is the current operation state in the monitoring camera 1 from the past operation history information in the monitoring camera 1, and the level of the predicted processing load is set in advance. Judge based on criteria. More specifically, the first load determination unit 14 stores a record of load fluctuations, predicts the degree of increase or decrease, predicts the current load, and performs periodic fluctuations such as date and time. You can learn and predict the current load. The load level is determined from the predicted load of the monitoring camera 1 in this way, and the operation of the monitoring camera 1 and / or the analysis server 1 is controlled as described above.
  • the first load determination unit 14 can measure the load that is the operating state of the monitoring camera 1 by another method. For example, the first load determination unit 14 measures a situation such as a load on the network 3 connected to the monitoring camera 1, predicts the load on the monitoring camera 1 from the measurement result, and determines the predicted load level. Also good. As an example, when the load on the network 3 is lower than a preset reference value, it is considered that the amount of data transmitted from the monitoring camera 1 is small, and therefore it can be determined that the processing load on the monitoring camera 1 is low. Therefore, the current load of the monitoring camera 1 can be predicted based on the current load value of the network 3.
  • the subsequent process load can be predicted from the previous process result. is there.
  • the load of the face feature extraction process will increase.
  • the mutual relationship between the positions of the surveillance cameras can be used. For example, in the case of surveillance cameras arranged on a passage, it can be predicted that similar additional fluctuations occur in the order of arrangement according to the movement of a person.
  • load measurement by the first load determination unit 14 information from an external system can be used. For example, in a station monitoring camera, it is conceivable that the number of people will increase when a train arrives. Therefore, it is possible to predict the load by interlocking with operation information.
  • the analysis system in this invention is the above-mentioned. It is not limited to having the configuration.
  • the analysis system executes each analysis module of the first video analysis unit 12 and the second video analysis unit 22 based on other determination criteria without determining the operation status such as the load of the monitoring camera 1 or the analysis server 2. Or stop may be controlled. That is, the analysis system according to the present invention includes the first substitutable analysis module and the second substitutable analysis that execute the analysis processing of the same content without determining the operation status such as the load of the monitoring camera 1 or the analysis server 2. One or both of the modules may be controlled to operate.
  • An analysis target data acquisition device 100 that acquires analysis target data, and an analysis processing device 200 that executes a predetermined analysis process, connected to each other via a network 300;
  • the analysis target data acquisition apparatus 100 includes a first analysis unit 110 that executes a predetermined analysis process on the acquired analysis target data, and a data transmission unit that transmits data based on the acquired analysis target data to the analysis processing apparatus.
  • the analysis processing device 200 includes a second analysis unit 210 that performs a predetermined analysis process on the data transmitted from the analysis target data acquisition device 100,
  • the first analysis unit 110 and the second analysis unit 210 are respectively provided with analysis units 111 and 211 that execute analysis processing of equivalent contents,
  • An analysis control means 130 for controlling one or both of the analysis units 111 and 211 provided in the first analysis means 110 and the second analysis means 210 to operate is provided. Analysis system.
  • (Appendix 2) The analysis system according to attachment 1, wherein A determination unit that determines an operation state of the analysis target data acquisition device based on a preset criterion; The analysis control unit controls, based on the determination result by the determination unit, either one or both of the analysis units included in the first analysis unit and the second analysis unit, respectively. Analysis system.
  • the analysis control unit may execute the analysis process by the analysis unit of the first analysis unit when the determination unit determines that the processing load of the analysis target data acquisition apparatus is higher than a preset reference. Without controlling the analysis processing by the analysis unit of the second analysis means, Analysis system.
  • the analysis control unit determines that the processing load of the analysis target data acquisition device is higher than a preset reference by the determination unit when the analysis process by the analysis unit of the first analysis unit is being performed. If it is, control to stop the execution of the analysis process by the analysis unit of the first analysis means, and to execute the analysis process by the analysis unit of the second analysis means, Analysis system.
  • Appendix 5 The analysis system according to appendix 3 or 4, When the analysis control unit determines that the processing load of the analysis target data acquisition apparatus is higher than a preset reference by the determination unit, the data transmission unit is changed from the first analysis unit to the analysis unit. Control to transmit data based on the analysis target data to be analyzed to the second analysis means; Analysis system.
  • Appendix 7 The analysis system according to any one of appendices 2 to 5, An operation state measuring means for measuring the operation state of the analysis object data acquisition device and storing it as operation history information; The determination means predicts the operating status of the analysis target data acquisition device based on the operating history information, and determines the predicted operating status based on a preset criterion. Analysis system.
  • the analysis system according to appendices 2 to 5, The determination unit measures the network status, predicts the operating status of the analysis target data acquisition device based on the network status, and determines the predicted operating status based on a preset criterion. Analysis system.
  • An analysis target data acquisition device for acquiring analysis target data, connected to an analysis processing device that executes a predetermined analysis process, First analysis means for executing a predetermined analysis process on the acquired analysis target data; Data transmission means for transmitting data based on the acquired analysis target data to the analysis processing device,
  • the first analysis means includes another analysis unit that executes an analysis process having the same content as the analysis unit included in the analysis processing device, Among the analysis units provided in the first analysis means and the second analysis means, respectively, provided with an analysis control means for controlling either one or both to operate, Analysis target data acquisition device.
  • a communication system comprising an analysis target data acquisition device for acquiring analysis target data and an analysis processing device for executing a predetermined analysis process, which are connected to each other via a network
  • the analysis target data acquisition device performs predetermined analysis processing on the acquired analysis target data, and transmits data based on the acquired analysis target data to the analysis processing device.
  • the analysis processing device performs a predetermined analysis process on the data transmitted from the analysis target data acquisition device,
  • the analysis target data acquisition device and the analysis processing device can each perform an analysis process of equivalent content, and either one or both of the analysis target data acquisition device and the analysis processing device analyze the equivalent content. Control to execute the process, Analysis processing method.
  • the above-described program is stored in a storage device or recorded on a computer-readable recording medium.
  • the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)
  • Communication Control (AREA)
  • Image Analysis (AREA)

Abstract

This analysis system is provided with a data-for-analysis acquisition device and an analysis process device that are connected via a network. The data-for-analysis acquisition device is provided with: a first analysis means that executes a specified analysis process on acquired data-for-analysis; and a data sending means that, to the analysis process device, sends data based on the acquired data-for-analysis. The analysis process device is provided with a second analysis means that executes a specified analysis process on the data sent from the data-for-analysis acquisition device. The first analysis means and the second analysis means: are each provided with an analysis unit, said analysis units executing analysis processes that are mutually equivalent in nature; and are provided with an analysis control means that effects control such that the analysis unit of the first analysis means and/or the analysis unit of the second analysis means operates.

Description

解析システムAnalysis system
　本発明は、解析システムにかかり、特に、解析対象データを取得する装置と解析処理を行う装置とがネットワークを介して接続された解析システムに関する。 The present invention relates to an analysis system, and more particularly to an analysis system in which a device that acquires data to be analyzed and a device that performs analysis processing are connected via a network.
　近年、情報処理技術の発達に伴い、様々なデータの解析を行う解析システムが開発されており、例えば、監視カメラにて撮影された映像データから特定の人物を検出する、という解析処理を行う解析システムが開発されている。このような解析システムでは、監視カメラで取得した映像データをそのまま、ネットワークを経由して解析処理を実行する解析処理装置に送信する場合がある。ところが、映像データをネットワークを経由して送信すると、ネットワークの負荷を増大させることとなるため、送信する映像データのデータ量を削減する工夫がなされている。その一例として、映像データのフレームレートの低減することや、監視カメラ側で映像データの映像解析処理を実行して、その解析処理結果のみを解析装置側に送信する、ということが行われている。 In recent years, with the development of information processing technology, analysis systems that analyze various data have been developed. For example, analysis that performs analysis processing to detect a specific person from video data captured by a surveillance camera. A system has been developed. In such an analysis system, there is a case where video data acquired by a surveillance camera is transmitted as it is to an analysis processing apparatus that executes analysis processing via a network. However, when video data is transmitted via a network, the load on the network is increased. Therefore, a device for reducing the amount of video data to be transmitted has been devised. For example, the frame rate of the video data is reduced, or the video analysis processing of the video data is executed on the monitoring camera side, and only the analysis processing result is transmitted to the analysis device side. .
　ここで、本発明に関連する解析システムの一例として、特許文献１に開示された映像監視システムがある。この映像監視システムは、特許文献１の図１に示すように、物体認識部と、認識結果分析部と、映像処理制御パラメータ決定部と、映像処理制御パラメータ設定部と、を備えている。 Here, there is a video surveillance system disclosed in Patent Document 1 as an example of an analysis system related to the present invention. As shown in FIG. 1 of Patent Document 1, the video monitoring system includes an object recognition unit, a recognition result analysis unit, a video processing control parameter determination unit, and a video processing control parameter setting unit.
　上述した構成を有する特許文献１に記載の映像監視システムは、次のように動作する。まず、物体認識部が、カメラの映像データから物体を認識し、認識結果分析部が、その認識結果を分析し、受信したフレーム画像から物体認識部で認識した映像中の顔の最小サイズと、移動速度とを求める。そして、映像処理制御パラメータ決定部は、顔の最小サイズと移動速度とから、フレームレート及び解像度の下限値を決定する。その後、決定したフレームレート及び解像度の下限値を映像処理制御パラメータ設定部に送り、カメラの設定を行う。このように、特許文献１に記載の技術では、映像データのフレームレートを低減することで、データ量の削減を図っている。 The video surveillance system described in Patent Document 1 having the above-described configuration operates as follows. First, the object recognition unit recognizes an object from the video data of the camera, the recognition result analysis unit analyzes the recognition result, and the minimum size of the face in the video recognized by the object recognition unit from the received frame image, Find the moving speed. Then, the video processing control parameter determination unit determines a lower limit value of the frame rate and the resolution from the minimum face size and the moving speed. Thereafter, the determined frame rate and the lower limit value of the resolution are sent to the video processing control parameter setting unit to set the camera. As described above, in the technique described in Patent Document 1, the amount of data is reduced by reducing the frame rate of video data.
　また、本発明に関連する解析システムの一例として、特許文献２に開示の映像監視システムの別の例がある。この映像監視システムは、特許文献２の図１、図３に示すように、カメラと、監視センタとから構成され、カメラは、プログラマブルな内部モジュール構成を有している。 As an example of the analysis system related to the present invention, there is another example of the video surveillance system disclosed in Patent Document 2. As shown in FIGS. 1 and 3 of Patent Document 2, this video surveillance system is composed of a camera and a surveillance center, and the camera has a programmable internal module configuration.
　上述した構成を有する特許文献２に記載の映像監視システムは、次のように動作する。まず、カメラと監視センタとがネットワークを介して接続されている。カメラは、監視対象の映像データに基づいて、当該監視対象の異常検知のための認識処理を実行するプログラムモジュールと、当該プログラムモジュールのリンク情報とを、モジュール管理センタから必要に応じて取得する。このように、特許文献２に記載の技術では、カメラ側でモジュールにて映像データの解析処理を実行して、その解析処理結果のみを監視センタに送信することで、データ量の削減を図っている。 The video surveillance system described in Patent Document 2 having the above-described configuration operates as follows. First, a camera and a monitoring center are connected via a network. Based on the video data to be monitored, the camera acquires, from the module management center, a program module that executes a recognition process for detecting an abnormality of the monitoring target and link information of the program module as necessary. As described above, in the technique described in Patent Document 2, the video data analysis processing is executed by the module on the camera side, and only the analysis processing result is transmitted to the monitoring center, thereby reducing the data amount. Yes.
特開２００４－２００９８９号公報JP 2004-200909 A
　しかしながら、上述した技術では、ネットワークの負荷削減とカメラの性能削減とを両立することができない、という問題が生じる。かかる問題について詳しく説明すると、まず、カメラ側においてモジュールにて映像解析処理を行うと、処理結果のデータ量はもとの映像データよりも小さくなるため、ネットワークの負荷を削減できる。一方、映像解析処理を実行するためには、一般に高い処理能力が必要であり、解析処理によっては映像に含まれる対象物の数によって負荷の変動が大きくなる。従って、どのような映像データが得られた場合であっても、充分な性能を保証するためにはカメラ側に高性能のＣＰＵ（Central Processing Unit）やメモリが必要になる。 However, the above-described technology has a problem that it is impossible to achieve both a reduction in network load and a reduction in camera performance. This problem will be described in detail. First, when video analysis processing is performed by the module on the camera side, the data amount of the processing result becomes smaller than the original video data, so that the load on the network can be reduced. On the other hand, in order to execute the video analysis processing, generally high processing capability is required, and depending on the analysis processing, variation in load increases depending on the number of objects included in the video. Therefore, no matter what kind of video data is obtained, a high-performance CPU (Central Processing Unit) or memory is required on the camera side in order to guarantee sufficient performance.
　以上より、カメラと解析装置とがネットワークを介して接続された解析システムでは、ネットワーク負荷を削減しようとすると、カメラに必要な性能が増大するため、ネットワークの負荷削減とカメラの性能削減とを両立することができない、という問題が生じる。そして、かかる問題は、カメラを備えた解析システムのみならず、解析対象となるデータを取得する装置と解析処理を実行する装置とがネットワークを介して接続されて構成された解析システムにおいて生じうる。 As described above, in an analysis system in which a camera and an analysis device are connected via a network, reducing the network load increases the performance required for the camera, so both network load reduction and camera performance reduction are compatible. The problem of not being able to do arises. Such a problem may occur not only in an analysis system provided with a camera but also in an analysis system configured by connecting a device that acquires data to be analyzed and a device that executes analysis processing via a network.
　このため、本発明の目的は、上述した課題である、解析対象となるデータを取得するデータ取得装置と解析処理を実行する解析装置とがネットワークを介して接続されて構成された解析システムにおいて、ネットワークの負荷削減と解析対象データを取得する装置の性能削減とを両立することができない、ことを解決することにある。 For this reason, the object of the present invention is the analysis system configured by connecting the data acquisition device that acquires the data to be analyzed and the analysis device that executes the analysis process, which is the above-described problem, via a network. The object is to solve the problem that it is impossible to achieve both a reduction in the load on the network and a reduction in the performance of the device that acquires the analysis target data.
　本発明の一形態である解析システムは、
　相互にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置と、所定の解析処理を実行する解析処理装置と、を備え、
　前記解析対象データ取得装置は、取得した前記解析対象データに対する所定の解析処理を実行する第一解析手段と、取得した前記解析対象データに基づくデータを前記解析処理装置に送信するデータ送信手段と、を備え、
　前記解析処理装置は、前記解析対象データ取得装置から送信されたデータに対する所定の解析処理を実行する第二解析手段を備え、
　前記第一解析手段と前記第二解析手段とは、同等内容の解析処理を実行する解析部をそれぞれ備えており、
　前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する解析制御手段を備えた、
という構成をとる。 An analysis system according to one aspect of the present invention is:
An analysis target data acquisition device for acquiring analysis target data, connected to each other via a network, and an analysis processing device for executing a predetermined analysis process,
The analysis target data acquisition device includes a first analysis unit that executes a predetermined analysis process on the acquired analysis target data, a data transmission unit that transmits data based on the acquired analysis target data to the analysis processing unit, With
The analysis processing device includes second analysis means for executing a predetermined analysis process on the data transmitted from the analysis target data acquisition device,
The first analysis unit and the second analysis unit each include an analysis unit that executes an analysis process of equivalent content,
Among the analysis units provided in the first analysis means and the second analysis means, respectively, provided with an analysis control means for controlling either one or both to operate,
The configuration is as follows.
　また、本発明の他の形態である解析対象データ取得装置は、
　所定の解析処理を実行する解析処理装置にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置であって、
　取得した前記解析対象データに対する所定の解析処理を実行する第一解析手段と、
　取得した前記解析対象データに基づくデータを前記解析処理装置に送信するデータ送信手段と、を備え、
　前記第一解析手段は、前記解析処理装置が有する解析部と同等内容の解析処理を実行する別の解析部を備え、
　前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する解析制御手段を備えた、
という構成をとる。 Moreover, the analysis object data acquisition device according to another aspect of the present invention is
An analysis target data acquisition device for acquiring analysis target data, connected to an analysis processing device that executes a predetermined analysis process,
First analysis means for executing a predetermined analysis process on the acquired analysis target data;
Data transmission means for transmitting data based on the acquired analysis target data to the analysis processing device,
The first analysis means includes another analysis unit that executes an analysis process having the same content as the analysis unit included in the analysis processing device,
Among the analysis units provided in the first analysis means and the second analysis means, respectively, provided with an analysis control means for controlling either one or both to operate,
The configuration is as follows.
　また、本発明の他の形態であるプログラムは、
　所定の解析処理を実行する解析処理装置にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置に、
　取得した前記解析対象データに対する所定の解析処理を実行する第一解析手段と、
　取得した前記解析対象データに基づくデータを前記解析処理装置に送信するデータ送信手段と、
　前記第一解析手段と前記第二解析手段とがそれぞれ備える同等内容の解析処理を実行する各解析部のうち、いずれか一方あるいは両方が作動するよう制御する解析制御手段と、
を実現させるためのプログラムである。 Moreover, the program which is the other form of this invention is:
To the analysis target data acquisition device that acquires the analysis target data connected to the analysis processing device that executes the predetermined analysis processing via the network,
First analysis means for executing a predetermined analysis process on the acquired analysis target data;
Data transmission means for transmitting data based on the acquired analysis target data to the analysis processing device;
Analysis control means for controlling either one or both of the analysis units that perform analysis processing of equivalent contents respectively provided by the first analysis means and the second analysis means,
It is a program for realizing.
　また、本発明の他の形態である解析処理方法は、
　相互にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置と、所定の解析処理を実行する解析処理装置と、を備えた通信システムにて、
　前記解析対象データ取得装置が、取得した前記解析対象データに対する所定の解析処理を実行すると共に、取得した前記解析対象データに基づくデータを前記解析処理装置に送信し、
　前記解析処理装置が、前記解析対象データ取得装置から送信されたデータに対する所定の解析処理を実行し、
　前記解析対象データ取得装置及び前記解析処理装置は、それぞれ同等内容の解析処理を実行可能であり、前記解析対象データ取得装置及び前記解析処理装置のうちいずれか一方あるいは両方が、前記同等内容の解析処理を実行するよう制御する、
という構成をとる。 In addition, an analysis processing method according to another embodiment of the present invention includes:
In a communication system comprising an analysis target data acquisition device for acquiring analysis target data and an analysis processing device for executing a predetermined analysis process, which are connected to each other via a network,
The analysis target data acquisition device performs predetermined analysis processing on the acquired analysis target data, and transmits data based on the acquired analysis target data to the analysis processing device.
The analysis processing device performs a predetermined analysis process on the data transmitted from the analysis target data acquisition device,
The analysis target data acquisition device and the analysis processing device can each perform an analysis process of equivalent content, and either one or both of the analysis target data acquisition device and the analysis processing device analyze the equivalent content. Control to execute the process,
The configuration is as follows.
　本発明は、以上のように構成されることにより、解析対象となるデータを取得するデータ取得装置と解析処理を実行する解析装置とがネットワークを介して接続されて構成された解析システムにおいて、ネットワークの負荷削減と解析対象データを取得する装置の性能削減とを両立することができる。 The present invention is configured as described above so that a data acquisition device that acquires data to be analyzed and an analysis device that executes analysis processing are connected via a network. It is possible to achieve both the reduction of the load and the performance reduction of the apparatus for acquiring the analysis target data.
本発明の実施形態１における解析システムの構成を示すブロック図である。It is a block diagram which shows the structure of the analysis system in Embodiment 1 of this invention. 本発明の実施形態１における監視カメラの動作を示すフローチャートである。It is a flowchart which shows operation | movement of the surveillance camera in Embodiment 1 of this invention. 本発明の実施形態１における解析サーバの動作を示すフローチャートである。It is a flowchart which shows operation | movement of the analysis server in Embodiment 1 of this invention. 本発明の実施形態２における解析システムの構成を示すブロック図である。It is a block diagram which shows the structure of the analysis system in Embodiment 2 of this invention. 本発明の実施形態２における対応関係記憶部に記憶されたデータの一例を示す図である。It is a figure which shows an example of the data memorize | stored in the corresponding relationship memory | storage part in Embodiment 2 of this invention. 本発明の実施形態２における解析システムにおける処理状況を示す図である。It is a figure which shows the processing condition in the analysis system in Embodiment 2 of this invention. 本発明の実施形態３における解析システムの構成を示すブロック図である。It is a block diagram which shows the structure of the analysis system in Embodiment 3 of this invention. 本発明の実施形態３における解析システムにおける処理状況を示す図である。It is a figure which shows the processing condition in the analysis system in Embodiment 3 of this invention. 本発明の実施形態４における解析システムの構成を示すブロック図である。It is a block diagram which shows the structure of the analysis system in Embodiment 4 of this invention. 本発明の付記１における構成を示すブロック図である。It is a block diagram which shows the structure in the additional remark 1 of this invention.
　＜実施形態１＞
　本発明の第１の実施形態を、図１乃至図３を参照して説明する。図１は、本実施形態における解析システムの構成を説明するための図であり、図２乃至図３は、解析システムの動作を説明するための図である。 <Embodiment 1>
A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a diagram for explaining the configuration of the analysis system in the present embodiment, and FIGS. 2 to 3 are diagrams for explaining the operation of the analysis system.
　［構成］
　本実施形態における解析システムは、映像監視システムであり、図１に示すように、解析対象となる映像データを取得する監視カメラ１（解析対象データ取得装置）と、解析処理を行う解析サーバ２（解析処理装置）と、を備えている。そして、監視カメラ１と解析サーバ２とは、インターネット網やＬＡＮ（Local Area Network）などのネットワーク３を介して接続されている。なお、本発明における解析システムは、以下に説明するような映像監視システムであることに限定されず、音声データなど他の解析対象データを取得する解析対象データ取得装置と、他の解析処理を行う解析処理装置と、がネットワークを介して接続されて構成されていてもよい。また、ネットワーク３は、無線有線を問わず、いかなるネットワークであってもよい。 [Constitution]
The analysis system in this embodiment is a video surveillance system, and as shown in FIG. 1, a monitoring camera 1 (analysis target data acquisition device) that acquires video data to be analyzed and an analysis server 2 (analysis processing data acquisition device) Analysis processing device). The monitoring camera 1 and the analysis server 2 are connected via a network 3 such as the Internet network or a LAN (Local Area Network). The analysis system according to the present invention is not limited to the video surveillance system described below, and performs other analysis processing with an analysis target data acquisition device that acquires other analysis target data such as audio data. The analysis processing apparatus may be configured to be connected via a network. Further, the network 3 may be any network regardless of wireless wired.
　上記監視カメラ１は、演算装置及び記憶装置を備えると共に、図１に示すように、映像取得部１１と、第１映像解析部１２と、カメラ制御部１３と、第１負荷判定部１４と、を備えている。そして、第１映像解析部１２とカメラ制御部１３と第１負荷判定部１４とは、演算装置にプログラムが組み込まれることで構築される。 The monitoring camera 1 includes an arithmetic device and a storage device, and as shown in FIG. 1, a video acquisition unit 11, a first video analysis unit 12, a camera control unit 13, a first load determination unit 14, It has. The first video analysis unit 12, the camera control unit 13, and the first load determination unit 14 are constructed by incorporating a program into the arithmetic device.
　上記映像取得部１１は、映像を撮影するカメラモジュールを備えており、撮影した映像である動画像や静止画像を映像データとしてデータ化する処理部も備えている。そして、映像取得部１１は、カメラ制御部１３にて動作を制御されることにより、映像データを取得し、取得した映像データを第１映像解析部１２に出力する。 The video acquisition unit 11 includes a camera module that captures video, and also includes a processing unit that converts moving images and still images that are the captured video as video data. Then, the video acquisition unit 11 acquires video data by the operation being controlled by the camera control unit 13, and outputs the acquired video data to the first video analysis unit 12.
　上記第１映像解析部１２（第一解析手段）は、映像取得部１１にて取得した映像データに対する解析処理を実行する。具体的に、第１映像解析部１２は、所定の解析処理を実行する解析モジュール（解析部）を１つ以上含み、当該解析モジュールの全部あるいは一部だけを実行する。例えば、解析モジュールは、映像データから人間の顔部分を抽出する処理や、顔画像から顔特徴データを抽出する処理などの解析処理を行うものである。但し、第１映像解析部１２は、後述するように、解析モジュールによる解析処理を１つも実行しない場合もある。そして、第１映像解析部１２は、解析結果及び／又は解析処理前のデータを、カメラ制御部１３に出力する。なお、第１映像解析部１２の動作は、カメラ制御部１３にて制御される。 The first video analysis unit 12 (first analysis means) executes analysis processing on the video data acquired by the video acquisition unit 11. Specifically, the first video analysis unit 12 includes one or more analysis modules (analysis units) that execute predetermined analysis processing, and executes all or only a part of the analysis modules. For example, the analysis module performs analysis processing such as processing for extracting a human face portion from video data and processing for extracting face feature data from a face image. However, as will be described later, the first video analysis unit 12 may not perform any analysis processing by the analysis module. Then, the first video analysis unit 12 outputs the analysis result and / or the data before the analysis process to the camera control unit 13. The operation of the first video analysis unit 12 is controlled by the camera control unit 13.
　ここで、上記第１映像解析部１２が有する解析モジュールのうち、少なくとも１つは、後述する解析サーバ２が備える第２映像解析部２２が有する解析モジュール（第２の代替可能解析モジュール）と同等内容の解析処理を実行する第１の代替可能解析モジュールである。このとき、第１の代替可能解析モジュールと第２の代替可能解析モジュールとは、同一の解析モジュールであってもよく、同等内容の解析処理を実行して同等の解析結果を得ることができる別の解析モジュールであってもよい。 Here, at least one of the analysis modules included in the first video analysis unit 12 is equivalent to the analysis module (second substitutable analysis module) included in the second video analysis unit 22 included in the analysis server 2 described later. It is the 1st substitutable analysis module which performs analysis processing of contents. At this time, the first substitutable analysis module and the second substitutable analysis module may be the same analysis module, and the same analysis result can be obtained by executing the analysis process of the same content. The analysis module may be used.
　上記第１負荷判定部１４（判定手段）は、監視カメラ１における負荷を測定し、負荷レベルを判定する。例えば、監視カメラ１が装備する演算装置全体の処理負荷を計測してもよく、第１映像解析部１２の処理負荷を計測してもよい。そして、計測した負荷のレベルを、予め設定された基準に基づいて判定する。例えば、基準値として、低レベル基準値と高レベル基準値とが設定されており、計測した負荷が低レベル基準値よりも低い場合には、負荷レベルが低レベルであると判定し、計測した負荷が高レベル基準値よりも高い場合には、負荷レベルが高レベルであると判定し、いずれでもない場合には、その他のレベルであると判定する。そして、第１負荷判定部１４は、判定した負荷レベルをカメラ制御部１３に出力する。 The first load determination unit 14 (determination means) measures the load in the monitoring camera 1 and determines the load level. For example, the processing load of the entire arithmetic device equipped in the monitoring camera 1 may be measured, or the processing load of the first video analysis unit 12 may be measured. Then, the measured load level is determined based on a preset criterion. For example, when the low level reference value and the high level reference value are set as the reference value, and the measured load is lower than the low level reference value, the load level is determined to be low and measured. When the load is higher than the high level reference value, it is determined that the load level is a high level, and when it is not any, it is determined that the load level is other level. Then, the first load determination unit 14 outputs the determined load level to the camera control unit 13.
　なお、本実施形態における第１負荷判定部１４は、監視カメラ１における演算装置の処理負荷を当該監視カメラ１の負荷として計測する場合を説明するが、別の方法で監視カメラ１の負荷を計測して、その負荷レベルを判定してもよい。例えば、監視カメラ１に装備されたメモリの使用量や、監視カメラ１にて実行される処理の遅延状況、監視カメラ１に対するデータの入出力量、監視カメラ１が接続されているネットワークの状況など、監視カメラ１の作動状況を表す情報から当該監視カメラ１の負荷を計測して、予め設定された基準に基づいてそのレベルを判定してもよい。 In addition, although the 1st load determination part 14 in this embodiment demonstrates the case where the processing load of the arithmetic unit in the monitoring camera 1 is measured as a load of the said monitoring camera 1, it measures the load of the monitoring camera 1 by another method. Then, the load level may be determined. For example, the amount of memory used in the surveillance camera 1, the delay status of processing executed by the surveillance camera 1, the amount of data input / output to / from the surveillance camera 1, the status of the network to which the surveillance camera 1 is connected, etc. You may measure the load of the said monitoring camera 1 from the information showing the operating condition of the monitoring camera 1, and may determine the level based on the preset reference | standard.
　上記カメラ制御部１３（解析制御手段、データ送信手段）は、第１負荷判定部１４から出力された監視カメラ１の負荷レベルに基づいて、カメラ制御部１２の動作を制御する。これと共に、カメラ制御部１３は、解析サーバ２とのデータ通信を制御する。 The camera control unit 13 (analysis control unit, data transmission unit) controls the operation of the camera control unit 12 based on the load level of the monitoring camera 1 output from the first load determination unit 14. At the same time, the camera control unit 13 controls data communication with the analysis server 2.
　具体的に、カメラ制御部１３は、まず、通常状態では、第１映像解析部１２にて予め設定された解析モジュールによる解析処理及び第１の代替可能解析モジュールによる解析処理が実行されるよう制御すると共に、第１映像解析部１２による解析結果のデータ、つまり、第１の代替可能解析モジュールによる解析結果のデータを、ネットワークを介して解析サーバ２に送信する。そして、カメラ制御部１３は、上記解析処理や送信処理を実行しつつ、第１負荷判定部１４から出力された監視カメラ１の負荷レベルを調べ、当該負荷レベルが「高負荷レベル」ではない場合には、そのままの制御となる。 Specifically, the camera control unit 13 first performs control so that the analysis process by the analysis module preset by the first video analysis unit 12 and the analysis process by the first substitutable analysis module are executed in the normal state. At the same time, the analysis result data by the first video analysis unit 12, that is, the analysis result data by the first substitutable analysis module is transmitted to the analysis server 2 via the network. Then, the camera control unit 13 checks the load level of the monitoring camera 1 output from the first load determination unit 14 while executing the analysis process and the transmission process, and the load level is not “high load level”. In this case, the control is performed as it is.
　一方、カメラ制御部１３は、第１負荷判定部１４から出力された監視カメラ１の負荷レベルが「高負荷レベル」となった場合には、第１映像解析部１２で作動している解析モジュールのうち、上述した第１の代替可能解析モジュールの動作を停止するよう制御する。これに伴い、カメラ制御部１３は、上記第１の代替可能解析モジュールで解析処理される予定のデータを、解析サーバ２にネットワークを介して送信する。さらに、カメラ制御部１３は、第１の代替可能解析モジュールの動作を停止した旨、つまり、当該第１の代替可能解析モジュールによる解析処理と同等内容の解析処理を解析サーバ２で実行する旨の指示を、当該解析サーバ２に送信する。 On the other hand, when the load level of the monitoring camera 1 output from the first load determination unit 14 becomes “high load level”, the camera control unit 13 operates the analysis module operating in the first video analysis unit 12. Among these, control is performed to stop the operation of the first substitutable analysis module described above. Accordingly, the camera control unit 13 transmits data to be analyzed by the first substitutable analysis module to the analysis server 2 via the network. Further, the camera control unit 13 indicates that the operation of the first substitutable analysis module has been stopped, that is, the analysis server 2 executes analysis processing having the same content as the analysis processing by the first substitutable analysis module. The instruction is transmitted to the analysis server 2.
　なお、カメラ制御部１３は、第１映像解析部１２で第１の代替可能解析モジュールの動作が停止されている際に、第１負荷判定部１４から出力された監視カメラ１の負荷レベルが「低負荷レベル」となった場合には、第１映像解析部１２で停止している上記第１の代替可能解析モジュールの動作を再開させるよう制御する。これに伴い、カメラ制御部１３は、第１映像解析部１２による解析結果のデータをネットワークを介して解析サーバ２に送信する。また、カメラ制御部１３は、第１の代替可能解析モジュールの動作を再開した旨、つまり、当該第１の代替可能解析モジュールによる解析処理と同等内容の解析処理を解析サーバ２で停止する旨の指示を、当該解析サーバ２に送信する。 The camera control unit 13 indicates that the load level of the monitoring camera 1 output from the first load determination unit 14 is “when the operation of the first substitutable analysis module is stopped by the first video analysis unit 12. When the load level is “low load level”, the first video analysis unit 12 is controlled to resume the operation of the first substitutable analysis module stopped. Accordingly, the camera control unit 13 transmits the data of the analysis result by the first video analysis unit 12 to the analysis server 2 via the network. In addition, the camera control unit 13 indicates that the operation of the first substitutable analysis module has been resumed, that is, the analysis server 2 stops the analysis processing having the same content as the analysis processing by the first substitutable analysis module. The instruction is transmitted to the analysis server 2.
　次に、解析サーバ２の構成について説明する。解析サーバ２は、演算装置及び記憶装置を備えた一般的な情報処理装置（解析処理装置）であり、１台又は複数台の情報処理装置で構成されている。そして、解析サーバ２は、演算装置にプログラムが組み込まれることで構築された、結果出力部２１と、第２映像解析部２２と、サーバ制御部２３と、を備えている。 Next, the configuration of the analysis server 2 will be described. The analysis server 2 is a general information processing device (analysis processing device) including an arithmetic device and a storage device, and is configured by one or a plurality of information processing devices. And the analysis server 2 is provided with the result output part 21, the 2nd image | video analysis part 22, and the server control part 23 constructed | assembled by incorporating a program in an arithmetic unit.
　上記結果出力部２１は、後述する第２映像解析部２２による解析処理結果を、モニタやプリンタなどの出力装置を介して出力する。 The result output unit 21 outputs an analysis processing result by a second video analysis unit 22 described later via an output device such as a monitor or a printer.
　上記第２映像解析部２２（第二解析手段）は、監視カメラ１からネットワーク３を介して送信されたデータに対する解析処理を実行する。具体的に、第２映像解析部２２は、所定の解析処理を実行する解析モジュール（解析部）を１つ以上含み、当該解析モジュールの全部あるいは一部だけを実行する。例えば、解析モジュールは、顔画像から顔特徴データを抽出する処理や、顔特徴データから特定の顔を照合する処理などの解析処理を行うものである。そして、第２映像解析部２２は、解析結果を結果出力部２１に出力する。なお、第２映像解析部２２の動作は、サーバ制御部２３にて制御される。 The second video analysis unit 22 (second analysis means) executes analysis processing on data transmitted from the monitoring camera 1 via the network 3. Specifically, the second video analysis unit 22 includes one or more analysis modules (analysis units) that execute predetermined analysis processing, and executes all or only a part of the analysis modules. For example, the analysis module performs analysis processing such as processing for extracting face feature data from a face image and processing for matching a specific face from face feature data. Then, the second video analysis unit 22 outputs the analysis result to the result output unit 21. The operation of the second video analysis unit 22 is controlled by the server control unit 23.
　ここで、上記第２映像解析部２２が有する解析モジュールのうち、少なくとも１つは、上述した監視カメラ１が備える第１映像解析部１２が有する解析モジュール（第１の代替可能解析モジュール）と同等内容の解析処理を実行する第２の代替可能解析モジュールである。このとき、上述したように、第２の代替可能解析モジュールと第１の代替可能解析モジュールとは、同一の解析モジュールであってもよく、同等内容の解析処理を実行して同等の解析結果を得ることができる別の解析モジュールであってもよい。 Here, at least one of the analysis modules included in the second video analysis unit 22 is equivalent to the analysis module (first substitutable analysis module) included in the first video analysis unit 12 included in the monitoring camera 1 described above. It is a 2nd substitutable analysis module which performs analysis processing of contents. At this time, as described above, the second substitutable analysis module and the first substitutable analysis module may be the same analysis module, and an analysis process having the same content is executed to obtain an equivalent analysis result. It may be another analysis module that can be obtained.
　また、対応関係保存部４１は、上記第２の代替可能解析モジュールと第１の代替可能解析モジュールとの対応関係を表す情報を記憶しており、解析サーバ２に接続された記憶装置に構築されている。具体的に、対応関係保存部４１には、相互に対応する第１の代替可能解析モジュールと第２の代替可能解析モジュールとをそれぞれ特定する情報が関連付けられて記憶されており、さらに、各代替可能解析モジュールの実行時に設定されるパラメータなどの実行方法も記憶されている。なお、図１の例では、対応関係保存部２が解析サーバ２に接続された装置内に装備されている場合を示しているが、解析サーバ２内に装備されていてもよく、さらに他の場所に装備されていてもよい。 The correspondence storage unit 41 stores information representing the correspondence between the second substitutable analysis module and the first substitutable analysis module, and is constructed in a storage device connected to the analysis server 2. ing. Specifically, the correspondence relationship storage unit 41 stores information for identifying the first substitutable analysis module and the second substitutable analysis module corresponding to each other in association with each other. Execution methods such as parameters set when executing the possibility analysis module are also stored. In addition, although the example of FIG. 1 has shown the case where the correspondence storage part 2 is equipped in the apparatus connected to the analysis server 2, it may be equipped in the analysis server 2, and other It may be equipped at the place.
　上記サーバ制御部２３（解析制御手段）は、監視カメラ１から送信された情報と、対応関係保存部４１内の情報に基づいて、第２映像解析部２２の動作を制御する。これと共に、サーバ制御部２３は、監視カメラ１とのデータ通信を制御する。 The server control unit 23 (analysis control unit) controls the operation of the second video analysis unit 22 based on the information transmitted from the monitoring camera 1 and the information in the correspondence storage unit 41. At the same time, the server control unit 23 controls data communication with the monitoring camera 1.
　具体的に、サーバ制御部２３は、まず、通常状態では、監視カメラ１から送信されたデータに対して、第２映像解析部２２にて予め設定された解析モジュール、及び、第２の代替可能解析モジュールによる解析処理が実行されるよう制御すると共に、解析結果を結果出力部２１に出力する。かかる状態で、サーバ制御部２３は、監視カメラ１の負荷レベルが「高負荷レベル」ではない場合には、そのままの制御となる。 Specifically, the server control unit 23 first, in a normal state, analyzes data set in advance by the second video analysis unit 22 with respect to data transmitted from the monitoring camera 1, and a second alternative is possible. The analysis process by the analysis module is controlled to be executed, and the analysis result is output to the result output unit 21. In this state, when the load level of the monitoring camera 1 is not “high load level”, the server control unit 23 performs the control as it is.
　一方、サーバ制御部２３は、監視カメラ１の負荷レベルが「高負荷レベル」となった場合には、上述したように監視カメラ１から第１の代替可能解析モジュールによる解析処理と同等内容の解析処理を解析サーバ２で実行する旨の指示が送信されるため、かかる指示に応じて、第２の代替可能解析モジュールによる解析処理を実行するよう制御する。このとき、サーバ制御部２３は、監視カメラ１から当該監視カメラ１側で解析処理を停止した第１の代替可能解析モジュールを特定する情報を受け付け、当該第１の代替可能解析処理モジュールに対応する第２の代替可能解析処理モジュールを、対応関係記憶部４１の情報から特定して、実行するよう制御する。 On the other hand, when the load level of the monitoring camera 1 becomes “high load level”, the server control unit 23 analyzes the same content as the analysis process from the monitoring camera 1 by the first substitutable analysis module as described above. Since an instruction to execute the process in the analysis server 2 is transmitted, control is performed so that the analysis process by the second substitutable analysis module is executed in accordance with the instruction. At this time, the server control unit 23 receives information specifying the first substitutable analysis module that has stopped the analysis processing on the monitoring camera 1 side from the monitoring camera 1 and corresponds to the first substitutable analysis processing module. The second substitutable analysis processing module is specified from the information in the correspondence storage unit 41 and controlled to be executed.
　なお、サーバ制御部２３は、第２映像解析部２２で第２の代替可能解析モジュールが実行されている際に、監視カメラ１の負荷レベルが「低付加レベル」となった場合には、上述したように監視カメラ１から第２の代替可能解析モジュールの停止指示を受け、当該第２の代替可能解析モジュールによる解析処理を停止するよう制御する。 In addition, when the load level of the monitoring camera 1 becomes the “low addition level” when the second substitutable analysis module is being executed by the second video analysis unit 22, the server control unit 23 is configured as described above. As described above, the instruction to stop the second substitutable analysis module is received from the monitoring camera 1, and the analysis processing by the second substitutable analysis module is controlled to stop.
　［動作］
　次に、上述した映像解析システムの構成を、図２及び図３のフローチャートを参照して説明する。はじめに、監視カメラ１の動作を、図２を参照して説明する。 [Operation]
Next, the configuration of the video analysis system described above will be described with reference to the flowcharts of FIGS. First, the operation of the monitoring camera 1 will be described with reference to FIG.
　まず、通常の状態では、解析カメラ１の第１映像解析部１２にて第１の代替可能解析モジュールによる解析処理が実行されており、これと同等内容の解析処理を行う第２の代替可能解析モジュールによる解析処理は、解析サーバ２の第２映像解析部２２では実行されていない。 First, in a normal state, the first video analysis unit 12 of the analysis camera 1 performs analysis processing by the first substitutable analysis module, and the second substitutable analysis that performs analysis processing equivalent to this is performed. The analysis process by the module is not executed by the second video analysis unit 22 of the analysis server 2.
　上述した状況において、監視カメラ１は、第１負荷判定部１４が監視カメラ１の負荷を判定する（ステップＳ１）。なお、判定のタイミングは、一定間隔や特定の時刻、処理の開始終了のタイミングなど、システムの要件に基づいて設定して良い。 In the situation described above, in the monitoring camera 1, the first load determination unit 14 determines the load of the monitoring camera 1 (step S1). Note that the determination timing may be set based on system requirements such as a fixed interval, a specific time, and a start / end timing of processing.
　そして、第１負荷判定部１４による判定の結果、「高負荷レベル」と判定された場合には（ステップＳ２で「高負荷」）、カメラ制御部１３が第１映像解析部１２で実行されている解析処理のうち停止できるものを選択し（ステップＳ３）、解析サーバ２に同等の処理の実行を依頼する（ステップＳ４）。このとき、カメラ制御部１３は、第１映像解析部１２で実行されている第１の代替可能解析モジュールによる解析処理を停止できるものとして選択し、当該第１の代替可能解析モジュールを停止する旨を解析サーバ２に通知する。そして、カメラ制御部１３は、解析サーバ２から第１の代替可能解析モジュールと同等の解析処理が実行可能である旨の通知を受けると（ステップＳ５で「ＯＫ」）、第１の代替可能解析モジュールによる解析処理を停止する（ステップＳ６）。このとき、カメラ制御部１３は、第１の代替可能解析モジュールにより解析処理が停止されたことに伴い、当該第１の代替可能解析処理モジュールにて解析処理されるはずのデータを、解析サーバ２に送信する。 If the result of determination by the first load determination unit 14 is “high load level” (“high load” in step S2), the camera control unit 13 is executed by the first video analysis unit 12. The analysis process that can be stopped is selected (step S3), and the analysis server 2 is requested to execute the equivalent process (step S4). At this time, the camera control unit 13 selects that the analysis process by the first substitutable analysis module executed in the first video analysis unit 12 can be stopped, and stops the first substitutable analysis module. Is sent to the analysis server 2. When the camera control unit 13 receives a notification from the analysis server 2 that analysis processing equivalent to that of the first substitutable analysis module can be executed (“OK” in step S5), the first substitutable analysis is performed. The analysis process by the module is stopped (step S6). At this time, the camera control unit 13 sends the data to be analyzed by the first substitutable analysis processing module to the analysis server 2 when the analysis processing is stopped by the first substitutable analysis module. Send to.
　ここで、上述した監視カメラ１の動作に応じた解析サーバ２の動作を、図３を参照して説明する。サーバ制御部２３は、監視カメラ１からの処理依頼を受け取ると（ステップＳ１１）、その種類に応じた処理を行う（ステップ１２，Ｓ１３，Ｓ１５）。具体的に、上記図２のステップＳ４のように、監視カメラ１から第１の代替可能解析モジュールと同等の解析処理の実行の依頼を受けると（ステップＳ１１で「処理実行」）、まず、対応関係保存部４１内から第１の代替可能解析モジュールと同等の解析処理を実行する解析モジュールである第２の代替可能解析モジュールを特定する。そして、特定した第２の代替可能解析モジュールによる解析処理を解析サーバ２にて実行可能か否かを当該解析サーバ２の状況などに応じて判定し（ステップＳ１２）、実行可能であれば（ステップＳ１２で「可能」）、第２の代替可能解析モジュールによる解析処理を実行する（ステップＳ１３）。そして、解析サーバ２は、第２の代替可能解析モジュールを含む第２映像解析部２２による解析処理の結果を、結果出力部２１から出力する（ステップＳ１４）。 Here, the operation of the analysis server 2 according to the operation of the monitoring camera 1 described above will be described with reference to FIG. When the server control unit 23 receives a processing request from the monitoring camera 1 (step S11), the server control unit 23 performs processing according to the type (step 12, S13, S15). Specifically, as in step S4 in FIG. 2, when a request for execution of analysis processing equivalent to that of the first substitutable analysis module is received from the monitoring camera 1 ("execution of processing" in step S11), first, A second substitutable analysis module that is an analysis module that executes analysis processing equivalent to that of the first substitutable analysis module is specified from within the relationship storage unit 41. Then, it is determined whether or not the analysis process by the specified second substitutable analysis module can be executed by the analysis server 2 according to the situation of the analysis server 2 (step S12). The analysis processing by the second substitutable analysis module is executed (step S13). And the analysis server 2 outputs the result of the analysis process by the 2nd image | video analysis part 22 containing a 2nd substitutable analysis module from the result output part 21 (step S14).
　次に、監視カメラ１の動作に戻り、第１負荷判定部１４により「低負荷状態」と判定された場合（ステップＳ２で「低負荷」）を説明する。この場合には、第１映像解析部１２で停止されている解析処理のうち、実行できるものを選択する（ステップＳ７）。このとき、カメラ制御部１３は、第１映像解析部１２で停止している第１の代替可能解析モジュールによる解析処理を開始できるものとして選択し、当該第１の代替可能解析モジュールと同等の処理を停止するよう解析サーバ２に依頼する（ステップＳ８）。そして、カメラ制御部１３は、解析サーバ２から第１の代替可能解析モジュールと同等の解析処理を停止可能である旨の通知を受けると（ステップＳ９で「ＯＫ」）、第１の代替可能解析モジュールによる解析処理を再開する（ステップＳ１０）。 Next, returning to the operation of the monitoring camera 1, the case where the first load determination unit 14 determines “low load state” (“low load” in step S2) will be described. In this case, an analysis process that can be executed is selected from the analysis processes stopped by the first video analysis unit 12 (step S7). At this time, the camera control unit 13 selects that the analysis process by the first substitutable analysis module stopped by the first video analysis unit 12 can be started, and a process equivalent to the first substitutable analysis module. Is requested to the analysis server 2 to stop (step S8). When the camera control unit 13 receives a notification from the analysis server 2 that analysis processing equivalent to that of the first substitutable analysis module can be stopped (“OK” in step S9), the first substitutable analysis is performed. The analysis process by the module is resumed (step S10).
　ここで、上述した監視カメラ１の動作に応じた解析サーバ２の動作を、図３を参照して説明する。サーバ制御部２３は、監視カメラ１から第１の代替可能解析モジュールと同等の解析処理の停止依頼を受けると（ステップＳ１１で「処理停止」）、解析サーバ２にて実行している解析モジュールのうち、対応関係保存部４１内から第１の代替可能解析モジュールと同等の解析処理を実行する解析モジュールである第２の代替可能解析モジュールを特定する。そして、サーバ制御部２３は、特定した第２の代替可能解析モジュールによる解析処理を停止する（ステップＳ１５）。なお、解析サーバ２は、第２の代替可能解析モジュールを含む第２映像解析部２２による解析処理の結果を、結果出力部２１から出力する（ステップＳ１４）。 Here, the operation of the analysis server 2 according to the operation of the monitoring camera 1 described above will be described with reference to FIG. When the server control unit 23 receives a request to stop the analysis process equivalent to the first substitutable analysis module from the monitoring camera 1 (“process stop” in step S11), the server control unit 23 receives the analysis module executed by the analysis server 2 Among these, the second substitutable analysis module, which is an analysis module that executes an analysis process equivalent to that of the first substitutable analysis module, is specified from the correspondence storage unit 41. Then, the server control unit 23 stops the analysis process by the specified second substitutable analysis module (step S15). The analysis server 2 outputs the result of the analysis processing by the second video analysis unit 22 including the second substitutable analysis module from the result output unit 21 (step S14).
　以上のように、本実施形態における映像解析システムによると、監視カメラ１の第１負荷判定部１４による当該監視カメラ１の負荷の判定結果に応じて、同等内容の解析処理を実行する解析処理モジュールによる特定の解析処理が、監視カメラ１か解析サーバ２のいずれか一方で作動することとなる。このため、通常は、監視カメラ１上で特定の解析処理が実行されることにより、かかる特定の解析処理の結果のみがネットワークＮを介して解析サーバ２に送信されるため、ネットワーク３の負荷が軽減される。一方で、監視カメラ１の負荷が高くなった場合には、上記特定の解析処理の実行が監視カメラ１から解析サーバ２に切り替わるため、解析システム全体としては特定の解析処理を継続することができる。従って、ネットワーク３の負荷を削減しつつ、監視カメラ１の性能削減を図ることができ、性能向上と設備コストの抑制を両立した解析システムを構築することができる。 As described above, according to the video analysis system of the present embodiment, the analysis processing module that executes the analysis processing of the equivalent content according to the determination result of the load of the monitoring camera 1 by the first load determination unit 14 of the monitoring camera 1. The specific analysis process according to is operated by either the monitoring camera 1 or the analysis server 2. For this reason, normally, when a specific analysis process is executed on the surveillance camera 1, only the result of the specific analysis process is transmitted to the analysis server 2 via the network N. It is reduced. On the other hand, when the load on the monitoring camera 1 is increased, the execution of the specific analysis process is switched from the monitoring camera 1 to the analysis server 2, and therefore the specific analysis process can be continued as the entire analysis system. . Accordingly, it is possible to reduce the performance of the monitoring camera 1 while reducing the load on the network 3, and to construct an analysis system that achieves both improvement in performance and reduction in equipment costs.
　なお、上記では、同等内容の解析処理を実行する第１の代替可能解析モジュールと第２の代替可能解析モジュールとのうち、いずれか一方のみによる解析処理が実行されるよう制御する場合を例示したが、両方が同時に解析処理を実行するよう、カメラ制御部１３及びサーバ制御部２３が制御してもよい。これにより、解析処理されるデータのうち一部が監視カメラ１により解析処理され、残りが解析サーバ２にて解析処理されることとなり、システム全体における負荷分散を図ることができる。 In addition, in the above, the case where control is performed so that the analysis process by only one of the first substitutable analysis module and the second substitutable analysis module that executes the analysis process of the same content is executed is illustrated. However, the camera control unit 13 and the server control unit 23 may control such that both perform analysis processing simultaneously. As a result, part of the data to be analyzed is analyzed by the monitoring camera 1 and the rest is analyzed by the analysis server 2, and load distribution in the entire system can be achieved.
　＜実施形態２＞
　次に、本発明の第２の実施形態を、図４乃至図６を参照して説明する。図４は、本実施形態における映像解析システムの構成を示すブロック図であり、図５は、映像解析システムに記憶されるデータの一例を示す図である。図６は、映像解析システムによる解析処理の様子を説明するための図である。なお、本実施形態は、実施形態１で説明した映像解析システムの具体的な構成及び動作の一例を示すものであり、例えば、映像監視システムを、予め登録した人物が監視カメラ１の映像に映ったときにアラームを出す、といった登録者通知システムに適用する例を示している。 <Embodiment 2>
Next, a second embodiment of the present invention will be described with reference to FIGS. FIG. 4 is a block diagram showing the configuration of the video analysis system in the present embodiment, and FIG. 5 is a diagram showing an example of data stored in the video analysis system. FIG. 6 is a diagram for explaining the state of analysis processing by the video analysis system. This embodiment shows an example of the specific configuration and operation of the video analysis system described in the first embodiment. For example, a person who has registered a video monitoring system in the video of the surveillance camera 1 is shown in the video. In this example, the system is applied to a registrant notification system in which an alarm is issued when an error occurs.
　まず、本実施形態における映像解析システムによる解析処理の流れを、図６を参照して説明する。映像解析システムは、まず、監視カメラ１にて取得した映像データ７１に対して人物の顔の部分を抽出する顔抽出処理７２を行い、顔画像データ７３を出力する。続いて、映像解析システムは、顔画像データ７３に対して目や鼻の位置など顔の特徴を抽出する顔特徴抽出処理７４を行い、顔特徴データ７５を出力する。さらに、映像解析システムは、顔特徴データ７５を顔データベース内のデータと照合して、当該顔データベースに登録された人物かどうかを判定する顔照合処理７６を行い、照合結果７７を出力する。 First, the flow of analysis processing by the video analysis system in this embodiment will be described with reference to FIG. The video analysis system first performs face extraction processing 72 for extracting a human face portion on the video data 71 acquired by the monitoring camera 1, and outputs face image data 73. Subsequently, the video analysis system performs a facial feature extraction process 74 that extracts facial features such as the positions of eyes and noses on the facial image data 73, and outputs facial feature data 75. Further, the video analysis system collates the face feature data 75 with the data in the face database, performs face collation processing 76 for determining whether the person is registered in the face database, and outputs a collation result 77.
　上述した解析処理を実現すべく、本実施形態における監視カメラ１の第１映像解析部１２は、図４に示すように、上述した顔抽出処理７２を行う顔抽出モジュール１２ａと、上述した顔特徴抽出処理を７４行う顔特徴抽出モジュール１２ｂと、を備えている。また、解析サーバ２の第２映像解析部２２は、上述した顔特徴抽出処理７４を行う顔特徴抽出モジュール２２ａと、上述した顔照合処理７６を行う顔照合モジュール２２ｂと、を備えている。 In order to realize the above-described analysis processing, the first video analysis unit 12 of the monitoring camera 1 according to the present embodiment includes a face extraction module 12a that performs the above-described face extraction processing 72 as shown in FIG. And a facial feature extraction module 12b that performs 74 extraction processes. The second video analysis unit 22 of the analysis server 2 includes a face feature extraction module 22a that performs the above-described face feature extraction processing 74 and a face matching module 22b that performs the above-described face matching processing 76.
　ここで、上記第１映像解析部１２が備える顔特徴抽出モジュール１２ｂと、第２映像解析部２２が備える顔特徴抽出モジュール２２ａとは、同等内容の解析処理を行う解析モジュールであって、機能的には同一である。なお、各顔特徴抽出モジュール１２ｂ，２２ａは、完全に同じモジュールであってもよいが、全く同じものであるとは限らない。例えば、監視カメラ１と解析サーバ２にて稼働するＯＳ（Operating System）が異なっている場合には、各ＯＳに対応したモジュールであってもよく、全く別のモジュールであってもよい。 Here, the facial feature extraction module 12b included in the first video analysis unit 12 and the facial feature extraction module 22a included in the second video analysis unit 22 are analysis modules that perform analysis processing of equivalent contents, and are functional. Are the same. The facial feature extraction modules 12b and 22a may be completely the same module, but are not necessarily the same. For example, when the OS (Operating System) operating on the monitoring camera 1 and the analysis server 2 are different, the modules may correspond to the respective OSs or may be completely different modules.
　そして、上記顔特徴モジュール１２ｂ，２２ａの対応関係は、図５に示す対応関係保存部４１内のデータのように記憶されている。具体的に、図５に示す対応関係保存部４１内のデータには、監視カメラ１毎（カメラＩＤ毎）に、当該監視カメラ１に搭載れている解析モジュール（第１の代替可能解析モジュール）と同等内容の解析処理を行う解析サーバ２に搭載された解析モジュール（第２の代替可能解析モジュール）とが、対応付けられて登録されている。例えば、図５の上から２番目に登録されている項目にみると（図５の符号４１ａ参照）を例にとると、監視カメラ１（Ｃ１）に搭載された「顔特徴抽出」モジュールを「-mode 1」というパラメータを付けて実行する場合と、解析サーバ２に搭載された「顔検査」モジュールを「２０」というパラメータで実行する場合とが、同等内容の解析処理として関連付けて登録されている。つまり、相互に対応付けられた解析処理のいずれを行っても、同等の解析結果を得ることができる。なお、本実施形態においては、図４に示すように、対応関係保存部４１が解析サーバ２内に装備されているが、いかなる位置に装備されていてもよい。 The correspondence relationship between the face feature modules 12b and 22a is stored as data in the correspondence storage unit 41 shown in FIG. Specifically, the data in the correspondence storage unit 41 shown in FIG. 5 includes, for each monitoring camera 1 (for each camera ID), an analysis module (first substitutable analysis module) mounted on the monitoring camera 1. And an analysis module (second substitutable analysis module) mounted on the analysis server 2 that performs an analysis process having the same content as that in FIG. For example, in the second registered item from the top in FIG. 5 (see reference numeral 41a in FIG. 5), the “face feature extraction” module installed in the surveillance camera 1 (C1) is “ -mode 1 ”is executed with the parameter“ 20 ”, and the case where the“ face inspection ”module installed in the analysis server 2 is executed with the parameter“ 20 ”is registered in association with the analysis processing of the same content. Yes. That is, an equivalent analysis result can be obtained by performing any of the analysis processes associated with each other. In the present embodiment, as shown in FIG. 4, the correspondence storage unit 41 is installed in the analysis server 2, but may be installed at any position.
　上述した構成にすることで、本実施形態における映像解析システムでは、図６に示す顔特徴抽出処理７４を、監視カメラ１と解析サーバ２のいずれでも実行することができる。そして、顔特徴抽出処理７４を監視カメラ１で実行した場合には、当該監視カメラ１から解析サーバ２に顔特徴データ７５が送信されるが、顔特徴抽出処理７４を解析サーバ２で実行した場合には、監視カメラ１から解析サーバ２に顔画像データ７３が送信されることとなる。このとき、一般的に、監視カメラ１から出力されるデータ量は、顔画像データ７３よりも顔特徴データ７５の方が少なくなるので、顔特徴抽出処理７４を監視カメラ１で実行する方がネットワーク３への負荷は小さくなる。 With the configuration described above, in the video analysis system according to the present embodiment, the face feature extraction process 74 shown in FIG. 6 can be executed by either the monitoring camera 1 or the analysis server 2. When the facial feature extraction process 74 is executed by the monitoring camera 1, the facial feature data 75 is transmitted from the monitoring camera 1 to the analysis server 2, but when the facial feature extraction process 74 is executed by the analysis server 2. In this case, the face image data 73 is transmitted from the monitoring camera 1 to the analysis server 2. At this time, generally, the amount of data output from the monitoring camera 1 is smaller in the face feature data 75 than in the face image data 73, so that the face feature extraction process 74 is executed by the monitoring camera 1. The load on 3 is reduced.
　例えば、顔特徴抽出処理７４は、映像に映っている人数で負荷が変化するので、大勢が映った場合には監視カメラ１で処理できなくなることが考えられる。従って、通常状態では、監視カメラ１にて顔特徴抽出処理７４を実行して、ネットワーク３の負荷を下げ、第１負荷判定部１４により監視カメラ１が高負荷レベルとなると、解析サーバ２に顔特徴抽出処理７４の一部あるいは全部を依頼して、監視カメラ１の負荷を下げることができる。 For example, the facial feature extraction process 74 may be unable to be processed by the surveillance camera 1 when a large number of people are reflected because the load varies depending on the number of people shown in the video. Therefore, in the normal state, the facial feature extraction processing 74 is executed by the monitoring camera 1 to reduce the load on the network 3, and when the monitoring camera 1 reaches a high load level by the first load determination unit 14, A part or all of the feature extraction processing 74 can be requested to reduce the load on the monitoring camera 1.
　そして、上記いずれの場合であっても、顔照合処理７６の結果、映像データ内から顔データベースに登録されている人物が見つかった場合は、アラーム表示アプリ５によって情報がユーザに提供される。 In any case, if a person registered in the face database is found in the video data as a result of the face matching process 76, the alarm display application 5 provides information to the user.
　＜実施形態３＞
　次に、本発明の第３の実施形態を、図７乃至図８を参照して説明する。図７は、本実施形態における映像解析システムの構成を示すブロック図であり、図８は映像解析システムによる解析処理の様子を説明するための図である。なお、本実施形態は、実施形態１で説明した映像解析システムの具体的な構成及び動作の一例を示すものであり、例えば、映像監視システムを、監視カメラ１の映像データに映った人物を性別や服装を指定して検索する、といった人物映像検索システムに適用する例を示している。 <Embodiment 3>
Next, a third embodiment of the present invention will be described with reference to FIGS. FIG. 7 is a block diagram showing the configuration of the video analysis system in the present embodiment, and FIG. 8 is a diagram for explaining the state of analysis processing by the video analysis system. In addition, this embodiment shows an example of a specific configuration and operation of the video analysis system described in the first embodiment. For example, the video monitoring system can be used to identify a person shown in the video data of the monitoring camera 1 by gender. This example shows an application to a human video search system in which a search is performed by designating clothes and clothes.
　まず、本実施形態における映像解析システムによる解析処理の流れを、図８を参照して説明する。映像解析システムは、まず、監視カメラ１にて取得した映像データ８１に対して人物の顔の部分を抽出する顔抽出処理８２を行い、顔画像データ８３を出力する。続いて、映像解析システムは、顔画像データ８３をもとに性別を判別する性別判定処理８４を行い、性別データ８５を出力し、情報登録処理８６を行う。また、映像解析システムは、上記処理と並行して、監視カメラ１にて取得した映像データ８１から人物の全身部分を抽出する人物抽出処理８７を行い、人物画像データ８８を出力する。続いて、映像解析システムは、人物画像データ８８から服装の種類や色などの情報を抽出する服装抽出処理８９を行い、情報登録処理８６を行う。 First, the flow of analysis processing by the video analysis system in this embodiment will be described with reference to FIG. First, the video analysis system performs face extraction processing 82 for extracting a human face portion on the video data 81 acquired by the monitoring camera 1, and outputs face image data 83. Subsequently, the video analysis system performs gender determination processing 84 for determining gender based on the face image data 83, outputs gender data 85, and performs information registration processing 86. In parallel with the above processing, the video analysis system performs a person extraction process 87 for extracting the whole body part of the person from the video data 81 acquired by the monitoring camera 1 and outputs the person image data 88. Subsequently, the video analysis system performs a clothing extraction process 89 for extracting information such as the type and color of clothes from the person image data 88 and performs an information registration process 86.
　上述した解析処理を実現すべく、本実施形態における監視カメラ１の第１映像解析部１２は、図７に示すように、上記顔抽出処理８２を行う顔抽出モジュール１２ｃと、上記性別判定処理８４を行う性別判定モジュール１２ｄと、上記人物抽出処理８７を行う人物抽出モジュール１２ｅと、上記服装抽出処理８９を行う服装抽出モジュール１２ｆと、を備えている。また、解析サーバ２の第２映像解析部２２は、上記性別判定処理８４を行う性別判定モジュール２２ｃと、上記服装抽出処理８９を行う服装抽出モジュール２２ｄと、を備えている。 In order to realize the above-described analysis processing, the first video analysis unit 12 of the surveillance camera 1 in this embodiment includes a face extraction module 12c for performing the face extraction processing 82 and the gender determination processing 84 as shown in FIG. A gender determination module 12d that performs the above-described process, a person extraction module 12e that performs the person extraction process 87, and a clothing extraction module 12f that performs the clothes extraction process 89. The second video analysis unit 22 of the analysis server 2 includes a gender determination module 22 c that performs the gender determination process 84 and a clothing extraction module 22 d that performs the clothes extraction process 89.
　ここで、上記第１映像解析部１２が備える性別判定モジュール１２ｄと、第２映像解析部２２が備える性別判定モジュール２２ｃとは、同等内容の解析処理を行う解析モジュールであって、機能的には同一である。また、上記第１映像解析部１２が備える服装抽出モジュール１２ｆと、第２映像解析部２２が備える服装抽出判定モジュール２２ｄとは、同等内容の解析処理を行う解析モジュールであって、機能的には同一である。 Here, the gender determination module 12d included in the first video analysis unit 12 and the gender determination module 22c included in the second video analysis unit 22 are analysis modules that perform analysis processing of equivalent contents, and are functionally Are the same. The clothing extraction module 12f included in the first video analysis unit 12 and the clothing extraction determination module 22d included in the second video analysis unit 22 are analysis modules that perform analysis processing of equivalent contents, and are functionally Are the same.
　上述した構成にすることで、本実施形態における映像解析システムでは、図８に示す性別判定処理８４と服装抽出処理８９とは、監視カメラ１と解析サーバ２のいずれでも実行することができる。なお、上記ふたつの処理（性別判定処理８４と服装抽出処理８９）は独立であるため、監視カメラ１や解析サーバ２の負荷の状態によって、どちらか一方あるいは両方を、監視カメラ１あるいは解析サーバ２で実行してもよい。これにより、ネットワーク３の負荷を下げることと、監視カメラ１の性能削減とを両立することができる。 With the above-described configuration, in the video analysis system according to the present embodiment, the gender determination process 84 and the clothing extraction process 89 shown in FIG. 8 can be executed by either the monitoring camera 1 or the analysis server 2. Since the above two processes (gender determination process 84 and clothes extraction process 89) are independent, either one or both may be monitored camera 1 or analysis server 2 depending on the load state of monitoring camera 1 or analysis server 2. It may be executed with. Thereby, the load of the network 3 can be reduced and the performance of the surveillance camera 1 can be reduced.
　そして、上記映像解析システムによる解析結果である性別および服装情報は、情報登録・検索アプリ６に出力され、データベースに登録される。これにより、データベースに登録されている情報を、情報登録・検索アプリから検索することができる。 Then, the gender and clothes information, which is the analysis result by the video analysis system, is output to the information registration / search application 6 and registered in the database. Thereby, the information registered in the database can be searched from the information registration / search application.
　＜実施形態４＞
　次に、本発明の第４の実施形態を、図９を参照して説明する。図９は、本実施形態における映像解析システムの構成を示すブロック図である。 <Embodiment 4>
Next, a fourth embodiment of the present invention will be described with reference to FIG. FIG. 9 is a block diagram showing the configuration of the video analysis system in the present embodiment.
　図９に示すように、本実施形態における映像解析システムは、上述した実施形態１の映像解析システムとほぼ同様の構成をとる。これに加え、本実施形態では、解析サーバ２が、第２負荷判定部２４（判定手段）を備えている。 As shown in FIG. 9, the video analysis system according to the present embodiment has substantially the same configuration as the video analysis system according to the first embodiment described above. In addition to this, in the present embodiment, the analysis server 2 includes a second load determination unit 24 (determination means).
　上記第２負荷判定部２４は、上述した第１負荷判定部１４と同様に、解析サーバ２における予め設定された負荷を測定し、負荷レベルを判定する。例えば、解析サーバ２が装備する演算装置全体の処理負荷を計測してもよく、第２映像解析部２２による処理負荷を計測してもよい。そして、計測した負荷のレベルを、予め設定された基準に基づいて判定する。そして、第２負荷判定部２４は、判定した負荷レベルをサーバ制御部２３に出力する。 The second load determination unit 24 measures the preset load in the analysis server 2 and determines the load level, similarly to the first load determination unit 14 described above. For example, the processing load of the entire arithmetic device provided in the analysis server 2 may be measured, or the processing load by the second video analysis unit 22 may be measured. Then, the measured load level is determined based on a preset criterion. Then, the second load determination unit 24 outputs the determined load level to the server control unit 23.
　なお、第２負荷判定部２４は、別の方法で解析サーバ２の負荷を計測して、その負荷レベルを判定してもよい。例えば、解析サーバ２に装備されたメモリの使用量や、解析サーバ２にて実行される処理の遅延状況、解析サーバ２に対するデータの入出力量、解析サーバ２が接続されているネットワークの状況など、解析サーバ２の作動状況を表す情報から当該解析サーバ２の負荷を計測して、予め設定された基準に基づいてそのレベルを判定してもよい。 The second load determination unit 24 may measure the load of the analysis server 2 by another method and determine the load level. For example, the amount of memory used in the analysis server 2, the delay state of processing executed in the analysis server 2, the amount of data input / output to the analysis server 2, the state of the network to which the analysis server 2 is connected, etc. You may measure the load of the said analysis server 2 from the information showing the operating condition of the analysis server 2, and may determine the level based on the preset reference | standard.
　そして、本実施形態におけるサーバ制御部２３は、上記第２負荷判定部２４から出力された解析サーバ２の負荷レベルに基づいて、第２映像解析部２２の動作を制御する。例えば、サーバ制御部２３は、上述したように監視カメラ１のカメラ制御部１３から当該監視カメラ１が高負荷レベルであって第２の代替可能解析モジュールを実行するよう指示された場合であっても、解析サーバ２が高負荷レベルであると判定されている場合には、第２の代替可能解析モジュールの実行が不可能であると、監視カメラ１に回答してもよい。逆に、サーバ制御部２３は、解析サーバ２が低負荷レベルであると判定されている場合に、監視カメラ１に対して第２の代替可能解析モジュールの実行が可能であり、第１の代替可能解析モジュールを停止してもよい旨の通知を、監視カメラ１に対して行ってもよい。 The server control unit 23 in the present embodiment controls the operation of the second video analysis unit 22 based on the load level of the analysis server 2 output from the second load determination unit 24. For example, as described above, the server control unit 23 is a case where the camera control unit 13 of the monitoring camera 1 is instructed to execute the second substitutable analysis module when the monitoring camera 1 is at a high load level. However, if it is determined that the analysis server 2 is at a high load level, the monitoring camera 1 may be answered that the second substitutable analysis module cannot be executed. Conversely, the server control unit 23 can execute the second substitutable analysis module for the monitoring camera 1 when it is determined that the analysis server 2 is at the low load level, and the first alternative The monitoring camera 1 may be notified that the possibility analysis module may be stopped.
　そして、上記第２負荷判定部２４による判定結果に応じて、サーバ制御部２３及び／あるいはカメラ制御部１３は、第２映像解析部２２における第２の代替可能モジュールの実行を制御して、第１の代替可能解析モジュールと第２の代替可能解析モジュールとのうち、いずれか一方あるいは両方が実行されるよう制御してもよい。このとき、サーバ制御部２３及び／あるいはカメラ制御部１３は、第２負荷判定部２４及び第１負荷判定部１４の判定結果に応じて、第１の代替可能解析モジュールと第２の代替可能解析モジュールとのうち、いずれか一方あるいは両方が実行されるよう制御してもよい。 Then, according to the determination result by the second load determination unit 24, the server control unit 23 and / or the camera control unit 13 controls the execution of the second substitutable module in the second video analysis unit 22, One or both of the one substitutable analysis module and the second substitutable analysis module may be controlled to be executed. At this time, the server control unit 23 and / or the camera control unit 13 determines the first substitutable analysis module and the second substitutable analysis in accordance with the determination results of the second load determination unit 24 and the first load determination unit 14. One or both of the modules may be controlled to be executed.
　なお、上述したように、解析サーバ２に第２判定部２４を搭載して、当該解析サーバ２の負荷など作動状況を考慮して各映像解析部１２，２２における同等内容の解析処理を行う解析モジュールを制御する方法は、上述した実施形態２，３にも適用可能である。 Note that, as described above, the analysis server 2 is equipped with the second determination unit 24 and performs analysis processing of equivalent contents in each of the video analysis units 12 and 22 in consideration of operating conditions such as the load of the analysis server 2. The method for controlling the module is also applicable to the second and third embodiments.
　＜実施形態５＞
　次に、本発明の第５の実施形態を、図９を参照して説明する。図９は、本実施形態における映像解析システムの構成を示すブロック図である。 <Embodiment 5>
Next, a fifth embodiment of the present invention will be described with reference to FIG. FIG. 9 is a block diagram showing the configuration of the video analysis system in the present embodiment.
　本実施形態における映像解析システムは、上述した実施形態４の映像解析システムとほぼ同様の構成をとる。これに加え、本実施形態では、第１負荷判定部１４と第２負荷判定部２４とが、上述した実施形態とは異なる方法にて、監視カメラ１や解析サーバ２の負荷などの作動状況を計測して判定する。なお、以下では、監視カメラ１の第１負荷判定部１４による当該監視カメラ１の負荷を計測する方法を説明するが、同法の方法を解析サーバ２の第２負荷判定部２４にも適用可能である。 The video analysis system in the present embodiment has substantially the same configuration as the video analysis system in the fourth embodiment described above. In addition to this, in the present embodiment, the first load determination unit 14 and the second load determination unit 24 use different methods from the above-described embodiment to check the operation status of the monitoring camera 1 and the analysis server 2. Measure and judge. In the following, a method for measuring the load on the monitoring camera 1 by the first load determination unit 14 of the monitoring camera 1 will be described, but the same method can also be applied to the second load determination unit 24 of the analysis server 2. It is.
　本実施形態における第１負荷判定部１４（作動状況計測手段）は、これまでに計測した監視カメラ１の作動状況の履歴を、作動履歴情報として記憶装置に記憶しておく。例えば、監視カメラ１に装備された演算装置の処理負荷を、時刻情報と共に記憶しておく。そして、第１負荷判定部１４は、監視カメラ１における過去の作動履歴情報から、現在の監視カメラ１における作動状況である処理負荷を予測し、この予測した処理負荷のレベルを、予め設定された基準に基づいて判定する。さらに具体的に、第１負荷判定部１４は、負荷変動の記録を保存しておいて、その増加や減少の度合いを予測して現在の負荷を予測したり、日時などの周期的な変動を学習して現在の負荷を予測することができる。このようにして予測した監視カメラ１の負荷から負荷レベルを判定して、上述同様に、監視カメラ１及び／あるいは解析サーバ１の動作を制御する。 The first load determination unit 14 (operation status measurement means) in the present embodiment stores the history of the operation status of the monitoring camera 1 measured so far in the storage device as operation history information. For example, the processing load of the arithmetic device equipped in the monitoring camera 1 is stored together with time information. Then, the first load determination unit 14 predicts the processing load that is the current operation state in the monitoring camera 1 from the past operation history information in the monitoring camera 1, and the level of the predicted processing load is set in advance. Judge based on criteria. More specifically, the first load determination unit 14 stores a record of load fluctuations, predicts the degree of increase or decrease, predicts the current load, and performs periodic fluctuations such as date and time. You can learn and predict the current load. The load level is determined from the predicted load of the monitoring camera 1 in this way, and the operation of the monitoring camera 1 and / or the analysis server 1 is controlled as described above.
　また、第１負荷判定部１４は、他の方法により監視カメラ１の作動状況である負荷を計測することができる。例えば、第１負荷判定部１４は、監視カメラ１に接続されたネットワーク３の負荷といった状況を計測し、かかる計測結果から監視カメラ１の負荷を予測して、予測した負荷のレベルを判定してもよい。一例として、ネットワーク３の負荷が予め設定された基準値よりも低い場合には、監視カメラ１から送信されるデータ量が少ないと考えられるため、監視カメラ１の処理負荷が低いと判断できる。従って、ネットワーク３の現在の負荷の値に基づいて、監視カメラ１の現在の負荷を予測することができる。 Also, the first load determination unit 14 can measure the load that is the operating state of the monitoring camera 1 by another method. For example, the first load determination unit 14 measures a situation such as a load on the network 3 connected to the monitoring camera 1, predicts the load on the monitoring camera 1 from the measurement result, and determines the predicted load level. Also good. As an example, when the load on the network 3 is lower than a preset reference value, it is considered that the amount of data transmitted from the monitoring camera 1 is small, and therefore it can be determined that the processing load on the monitoring camera 1 is low. Therefore, the current load of the monitoring camera 1 can be predicted based on the current load value of the network 3.
　さらに、第１負荷判定部１４による負荷の計測の他の例としては、映像解析システムにおいて複数の映像解析処理が関連する場合は、前段階の処理結果から後段階の処理負荷が予測できる場合がある。例えば、人物認証の場合、顔を検出する処理で大人数が見つかると顔特徴抽出処理の負荷が上がることが予測できる。また、複数の監視カメラを統合して管理している場合は、監視カメラの位置の相互関係を利用できる。たとえば、通路上に並んでいる監視カメラであれば、人の動きに応じて並び順に同じような付加変動が起こることが予測できる。 Further, as another example of the load measurement by the first load determination unit 14, when a plurality of video analysis processes are related in the video analysis system, the subsequent process load can be predicted from the previous process result. is there. For example, in the case of person authentication, if a large number of people is found in the face detection process, it can be predicted that the load of the face feature extraction process will increase. When a plurality of surveillance cameras are integrated and managed, the mutual relationship between the positions of the surveillance cameras can be used. For example, in the case of surveillance cameras arranged on a passage, it can be predicted that similar additional fluctuations occur in the order of arrangement according to the movement of a person.
　また、第１負荷判定部１４による負荷の計測の他の例として、外部システムからの情報を利用することもできる。例えば、駅の監視カメラでは、列車が到着すると人が増加することが考えられるので、運行情報と連動させることで負荷の予測が可能になる。 Further, as another example of load measurement by the first load determination unit 14, information from an external system can be used. For example, in a station monitoring camera, it is conceivable that the number of people will increase when a train arrives. Therefore, it is possible to predict the load by interlocking with operation information.
　なお、上述した各実施形態では、通常は監視カメラ１で実行する処理を必要に応じて解析サーバ２で実行する例を説明しているが、逆に、通常は解析サーバ２で実行する処理を必要に応じて監視カメラ１で実行することも可能である。 In each of the above-described embodiments, an example has been described in which processing that is normally executed by the monitoring camera 1 is executed by the analysis server 2 as necessary. Conversely, processing that is normally executed by the analysis server 2 is described. It can also be executed by the monitoring camera 1 as necessary.
　また、上述した各実施形態では、監視カメラ１や解析サーバ２の負荷などの作動状況の判定結果に基づいて、解析モジュールの実行を制御する例を説明したが、本発明における解析システムは、上述した構成であることに限定されない。解析システムは、監視カメラ１や解析サーバ２の負荷などの作動状況を判定することなく、他の判断基準に基づいて、第１映像解析部１２及び第２映像解析部２２の各解析モジュールの実行や停止を制御してもよい。つまり、本発明における解析システムは、監視カメラ１や解析サーバ２の負荷などの作動状況を判定することなく、同等内容の解析処理を実行する第１の代替可能解析モジュールと第２の代替可能解析モジュールのいずれか一方あるいは両方が作動するよう制御してもよい。 Moreover, although each embodiment mentioned above demonstrated the example which controls execution of an analysis module based on the determination result of operating conditions, such as the load of the monitoring camera 1 or the analysis server 2, the analysis system in this invention is the above-mentioned. It is not limited to having the configuration. The analysis system executes each analysis module of the first video analysis unit 12 and the second video analysis unit 22 based on other determination criteria without determining the operation status such as the load of the monitoring camera 1 or the analysis server 2. Or stop may be controlled. That is, the analysis system according to the present invention includes the first substitutable analysis module and the second substitutable analysis that execute the analysis processing of the same content without determining the operation status such as the load of the monitoring camera 1 or the analysis server 2. One or both of the modules may be controlled to operate.
　＜付記＞
　上記実施形態の一部又は全部は、以下の付記のようにも記載されうる。以下、本発明における解析システム（図１０参照）、解析対象データ取得装置、プログラム、解析処理方法の構成の概略を説明する。但し、本発明は、以下の構成に限定されない。 <Appendix>
Part or all of the above-described embodiment can be described as in the following supplementary notes. The outline of the configuration of the analysis system (see FIG. 10), the analysis target data acquisition device, the program, and the analysis processing method in the present invention will be described below. However, the present invention is not limited to the following configuration.
（付記１）
　相互にネットワーク３００を介して接続された、解析対象データを取得する解析対象データ取得装置１００と、所定の解析処理を実行する解析処理装置２００と、を備え、
　前記解析対象データ取得装置１００は、取得した前記解析対象データに対する所定の解析処理を実行する第一解析手段１１０と、取得した前記解析対象データに基づくデータを前記解析処理装置に送信するデータ送信手段１２０と、を備え、
　前記解析処理装置２００は、前記解析対象データ取得装置１００から送信されたデータに対する所定の解析処理を実行する第二解析手段２１０を備え、
　前記第一解析手段１１０と前記第二解析手段２１０とは、同等内容の解析処理を実行する解析部１１１，２１１をそれぞれ備えており、
　前記第一解析手段１１０と前記第二解析手段２１０とがそれぞれ備える前記解析部１１１，２１１のうち、いずれか一方あるいは両方が作動するよう制御する解析制御手段１３０を備えた、
解析システム。 (Appendix 1)
An analysis target data acquisition device 100 that acquires analysis target data, and an analysis processing device 200 that executes a predetermined analysis process, connected to each other via a network 300;
The analysis target data acquisition apparatus 100 includes a first analysis unit 110 that executes a predetermined analysis process on the acquired analysis target data, and a data transmission unit that transmits data based on the acquired analysis target data to the analysis processing apparatus. 120, and
The analysis processing device 200 includes a second analysis unit 210 that performs a predetermined analysis process on the data transmitted from the analysis target data acquisition device 100,
The first analysis unit 110 and the second analysis unit 210 are respectively provided with analysis units 111 and 211 that execute analysis processing of equivalent contents,
An analysis control means 130 for controlling one or both of the analysis units 111 and 211 provided in the first analysis means 110 and the second analysis means 210 to operate is provided.
Analysis system.
（付記２）
　付記１に記載の解析システムであって、
　前記解析対象データ取得装置の作動状況を予め設定された基準に基づいて判定する判定手段を備え、
　前記解析制御手段は、前記判定手段による判定結果に基づいて、前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する、
解析システム。 (Appendix 2)
The analysis system according to attachment 1, wherein
A determination unit that determines an operation state of the analysis target data acquisition device based on a preset criterion;
The analysis control unit controls, based on the determination result by the determination unit, either one or both of the analysis units included in the first analysis unit and the second analysis unit, respectively.
Analysis system.
（付記３）
　付記２に記載の解析システムであって、
　前記判定手段は、前記解析対象データ取得装置の処理負荷が予め設定された基準よりも高いか否かを判定し、
　前記解析制御手段は、前記判定手段により前記解析対象データ取得装置の処理負荷が予め設定された基準よりも高いと判定された場合に、前記第一解析手段の前記解析部による解析処理を実行せず、前記第二解析手段の前記解析部による解析処理を実行するよう制御する、
解析システム。 (Appendix 3)
The analysis system according to attachment 2, wherein
The determination means determines whether or not the processing load of the analysis target data acquisition device is higher than a preset reference,
The analysis control unit may execute the analysis process by the analysis unit of the first analysis unit when the determination unit determines that the processing load of the analysis target data acquisition apparatus is higher than a preset reference. Without controlling the analysis processing by the analysis unit of the second analysis means,
Analysis system.
（付記４）
　付記３に記載の解析システムであって、
　前記解析制御手段は、前記第一解析手段の前記解析部による解析処理が実行されているときに、前記判定手段により前記解析対象データ取得装置の処理負荷が予め設定された基準よりも高いと判定された場合に、前記第一解析手段の前記解析部による解析処理の実行を停止し、前記第二解析手段の前記解析部による解析処理を実行するよう制御する、
解析システム。 (Appendix 4)
The analysis system according to attachment 3, wherein
The analysis control unit determines that the processing load of the analysis target data acquisition device is higher than a preset reference by the determination unit when the analysis process by the analysis unit of the first analysis unit is being performed. If it is, control to stop the execution of the analysis process by the analysis unit of the first analysis means, and to execute the analysis process by the analysis unit of the second analysis means,
Analysis system.
（付記５）
　付記３又は４に記載の解析システムであって、
　前記解析制御手段は、前記判定手段により前記解析対象データ取得装置の処理負荷が予め設定された基準よりも高いと判定された場合に、前記データ送信手段が前記第一解析手段から前記解析部により解析処理される前記解析対象データに基づくデータを前記第二解析手段に送信するよう制御する、
解析システム。 (Appendix 5)
The analysis system according to appendix 3 or 4,
When the analysis control unit determines that the processing load of the analysis target data acquisition apparatus is higher than a preset reference by the determination unit, the data transmission unit is changed from the first analysis unit to the analysis unit. Control to transmit data based on the analysis target data to be analyzed to the second analysis means;
Analysis system.
（付記６）
　付記２に記載の解析システムであって、
　前記判定手段は、前記解析対象データ取得装置及び前記解析処理装置のそれぞれの作動状況を予め設定された基準に基づいてそれぞれ判定し、
　前記解析制御手段は、前記判定手段による判定結果に基づいて、前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する、
解析システム。 (Appendix 6)
The analysis system according to attachment 2, wherein
The determination means determines each operation status of the analysis target data acquisition device and the analysis processing device based on a preset criterion,
The analysis control unit controls, based on the determination result by the determination unit, either one or both of the analysis units included in the first analysis unit and the second analysis unit, respectively.
Analysis system.
（付記７）
　付記２乃至５のいずれかに記載の解析システムであって、
　前記解析対象データ取得装置の作動状況を計測して作動履歴情報として記憶する作動状況計測手段を備え、
　前記判定手段は、前記解析対象データ取得装置の作動状況を前記作動履歴情報に基づいて予測し、当該予測した作動状況を予め設定された基準に基づいて判定する、
解析システム。 (Appendix 7)
The analysis system according to any one of appendices 2 to 5,
An operation state measuring means for measuring the operation state of the analysis object data acquisition device and storing it as operation history information;
The determination means predicts the operating status of the analysis target data acquisition device based on the operating history information, and determines the predicted operating status based on a preset criterion.
Analysis system.
（付記８）
　付記２乃至５に記載の解析システムであって、
　前記判定手段は、前記ネットワークの状況を計測し、当該ネットワークの状況に基づいて前記解析対象データ取得装置の作動状況を予測し、当該予測した作動状況を予め設定された基準に基づいて判定する、
解析システム。 (Appendix 8)
The analysis system according to appendices 2 to 5,
The determination unit measures the network status, predicts the operating status of the analysis target data acquisition device based on the network status, and determines the predicted operating status based on a preset criterion.
Analysis system.
（付記９）
　所定の解析処理を実行する解析処理装置にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置であって、
　取得した前記解析対象データに対する所定の解析処理を実行する第一解析手段と、
　取得した前記解析対象データに基づくデータを前記解析処理装置に送信するデータ送信手段と、を備え、
　前記第一解析手段は、前記解析処理装置が有する解析部と同等内容の解析処理を実行する別の解析部を備え、
　前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する解析制御手段を備えた、
解析対象データ取得装置。 (Appendix 9)
An analysis target data acquisition device for acquiring analysis target data, connected to an analysis processing device that executes a predetermined analysis process,
First analysis means for executing a predetermined analysis process on the acquired analysis target data;
Data transmission means for transmitting data based on the acquired analysis target data to the analysis processing device,
The first analysis means includes another analysis unit that executes an analysis process having the same content as the analysis unit included in the analysis processing device,
Among the analysis units provided in the first analysis means and the second analysis means, respectively, provided with an analysis control means for controlling either one or both to operate,
Analysis target data acquisition device.
（付記１０）
　付記９に記載の解析対象データ取得装置であって、
　前記解析対象データ取得装置の作動状況を予め設定された基準に基づいて判定する判定手段を備え、
　前記解析制御手段は、前記判定手段による判定結果に基づいて、前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する、
解析対象データ取得装置。 (Appendix 10)
The analysis target data acquisition device according to attachment 9, wherein
A determination unit that determines an operation state of the analysis target data acquisition device based on a preset criterion;
The analysis control unit controls, based on the determination result by the determination unit, either one or both of the analysis units included in the first analysis unit and the second analysis unit, respectively.
Analysis target data acquisition device.
（付記１１）
　所定の解析処理を実行する解析処理装置にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置に、
　取得した前記解析対象データに対する所定の解析処理を実行する第一解析手段と、
　取得した前記解析対象データに基づくデータを前記解析処理装置に送信するデータ送信手段と、
　前記第一解析手段と前記第二解析手段とがそれぞれ備える同等内容の解析処理を実行する各解析部のうち、いずれか一方あるいは両方が作動するよう制御する解析制御手段と、
を実現させるためのプログラム。 (Appendix 11)
To the analysis target data acquisition device that acquires the analysis target data connected to the analysis processing device that executes the predetermined analysis processing via the network,
First analysis means for executing a predetermined analysis process on the acquired analysis target data;
Data transmission means for transmitting data based on the acquired analysis target data to the analysis processing device;
Analysis control means for controlling either one or both of the analysis units that perform analysis processing of equivalent contents respectively provided by the first analysis means and the second analysis means,
A program to realize
（付記１２）
　付記１１に記載のプログラムであって、
　前記解析対象データ取得装置に、さらに、当該外解析対象データ取得装置の作動状況を予め設定された基準に基づいて判定する判定手段を実現させると共に、
　前記解析制御手段は、前記判定手段による判定結果に基づいて、前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する、
プログラム。 (Appendix 12)
The program according to attachment 11, wherein
Further, the analysis target data acquisition device further realizes a determination unit that determines the operation status of the external analysis target data acquisition device based on a preset criterion,
The analysis control unit controls, based on the determination result by the determination unit, either one or both of the analysis units included in the first analysis unit and the second analysis unit, respectively.
program.
（付記１３）
　相互にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置と、所定の解析処理を実行する解析処理装置と、を備えた通信システムにて、
　前記解析対象データ取得装置が、取得した前記解析対象データに対する所定の解析処理を実行すると共に、取得した前記解析対象データに基づくデータを前記解析処理装置に送信し、
　前記解析処理装置が、前記解析対象データ取得装置から送信されたデータに対する所定の解析処理を実行し、
　前記解析対象データ取得装置及び前記解析処理装置は、それぞれ同等内容の解析処理を実行可能であり、前記解析対象データ取得装置及び前記解析処理装置のうちいずれか一方あるいは両方が、前記同等内容の解析処理を実行するよう制御する、
解析処理方法。 (Appendix 13)
In a communication system comprising an analysis target data acquisition device for acquiring analysis target data and an analysis processing device for executing a predetermined analysis process, which are connected to each other via a network,
The analysis target data acquisition device performs predetermined analysis processing on the acquired analysis target data, and transmits data based on the acquired analysis target data to the analysis processing device.
The analysis processing device performs a predetermined analysis process on the data transmitted from the analysis target data acquisition device,
The analysis target data acquisition device and the analysis processing device can each perform an analysis process of equivalent content, and either one or both of the analysis target data acquisition device and the analysis processing device analyze the equivalent content. Control to execute the process,
Analysis processing method.
（付記１４）
　付記１３に記載の解析処理方法であって、
　前記解析対象データ取得装置の作動状況を予め設定された基準に基づいて判定し、この判定結果に基づいて、前記解析対象データ取得装置及び前記解析処理装置のうちいずれか一方あるいは両方が、前記同等内容の解析処理を実行するよう制御する、
解析処理方法。 (Appendix 14)
The analysis processing method according to attachment 13, wherein
The operation status of the analysis target data acquisition device is determined based on a preset criterion, and based on the determination result, one or both of the analysis target data acquisition device and the analysis processing device are the same Control to perform content analysis processing,
Analysis processing method.
　なお、上述したプログラムは、記憶装置に記憶されていたり、コンピュータが読み取り可能な記録媒体に記録されている。例えば、記録媒体は、フレキシブルディスク、光ディスク、光磁気ディスク、及び、半導体メモリ等の可搬性を有する媒体である。 Note that the above-described program is stored in a storage device or recorded on a computer-readable recording medium. For example, the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.
　以上、上記実施形態等を参照して本願発明を説明したが、本願発明は、上述した実施形態に限定されるものではない。本願発明の構成や詳細には、本願発明の範囲内で当業者が理解しうる様々な変更をすることができる。 As mentioned above, although this invention was demonstrated with reference to the said embodiment etc., this invention is not limited to embodiment mentioned above. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
　なお、本発明は、日本国にて２０１２年３月２８日に特許出願された特願２０１２－０７３３５０の特許出願に基づく優先権主張の利益を享受するものであり、当該特許出願に記載された内容は、全て本明細書に含まれるものとする。 The present invention enjoys the benefit of the priority claim based on the patent application of Japanese Patent Application No. 2012-073350 filed on March 28, 2012 in Japan, and is described in the patent application. The contents are all included in this specification.
１　監視カメラ
１１　映像取得部
１２　第１映像解析部
１２ａ　顔抽出モジュール
１２ｂ　顔特徴抽出モジュール
１２ｃ　顔抽出モジュール
１２ｄ　性別判定モジュール
１２ｅ　人物抽出モジュール
１２ｆ　服装抽出モジュール
１３　カメラ制御部
１４　第１負荷判定部
２　解析サーバ
２１　結果出力部
２２　第２映像解析部
２２ａ　顔特徴抽出モジュール
２２ｂ　顔照合モジュール
２２ｃ　性別判定モジュール
２２ｄ　服装抽出モジュール
２３　サーバ制御部
２４　第２負荷判定部
３　ネットワーク
４１　対応関係記憶部
５　アラーム表示アプリ
６　情報登録・検索アプリ
１００　解析対象データ取得装置
１１０　第一映像解析手段
１１１　解析部
１２０　データ送信手段
１３０　解析制御手段
２００　解析処理装置
２１０　第二映像解析手段
２１１　解析部
３００　ネットワーク DESCRIPTION OF SYMBOLS 1 Surveillance camera 11 Image | video acquisition part 12 1st image | video analysis part 12a Face extraction module 12b Face feature extraction module 12c Face extraction module 12d Gender determination module 12e Person extraction module 12f Clothing extraction module 13 Camera control part 14 1st load determination part 2 Analysis Server 21 Result output unit 22 Second video analysis unit 22a Face feature extraction module 22b Face matching module 22c Gender determination module 22d Clothes extraction module 23 Server control unit 24 Second load determination unit 3 Network 41 Correspondence storage unit 5 Alarm display application 6 Information registration / retrieval application 100 Analysis target data acquisition device 110 First video analysis unit 111 Analysis unit 120 Data transmission unit 130 Analysis control unit 200 Analysis processing unit 210 Second video analysis unit 211 Analysis unit 300 Network

Claims (10)

  1. 　相互にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置と、所定の解析処理を実行する解析処理装置と、を備え、
    　前記解析対象データ取得装置は、取得した前記解析対象データに対する所定の解析処理を実行する第一解析手段と、取得した前記解析対象データに基づくデータを前記解析処理装置に送信するデータ送信手段と、を備え、
    　前記解析処理装置は、前記解析対象データ取得装置から送信されたデータに対する所定の解析処理を実行する第二解析手段を備え、
    　前記第一解析手段と前記第二解析手段とは、同等内容の解析処理を実行する解析部をそれぞれ備えており、
    　前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する解析制御手段を備えた、
    解析システム。     An analysis target data acquisition device for acquiring analysis target data, connected to each other via a network, and an analysis processing device for executing a predetermined analysis process,
    The analysis target data acquisition device includes a first analysis unit that executes a predetermined analysis process on the acquired analysis target data, a data transmission unit that transmits data based on the acquired analysis target data to the analysis processing unit, With
    The analysis processing device includes second analysis means for executing a predetermined analysis process on the data transmitted from the analysis target data acquisition device,
    The first analysis unit and the second analysis unit each include an analysis unit that executes an analysis process of equivalent content,
    Among the analysis units provided in the first analysis means and the second analysis means, respectively, provided with an analysis control means for controlling either one or both to operate,
    Analysis system.
  2. 　請求項１に記載の解析システムであって、
    　前記解析対象データ取得装置の作動状況を予め設定された基準に基づいて判定する判定手段を備え、
    　前記解析制御手段は、前記判定手段による判定結果に基づいて、前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する、
    解析システム。     The analysis system according to claim 1,
    A determination unit that determines an operation state of the analysis target data acquisition device based on a preset criterion;
    The analysis control unit controls, based on the determination result by the determination unit, either one or both of the analysis units included in the first analysis unit and the second analysis unit, respectively.
    Analysis system.
  3. 　請求項２に記載の解析システムであって、
    　前記判定手段は、前記解析対象データ取得装置の処理負荷が予め設定された基準よりも高いか否かを判定し、
    　前記解析制御手段は、前記判定手段により前記解析対象データ取得装置の処理負荷が予め設定された基準よりも高いと判定された場合に、前記第一解析手段の前記解析部による解析処理を実行せず、前記第二解析手段の前記解析部による解析処理を実行するよう制御する、
    解析システム。     The analysis system according to claim 2,
    The determination means determines whether or not the processing load of the analysis target data acquisition device is higher than a preset reference,
    The analysis control unit may execute the analysis process by the analysis unit of the first analysis unit when the determination unit determines that the processing load of the analysis target data acquisition apparatus is higher than a preset reference. Without controlling the analysis processing by the analysis unit of the second analysis means,
    Analysis system.
  4. 　請求項３に記載の解析システムであって、
    　前記解析制御手段は、前記第一解析手段の前記解析部による解析処理が実行されているときに、前記判定手段により前記解析対象データ取得装置の処理負荷が予め設定された基準よりも高いと判定された場合に、前記第一解析手段の前記解析部による解析処理の実行を停止し、前記第二解析手段の前記解析部による解析処理を実行するよう制御する、
    解析システム。     The analysis system according to claim 3,
    The analysis control unit determines that the processing load of the analysis target data acquisition device is higher than a preset reference by the determination unit when the analysis process by the analysis unit of the first analysis unit is being performed. If it is, control to stop the execution of the analysis process by the analysis unit of the first analysis means, and to execute the analysis process by the analysis unit of the second analysis means,
    Analysis system.
  5. 　請求項３又は４に記載の解析システムであって、
    　前記解析制御手段は、前記判定手段により前記解析対象データ取得装置の処理負荷が予め設定された基準よりも高いと判定された場合に、前記データ送信手段が前記第一解析手段から前記解析部により解析処理される前記解析対象データに基づくデータを前記第二解析手段に送信するよう制御する、
    解析システム。     The analysis system according to claim 3 or 4,
    When the analysis control unit determines that the processing load of the analysis target data acquisition apparatus is higher than a preset reference by the determination unit, the data transmission unit is changed from the first analysis unit to the analysis unit. Control to transmit data based on the analysis target data to be analyzed to the second analysis means;
    Analysis system.
  6. 　請求項２に記載の解析システムであって、
    　前記判定手段は、前記解析対象データ取得装置及び前記解析処理装置のそれぞれの作動状況を予め設定された基準に基づいてそれぞれ判定し、
    　前記解析制御手段は、前記判定手段による判定結果に基づいて、前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する、
    解析システム。     The analysis system according to claim 2,
    The determination means determines each operation status of the analysis target data acquisition device and the analysis processing device based on a preset criterion,
    The analysis control unit controls, based on the determination result by the determination unit, either one or both of the analysis units included in the first analysis unit and the second analysis unit, respectively.
    Analysis system.
  7. 　請求項２乃至５のいずれかに記載の解析システムであって、
    　前記解析対象データ取得装置の作動状況を計測して作動履歴情報として記憶する作動状況計測手段を備え、
    　前記判定手段は、前記解析対象データ取得装置の作動状況を前記作動履歴情報に基づいて予測し、当該予測した作動状況を予め設定された基準に基づいて判定する、
    解析システム。     The analysis system according to any one of claims 2 to 5,
    An operation state measuring means for measuring the operation state of the analysis object data acquisition device and storing it as operation history information;
    The determination means predicts the operating status of the analysis target data acquisition device based on the operating history information, and determines the predicted operating status based on a preset criterion.
    Analysis system.
  8. 　請求項２乃至５に記載の解析システムであって、
    　前記判定手段は、前記ネットワークの状況を計測し、当該ネットワークの状況に基づいて前記解析対象データ取得装置の作動状況を予測し、当該予測した作動状況を予め設定された基準に基づいて判定する、
    解析システム。     The analysis system according to claim 2, wherein
    The determination unit measures the network status, predicts the operating status of the analysis target data acquisition device based on the network status, and determines the predicted operating status based on a preset criterion.
    Analysis system.
  9. 　所定の解析処理を実行する解析処理装置にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置であって、
    　取得した前記解析対象データに対する所定の解析処理を実行する第一解析手段と、
    　取得した前記解析対象データに基づくデータを前記解析処理装置に送信するデータ送信手段と、を備え、
    　前記第一解析手段は、前記解析処理装置が有する解析部と同等内容の解析処理を実行する別の解析部を備え、
    　前記第一解析手段と前記第二解析手段とがそれぞれ備える前記解析部のうち、いずれか一方あるいは両方が作動するよう制御する解析制御手段を備えた、
    解析対象データ取得装置。     An analysis target data acquisition device for acquiring analysis target data, connected to an analysis processing device that executes a predetermined analysis process,
    First analysis means for executing a predetermined analysis process on the acquired analysis target data;
    Data transmission means for transmitting data based on the acquired analysis target data to the analysis processing device,
    The first analysis means includes another analysis unit that executes an analysis process having the same content as the analysis unit included in the analysis processing device,
    Among the analysis units provided in the first analysis means and the second analysis means, respectively, provided with an analysis control means for controlling either one or both to operate,
    Analysis target data acquisition device.
  10. 　相互にネットワークを介して接続された、解析対象データを取得する解析対象データ取得装置と、所定の解析処理を実行する解析処理装置と、を備えた通信システムにて、
    　前記解析対象データ取得装置が、取得した前記解析対象データに対する所定の解析処理を実行すると共に、取得した前記解析対象データに基づくデータを前記解析処理装置に送信し、
    　前記解析処理装置が、前記解析対象データ取得装置から送信されたデータに対する所定の解析処理を実行し、
    　前記解析対象データ取得装置及び前記解析処理装置は、それぞれ同等内容の解析処理を実行可能であり、前記解析対象データ取得装置及び前記解析処理装置のうちいずれか一方あるいは両方が、前記同等内容の解析処理を実行するよう制御する、
    解析処理方法。
          In a communication system comprising an analysis target data acquisition device for acquiring analysis target data and an analysis processing device for executing a predetermined analysis process, which are connected to each other via a network,
    The analysis target data acquisition device performs predetermined analysis processing on the acquired analysis target data, and transmits data based on the acquired analysis target data to the analysis processing device.
    The analysis processing device performs a predetermined analysis process on the data transmitted from the analysis target data acquisition device,
    The analysis target data acquisition device and the analysis processing device can each perform an analysis process of equivalent content, and either one or both of the analysis target data acquisition device and the analysis processing device analyze the equivalent content. Control to execute the process,
    Analysis processing method.
PCT/JP2013/000797 2012-03-28 2013-02-14 Analysis system WO2013145530A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012-073350 2012-03-28
JP2012073350 2012-03-28

Publications (1)

Publication Number Publication Date
WO2013145530A1 true WO2013145530A1 (en) 2013-10-03

Family

ID=49258857

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/000797 WO2013145530A1 (en) 2012-03-28 2013-02-14 Analysis system

Country Status (2)

Country Link
JP (1) JPWO2013145530A1 (en)
WO (1) WO2013145530A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015151449A1 (en) * 2014-03-31 2015-10-08 日本電気株式会社 Image-processing system, image-processing device, image-processing method, and recording medium
JP2017045319A (en) * 2015-08-27 2017-03-02 沖電気工業株式会社 Information processing device, information processing method, and information processing system
WO2018097058A1 (en) * 2016-11-22 2018-05-31 日本電気株式会社 Analysis node, method for managing resources, and program recording medium
WO2018150649A1 (en) * 2017-02-14 2018-08-23 ソニーセミコンダクタソリューションズ株式会社 Electronic apparatus, processing take-over request method for electronic apparatus, and information processing system
JP6628948B1 (en) * 2019-01-30 2020-01-15 三菱電機株式会社 Motor drive
JP2020035086A (en) * 2018-08-28 2020-03-05 富士ゼロックス株式会社 Information processing system, information processing apparatus and program
JP2021099690A (en) * 2019-12-23 2021-07-01 横河電機株式会社 Apparatus, system, method, and program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002165210A (en) * 2000-08-04 2002-06-07 Matsushita Electric Ind Co Ltd Data-transmitting source and data transmitter/receiver
JP2010028594A (en) * 2008-07-23 2010-02-04 Hitachi Ltd Moving object monitoring device
WO2011099320A1 (en) * 2010-02-12 2011-08-18 株式会社日立製作所 Information processing device, and method of processing information upon information processing device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002165210A (en) * 2000-08-04 2002-06-07 Matsushita Electric Ind Co Ltd Data-transmitting source and data transmitter/receiver
JP2010028594A (en) * 2008-07-23 2010-02-04 Hitachi Ltd Moving object monitoring device
WO2011099320A1 (en) * 2010-02-12 2011-08-18 株式会社日立製作所 Information processing device, and method of processing information upon information processing device

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11100691B2 (en) 2014-03-31 2021-08-24 Nec Corporation Image processing system, image processing method and program, and device
JPWO2015151449A1 (en) * 2014-03-31 2017-04-13 日本電気株式会社 Image processing system, image processing apparatus, image processing method, and recording medium
WO2015151449A1 (en) * 2014-03-31 2015-10-08 日本電気株式会社 Image-processing system, image-processing device, image-processing method, and recording medium
US11798211B2 (en) 2014-03-31 2023-10-24 Nec Corporation Image processing system, image processing method and program, and device
JP2017045319A (en) * 2015-08-27 2017-03-02 沖電気工業株式会社 Information processing device, information processing method, and information processing system
WO2018097058A1 (en) * 2016-11-22 2018-05-31 日本電気株式会社 Analysis node, method for managing resources, and program recording medium
JPWO2018097058A1 (en) * 2016-11-22 2019-10-17 日本電気株式会社 Analysis node, resource management method, and program recording medium
WO2018150649A1 (en) * 2017-02-14 2018-08-23 ソニーセミコンダクタソリューションズ株式会社 Electronic apparatus, processing take-over request method for electronic apparatus, and information processing system
US11561908B2 (en) 2017-02-14 2023-01-24 Sony Semiconductor Solutions Corporation Electronic device, processing proxy requesting method of electronic device, and information processing system
JP2020035086A (en) * 2018-08-28 2020-03-05 富士ゼロックス株式会社 Information processing system, information processing apparatus and program
JP6628948B1 (en) * 2019-01-30 2020-01-15 三菱電機株式会社 Motor drive
WO2020157865A1 (en) * 2019-01-30 2020-08-06 三菱電機株式会社 Motor drive device
US11373496B2 (en) 2019-12-23 2022-06-28 Yokogawa Electric Corporation Security system having an alert signal generated by sensors or analytics on image data
JP2021099690A (en) * 2019-12-23 2021-07-01 横河電機株式会社 Apparatus, system, method, and program
JP7211353B2 (en) 2019-12-23 2023-01-24 横河電機株式会社 Apparatus, system, method and program

Also Published As

Publication number Publication date
JPWO2013145530A1 (en) 2015-12-10

Similar Documents

Publication Publication Date Title
WO2013145530A1 (en) Analysis system
JP6094903B2 (en) Receiving apparatus and receiving side image processing method
KR101709715B1 (en) Control and monitoring apparatus based internet of things using a camera
US11727578B2 (en) Crowd type classification system, crowd type classification method and storage medium for storing crowd type classification program
EP3249919B1 (en) Image processing apparatus, image processing method, and program
KR20160074208A (en) System and method for providing safety service using beacon signals
KR102054930B1 (en) Method and apparatus for sharing picture in the system
KR20220064098A (en) Fault diagnosis apparatus and method based on machine-learning
KR20210155655A (en) Method and apparatus for identifying object representing abnormal temperatures
CN111581436A (en) Target identification method and device, computer equipment and storage medium
AU2021104400A4 (en) An intelligent system for detecting behavioral cyber attack on industrial iot using ai federated learning algorithm
WO2023045084A1 (en) Subway station device control method and apparatus, and electronic device and storage medium
KR102290857B1 (en) Artificial intelligence based smart user detection method and device using channel state information
JP2022185634A (en) Terminal device, information processing device, information processing method, information processing program and information processing system
JP2018142137A (en) Information processing device, information processing method and program
KR102082690B1 (en) Control apparatus, control method, and storage medium
JPWO2020110279A1 (en) Number information acquisition system, number information acquisition method and elevator
US11442129B1 (en) Systemic certainty of event convergence
US20240161492A1 (en) Image collection sensor device, unmanned counting edge computing system and method using the same
US20240135716A1 (en) Congestion degree determination apparatus, control method, and non-transitory computer-readable medium
US11005996B2 (en) Contact center network and method for establishing a communication session in a contact center network
US20230394836A1 (en) Server device, method for controlling server device, and storage medium
JP7040207B2 (en) Information processing equipment, communication system, communication control method and program
JP6525937B2 (en) Display control device and program
KR20240047778A (en) Smart home emergency treatment device based on iot camera

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13768187

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2014507361

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13768187

Country of ref document: EP

Kind code of ref document: A1