JP7371076B2 - Information processing device, information processing system, information processing method and program - Google Patents

Description

The present invention relates to an information processing device, an information processing system, an information processing method, and a program.

2. Description of the Related Art Some digital cameras, digital video cameras, and the like automatically detect a subject from a still image or a moving image when shooting a still image or a moving image. Patent Document 1 discloses a face detection method in a digital camera.

Japanese Patent Application Publication No. 2008-289006

For example, surveillance cameras and the like often capture images with depth. In such a case, large objects and small objects coexist in the image, and detection processing for detecting objects may take a long time or may be detected incorrectly.
The present invention aims at at least one of speeding up detection processing and reducing false detections.

The information processing device of the present invention includes a size setting screen for setting a first detection size and a second detection size of a detection target object detected from a detection area in an image , or a size setting screen for setting a first detection size and a second detection size of a detection target object detected from a detection area in an image; display control means for displaying an area setting screen for setting the detection area on a display unit; and a display control means for displaying an area setting screen on a display unit for setting the detection area, and a detection target object having a size between the first detection size and the second detection size from the detection area. and a detection means for detecting, and the display control means displays an object for setting the first detection size or an object for setting the second detection size on the size setting screen. , on the screen for setting the detection area, the object for setting the first detection size or the object for setting the second detection size is controlled not to be displayed, and the second detection size is the size is larger than the first detection size, and the display control means is configured to set the lower end of the object for setting the second detection size on the size setting screen to the first detection size. is displayed below the bottom edge of the object and near the bottom edge of the detection area, and the top edge of the object for setting the first detection size is displayed below the bottom edge of the object for setting the second detection size. It is controlled to be displayed above the upper end and near the upper side of the detection area.

According to the present invention, it is possible to realize at least one of speeding up detection processing and reducing false detections.

1 is a diagram illustrating an example of a hardware configuration, etc. of an information processing system. 1 is a diagram illustrating an example of a functional configuration, etc. of an information processing system. It is a figure showing an example of a captured image. It is a figure which shows an example of a screen. 3 is a flowchart illustrating an example of information processing. It is a figure which shows an example of setting a detection area. It is a figure which shows an example of setting a human body size. FIG. 3 is a diagram showing an example of changing the human body size.

Embodiments of the present invention will be described below based on the drawings.

<Embodiment 1>
In this embodiment, in an information processing system that monitors moving images, a detection area for human body detection is set in the captured moving image, a maximum and minimum human body size is set for each set detection area, and the human body size is set for each set detection area. The process of detecting will be explained. The image may be a moving image, but it may be a still image. The minimum human body size is an example of the first detected size. Further, the maximum human body size is an example of the second detected size. Further, a human body included in an image is an example of an object.
FIG. 1 shows an example of the system configuration and hardware configuration of the information processing system in this embodiment. In FIG. 1, an imaging device 110 performs imaging. The client device 120 drives the imaging device 110 and displays images captured by the imaging device 110. The input device 130 includes a mouse, a keyboard, etc., and performs user input to the client device 120. The display device 140 is composed of a display or the like, and displays images output by the client device 120. Although the client device 120 and the display device 140 are shown as independent devices in FIG. 1, the client device 120 and the display device 140 may be integrated. Further, the input device 130 and the display device 140 may be configured as one unit, or the client device 120, the input device 130, and the display device 140 may be configured as one unit. Network 150 connects imaging device 110 and client device 120. The network 150 is composed of a plurality of routers, switches, cables, etc. that meet communication standards such as local networks, for example. In this embodiment, the communication standard, scale, and configuration are not limited as long as the imaging device and the client can communicate with each other. For example, the network 150 may be configured by the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network), or the like. Furthermore, the number of imaging devices connected to the client device 120 is not limited to one, but may be multiple. The display device 140 is an example of a display section. Client device 120 is an example of an information processing device. The imaging device 110 is, for example, a surveillance camera.

The hardware configuration of the imaging device 110 will be explained. The imaging device 110 includes an imaging unit 11, a CPU 12, a memory 13, and a communication I/F 14 as a hardware configuration. The imaging unit 11 has an imaging device and an engineering system as a subject on the imaging device, and performs imaging on the imaging device with the intersection of the optical axis of the optical system and the imaging device as the imaging center under the control of the CPU 12. The image sensor is an image sensor such as a CMOS (Complementary Metal-Oxide Semiconductor) or a CCD (Charged Coupled Device). The CPU 12 controls the entire imaging device 110. The memory 13 stores programs, images captured by the imaging unit 11, data used by the CPU 12 when executing processing, and the like. The communication I/F 14 controls communication with the client device 120 via the network 150 based on the control of the CPU 12. The functions of the imaging device 110 are realized by the CPU 12 executing processing based on the program stored in the memory 13.
Next, the hardware configuration of the client device 120 will be explained. The client device 120 includes a memory 21, a CPU 22, a communication I/F 23, an input I/F 24, and a display I/F 25 as a hardware configuration. The CPU 22 controls the entire client device 120. The memory 21 stores programs, captured images transmitted from the imaging device 110, data used when the CPU 22 executes processing, and the like. The communication I/F 23 controls communication with the imaging device 110 via the network 150 under the control of the CPU 22 . The input I/F 24 connects the client device 120 and the input device 130 and controls input of information from the input device 130. The display I/F 25 connects the client device 120 and the display device 140 and controls the output of information to the display device 140. When the CPU 22 executes processing based on the program stored in the memory 21, the functions of the client device 120 and the processing shown in the flowchart of FIG. 5, which will be described later, are realized.

FIG. 2 is a diagram illustrating an example of the functional configuration of the imaging device 110 and the client device 120. The imaging device 110 includes a control section 111, a signal processing section 112, a drive control section 113, and a communication control section 114 as functional configurations. The control unit 111 controls the imaging device 110. The signal processing unit 112 processes the image signal captured by the imaging unit 11. For example, the signal processing unit 112 encodes the image captured by the imaging unit 11. The signal processing unit 112 can use, for example, JPEG (Joint Photographic Experts Group) as the encoding method. Alternatively, the signal processing unit 112 uses H. H.264/MPEG-4 AVC (hereinafter referred to as H.264) can be used. Alternatively, the signal processing unit 112 can use HEVC (High Efficiency Video Coding) as the encoding method. However, the encoding method is not limited to these. Further, the signal processing unit 112 may select an encoding method from among a plurality of encoding methods and perform encoding. The drive control unit 113 performs control to change the imaging direction and angle of view of the imaging unit 11. In this embodiment, a case will be described in which the imaging unit 11 can change the imaging direction in the panning direction and the tilting direction, and can change the imaging angle of view, but the invention is not limited to this. The imaging device 110 does not need to have the function of changing the imaging direction in the panning direction or the tilting direction, nor does it need to have the function of changing the angle of view. The communication control unit 114 transmits the captured image processed by the signal processing unit 112 to the client device 120. Further, the communication control unit 114 receives a control command for the imaging device 110 from the client device 120.

The client device 120 includes a control section 121, a communication control section 123, an information acquisition section 124, and a display control section 125 as functional configurations. The control unit 121 controls the client device 120. The communication control unit 123 receives captured images from the imaging device 110. The information acquisition unit 124 receives user input through the input device 130 and acquires input information from the input device 130. The display control unit 125 outputs the video to the display device 140 and causes the display device 140 to perform display processing to be described later.
In this embodiment, the client device 120 sets a detection area for performing human body detection on the captured image received from the imaging device 110, sets the maximum and minimum human body size for each set detection area, and performs human body detection processing. . With this, it is possible to set a detection area for performing human body detection on real-time live video, set the maximum and minimum human body sizes for each set detection area, and perform human body detection processing. However, it is not limited to this. For example, the client device 120 acquires a video stored in the imaging device 110, sets a detection area for human body detection for each frame, and sets the maximum and minimum human body size for each set detection area. , human body detection processing may be performed. In addition, the client device 120 sets a detection area for human body detection for each frame of the video stored in the client device 120, sets the maximum and minimum human body size for each set detection area, and Detection processing may also be performed. Alternatively, the client device 120 accesses the recording server or the like, sets a detection area for human body detection for each frame of the video stored in the recording server, and determines the maximum and minimum human body size for each set detection area. may be set to perform human body detection processing.

Next, the configuration and process flow for setting a detection area for human body detection and setting the maximum and minimum human body size for each set detection area in this embodiment will be explained using FIGS. 3 to 8.
FIG. 3 is a diagram showing an example of a captured image 200 acquired by the control unit 121 from the imaging device 110. As shown in FIG. 3, the image 200 includes human bodies 201 and 202 and a human body 203.
FIG. 4 is a diagram showing an example of setting detection areas for human body detection and setting maximum and minimum human body sizes for each set detection area. In FIG. 4, a screen 300 is a graphical user interface for prompting the user to set a detection area. Image 301 is image 200 displayed on screen 300. Button 302 is a button for setting a detection area. A button 303 is a button for setting the maximum and minimum human body size for each detection area. Screen 300 in FIG. 4 is displayed to the user by display device 140. In this embodiment, the user makes settings using a graphical user interface, but the user may make settings using other methods such as voice.

FIG. 5 is a flowchart showing an example of information processing for setting detection areas for human body detection and setting maximum and minimum human body sizes for each set detection area.
In S400, the control unit 121 acquires a captured image from the imaging device 110. The process in S401 is an example of a reception process for accepting an image.
In S<b>401 , the control unit 121 determines whether or not the detection area and the maximum and minimum human body sizes of the detection area have been set based on the description of the setting file stored in the memory 21 . If the control unit 121 determines that the setting is completed (YES in S401), the process proceeds to S415, and if it determines that the setting is not completed (NO in S401), the process proceeds to S402.
In S402, the control unit 121 determines whether there is a user input via the input device 130. If the control unit 121 determines that there is a user input (YES in S402), the process proceeds to S403, and if it determines that there is no user input (NO in S402), the process returns to S400.

In S403, the control unit 121 determines whether the button 302 is selected. If the control unit 121 determines that the button 302 is selected (YES in S403), the process proceeds to S404, and if it determines that the button 303 is not selected (NO in S403), the process proceeds to S407.
In S404, the control unit 121 changes to the detection area setting mode and controls the display device 140 to display the screen shown in FIG.
FIG. 6 is a diagram illustrating an example of a screen for setting the detection area when transitioning to the detection area setting mode. Screen 500 is a screen for setting a detection area in which human body detection is to be performed, which has transitioned to a detection area setting mode. Screen 500 is a diagram showing an example of an area setting screen. The button 501 is the button 302 whose display has changed, indicating that the mode has changed to the detection area setting mode. A cursor 502 is a cursor of the input device 130 for setting a detection area. Detection area 503 is a rectangle indicating a set detection area. In this embodiment, the detection area 503 is set to have a rectangular shape, but it may have another shape. The button 501 is an example of identification information that identifies that the screen displayed on the display device 140 is an area setting screen.
In S405, the control unit 121 receives the user's operation to set the detection area 503 via the screen 500 displayed on the display device 140 and the input device 130, and sets the detection area 503. The detection area 503 is an area (range) having a fixed size set for the image.
In S406, the control unit 121 displays the detection area 503 set in S405 on the display device 140 as shown in FIG.

In S407, the control unit 121 determines whether the button 303 is selected. If the control unit 121 determines that the button 303 is selected (YES in S407), the process proceeds to S408, and if it determines that the button 303 is not selected (NO in S407), the process returns to S400.
In S408, the control unit 121 changes to the human body size setting mode and controls the display device 140 to display the screen shown in FIG.
FIG. 7 is a diagram showing an example of a screen for setting the human body size when transitioning to the human body size setting mode. Screen 600 is a diagram showing an example of a size setting screen. The detection area 601 is the same as the detection area 503, and is also an area where the maximum and minimum human body sizes are set by the user. The button 602 is the button 303 whose display has changed, indicating that the mode has changed to the human body size setting mode. The human body model 603 is a human body model for setting the maximum human body size in the detection area 601. A human body model 604 is a human body model for setting the minimum human body size in the detection area 601. In this embodiment, the human body model 603 and the human body model 604 are displayed in a shape similar to a human body, but they may be displayed in other shapes. The button 602 is an example of identification information that identifies that the screen displayed on the display device 140 is a size setting screen.

In S409, the control unit 121 controls the display device 140 to display the human body model 603 and the human body model 604. In this embodiment, the control unit 121 displays the human body model 603 and the human body model 604 after transitioning to the human body size setting mode, but this does not limit the present embodiment. The control unit 121 may display the human body model 603 and the human body model 604 from the time of the detection area setting mode, or may display the human body model 603 and the human body model 604 by other methods such as displaying them semitransparently until the transition to the human body size setting mode. The display state of the human body model 603 and the human body model 604 may be controlled. The human body model 604 is an example of an object for setting the first detection size. Furthermore, the human body model 603 is an example of an object for setting the second detection size. The control unit 121 causes the human body model 603 to be displayed on the screen 600 in front of the human body model 604 or at the bottom of the screen. This is because in a captured image of a wide range with depth, a relatively large object will be in the foreground, and a relatively small object will be in the background.
In S410, the control unit 121 accepts the user's drag operation of the human body model 603 via the input device 130 on the screen 600 displayed on the display device 140, and changes the maximum human body size. Here, the maximum human body size is the maximum detected size of the human body in the image. In this embodiment, the maximum human body size in the detection area 601 is changed by dragging the human body model 603, but it may be changed using other methods.
In S411, the control unit 121 causes the human body model 701 of the maximum human body size changed in S410 to be displayed on the screen 600, as shown in FIG. 8, which will be described later.

In S412, the control unit 121 accepts the user's drag operation of the human body model 604 via the input device 130 on the screen 600 displayed on the display device 140, and changes the minimum human body size. Here, the minimum human body size is the minimum detected size of the human body in the image. In this embodiment, the minimum human body size in the detection area 601 is changed by dragging the human body model 604, but it may be changed by other methods.
In S413, the control unit 121 causes the human body model 702 of the minimum human body size changed in S412 to be displayed on the screen 600, as shown in FIG. 8, which will be described later.
FIG. 8 is a diagram showing an example of the maximum and minimum human body sizes after being changed. The human body model 701 is the largest human body model in the detection area 601 after the size has been changed. The human body model 702 is the human body model of the smallest human size in the detection area 601 after the size has been changed. The processing in S410 and S411 and the processing in S412 and S413 may be performed in the reverse order.
In S414, the control unit 121 writes, for example, a setting file in the memory 21 indicating that the setting is completed, and saves it.
In S415, the control unit 121 detects a human body within the detection area set in S405, from the smallest human body size in the detection area set in S412 to the largest human body size in the detection area set in S410. . As a human body detection method, the technique disclosed in Japanese Patent Application Laid-open No. 2014-199506 may be used. Further, the control unit 121 may set a maximum human body size and a minimum human body size for each set detection area, and detect a human body of the set human body size in the set detection area.
The control unit 121 may transmit the detected human bodies, the number of detected human bodies, etc. to an external device via the communication control unit 123, or may display them on the display device 140.
In S416, the control unit 121 determines whether to end the iterative process. If the control unit 121 determines to end the repetitive processing (YES in S416), it ends the process of the flowchart shown in FIG. 5, and if it determines to end the repetitive process (NO in S416), the process returns to S400.

<Other embodiments>
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or device via a network or a storage medium. It can also be realized by a process in which one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Although an example of the embodiment of the present invention has been described in detail above, the present invention is not limited to such specific embodiment.
A part or all of the functional configuration of the imaging device 110 may be implemented in the imaging device 110 as a hardware configuration. Similarly, part or all of the functional configuration of the client device 120 may be implemented in the client device 120 as a hardware configuration. Furthermore, the hardware configurations of the client device and the imaging device described above are merely examples, and for example, they may have multiple CPUs, memories, communication I/Fs, and the like.
Further, in the above-described embodiment, the human body was described as an example of the detection target, but other objects such as a car, an animal, etc. may be used.

As described above, according to the processing of each embodiment described above, it is possible to realize at least one of speeding up the detection processing and reducing false detections.

22 CPU
120 Client device 140 Display device

Claims (12)

A size setting screen for setting a first detection size and a second detection size of a detection target object detected from a detection area in an image , or a size setting screen for setting the detection area in which the detection target object is detected. Display control means for displaying an area setting screen on a display unit;
Detection means for detecting a detection target object having a size between the first detection size and the second detection size from the detection area;
has
The display control means displays, on the size setting screen, an object for setting the first detection size or an object for setting the second detection size, and on the screen for setting the detection area, controlling not to display an object for setting the first detection size or an object for setting the second detection size;
The second detection size is larger than the first detection size,
On the size setting screen, the display control means sets the lower end of the object for setting the second detection size to be below the lower end of the object for setting the first detection size, and The upper edge of the object for setting the first detection size is displayed near the lower edge of the area, and the upper edge of the object for setting the first detection size is above the upper edge of the object for setting the second detection size and is above the upper edge of the detection area. An information processing device that controls display in the vicinity. an acquisition means for acquiring an image;
a first setting means for setting the detection area for the acquired image;
further comprising a second setting means for setting the first detection size and the second detection size of the detection target object in the set detection area,
The information processing apparatus according to claim 1, wherein the detection means detects a detection target object having a size between the first detection size and the second detection size from the detection area in the acquired image. . The information processing apparatus according to claim 2, wherein the image is a moving image. 4. The information processing apparatus according to claim 2, wherein the second setting means sets the first detection size and the second detection size of the detection target object for each of the set detection areas. The information processing according to any one of claims 1 to 4, wherein an object for setting the first detection size and an object for setting the second detection size are displayed so as not to overlap. Device. 6. The display control means displays at least two human body models as an object for setting the first detection size or an object for setting the second detection size. The information processing device described in . 7. The display control means causes the display section to display identification information for identifying whether the screen displayed on the display section is the area setting screen or the size setting screen. information processing equipment. The information processing apparatus according to any one of claims 1 to 7, wherein the display control means causes the display unit to display information indicating the detection target object, which is a result of detection of the detection target object. The display control means includes an object for setting the first detection size, which is the minimum size of the object to be detected , and a second object, which is the maximum size of the object to be detected , on the size setting screen including the image . 9. The information processing apparatus according to claim 2, wherein an object for setting the second detection size and an area representing the detection area are displayed on the display unit in an overlapping manner. an imaging device;
A size setting screen for setting a first detection size and a second detection size of a detection target object detected from a detection area, or an area setting screen for setting the detection area in which the detection target object is detected. display control means for displaying on a display unit;
acquisition means for acquiring an image from the imaging device;
a first setting means for setting the detection area for the acquired image;
a second setting means for setting the first detection size and the second detection size of the detection target object in the set detection area;
Detection means for detecting a detection target object having a size between the first detection size and the second detection size from the detection area in the acquired image;
has
The display control means displays, on the size setting screen, an object for setting the first detection size or an object for setting the second detection size, and on the screen for setting the detection area, controlling not to display an object for setting the first detection size or an object for setting the second detection size;
The second detection size is larger than the first detection size,
On the size setting screen, the display control means sets the lower end of the object for setting the second detection size to be below the lower end of the object for setting the first detection size, and The upper edge of the object for setting the first detection size is displayed near the lower edge of the area, and the upper edge of the object for setting the first detection size is above the upper edge of the object for setting the second detection size and is above the upper edge of the detection area. An information processing system that controls display in the vicinity. A size setting screen for setting a first detection size and a second detection size of a detection target object detected from a detection area in an image , or a size setting screen for setting the detection area in which the detection target object is detected. a display control step for displaying an area setting screen on a display unit;
a detection step of detecting a detection target object having a size between the first detection size and the second detection size from the detection area;
including;
In the display control step, on the size setting screen, an object for setting the first detection size or an object for setting the second detection size is displayed, and on the screen for setting the detection area, controlling not to display an object for setting the first detection size or an object for setting the second detection size;
The second detection size is larger than the first detection size,
In the display control step, on the size setting screen, the lower end of the object for setting the second detection size is located below the lower end of the object for setting the first detection size, and The upper edge of the object for setting the first detection size is displayed near the lower edge of the area, and the upper edge of the object for setting the first detection size is above the upper edge of the object for setting the second detection size and is above the upper edge of the detection area. An information processing method that controls display in the vicinity. A program for causing a computer to function as each means of the information processing apparatus according to any one of claims 1 to 9.

Images