WO2014192483A1

WO2014192483A1 - Information processing system, information processing method, and program

Info

Publication number: WO2014192483A1
Application number: PCT/JP2014/061872
Authority: WO
Inventors: 亮磨大網
Original assignee: 日本電気株式会社
Priority date: 2013-05-30
Filing date: 2014-04-28
Publication date: 2014-12-04
Also published as: JPWO2014192483A1; JP6459964B2

Abstract

[Problem] To provide an information processing device, an information processing method, and a program that make it possible to suitably track a moving body when a door is present. [Solution] An information processing system is provided with a door opening/closing detection unit (120) that detects the open/closed state of a door and an object detection/tracking unit (130) that tracks a moving body that appears in a video. The object detection/tracking unit (130) changes the method used to track the moving body in accordance with the open/closed state of the door when the moving body is positioned in the vicinity of the door.

Description

Information processing system, information processing method, and program

Some aspects according to the present invention relate to an information processing system, an information processing method, and a program.

Recently, a technique for tracking a notable object in a moving image has been proposed. Here, for object tracking, object detection is performed on each frame image constituting the moving image, and then the object tracking is performed by determining the identity of the object detected in each frame image. There are many cases.

However, the object may be temporarily undetectable due to some kind of shielding. In the case where there is such an obstruction, it is difficult to continue tracking before and after occlusion because the object cannot be detected temporarily from the image frame.

Therefore, Patent Document 1 discloses an object tracking device that enables tracking even when the tracking target is shielded for a long time or when the shielding object moves together with the tracking target after shielding.

JP 2007-272436 A

Here, the method described in Patent Document 1 is intended for a case where it is impossible to know in advance which object is a shielding object. However, when a shielding object is assumed in advance, for example, when a person is temporarily shielded by opening and closing a door in front of a merchandise shelf in a convenience store, it is preferable to perform processing according to the shielding object.

Some aspects of the present invention have been made in view of the above-described problems, and provide an information processing apparatus, an information processing method, and a program capable of suitably tracking a moving object when a door is present. Is one of the purposes.

The information processing system according to the present invention includes a detecting unit that detects an open / closed state of a door, and a tracking unit that tracks a moving body shown in an image, and the movement is performed when the moving body is located in the vicinity of the door. Tracking means for changing a body tracking method according to the open / closed state of the door.

An information processing method according to the present invention includes a step of detecting an open / closed state of a door and a step of tracking a moving body shown in an image, and when the moving body is located in the vicinity of the door, The information processing system performs the step of changing the tracking method according to the open / closed state of the door.

The program according to the present invention includes a process for detecting an open / closed state of a door, and a step for tracking a moving body shown in an image, wherein the moving body is tracked when the moving body is located in the vicinity of the door. The computer is caused to execute a process of changing according to the open / closed state of the door.

In the present invention, “part”, “means”, “apparatus”, and “system” do not simply mean physical means, but “part”, “means”, “apparatus”, “system”. This includes the case where the functions possessed by "are realized by software. Further, even if the functions of one “unit”, “means”, “apparatus”, and “system” are realized by two or more physical means or devices, two or more “parts” or “means”, The functions of “device” and “system” may be realized by a single physical means or device.

According to the present invention, it is possible to provide an information processing apparatus, an information processing method, and a program that can suitably track a moving object when a door is present.

It is a figure which shows the specific example of the image | video of a video camera. It is a figure which shows the specific example of the image | video of a video camera. It is a figure which shows the function structure of the information processing system which concerns on 1st Embodiment. It is a figure which shows the function structure of the door opening detection part which concerns on the information processing system of FIG. It is a figure for demonstrating the specific example of the determination method of the opening / closing state of a door. It is a figure which shows the function structure of the object detection and tracking part which concerns on the information processing system of FIG. It is a flowchart which shows the flow of a process of the information processing system shown in FIG. It is a block diagram which shows the structure of the hardware which can mount the information processing system shown in FIG. It is a functional block diagram which shows schematic structure of the monitoring apparatus which concerns on 2nd Embodiment.

Embodiments of the present invention will be described below. In the following description and the description of the drawings to be referred to, the same or similar components are denoted by the same or similar reference numerals.

(1 First Embodiment)
1 to 7 are diagrams for explaining the first embodiment. Hereinafter, the present embodiment will be described along the following flow with reference to these drawings. First, in “1.1”, an overview of the present embodiment will be described. Next, an overview of the functional configuration of the system is described in “1.2”, and a processing flow is described in “1.3”. “1.4” shows a specific example of a hardware configuration capable of realizing the information processing system according to the present embodiment. Finally, the effects and the like according to the present embodiment will be described after “1.5”.

(1.1 Overview)
The present embodiment relates to an information processing system that tracks a moving object (hereinafter also referred to as “object”) in a video imaged by a video camera such as a surveillance camera. In particular, in the information processing system according to the present embodiment, it is possible to suitably track a moving object even when there is a shielding by a door.

In addition, as a specific example of the moving body (object) tracked by the information processing system according to the present embodiment, for example, a person, an animal, a wheelchair, a cart for product introduction, and the like can be considered. The description will be focused on the case of a person.

Consider a system in which a person is extracted from a video from a surveillance camera or the like that captures the inside of the store, and then the tracked person is tracked. However, in such a system, when there is a fixture with a door such as a drink corner of a convenience store, for example, if a person is hidden by the door, tracking of the person is often interrupted.

Referring to FIGS. 1A and 1B, tracking of the person P shown in the video 10 of the surveillance camera will be described. FIG. 1A and FIG. 1B are diagrams showing a specific example of an image 10 for photographing a drink corner of a convenience store, for example. In the example of FIGS. 1A and 1B, the person P and the doors D1 to D3 for taking out the refrigerated goods are shown in the video 10.

In the example of FIG. 1A, the person P is moving in the direction of the arrow a toward the door D2. Further, all the doors D1 to D3 are in a closed state. In the state of FIG. 1A, there is no shielding object that blocks the person P, and the whole body of the person P is shown in the video 10. That is, continuous tracking of the person P is easy.

FIG. 1B shows an image 10 showing a state where the person P has moved to the door D2 and opened the door D2. In the example of FIG. 1B, the door D2 is in an open state, and the doors D1 and D3 are in a closed state. Since the person P is hidden behind the door D2, only a part of the person P is shown in the video 10. As shown in FIG. 1B, when the person P is hidden behind the door, it is difficult to detect the person P from the video 10. Furthermore, once the person P cannot be detected, even if the whole body of the person P is reflected in the video 10 again, the person P reflected before the shielding and the person P reflected again after the shielding are the same person. Unless it is associated with a certain thing, it is impossible to detect an accurate flow line of the person P. In analyzing the flow lines of customers in the store, it is important to keep the flow lines as discontinuous as possible.

Therefore, in the information processing system according to the present embodiment, after determining the open / closed state of the door, when the moving body exists in the vicinity of the door in the open state (open state), the moving body is Since there is a high possibility of being shielded (or shielded in the near future), the tracking state immediately before the door is opened is maintained. Thereby, since the identity of the moving body is determined before and after the door is opened, the flow line of the moving body can be prevented from being interrupted as a result.
A plurality of door opening / closing determination methods are conceivable. For example, it is conceivable to analyze the characteristics of the upper or lower edge portion of the door.
Hereinafter, the information processing system according to the present embodiment will be described in detail.

(1.2 System overview)
(1.2.1 Overview of the entire system)
First, the system configuration of the information processing system 100 according to the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram illustrating a system configuration of the information processing system 100. The information processing system 100 broadly includes an input unit 110, a door opening / closing detection unit 120, an object detection / tracking unit 130, and an output unit 140.

The input unit 110 receives video input from, for example, a monitoring camera (not shown) or a storage medium that records video captured by the monitoring camera. The input unit 110 outputs the input video to the door opening / closing detection unit 120 and the object detection / tracking unit 130.

The door open / close detection unit 120 detects the open / closed state of the door shown in the video. Here, there are a plurality of methods for determining the detection state of the open / closed state of the door. Here, the determination is made by analyzing the door region in the video. In addition, for example, it is conceivable to detect the open / closed state of the door using a sensor installed on the door. The door opening / closing detection unit 120 outputs information indicating the door opening / closing state (door opening / closing state information) to the object detection / tracking unit 130. The detailed functional configuration of the door opening / closing detection unit 120 will be described in detail later in “1.2.2” with reference to FIGS. 3 and 4.

The object detection / tracking unit 130 detects a moving object from the video and tracks it between frames. As a method for detecting a moving object by the object detection / tracking unit 130, for example, a method of previously learning feature quantities such as a shape and color of the moving object and specifying the moving object using the learning result is considered. It is done. In addition, tracking of a moving object is performed by, for example, performing processing for each frame to identify a moving object whose position and feature amount are approximated between consecutive (or close to shooting time) frames as the same moving object. A method of identifying the body flow line is conceivable.

At this time, the object detection / tracking unit 130 changes the tracking method of the moving object using the door opening / closing determination result information. More specifically, first, the object detection / tracking unit 130 calculates the coordinates of the detected moving object, and then compares the coordinate value with the coordinate value of the door. As a result, when it is determined that the moving body is near the door (for example, the difference in coordinate values is equal to or less than the threshold value), the object detection / tracking unit 130 determines whether the door is in an open state or a closed state. Is determined from the door open / close state information. If the door is open, it is considered that there is a possibility that the moving object may be blocked by the door at present or in the near future. Therefore, the object detection / tracking unit 130 detects the detection result related to the moving object. The tracking result is not updated with the detection result / tracking result using the current frame, but the previous result is held. Thereafter, with respect to the moving body once determined to be in the shielding state, the open / closed state of the door is continuously checked in each subsequent frame, and the tracking is resumed when the door is closed.
The object detection / tracking unit 130 will be described in detail later in “1.2.3” with reference to FIG.

When determining whether or not the moving body is near the door, consider the direction in which the door opens, and if it can be determined that the moving body is on the side that is not hidden by the shadow of the door (the monitoring camera side than the door) The object detection / tracking unit 130 may continue tracking the moving object. Alternatively, even when the moving body is closer to the monitoring camera than the door and the whole body is reflected, there is a possibility that tracking is more difficult than when the door is closed due to a change in the background area. For this reason, you may adjust the parameter which concerns on a mobile body tracking. Also, in the near future, tracking may be interrupted due to the influence of an open door (for example, when a moving object moves and hides in the shadow of the door immediately afterwards). You may adjust it.

Also, when the door is made of glass, the moving object may be detected depending on the door angle even if the door is closed. Therefore, even if the door is in an open state (a person is in a shielding state), if the moving object can be detected, the object detection / tracking unit 130 updates the tracking state. Anyway.

The output unit 140 outputs the tracking result of the moving object by the object tracking unit 135. As an output destination of the tracking result by the output unit 140, for example, a display device, a storage medium such as an HDD (Hard Disk Drive), or the like can be considered.

(1.2.2 Door opening / closing detection unit 120)
Hereinafter, the functional configuration of the door opening / closing detection unit 120 according to the present embodiment will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram illustrating a functional configuration of the door opening / closing detection unit 120. The door opening / closing detection unit 120 includes a feature analysis unit 121, a door movable region specifying unit 123, and a door opening / closing determination unit 125.

The door movable area specifying unit 123 is a partial area (hereinafter, also referred to as a door feature amount detection area) of an area (hereinafter, also referred to as a door movable area) in which a change occurs when the door is opened and closed in the video. specify. In the present embodiment, the upper region of the door is designated as the door feature amount detection region. This point will be described with reference to FIG.

4A is a diagram showing the video 10 in which the door D2 is closed, and FIG. 4B is a diagram showing the video 10 in which the door D2 is open. The image of the door movable region 11 changes between when the door D2 is in the open state and when it is in the closed state. For example, in this door movable region 11, the region where the upper end of the door D2 moves is set as the door feature amount detection region 12 used when determining whether the door D2 is in an open state or a closed state. it can. Since the position of the door feature amount detection area 12 in the video 10 differs depending on the installation location of the surveillance camera, for example, the door movable area specifying unit 123 may designate based on an input using an input interface from the user. Conceivable.

The feature analysis unit 121 extracts the feature amount of the door feature amount detection region 12 specified by the door movable region specifying unit 123. Here, as the feature amount analyzed by the feature analysis unit 121, for example, it is conceivable to extract edge information of the door feature amount detection region 12.

The door open / close determination unit 125 determines whether the door is in an open state or a closed state based on the feature amount of the door feature amount detection region 12 analyzed by the feature analysis unit 121. For example, if the edge information of the door feature amount detection region 12 is used as a feature amount, the door opening / closing determination unit 125 creates a histogram of the gradient direction and the magnitude of the gradient, and the histogram is in an open state. Whether the door D2 is in an open state or a closed state can be determined depending on whether it is close to a histogram or a closed histogram. In addition, the door open / close determination unit 125 outputs door open / close state information indicating whether the door D2 is in an open state or a closed state.

When determining whether the door D2 is in the open state or the closed state using the edge information, the region including the lower end of the door may be set as the door feature amount detection region 12 used for feature amount extraction. Conceivable. However, if the area including the upper end of the door is the door feature amount detection area 12, the detection accuracy can be increased because the possibility of being blocked by any shielding object (for example, a person) is low.

In the above description, the process is performed only on the door D2, but the present invention is not limited to this. The door is obtained by performing the same process on all the doors D1 to D3 shown in the video 10. The door opening / closing state information can be generated in units.

(1.2.3 Object Detection / Tracking Unit 130)
Hereinafter, the functional configuration of the object detection / tracking unit 130 according to the present embodiment will be described with reference to FIG. FIG. 5 is a diagram illustrating a functional configuration of the object detection / tracking unit 130. The object detection / tracking unit 130 includes an object detection unit 131, a door vicinity determination unit 133, and an object tracking unit 135.

As described above, the object detection / tracking unit 130 extracts a moving object from the input video and tracks it between frames. At this time, the object detection / tracking unit 130 uses the door opening / closing determination result.

The object detection unit 131 performs a moving object detection process on each input image frame. As a method of detecting a moving object, a method of detecting a moving object using the learning result after learning the feature amount (for example, size, shape, color histogram, etc.) of the moving object in advance can be considered.

The door vicinity determination unit 133 calculates the coordinates of the moving body detected by the object detection unit 131 when the door is in the open state based on the door open state information output from the door open / close detection unit 120. In addition, the door vicinity determination unit 133 compares the coordinate value of the moving body with the coordinate value of the door stored in advance, and whether or not the difference (distance) between the coordinate values is, for example, a threshold value or less. Based on the above, it is determined whether or not the moving body is in the vicinity of the door. The coordinates obtained at this time may be coordinates on the video, but may be coordinates on the actual floor. In this case, the door vicinity determining unit 133 obtains the coordinate value on the floor of the person P using the camera parameters from the coordinates on the image, compares the coordinate value with the coordinate value of the door on the floor, and It is determined whether the difference is equal to or less than a threshold value.

The object tracking unit 135 compares the detection results of the moving object shown in each image frame between the frames, and the moving objects having similar feature amounts and positions are tracked as being the same moving object.

Here, regarding the moving body determined by the door vicinity determining unit 133 to be in the vicinity of the door in the open state, the object tracking unit 135 considers that the moving body may be blocked by the door, Maintain the previous state without updating the object detection / tracking result (the previous object detection / tracking result is used for object tracking for the next image frame).

For a mobile object that has been determined to be in a shielded state, the object tracking unit 135 checks the open / closed state of the door that shields the mobile object in each subsequent frame, and when the door becomes closed (the door is closed). When it is closed, it will resume tracking.

The door vicinity determination unit 133 determines whether or not the door is near the door and determines whether or not the moving body is on the side not hidden by the door as viewed from the monitoring camera in consideration of the door opening direction. You may do it. When the moving body is on the side that is not hidden by the door, the object tracking unit 135 may continue tracking the moving body. Or, even if the moving object is on the side that is not hidden by the door, the tracking may be interrupted due to the influence of the door, so adjust the parameters related to the tracking of the moving object so that it is difficult to interrupt. It is also possible to do.

Even when the moving body is in a position hidden behind the door, if the door is made of glass or other transparent material, the object detection unit 131 may be able to detect the moving body depending on the angle of the door. is there. Therefore, when the probability of the detection result of the moving object is high, the object tracking unit 135 tracks the moving object using the detection result even when the moving object is in a state of being blocked by the door. May be.

(1.3 Process flow)
Next, a processing flow of the information processing system 100 will be described with reference to FIG. FIG. 6 is a flowchart showing a processing flow of the information processing system 100 according to the present embodiment.

Each processing step to be described later can be executed in any order or in parallel as long as there is no contradiction in processing contents, and other steps can be added between the processing steps. good. Further, a step described as a single step for convenience can be executed by being divided into a plurality of steps, and a step described as being divided into a plurality of steps for convenience can be executed as one step.

The input unit 110 receives video input from, for example, a surveillance camera or a storage medium that stores video of the surveillance camera (S601). The feature analysis unit 121 of the door opening / closing detection unit 120 analyzes the feature amount of at least a part of the movable region 11 (the door feature amount detection region 12 in the present embodiment) of the input video. (S603). The door open / close determination unit 125 determines the open / closed state of the door using the feature amount extracted by the feature analysis unit 121 (S605).

The object detection unit 131 of the object detection / tracking unit 130 detects the presence / absence of a moving body in the input video (S607), and the door vicinity determination unit 133 determines whether the moving body is in the vicinity of the door. (S609). If the moving body is in the vicinity of the door (Yes in S609), the door vicinity determining unit 133 determines whether or not the door is in an open state (S611). As a result, if the door is in an open state and the moving body is in the vicinity of the door (Yes in S611), the object tracking unit 135 may continue tracking the moving body. The state of the moving body (more specifically, the detection result and tracking result of the moving body) is held so that the tracking of the moving body of the next moving body can be continued.

If there is no moving object in the vicinity of the door or the door is in a closed state (No in S609 and No in S611), the object tracking unit 135 performs a normal moving object tracking process.

(1.4 Hardware configuration)
Hereinafter, an example of a hardware configuration when the information processing system 100 described above is realized by a computer will be described with reference to FIG. Note that the functions of the information processing system 100 can also be realized by a plurality of information processing apparatuses.

7, the information processing system 100 includes a processor 701, a memory 703, a storage device 705, an input interface (I / F) 707, a data I / F 709, a communication I / F 711, and a display device 713.

The processor 701 controls various processes in the information processing system 100 by executing a program stored in the memory 703. For example, the processing related to the input unit 110, the door opening / closing detection unit 120, the object detection / tracking unit 130, and the output unit 140 described with reference to FIG. 2 is temporarily stored in the memory 703 and mainly operates on the processor 701. It can be realized as a program.

The memory 703 is a storage medium such as a RAM (Random Access Memory). The memory 703 temporarily stores a program code of a program executed by the processor 701 and data necessary for executing the program. For example, a stack area necessary for program execution is secured in the storage area of the memory 703.

The storage device 705 is a non-volatile storage medium such as a hard disk or a flash memory. The storage device 705 stores an operating system, various programs for realizing the input unit 110, the door opening / closing detection unit 120, the object detection / tracking unit 130, and the output unit 140, various data, and the like. Programs and data stored in the storage device 705 are referred to by the processor 701 by being loaded into the memory 703 as necessary.

The input I / F 707 is a device for receiving input from the user. The user input for specifying the door movable area to the door movable area specifying unit 123 described with reference to FIG. 3 can also be realized by the input I / F 707. Specific examples of the input I / F 707 include a keyboard, a mouse, and a touch panel. The input I / F 707 may be connected to the information processing system 100 via an interface such as a USB (Universal Serial Bus), for example.

The data I / F 709 is a device for inputting data from outside the information processing system 100. Specific examples of the data I / F 709 include a drive device for reading data stored in various storage media. The data I / F 709 may be provided outside the information processing system 100. In that case, the data I / F 709 is connected to the information processing system 100 via an interface such as a USB.

The communication I / F 711 is a device for performing data communication with an external device of the information processing system 100, for example, a monitoring camera or the like by wire or wireless. It is conceivable that the communication I / F 711 is provided outside the information processing system 100. In that case, the communication I / F 711 is connected to the information processing system 100 via an interface such as a USB.

The display device 713 is a device for displaying various information. Specific examples of the display device 713 include a liquid crystal display and an organic EL (Electro-Luminescence) display. The display device 713 may be provided outside the information processing system 100. In that case, the display device 713 is connected to the information processing system 100 via a display cable or the like, for example.

(1.5 Effects according to this embodiment)
As described above, in the information processing system 100 according to the present embodiment, after determining whether the door is open or closed, when the moving body exists near the door in a state where the door is open (open state). Since the mobile object is likely to be shielded (or shielded in the near future), the tracking state immediately before the door is opened is maintained. This prevents the moving line of the moving body from being interrupted before and after the door is opened. That is, the moving body can be suitably tracked.

(2 Second Embodiment)
The second embodiment will be described below with reference to FIG. FIG. 8 is a block diagram illustrating a functional configuration of the information processing system 800. As illustrated in FIG. 8, the information processing system 800 includes a detection unit 810 and a tracking unit 820.
The detection unit 810 detects the open / closed state of the door.

The tracking unit 820 tracks a moving object shown in the video. Furthermore, the tracking unit 820 changes the tracking method of the moving body according to the open / closed state of the door when the moving body is positioned near the door.
By mounting in this way, in the information processing system 800 according to the present embodiment, when a door exists, it is possible to suitably track the moving body.

(3 Additional notes)
Note that the configurations of the above-described embodiments may be combined or some of the components may be replaced. The configuration of the present invention is not limited to the above-described embodiment, and various modifications may be made without departing from the scope of the present invention.

Note that part or all of the above-described embodiments can be described as in the following supplementary notes, but is not limited to the following. Moreover, the program of this invention should just be a program which makes a computer perform each operation | movement demonstrated in said each embodiment.

(Appendix 1)
A detecting means for detecting an open / closed state of the door, and a tracking means for tracking the moving body shown in the image, wherein when the moving body is located in the vicinity of the door, the tracking method of the moving body is determined by opening / closing the door. An information processing system comprising tracking means that changes according to a state.

(Appendix 2)
The information processing system according to claim 1, wherein the detection unit detects an open / closed state of the door based on a movable region of the door shown in the video.

(Appendix 3)
The information processing system according to claim 2, wherein the detection unit detects an open / closed state of the door based on an upper image in the height direction in the movable region of the door.

(Appendix 4)
The information processing system according to appendix 2 or appendix 3, further comprising designation means for designating an image area used by the detection means for detecting the open / closed state of the door.

(Appendix 5)
When the moving body is located in the vicinity of the door and the door is in an open state, the tracking means is configured to move the moving body in the vicinity of the door before and after the door is opened. The information processing system according to any one of supplementary notes 1 to 4, which is associated with the same mobile object.

(Appendix 6)
The information processing system according to any one of appendices 1 to 5, wherein the tracking unit changes a parameter related to extraction of a moving object shown in an image when the door is in an open state.

(Appendix 7)
The tracking means changes whether or not to use the detection result according to the probability of the detection result of the moving body located in the vicinity of the door when the door is in an open state. The information processing system according to claim 6.

(Appendix 8)
A step of detecting an open / closed state of the door, and a step of tracking the moving body shown in the image, wherein when the moving body is located in the vicinity of the door, the tracking method of the moving body is changed to the open / closed state of the door. An information processing method in which the information processing system performs the step of changing in response.

(Appendix 9)
The information processing method according to appendix 8, wherein an open / closed state of the door is detected based on a movable region of the door shown in the video.

(Appendix 10)
The information processing method according to appendix 9, wherein an open / closed state of the door is detected based on an upper image in the height direction of the movable region of the door.

(Appendix 11)
The information processing method according to appendix 9 or appendix 10, further comprising a step of designating an image region used for detecting the open / closed state of the door.

(Appendix 12)
When the moving body is located in the vicinity of the door and the door is in an open state, the moving body in the vicinity of the door is the same moving body before and after the door is opened. The information processing method according to any one of appendix 8 to appendix 11, which is associated as follows.

(Appendix 13)
The information processing method according to any one of supplementary notes 8 to 12, wherein when the door is in an open state, a parameter related to extraction of a moving object shown in an image is changed.

(Appendix 14)
Any one of appendix 8 to appendix 13, wherein when the door is in an open state, whether or not to use the detection result is changed according to the probability of the detection result of the moving body located in the vicinity of the door. Information processing method according to item.

(Appendix 15)
A process of detecting the open / closed state of the door and a step of tracking the moving body shown in the video, and when the moving body is located in the vicinity of the door, the tracking method of the moving body is changed to the open / closed state of the door. A program that causes a computer to execute processing that changes depending on the computer.

(Appendix 16)
The program according to appendix 15, wherein the open / closed state of the door is detected based on a movable area of the door shown in the video.

(Appendix 17)
The program according to appendix 16, wherein the open / closed state of the door is detected based on an upper image in the height direction in the movable region of the door.

(Appendix 18)
The program according to appendix 16 or appendix 17, further comprising designation means for designating an image area used for detecting the open / closed state of the door.

(Appendix 19)
When the moving body is located in the vicinity of the door and the door is in an open state, the moving body in the vicinity of the door is the same moving body before and after the door is opened. The program according to any one of supplementary notes 15 to 18, which is associated as follows.

(Appendix 20)
The program according to any one of appendix 15 to appendix 19, wherein when the door is in an open state, a parameter related to extraction of a moving object shown in an image is changed.

(Appendix 21)
Any one of Supplementary Notes 15 to 20, wherein when the door is in an open state, whether or not to use the detection result is changed according to the probability of the detection result of the moving body located in the vicinity of the door. Program described in the section.

This application claims priority based on Japanese Patent Application No. 2013-113696 filed on May 30, 2013, the entire disclosure of which is incorporated herein.

DESCRIPTION OF SYMBOLS 10 ... Image | video, 11 ... Door movable area | region, 12 ... Door feature-value detection area | region, 100 ... Information processing system, 110 ... Input part, 120 ... Door opening / closing detection part, 121. ..Characteristic analysis unit, 123... Door movable region specifying unit, 125 .. door opening / closing determination unit, 130... Object detection / tracking unit, 131... Object detection unit, 133. 135, object tracking unit, 140 ... output unit, 701 ... processor, 703 ... memory, 705 ... storage device, 707 ... input interface, 709 ... data interface, 711 ... Communication interface, 713 ... Display device, 800 ... Information processing system, 810 ... Detection part, 820 ... Tracking part, D1 ... Door, D2 ... Door, P・・Thing

Claims

Detecting means for detecting the open / closed state of the door;
Tracking means for tracking a moving body shown in an image, the tracking means changing a tracking method of the moving body according to an open / closed state of the door when the moving body is located in the vicinity of the door. Information processing system.
The detection means detects an open / closed state of the door based on a movable area of the door shown in the video.
The information processing system according to claim 1.
The detecting means detects an open / closed state of the door based on an image of an upper portion in the height direction in the movable region of the door.
The information processing system according to claim 2.
The detecting means further comprises a specifying means for specifying an image region used for detecting the open / closed state of the door.
The information processing system according to claim 2 or claim 3.
When the moving body is located in the vicinity of the door and the door is in an open state, the tracking means is configured to move the moving body in the vicinity of the door before and after the door is opened. , As the same moving object,
The information processing system according to any one of claims 1 to 4.
The tracking means, when the door is in an open state, to change a parameter related to extraction of a moving object shown in a video;
The information processing system according to any one of claims 1 to 5.
The tracking means changes whether or not to use the detection result according to the probability of the detection result of the moving body located in the vicinity of the door when the door is in an open state.
The information processing system according to any one of claims 1 to 6.
Detecting the open / closed state of the door;
An information processing system that tracks a moving body shown in an image, wherein when the moving body is located in the vicinity of the door, the tracking method of the moving body is changed according to an open / closed state of the door. Information processing method to be performed.
Processing to detect the open / closed state of the door;
A step of tracking a moving object shown in an image, wherein when the moving object is positioned in the vicinity of the door, the computer executes a process of changing a tracking method of the moving object according to an open / closed state of the door program.