WO2014112407A1 - Information processing system, information processing method, and program - Google Patents

Information processing system, information processing method, and program Download PDF

Info

Publication number
WO2014112407A1
WO2014112407A1 PCT/JP2014/050080 JP2014050080W WO2014112407A1 WO 2014112407 A1 WO2014112407 A1 WO 2014112407A1 JP 2014050080 W JP2014050080 W JP 2014050080W WO 2014112407 A1 WO2014112407 A1 WO 2014112407A1
Authority
WO
WIPO (PCT)
Prior art keywords
time
information processing
target area
moving body
score
Prior art date
Application number
PCT/JP2014/050080
Other languages
French (fr)
Japanese (ja)
Inventor
有紀江 海老山
小西 勇介
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Publication of WO2014112407A1 publication Critical patent/WO2014112407A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition

Definitions

  • Some aspects according to the present invention relate to an information processing system, an information processing method, and a program.
  • Patent Document 1 discloses detecting a staying location by using a video taken by a fixed camera such as a surveillance camera and quantifying the degree of human stillness, staying, gathering, etc. in an area of the shooting range. Yes.
  • scoring is performed on each block by dividing the region corresponding to the shooting range into a plurality of blocks and plotting the trajectory for each person. As a result, the block whose score is equal to or greater than the threshold is extracted as the staying location.
  • Some aspects of the present invention have been made in view of the above-described problems, and one of the objects is to provide an information processing system, an information processing method, and a program that can suitably detect staying of a moving object. To do.
  • An information processing system includes: an input unit that receives input of information relating to the position of a moving body at each time in the target area; and the target area estimated based on the position of each moving body at each time. Calculating means for calculating a score indicating the degree of staying in the target area according to the staying time in which the moving body stays.
  • the image processing method includes a step of receiving information related to a position of a moving body at each time in the target area, and a movement to each target area estimated based on the position of each moving body at each time.
  • the information processing system performs a step of calculating a score indicating a staying degree related to the target region according to a staying time in which the body stays.
  • the program according to the present invention includes a process for receiving input of information relating to the position of a moving body at each time in the target area, and each moving body in the target area estimated based on the position of each moving body at each time.
  • the computer is caused to execute a process of calculating a score indicating the degree of staying related to the target area.
  • “part”, “means”, “apparatus”, and “system” do not simply mean physical means, but “part”, “means”, “apparatus”, “system”. This includes the case where the functions possessed by "are realized by software. Further, even if the functions of one “unit”, “means”, “apparatus”, and “system” are realized by two or more physical means or devices, two or more “parts” or “means”, The functions of “device” and “system” may be realized by a single physical means or device.
  • FIG. 1 It is a flowchart which shows the flow of a process of the information processing system shown in FIG. It is a block diagram which shows the structure of the hardware which can mount the information processing system shown in FIG. It is a functional block diagram which shows schematic structure of the information processing system which concerns on 2nd Embodiment.
  • the information processing system is a system for determining whether or not a moving object is staying (stopped) in the stay determination area A1.
  • a moving body not only a person (human) but also a car, a truck, a bicycle, a motorcycle, and the like can be considered. In the following description, it is assumed that a person is staying.
  • “person” in the following description refers to a person detected by the system unless there is a special description, and does not necessarily match one-to-one with an actual person. More specifically, for example, even if one person is actually moving, if each person detected at each timing cannot be detected by the system as being the same, The number will be multiple.
  • the stay determination area A1 is the target of stay determination in the whole, but the present invention is not limited to this, and a plurality of areas can be the target of stay determination.
  • the region to be subject to stay determination may be determined in advance, or the information processing system may accept input of settings by the user as needed.
  • the person P1 and the person P2 stay in the stay determination area A1 from time t0 to time t1, but the person P3 passes through the stay determination area A1 from time t0 to time t1. .
  • the number of staying persons in the stay determination area A1 during the time period from time t0 to t1 can be determined to be two. it can.
  • the information processing system does not consider the person who just passes through the stay determination area A1, and determines the stay degree based only on the person who stays purely in the stay determination area A1. Scoring (calculation of a score for determining the staying degree) is performed. Alternatively, a person who only passes through the stay determination area A1 performs scoring for stay determination with a lower score than the staying person.
  • an information processing system it is possible to detect a place where a large number of persons hang out without passing through, and therefore it is possible to accurately detect an area that should be noted in terms of security. Moreover, if it is used for various commercial facilities such as supermarkets and convenience stores, it becomes possible to determine the staying time and number of customers of each purchase shelf, so that it can be used for marketing. In addition, when used in, for example, a factory or a warehouse, the visualization of the work time for each area can detect chats between workers and can be used for verification of work efficiency.
  • the video camera C1 captures an area including the stay determination area A1, and then analyzes the captured video.
  • a method of detecting the positions of the persons P1, P2, and P3 at each time is adopted.
  • the method of acquiring the movement information of the person (moving body) is not limited to this, and any apparatus that can detect the position information of the person (moving body) and specify the detection time in the stay determination area A1 may be used. . Further, it is not necessary to detect a unique ID (identifier) for identifying each person (moving body).
  • a moving body using a camera, a floor pressure sensor, a laser range finder, a human sensor, or a radar that uses a sensor installed in a tracking environment and does not require the person (moving body) to hold the sensor. It can be realized by a tracking system.
  • the mobile body itself needs to hold a device for position acquisition, but under the condition that a unique ID cannot be acquired from the device, a wireless communication device such as GPS (Global Positioning System) or ultrasonic waves You may implement
  • GPS Global Positioning System
  • GPS Global Positioning System
  • the movement information can be used even when there are a large number of persons in the stay determination area A1 and tracking is interrupted due to the overlapping of persons, or when a moving body other than a person is erroneously detected as a person. it can.
  • FIG. 2 is a functional block diagram showing a functional configuration of the information processing system 100.
  • the information processing system 100 roughly includes an input unit 110, a score calculation unit 130, and an output unit 140.
  • these configurations will be described in order.
  • the input unit 110 receives input of movement information of each person.
  • This information can be, for example, position information of a person at each time obtained by analyzing a video photographed by a video camera C1 or the like (possibly a plurality of video cameras C1). More specifically, for example, it is possible to obtain movement information for each person extracted as an object by comparing the feature amount of a person photographed by the video camera C1 and time-series images (frames).
  • movement information may be input from the video camera C1 as needed in real time, or movement information may be received by reading from a storage medium (not shown).
  • FIG. 3 shows an example of the movement information input to the input unit 110.
  • information on an ID assigned to each person (hereinafter also referred to as a mobile object ID) is associated with the time when each person is detected and its position (coordinates).
  • the movement information ID is identification information assigned to determine that the position information is related to the same moving body with respect to the position information of the moving body (for example, a person) that has been successfully detected continuously. That is, the position information group (position coordinate group) to which the same ID is assigned represents the locus of the same moving object.
  • the position detection of the moving body fails at a certain time, the trajectory of the moving body that has been detected until then is interrupted. For this reason, if the position detection of the moving object succeeds again after the position detection of the moving object fails, a new ID is assigned to the moving object.
  • the score calculation unit 130 calculates a residence score indicating the degree of residence in each time zone of the residence determination region A1 based on the flow line of the person (moving body detected as the same person) in each time zone. A time zone in which the stay score is high indicates that there are many staying people in the stay determination area A1.
  • the score calculation unit 130 includes a motion determination unit 131, a stay score calculation unit 133, a staying number calculation unit 135, and stay determination area information 137.
  • the movement determination unit 131 specifies a person (flow line) that can be determined to be moving by determining the movement of each person in the stay determination area A1. Thereby, it becomes possible to calculate the staying score by excluding the flow line of the person who can be determined to be moving.
  • a motion line-based motion determination method and an image-based motion determination method will be described with reference to FIGS. 4 and 5.
  • the movement determination method based on the flow line is a technique for separating a moving person and a staying person by paying attention to the flow line of each person. A specific example will be described with reference to FIG.
  • the flow line related to the person P4 in the target time zone for stay determination has a start point entering the stay determination area A1 and an end point exiting from the stay determination area A1. Accordingly, it can be determined that the person P4 has passed through the stay determination area A1 during this time period. Therefore, a person having a flow line having a start point entering the stay determination area A1 and an end point exiting from the stay determination area A1 can be determined to be moving without staying, and thus excluded from the stay score calculation. can do.
  • the moving speed of the person P5 in the target time zone for the stay determination is faster than the threshold value.
  • Such a person P5 having a high moving speed can be considered not staying and can be excluded from the calculation of the staying score.
  • the moving speed can be calculated by dividing the distance between the positions of the moving body at each time by the time required for the movement.
  • an image-based motion determination method for example, using an optical flow, a human flow generation region in which a plurality of persons advance in the same direction at approximately the same speed is specified as shown in FIG. Since it can be considered that the person in the person flow generation area is moving without staying, it can be excluded from the calculation of the staying score.
  • the motion discriminating unit 131 may use only one or both of the motion line-based motion determination method and the image-based motion determination method.
  • the stay score calculation unit 133 receives an input of a flow line related to the moving body determined to be staying by the motion determination unit 131, and calculates a stay score of the target time zone related to the stay determination region A1.
  • the stay score is calculated according to the sum of the flow rate detection time rate and the method of calculating the stay score based on the number of flow lines detected continuously over a certain time. A specific example of the calculation method will be described with reference to FIGS.
  • FIG. 6 is a diagram for explaining a method of calculating a residence score based on the number of flow lines detected continuously for a certain time or more.
  • four persons A to D are in the stay determination area A1 during times t0 to t1, which are target times for stay determination.
  • the person A is 70% of the time period
  • the person B is 30% of the time
  • the person C is 20% of the time
  • the person D is 80% of the time of the time in the stay determination area A1. It is assumed that a flow line has been detected.
  • the person A and the person who are considered to have been in the stay determination area A1 in the target time zone for a threshold time of 50% or more D can be regarded as a staying person, and a staying score can be 2 (2 persons).
  • the threshold value may be determined in advance, or the information processing system 100 may accept input of settings by the user as needed.
  • the target time length of the stay determination is determined by the size of the stay determination area A1 and the moving speed of the person who is the tracking target. That is, it is desirable to set a time longer than the time required to pass through the stay determination region A1 at the assumed moving speed of the moving body as the target time length for stay determination.
  • the information processing system 100 may accept input of setting of the target time length from time to time by the user.
  • FIG. 7 is a diagram for explaining this method.
  • the time for the persons A to D to stay in the stay determination area A1 is the same as in the case of FIG.
  • a residence score is calculated in proportion to each residence time rate. Since the stay time of each of the persons A to D is 70%, 30%, 20%, and 80%, the total of 2 (0.7 + 0.3 + 0.2 + 0.8) is added to the number of people staying in the time period. It can be set as the residence score equivalent to.
  • the tracking target is based on the continuous detection time length of the flow line. It is possible to score the degree to which a certain mobile object is stationary.
  • the staying number calculation unit 135 is for correcting the staying score calculated by the staying score calculation unit 133 and corresponding to the number of staying people in the target time zone.
  • the staying number calculation unit 135 has a function for correcting such a person extraction error.
  • FIG. 8 is a diagram for explaining a specific example of the method.
  • the number of detected persons can be two.
  • the number of detected persons is one.
  • the staying number calculation unit 135 can estimate the staying number of persons in the time zone that is the reference target of the staying score by analyzing the transition of the staying number of persons over a plurality of time periods and the presence or absence of the flow line. . This estimation can be performed only in the time zone (past) before the target time zone or only in the time zone (future) after the target time zone. However, if both are used, estimation with higher accuracy can be performed.
  • the retention score is corrected by multiplying a low coefficient for the number of flow lines (number of people) in areas where flow lines are easy to detect, and a high coefficient for the number of flow lines (number of people) in areas where flow lines are difficult to detect. can do.
  • a recognition error is likely to occur. Therefore, by performing such correction, it is possible to calculate a suitable stay score.
  • the staying number calculation unit 135 may use only one of the stay score adjustment based on the flow line analysis in a plurality of time zones and the stay score adjustment according to the coefficient based on the position, or both. It is also possible.
  • the stay determination area information 137 is information related to the coordinates of the stay determination area A1.
  • the stay determination area may be defined in any shape such as a polygon or a circle. If the position coordinates of the stay determination area are polygons, the vertex coordinates are input, and the coordinates and radius of the center point of the circle are entered. You can enter. Further, when setting a plurality of stay determination areas, they may be set so as to overlap each other, or may be installed so as not to overlap each other.
  • the output unit 140 outputs the residence score calculated by the score calculation unit 130 and corresponding to the number of people staying in the stay determination region A1 in the target time zone, in association with the coordinates (position) and time of the stay determination region A1. At this time, it is also possible to output a stay score relating to a plurality of monitoring areas over a plurality of time zones. If implemented in this way, it is possible to identify the time transition of the residence score, the difference for each region, and the like.
  • the stay score can be simply output as a numerical value, and the stay score is output by causing the display device to display a map screen in which the shade of the area on the map changes according to the stay score. It is also possible.
  • the display device may notify the occurrence of the retention by a message such as “Residence has occurred in front of convenience store A”, for example. .
  • FIG. 9 is a flowchart showing a processing flow of the information processing system 100 according to the present embodiment.
  • Each processing step to be described later can be executed in any order or in parallel as long as there is no contradiction in processing contents, and other steps can be added between the processing steps. good. Further, a step described as a single step for convenience can be executed by being divided into a plurality of steps, and a step described as being divided into a plurality of steps for convenience can be executed as one step.
  • the input unit 110 receives the movement information illustrated in FIG. 3 (S901). As described above, a plurality of movement information input methods are conceivable. In addition to the case where the movement information recorded in the storage medium is read in addition to the case where the movement information is input in real time by analyzing the video captured by the video camera C1 or the like. It is done.
  • the motion discriminating unit 131 discriminates whether or not each person is moving by discriminating the motion of each person based on the flow line specified based on the movement information input from the input unit 110 ( S905). As described above, as described above, when the movement is determined based on the flow line, it is determined whether the movement line crosses the stay determination area A1, and the speed of each moving body exceeds the threshold value based on the flow line. It is conceivable to make a determination by identifying whether or not it is. When discriminating on the basis of an image, it is possible to first identify a human flow generation region and then determine that a flow line (person) on the human flow generation region is moving.
  • the staying score calculation unit 133 calculates a staying score corresponding to the number of staying persons in the target time zone based on the flow line excluding the flow line (person) determined as the movement determination unit 131 moving (S907). ).
  • the score is calculated according to the number of flow lines detected in the stay determination region A1 for a certain period of time, or for each moving object. It may be calculated according to the detection time length.
  • the staying number calculation unit 135 corrects the staying score (S909).
  • the correction method as described above, it is conceivable to perform correction according to the position of the flow line (person) or correction based on the flow line analysis of a person including past and / or future time zones.
  • the output unit 140 After correcting the stay score in this way, the output unit 140 outputs stay information (S911).
  • the stay information includes a stay score, a time zone, and position information of the target stay determination area A1.
  • the information processing system 100 includes a processor 1001, a memory 1003, a storage device 1005, an input interface (I / F) 1007, a data I / F 1009, a communication I / F 1011, and a display device 1013.
  • a processor 1001 a memory 1003, a storage device 1005, an input interface (I / F) 1007, a data I / F 1009, a communication I / F 1011, and a display device 1013.
  • the processor 1001 controls various processes in the information processing system 100 by executing a program stored in the memory 1003.
  • the processing related to the input unit 110, the score calculation unit 130, and the output unit 140 described in FIG. 2 can be realized as a program mainly operating on the processor 1001 after being temporarily stored in the memory 1003.
  • the memory 1003 is a storage medium such as a RAM (Random Access Memory).
  • the memory 1003 temporarily stores a program code of a program executed by the processor 1001 and data necessary for executing the program. For example, in the storage area of the memory 1003, a stack area necessary for program execution is secured.
  • the storage device 1005 is a non-volatile storage medium such as a hard disk or flash memory.
  • the storage device 1005 stores an operating system, various programs for realizing the input unit 110, the score calculation unit 130, and the output unit 140, various data such as the stay determination area information 137, and the like. Programs and data stored in the storage device 1005 are referred to by the processor 1001 by being loaded into the memory 1003 as necessary.
  • the input I / F 1007 is a device for receiving input from the user. Specific examples of the input I / F 1007 include a keyboard, a mouse, a touch panel, and various sensors. The input I / F 1007 may be connected to the information processing system 100 via an interface such as USB (Universal Serial Bus), for example.
  • USB Universal Serial Bus
  • the data I / F 1009 is a device for inputting data from outside the information processing system 100.
  • Specific examples of the data I / F 1009 include a drive device for reading data stored in various storage media.
  • the data I / F 1009 may be provided outside the information processing system 100. In that case, the data I / F 1009 is connected to the information processing system 100 via an interface such as a USB.
  • the communication I / F 1011 is a device for performing data communication with an external device of the information processing system 100, for example, a video camera C1 or the like by wire or wireless.
  • the communication I / F 1011 may be provided outside the information processing system 100. In this case, the communication I / F 1011 is connected to the information processing system 100 via an interface such as a USB.
  • the display device 1013 is a device for displaying various information. Specific examples of the display device 1013 include a liquid crystal display and an organic EL (Electro-Luminescence) display.
  • the display device 1013 may be provided outside the information processing system 100. In that case, the display device 1013 is connected to the information processing system 100 via, for example, a display cable.
  • the information processing system 100 it is possible to suitably detect staying of a moving body such as a person. For this reason, for example, a flow line related to a moving body that can be determined to be moving by the movement determination unit 131 is excluded from the calculation of the staying score.
  • the stay score calculation unit 133 calculates the stay score based on the stay time, a person who stays only for a short time has no or little influence on the stay score. Further, since the staying number calculating unit 135 corrects the staying number, even when there is an error in the staying number identification, the correction is possible.
  • FIG. 11 is a block diagram illustrating a functional configuration of the information processing system 1100.
  • the information processing system 1100 includes an input unit 1110 and a calculation unit 1120.
  • the input unit 1110 receives input of information relating to the position of the moving body at each time in the target area for which the stay score is calculated.
  • the calculation unit 1120 calculates a score indicating the degree of stay in the target area according to the stay time in which each mobile body stays in the target area, which is estimated based on the position of each mobile body at each time.
  • An information processing system comprising: a calculating unit that calculates a score indicating the degree of staying in the target area.
  • the calculating unit is configured to determine whether or not there is a moving body detected in the vicinity of the target area at the changed time.
  • the information processing system according to attachment 2 wherein the number of moving objects is estimated.
  • the calculation means determines a human current area in the target area based on the position of each mobile object at each time, and according to the continuous detection time of each mobile object in the area of the target area excluding the human current area.
  • the information processing system according to any one of supplementary notes 1 to 5, wherein the score is calculated.
  • the calculation means includes a continuous detection time of the moving body in the first region of the target region, and a continuous detection time of the mobile body in the second region where the detection of the moving body is more difficult than the first region.
  • the information processing system according to any one of appendices 1 to 6, wherein the score is calculated by multiplying each by a different coefficient.
  • Appendix 9 The information processing method according to appendix 8, wherein the score is calculated based on the number of moving objects for which the continuous detection time of moving objects in the target region is equal to or greater than a threshold value.
  • Appendix 11 The information processing method according to appendix 8, wherein the score is calculated based on a total of continuous detection times of the moving objects in the target region.
  • Appendix 12 The information processing method according to any one of appendices 8 to 11, wherein the score is calculated by removing a moving body that can be determined to have passed through the target region.
  • Appendix 16 The program according to appendix 15, wherein the score is calculated based on the number of moving objects for which the continuous detection time of moving objects in the target region is equal to or greater than a threshold value.
  • Appendix 19 The program according to any one of appendix 15 to appendix 18, wherein the score is calculated by removing a moving body that can be identified as having passed through the target region.
  • An information processing system comprising: an input unit that receives an input of a position of a moving body at each time in a target region; and a calculation unit that calculates a degree of staying in the target region based on the position of each moving body at each time .
  • the information processing system performs a step of receiving an input of a position of each moving body at each time in the target region, and a step of calculating a staying degree related to the target region based on the position of each moving body at each time Information processing method.
  • Appendix 24 A program that causes a computer to execute a process of receiving an input of a position of a moving body at each time in a target area and a process of calculating a degree of stay related to the target area based on the position of each moving body at each time.
  • a display device that changes a display mode of the target area according to a residence time of the moving object in the target area of the video;
  • An information processing system comprising:
  • DESCRIPTION OF SYMBOLS 100 ... Information processing system, 110 ... Input part, 130 ... Score calculation part, 131 ... Motion discrimination

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

[Program] To provide an information processing system, an information processing method, and a program, whereby it is possible to suitably detect a standstill of a moving body. [Solution] An information processing system (100) comprises: an input unit (110) which receives input of information relating to a location of a moving body in a region to be examined at each time point; and a score computation unit (130) which computes a score which denotes a degree of standstill relating to the region to be examined, according to a standstill time wherein each mobile body in the region to be examined stands still which is estimated on the basis of the location of each moving body at each time point.

Description

情報処理システム、情報処理方法及びプログラムInformation processing system, information processing method, and program
 本発明に係るいくつかの態様は、情報処理システム、情報処理方法及びプログラムに関する。 Some aspects according to the present invention relate to an information processing system, an information processing method, and a program.
 近年、カメラで長時間撮影した映像に基づいて人間の行動を分析することが考えられている。例えば特許文献1は、監視カメラなどの固定カメラにおいて撮影された映像を用いて、撮影範囲の領域における人間の静止・滞留・集合等の度合いを数値化して滞留箇所を検出することを開示している。特許文献1記載の手法では、撮影範囲に対応する領域を複数のブロックに分割した上で、人物毎の軌跡をプロットすることにより、各ブロックに対するスコアリングを行う。この結果、スコアが閾値以上となったブロックを滞留箇所として抽出している。 In recent years, it has been considered to analyze human behavior based on video taken for a long time with a camera. For example, Patent Document 1 discloses detecting a staying location by using a video taken by a fixed camera such as a surveillance camera and quantifying the degree of human stillness, staying, gathering, etc. in an area of the shooting range. Yes. In the method described in Patent Document 1, scoring is performed on each block by dividing the region corresponding to the shooting range into a plurality of blocks and plotting the trajectory for each person. As a result, the block whose score is equal to or greater than the threshold is extracted as the staying location.
特開2011-245945号公報JP 2011-245945 A
 しかしながら、特許文献1記載の手法では、単に人物の動線に基づいてスコア算出しているため、例えばターミナル駅のように、多くの人間がどこにも留まらずにただ移動しているだけの場合であってもスコアが高くなってしまい、結果として滞留として判定される可能性がある。 However, in the method described in Patent Document 1, since the score is simply calculated based on the flow line of the person, for example, in the case of a terminal station, a lot of people are just moving without staying anywhere. Even if it exists, a score will become high and may be determined as a stay as a result.
 本発明のいくつかの態様は前述の課題に鑑みてなされたものであり、移動体の滞留を好適に検出することのできる情報処理システム、情報処理方法及びプログラムを提供することを目的の1つとする。 Some aspects of the present invention have been made in view of the above-described problems, and one of the objects is to provide an information processing system, an information processing method, and a program that can suitably detect staying of a moving object. To do.
 本発明に係る情報処理システムは、対象領域における各時刻の移動体の位置に係る情報の入力を受ける入力手段と、各時刻の各移動体の位置に基づいて推定される、前記対象領域に各移動体が滞留した滞留時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出する算出手段とを備える。 An information processing system according to the present invention includes: an input unit that receives input of information relating to the position of a moving body at each time in the target area; and the target area estimated based on the position of each moving body at each time. Calculating means for calculating a score indicating the degree of staying in the target area according to the staying time in which the moving body stays.
 本発明に係る画像処理方法は、対象領域における各時刻の移動体の位置に係る情報の入力を受けるステップと、各時刻の各移動体の位置に基づいて推定される、前記対象領域に各移動体が滞留した滞留時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出するステップとを情報処理システムが行う。 The image processing method according to the present invention includes a step of receiving information related to a position of a moving body at each time in the target area, and a movement to each target area estimated based on the position of each moving body at each time. The information processing system performs a step of calculating a score indicating a staying degree related to the target region according to a staying time in which the body stays.
 本発明に係るプログラムは、対象領域における各時刻の移動体の位置に係る情報の入力を受ける処理と、各時刻の各移動体の位置に基づいて推定される、前記対象領域に各移動体が滞留した滞留時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出する処理とをコンピュータに実行させる。 The program according to the present invention includes a process for receiving input of information relating to the position of a moving body at each time in the target area, and each moving body in the target area estimated based on the position of each moving body at each time. In accordance with the staying time, the computer is caused to execute a process of calculating a score indicating the degree of staying related to the target area.
 なお、本発明において、「部」や「手段」、「装置」、「システム」とは、単に物理的手段を意味するものではなく、その「部」や「手段」、「装置」、「システム」が有する機能をソフトウェアによって実現する場合も含む。また、1つの「部」や「手段」、「装置」、「システム」が有する機能が2つ以上の物理的手段や装置により実現されても、2つ以上の「部」や「手段」、「装置」、「システム」の機能が1つの物理的手段や装置により実現されても良い。 In the present invention, “part”, “means”, “apparatus”, and “system” do not simply mean physical means, but “part”, “means”, “apparatus”, “system”. This includes the case where the functions possessed by "are realized by software. Further, even if the functions of one “unit”, “means”, “apparatus”, and “system” are realized by two or more physical means or devices, two or more “parts” or “means”, The functions of “device” and “system” may be realized by a single physical means or device.
 本発明によれば、移動体の滞留を好適に検出することのできる情報処理システム、情報処理方法及びプログラムを提供することができる。 According to the present invention, it is possible to provide an information processing system, an information processing method, and a program that can suitably detect staying of a moving object.
第1実施形態に係る情報処理システムの概要を説明するための図である。It is a figure for demonstrating the outline | summary of the information processing system which concerns on 1st Embodiment. 第1実施形態に係る情報処理システムの概略構成を示す機能ブロック図である。It is a functional block diagram which shows schematic structure of the information processing system which concerns on 1st Embodiment. 移動情報の具体例を示す図である。It is a figure which shows the specific example of movement information. 動き判別部の処理の具体例を説明するための図である。It is a figure for demonstrating the specific example of a process of a motion discrimination | determination part. 動き判別部の処理の具体例を説明するための図である。It is a figure for demonstrating the specific example of a process of a motion discrimination | determination part. 滞留スコア算出部の処理の具体例を説明するための図である。It is a figure for demonstrating the specific example of a process of a residence score calculation part. 滞留スコア算出部の処理の具体例を説明するための図である。It is a figure for demonstrating the specific example of a process of a residence score calculation part. 滞留人数算出部の処理の具体例を説明するための図である。It is a figure for demonstrating the specific example of a process of a staying number calculation part. 図2に示す情報処理システムの処理の流れを示すフローチャートである。It is a flowchart which shows the flow of a process of the information processing system shown in FIG. 図2に示す情報処理システムを実装可能なハードウェアの構成を示すブロック図である。It is a block diagram which shows the structure of the hardware which can mount the information processing system shown in FIG. 第2実施形態に係る情報処理システムの概略構成を示す機能ブロック図である。It is a functional block diagram which shows schematic structure of the information processing system which concerns on 2nd Embodiment.
 以下に本発明の実施形態を説明する。以下の説明及び参照する図面の記載において、同一又は類似の構成には、それぞれ同一又は類似の符号が付されている。 Embodiments of the present invention will be described below. In the following description and the description of the drawings to be referred to, the same or similar components are denoted by the same or similar reference numerals.
 (1 第1実施形態)
 図1乃至図10は、第1実施形態を説明するための図である。以下、これらの図を参照しながら、次の流れに従って本実施形態を説明する。まず、「1.1」で本実施形態に係るシステムの概要を説明した上で、「1.2」でシステムの機能構成を、各機能に係る処理の具体例を示しながら説明する。「1.3」では処理の流れを説明し、「1.4」では、本システムを実現可能なハードウェア構成の具体例を示す。最後に、「1.5」以降で、本実施形態に係る効果などを説明する。
(1 First Embodiment)
1 to 10 are diagrams for explaining the first embodiment. Hereinafter, the present embodiment will be described according to the following flow with reference to these drawings. First, the outline of the system according to the present embodiment is described in “1.1”, and then the functional configuration of the system is described in “1.2” while showing specific examples of processing relating to each function. “1.3” describes the flow of processing, and “1.4” shows a specific example of a hardware configuration capable of realizing this system. Finally, the effects and the like according to the present embodiment will be described after “1.5”.
 (1.1 概要)
 図1を参照しながら、本実施形態に係る情報処理システムの処理の概要を、具体例を示しながら説明する。
(1.1 Overview)
An outline of processing of the information processing system according to the present embodiment will be described with reference to FIG.
 本実施形態に係る情報処理システムは、滞留判定領域A1内で移動体が滞留(停留)しているか否かを判別するためのシステムである。移動体の具体例としては、人物(人間)のみならず、自動車、トラック、自転車、バイクなど種々考えることができるが、以下の説明では人物の滞留を判定するものとして説明する。また、以下の説明での「人物」は、特別な説明が無い限りシステムにより検出される人物を指し、必ずしも実際の人間と1対1で一致しているとは限らない。より具体的には、例えば、実際には1人の人物が移動している場合であっても、各タイミングで検出された各人物が同一であるものとしてシステムで検出できない場合には、人物の数は複数名となる。 The information processing system according to the present embodiment is a system for determining whether or not a moving object is staying (stopped) in the stay determination area A1. As a specific example of the moving body, not only a person (human) but also a car, a truck, a bicycle, a motorcycle, and the like can be considered. In the following description, it is assumed that a person is staying. In addition, “person” in the following description refers to a person detected by the system unless there is a special description, and does not necessarily match one-to-one with an actual person. More specifically, for example, even if one person is actually moving, if each person detected at each timing cannot be detected by the system as being the same, The number will be multiple.
 なお、図1の例では、全体のうち、滞留判定領域A1のみを滞留判定の対象としているがこれに限られるものではなく、複数の領域を滞留判定の対象とすることも可能である。滞留判定の対象とする領域については、予め定められても良いし、情報処理システムが随時ユーザによる設定の入力を受け付けても良い。 In the example of FIG. 1, only the stay determination area A1 is the target of stay determination in the whole, but the present invention is not limited to this, and a plurality of areas can be the target of stay determination. The region to be subject to stay determination may be determined in advance, or the information processing system may accept input of settings by the user as needed.
 図1の具体例では、時刻t0乃至t1の間、人物P1及び人物P2は滞留判定領域A1にずっととどまっているが、人物P3は時刻t0乃至t1の間に滞留判定領域A1を通過している。このような場合には、人物P3は滞留判定領域A1には留まっていない(停留していない)ため、時刻t0乃至t1の時間帯の滞留判定領域A1の滞留人数は2名と判断することができる。 In the specific example of FIG. 1, the person P1 and the person P2 stay in the stay determination area A1 from time t0 to time t1, but the person P3 passes through the stay determination area A1 from time t0 to time t1. . In such a case, since the person P3 does not stay (not stay) in the stay determination area A1, the number of staying persons in the stay determination area A1 during the time period from time t0 to t1 can be determined to be two. it can.
 その後、時刻t1乃至t2においては、人物P1は依然として滞留判定領域A1にとどまったままだが、人物P2は滞留判定領域A1から外に移動している。よって、このような場合には、時刻t1乃至t2における滞留判定領域A1の滞留人数は1名と判断することができる。 Thereafter, from time t1 to time t2, the person P1 still remains in the stay determination area A1, but the person P2 has moved out of the stay determination area A1. Therefore, in such a case, it is possible to determine that the number of people staying in the stay determination area A1 from time t1 to time t2 is one person.
 このように、本実施形態に係る情報処理システムは、滞留判定領域A1をただ通り過ぎるだけの人物については考慮せずに、純粋に滞留判定領域A1に滞留している人物だけに基づいて滞留度判定のためのスコアリング(滞留度を判定するためのスコアの算出)を行う。若しくは、滞留判定領域A1を通過等するだけの人物は、滞留している人物よりスコアを下げて、滞留判定のためのスコアリングを行う。 As described above, the information processing system according to the present embodiment does not consider the person who just passes through the stay determination area A1, and determines the stay degree based only on the person who stays purely in the stay determination area A1. Scoring (calculation of a score for determining the staying degree) is performed. Alternatively, a person who only passes through the stay determination area A1 performs scoring for stay determination with a lower score than the staying person.
 このような情報処理システムによれば、多数の人物が通過せずにたむろしているような場所を検出できることから、セキュリティ上注意すべき領域等を精度よく検出することが可能となる。また、スーパー、コンビニエンスストア等の各種商業施設に用いれば、商品棚毎の購買顧客の滞留時間や人数等を判別できるようになるため、マーケティングに使用することが可能である。その他、例えば工場や倉庫などに用いれば、エリアごとの作業時間の可視化は作業員同士の雑談等を検出できるようになるため、作業効率の検証等に用いることが可能である。 According to such an information processing system, it is possible to detect a place where a large number of persons hang out without passing through, and therefore it is possible to accurately detect an area that should be noted in terms of security. Moreover, if it is used for various commercial facilities such as supermarkets and convenience stores, it becomes possible to determine the staying time and number of customers of each purchase shelf, so that it can be used for marketing. In addition, when used in, for example, a factory or a warehouse, the visualization of the work time for each area can detect chats between workers and can be used for verification of work efficiency.
 なお、滞留判定領域A1での人物P1、P2及びP3の移動情報の取得方法として、図1の例ではビデオカメラC1により滞留判定領域A1を含む領域を撮影した上で、撮影した映像を解析することにより、各時刻における人物P1、P2及びP3の位置をそれぞれ検出する方法をとっている。しかしながら、人物(移動体)の移動情報の取得方法はこれに限られるものではなく、滞留判定領域A1内で人物(移動体)の位置情報を検出し、検出時刻を特定できる装置であればよい。また、各人物(移動体)を識別するための固有のID(識別子)を検出する必要はない。例えば、追跡環境に設置されたセンサを用い、人物(移動体)自身はセンサを保持する必要がないような、カメラ、床圧力センサ、レーザレンジファインダー、人感センサ、もしくはレーダーを用いた移動体追跡システムによって実現することも考えられる。あるいは、移動体自身が位置取得用の機器を保持する必要があるが、機器からは移動体に固有のIDを取得できないという条件下において、GPS(Global Positioning System)などの無線通信機器や超音波受信機を用いた移動体追跡システム等によって実現していてもよい。以下では、ビデオカメラC1により撮影した画像に基づいて人物の移動情報(各時刻における位置情報)を取得するものとして説明する。 As a method for acquiring movement information of the persons P1, P2, and P3 in the stay determination area A1, in the example of FIG. 1, the video camera C1 captures an area including the stay determination area A1, and then analyzes the captured video. Thus, a method of detecting the positions of the persons P1, P2, and P3 at each time is adopted. However, the method of acquiring the movement information of the person (moving body) is not limited to this, and any apparatus that can detect the position information of the person (moving body) and specify the detection time in the stay determination area A1 may be used. . Further, it is not necessary to detect a unique ID (identifier) for identifying each person (moving body). For example, a moving body using a camera, a floor pressure sensor, a laser range finder, a human sensor, or a radar that uses a sensor installed in a tracking environment and does not require the person (moving body) to hold the sensor. It can be realized by a tracking system. Alternatively, the mobile body itself needs to hold a device for position acquisition, but under the condition that a unique ID cannot be acquired from the device, a wireless communication device such as GPS (Global Positioning System) or ultrasonic waves You may implement | achieve by the mobile body tracking system etc. which used the receiver. In the following description, it is assumed that person movement information (position information at each time) is acquired based on an image captured by the video camera C1.
 また、移動情報は、滞留判定領域A1内に多数の人物が存在し人物同士の重なりによって追跡が途切れた場合や、人物以外の移動体を人物として誤検出した場合であっても、用いることができる。 The movement information can be used even when there are a large number of persons in the stay determination area A1 and tracking is interrupted due to the overlapping of persons, or when a moving body other than a person is erroneously detected as a person. it can.
 (1.2 システムの機能構成)
 以下、図2を参照しながら、本実施形態に係る情報処理システム100のシステム構成を説明する。図2は、情報処理システム100のシステムの機能構成を示す機能ブロック図である。
(1.2 System functional configuration)
Hereinafter, the system configuration of the information processing system 100 according to the present embodiment will be described with reference to FIG. FIG. 2 is a functional block diagram showing a functional configuration of the information processing system 100.
 図2に示すように、情報処理システム100は、大きく分けると、入力部110と、スコア算出部130と、出力部140とを含む。以下、順番にこれらの構成について説明する。 As shown in FIG. 2, the information processing system 100 roughly includes an input unit 110, a score calculation unit 130, and an output unit 140. Hereinafter, these configurations will be described in order.
 (1.2.1 入力部110)
 入力部110は、各人物の移動情報の入力を受ける。この情報は、例えばビデオカメラC1等(複数台のビデオカメラC1であることも考えられる)で撮影した映像を解析することにより得られる、各時刻における人物の位置情報等であることが考えられる。より具体的には、例えば、ビデオカメラC1で撮影された人物の特徴量や時系列の画像(フレーム)間の比較により、オブジェクトとして抽出された人物毎の移動情報を得ることが可能である。
(1.2.1 Input unit 110)
The input unit 110 receives input of movement information of each person. This information can be, for example, position information of a person at each time obtained by analyzing a video photographed by a video camera C1 or the like (possibly a plurality of video cameras C1). More specifically, for example, it is possible to obtain movement information for each person extracted as an object by comparing the feature amount of a person photographed by the video camera C1 and time-series images (frames).
 なお、移動情報の入力方法は種々考えられる。例えば、ビデオカメラC1からリアルタイムに随時移動情報が入力されることも考えられるし、或いは、図示しない記憶媒体から読み出すことにより、移動情報の入力を受けることも考えられる。 There are various ways to input movement information. For example, movement information may be input from the video camera C1 as needed in real time, or movement information may be received by reading from a storage medium (not shown).
 図3に、入力部110に入力される移動情報の一例を示す。図3の例では、人物毎に割り当てたID(以下、移動体IDともいう。)の情報と、各人物が検出された時刻及びその位置(座標)とが対応付けられている。ここで移動情報IDは、連続して検出に成功した移動体(例えば人物)の位置情報に対して同一の移動体に係る位置情報であることを判別するために割り当てられる識別情報である。つまり、同一のIDが割り当てられた位置情報群(位置座標群)は、同一の移動体の軌跡を表す。ただし、ある時刻において移動体の位置検出に失敗した場合、それまでに検出していた移動体の軌跡は途切れることになる。そのため、移動体の位置検出に失敗した後、再度、移動体の位置検出に成功した場合、その移動体に対して新しいIDが割り振られることになる。 FIG. 3 shows an example of the movement information input to the input unit 110. In the example of FIG. 3, information on an ID assigned to each person (hereinafter also referred to as a mobile object ID) is associated with the time when each person is detected and its position (coordinates). Here, the movement information ID is identification information assigned to determine that the position information is related to the same moving body with respect to the position information of the moving body (for example, a person) that has been successfully detected continuously. That is, the position information group (position coordinate group) to which the same ID is assigned represents the locus of the same moving object. However, if the position detection of the moving body fails at a certain time, the trajectory of the moving body that has been detected until then is interrupted. For this reason, if the position detection of the moving object succeeds again after the position detection of the moving object fails, a new ID is assigned to the moving object.
 (1.2.2 スコア算出部130)
 スコア算出部130は、各時間帯における人物(同一人物として検出された移動体)の動線に基づき、滞留判定領域A1の各時間帯における滞留の度合いを示す滞留スコアを算出する。滞留スコアが高い時間帯は、滞留判定領域A1での滞留人数が多いことを示す。スコア算出部130は、動き判別部131、滞留スコア算出部133、滞留人数算出部135、及び滞留判定領域情報137を含む。
(1.2.2 Score Calculation Unit 130)
The score calculation unit 130 calculates a residence score indicating the degree of residence in each time zone of the residence determination region A1 based on the flow line of the person (moving body detected as the same person) in each time zone. A time zone in which the stay score is high indicates that there are many staying people in the stay determination area A1. The score calculation unit 130 includes a motion determination unit 131, a stay score calculation unit 133, a staying number calculation unit 135, and stay determination area information 137.
 (1.2.2.1 動き判別部131)
 動き判別部131は、滞留判定領域A1内の各人物の動きを判別することにより、移動していると判断できる人物(動線)を特定する。これにより、移動していると判断できる人物の動線を除外して滞留スコアを算出することができるようになる。人物の動き判定の手法としてはいくつか考えられるが、ここでは、動線ベースでの動き判定方法及び画像ベースの動き判定方法について、図4及び図5を参照しながら説明する。
(1.2.2.1 Motion discriminating unit 131)
The movement determination unit 131 specifies a person (flow line) that can be determined to be moving by determining the movement of each person in the stay determination area A1. Thereby, it becomes possible to calculate the staying score by excluding the flow line of the person who can be determined to be moving. Several methods for determining the movement of a person can be considered. Here, a motion line-based motion determination method and an image-based motion determination method will be described with reference to FIGS. 4 and 5.
 動線ベースでの動き判定方法は、個々の人物の動線に着目して、移動している人物と滞留している人物とを分ける手法である。図4を参照しながら、その具体例を説明する。 The movement determination method based on the flow line is a technique for separating a moving person and a staying person by paying attention to the flow line of each person. A specific example will be described with reference to FIG.
 図4の例では、滞留判定の対象時間帯における人物P4に係る動線は、滞留判定領域A1に入る始点と、滞留判定領域A1から出る終点とを持つ。これにより、人物P4は滞留判定領域A1をこの時間帯の間に通過していると判断できる。よって、このように滞留判定領域A1に入る始点と滞留判定領域A1から出る終点とを持つ動線を持つ人物については、滞留せずに移動していると判断できるため、滞留スコアの算出から除外することができる。 In the example of FIG. 4, the flow line related to the person P4 in the target time zone for stay determination has a start point entering the stay determination area A1 and an end point exiting from the stay determination area A1. Accordingly, it can be determined that the person P4 has passed through the stay determination area A1 during this time period. Therefore, a person having a flow line having a start point entering the stay determination area A1 and an end point exiting from the stay determination area A1 can be determined to be moving without staying, and thus excluded from the stay score calculation. can do.
 また、図4の例では、滞留判定の対象時間帯における人物P5の移動速度は閾値よりも速い。このような移動速度の速い人物P5は、滞留していないと考えることができるので、滞留スコアの算出から除外することができる。なお、移動速度は、移動体の各時刻における位置の間の距離を、その移動に要した時間で除算することにより算出することが可能である。 Further, in the example of FIG. 4, the moving speed of the person P5 in the target time zone for the stay determination is faster than the threshold value. Such a person P5 having a high moving speed can be considered not staying and can be excluded from the calculation of the staying score. The moving speed can be calculated by dividing the distance between the positions of the moving body at each time by the time required for the movement.
 続いて、画像ベースの動き判定方法について説明する。画像ベースの動き判定方法では、例えばオプティカルフロー等を用いて、図5に示すように、複数の人物がほぼ同じ速度で同じ方向に向かって進む人流発生領域を特定する。当該人流発生領域にいる人物は滞留せずに移動しているものと考えることができるため、滞留スコアの算出から除外することができる。 Subsequently, an image-based motion determination method will be described. In the image-based motion determination method, for example, using an optical flow, a human flow generation region in which a plurality of persons advance in the same direction at approximately the same speed is specified as shown in FIG. Since it can be considered that the person in the person flow generation area is moving without staying, it can be excluded from the calculation of the staying score.
 なお、動き判別部131は、動線ベースでの動き判定方法及び画像ベースの動き判定方法はどちらか片方のみを用いることも考えられるし、両方用いることも考えられる。 Note that the motion discriminating unit 131 may use only one or both of the motion line-based motion determination method and the image-based motion determination method.
 (1.2.2.2 滞留スコア算出部133)
 滞留スコア算出部133は、動き判別部131により滞留していると判断された移動体に係る動線の入力を受けて、滞留判定領域A1に係る対象時間帯の滞留スコアを算出する。滞留スコアの算出方法としてはいくつか考えられるが、ここでは、一定時間以上連続して検出した動線数により滞留スコアを算出する方法と、動線の検出時間率の総和に応じて滞留スコアを算出する方法との具体例を、図6及び図7を参照しながら説明する。
(1.2.2.2 Residence score calculation unit 133)
The stay score calculation unit 133 receives an input of a flow line related to the moving body determined to be staying by the motion determination unit 131, and calculates a stay score of the target time zone related to the stay determination region A1. There are several methods for calculating the stay score. Here, the stay score is calculated according to the sum of the flow rate detection time rate and the method of calculating the stay score based on the number of flow lines detected continuously over a certain time. A specific example of the calculation method will be described with reference to FIGS.
 図6は、一定時間以上連続して検出した動線数により滞留スコアを算出する方法を説明するための図である。図6の例において、滞留判定の対象時間帯である時刻t0乃至t1の間に、人物A乃至Dの4名が滞留判定領域A1にいるものとする。このうち、人物Aは当該時間帯の70%の時間、人物Bは30%の時間、人物Cは20%の時間、人物Dは当該時間帯の80%の時間、それぞれ滞留判定領域A1内の動線が検出されているものとする。このような場合に、一定時間以上連続して検出した動線数により滞留スコアを算出する方法では、閾値である50%以上、対象時間帯に滞留判定領域A1にいたと考えられる人物A及び人物Dを滞留者として捉え、滞留スコアを2(2名)とすることができる。なお、閾値は予め定められていても良いし、情報処理システム100が、随時ユーザによる設定の入力を受け付けても良い。 FIG. 6 is a diagram for explaining a method of calculating a residence score based on the number of flow lines detected continuously for a certain time or more. In the example of FIG. 6, it is assumed that four persons A to D are in the stay determination area A1 during times t0 to t1, which are target times for stay determination. Among these, the person A is 70% of the time period, the person B is 30% of the time, the person C is 20% of the time, and the person D is 80% of the time of the time in the stay determination area A1. It is assumed that a flow line has been detected. In such a case, in the method of calculating the stay score based on the number of flow lines detected continuously for a certain time or more, the person A and the person who are considered to have been in the stay determination area A1 in the target time zone for a threshold time of 50% or more D can be regarded as a staying person, and a staying score can be 2 (2 persons). Note that the threshold value may be determined in advance, or the information processing system 100 may accept input of settings by the user as needed.
 また、滞留判定の対象時間長は、滞留判定領域A1の大きさと追跡対象である人物の移動速度によって決定することが望ましい。すなわち、想定される移動体の移動速度にて滞留判定領域A1を通過するのに要する時間よりも長い時間を、滞留判定の対象時間長として設定することが望ましい。情報処理システム100は、随時ユーザにより対象時間長の設定の入力を受け付けても良い。 Also, it is desirable that the target time length of the stay determination is determined by the size of the stay determination area A1 and the moving speed of the person who is the tracking target. That is, it is desirable to set a time longer than the time required to pass through the stay determination region A1 at the assumed moving speed of the moving body as the target time length for stay determination. The information processing system 100 may accept input of setting of the target time length from time to time by the user.
 続いて、図7を参照しながら、動線の検出時間率の総和に応じて滞留スコアを算出する方法について説明する。図7は、この方法を説明するための図である。図7の例において、人物A乃至Dがそれぞれ滞留判定領域A1に滞在する時間は図6の場合と同じである。しかしながらこの方法では、それぞれの滞留時間率に比例して、滞留スコアを算出する。人物A乃至Dのそれぞれの滞在時間は70%、30%、20%、80%であるため、これらの合計である2(0.7+0.3+0.2+0.8)を、当該時間帯における滞留人数に相当する滞留スコアとすることができる。 Subsequently, a method for calculating the staying score according to the sum of the flow line detection time rates will be described with reference to FIG. FIG. 7 is a diagram for explaining this method. In the example of FIG. 7, the time for the persons A to D to stay in the stay determination area A1 is the same as in the case of FIG. However, in this method, a residence score is calculated in proportion to each residence time rate. Since the stay time of each of the persons A to D is 70%, 30%, 20%, and 80%, the total of 2 (0.7 + 0.3 + 0.2 + 0.8) is added to the number of people staying in the time period. It can be set as the residence score equivalent to.
 以上の方法で滞留判定の対象時間帯ごとに滞留スコアを算出することにより、移動体(ここでは人物)の動線に途切れが生じる場合でも、動線の連続検出時間長に基づいて追跡対象である移動体が停留している度合いをスコア化することが可能になる。 By calculating the stay score for each time period subject to stay determination using the above method, even if there is a break in the flow line of the moving body (here, a person), the tracking target is based on the continuous detection time length of the flow line. It is possible to score the degree to which a certain mobile object is stationary.
 (1.2.2.3 滞留人数算出部135)
 滞留人数算出部135は、滞留スコア算出部133が算出した、対象時間帯における滞留人数に相当する滞留スコアを補正するためのものである。
(1.2.2.3 Residence number calculation unit 135)
The staying number calculation unit 135 is for correcting the staying score calculated by the staying score calculation unit 133 and corresponding to the number of staying people in the target time zone.
 例えば、ビデオカメラC1が撮影する映像の中から人物の抽出を行う場合には、それぞれの人物が重なったり物陰に隠れたり薄暗い位置があったりすると、人物の抽出を誤る可能性がある。そこで、滞留人数算出部135は、このような人物抽出の誤りを補正するための機能を有する。 For example, when extracting a person from video captured by the video camera C1, there is a possibility that the person is erroneously extracted if each person overlaps, is hidden behind the object, or has a dim position. Therefore, the staying number calculation unit 135 has a function for correcting such a person extraction error.
 まず1つ目の補正方法として、過去又は未来一定時間分の滞留判定結果、及び滞留判定領域周辺(近傍)で検出された動線を用いて滞留人数を推定する手法が考えられる。図8は、当該手法の具体例を説明するための図である。図8の例において、時刻t-1及び時刻t+1の映像では、人物P9とP10とが、それぞれ別々の人物として正しく抽出することができているため、検出人数は2名ことができる。一方、時刻tの映像では、人物P9とP10とが重なっているため、検出人数は1名となっている。 First, as a first correction method, a method for estimating the number of staying persons using a stay determination result for a certain period of time in the past or the future and a flow line detected around (in the vicinity of) the stay determination area can be considered. FIG. 8 is a diagram for explaining a specific example of the method. In the example of FIG. 8, in the video at time t−1 and time t + 1, since the persons P9 and P10 can be correctly extracted as separate persons, the number of detected persons can be two. On the other hand, in the video at time t, since the persons P9 and P10 overlap, the number of detected persons is one.
 しかしながら、時刻t-1から時刻tの間に新たに映像から出ていく人物が検出されていない場合には、時刻tにおいても、映像領域内にいる人数は2名であるものと推定することができる。また、時刻tから時刻t+1までの間に新たに映像に入ってくる人物が検出されていない場合にも、同様に時刻tにおける映像領域内にいる人数は2名であると推定することが可能である。 However, if no new person coming out of the video is detected between time t-1 and time t, it is assumed that there are two people in the video area even at time t. Can do. Also, even when no new person entering the video is detected between time t and time t + 1, it is possible to estimate that there are two people in the video area at time t. It is.
 このように、滞留人数算出部135は、複数の時間帯に渡る滞留人数の遷移と動線の有無とを分析することにより、滞留スコアの参照対象の時間帯における滞留人数を推定することができる。この推定は、対象時間帯の前の時間帯(過去)のみ、又は後ろの時間帯(未来)のみでも可能であるが、両方使用すれば、より精度の高い推定を行うことが可能となる。 As described above, the staying number calculation unit 135 can estimate the staying number of persons in the time zone that is the reference target of the staying score by analyzing the transition of the staying number of persons over a plurality of time periods and the presence or absence of the flow line. . This estimation can be performed only in the time zone (past) before the target time zone or only in the time zone (future) after the target time zone. However, if both are used, estimation with higher accuracy can be performed.
 なお、ここでは動線の検出を前提として説明したが、これに限られるものではない。例えば、同一人物として検出できない等の事情により動線は必ずしも好適に検出できるとは限らないため、滞留判定領域での検出人数が変化した際に、当該領域近傍で検出された人物がいるか否かによって、人間の数を推定することもできる。上記の例で説明すると、時刻t-1から時刻tに至るまでに検出人数が2名から1名に変化しているが、時刻tにおいて滞留判定領域近傍で人物が検出できない場合には、滞留判定領域内に2名の人物がいるものと推定できる。また同様に、時刻tから時刻t+1に至るまでに検出人数が1名から2名に変化しているが、時刻tにおいて滞留判定領域近傍の人物が検出できない場合には、時刻tにおいて2名の人物がいたものと推定することが可能である。 In addition, although it demonstrated on the assumption that a flow line was detected here, it is not restricted to this. For example, since it is not always possible to properly detect the flow line due to circumstances such as being unable to detect the same person, whether or not there is a person detected in the vicinity of the area when the number of people detected in the stay determination area changes. Can also estimate the number of people. Explaining in the above example, the number of detected people has changed from two to one from time t-1 to time t, but if no person can be detected near the stay determination area at time t, It can be estimated that there are two persons in the determination area. Similarly, the number of detected people has changed from one to two from time t to time t + 1, but if no person near the stay determination area can be detected at time t, two people at time t can be detected. It can be estimated that there was a person.
 この他、位置に応じて滞留スコアを調整することも考えられる。前述の通り、例えば映像の中から人物の抽出を行う場合には、位置によって人物を抽出しづらい場合がある。そこで、例えば、動線検出しやすい領域の動線数(人数)には低い係数を、動線検出しづらい領域の動線数(人数)には高い係数を乗算することによって、滞留スコアを補正することができる。
 特に、画像処理により人物検出を行う場合には、認識誤りが発生しやすいため、このような補正を行うことにより、好適な滞留スコアの算出が可能となる。
In addition, it is conceivable to adjust the staying score according to the position. As described above, for example, when extracting a person from a video, it may be difficult to extract a person depending on the position. Therefore, for example, the retention score is corrected by multiplying a low coefficient for the number of flow lines (number of people) in areas where flow lines are easy to detect, and a high coefficient for the number of flow lines (number of people) in areas where flow lines are difficult to detect. can do.
In particular, when a person is detected by image processing, a recognition error is likely to occur. Therefore, by performing such correction, it is possible to calculate a suitable stay score.
 なお、滞留人数算出部135は、複数の時間帯における動線分析に基づく滞留スコアの調整と、位置に基づく係数に応じた滞留スコアの調整の片方のみを用いることも考えられるし、両方を用いることも考えられる。 Note that the staying number calculation unit 135 may use only one of the stay score adjustment based on the flow line analysis in a plurality of time zones and the stay score adjustment according to the coefficient based on the position, or both. It is also possible.
 (1.2.2.4 滞留判定領域情報137)
 滞留判定領域情報137は、滞留判定領域A1の座標に関する情報である。特に、滞留判定領域A1が、入力部110から入力される移動情報に基づいて特定される動線の領域範囲の一部である場合には、動き判別部131、滞留スコア算出部133、及び滞留人数算出部135は滞留判定領域情報137を参照しながら、滞留判定領域A1内の情報の分析を行う。
 なお、滞留判定領域は、多角形や円形などどのような形状で定義してもよく、滞留判定領域の位置座標は、多角形の場合は頂点座標を入力し、円の中心点の座標と半径を入力すればよい。また、複数の滞留判定領域を設定する際に、互いに重なり合うように設定してもよいし、あるいは、互いに重なり合わないように設置してもよい。
(1.2.2.4 Residence determination area information 137)
The stay determination area information 137 is information related to the coordinates of the stay determination area A1. In particular, when the stay determination region A1 is a part of the region of the flow line specified based on the movement information input from the input unit 110, the motion determination unit 131, the stay score calculation unit 133, and the stay The number calculation unit 135 analyzes the information in the stay determination area A1 while referring to the stay determination area information 137.
The stay determination area may be defined in any shape such as a polygon or a circle. If the position coordinates of the stay determination area are polygons, the vertex coordinates are input, and the coordinates and radius of the center point of the circle are entered. You can enter. Further, when setting a plurality of stay determination areas, they may be set so as to overlap each other, or may be installed so as not to overlap each other.
 (1.2.3 出力部)
 出力部140は、スコア算出部130が算出した、対象時間帯における滞留判定領域A1の滞留人数に相当する滞留スコアを、その滞留判定領域A1の座標(位置)や時刻と対応付けて出力する。なおこの時、複数の時間帯に渡る、複数の監視領域に係る滞留スコアを出力することも可能である。このように実装すれば、滞留スコアの時間推移や領域毎の違い等を識別することが可能である。
(1.2.3 Output section)
The output unit 140 outputs the residence score calculated by the score calculation unit 130 and corresponding to the number of people staying in the stay determination region A1 in the target time zone, in association with the coordinates (position) and time of the stay determination region A1. At this time, it is also possible to output a stay score relating to a plurality of monitoring areas over a plurality of time zones. If implemented in this way, it is possible to identify the time transition of the residence score, the difference for each region, and the like.
 滞留スコアの出力方法は複数考えられる。例えば、滞留スコアを単純に数値として出力することも可能であるし、また、表示装置に、滞留スコアに応じて地図上のエリアの濃淡が変化する地図画面を表示させることにより滞留スコアを出力することも考えられる。
 または、滞留スコアが所定の閾値を超える領域が存在する場合、表示装置は、例えば「コンビニエンスストアAの前で滞留が発生しています。」等のメッセージによって、滞留の発生を報知しても良い。
There are a plurality of methods for outputting the retention score. For example, the stay score can be simply output as a numerical value, and the stay score is output by causing the display device to display a map screen in which the shade of the area on the map changes according to the stay score. It is also possible.
Alternatively, when there is a region where the retention score exceeds a predetermined threshold, the display device may notify the occurrence of the retention by a message such as “Residence has occurred in front of convenience store A”, for example. .
 (1.3 処理の流れ)
 以下、情報処理システム100の処理の流れを、図9を参照しながら説明する。図9は、本実施形態に係る情報処理システム100の処理の流れを示すフローチャートである。
(1.3 Process flow)
Hereinafter, the processing flow of the information processing system 100 will be described with reference to FIG. FIG. 9 is a flowchart showing a processing flow of the information processing system 100 according to the present embodiment.
 なお、後述の各処理ステップは、処理内容に矛盾を生じない範囲で、任意に順番を変更して若しくは並列に実行することができ、また、各処理ステップ間に他のステップを追加しても良い。更に、便宜上1つのステップとして記載されているステップは複数のステップに分けて実行することもでき、便宜上複数に分けて記載されているステップを1ステップとして実行することもできる。 Each processing step to be described later can be executed in any order or in parallel as long as there is no contradiction in processing contents, and other steps can be added between the processing steps. good. Further, a step described as a single step for convenience can be executed by being divided into a plurality of steps, and a step described as being divided into a plurality of steps for convenience can be executed as one step.
 まず、入力部110は、図3に例示した移動情報の入力を受ける(S901)。前述の通り、移動情報の入力方法としては複数考えられ、ビデオカメラC1等で撮影した映像を解析することによりリアルタイムに入力される場合のほか、記憶媒体に記録された移動情報を読み込むことも考えられる。 First, the input unit 110 receives the movement information illustrated in FIG. 3 (S901). As described above, a plurality of movement information input methods are conceivable. In addition to the case where the movement information recorded in the storage medium is read in addition to the case where the movement information is input in real time by analyzing the video captured by the video camera C1 or the like. It is done.
 動き判別部131は、入力部110から入力される移動情報に基づいて特定される動線に基づいて各人物の動きを判別することにより、移動している人物であるか否かを判別する(S905)。この判別方法としては、前述の通り、動線ベースで動きを判別する場合には、滞留判定領域A1をまたぐ動線であるか否かや、動線ベースで各移動体の速度が閾値を超えているか否かを識別することにより判別することが考えられる。画像ベースで判別する場合には、まず人流発生領域を特定した上で、人流発生領域上にある動線(人物)は移動しているものとして判別することが可能である。 The motion discriminating unit 131 discriminates whether or not each person is moving by discriminating the motion of each person based on the flow line specified based on the movement information input from the input unit 110 ( S905). As described above, as described above, when the movement is determined based on the flow line, it is determined whether the movement line crosses the stay determination area A1, and the speed of each moving body exceeds the threshold value based on the flow line. It is conceivable to make a determination by identifying whether or not it is. When discriminating on the basis of an image, it is possible to first identify a human flow generation region and then determine that a flow line (person) on the human flow generation region is moving.
 滞留スコア算出部133は、動き判別部131が移動しているものとして判別した動線(人物)を除いた動線を元に、対象時間帯における滞留人数に相当する滞留スコアを算出する(S907)。このいてスコアの算出方法としては、例えば図6や図7を参照しながら説明したように、滞留判定領域A1に一定時間以上検出された動線の数に応じて算出したり、或いは移動体毎の検出時間長に応じて算出したりすることが考えられる。 The staying score calculation unit 133 calculates a staying score corresponding to the number of staying persons in the target time zone based on the flow line excluding the flow line (person) determined as the movement determination unit 131 moving (S907). ). As a score calculation method, for example, as described with reference to FIGS. 6 and 7, the score is calculated according to the number of flow lines detected in the stay determination region A1 for a certain period of time, or for each moving object. It may be calculated according to the detection time length.
 滞留スコア算出部133による算出後、滞留人数算出部135は滞留スコアの補正を行う(S909)。この補正方法としては、前述の通り、動線(人物)の位置に応じて補正する方法や、過去及び/又は未来の時間帯も含む人物の動線分析により補正することが考えられる。 After the calculation by the staying score calculation unit 133, the staying number calculation unit 135 corrects the staying score (S909). As the correction method, as described above, it is conceivable to perform correction according to the position of the flow line (person) or correction based on the flow line analysis of a person including past and / or future time zones.
 なお、S905乃至S909の処理は、滞留判定対象の時間帯ごとに、時間窓をずらしながら逐次処理する。 In addition, the process of S905 thru | or S909 processes sequentially, shifting a time window for every time slot | zone of residence determination object.
 このように滞留スコアを補正した後、出力部140は滞留情報を出力する(S911)。滞留情報には、滞留スコアと時間帯、対象とする滞留判定領域A1の位置情報とを含む。 After correcting the stay score in this way, the output unit 140 outputs stay information (S911). The stay information includes a stay score, a time zone, and position information of the target stay determination area A1.
 (1.4 ハードウェア構成)
 以下、図10を参照しながら、上述してきた情報処理システム100をコンピュータにより実現する場合のハードウェア構成の一例を説明する。なお、情報処理システム100は、複数の情報処理装置により実現することも可能である。
(1.4 Hardware configuration)
Hereinafter, an example of a hardware configuration when the information processing system 100 described above is realized by a computer will be described with reference to FIG. The information processing system 100 can also be realized by a plurality of information processing apparatuses.
 図10に示すように、情報処理システム100は、プロセッサ1001、メモリ1003、記憶装置1005、入力インタフェース(I/F)1007、データI/F1009、通信I/F1011、表示装置1013を含む。 As shown in FIG. 10, the information processing system 100 includes a processor 1001, a memory 1003, a storage device 1005, an input interface (I / F) 1007, a data I / F 1009, a communication I / F 1011, and a display device 1013.
 プロセッサ1001は、メモリ1003に記憶されているプログラムを実行することにより情報処理システム100における様々な処理を制御する。例えば、図2で説明した入力部110、スコア算出部130及び出力部140に係る処理は、メモリ1003に一時記憶された上で、主にプロセッサ1001上で動作するプログラムとして実現可能である。 The processor 1001 controls various processes in the information processing system 100 by executing a program stored in the memory 1003. For example, the processing related to the input unit 110, the score calculation unit 130, and the output unit 140 described in FIG. 2 can be realized as a program mainly operating on the processor 1001 after being temporarily stored in the memory 1003.
 メモリ1003は、例えばRAM(Random Access Memory)等の記憶媒体である。メモリ1003は、プロセッサ1001によって実行されるプログラムのプログラムコードや、プログラムの実行時に必要となるデータを一時的に記憶する。例えば、メモリ1003の記憶領域には、プログラム実行時に必要となるスタック領域が確保される。 The memory 1003 is a storage medium such as a RAM (Random Access Memory). The memory 1003 temporarily stores a program code of a program executed by the processor 1001 and data necessary for executing the program. For example, in the storage area of the memory 1003, a stack area necessary for program execution is secured.
 記憶装置1005は、例えばハードディスクやフラッシュメモリなどの不揮発性の記憶媒体である。記憶装置1005は、オペレーティングシステムや、入力部110、スコア算出部130及び出力部140を実現するための各種プログラムや、滞留判定領域情報137等の各種データ等を記憶する。記憶装置1005に記憶されているプログラムやデータは、必要に応じてメモリ1003にロードされることにより、プロセッサ1001から参照される。 The storage device 1005 is a non-volatile storage medium such as a hard disk or flash memory. The storage device 1005 stores an operating system, various programs for realizing the input unit 110, the score calculation unit 130, and the output unit 140, various data such as the stay determination area information 137, and the like. Programs and data stored in the storage device 1005 are referred to by the processor 1001 by being loaded into the memory 1003 as necessary.
 入力I/F1007は、ユーザからの入力を受け付けるためのデバイスである。入力I/F1007の具体例としては、キーボードやマウス、タッチパネル、各種センサ等が挙げられる。入力I/F1007は、例えばUSB(Universal Serial Bus)等のインタフェースを介して情報処理システム100に接続されても良い。 The input I / F 1007 is a device for receiving input from the user. Specific examples of the input I / F 1007 include a keyboard, a mouse, a touch panel, and various sensors. The input I / F 1007 may be connected to the information processing system 100 via an interface such as USB (Universal Serial Bus), for example.
 データI/F1009は、情報処理システム100の外部からデータを入力するためのデバイスである。データI/F1009の具体例としては、各種記憶媒体に記憶されているデータを読み取るためのドライブ装置等がある。データI/F1009は、情報処理システム100の外部に設けられることも考えられる。その場合、データI/F1009は、例えばUSB等のインタフェースを介して情報処理システム100へと接続される。 The data I / F 1009 is a device for inputting data from outside the information processing system 100. Specific examples of the data I / F 1009 include a drive device for reading data stored in various storage media. The data I / F 1009 may be provided outside the information processing system 100. In that case, the data I / F 1009 is connected to the information processing system 100 via an interface such as a USB.
 通信I/F1011は、情報処理システム100の外部の装置、例えばビデオカメラC1等との間で有線又は無線によりデータ通信するためのデバイスである。通信I/F1011は情報処理システム100の外部に設けられることも考えられる。その場合、通信I/F1011は、例えばUSB等のインタフェースを介して情報処理システム100に接続される。 The communication I / F 1011 is a device for performing data communication with an external device of the information processing system 100, for example, a video camera C1 or the like by wire or wireless. The communication I / F 1011 may be provided outside the information processing system 100. In this case, the communication I / F 1011 is connected to the information processing system 100 via an interface such as a USB.
 表示装置1013は、各種情報を表示するためのデバイスである。表示装置1013の具体例としては、例えば液晶ディスプレイや有機EL(Electro-Luminescence)ディスプレイ等が挙げられる。表示装置1013は、情報処理システム100の外部に設けられても良い。その場合、表示装置1013は、例えばディスプレイケーブル等を介して情報処理システム100に接続される。 The display device 1013 is a device for displaying various information. Specific examples of the display device 1013 include a liquid crystal display and an organic EL (Electro-Luminescence) display. The display device 1013 may be provided outside the information processing system 100. In that case, the display device 1013 is connected to the information processing system 100 via, for example, a display cable.
 (1.5 本実施形態に係る効果)
 以上説明したように、本実施形態に係る情報処理システム100では、人物などの移動体の滞留を好適に検出することができる。このために、例えば動き判別部131で動いていると判別できる移動体に係る動線を滞留スコアの算出から除外している。また滞留スコア算出部133では、滞留時間に基づいて滞留スコアを算出しているため、短時間のみしか滞留していない人物は滞留スコアに全く若しくはほとんど影響を与えないようになっている。更に、滞留人数算出部135では滞留人数の補正を行なっているため、滞留人数の識別に誤りがある場合であっても、その補正が可能となっている。
(1.5 Effects according to this embodiment)
As described above, in the information processing system 100 according to the present embodiment, it is possible to suitably detect staying of a moving body such as a person. For this reason, for example, a flow line related to a moving body that can be determined to be moving by the movement determination unit 131 is excluded from the calculation of the staying score. In addition, since the stay score calculation unit 133 calculates the stay score based on the stay time, a person who stays only for a short time has no or little influence on the stay score. Further, since the staying number calculating unit 135 corrects the staying number, even when there is an error in the staying number identification, the correction is possible.
 (2 第2実施形態)
 以下、第2実施形態を、図11を参照しながら説明する。図11は、情報処理システム1100の機能構成を示すブロック図である。図11に示すように情報処理システム1100は、入力部1110と算出部1120とを含む。
 入力部1110は、滞留スコアを算出する対象領域における各時刻の移動体の位置に係る情報の入力を受ける。
(2 Second Embodiment)
The second embodiment will be described below with reference to FIG. FIG. 11 is a block diagram illustrating a functional configuration of the information processing system 1100. As illustrated in FIG. 11, the information processing system 1100 includes an input unit 1110 and a calculation unit 1120.
The input unit 1110 receives input of information relating to the position of the moving body at each time in the target area for which the stay score is calculated.
 算出部1120は、各時刻の各移動体の位置に基づいて推定される、対象領域に各移動体が滞留した滞留時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出する。
 このように実装することで、本実施形態に係る情報処理システム1100によれば、移動体の滞留を好適に検出することができるようになる。
The calculation unit 1120 calculates a score indicating the degree of stay in the target area according to the stay time in which each mobile body stays in the target area, which is estimated based on the position of each mobile body at each time.
By mounting in this way, according to the information processing system 1100 according to the present embodiment, it is possible to suitably detect staying of the moving body.
 (3 付記事項)
 なお、前述の実施形態の構成は、組み合わせたり或いは一部の構成部分を入れ替えたりしてもよい。また、本発明の構成は前述の実施形態のみに限定されるものではなく、本発明の要旨を逸脱しない範囲内において種々変更を加えてもよい。
(3 Additional notes)
Note that the configurations of the above-described embodiments may be combined or some of the components may be replaced. The configuration of the present invention is not limited to the above-described embodiment, and various modifications may be made without departing from the scope of the present invention.
 なお、前述の各実施形態の一部又は全部は、以下の付記のようにも記載されうるが、以下には限られない。また、本発明のプログラムは、上記の各実施形態で説明した各動作を、コンピュータに実行させるプログラムであれば良い。 Note that part or all of the above-described embodiments can be described as in the following supplementary notes, but is not limited to the following. Moreover, the program of this invention should just be a program which makes a computer perform each operation | movement demonstrated in said each embodiment.
 (付記1)
 対象領域における各時刻の移動体の位置に係る情報の入力を受ける入力手段と、各時刻の各移動体の位置に基づいて推定される、前記対象領域における各移動体の連続検出時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出する算出手段とを備える情報処理システム。
(Appendix 1)
According to the input means for receiving information related to the position of the moving body at each time in the target area, and the continuous detection time of each moving body in the target area estimated based on the position of each moving body at each time An information processing system comprising: a calculating unit that calculates a score indicating the degree of staying in the target area.
 (付記2)
 前記算出手段は、前記対象領域での移動体の連続検出時間が閾値以上となる移動体の数に基づいて前記スコアを算出する、付記1記載の情報処理システム。
(Appendix 2)
The information processing system according to supplementary note 1, wherein the calculation unit calculates the score based on the number of moving objects whose continuous detection time of moving objects in the target region is equal to or greater than a threshold value.
 (付記3)
 前記算出手段は、前記対象領域内で算出する前記スコアに時間に対する変化が生じた場合に、当該変化した時間に前記対象領域の近傍で検出された移動体の有無に基づいて前記対象領域内の移動体の数を推定する、付記2記載の情報処理システム。
(Appendix 3)
When the score calculated in the target area is changed with respect to time, the calculating unit is configured to determine whether or not there is a moving body detected in the vicinity of the target area at the changed time. The information processing system according to attachment 2, wherein the number of moving objects is estimated.
 (付記4)
 前記算出手段は、前記対象領域における各移動体の連続検出時間の合計に基づいて前記スコアを算出する、付記1記載の情報処理システム。
(Appendix 4)
The information processing system according to supplementary note 1, wherein the calculation unit calculates the score based on a total of continuous detection times of the moving objects in the target region.
 (付記5)
 前記算出手段は、前記対象領域を通過したと判別できる移動体を除いて前記スコアを算出する、付記1乃至付記4のいずれか1項記載の情報処理システム。
(Appendix 5)
5. The information processing system according to claim 1, wherein the calculation unit calculates the score excluding a moving body that can be determined to have passed through the target region.
 (付記6)
 前記算出手段は、各時刻の各移動体の位置に基づいて、前記対象領域のうちの人流領域を判別し、前記対象領域のうち前記人流領域を除く領域における各移動体の連続検出時間に応じて前記スコアを算出する、付記1乃至付記5のいずれか1項記載の情報処理システム。
(Appendix 6)
The calculation means determines a human current area in the target area based on the position of each mobile object at each time, and according to the continuous detection time of each mobile object in the area of the target area excluding the human current area. The information processing system according to any one of supplementary notes 1 to 5, wherein the score is calculated.
 (付記7)
 前記算出手段は、前記対象領域のうちの第1の領域における移動体の連続検出時間間と、前記第1の領域よりも移動体の検出が困難な第2の領域における移動体の連続検出時間とにそれぞれ異なる係数を掛けることにより前記スコアを算出する、付記1乃至付記6のいずれか1項記載の情報処理システム。
(Appendix 7)
The calculation means includes a continuous detection time of the moving body in the first region of the target region, and a continuous detection time of the mobile body in the second region where the detection of the moving body is more difficult than the first region. The information processing system according to any one of appendices 1 to 6, wherein the score is calculated by multiplying each by a different coefficient.
 (付記8)
 対象領域における各時刻の移動体の位置に係る情報の入力を受けるステップと、各時刻の各移動体の位置に基づいて推定される、前記対象領域における各移動体の連続検出時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出するステップとを情報処理システムが行う、情報処理方法。
(Appendix 8)
According to the step of receiving information related to the position of the moving body at each time in the target area, and the continuous detection time of each moving body in the target area estimated based on the position of each moving body at each time, An information processing method in which the information processing system performs a step of calculating a score indicating the degree of stay in the target area.
 (付記9)
 前記対象領域での移動体の連続検出時間が閾値以上となる移動体の数に基づいて前記スコアを算出する、付記8記載の情報処理方法。
(Appendix 9)
The information processing method according to appendix 8, wherein the score is calculated based on the number of moving objects for which the continuous detection time of moving objects in the target region is equal to or greater than a threshold value.
 (付記10)
 前記対象領域内で算出する前記スコアに時間に対する変化が生じた場合に、当該変化した時間に前記対象領域の近傍で検出された移動体の有無に基づいて前記対象領域内の移動体の数を推定する、付記9記載の情報処理方法。
(Appendix 10)
When a change with respect to time occurs in the score calculated in the target area, the number of moving bodies in the target area is calculated based on the presence or absence of the mobile body detected in the vicinity of the target area at the changed time. The information processing method according to appendix 9, which is estimated.
 (付記11)
 前記対象領域における各移動体の連続検出時間の合計に基づいて前記スコアを算出する、付記8記載の情報処理方法。
(Appendix 11)
The information processing method according to appendix 8, wherein the score is calculated based on a total of continuous detection times of the moving objects in the target region.
 (付記12)
 前記対象領域を通過したと判別できる移動体を除いて前記スコアを算出する、付記8乃至付記11のいずれか1項記載の情報処理方法。
(Appendix 12)
The information processing method according to any one of appendices 8 to 11, wherein the score is calculated by removing a moving body that can be determined to have passed through the target region.
 (付記13)
 各時刻の各移動体の位置に基づいて、前記対象領域のうちの人流領域を判別し、前記対象領域のうち前記人流領域を除く領域における各移動体の連続検出時間に応じて前記スコアを算出する、付記8乃至付記12のいずれか1項記載の情報処理方法。
(Appendix 13)
Based on the position of each moving body at each time, a human current area in the target area is determined, and the score is calculated according to the continuous detection time of each moving body in the target area other than the human current area. The information processing method according to any one of supplementary notes 8 to 12.
 (付記14)
 前記対象領域のうちの第1の領域における移動体の連続検出時間と、前記第1の領域よりも移動体の検出が困難な第2の領域における移動体の連続検出時間とにそれぞれ異なる係数を掛けることにより前記スコアを算出する、付記8乃至付記13のいずれか1項記載の情報処理方法。
(Appendix 14)
Different coefficients are used for the continuous detection time of the moving object in the first region of the target region and the continuous detection time of the moving object in the second region where detection of the moving object is more difficult than in the first region. 14. The information processing method according to any one of supplementary notes 8 to 13, wherein the score is calculated by multiplying.
 (付記15)
 対象領域における各時刻の移動体の位置に係る情報の入力を受ける処理と、各時刻の各移動体の位置に基づいて推定される、前記対象領域における各移動体の連続検出時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出する処理とをコンピュータに実行させるプログラム。
(Appendix 15)
According to the process of receiving information related to the position of the moving body at each time in the target area, and the continuous detection time of each moving body in the target area, which is estimated based on the position of each moving body at each time, The program which makes a computer perform the process which calculates the score which shows the degree of stay concerning the said object area | region.
 (付記16)
 前記対象領域での移動体の連続検出時間が閾値以上となる移動体の数に基づいて前記スコアを算出する、付記15記載のプログラム。
(Appendix 16)
The program according to appendix 15, wherein the score is calculated based on the number of moving objects for which the continuous detection time of moving objects in the target region is equal to or greater than a threshold value.
 (付記17)
 前記対象領域内で算出する前記スコアに時間に対する変化が生じた場合に、当該変化した時間に前記対象領域の近傍で検出された移動体の有無に基づいて前記対象領域内の移動体の数を推定する、付記16記載のプログラム。
(Appendix 17)
When a change with respect to time occurs in the score calculated in the target area, the number of moving bodies in the target area is calculated based on the presence or absence of the mobile body detected in the vicinity of the target area at the changed time. The program according to appendix 16, which is estimated.
 (付記18)
 前記対象領域における各移動体の連続検出時間の合計に基づいて前記スコアを算出する、付記15記載のプログラム。
(Appendix 18)
The program according to claim 15, wherein the score is calculated based on a total of continuous detection times of the respective moving objects in the target region.
 (付記19)
 前記対象領域を通過したと判別できる移動体を除いて前記スコアを算出する、付記15乃至付記18のいずれか1項記載のプログラム。
(Appendix 19)
The program according to any one of appendix 15 to appendix 18, wherein the score is calculated by removing a moving body that can be identified as having passed through the target region.
 (付記20)
 各時刻の各移動体の位置に基づいて、前記対象領域のうちの人流領域を判別し、前記対象領域のうち前記人流領域を除く領域における各移動体の連続検出時間に応じて前記スコアを算出する、付記15乃至付記19のいずれか1項記載のプログラム。
(Appendix 20)
Based on the position of each moving body at each time, a human current area in the target area is determined, and the score is calculated according to the continuous detection time of each moving body in the target area other than the human current area. The program according to any one of supplementary notes 15 to 19.
 (付記21)
 前記対象領域のうちの第1の領域における各移動体の連続検出時間と、前記第1の領域よりも移動体の検出が困難な第2の領域における各移動体の連続検出時間とにそれぞれ異なる係数を掛けることにより前記スコアを算出する、付記15乃至付記20のいずれか1項記載のプログラム。
(Appendix 21)
The continuous detection time of each moving body in the first area of the target area is different from the continuous detection time of each moving body in the second area where it is more difficult to detect the moving body than the first area. The program according to any one of supplementary notes 15 to 20, wherein the score is calculated by multiplying by a coefficient.
 (付記22)
 対象領域における各時刻の移動体の位置の入力を受ける入力手段と、前記各時刻の各移動体の位置に基づいて、前記対象領域に係る滞留の度合いを算出する算出手段とを備える情報処理システム。
(Appendix 22)
An information processing system comprising: an input unit that receives an input of a position of a moving body at each time in a target region; and a calculation unit that calculates a degree of staying in the target region based on the position of each moving body at each time .
 (付記23)
 対象領域における各時刻の各移動体の位置の入力を受けるステップと、前記各時刻の各移動体の位置に基づいて、前記対象領域に係る滞留の度合いを算出するステップとを情報処理システムが行う、情報処理方法。
(Appendix 23)
The information processing system performs a step of receiving an input of a position of each moving body at each time in the target region, and a step of calculating a staying degree related to the target region based on the position of each moving body at each time Information processing method.
 (付記24)
 対象領域における各時刻の移動体の位置の入力を受ける処理と、前記各時刻の各移動体の位置に基づいて、前記対象領域に係る滞留の度合いを算出する処理とをコンピュータに実行させるプログラム。
(Appendix 24)
A program that causes a computer to execute a process of receiving an input of a position of a moving body at each time in a target area and a process of calculating a degree of stay related to the target area based on the position of each moving body at each time.
 (付記25)
 映像の入力を受ける入力手段と、
 前記映像の対象領域における移動体の滞留時間に応じて、前記対象領域の表示態様を変更する表示装置と、
を備える情報処理システム。
(Appendix 25)
Input means for receiving video input;
A display device that changes a display mode of the target area according to a residence time of the moving object in the target area of the video;
An information processing system comprising:
 (付記26)
 映像の入力を受けるステップと、
 前記映像の対象領域における移動体の滞留時間に応じて、前記対象領域の表示態様を変更するステップと、
を情報処理システムが行う、情報処理方法。
(Appendix 26)
Receiving video input,
Changing the display mode of the target area according to the residence time of the moving object in the target area of the video;
An information processing method in which the information processing system performs.
 (付記27)
 映像の入力を受ける処理と、
 前記映像の対象領域における移動体の滞留時間に応じて、前記対象領域の表示態様を変更する処理と、
をコンピュータに実行させるプログラム。
(Appendix 27)
Processing to receive video input,
A process of changing the display mode of the target area according to the residence time of the moving object in the target area of the video;
A program that causes a computer to execute.
 この出願は、2013年1月16日に出願された日本出願特願2013-5505を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2013-5505 filed on January 16, 2013, the entire disclosure of which is incorporated herein.
100・・・情報処理システム、110・・・入力部、130・・・スコア算出部、131・・・動き判別部、133・・・滞留スコア算出部、135・・・滞留人数算出部、137・・・滞留判定領域情報、140・・・出力部、1001・・・プロセッサ、1003・・・メモリ、1005・・・記憶装置、1007・・・入力インタフェース、1009・・・データインタフェース、1011・・・通信インタフェース、1013・・・表示装置、1100・・・情報処理システム、1110・・・入力部、1120・・・算出部 DESCRIPTION OF SYMBOLS 100 ... Information processing system, 110 ... Input part, 130 ... Score calculation part, 131 ... Motion discrimination | determination part, 133 ... Retention score calculation part, 135 ... Retention number calculation part, 137 ... Residence determination area information, 140 ... Output unit, 1001 ... Processor, 1003 ... Memory, 1005 ... Storage device, 1007 ... Input interface, 1009 ... Data interface, 1011 ..Communication interface, 1013 ... display device, 1100 ... information processing system, 1110 ... input unit, 1120 ... calculation unit

Claims (11)

  1.  対象領域における各時刻の移動体の位置に係る情報の入力を受ける入力手段と、
     各時刻の各移動体の位置に基づいて推定される、前記対象領域における各移動体の連続検出時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出する算出手段とを備える情報処理システム。
    Input means for receiving input of information relating to the position of the moving body at each time in the target area;
    Information comprising: a calculating means for calculating a score indicating the degree of stay in the target area according to the continuous detection time of each moving body in the target area, which is estimated based on the position of each moving body at each time Processing system.
  2.  前記算出手段は、前記対象領域での移動体の連続検出時間が閾値以上となる移動体の数に基づいて前記スコアを算出する、
    請求項1記載の情報処理システム。
    The calculating means calculates the score based on the number of moving objects for which the continuous detection time of the moving object in the target region is equal to or greater than a threshold;
    The information processing system according to claim 1.
  3.  前記算出手段は、前記対象領域内で算出する前記スコアに時間に対する変化が生じた場合に、当該変化した時間に前記対象領域の近傍で検出された移動体の有無に基づいて前記対象領域内の移動体の数を推定する、
    請求項2記載の情報処理システム。
    When the score calculated in the target area is changed with respect to time, the calculating unit is configured to determine whether or not there is a moving body detected in the vicinity of the target area at the changed time. Estimate the number of moving objects,
    The information processing system according to claim 2.
  4.  前記算出手段は、前記対象領域での各移動体の連続検出時間の合計に基づいて前記スコアを算出する、
    請求項1記載の情報処理システム。
    The calculating means calculates the score based on a total of continuous detection times of the moving objects in the target region;
    The information processing system according to claim 1.
  5.  前記算出手段は、前記対象領域を通過したと判別できる移動体を除いて前記スコアを算出する、請求項1乃至請求項4のいずれか1項記載の情報処理システム。 The information processing system according to any one of claims 1 to 4, wherein the calculation means calculates the score excluding a moving body that can be determined to have passed through the target region.
  6.  前記算出手段は、各時刻の各移動体の位置に基づいて、前記対象領域のうちの人流領域を判別し、前記対象領域のうち前記人流領域を除く領域における各移動体の連続検時間に応じて前記スコアを算出する、
    請求項1乃至請求項5のいずれか1項記載の情報処理システム。
    The calculation means determines a human current area in the target area based on the position of each mobile object at each time, and according to a continuous detection time of each mobile object in an area of the target area excluding the human current area. Calculating the score,
    The information processing system according to any one of claims 1 to 5.
  7.  前記算出手段は、前記対象領域のうちの第1の領域における各移動体の連続検出時間と、前記第1の領域よりも移動体の検出が困難な第2の領域における各移動体の連続検出時間とにそれぞれ異なる係数を掛けることにより前記スコアを算出する、
    請求項1乃至請求項6のいずれか1項記載の情報処理システム。
    The calculating means includes a continuous detection time of each moving body in the first area of the target area, and a continuous detection of each moving body in the second area where it is more difficult to detect the moving body than the first area. Calculating the score by multiplying time by a different coefficient,
    The information processing system according to any one of claims 1 to 6.
  8.  対象領域における各時刻の各移動体の位置に係る情報の入力を受けるステップと、
     各時刻の各移動体の位置に基づいて推定される、前記対象領域における各移動体の連続検出時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出するステップと
    を情報処理システムが行う、情報処理方法。
    Receiving information related to the position of each mobile object at each time in the target area;
    Calculating a score indicating the degree of stay in the target area according to the continuous detection time of each moving body in the target area, which is estimated based on the position of each mobile body at each time. Information processing method performed by
  9.  対象領域における各時刻の移動体の位置に係る情報の入力を受ける処理と、
     各時刻の各移動体の位置に基づいて推定される、前記対象領域における各移動体の連続検出時間に応じて、当該対象領域に係る滞留の度合いを示すスコアを算出する処理と
    をコンピュータに実行させるプログラム。
    A process of receiving input of information relating to the position of the moving object at each time in the target area;
    The computer executes a process of calculating a score indicating the degree of stay in the target area according to the continuous detection time of each moving body in the target area, which is estimated based on the position of each moving body at each time Program to make.
  10.  対象領域における各時刻の移動体の位置の入力を受ける入力手段と、
     前記各時刻の各移動体の位置に基づいて、前記対象領域に係る滞留の度合いを算出する算出手段と
    を備える情報処理システム。
    An input means for receiving an input of the position of the moving body at each time in the target area;
    An information processing system comprising: a calculating unit that calculates a staying degree related to the target area based on the position of each moving body at each time.
  11.  映像の入力を受ける入力手段と、
     前記映像の対象領域における移動体の滞留時間に応じて、前記対象領域の表示態様を変更する表示装置と、
    を備える情報処理システム。
    Input means for receiving video input;
    A display device that changes a display mode of the target area according to a residence time of the moving object in the target area of the video;
    An information processing system comprising:
PCT/JP2014/050080 2013-01-16 2014-01-07 Information processing system, information processing method, and program WO2014112407A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013005505 2013-01-16
JP2013-005505 2013-01-16

Publications (1)

Publication Number Publication Date
WO2014112407A1 true WO2014112407A1 (en) 2014-07-24

Family

ID=51209499

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/050080 WO2014112407A1 (en) 2013-01-16 2014-01-07 Information processing system, information processing method, and program

Country Status (1)

Country Link
WO (1) WO2014112407A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016114134A1 (en) * 2015-01-14 2016-07-21 日本電気株式会社 Motion condition estimation device, motion condition estimation method and program recording medium
JP2017123025A (en) * 2016-01-06 2017-07-13 パナソニックIpマネジメント株式会社 Traffic line analysis system and traffic line analysis method
CN107145433A (en) * 2017-05-03 2017-09-08 浙江极赢信息技术有限公司 Detect that APP registers the method and system of channel brush list
US11189038B2 (en) 2017-11-21 2021-11-30 Mitsubishi Electric Corporation Tracking apparatus and computer readable medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0749952A (en) * 1993-08-06 1995-02-21 Hitachi Ltd Device for monitoring mobile object
JP2004272756A (en) * 2003-03-11 2004-09-30 Meidensha Corp Device for investigating congestion degree
JP2007280043A (en) * 2006-04-06 2007-10-25 Mitsubishi Electric Corp Video monitoring and search system
WO2009054119A1 (en) * 2007-10-26 2009-04-30 Panasonic Corporation Situation judging device, situation judging method, situation judging program, abnormality judging device, abnormality judging method, abnormality judging program, and congestion estimating device
JP2009181556A (en) * 2008-02-01 2009-08-13 Sony Corp Congestion determination device and congestion determination method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0749952A (en) * 1993-08-06 1995-02-21 Hitachi Ltd Device for monitoring mobile object
JP2004272756A (en) * 2003-03-11 2004-09-30 Meidensha Corp Device for investigating congestion degree
JP2007280043A (en) * 2006-04-06 2007-10-25 Mitsubishi Electric Corp Video monitoring and search system
WO2009054119A1 (en) * 2007-10-26 2009-04-30 Panasonic Corporation Situation judging device, situation judging method, situation judging program, abnormality judging device, abnormality judging method, abnormality judging program, and congestion estimating device
JP2009181556A (en) * 2008-02-01 2009-08-13 Sony Corp Congestion determination device and congestion determination method

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016114134A1 (en) * 2015-01-14 2016-07-21 日本電気株式会社 Motion condition estimation device, motion condition estimation method and program recording medium
JPWO2016114134A1 (en) * 2015-01-14 2017-10-26 日本電気株式会社 Movement situation estimation apparatus, movement situation estimation method, and program
US20180005046A1 (en) * 2015-01-14 2018-01-04 Nec Corporation Movement state estimation device, movement state estimation method and program recording medium
US10325160B2 (en) 2015-01-14 2019-06-18 Nec Corporation Movement state estimation device, movement state estimation method and program recording medium
US10657386B2 (en) 2015-01-14 2020-05-19 Nec Corporation Movement state estimation device, movement state estimation method and program recording medium
US10755108B2 (en) 2015-01-14 2020-08-25 Nec Corporation Movement state estimation device, movement state estimation method and program recording medium
JP2021036437A (en) * 2015-01-14 2021-03-04 日本電気株式会社 Movement situation estimation device, movement situation estimation method and program recording medium
JP7163945B2 (en) 2015-01-14 2022-11-01 日本電気株式会社 Movement situation estimation device, movement situation estimation method, and program recording medium
JP2017123025A (en) * 2016-01-06 2017-07-13 パナソニックIpマネジメント株式会社 Traffic line analysis system and traffic line analysis method
CN107145433A (en) * 2017-05-03 2017-09-08 浙江极赢信息技术有限公司 Detect that APP registers the method and system of channel brush list
US11189038B2 (en) 2017-11-21 2021-11-30 Mitsubishi Electric Corporation Tracking apparatus and computer readable medium

Similar Documents

Publication Publication Date Title
JP6649306B2 (en) Information processing apparatus, information processing method and program
EP2947602B1 (en) Person counting device, person counting system, and person counting method
CN106952303B (en) Vehicle distance detection method, device and system
JP4966820B2 (en) Congestion estimation apparatus and method
JP6347211B2 (en) Information processing system, information processing method, and program
US9158738B2 (en) Apparatus for monitoring vicinity of a vehicle
JP2015506516A5 (en)
US9811755B2 (en) Object monitoring system, object monitoring method, and monitoring target extraction program
US9761012B2 (en) Object tracking device, object tracking method, and computer-readable medium
US9292939B2 (en) Information processing system, information processing method and program
KR102248404B1 (en) Method and device for analyzing motion
US9514542B2 (en) Moving object tracking device, moving object tracking system and moving object tracking method
US9934576B2 (en) Image processing system, image processing method, and recording medium
WO2014175356A1 (en) Information processing system, information processing method, and program
JP2008002817A (en) Object identification system
KR101897018B1 (en) Method for tracking an object and apparatus thereof
WO2014192441A1 (en) Image processing system, image processing method, and program
WO2014050432A1 (en) Information processing system, information processing method and program
WO2014112407A1 (en) Information processing system, information processing method, and program
US20110249862A1 (en) Image display device, image display method, and image display program
US20140064562A1 (en) Approaching-object detector, approaching object detecting method, and recording medium storing its program
KR20130031713A (en) Device for guiding safty distance for vehicle and method therefor
CN112347853A (en) License plate data desensitization method based on video, storage medium and server
US20230196773A1 (en) Object detection device, object detection method, and computer-readable storage medium
JP4298621B2 (en) Object detection apparatus, object detection method, and object detection program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14740180

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14740180

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP