JP7027171B2 - Information processing equipment, information processing methods and programs - Google Patents

Description

The present invention relates to an information processing apparatus, an information processing method and a program.

In recent years, a technique for predicting the waiting time of a matrix by analyzing an image captured by an imaging device has attracted attention. By using such a technique, it is possible to collect data on the state of the matrix and the waiting time. In addition, the collected data can be used to guide the waiting time to the users forming the matrix.
Patent Document 1 describes a system that analyzes an image captured by an image pickup device, identifies a queue, and displays a schematic queue so that a user can easily check the state of the queue. It has been disclosed.

Japanese Patent No. 4402505

However, when the matrix extends over the imaging range of a plurality of imaging devices, it is necessary to confirm the matrix partially captured in each image, and it is difficult for the user to grasp the state of the entire matrix. Become. The technique described in Patent Document 1 does not take this point into consideration at all.
Therefore, it is an object of the present invention to make it possible for a user to easily confirm a matrix existing over an imaging range of a plurality of imaging means.

In order to solve the above problems, one aspect of the information processing apparatus according to the present invention is an extraction means for extracting a matrix region containing a plurality of objects from images captured by a plurality of imaging means, and the extraction means. The acquisition means for acquiring information about the matrix area extracted by the extraction means and a plurality of related matrix areas among the matrix areas extracted by the extraction means are displayed by a display method according to the information acquired by the acquisition means. It is provided with a display control means for displaying on a display device.

According to the present invention, it is possible for the user to easily confirm the matrix existing over the imaging range of the plurality of imaging means.

It is a figure which shows the configuration example of the display system in this embodiment. It is a flowchart which shows the display control processing procedure in an information processing apparatus. This is an example of an image captured by a plurality of image pickup devices. This is an example of a display screen that displays a matrix area.

Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings.
It should be noted that the embodiment described below is an example as a means for realizing the present invention, and should be appropriately modified or modified depending on the configuration of the apparatus to which the present invention is applied and various conditions, and the present invention is described below. Is not limited to the embodiment of the above.

(First embodiment)
FIG. 1 is a configuration example of the display system 1000 according to the present embodiment.
The display system 1000 in the present embodiment is a system that analyzes images captured by a plurality of image pickup devices and presents the analysis results to the user. Specifically, the display system 1000 extracts a matrix region including a plurality of objects (human body in the present embodiment) from images captured by a plurality of image pickup devices. Then, the display system 100 displays a plurality of related matrix areas among the extracted matrix areas by a display method according to the information of the matrix area (hereinafter, also referred to as "matrix information"). Here, the plurality of related matrix regions are matrix regions constituting the same matrix existing across the imaging regions of the plurality of imaging devices, and the display system 100 straddles the imaging regions of the plurality of imaging devices. Display the existing matrix so that the user can easily see it.
In the present embodiment, the object forming the matrix is described as a human body, but the object may be, for example, a car or an animal.

As shown in FIG. 1, the display system 1000 includes a plurality of image pickup devices 100A and 100B, and an information processing device 200. The image pickup devices 100A and 100B and the information processing device 200 are connected to each other by a network 300 so as to be communicable with each other.
The image pickup devices 100A and 100B are cameras that capture images. The image pickup devices 100A and 100B can be, for example, a surveillance camera used for surveillance. The image pickup devices 100A and 100B transmit the images captured via the network 300 to the information processing device 200.

The image pickup devices 100A and 100B can be installed on a wall surface, a ceiling, or the like, and may be cameras that capture an image including one or more images. Further, the image pickup devices 100A and 100B may be compatible with PoE (Power Over Ethernet (registered trademark)), or may be configured such that power is supplied via a LAN cable or the like. Further, in FIG. 1, two image pickup devices 100A and 100B are connected to the network 300, but it is sufficient that two or more image pickup devices are connected to the network 300, and the number of connected images is the number shown in FIG. Not limited to.

Next, the configuration of the image pickup apparatus 100A will be described. In the present embodiment, since the image pickup apparatus 100A and the image pickup apparatus 100B have the same configuration, only the configuration of the image pickup apparatus 100A will be described below.
The image pickup apparatus 100A includes an image pickup unit 101A, a communication unit 102A, a CPU 103A, and a storage unit 104A.
The image pickup unit 101A includes a lens group and an image pickup element that constitute an image pickup optical system. The lens group has an optical lens for forming an image of incident light, and the incident light is focused on an image pickup device. The image pickup device is an element that converts light into an analog image signal, and can be configured by, for example, a CCD, a CMOS (Complementary Metal Oxide Semiconductor), or the like. The image pickup unit 101A performs image processing on the analog image signal obtained from the image pickup element, encodes the signal, and outputs the coded image signal.

The communication unit 102A provides a wireless or wired communication interface with an external device including the information processing device 200. That is, the communication unit 102A can communicate with an external device such as the information processing device 200 by wireless communication. This wireless communication includes a wireless PAN (Personal Area Network) such as Bluetooth®, Z-Wave®, ZigBee®, UWB (Ultra Wide Band) and the like. Further, it includes a wireless LAN (Local Area Network) such as Wi-Fi (Wi-Filess Fidelity) (registered trademark) and a wireless MAN (Metropolitan Area Network) such as WiMAX (registered trademark). Further, it includes a wireless WAN (Wide Area Network) such as LTE / 3G.
Further, the communication unit 102A may communicate with an external device such as the information processing device 200 by a wired LAN. Examples of the wired LAN include configurations of a plurality of routers, switches, cables, and the like that satisfy communication standards such as Ethernet (registered trademark). The communication unit 102A may be capable of communicating with an external device, and the communication standard, scale, and configuration are not limited to the above.

The CPU 103A is a calculation processing unit that performs processing such as calculation and logic determination in each part of the image pickup apparatus 100A, and controls each component unit (101A, 102A, 104A) via a system bus. The functions and processes of the image pickup apparatus 100A may be realized by the CPU 103A reading a program stored in the storage unit 104A and executing this program.
The storage unit 104A is composed of an electrically erasable non-volatile memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory). Further, the storage unit 104A may include a main memory of the CPU 103A, a RAM functioning as a work memory, an external memory, a detachable storage medium, and the like. Various information used by the CPU 103A is recorded in the storage unit 104A. The storage unit 104A may store, for example, an image captured by the image pickup unit 101A.

Next, the configuration of the information processing apparatus 200 will be described.
The information processing device 200 may be, for example, a PC (Personal Computer) or a portable terminal such as a tablet terminal or a smartphone.
The information processing device 200 includes a communication unit 201, a CPU 202, a storage unit 203, a display unit 204, and an input unit 205. Further, the information processing apparatus 200 includes a matrix area setting unit 206, a matrix information management unit 207, a matrix area extraction unit 208, a matrix synthesis determination unit 209, and a matrix area synthesis unit 210.

The communication unit 201 provides a wireless or wired communication interface with an external device including the image pickup devices 100A and 100B, similarly to the communication unit 102A of the image pickup device 100A described above. The communication unit 201A receives images from the image pickup devices 100A and 100B via the network 300, and communicates various information with the image pickup devices 100A and 100B, respectively.
The CPU 202 is a calculation processing unit that performs processing such as calculation and logic determination in each part of the information processing device 200, like the CPU 103A of the image pickup device 100A described above, and each component unit (201, 203 to 210) via a system bus. ) Is controlled.
The storage unit 203 is configured by an electrically erasable non-volatile memory such as an EEPROM, similarly to the storage unit 104A of the image pickup apparatus 100A described above. Further, the storage unit 203 may include a main memory of the CPU 202, a RAM functioning as a work memory, an external memory, a removable storage medium, and the like.

The display unit 204 displays images received from the image pickup devices 100A and 100B, and displays a matrix area and matrix information described later. In this embodiment, the configuration in which the information processing apparatus 200 includes the display unit 204 will be described, but the configuration is not limited to the above configuration. For example, the information processing device 200 may not include the display unit 204 and may perform display control to display an image on an external display device (client device).
The input unit 205 receives instruction input from the user via various user interfaces (UI) such as mouse input, keyboard input, and touch input. When, for example, an instruction to change the setting of the image pickup apparatus 100A is input to the input unit 205, the CPU 202 generates a control command for changing the setting of the image pickup apparatus 100A based on the input information, and the communication unit 201 The control command generated to the image pickup apparatus 100A is output to the image pickup apparatus 100A. In this way, the information processing device 200 can appropriately change the settings of the image pickup devices 100A and 100B based on the information input to the input unit 205.

The matrix area setting unit 206 sets the matrix area from the images captured by the image pickup devices 100A and 100B. The matrix area setting unit 206 can set the matrix area based on the information about the matrix area specified by the user. In this case, the user operates various UIs such as a mouse while checking the images of the image pickup devices 100A and 100B displayed on the display unit 204 to specify a matrix area in the image. Then, the matrix area setting unit 206 sets the matrix area based on the above-mentioned user's designation accepted by the input unit 205.
The matrix area setting unit 206 analyzes the images captured by the image pickup devices 100A and 100B, and sets the matrix area by detecting the moving speed of the human body existing in the image and the region where the human body is highly dense. You may. At that time, any algorithm can be used to set the matrix area.

The matrix information management unit 207 manages information (matrix information) regarding the matrix area set by the matrix area setting unit 206. The matrix information includes at least one of a matrix identification number 207a, a matrix position information 207b, a matrix direction and length 207c, and a matrix latency 207d. Hereinafter, the matrix information managed by the matrix information management unit 207 will be specifically described.
The matrix identification number 207a is a number for distinguishing a matrix imaged by a plurality of image pickup devices, and the same identification number is assigned to the related matrix regions. Here, the matrix region having a relationship is a matrix region constituting the same matrix. The matrix identification number 207a may be set by the user while checking the images of the image pickup devices 100A and 100B when designating the matrix area of the image. Further, when the matrix synthesis determination unit 209 described later detects a corresponding point between a plurality of images, the same identification number may be assigned to the matrix regions having a relationship with each other.

The matrix position information 207b is information regarding the position of the matrix area set by the matrix area setting unit 206. The position information 207b of the matrix can be determined based on the positions of the image pickup devices 100A and 100B and the image pickup direction and the image pickup angle of view of the image pickup devices 100A and 100B. Here, the position information of the image pickup devices 100A and 100B can be acquired by GPS (Global Positioning System) (not shown). The method of acquiring the position information of the image pickup devices 100A and 100B is not limited to the method using GPS, and may be a method of acquiring by a positioning technique such as an indoor positioning technique.

The matrix direction and length 207c is information regarding the direction and length of the matrix area set by the matrix area setting unit 206. The direction of the matrix can be the direction of movement of the human body forming the matrix region. The direction of movement of the human body can be detected by detecting the same human body forming the matrix region in different frames and tracking the human body. For example, the human body may be tracked based on the similarity of the histograms of colors contained in the human body, and the direction of movement of the human body may be detected. The length of the matrix can be measured based on the number of human bodies forming the matrix region.
The matrix waiting time 207d is the waiting time of a person who forms the matrix area set by the matrix area setting unit 206. The queue waiting time 207d may be set by measuring the waiting time of a person who is actually waiting in the queue, or the waiting time may be estimated based on the queuing theory. Any algorithm can be used as a method for estimating the waiting time.

The matrix area extraction unit 208 cuts out the matrix area set by the matrix area setting unit 206 from the images captured by the image pickup devices 100A and 100B, respectively.
The matrix synthesis determination unit 209 determines whether or not the matrix regions extracted from the images captured by the plurality of image pickup devices are related matrix regions, that is, whether or not they are the same matrix. For example, the matrix synthesis determination unit 209 extracts a local feature amount for each image captured by a plurality of image pickup devices, and detects a point correspondence between the images by the extracted local feature amount to determine whether the matrix is the same. Can be judged. Further, the matrix synthesis determination unit 209 may determine whether the matrix is the same based on the matrix identification number 207a and the position information 207b managed by the matrix information management unit 207.

The matrix area synthesis unit 210 synthesizes the matrix area extracted by the matrix area extraction unit 208 based on the determination result by the matrix composition determination unit 209, and performs display control to display the combined image on the display unit 204. When synthesizing images, the matrix area synthesizing unit 210 detects the point correspondence between the images due to the local feature amount, and estimates the movement amount and the deformation amount between the images using the detected point correspondence. Then, the matrix area synthesizing unit 210 moves and transforms the image according to the estimated movement amount and deformation amount, and synthesizes the image. Further, in the present embodiment, the matrix area synthesizing unit 210 changes the method of synthesizing the matrix area based on the matrix information. That is, the matrix area synthesizing unit 210 changes the display method of the matrix area based on the matrix information. The details of the method of synthesizing (displaying) the matrix area will be described later.
Any algorithm can be used as the method for synthesizing the matrix region. Further, when there is no point correspondence between images in the related matrix region, synthesis may be performed in consideration of the non-existing matrix region based on the position information of the matrix region.

As described above, the information processing apparatus 200 in the present embodiment extracts each matrix region including a plurality of objects from the images captured by the plurality of imaging devices, and information (matrix information) regarding the extracted matrix region. To get. Then, the information processing apparatus 200 performs display control to display a plurality of related matrix areas among the matrix areas extracted from the image on the display unit 204 by a display method according to the matrix information. In this way, the information processing device 200 can display the related matrix regions imaged by the plurality of image pickup devices on the display unit 204 in association with each other. Therefore, the user can easily confirm the state of the matrix existing over the imaging range of the plurality of imaging devices.

Next, the operation of the camera 100 in this embodiment will be described.
FIG. 2 is a flowchart showing an example of display control processing executed by the information processing apparatus 200. The process of FIG. 2 is started at the timing when the image pickup is started by, for example, the image pickup devices 100A and 100B. However, the start timing of the process of FIG. 2 is not limited to the above timing.
The information processing apparatus 200 can realize the process shown in FIG. 2 by reading a program required by the CPU 202 from the storage unit 203 and executing the program. However, the processing of FIG. 2 may be realized by operating at least a part of each element of the information processing apparatus 200 shown in FIG. 1 as dedicated hardware. In this case, the dedicated hardware operates under the control of the CPU 202. Hereinafter, the alphabet S shall mean a step in the flowchart.

First, in S1, the information processing device 200 acquires the first image captured by the image pickup device 100A. Next, in S2, the information processing apparatus 200 determines whether or not the matrix area is set in the first image acquired in S1, and if the matrix area is not set, the information processing apparatus 200 shifts to S3 and the matrix is set. If the area is set, the process proceeds to S4. In S3, the information processing apparatus 200 sets the matrix area in the first image acquired in S1.
In S4, the information processing device 200 acquires a second image captured by the image pickup device 100B. Here, the second image is an image captured at the same timing as the first image acquired in S1. Next, in S5, the information processing apparatus 200 determines whether or not the matrix area is set in the second image acquired in S4, and if the matrix area is not set, the information processing apparatus 200 shifts to S6 and the matrix is set. If the area is set, the process proceeds to S7. In S6, the information processing apparatus 200 sets the matrix area in the second image acquired in S4.

In S7, the information processing apparatus 200 collects information in the matrix region set in the first image and the second image, respectively. Next, in S8, the information processing apparatus 200 determines whether or not a matrix region constituting the same matrix exists in the first image and the second image, and if so, shifts to S9 and exists. If not, the process proceeds to S10. In S9, the information processing apparatus 200 synthesizes a matrix region constituting the same matrix. Next, in S10, the information processing apparatus 200 displays an image synthesized for each matrix. Finally, in S11, the information processing device 200 determines whether or not the next image captured by the image pickup devices 100A and 100B exists, and if the next image exists, returns to S1 and returns to the next image. If does not exist, the process ends.

Hereinafter, a display example of the matrix area will be specifically described.
FIG. 3 is an example of an image captured by a plurality of image pickup devices. In FIG. 3, the image 310 is an image captured by the first image pickup device, the image 320 is an image captured by the second image pickup device, and the image 330 is an image captured by the third image pickup device. Image 410 shows an image captured by the fourth image pickup device.
The first image pickup apparatus and the second image pickup apparatus capture the same matrix, and the image 310 of the first image pickup apparatus includes a matrix region 311 and a matrix region 312, and the second image pickup apparatus. The image 320 includes a matrix region 321. Matrix regions 311, 312 and 321 constitute the same queue formed by those waiting for taxi 313. Further, the third image pickup device and the fourth image pickup device capture the same matrix, and the image 330 of the third image pickup device includes the matrix area 331, and the image 340 of the fourth image pickup device includes. Includes matrix area 341. Matrix regions 331 and 341 constitute the same queue formed by those waiting for taxi 343. The image 340 of the fourth image pickup device further includes a matrix region 342. The queue area 342 constitutes a queue formed by people waiting for the taxi 344.

When the images 310 to 340 shown in FIG. 3 are imaged by the first to fourth image pickup devices, the information processing apparatus 200 extracts the above matrix region from each image, and the extracted plurality of matrix regions Among them, the matrix areas constituting the same matrix are combined and displayed on the display unit 204.
As described above, the matrix regions 311, 312 and 321 are matrix regions constituting the same matrix. Therefore, the information processing apparatus 200 synthesizes the matrix areas 311, 312 and 321 and displays them on the display unit 204. Similarly, the information processing apparatus 200 synthesizes the matrix areas 331 and 341 and displays them on the display unit 204.
When synthesizing the matrix region, the information processing apparatus 200 may simply synthesize a plurality of matrix regions by using the point correspondence between the images. That is, a plurality of matrix regions constituting the same matrix may be arranged and displayed so as to correspond to the positions of the actual matrix. Further, the information processing apparatus 200 may change the method of synthesizing the matrix area based on the matrix information of the matrix area to be synthesized.

FIG. 4 is an example of a display screen 400 that displays a matrix area. The display screen 400 is a screen displayed on the display unit 204 of the information processing apparatus 200.
The matrix 401 is a matrix obtained by synthesizing the matrix regions 311, 312 and 321 of FIG. This matrix 401 is a composite of the matrix regions 311 and 312 and 321 modified so that the matrix is displayed as a straight line. Here, the deformation of the image includes at least one of inversion, rotation, movement, enlargement and reduction of the image.
Specifically, the matrix 401 includes a matrix region 311A obtained by modifying the matrix region 311 of FIG. 3, a matrix region 321A obtained by modifying the matrix region 321 of FIG. 3, and a matrix region 312A obtained by modifying the matrix region 312 of FIG. including. The matrix region 311A is an image in which the matrix region 311 is inverted so that the directions of the matrices are opposite to each other. The matrix area 321A is an image in which the matrix area 321 is partially inverted and moved so that the direction of the matrix is one direction (horizontal direction in FIG. 4). Further, the matrix regions 311A, 312A and 321A are images in which the length of the matrix is reduced so that the people forming the matrix are displayed at equal intervals.

Further, the matrix region 351A between the matrix region 311A and the matrix region 321A and the matrix region 352A between the matrix region 321A and the matrix region 312A are matrix regions that do not exist in the images of the plurality of image pickup devices. These matrix regions 351A and 352A correspond to the regions 351 and 352 shown in FIG. 3, respectively, and can be generated and synthesized based on the position information of the matrix regions 311, 312 and 321.
In this way, when the directions of the plurality of related matrix regions are different from each other, the information processing apparatus 200 transforms and displays the plurality of matrix regions so as to be aligned linearly. As a result, the directions of the matrix can be aligned in one direction, and the user can easily check the length of the entire matrix. Further, at this time, the information processing apparatus 200 deforms and displays the matrix area so that the people forming the matrix are displayed at equal intervals. That is, the information processing apparatus 200 transforms a plurality of related matrix regions into lengths corresponding to the actual lengths of the matrices and displays them. As a result, the user can easily grasp the number of people waiting in line.

The matrix 402 is a matrix obtained by synthesizing the matrix regions 331 and 341 of FIG. Similar to the matrix 401, the matrix 402 is a composite of the matrix regions 331 and 341 modified so that the matrix is displayed as a straight line. Further, the matrix 402 synthesizes the matrix regions 331 and 341 by transforming them into lengths according to the waiting time of the matrix.
Specifically, the matrix 402 is composed of a matrix region 331A obtained by modifying the matrix region 331 of FIG. 3 and a matrix region 341A obtained by modifying the matrix region 341 of FIG. The matrix area 331A is an image obtained by rotating the matrix area 331 so that the direction of the matrix is one direction (left-right direction in FIG. 4) and reducing the length according to the waiting time of the matrix. The matrix area 341A is an image obtained by reducing the matrix area 341 to a length corresponding to the waiting time of the matrix.

When the waiting time per person in the queue of taxi 343 in FIG. 3 is shorter than the waiting time per person in the queue of taxi 313 or taxi 344, as shown in FIG. Narrow the interval compared to other matrices. As a result, the length of the matrix 402 can be displayed shorter according to the waiting time, and it is possible to show the user that the waiting time of the taxi 343 is small. That is, the user can properly grasp the waiting time regardless of the length of the matrix.
The matrix 403 is composed of the matrix region 342A. Since the matrix region 342 of FIG. 3 does not have any other related matrix region, the composition is not performed and the matrix region 342 is displayed as it is as the matrix region 342A.

As described above, the information processing apparatus 200 in the present embodiment extracts a matrix region including a plurality of objects from the images captured by each of the plurality of imaging devices, and information about the extracted matrix region (matrix information). ). Then, the information processing apparatus 200 causes the display unit 204 to display a plurality of related matrix areas among the extracted matrix areas by a display method according to the matrix information.
As described above, when the related matrix exists over the imaging range of the plurality of imaging devices, the information processing apparatus 200 appropriately arranges and displays the images of the matrix captured by the plurality of imaging devices. Can be done. Therefore, the user can easily confirm the matrix imaged by the plurality of image pickup devices. Here, the related matrix can be, for example, one matrix formed by a plurality of people waiting for a taxi at the same taxi stand. As a result, the user can easily grasp the whole image of the same matrix imaged by a plurality of image pickup devices.

Further, the information processing apparatus 200 synthesizes a plurality of related matrix regions among the extracted plurality of matrix regions, and displays the combined image on the display unit 204. In this way, the information processing apparatus 200 combines and displays images of a plurality of related matrix regions into one image, so that the user can easily and appropriately confirm the matrix captured by the plurality of imaging devices. can do.
Here, the matrix information includes information regarding at least one of the position of the matrix, the direction of the matrix, the length of the matrix, and the waiting time of the matrix. Therefore, the information processing apparatus 200 can appropriately display the state of the matrix such as the length of the matrix and the waiting time in a form that can be easily confirmed by the user.

Specifically, the information processing apparatus 200 can arrange and display a plurality of related matrix regions corresponding to the actual matrix positions based on the matrix position information. Further, the information processing apparatus 200 can also deform and display a plurality of related matrix regions so as to be aligned linearly based on the direction of the matrix. Further, the information processing apparatus 200 can also display a plurality of related matrix regions by transforming them into lengths corresponding to the lengths of the matrices. Further, the information processing apparatus 200 can also display a plurality of related matrix areas by transforming them into lengths corresponding to the waiting time of the matrix.
Therefore, even if the actual matrix has a complicated shape, the user can easily grasp the length of the matrix. The user can also keep track of the queue wait time, regardless of the actual length of the matrix.

Further, the information processing apparatus 200 sets and extracts the matrix area by displaying the images captured by the plurality of imaging devices on the display unit 204 and accepting the setting of the matrix area in the displayed image from the user. You may do so. In this case, the matrix area can be appropriately extracted from the image. Further, since the information processing apparatus 200 extracts the matrix area designated by the user, the matrix that the user wants to confirm can be displayed, and the display control according to the user's request becomes possible.

(Modification example)
In the above embodiment, a case will be described in which a plurality of related matrix regions among the matrix regions extracted from images captured by a plurality of image pickup devices are combined and displayed by a synthesis method according to the matrix information. did. However, it is also possible not to combine a plurality of related matrix areas into one image, but to display the plurality of matrix areas by a display method according to the matrix information. For example, a plurality of matrix areas may be deformed based on the matrix information and displayed close to each other.
Further, in the above embodiment, as shown in FIG. 4, the case where only the image of the matrix is displayed on the display screen 400 has been described, but the matrix information may be displayed together with the image of the matrix. In that case, the user may be able to select the matrix information to be displayed on the display screen 400.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100A, 100B ... Imaging device, 200 ... Information processing device, 201 ... Communication unit, 202 ... CPU, 203 ... Storage unit, 204 ... Display unit, 205 ... Input unit, 206 ... Matrix area setting unit, 207 ... Matrix information management unit , 208 ... Matrix area extraction unit, 209 ... Matrix synthesis judgment unit, 210 ... Matrix area synthesis unit, 300 ... Network

Claims (11)

An extraction means for extracting a matrix region containing a plurality of objects from an image captured by a plurality of imaging means, respectively.
An acquisition means for acquiring information about the matrix region extracted by the extraction means, and an acquisition means.
It is characterized by comprising a display control means for displaying a plurality of related matrix areas among the matrix areas extracted by the extraction means on a display device by a display method according to the information acquired by the acquisition means. Information processing device. Further, a synthesis means for synthesizing a plurality of related matrix regions among the plurality of matrix regions extracted by the extraction means is provided.
The display control means is
The information processing device according to claim 1, wherein an image synthesized by the synthesis means is displayed on the display device. The information processing apparatus according to claim 1 or 2, wherein the information regarding the matrix region includes information regarding at least one of the position of the matrix, the direction of the matrix, the length of the matrix, and the waiting time of the matrix. The display control means is
The information processing apparatus according to claim 3, wherein a plurality of related matrix regions are arranged and displayed so as to correspond to the actual matrix positions, based on the information regarding the matrix positions. The display control means is
The information processing apparatus according to claim 3 or 4, wherein the plurality of related matrix regions are deformed and displayed so as to be aligned linearly based on the information regarding the direction of the matrix. The display control means is
Any of claims 3 to 5, wherein a plurality of matrix regions having the relationship are transformed into a length corresponding to the length of the matrix and displayed based on the information regarding the length of the matrix. The information processing apparatus according to item 1. The display control means is
Any of claims 3 to 6, wherein a plurality of related matrix regions are transformed into a length corresponding to the waiting time of the matrix and displayed based on the information regarding the waiting time of the matrix. The information processing apparatus according to item 1. A second display control means for displaying an image captured by each of the plurality of image pickup means on the display device is further provided.
The extraction means is
The information processing apparatus according to any one of claims 1 to 7, wherein the setting of the matrix area in the image displayed by the second display control means is accepted and the matrix area is extracted. A step of extracting a matrix region containing a plurality of objects from an image captured by a plurality of imaging means, respectively.
Steps to acquire information about the extracted matrix area, and
An information processing method comprising: displaying a plurality of related matrix regions among the extracted matrix regions on a display device by a display method according to information regarding the matrix regions. The information processing apparatus according to any one of claims 1 to 8.
A plurality of image pickup devices each having the image pickup means and connected to the information processing device via a network, and
A display system including the information processing device and the display device connected via a network. A program for making a computer function as each means of the information processing apparatus according to any one of claims 1 to 8.

Images