JP2022102710A - Information processing device and information processing method - Google Patents

Abstract

To provide an information processing device and an information processing method, capable of improving accuracy of passenger information.SOLUTION: An information processing device according to one aspect of the embodiment includes a first detection unit, a second detection unit and a storage processing unit. The first detection unit is configured to be able to detect passenger information on passengers in a vehicle on the basis of an image captured by a first camera provided in a loading port of the vehicle. The second detection unit is configured to be able to detect passenger information on passengers in the vehicle on the basis of an image captured by a second camera provided in the loading port of the vehicle. The storage processing unit, when the passenger information is detected by each of the first detection unit and the second detection unit, allows the storage unit to store the passenger information detected based on the captured image of one of the first camera and the second camera, which has more favorable imaging conditions.SELECTED DRAWING: Figure 1A

Description

The present invention relates to an information processing apparatus and an information processing method.

Conventionally, various techniques for calculating the number of passengers getting on and off a vehicle such as a bus have been proposed (see, for example, Patent Document 1). In the prior art, cameras are installed at the entrance and the exit, respectively, and the number of passengers (number of passengers) is calculated using the images of the passengers captured by the cameras.

Japanese Unexamined Patent Publication No. 2014-219913

By the way, there is a technique for detecting passenger information about a passenger, such as the age and gender of the passenger, based on the above-mentioned captured image of the passenger. However, there is room for improvement in the prior art in terms of improving the accuracy of such passenger information.

The present invention has been made in view of the above, and an object of the present invention is to provide an information processing apparatus and an information processing method capable of improving the accuracy of passenger information.

In order to solve the above problems and achieve the object, the present invention includes a first detection unit, a second detection unit, and a storage processing unit in the information processing apparatus. The first detection unit is configured to be able to detect passenger information about the passengers of the vehicle based on the captured image captured by the first camera provided at the entrance of the vehicle. The second detection unit is configured to be able to detect the passenger information regarding the passenger based on the captured image captured by the second camera provided at the exit of the vehicle. When the passenger information is detected by the first detection unit and the second detection unit, respectively, the storage processing unit obtains an image captured by one of the first camera and the second camera, which has an advantageous imaging condition. The passenger information detected based on the above is stored in the storage unit.

According to the present invention, the accuracy of passenger information can be improved.

FIG. 1A is a diagram showing an outline of an information processing method according to an embodiment. FIG. 1B is a diagram for explaining passenger information stored in the storage unit. FIG. 2 is a block diagram showing a configuration example of an information processing system including a bus terminal device. FIG. 3 is a block diagram showing a configuration example of the entrance terminal device. FIG. 4 is a diagram showing an example of passenger information. FIG. 5 is a diagram showing an example of imaging status information. FIG. 6 is a block diagram showing a configuration example of the exit terminal device. FIG. 7 is a diagram showing an example of passenger information. FIG. 8 is a diagram showing an example of imaging status information. FIG. 9 is a block diagram showing a configuration example of the management server. FIG. 10 is a diagram showing an example of a processing sequence executed by the information processing system. FIG. 11 is a flowchart showing a processing procedure executed by the bus terminal device according to the modified example.

Hereinafter, embodiments of the information processing apparatus and information processing method disclosed in the present application will be described in detail with reference to the accompanying drawings. The present invention is not limited to the embodiments shown below.

(Embodiment)
<Outline of information processing method by information processing device>
Hereinafter, the outline of the information processing method by the information processing apparatus according to the embodiment will be described with reference to FIG. 1A and the like. FIG. 1A is a diagram showing an outline of an information processing method according to an embodiment.

The information processing method according to the embodiment can perform, for example, a process of detecting passenger information about passengers of a vehicle and storing it in a storage unit, a process of calculating the number of passengers, and the like. In the following, the bus 1 will be described as an example of the vehicle, but the type of the vehicle is not limited to this. That is, the vehicle may be another type of vehicle, such as a railroad vehicle, an aircraft, or a ship.

As shown in FIG. 1A, a bus terminal device 10 is mounted on the bus 1, and the bus terminal device 10 functions as an information processing device. Specifically, the bus terminal device 10 includes an entrance terminal device 10a and an exit terminal device 10b.

The entrance terminal device 10a is installed at the entrance 2a of the bus 1. The entrance terminal device 10a includes a first camera 11a. For example, the first camera 11a is the entrance 2a of the bus 1 and is provided in the bus 1 (inside the bus) to capture a passenger image of a passenger who is a passenger on the bus 1. .. The entrance terminal device 10a can detect the occupant by detecting the face information from the occupant captured image.

The exit terminal device 10b is installed at the exit 2b of the bus 1. The exit terminal device 10b includes a second camera 11b. For example, the second camera 11b is provided at the exit 2b of the bus 1 and is provided in the bus 1 (inside the bus), and captures an image captured by the disembarking passenger who is a passenger disembarking from the bus 1. .. The exit terminal device 10b can detect a person getting off by detecting face information from the image captured by the person getting off the vehicle.

Then, the bus terminal device 10 can calculate the number of passengers based on the passenger information about the passenger detected by the entrance terminal device 10a and the passenger information about the passenger detected by the exit terminal device 10b. .. The calculation of the number of passengers will be described later.

By the way, the above-mentioned passenger information includes various information about passengers such as the age and gender of passengers, the bus stop where they got on, and the bus stop where they got off. Therefore, the bus terminal device 10 stores such passenger information, and the bus operator can take various appropriate measures regarding the bus 1 by analyzing the passenger information stored in the bus terminal device 10. can. For example, the bus operator may change the content of the in-vehicle advertisement or the content of the in-vehicle announcement according to the passenger information, or adjust the operation plan according to the passenger information to operate the bus 1 efficiently. It can be performed.

However, there is room for improvement in the prior art in terms of improving the accuracy of passenger information. Specifically, in the prior art, the entrance terminal device 10a detects passenger information (hereinafter, may be referred to as "first passenger information") based on the passenger captured image of the first camera 11a. The exit terminal device 10b detects passenger information (hereinafter, may be referred to as "second passenger information") based on the image captured by the person getting off the second camera 11b. In the prior art, the above-mentioned first passenger information is stored in the storage unit 30b, and then the information lacking in the first passenger information (for example, the information of the stop where the passenger got off) is supplemented with the second passenger information. Was there.

Here, although the imaging conditions are different between the first camera 11a and the second camera 11b described above, the conventional technique does not consider the difference in the imaging conditions, and as a result, the accuracy of passenger information may be deteriorated. was there.

Therefore, the bus terminal device (information processing device) 10 according to the present embodiment is configured so as to be able to improve the accuracy of passenger information.

Specifically, the entrance terminal device 10a of the bus terminal device 10 first acquires a passenger image taken by a passenger (passenger) getting on the bus 1 from the first camera 11a (step S1). ..

Next, the entrance terminal device 10a detects the first passenger information based on the passenger image captured by the first camera 11a (step S2). Next, the entrance terminal device 10a outputs the detected first passenger information to the exit terminal device 10b (step S3).

The exit terminal device 10b stores the first passenger information output from the entrance terminal device 10a in the storage unit 30b (step S4).

Next, the exit terminal device 10b acquires a captured image of a passenger (getting off) getting off from the bus 1 from the second camera 11b (step S5). Next, the second passenger information is detected based on the image captured by the getting-off person captured by the second camera 11b (step S6).

Here, the exit terminal device 10b stores the detected second passenger information in the storage unit 30b, but at that time, in the present embodiment, the difference in the imaging conditions between the first camera 11a and the second camera 11b. I tried to memorize it according to.

First, the imaging conditions of the cameras 11a and 11b will be specifically described. The first camera 11a is located at a position that does not interfere with boarding at the entrance 2a, for example, a lower position that is not used at the handrail of the entrance 2a. Will be installed. Further, since the passenger gets on the stairs of the entrance 2a, for example, the head easily moves in the vertical direction and the horizontal direction. Therefore, it may be difficult for the first camera 11a to capture a passenger's face or the like from the front, and it may be difficult to obtain face information. Further, since the first camera 11a captures images from the inside of the vehicle to the outside of the vehicle, it is also affected by the external environment, for example, the passenger's face in the passenger's captured image becomes dark and it becomes difficult to obtain face information due to backlight or the like. Cheap. Due to these various factors, it can be said that the imaging conditions of the first camera 11a are relatively disadvantageous.

On the other hand, since the second camera 11b only needs to be able to capture an image of a passenger moving to the exit 2b, the second camera 11b can be installed near the height of the passenger's face, for example, so as to face the inside of the vehicle from the exit 2b. Further, since the passenger only moves in the vehicle toward the exit 2b, for example, the head often does not move much in the vertical direction or the horizontal direction. Therefore, the second camera 11b can easily capture a passenger's face or the like from the front, and can easily obtain face information. Further, since the second camera 11b is installed in the vehicle and takes an image toward the inside of the vehicle, it is not easily affected by the above-mentioned external environment. Therefore, it can be said that the imaging conditions of the second camera 11b are more advantageous than the imaging conditions of the first camera 11a.

Therefore, the accuracy of the second passenger information detected based on the captured image of the second camera 11b in which the imaging condition is advantageous is the first passenger information detected based on the captured image of the first camera 11a in which the imaging condition is unfavorable. Is likely to be higher than the accuracy of.

Therefore, the exit terminal device 10b according to the present embodiment preferentially stores the second passenger information, which is more accurate than the first passenger information, in the storage unit 30b. Specifically, the exit terminal device 10b is one of the first camera 11a and the second camera 11b, which has an advantageous imaging condition when the first passenger information and the second passenger information are detected (here, the second camera). The passenger information (second passenger information) detected based on the captured image of 11b) is stored in the storage unit 30b (step S7).

The process of step S7 and the like will be described in detail with reference to FIG. 1B. FIG. 1B is a diagram for explaining passenger information stored in the storage unit 30b. FIG. 1B shows the relationship between the data items included in the passenger information and the terminal device that has detected the data (information) of the corresponding data items. The contents of the data items included in the passenger information shown in FIG. 1B are merely examples and are not limited.

Further, in FIG. 1B, the left figure shows the passenger information of the storage unit 30b in which the first passenger information is stored in the process of step S4 before the second passenger information is detected, and the right figure shows the second passenger. The information is detected, and the passenger information of the storage unit 30b in which the second passenger information is stored in the process of step S7 is shown.

As shown in the left figure of FIG. 1B, the exit terminal device 10b first stores the first passenger information detected by the entrance terminal device 10a in the storage unit 30b. Since the first passenger information is information about passengers (passengers) getting on the bus 1, it does not include information on the stop where the bus got off.

After that, when the second passenger information is detected and both the first and second passenger information are detected, the exit terminal device 10b takes an image of one camera (here, the second camera 11b) having favorable imaging conditions. The passenger information (second passenger information) detected based on the image is stored in the storage unit 30b, in other words, the second passenger information is used for updating. It should be noted that the camera on which the above-mentioned imaging conditions and imaging conditions are advantageous is set in advance, but is not limited thereto.

As an example, as shown in the right figure of FIG. 1B, the exit terminal device 10b has an exit for the data items "age" and "gender" which are the first passenger information detected by the entrance terminal device 10a. The second passenger information detected by the terminal device 10b is overwritten.

Since the second passenger information is information about passengers (getting off) getting off from bus 1, it does not include information on the bus stop where they got on, but includes information on the bus stop where they got off. Therefore, the data item "boarding stop" remains the first passenger information, and the data item "getting off stop" stores the second passenger information.

As described above, in the present embodiment, passenger information is stored in the storage unit 30b by storing the passenger information (second passenger information) detected based on the image captured by the second camera 11b, which has favorable imaging conditions. The accuracy of can be improved.

That is, for example, if the data items "age" and "gender" are left as the first passenger information after the second passenger information is detected, the accuracy of the passenger information may decrease, as described above. By overwriting the second passenger information, which is more accurate than the first passenger information, the accuracy of the passenger information (for example, the data items "age" and "gender") can be improved.

<Information processing system configuration>
Next, the configuration of the information processing system including the bus terminal device (information processing device) 10 according to the embodiment will be described with reference to FIG. FIG. 2 is a block diagram showing a configuration example of an information processing system 100 provided with a bus terminal device 10.

As shown in FIG. 2, the information processing system 100 includes the above-mentioned bus terminal device 10, a management server 200, a bus operator terminal device 300, and a user terminal device 400, which are communication networks such as an Internet network. It is connected so that it can communicate via N.

As described above, the bus terminal device 10 includes an entrance terminal device 10a and an exit terminal device 10b. The entrance terminal device 10a and the exit terminal device 10b are connected to each other so as to be communicable via short-range wireless communication such as Wi-Fi (registered trademark), but the present invention is not limited to this, and in addition to short-range wireless communication. Alternatively, or instead, they may be connected so as to be communicable via the communication network N or the like. The detailed configuration of the entrance terminal device 10a will be described later with reference to FIG. 3 and the like. The detailed configuration of the exit terminal device 10b will be described later with reference to FIG. 6 and the like.

The management server 200 is a server device that manages passenger information including information on the number of passengers on the bus 1 transmitted from the bus terminal device 10. The management server 200 can provide passenger information and the like to the bus operator terminal device 300. Further, the management server 200 can calculate the congestion degree of the bus 1 based on the information of the number of passengers of the bus 1 and provide the congestion degree information indicating the calculated congestion degree to the user terminal device 400. The detailed configuration of the management server 200 will be described later with reference to FIG.

The bus operator terminal device 300 is a terminal device used by the bus operator that operates the bus 1. As the bus operator terminal device 300, for example, a PC (Personal Computer), a smartphone, a tablet terminal, or the like can be used, but the bus operator terminal device 300 is not limited thereto. Passenger information and the like are transmitted from the management server 200 to the bus operator terminal device 300 and displayed. As a result, the bus operator can change the content of the in-vehicle advertisement and the content of the in-vehicle announcement according to the passenger information and the like, and can make an operation plan of the bus 1 according to the passenger information and the like.

The user terminal device 400 is a terminal device used by a user who uses the bus 1, to be exact, a user who will use the bus 1 from now on. As the user terminal device 400, for example, a smartphone, a tablet terminal, a PC, or the like can be used, but the user terminal device 400 is not limited thereto. Congestion degree information of bus 1 is transmitted from the management server 200 to the user terminal device 400 and displayed. This allows the user to check, for example, the degree of congestion of the bus 1 before boarding. In FIG. 2, two user terminal devices 400 are shown for the sake of simplification of illustration, but the present invention is not limited to this, and the number may be one or three or more.

<Configuration of entrance terminal device>
Next, the configuration of the entrance terminal device 10a will be described with reference to FIG. 3 and the like. FIG. 3 is a block diagram showing a configuration example of the entrance terminal device 10a. In each block diagram including FIG. 3, only the components necessary for explaining the features of the present embodiment are represented by functional blocks, and the description of general components is omitted.

In other words, each component shown in the block diagram of FIG. 3 or the like is a functional concept and does not necessarily have to be physically configured as shown in the figure. For example, the specific form of distribution / integration of each functional block is not limited to the one shown in the figure, and all or part of it is functionally or physically distributed in any unit according to various loads and usage conditions. -It is possible to integrate and configure.

As shown in FIG. 3, the entrance terminal device 10a includes a first camera 11a, a positioning unit 12a, a control unit 20a, and a storage unit 30a. As the entrance terminal device 10a, a smartphone, a tablet terminal, or the like can be used, but the present invention is not limited to this.

The first camera 11a is a camera including, for example, a lens and an image pickup device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The first camera 11a is the entrance 2a of the bus 1 (see FIG. 1A) and is provided inside the bus 1 (inside the bus). Specifically, the first camera 11a is provided at a position where at least a range including the face of a passenger (passenger) who gets on the bus from the entrance 2a can be imaged from inside the bus. The first camera 11a captures a passenger image captured by the passenger and outputs the captured image captured by the passenger to the control unit 20a.

The positioning unit 12a acquires the position information (for example, latitude and longitude) of the bus 1. For example, the positioning unit 12a receives radio waves transmitted from a GPS (Global Positioning System) satellite, acquires the position information of the bus 1 based on the received radio waves, and outputs the acquired position information to the control unit 20a. .. The positioning unit 12a may output the position information of the bus 1 acquired when the bus 1 is stopped at the bus stop as the position information of the bus stop where the bus 1 is stopped.

The control unit 20a includes an acquisition unit 21a, a detection unit 22a, a registration unit 23a, and an output unit 24a. For example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. Includes computers with input / output ports and various circuits.

The CPU of the computer functions as the acquisition unit 21a, the detection unit 22a, the registration unit 23a, and the output unit 24a of the control unit 20a by reading and executing the program stored in the ROM, for example.

Further, at least a part or all of the acquisition unit 21a, the detection unit 22a, the registration unit 23a, and the output unit 24a of the control unit 20a are used by hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). It can also be configured.

Further, the storage unit 30a is a storage unit composed of a storage device such as a non-volatile memory or a data flash. Passenger information 31a, imaging status information 32a, various programs, and the like are stored in the storage unit 30a.

Passenger information 31a is information about passengers (passengers) who get on the bus 1. Here, the passenger information 31a will be described with reference to FIG. FIG. 4 is a diagram showing an example of passenger information 31a. As shown in FIG. 4, the passenger information 31a includes "passenger ID", "passenger image", "feature point", "gender", "age", "age group", "presence / absence of mask", and "boarding". It includes items such as "stops where you got off" and "stops where you got off", and each item is related to each other.

The "passenger ID" is identification information that identifies a passenger. The "passenger image" is information of the passenger captured image. In the example shown in FIG. 4, for convenience, the "passenger image" is described as an abstract description such as "image E01", but specific information is stored in the "image E01". Hereinafter, other information may be described in an abstract manner.

The "feature point" is the feature point information of the occupant's face captured in the image captured by the occupant, and is an example of the face information. The feature point information includes, but is not limited to, for example, the position of the feature points such as the eyes (inner corners of eyes, outer corners of eyes, etc.), nose, mouth, etc. on the passenger's face in the image captured by the passenger. ..

The "gender" is information indicating the gender of the occupant in the image captured by the occupant. The "age" is information indicating the age of the passenger in the image captured by the passenger, and the "age group" is information indicating the age group of the passenger. "Presence / absence of mask" is information indicating whether or not the passenger in the image captured by the passenger is wearing a mask. The above-mentioned information such as gender, age, age group, and presence / absence of a mask is an example of the attribute information of the passenger.

The "bus stop" is information indicating the bus stop where the passenger (passenger) boarded. The "bus stop where the passenger got off" is information indicating the bus stop where the passenger got off. Since the storage unit 30a of the entrance terminal device 10a stores information about the passengers (passengers) who get on the bus 1, the information about the bus stop where they got off is not stored.

The "first accuracy" is information indicating the accuracy of passenger information including attribute information, which is detected based on the image captured by the passenger. The "first accuracy" is calculated by, for example, the detection unit 22a, which will be described later.

In the example shown in FIG. 4, the passenger data identified by the passenger ID "P01" has a passenger image of "image E01", a feature point of "feature point F01", a gender of "male", and an age of "age G01". , The age group is "adult", the presence or absence of a mask is "none", the boarding stop is "stop H01", and the first probability is "probability I01".

Returning to the description of FIG. 3, the image pickup status information 32a is information indicating the image pickup conditions of the first camera 11a, the situation when the passenger image is captured by the first camera 11a, and the like.

Here, the imaging status information 32a will be described with reference to FIG. FIG. 5 is a diagram showing an example of imaging status information 32a. As shown in FIG. 5, the imaging status information 32a includes "status ID", "first camera installation position", "first camera installation angle", "stop", "date and time", "weather" and the like. Items are included and each item is associated with each other.

The "situation ID" is identification information that identifies the imaging status information. The “first camera installation position” is information indicating a position where the first camera 11a is installed at the entrance 2a. The "installation position of the first camera" includes, for example, information such as a place where the first camera 11a is installed (for example, a handrail in a car, a seat, etc.), a height at which the first camera 11a is installed, and the like. Not limited to.

The “first camera installation angle” is information indicating the angle at which the first camera 11a is installed. The "installation angle of the first camera" is, for example, the mounting angle of the first camera 11a with respect to the entrance 2a, but is not limited to this, and may include other information such as the angle of view of the first camera 11a.

The "bus stop" is information indicating a bus stop in which a passenger image is captured. The "date and time" and the "weather" are information indicating the date and time when the passenger image was captured and information indicating the weather, respectively.

In the example shown in FIG. 5, the image pickup status data identified by the status ID “J01” is such that the installation position of the first camera 11a is “position K01”, the installation angle of the first camera 11a is “angle L01”, and the stop is. It indicates that "stop M01", the date and time is "date and time N01", and the weather is "sunny".

The imaging conditions of the first camera 11a are "the installation position of the first camera" and "the installation angle of the first camera" among the above items, and are set (registered) in advance in the storage unit 30a. However, it is not limited to this. That is, the imaging condition of the first camera 11a may be one of "the installation position of the first camera" and "the installation angle of the first camera", "stop", "date and time", "weather" and the like. Information may be included and can be set arbitrarily.

Returning to the description of FIG. 3, the acquisition unit 21a of the control unit 20a acquires a passenger image captured by the passenger (passenger) who gets on the bus 1 from the first camera 11a. For example, the acquisition unit 21a acquires the passenger captured image when the bus 1 is stopped at the bus stop, but the acquisition timing is not limited to this. The acquisition unit 21a outputs the acquired occupant captured image to the detection unit 22a.

The detection unit 22a can detect passenger information about a passenger (passenger) based on a passenger captured image. The detection unit 22a is an example of the first detection unit.

For example, the detection unit 22a detects the face information of the passenger (passenger) (specifically, the feature point information of the face) from the image captured by the passenger. For example, the detection unit 22a extracts feature points such as eyes (inner corners of eyes, outer corners of eyes, etc.), nose, mouth, contour, etc. from the image captured by the passenger, and detects the positions of the extracted feature points as feature point information. The detection unit 22a outputs the detected feature point information to the registration unit 23a together with the passenger captured image.

The detection unit 22a detects the attribute information of the occupant from the captured image of the occupant. For example, the detection unit 22a detects attribute information such as gender, age, age group, and presence / absence of a mask based on the feature point information in the passenger captured image. Then, the detection unit 22a outputs the detected attribute information to the registration unit 23a.

In addition, the detection unit 22a can calculate the first accuracy indicating the accuracy of the passenger information including the attribute information detected based on the image captured by the passenger. For example, the detection unit 22a indicates the accuracy of the passenger information (here, the first accuracy) based on various information such as the number of feature points detected based on the passenger captured image and the sharpness of the captured image. ) Can be calculated. For example, the detection unit 22a calculates so that the first accuracy increases as the number of detected feature points increases. The detection unit 22a outputs the calculated information indicating the first accuracy to the registration unit 23a.

The above-mentioned method for detecting feature point information and attribute information and the method for calculating the accuracy of passenger information can be arbitrarily set.

The registration unit 23a registers the feature point information and the attribute information detected by the detection unit 22a, and the information indicating the calculated first accuracy in the storage unit 30a together with the passenger image as the passenger information 31a (see FIG. 4). (Remember). At this time, even if the registration unit 23a adds the information of the stop where the passenger image is captured, that is, the stop where the passenger got on, to the passenger information 31a based on the position information of the bus 1 of the positioning unit 12a. good.

Further, the registration unit 23a may register information indicating the imaging status such as the stop where the passenger captured image is captured, the date and time, and the weather as the imaging status information 32a (see FIG. 5) in the storage unit 30a. Information indicating weather and the like is acquired from an external server (not shown) and registered, but is not limited to this.

The output unit 24a accesses the storage unit 30a and outputs the passenger information 31a to the exit terminal device 10b. The output unit 24a executes the output process from the time when the bus 1 departs from the bus stop and the registration process or the like at the registration unit 23a is completed until the bus 1 arrives at the next bus stop. Not limited to.

<Configuration of exit terminal device>
Next, the configuration of the exit terminal device 10b will be described with reference to FIG. 6 and the like. FIG. 6 is a block diagram showing a configuration example of the exit terminal device 10b.

As shown in FIG. 6, the exit terminal device 10b includes a second camera 11b, a positioning unit 12b, a control unit 20b, and a storage unit 30b. As the exit terminal device 10b, a smartphone, a tablet terminal, or the like can be used, but the exit terminal device 10b is not limited to this.

The second camera 11b is a camera including, for example, a lens and an image pickup element such as a CCD or CMOS. The second camera 11b is the exit 2b of the bus 1 (see FIG. 1A) and is provided inside the bus 1 (inside the bus). Specifically, the second camera 11b is provided at a position where at least a range including the face of a disembarking person (passenger) getting off from the exit 2b can be imaged from inside the bus. The second camera 11b captures an image of the person getting off the vehicle and outputs the captured image of the person getting off the vehicle to the control unit 20b.

The positioning unit 12b acquires the position information of the bus 1 based on the radio wave transmitted from the GPS satellite, for example, and outputs the acquired position information to the control unit 20b. The positioning unit 12b may output the position information of the bus 1 acquired when the bus 1 is stopped at the bus stop as the position information of the bus stop where the bus 1 is stopped.

The control unit 20b includes an acquisition unit 21b, a detection unit 22b, a collation unit 23b, a registration unit 24b, a calculation unit 25b, and a transmission unit 26b, and includes, for example, a CPU, ROM, RAM, input / output port, and the like. Includes computers and various circuits.

The CPU of the computer functions as, for example, the acquisition unit 21b, the detection unit 22b, the collation unit 23b, the registration unit 24b, the calculation unit 25b, and the transmission unit 26b of the control unit 20b by reading and executing the program stored in the ROM. do.

Further, at least a part or all of the acquisition unit 21b, the detection unit 22b, the collation unit 23b, the registration unit 24b, the calculation unit 25b, and the transmission unit 26b of the control unit 20b may be configured by hardware such as ASIC or FPGA. can.

Further, the storage unit 30b is a storage unit composed of a storage device such as a non-volatile memory or a data flash. Passenger information 31b, image pickup status information 32b, boarding / alighting counter 33b, various programs, and the like are stored in the storage unit 30b.

Passenger information 31b is information about passengers (including passengers and disembarking passengers) who get on the bus 1. Here, the passenger information 31b will be described with reference to FIG. 7. FIG. 7 is a diagram showing an example of passenger information 31b. As shown in FIG. 7, the passenger information 31b includes "passenger ID", "getting off person image", "characteristic point", "gender", "age", "age group", "presence / absence of mask", and "boarding". Items such as "stopped", "stopped off", "history information" and "second accuracy" are included, and each item is associated with each other.

The "passenger ID" is identification information that identifies a passenger. In addition, in FIG. 7, it is shown that the passenger whose passenger ID is "P01" is the same person (same passenger) as the passenger whose passenger ID is "P01" in the passenger information 31a shown in FIG.

The "get-off person image" is information of the get-off person captured image. The "feature point" is the feature point information of the face. The feature point information includes, but is not limited to, for example, the positions of feature points such as eyes, nose, and mouth on the face of the disembarkator in the image captured by the disembarkant.

The "gender" is information indicating the gender of the disembarking person in the image captured by the disembarking person. The "age" is information indicating the age of the disembarking person in the image captured by the disembarking person, and the "age group" is information indicating the age group of the disembarking person. "Presence / absence of mask" is information indicating whether or not the disembarkation person in the image taken by the disembarkation person is wearing a mask.

The "bus stop" is information indicating the bus stop on which the passenger boarded. The "bus stop where the passenger got off" is information indicating the bus stop where the passenger (the person who got off) got off.

The "history information" is history information indicating passenger information before the update. Specifically, as described above, the storage unit 30b of the exit terminal device 10b stores the first passenger information detected based on the passenger image, and then the second passenger based on the passenger image. When the information is detected, the second passenger information is preferentially stored, that is, the passenger information 31b is updated (see FIG. 1B). The above-mentioned "history information" is information indicating passenger information before update, and more specifically, information indicating overwritten first passenger information (update history information).

It is assumed that the history information includes all or part of the overwritten first passenger information. That is, for example, in the history information "history Q01", the feature point is "feature point F01", the gender is "male", the age is "age G01", the age group is "adult", and the presence or absence of a mask is "none". It is assumed that the first passenger information including the attribute information of is included.

The "second accuracy" is information indicating the accuracy of the passenger information including the attribute information detected based on the image captured by the person getting off the vehicle. The "second accuracy" is calculated by, for example, the detection unit 22b, which will be described later.

In the example shown in FIG. 7, the data of the disembarkation person identified by the disembarkation person ID "Q01" is "image E11" for the disembarkation person image, "feature point F11" for the feature point, "male" for the gender, and "male" for the age. "Age G11", age group is "adult", presence or absence of mask is "none", boarding stop is "stop H01", getting off stop is "stop H11", history information is "history Q01", second accuracy is "stop H01" It shows that the accuracy is R01.

Returning to the description of FIG. 6, the image pickup status information 32b is information indicating the image pickup conditions of the second camera 11b, the situation when the disembarkation person image captured image is captured by the second camera 11b, and the like.

Here, the image pickup status information 32b will be described. FIG. 8 is a diagram showing an example of the imaging status information 32b. As shown in FIG. 8, the imaging status information 32b includes "status ID", "second camera installation position", "second camera installation angle", "stop", "date and time", "weather", and the like. Items are included and each item is associated with each other.

The "situation ID" is identification information that identifies the imaging status information. The "second camera installation position" is information indicating a position where the second camera 11b is installed at the exit 2b. The "installation position of the second camera" includes information such as the place where the second camera 11b is installed (for example, a handrail in a car, a seat, etc.), the height at which the second camera 11b is installed, and the like. Not limited to.

The “second camera installation angle” is information indicating the angle at which the second camera 11b is installed. The "installation angle of the second camera" is, for example, the mounting angle of the second camera 11b with respect to the exit 2b, but is not limited to this, and may include other information such as the angle of view of the second camera 11b.

The "bus stop" is information indicating the bus stop where the image of the person getting off the bus is captured. The "date and time" and the "weather" are information indicating the date and time when the image taken by the person getting off the vehicle was captured, and information indicating the weather, respectively.

In the example shown in FIG. 8, the image pickup status data identified by the status ID “S01” is such that the installation position of the second camera 11b is “position T01”, the installation angle of the second camera 11b is “angle U01”, and the stop is. It indicates that "stop M01", the date and time is "date and time N01", and the weather is "sunny".

The imaging conditions of the second camera 11b are "the installation position of the second camera" and "the installation angle of the second camera" among the above items, and are set (registered) in advance in the storage unit 30a. However, it is not limited to this. That is, the imaging condition of the second camera 11b may be one of "the installation position of the second camera" and "the installation angle of the second camera", "stop", "date and time", "weather" and the like. Information may be included and can be set arbitrarily.

Returning to the description of FIG. 6, the boarding / alighting counter 33b is a counter that counts the current number of passengers on the bus 1.

The acquisition unit 21b of the control unit 20b acquires the passenger information (first passenger information) output from the entrance terminal device 10a, and outputs the acquired first passenger information to the registration unit 24b. The registration unit 24b registers the first passenger information in the storage unit 30b as passenger information 31a (see FIG. 7). The acquisition unit 21b may register the first passenger information in the storage unit 30b.

Further, the acquisition unit 21b acquires an image captured by the passenger (getting off) getting off from the bus 1 from the second camera 11b. For example, the acquisition unit 21b acquires an image captured by a person getting off the bus when the bus 1 is stopped at a stop, but the timing of acquisition is not limited to this. The acquisition unit 21b outputs the acquired image of the person getting off the vehicle to the detection unit 22b.

The detection unit 22b can detect passenger information about passengers (getting off) based on the captured image of the getting off. The detection unit 22b is an example of the second detection unit.

For example, the detection unit 22b detects the face information (specifically, the feature point information of the face) of the passenger (getting off) from the image captured by the getting off person. For example, the detection unit 22b extracts feature points such as eyes, nose, mouth, and contour from the image captured by the person getting off the vehicle, and detects the positions of the extracted feature points as feature point information. The detection unit 22a outputs the detected feature point information to the collation unit 23b and the registration unit 24b together with the image captured by the person getting off the vehicle.

The detection unit 22b detects the attribute information of the disembarking person from the captured image of the disembarking person. For example, the detection unit 22a detects attribute information such as gender, age, age group, and presence / absence of a mask based on the feature point information in the image of the person getting off the vehicle. Then, the detection unit 22a outputs the detected attribute information to the collation unit 23b and the registration unit 23a.

Further, the detection unit 22b can calculate a second accuracy indicating the accuracy of the passenger information including the attribute information detected based on the image captured by the person getting off the vehicle. For example, the detection unit 22b can calculate the second accuracy of the passenger information based on various information such as the number of feature points detected based on the image captured by the getting-off person. For example, the detection unit 22b calculates so that the second accuracy increases as the number of detected feature points increases. The detection unit 22b outputs the calculated information indicating the second accuracy to the registration unit 24b.

The collation unit 23b collates the passenger information, which is the first passenger information stored in the storage unit 30b, with the second passenger information detected by the detection unit 22b. Specifically, the collating unit 23b collates whether or not the passenger indicated by the first passenger information and the disembarking passenger indicated by the second passenger information are the same passenger.

For example, the collation unit 23b collates whether or not the characteristic point information and attribute information of the passenger in the second passenger information match or substantially match the characteristic point information and attribute information of the passenger in the first passenger information. .. In the collation unit 23b, when the feature point information of the disembarkator matches or substantially matches the feature point information of the passenger, the passenger indicated by the first passenger information and the disembarkator indicated by the second passenger information are the same. The collation result indicating that the passenger is a passenger is output to the registration unit 24b.

When the collation result indicating that the disembarking person indicated by the second passenger information is the same passenger as the passenger indicated by the first passenger information is input, the registration unit 24b stores the second passenger information in the storage unit 30b. Register (store) as 31b (see FIG. 7). The registration unit 24b is an example of a storage processing unit.

In other words, for example, when the first passenger information and the second passenger information are detected for the same passenger, the registration unit 24b is one of the first camera 11a and the second camera 11b, which has an advantageous imaging condition (here, the first camera). Passenger information (second passenger information) detected based on the captured image of the 2 camera 11b) is stored in the storage unit 30b. In other words, the registration unit 24b updates the first passenger information stored in the storage unit 30b with the second passenger information detected based on the image captured by the disembarkator of the second camera 11b, which has favorable imaging conditions. (Overwrite).

As described above, in the present embodiment, passenger information is stored in the storage unit 30b by storing the passenger information (second passenger information) detected based on the image captured by the second camera 11b, which has favorable imaging conditions. The accuracy of can be improved. That is, by overwriting the passenger information of the storage unit 30b with the second passenger information having higher accuracy than the first passenger information as described above, the accuracy of the passenger information of the storage unit 30b can be improved.

Further, when the registration unit 24b stores the second passenger information including the feature point information and the attribute information in the storage unit 30b, the registration unit 24b stores the calculated second accuracy information in the storage unit 30a together with the disembarkation person captured image. Register as 31b (see FIG. 7). Further, the registration unit 24b may add to the passenger information 31b the information of the stop where the image of the disembarking person is captured, that is, the stop where the disembarking person got off, based on the position information of the bus 1 of the positioning unit 12b. ..

Further, the registration unit 24b may store the passenger information (first passenger information) before the update in the storage unit 30b as history information. Specifically, the registration unit 24b is of a camera (here, the first camera 11a) different from one of the first camera 11a and the second camera 11b, which has an advantageous image pickup condition (here, the second camera 11b). An image captured by one camera (second camera 11b) (image captured by a passenger) with respect to a storage unit 30b that stores passenger information (first passenger information) detected based on an captured image (image captured by a passenger). When the passenger information (second passenger information) detected based on the above is stored and updated, the passenger information (first passenger information) before the update may be stored in the storage unit 30b as history information.

By storing the history information in the storage unit 30b in this way, for example, it is possible to improve the imaging conditions of the first camera 11a. That is, for example, the registration unit 24b calculates the difference between the passenger information (second passenger information) and the history information (first passenger information) stored in the storage unit 30b, and the calculated difference is set in advance. If it is equal to or more than the value, a notification may be output to the effect that the installation position of the first camera 11a may not be appropriate. The information used as the above-mentioned difference can be arbitrarily set, and as an example, the difference between the first accuracy and the second accuracy can be used. Further, the predetermined value is set to a value indicating that the first passenger information and the second passenger information are relatively largely different from each other, but the present invention is not limited to this, and any value can be set.

Specifically, when there is a relatively large difference between the first passenger information and the second passenger information, in other words, when the first passenger information deviates from the highly accurate second passenger information. There is a possibility that the installation position and installation angle of the first camera 11a are not appropriate. Therefore, in this implementation, by storing the history information in the storage unit 30b, it is possible to output the above-mentioned notification and the like. Then, for example, the bus operator can appropriately change the installation position, installation angle, etc. of the first camera 11a in response to the notification, and as a result, the imaging conditions of the first camera 11a can be improved. can.

Conversely, if there is no relatively large difference between the first passenger information and the second passenger information, in other words, it seems that the first passenger information does not deviate from the highly accurate second passenger information. In this case, it is possible to estimate that the installation position, installation angle, and the like of the first camera 11a are appropriate.

Further, the registration unit 23a may register information indicating the imaging status such as the stop where the disembarking person's captured image was captured, the date and time, and the weather as the imaging status information 32b (see FIG. 5) in the storage unit 30b.

By storing the image pickup status information 32a of the first camera 11a, the image pickup status information 32b of the second camera 11b, and the like in this way, for example, there is a relatively large difference between the first passenger information and the second passenger information. If there is no such camera, it is possible to estimate that the current installation position, installation angle, date and time, weather, and the like of each camera 11a and 11b are appropriate.

Further, by storing the history information in the storage unit 30b, it is possible to confirm the change in the behavior of the passenger, for example, the passenger who got on without the mask wears the mask and gets off.

The calculation unit 25b calculates the number of passengers on the bus 1 based on the passenger information 31b and the like. For example, the calculation unit 25b adds one passenger number when the first passenger information including the passenger's face information and attribute information is newly registered in the passenger information 31b, and specifically increments the boarding / alighting counter 33b. do.

Further, when the second passenger information including the information of the disembarking person who matches or substantially matches the feature point information and the attribute information of the passenger is registered in the passenger information 31b, the calculation unit 25b obtains the feature point information and the like. It is estimated that the passengers got off the bus 1, and the value obtained by subtracting one person from the number of passengers is calculated as the current number of passengers on the bus 1. Specifically, the boarding / alighting counter 33b is decremented.

The calculation unit 25b executes the calculation process until the bus 1 departs from one stop and arrives at the next stop, but the timing of the calculation is not limited to this.

The transmission unit 26b transmits passenger information including a part or all of the passenger information 31b and information on the number of passengers on the bus 1, which is the value of the boarding / alighting counter 33b, to the management server 200.

The transmission unit 26b executes the transmission process from the time when the bus 1 departs from the bus stop and the calculation process or the like in the calculation unit 25b is completed until the bus 1 arrives at the next stop. Not limited to.

<Management server configuration>
Next, the configuration of the management server 200 will be described with reference to FIG. FIG. 9 is a block diagram showing a configuration example of the management server 200.

As shown in FIG. 9, the management server 200 includes a communication unit 201, a control unit 210, and a storage unit 220. The communication unit 201 is a communication interface that connects to the communication network N so as to be capable of bidirectional communication, and transmits / receives information to / from the bus terminal device 10, the bus operator terminal device 300, the user terminal device 400, and the like.

The control unit 210 includes an acquisition unit 211, a congestion degree calculation unit 212, and a provision unit 213, and includes, for example, a computer having a CPU, ROM, RAM, input / output ports, and various circuits.

The CPU of the computer functions as the acquisition unit 211, the congestion degree calculation unit 212, and the provision unit 213 of the control unit 210, for example, by reading and executing the program stored in the ROM.

Further, at least a part or all of the acquisition unit 211, the congestion degree calculation unit 212, and the provision unit 213 of the control unit 210 may be configured by hardware such as ASIC or FPGA.

Further, the storage unit 220 is a storage unit composed of a storage device such as a non-volatile memory or a data flash. Passenger information 221 and bus information 222, various programs, and the like are stored in the storage unit 220.

The passenger information 221 is information about the passengers of the bus 1 transmitted from the exit terminal device 10b. As described above, the passenger information 221 includes a part or all of the passenger information 31b and information on the number of passengers on the bus 1, which is the value of the boarding / alighting counter 33b.

Bus information 222 is information about bus 1. The bus information 222 includes, for example, capacity information indicating the capacity of the bus 1, but is not limited to this, and may include other information such as operation plan information of the bus 1. The bus information 222 is stored in the storage unit 220 in advance, but is not limited to this, and may be transmitted from an external terminal such as the bus operator terminal device 300 and stored in the storage unit 220.

The acquisition unit 211 of the control unit 210 acquires the information transmitted from the exit terminal device 10b, and stores the acquired information in the storage unit 220 as passenger information 221.

The congestion degree calculation unit 212 calculates the congestion degree of the bus 1, specifically, the current congestion degree of the bus 1. The degree of congestion is an index value indicating the degree of congestion of the bus 1, and is a value indicated in several levels according to, for example, the number of passengers with respect to the capacity of the bus 1.

For example, the congestion degree calculation unit 212 determines the current congestion degree of the bus 1 based on the information on the current number of passengers of the bus 1 included in the passenger information 221 and the capacity information of the bus 1 included in the bus information 222. calculate. The congestion degree calculation unit 212 outputs the congestion degree information indicating the calculated congestion degree to the provision unit 213.

The providing unit 213 can provide such congestion degree information to, for example, a user terminal device 400 or a bus operator terminal device 300 via the communication unit 201. Further, the providing unit 213 can provide the passenger information 221 to, for example, the bus operator terminal device 300 via the communication unit 201.

<Control processing of the information processing system according to the embodiment>
Next, a processing procedure executed by the information processing system 100 including the bus terminal device 10 according to the embodiment will be described with reference to FIG. FIG. 10 is a diagram showing an example of a processing sequence executed by the information processing system 100 including the bus terminal device 10 according to the embodiment.

As shown in FIG. 10, first, the entrance terminal device 10a acquires a passenger captured image from the first camera 11a (step S10). Next, the entrance terminal device 10a detects passenger information (first passenger information) based on the image captured by the passenger (step S11). Next, the entrance terminal device 10a registers the detected passenger information in the storage unit 30a (step S12).

Then, the entrance terminal device 10a outputs the detected passenger information to the exit terminal device 10b (step S13).

The exit terminal device 10b registers the passenger information output from the entrance terminal device 10a in the storage unit 30b (step S14). Next, the exit terminal device 10b acquires an image captured by the person getting off the vehicle from the second camera 11b (step S15). Next, the exit terminal device 10b detects passenger information (second passenger information) based on the image captured by the getting-off person (step S16).

Next, the exit terminal device 10b collates the passenger information (first passenger information) stored in the storage unit 30a with the passenger information (second passenger information) detected based on the image captured by the disembarking person (step). S17). For example, in the exit terminal device 10b, the feature point information and the attribute information of the disembarkator in the second passenger information detected based on the image captured by the disembarkator are stored in the storage unit 30a of the passenger in the first passenger information. It is collated whether or not it matches or substantially matches the feature point information and attribute information.

Next, when the exit terminal device 10b is a collation result indicating that the disembarking person indicated by the second passenger information is the same passenger as the passenger indicated by the first passenger information, the second passenger information is stored in the storage unit 30b. Register (update) as passenger information (step S18).

Next, the exit terminal device 10b calculates the number of passengers on the bus 1 based on passenger information and the like (step S19). Then, the exit terminal device 10b transmits passenger information including a part or all of the passenger information, the number of passengers on the bus 1, and the like to the management server 200 (step S20).

The management server 200 calculates the degree of congestion of the bus 1 based on the information on the number of passengers of the bus 1 (step S21). Then, the management server 200 provides the congestion degree information, passenger information, and the like to the bus operator terminal device 300 and the user terminal device 400 (step S22).

As described above, the bus terminal device 10 (an example of an information processing device) according to the embodiment is registered with a detection unit 22a (an example of a first detection unit) and a detection unit 22b (an example of a second detection unit). A unit 24b (an example of a storage processing unit) is provided. The detection unit 22a is configured to be able to detect passenger information (first passenger information) regarding passengers of the vehicle based on the passenger image captured by the first camera 11a provided at the entrance 2a of the bus 1. The detection unit 22b is configured to be able to detect passenger information (second passenger information) regarding passengers based on a passenger image captured by a second camera 11b provided at the exit 2b of the bus 1. When passenger information (first and second passenger information) is detected by the detection unit 22a and the detection unit 22b, the registration unit 24b is one of the first camera 11a and the second camera 11b, which has an advantageous imaging condition. Passenger information (second passenger information) detected based on the captured image of (here, the second camera 11b) is stored in the storage unit 30b. Thereby, in the embodiment, the accuracy of passenger information can be improved.

Further, the second camera 11b is one of the cameras having favorable imaging conditions. In this way, the second camera 11b installed at the exit 2b, which can be installed at a position where the passenger's face and the like can be easily imaged from the front as compared with the entrance 2a, is a camera whose imaging conditions are advantageous. This makes it possible to reliably convert the second passenger information detected by the captured image of the second camera 11b into highly accurate information.

(Modification example)
Next, the bus terminal device 10 according to the modified example will be described. In the above-described embodiment, when the first passenger information and the second passenger information are detected, the second passenger information detected based on the captured image of the second camera 11b is stored in the storage unit 30b. In the modified example, not limited to this, when a predetermined condition is satisfied, the first passenger information is stored in the storage unit 30b instead of the second passenger information.

Specifically, as described above, since the second camera 11b has advantageous imaging conditions, the accuracy of the second passenger information detected based on the image captured by the second camera 11b is likely to be high. .. However, in the second camera 11b, there may be some changes in the imaging conditions including, for example, the weather, or the passenger may not be able to image from the front depending on the posture of the passenger. In such a case, the accuracy of the second passenger information may decrease. Therefore, in the modified example, when the accuracy of the second passenger information is lowered, the first passenger information is stored in the storage unit 30b. In other words, the second passenger information is stored in the storage unit 30b. It is prohibited to register in.

As an example, the registration unit 24b can determine whether or not to register the second passenger information in the storage unit 30b by using the first accuracy and the second accuracy. For example, the registration unit 24b compares the first accuracy, which is the accuracy of the first passenger information, with the second accuracy, which is the accuracy of the second passenger information. Then, when the comparison result between the first accuracy and the second accuracy satisfies a predetermined condition set in advance, the registration unit 24b stores the first passenger information in the storage unit 30b. The predetermined condition can be arbitrarily set, but for example, a condition such that the second accuracy is less than the first accuracy can be set.

As a result, for example, when the accuracy of the second passenger information is lowered, it is not registered in the storage unit 30b, so that it is possible to suppress the deterioration of the accuracy of the passenger information of the storage unit 30b.

Next, a specific processing procedure in the bus terminal device 10 according to the modified example will be described with reference to FIG. FIG. 11 is a flowchart showing a processing procedure executed by the bus terminal device 10 according to the modified example.

As shown in FIG. 11, the control unit 20a of the bus terminal device 10 (gateway terminal device 10a) has a first accuracy indicating the accuracy of the first passenger information detected based on the passenger image captured by the first camera 11a. Is calculated (step S100).

Next, the control unit 20b of the bus terminal device 10 (exit terminal device 10b) calculates a second accuracy indicating the accuracy of the second passenger information detected based on the image captured by the getting-off person of the second camera 11b (step). S101).

Next, the control unit 20b compares the calculated first accuracy and the second accuracy (step S102). Next, the control unit 20b determines whether or not the comparison result satisfies the above-mentioned predetermined condition (step S103).

When it is determined that the comparison result does not satisfy the predetermined condition (step S103, No), the control unit 20b stores the second passenger information detected based on the image captured by the disembarkator of the second camera 11b in the storage unit 30b. (Step S104).

On the other hand, when it is determined that the comparison result satisfies a predetermined condition (step S103, Yes), the control unit 20b stores the first passenger information detected based on the passenger image captured by the first camera 11a in the storage unit 30b. Store it (step S105).

In the above, the second camera 11b is set to be one of the cameras having favorable imaging conditions, but the present invention is not limited to this. That is, the first camera 11a may be one of the cameras having favorable imaging conditions.

Further, in the above, the entrance terminal device 10a, the exit terminal device 10b, and the management server 200 each perform various processes, but the device on which the various processes are performed is not limited to the above. ..

That is, a part or all of the processing performed by the entrance terminal device 10a may be performed by the exit terminal device 10b or the management server 200. Further, a part or all of the processing performed by the exit terminal device 10b may be performed by the entrance terminal device 10a or the management server 200. Further, a part or all of the processing performed by the management server 200 may be performed by the entrance terminal device 10a or the exit terminal device 10b.

Further effects and variations can be easily derived by those skilled in the art. For this reason, the broader aspects of the invention are not limited to the particular details and representative embodiments described and described above. Thus, various modifications can be made without departing from the spirit or scope of the overall concept of the invention as defined by the appended claims and their equivalents.

1 Bus 10 Bus terminal device 10a Exit terminal device 10b Exit terminal device 11a 1st camera 11b 2nd camera 22a Detection unit 22b Detection unit 24b Registration unit 100 Information system 200 Management server

Claims (5)

A first detection unit capable of detecting passenger information regarding passengers of the vehicle based on an image captured by a first camera provided at the entrance of the vehicle.
A second detection unit capable of detecting the passenger information regarding the passenger based on an image captured by the second camera provided at the exit of the vehicle, and a second detection unit.
When the passenger information is detected by the first detection unit and the second detection unit, respectively, it is detected based on the image captured by one of the first camera and the second camera, which has an advantageous imaging condition. An information processing device including a storage processing unit that stores passenger information in a storage unit. The storage processing unit is
An image captured by the one camera with respect to the storage unit that stores the passenger information detected based on the image captured by the other camera different from the one camera of the first camera and the second camera. The information processing apparatus according to claim 1, wherein when the passenger information detected based on the above is stored and updated, the passenger information before the update is stored in the storage unit as history information. The information processing apparatus according to claim 1 or 2, wherein the second camera is one of the cameras. The first detection unit is
The first accuracy indicating the accuracy of the passenger information detected based on the image captured by the first camera was calculated.
The second detection unit is
A second accuracy indicating the accuracy of the passenger information detected based on the image captured by the second camera was calculated.
The storage processing unit is
The first accuracy calculated by the first detection unit is compared with the second accuracy calculated by the second detection unit, and if the comparison result satisfies a predetermined condition, the other camera is different from the one camera. The information processing apparatus according to any one of claims 1 to 3, wherein the passenger information detected based on an image captured by a camera is stored in the storage unit. A first detection step capable of detecting passenger information regarding passengers of the vehicle based on an image captured by a first camera provided at the entrance of the vehicle.
A second detection step capable of detecting the passenger information regarding the passenger based on an image captured by a second camera provided at the exit of the vehicle.
When the passenger information is detected by the first detection step and the second detection step, respectively, it is detected based on the captured image of one of the first camera and the second camera, which has an advantageous imaging condition. An information processing method including a storage processing step of storing passenger information in a storage unit.

Images