JP2022079320A - Getting on and off determining device and getting on and off determining method - Google Patents

Abstract

To provide a getting on and off determining device that can accurately determine whether a person who is present near an entrance of a vehicle gets on or off the vehicle, and to provide a getting on and off determining method.SOLUTION: A getting on and off determining device includes a detection part and a determination part. The detection part detects a head position of a person who is present near an entrance of a vehicle. The determination part determines whether the person gets on or off the vehicle on the basis of the head position of the person that is detected by the detection part.SELECTED DRAWING: Figure 1

Description

The present invention relates to a boarding / alighting determination device and a boarding / alighting determination method.

Conventionally, various techniques for calculating the number of passengers getting on and off a vehicle such as a bus have been proposed (see, for example, Patent Document 1). In the prior art, cameras are installed at the entrance and the exit, respectively, and the number of passengers (number of passengers) is calculated using the images of the passengers captured by the cameras.

Japanese Unexamined Patent Publication No. 2014-219913

However, the above-mentioned captured image may include, for example, a person who is standing outside the entrance of the vehicle but does not actually get on the vehicle. In the prior art, there is a risk of erroneously determining such a person as a passenger riding a vehicle, and there is room for improvement. It should be noted that even on the exit side of the vehicle, it may be erroneously determined that a passenger who does not actually get off is disembarked from the vehicle.

The present invention has been made in view of the above, and an object of the present invention is to provide an boarding / alighting determination device and a boarding / alighting determination method capable of accurately determining boarding / alighting of a person existing near the boarding / alighting port of a vehicle. do.

In order to solve the above problems and achieve the object, the present invention includes a detection unit and a determination unit in the boarding / alighting determination device. The detection unit detects the position of the head of a person who is near the entrance / exit of the vehicle. The determination unit determines whether the person gets on and off the vehicle based on the position of the head of the person detected by the detection unit.

According to the present invention, it is possible to accurately determine the boarding / alighting of a person who exists near the boarding / alighting port of a vehicle with respect to the vehicle.

FIG. 1 is a diagram showing an outline of a boarding / alighting determination method according to an embodiment. FIG. 2 is a block diagram showing a configuration example of an information processing system including a bus terminal device. FIG. 3 is a block diagram showing a configuration example of the entrance terminal device. FIG. 4 is a diagram showing an example of passenger information. FIG. 5A is a diagram for explaining a boarding determination process. FIG. 5B is a diagram for explaining a boarding determination process. FIG. 6 is a block diagram showing a configuration example of the exit terminal device. FIG. 7 is a diagram showing an example of disembarkation information. FIG. 8 is a block diagram showing a configuration example of the management server. FIG. 9 is a diagram showing an example of a processing sequence executed by the information processing system. FIG. 10 is a block diagram showing a configuration example of the exit terminal device according to the modified example. FIG. 11 is a diagram for explaining a disembarkation determination process.

Hereinafter, embodiments of the boarding / alighting determination device and the boarding / alighting determination method disclosed in the present application will be described in detail with reference to the accompanying drawings. The present invention is not limited to the embodiments shown below.

<Outline of boarding / alighting judgment method by boarding / alighting judgment device>
Hereinafter, the outline of the boarding / alighting determination method by the boarding / alighting determination device according to the embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an outline of a boarding / alighting determination method according to an embodiment.

The boarding / alighting determination method according to the embodiment can, for example, determine boarding / alighting of a person present near the boarding / alighting port of the vehicle. The above-mentioned entrance / exit shall include one or both of the entrance 2a and the exit 2b of the vehicle. In the following, an example will be described in which the boarding / alighting determination method determines boarding of a person's vehicle existing near the vehicle entrance 2a.

Further, although the bus 1 will be described here as an example of the vehicle, the type of the vehicle is not limited to this. That is, the vehicle may be another type of vehicle, such as a railroad vehicle, an aircraft, or a ship.

As shown in FIG. 1, a bus terminal device 10 is mounted on the bus 1, and the bus terminal device 10 functions as a boarding / alighting determination device. Specifically, the bus terminal device 10 includes an entrance terminal device 10a and an exit terminal device 10b.

The entrance terminal device 10a is installed at the entrance 2a of the bus 1. The entrance terminal device 10a includes a first camera 11a. For example, the first camera 11a is the entrance 2a of the bus 1 and is provided inside the bus 1 (inside the bus). The first camera 11a captures the captured image A of the person P existing in the vicinity of the entrance 2a. In FIG. 1, the person P imaged first is shown by a solid line, and then the person P imaged after the person P moves is shown by a broken line.

The entrance terminal device 10a acquires the captured image A from the first camera 11a, and detects the position of the head Pa of the person P existing in the vicinity of the entrance 2a from the captured image A (step S1). Next, the entrance terminal device 10a determines that the person P is on the bus 1 based on the position of the detected head Pa of the person P (step S2). As a result, the entrance terminal device 10a can accurately determine the boarding of the person P on the bus 1.

To explain in detail, for example, when the person P enters the vehicle from the outside of the bus 1 and gets on the bus, it is necessary to climb the step 3 at the entrance 2a of the bus 1, so that the position of the head Pa of the person P is the position of the person P. It rises relatively before and after the move. Therefore, in the entrance terminal device 10a according to the present embodiment, when the position of the head Pa of the person P rises relatively before and after the movement of the person P as shown by the arrow D, the person P becomes a bus. It is determined that the passenger has boarded 1.

As a result, the entrance terminal device 10a can accurately determine the boarding of the person P on the bus 1. In other words, the entrance terminal device 10a has the position of the head of the person even when a person who is only standing outside the entrance 2a of the bus 1 and does not actually get on the bus is reflected in the captured image. Since it does not rise relatively, it is not determined that the bus 1 has been boarded. As a result, the entrance terminal device 10a can prevent a person who is only standing outside the entrance 2a from being erroneously determined as a passenger boarding the bus 1.

In the present embodiment, when it is determined by the entrance terminal device 10a that the person P has boarded the bus 1, the person P is a passenger, so that the passenger (person P) is imaged. The captured image is used as a passenger captured image for processing such as calculation of the number of passengers.

The exit terminal device 10b is installed at the exit 2b of the bus 1. The exit terminal device 10b includes a second camera 11b. For example, the second camera 11b is provided at the exit 2b of the bus 1 and inside the bus 1 (inside the bus).

<Information processing system configuration>
Next, the configuration of the information processing system including the bus terminal device (boarding / alighting determination device) 10 according to the embodiment will be described with reference to FIG. FIG. 2 is a block diagram showing a configuration example of an information processing system 100 provided with a bus terminal device 10.

As shown in FIG. 2, the information processing system 100 includes the above-mentioned bus terminal device 10, a management server 200, a bus operator terminal device 300, and a user terminal device 400, which are communication networks such as an Internet network. It is connected so that it can communicate via N.

As described above, the bus terminal device 10 includes an entrance terminal device 10a and an exit terminal device 10b. The entrance terminal device 10a and the exit terminal device 10b are connected to each other so as to be communicable via short-range wireless communication such as Wi-Fi (registered trademark), but the present invention is not limited to this, and in addition to short-range wireless communication. Alternatively, or instead, they may be connected so as to be communicable via the communication network N or the like. The detailed configuration of the entrance terminal device 10a will be described later with reference to FIG. 3 and the like. The detailed configuration of the exit terminal device 10b will be described later with reference to FIG. 6 and the like.

The management server 200 is a server device that manages passenger information transmitted from the bus terminal device 10, passenger information (all of which will be described later), passenger information including information on the number of passengers on the bus 1. The management server 200 can provide passenger information and the like to the bus operator terminal device 300. Further, the management server 200 can calculate the congestion degree of the bus 1 based on the information of the number of passengers of the bus 1 and provide the congestion degree information indicating the calculated congestion degree to the user terminal device 400. The detailed configuration of the management server 200 will be described later with reference to FIG.

The bus operator terminal device 300 is a terminal device used by the bus operator that operates the bus 1. As the bus operator terminal device 300, for example, a PC (Personal Computer), a smartphone, a tablet terminal, or the like can be used, but the bus operator terminal device 300 is not limited thereto. Passenger information and the like are transmitted from the management server 200 to the bus operator terminal device 300 and displayed. This enables the bus operator to make an operation plan for the bus 1 according to, for example, passenger information.

The user terminal device 400 is a terminal device used by a user who uses the bus 1, to be exact, a user who will use the bus 1 from now on. As the user terminal device 400, for example, a smartphone, a tablet terminal, a PC, or the like can be used, but the user terminal device 400 is not limited thereto. Congestion degree information of bus 1 is transmitted from the management server 200 to the user terminal device 400 and displayed. This allows the user to check, for example, the degree of congestion of the bus 1 before boarding. In FIG. 2, two user terminal devices 400 are shown for the sake of simplification of illustration, but the present invention is not limited to this, and the number may be one or three or more.

<Configuration of entrance terminal device>
Next, the configuration of the entrance terminal device 10a will be described with reference to FIG. 3 and the like. FIG. 3 is a block diagram showing a configuration example of the entrance terminal device 10a. In each block diagram including FIG. 3, only the components necessary for explaining the features of the present embodiment are represented by functional blocks, and the description of general components is omitted.

In other words, each component shown in the block diagram of FIG. 3 or the like is a functional concept and does not necessarily have to be physically configured as shown in the figure. For example, the specific form of distribution / integration of each functional block is not limited to the one shown in the figure, and all or part of it is functionally or physically distributed in any unit according to various loads and usage conditions. -It is possible to integrate and configure.

As shown in FIG. 3, the entrance terminal device 10a includes a first camera 11a, a positioning unit 12a, a control unit 20a, and a storage unit 30a. As the entrance terminal device 10a, a smartphone, a tablet terminal, or the like can be used, but the present invention is not limited to this.

The first camera 11a is a camera including, for example, a lens and an image pickup element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The first camera 11a is the entrance 2a of the bus 1 (see FIG. 1) and is provided inside the bus 1 (inside the bus). Specifically, the first camera 11a is provided at a position where at least a range including the face of a passenger (passenger) who gets on the bus from the entrance 2a can be imaged from inside the bus. The first camera 11a captures an image of a person (including a passenger) existing in the vicinity of the entrance 2a, and outputs the captured image to the control unit 20a.

The positioning unit 12a acquires the position information (for example, latitude and longitude) of the bus 1. For example, the positioning unit 12a receives radio waves transmitted from a GPS (Global Positioning System) satellite, acquires the position information of the bus 1 based on the received radio waves, and outputs the acquired position information to the control unit 20a. .. The positioning unit 12a may output the position information of the bus 1 acquired when the bus 1 is stopped at the bus stop as the position information of the bus stop where the bus 1 is stopped.

The control unit 20a includes an acquisition unit 21a, a detection unit 22a, a determination unit 23a, a registration unit 24a, and an output unit 25a. For example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM ( Random Access Memory), including computers with input / output ports and various circuits.

The CPU of the computer functions as the acquisition unit 21a, the detection unit 22a, the determination unit 23a, the registration unit 24a, and the output unit 25a of the control unit 20a by reading and executing the program stored in the ROM, for example.

Further, at least a part or all of the acquisition unit 21a, the detection unit 22a, the determination unit 23a, the registration unit 24a, and the output unit 25a of the control unit 20a are ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), or the like. It can also be configured with the hardware of.

Further, the storage unit 30a is a storage unit composed of a storage device such as a non-volatile memory or a data flash. Passenger information 31a, various programs, and the like are stored in the storage unit 30a.

The passenger information 31a is information about the passenger. Here, the passenger information 31a will be described with reference to FIG. FIG. 4 is a diagram showing an example of passenger information 31a. As shown in FIG. 4, the passenger information 31a includes "passenger ID", "passenger image", "characteristic point", "gender", "age", "age group", "bus stop" and the like. Items are included, and each item is associated with each other.

The "passenger ID" is identification information that identifies the passenger. The "passenger image" is information of the passenger captured image. As described above, the passenger image is an image of the person (passenger) when it is determined by the entrance terminal device 10a that a person existing in the vicinity of the entrance 2a has boarded the bus 1. It is an image. In the example shown in FIG. 4, for convenience, the "passenger image" is described as an abstract description such as "image E01", but specific information is stored in the "image E01". Hereinafter, other information may be described in an abstract manner.

The "feature point" is the feature point information of the occupant's face captured in the image captured by the occupant, and is an example of the face information. The feature point information includes, but is not limited to, for example, the position of the feature points such as the eyes (inner corners of eyes, outer corners of eyes, etc.), nose, mouth, etc. on the passenger's face in the image captured by the passenger. ..

The "gender" is information indicating the gender of the occupant in the image captured by the occupant. The "age" is information indicating the age of the passenger in the image captured by the passenger, and the "age group" is information indicating the age group of the passenger. The above-mentioned information such as gender, age, and age group is an example of the attribute information of the passenger. "Bus stop" is information indicating the bus stop on which the passenger boarded.

In the example shown in FIG. 4, the passenger data identified by the passenger ID "P01" has a passenger image of "image E01", a feature point of "feature point F01", a gender of "male", and an age of "male". It indicates that "age G01", the age group is "adult", and the bus stop where you boarded is "stop H01".

Returning to the description of FIG. 3, the acquisition unit 21a of the control unit 20a acquires a captured image of a person (including a passenger) existing in the vicinity of the entrance 2a of the bus 1 from the first camera 11a. For example, the acquisition unit 21a acquires the captured image when the bus 1 is stopped at the bus stop, but the acquisition timing is not limited to this. The acquisition unit 21a outputs the acquired captured image to the detection unit 22a.

The detection unit 22a detects the position of the head of a person existing in the vicinity of the entrance 2a of the bus 1 based on the captured image. The position of the head can be arbitrarily set, and can be set at various parts of the head such as the position of the entire head, the center position of the head, the position of the upper end and the lower end of the head. Further, the detection unit 22a detects the size of the face of a person existing in the vicinity of the entrance 2a of the bus 1 based on the captured image. The detection unit 22a outputs the detected information indicating the position of the head and the information indicating the size of the face to the determination unit 23a.

Further, when the person in the captured image is the occupant, the detection unit 22a detects the occupant's face information (specifically, facial feature point information) from the occupant's captured image which is the captured image. For example, the detection unit 22a extracts feature points such as eyes (inner corners of eyes, outer corners of eyes, etc.), nose, mouth, contour, etc. from the image captured by the passenger, and detects the positions of the extracted feature points as feature point information.

The detection unit 22a detects attribute information such as the gender, age, and age group of the passenger from the image captured by the passenger. The method for detecting feature point information and attribute information can be arbitrarily set. The detection unit 22a outputs the detected feature point information and attribute information to the registration unit 24a.

The determination unit 23a determines that the person in the captured image is on the bus 1. This boarding determination process will be described with reference to FIGS. 5A and 5B. 5A and 5B are diagrams for explaining a boarding determination process.

Note that FIG. 5A shows the captured image A1, and FIG. 5B shows the captured image A2 captured after the captured image A1. Further, in FIG. 5A, as in FIG. 1, the person P imaged first is shown by a solid line, and then the person P imaged after the person P moves is shown by a broken line. In FIG. 5B, the person P shown by the broken line in FIG. 5A shows the person P imaged after further moving by a one-dot chain line or a two-dot chain line.

As shown in FIG. 5A, the determination unit 23a determines that the person P is on the bus 1 based on the position of the detected head Pa of the person P. For example, the determination unit 23a determines that the person P has boarded the bus 1 when the position of the head Pa of the person P rises relatively before and after the movement of the person P as shown by the arrow D1. .. As a result, as described above, in the present embodiment, the boarding of the person P on the bus 1 can be accurately determined.

For example, in the determination unit 23a, when the position of the head Pa before the movement of the person P shown by the solid line rises by a predetermined value or more and becomes the position of the head Pa after the movement of the person P shown by the broken line, the person P becomes a bus. It may be determined that the passenger has boarded 1. Here, the predetermined value is set according to, for example, the height from the road surface where the bus 1 is stopped to the step 3 (see FIG. 1). This makes it possible to accurately determine that the person P has climbed the step 3 and boarded the bus 1. In the above, the predetermined value is set according to the height of the step 3, but this is an example and is not limited, and may be set to an arbitrary value.

Further, as shown in FIG. 5B, the determination unit 23a is like the person P shown by the alternate long and short dash line after the position of the head Pa is relatively raised before and after the movement of the person, like the person P shown by the broken line. In addition, when the size of the face becomes relatively large before and after the movement of the person P, it may be determined that the person P has boarded the bus 1 (see arrow D2).

In this way, the fact that the size of the face became relatively large before and after the movement of the person P means that the person P approached the first camera 11a provided in the bus 1 and got on the bus 1. From the above, the determination unit 23a can determine the boarding of the person P on the bus 1 with higher accuracy.

In the determination unit 23a, when the size of the face of the person P becomes relatively large before and after the movement of the person P, and then the person P fades out from the captured image A2, the person P gets on the bus 1. May be determined.

On the other hand, in the determination unit 23a, the position of the head is changed like the person P shown by the two-dot chain line after the position of the head Pa is relatively raised before and after the movement of the person like the person P shown by the broken line. If the size of the face of the person P is relatively small before and after the movement of the person, and the size of the face of the person P is relatively small before and after the movement of the person, it may be determined that the person P is not on the bus 1. (See arrow D3).

As a result, it is possible to prevent the person P who does not get on the bus 1 from being erroneously determined as a passenger (passenger). That is, the action of the person P indicated by the two-dot chain line is, for example, an action of entering the bus 1 once, but getting off the bus 1 because the destination of the bus 1 is different from the desired destination. ..

Since the determination unit 23a determines that the person P who has performed such an operation is not on the bus 1, the passenger (the person P) who has once entered the bus 1 but does not actually get on the bus 1 ( It is possible to prevent misjudgment as a passenger).

Continuing the description of FIG. 3, the determination unit 23a outputs the determination result to the registration unit 24a. When it is determined that a person existing in the vicinity of the entrance 2a has boarded the bus 1, the registration unit 24a uses a captured image of the person (passenger) as a passenger captured image. Then, the registration unit 24a registers various information (feature point information and attribute information) including the passenger captured image in the storage unit 30a as the passenger information 31a (see FIG. 4). At this time, the registration unit 24a adds the information of the stop where the passenger image is captured, that is, the stop where the passenger got on, to the passenger information 31a based on the position information of the bus 1 of the positioning unit 12a. May be good.

The output unit 25a accesses the storage unit 30a and outputs the passenger information 31a to the exit terminal device 10b. As a result, in the entrance terminal device 10a according to the present embodiment, the passenger information 31a corresponding to the passenger actually boarded, that is, the accurate passenger information 31a can be output to the exit terminal device 10b. can.

The output unit 25a executes the output process between the time when the bus 1 departs from one stop and the time when the bus 1 arrives at the next stop, but the output timing is not limited to this.

<Configuration of exit terminal device>
Next, the configuration of the exit terminal device 10b will be described with reference to FIG. 6 and the like. FIG. 6 is a block diagram showing a configuration example of the exit terminal device 10b.

As shown in FIG. 6, the exit terminal device 10b includes a second camera 11b, a positioning unit 12b, a control unit 20b, and a storage unit 30b. As the exit terminal device 10b, a smartphone, a tablet terminal, or the like can be used, but the exit terminal device 10b is not limited to this.

The second camera 11b is a camera including, for example, a lens and an image pickup element such as a CCD or CMOS. The second camera 11b is the exit 2b of the bus 1 (see FIG. 1) and is provided inside the bus 1 (inside the bus). Specifically, the second camera 11b is provided at a position where at least a range including the face of a disembarking person (passenger) getting off from the exit 2b can be imaged from inside the bus. The second camera 11b captures an image of the person getting off the vehicle and outputs the captured image of the person getting off the vehicle to the control unit 20b.

The positioning unit 12b acquires the position information of the bus 1 based on the radio wave transmitted from the GPS satellite, for example, and outputs the acquired position information to the control unit 20b. The positioning unit 12b may output the position information of the bus 1 acquired when the bus 1 is stopped at the bus stop as the position information of the bus stop where the bus 1 is stopped.

The control unit 20b includes an acquisition unit 21b, a detection unit 22b, a registration unit 23b, a collation unit 24b, a calculation unit 25b, and a transmission unit 26b, and includes, for example, a CPU, ROM, RAM, input / output port, and the like. Includes computers and various circuits.

The CPU of the computer functions as, for example, the acquisition unit 21b, the detection unit 22b, the registration unit 23b, the collation unit 24b, the calculation unit 25b, and the transmission unit 26b of the control unit 20b by reading and executing the program stored in the ROM. do.

Further, at least a part or all of the acquisition unit 21b, the detection unit 22b, the registration unit 23b, the collation unit 24b, the calculation unit 25b, and the transmission unit 26b of the control unit 20b may be configured by hardware such as ASIC or FPGA. can.

Further, the storage unit 30b is a storage unit composed of a storage device such as a non-volatile memory or a data flash. The passenger information 31b, the disembarkation information 32b, the boarding / alighting counter 33b, various programs, and the like are stored in the storage unit 30b.

Since the passenger information 31b is the same information as the passenger information 31a output from the entrance terminal device 10a, the description thereof is omitted here (see FIG. 4).

The disembarkation information 32b is information about the disembarkation person. Here, the disembarkation information 32b will be described with reference to FIG. 7. FIG. 7 is a diagram showing an example of disembarkation information 32b. As shown in FIG. 7, the disembarkation information 32b includes "disembarkation ID", "disembarkation person image", "characteristic point", "gender", "age", "age group", "disembarkation stop" and Items such as "collation result" are included, and each item is associated with each other.

The "get-off ID" is identification information for identifying the get-off person. The "get-off person image" is information of the get-off person captured image. The "feature point" is the feature point information of the face. The feature point information includes, but is not limited to, for example, the positions of feature points such as eyes, nose, and mouth on the face of the disembarkator in the image captured by the disembarkant.

The "gender" is information indicating the gender of the disembarking person in the image captured by the disembarking person. The "age" is information indicating the age of the disembarking person in the image captured by the disembarking person, and the "age group" is information indicating the age group of the disembarking person.

The "bus stop where you got off" is information indicating the bus stop where the person who got off the bus got on. The "collation result" is information indicating a collation result when the passenger information 31b and the disembarkation information 32b are collated by the collation unit 24b described later. The “collation result” includes, for example, information regarding the passenger ID of the passenger information 31b that matches the disembarkation information 32b, but is not limited thereto.

In the example shown in FIG. 7, the data of the disembarkation person identified by the disembarkation person ID "Q01" is "image E11" for the disembarkation person image, "feature point F01" for the feature point, "male" for the gender, and "male" for the age. It indicates that "age G01", the age group is "adult", the stop where the bus got off is "stop H11", and the collation result is "match with the passenger ID [P01]".

Returning to the description of FIG. 6, the boarding / alighting counter 33b is a counter that counts the current number of passengers on the bus 1.

The acquisition unit 21b of the control unit 20b acquires an image of a person getting off the bus 1 (a person getting off the bus) from the second camera 11b. For example, the acquisition unit 21b acquires an image captured by a person getting off the bus when the bus 1 is stopped at a stop, but the timing of acquisition is not limited to this. The acquisition unit 21b outputs the acquired image of the person getting off the vehicle to the detection unit 22b.

Further, the acquisition unit 21b acquires the passenger information output from the entrance terminal device 10a and registers it in the storage unit 30b as the passenger information 31b (see FIG. 4).

The detection unit 22b detects the face information of the person getting off (specifically, the feature point information of the face) from the captured image of the person getting off. For example, the detection unit 22b extracts feature points such as eyes, nose, mouth, and contour from the image captured by the person getting off the vehicle, and detects the positions of the extracted feature points as feature point information.

The detection unit 22b detects attribute information such as the gender, age, and age group of the disembarking person from the captured image of the disembarking person. The detection unit 22b outputs the detected feature point information and attribute information to the registration unit 23b together with the image captured by the person getting off the vehicle.

The registration unit 23b registers various information including a disembarkation person captured image, feature point information, and attribute information in the storage unit 30b as disembarkation person information 32b (see FIG. 7). At this time, the registration unit 23b adds the information of the stop where the image of the disembarking person is captured, that is, the stop where the disembarking person got off, to the disembarking person information 32b based on the position information of the bus 1 of the positioning unit 12b. May be good.

The collation unit 24b collates the passenger information 31b with the disembarkation information 32b. For example, the collation unit 24b accesses the passenger information 31b and the disembarkation information 32b of the storage unit 30b, and the feature point information and the attribute information of the disembarkator match or substantially match the feature point information and the attribute information of the passenger. Check whether or not. When the collation unit 24b matches or substantially matches the feature point information of the occupant with the feature point information of the occupant, the collation unit 24b registers the collation result in the "collation result" of the disembarkation information 32b (see FIG. 7). .. Here, the collation unit 24b indicates that the feature point information and the attribute information of the disembarkator of the disembarkation ID “Q01” match the feature point information and the attribute information of the information of the passenger ID “P01”.

The calculation unit 25b calculates the number of passengers on the bus 1 based on the passenger information 31b and the disembarkation information 32b. For example, the calculation unit 25b adds one passenger to the passenger information 31b when the passenger's face information and attribute information are newly registered, and specifically increments the boarding / alighting counter 33b.

Further, in the calculation unit 25b, when the information of the disembarkation person who matches or substantially matches the feature point information and the attribute information of the passenger is registered in the disembarkation information 32b, the passenger such as the feature point information is transferred from the bus 1. It is estimated that the passengers have disembarked, and the value obtained by subtracting one passenger from the number of passengers is calculated as the current number of passengers on the bus 1. Specifically, the boarding / alighting counter 33b is decremented.

As described above, since the calculation unit 25b uses the accurate passenger information 31b, the number of passengers on the bus 1 can be calculated accurately. The calculation unit 25b executes the calculation process until the bus 1 departs from one stop and arrives at the next stop, but the timing of the calculation is not limited to this.

The transmission unit 26b transmits passenger information including a part or all of the passenger information 31b and the disembarkation information 32b and information on the number of passengers of the bus 1 which is the value of the boarding / alighting counter 33b to the management server 200.

The transmission unit 26b executes the transmission process from the time when the bus 1 departs from the bus stop and the calculation process or the like in the calculation unit 25b is completed until the bus 1 arrives at the next stop. Not limited to.

<Management server configuration>
Next, the configuration of the management server 200 will be described with reference to FIG. FIG. 8 is a block diagram showing a configuration example of the management server 200.

As shown in FIG. 8, the management server 200 includes a communication unit 201, a control unit 210, and a storage unit 220. The communication unit 201 is a communication interface that connects to the communication network N so as to be capable of bidirectional communication, and transmits / receives information to / from the bus terminal device 10, the bus operator terminal device 300, the user terminal device 400, and the like.

The control unit 210 includes an acquisition unit 211, a congestion degree calculation unit 212, and a provision unit 213, and includes, for example, a computer having a CPU, ROM, RAM, input / output ports, and various circuits.

The CPU of the computer functions as the acquisition unit 211, the congestion degree calculation unit 212, and the provision unit 213 of the control unit 210, for example, by reading and executing the program stored in the ROM.

Further, at least a part or all of the acquisition unit 211, the congestion degree calculation unit 212, and the provision unit 213 of the control unit 210 may be configured by hardware such as ASIC or FPGA.

Further, the storage unit 220 is a storage unit composed of a storage device such as a non-volatile memory or a data flash. Passenger information 221 and bus information 222, various programs, and the like are stored in the storage unit 220.

The passenger information 221 is information about the passengers of the bus 1 transmitted from the exit terminal device 10b. As described above, the passenger information 221 includes a part or all of the passenger information 31b and the disembarkation information 32b, and information on the number of passengers on the bus 1, which is the value of the boarding / alighting counter 33b.

Bus information 222 is information about bus 1. The bus information 222 includes, for example, capacity information indicating the capacity of the bus 1, but is not limited to this, and may include other information such as operation plan information of the bus 1. The bus information 222 is stored in the storage unit 220 in advance, but is not limited to this, and may be transmitted from an external terminal such as a bus operator terminal device 300 and stored in the storage unit 220.

The acquisition unit 211 of the control unit 210 acquires the information transmitted from the exit terminal device 10b, and stores the acquired information in the storage unit 220 as passenger information 221.

The congestion degree calculation unit 212 calculates the congestion degree of the bus 1, specifically, the current congestion degree of the bus 1. The degree of congestion is an index value indicating the degree of congestion of the bus 1, and is a value indicated in several levels according to, for example, the number of passengers with respect to the capacity of the bus 1.

For example, the congestion degree calculation unit 212 determines the current congestion degree of the bus 1 based on the information on the current number of passengers of the bus 1 included in the passenger information 221 and the capacity information of the bus 1 included in the bus information 222. calculate. The congestion degree calculation unit 212 outputs the congestion degree information indicating the calculated congestion degree to the provision unit 213.

The providing unit 213 can provide such congestion degree information to, for example, a user terminal device 400 or a bus operator terminal device 300 via the communication unit 201. Further, the providing unit 213 can provide the passenger information 221 to, for example, the bus operator terminal device 300 via the communication unit 201.

<Control processing of the information processing system according to the embodiment>
Next, a processing procedure executed by the information processing system 100 including the bus terminal device 10 according to the embodiment will be described with reference to FIG. FIG. 9 is a diagram showing an example of a processing sequence executed by the information processing system 100 including the bus terminal device 10 according to the embodiment.

As shown in FIG. 9, first, the entrance terminal device 10a acquires a captured image of a person existing in the vicinity of the entrance 2a of the bus 1 from the first camera 11a (step S10). Next, the entrance terminal device 10a determines that the person is on the bus 1 based on the position of the head of the person in the captured image (step S11).

The entrance terminal device 10a registers the passenger information including the captured image (passenger captured image) of the person determined to have boarded the bus 1 in the storage unit 30a (step S12). Then, the entrance terminal device 10a outputs the passenger information to the exit terminal device 10b (step S13).

The exit terminal device 10b acquires an image captured by the person getting off the vehicle from the second camera 11b (step S14). Next, the exit terminal device 10b registers the disembarkation person information including the disembarkation person captured image in the storage unit 30b (step S15). Here, it is assumed that the passenger information output from the entrance terminal device 10a in the previous process is registered in the storage unit 30b.

Next, the exit terminal device 10b collates the passenger information with the disembarkation information (step S16). For example, the exit terminal device 10b collates whether or not the feature point information and the attribute information of the disembarkator in the disembarkation information match or substantially match the feature point information and the attribute information of the occupant in the occupant information. ..

The exit terminal device 10b calculates the number of passengers on the bus 1 based on the passenger information, the disembarkation information, the collation result, and the like (step S17). Further, the exit terminal device 10b updates the passenger information of the storage unit 30b when the passenger information is newly output from the entrance terminal device 10a (step S18).

Then, the exit terminal device 10b transmits passenger information including passenger information, passenger information, the number of passengers on the bus 1, and the like to the management server 200 (step S19).

The management server 200 calculates the degree of congestion of the bus 1 based on the information on the number of passengers of the bus 1 (step S20). Then, the management server 200 provides congestion degree information, passenger information, and the like to the bus operator terminal device 300 and the user terminal device 400 (step S21).

As described above, the bus terminal device 10 (an example of the boarding / alighting determination device) according to the embodiment includes a detection unit 22a and a determination unit 23a. The detection unit 22a detects the position of the head of a person existing near the entrance / exit (entrance 2a) of the bus 1. The determination unit 23a determines whether the person gets on and off the vehicle based on the position of the head of the person detected by the detection unit 22a. Thereby, in the embodiment, it is possible to accurately determine the boarding / alighting of a person existing near the boarding / alighting port of the vehicle with respect to the vehicle.

<Modification example>
Next, a modification will be described. In the modified example, the exit terminal device 10b determines to disembark from the vehicle of a person existing near the exit 2b (see FIG. 1) of the bus 1, for example.

FIG. 10 is a block diagram showing a configuration example of the exit terminal device 10b according to the modified example. In the following, the same reference numerals will be given to the configurations common to the embodiments, and the description thereof will be omitted.

As shown in FIG. 10, the control unit 20b of the exit terminal device 10b according to the modified example further includes a determination unit 27b.

The acquisition unit 21b of the control unit 20b acquires a captured image of a person (including a person getting off) existing near the exit 2b of the bus 1 from the second camera 11b. The acquisition unit 21b outputs the acquired captured image to the detection unit 22b.

The detection unit 22b detects the position of the head of a person existing near the exit 2b of the bus 1 based on the captured image. The detection unit 22b outputs information indicating the detected head position to the determination unit 27b.

The determination unit 27b determines that the person in the captured image gets off the bus 1. This disembarkation determination process will be described with reference to FIG. FIG. 11 is a diagram for explaining a disembarkation determination process. In FIG. 11, the captured image B1 is shown, the first captured person P is shown by a solid line, and then the person P imaged after the person P moves is shown by a broken line.

As shown in FIG. 11, the determination unit 27b determines that the person P gets off the bus 1 based on the position of the detected head Pb of the person P. For example, the determination unit 27b determines that the person P has disembarked from the bus 1 when the position of the head Pb of the person P is relatively lowered before and after the movement of the person P as shown by the arrow D4. .. As a result, in the modified example, it is possible to accurately determine the disembarkation of the person P from the bus 1.

More specifically, for example, when the person P gets off from the inside of the bus 1 and gets off, it is necessary to go down the step 4 (see FIG. 1) at the exit 2b of the bus 1, so that the position of the head Pb of the person P Decreases relatively before and after the movement of the person P. Therefore, in the exit terminal device 10b according to the modified example, when the position of the head Pb of the person P is relatively lowered before and after the movement of the person P, it is determined that the person P has disembarked from the bus 1. I made it.

As a result, the exit terminal device 10b according to the modified example can accurately determine the disembarkation of the person P from the bus 1. In other words, in the exit terminal device 10b, even if a person who is standing near the exit 2b but does not actually get off is reflected in the captured image, the position of the head of the person is relatively lowered. Since there is no such thing, it is not determined that the bus has disembarked from bus 1. As a result, the exit terminal device 10b can prevent a person who is only standing in the vicinity of the exit 2b from being erroneously determined as a person getting off the bus 1.

For example, in the determination unit 27b, when the position of the head Pb before the movement of the person P shown by the solid line is lowered by a second predetermined value or more and becomes the position of the head Pb after the movement of the person P shown by the broken line, the person P May be determined to have disembarked from bus 1. Here, the second predetermined value is set according to, for example, the height from the road surface where the bus 1 is stopped to the step 4 (see FIG. 1). This makes it possible to accurately determine that the person P has descended the step 4 and got off the bus 1. In the above, the second predetermined value is set according to the height of the step 4, but this is an example and is not limited, and may be set to any value.

When it is determined that a person existing near the exit 2b has disembarked from the bus 1, the registration unit 23b uses an image captured by the person (disembarking person) as an image captured by the disembarking person. Then, the registration unit 24a registers various information (feature point information and attribute information) including the image captured by the disembarkator in the storage unit 30b as the disembarkation information 32b.

In the above-mentioned modification, the determination unit 27b determines the disembarkation of the person based on the position of the head of the person, but the present invention is not limited to this, and the determination unit 27b is added to or replaced with the position of the head. The disembarkation of a person may be determined based on the size of the person's face. That is, although not shown, in the determination unit 27b, when the position of the head is relatively lowered before and after the movement of the person and then the size of the face is relatively small before and after the movement of the person, the person is busted. It may be determined that the vehicle has disembarked at 1. In this way, the fact that the size of the face became relatively small before and after the movement of the person indicates that the person left the second camera 11b provided in the bus 1 and got off the bus 1. Therefore, the determination unit 27b can more accurately determine that a person is getting off the bus 1.

In addition, the bus terminal device 10 may perform both the determination of boarding and the determination of disembarkation described above, or may perform either one.

In the above-described embodiments and modifications, the entrance terminal device 10a, the exit terminal device 10b, and the management server 200 each perform various processes, but the devices on which the various processes are performed are described above. Not limited.

That is, a part or all of the processing performed by the entrance terminal device 10a may be performed by the exit terminal device 10b or the management server 200. Further, a part or all of the processing performed by the exit terminal device 10b may be performed by the entrance terminal device 10a or the management server 200. Further, a part or all of the processing performed by the management server 200 may be performed by the entrance terminal device 10a or the exit terminal device 10b.

Further effects and variations can be easily derived by those skilled in the art. For this reason, the broader aspects of the invention are not limited to the particular details and representative embodiments described and described above. Thus, various modifications can be made without departing from the spirit or scope of the overall concept of the invention as defined by the appended claims and their equivalents.

1 Bus 10 Bus terminal device 10a Exit terminal device 10b Exit terminal device 11a 1st camera 11b 2nd camera 22a Detection unit 23a Judgment unit 100 Information processing system 200 Management server

Claims (6)

A detector that detects the position of a person's head near the entrance of a vehicle,
A boarding / alighting determination device including a determination unit that determines boarding / alighting of the person with respect to the vehicle based on the position of the head of the person detected by the detection unit. The determination unit
The boarding / alighting determination device according to claim 1, wherein when the position of the head of the person is relatively raised before and after the movement of the person, it is determined that the person has boarded the vehicle. The detector is
The size of the face of the person is detected based on the captured image of the person, which is the entrance / exit of the vehicle and is captured by the camera provided in the vehicle.
The determination unit
When the size of the face of the person becomes relatively large before and after the movement of the person after the position of the head of the person rises relatively before and after the movement of the person, the person gets on the vehicle. The boarding / alighting determination device according to claim 1 or 2, wherein the determination is made. The determination unit
After the position of the head of the person is relatively raised before and after the movement of the person, the position of the head of the person is relatively lowered before and after the movement of the person, and the size of the face of the person is the person. The boarding / alighting determination device according to claim 3, wherein when the person becomes relatively small before and after the movement of the vehicle, it is determined that the person is not on the vehicle. The determination unit
The boarding / alighting according to any one of claims 1 to 4, wherein when the position of the head of the person is relatively lowered before and after the movement of the person, it is determined that the person has disembarked from the vehicle. Judgment device. A detection process that detects the position of a person's head near the entrance of a vehicle,
A method for determining boarding / alighting, which comprises a determination step of determining boarding / alighting of the person with respect to the vehicle based on the position of the head of the person detected by the detection step.

Images