JP2021039582A - Guidance system, information processing device, guidance method, and program - Google Patents

Abstract

To provide a guidance system, etc. to encourage a passenger to give consideration to a person requiring special attention.SOLUTION: A guidance system 1 is for making an announcement to a passenger of a vehicle. The guidance system 1 includes a server 2, a camera 3, a monitor 4, a speaker 5, and so on. The server 2 includes: analysis means 210 for analyzing an image taken by the camera 3 and detecting the ride of a person requiring special attention; and transmission means 230 for transmitting announcement data to the monitor 4 and the speaker 5 to encourage the passenger to give consideration to the person requiring special attention. The monitor 4 displays and outputs the announcement data, and the speaker 5 outputs the announcement data by voice.SELECTED DRAWING: Figure 5

Description

The present invention relates to a guidance system or the like that makes an announcement to passengers in a vehicle.

Wheelchair and stroller users, injured people with crutches, visually impaired people with white canes, pregnant women, etc. may find it difficult to get on or move in the train.

For example, when you get on a train that is crowded with stroller users, if there are passengers at the entrance or exit of the train, or if there are passengers who are looking at books or smartphones and do not notice the surroundings, it will be very difficult to push the stroller and move. There is. If the stroller user or other passengers pay attention to such passengers, it may cause trouble, and the stroller user may eventually fold the stroller and ride with the child in his arms closed. There are many.

In Patent Document 1, as a system for walking support, when a target person for walking support is photographed by a surveillance camera installed at a specific dangerous place such as a pedestrian crossing, an underpass, stairs, or a step, the control device is the target person. A walking support system that recognizes the existence of a pedestrian crossing and outputs a warning that there is a dangerous place, a safe passage method, a guidance voice such as a route guidance such as a detour, etc. by a voice output means is described.

Japanese Unexamined Patent Publication No. 2001-351190

However, the walking support system of Patent Document 1 outputs a warning to the subject that there is a dangerous place, a safe passage method, a guidance voice such as a route guidance such as a detour, and the like. It was not intended to arouse the consideration of those around us.

There are no dangerous spots like the ones above on the train, but there are cases where it is difficult to move without the consideration of the passengers, and the passengers will naturally sit down if they notice that there are people who need consideration nearby. It seems that there are many people who help with emptying or moving.

The present invention has been made in view of such a problem, and an object of the present invention is to provide a guidance system or the like for encouraging passengers to give consideration to persons requiring special attention.

The first invention for solving the above-mentioned problems is a guidance system for making an announcement to passengers of a vehicle, which includes a camera, an information processing device, and a guidance device. , The analysis means for analyzing the image taken by the camera and detecting the boarding of the person requiring special attention, and the announcement data for prompting the passengers to give consideration to the detected person requiring special care are transmitted to the guidance device. The guidance device includes a transmission means, and is a guidance system characterized in that the announcement data is output.

The guidance system of the present invention detects that a person requiring special attention has boarded from an image taken by a camera, and automatically makes an announcement to encourage the passenger to give consideration to the person requiring special attention. As a result, it becomes possible to make the surrounding passengers aware of the existence of the person requiring special attention. Persons requiring special attention can make passengers around them aware of their existence without having to speak to them themselves, and can smoothly board and move inside the vehicle. In addition, passengers around can quickly notice the existence of people requiring special attention and can help naturally.

It is desirable that the analysis means acquires the attribute of the person requiring special attention from the image, and the transmission means transmits the announcement data corresponding to the attribute to the guidance device.
As mentioned above, there are various people who need consideration, such as wheelchair and stroller users, injured people, visually impaired people, and pregnant women. The considerations we want you to take are different, such as whether you want to vacate your seat to sit down. Therefore, by making different announcements according to the attributes of the person requiring consideration, it is possible to encourage the passengers to give consideration according to the attributes of the person requiring consideration.

When the information processing device further has a determination means for determining whether or not consideration for the person requiring consideration is necessary by using the image, and the transmission means is determined to require consideration for the person requiring consideration. It is desirable to transmit the announcement data to the guidance device.
Whether or not consideration is necessary may differ depending on the intention of the person requiring consideration, the congestion situation in the vehicle, the situation of the person requiring consideration, and the like. Therefore, by determining whether or not consideration is necessary from these viewpoints, it is possible to make an announcement only when necessary.

The determination means makes a determination using, for example, a detection result from the image of a predetermined mark possessed by the person requiring special attention. It is desirable that the predetermined mark includes a mark indicating that consideration is not required.
Thereby, it is possible to determine whether or not consideration is necessary according to the intention of the person requiring consideration. Some of the above marks indicate that consideration is not required, and the intention can be clearly indicated not only when the person requiring consideration requires consideration but also when consideration is not required.

It is also desirable that the determination means make a determination using the detection result from the image of the congestion state of the vehicle.
As a result, it is possible to determine whether or not consideration is necessary according to the congestion situation of the vehicle, and it is possible to avoid making an announcement when the inside of the vehicle is vacant and no particular consideration is required.

It is also desirable that the determination means make a determination using the detection result from the image of the movement of the person requiring consideration.
As a result, it is possible to determine whether or not consideration is necessary according to the situation of the person requiring consideration, and for example, when the person requiring consideration is having trouble moving, it is possible to make an announcement to the passengers.

The guidance device preferably includes a monitor and a speaker.
As a result, the announcements can be effectively linked by displaying and outputting the announcements on the monitor in the vehicle and outputting the voices of the announcements on the speaker in the vehicle.

It is desirable that the analysis means analyze the image using the learned data obtained by learning the characteristics of the person requiring special attention by deep learning.
This makes it possible to accurately detect persons requiring special attention.

The second invention is an information processing device communicatively connected to a guidance device for making an announcement to passengers in a vehicle, which analyzes an image taken by a camera and detects the boarding of a person requiring special attention. The information processing device is characterized by comprising an analysis means and a transmission means for transmitting announcement data to the guide device for prompting passengers to give consideration to the detected person requiring consideration.
The second invention is an information processing apparatus used for making an announcement that encourages consideration for a person requiring consideration.

The third invention is a step in which an information processing device communicably connected to a guidance device for making an announcement to passengers in a vehicle analyzes an image taken by a camera and detects the boarding of a person requiring special attention. The guidance method is characterized by executing a step of transmitting announcement data to the guidance device for urging passengers to give consideration to the detected person requiring special attention.
The third invention is a guidance method executed by the information processing apparatus of the second invention.

A fourth invention is an analysis means for detecting the boarding of a person requiring special attention by analyzing an image taken by a camera of an information processing device communicably connected to a guidance device for making an announcement to passengers in the vehicle. And, it is a program for functioning as a transmission means for transmitting announcement data for urging passengers to give consideration to the detected person requiring special attention.
The fourth invention is a program for operating the information processing apparatus of the second invention.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a guidance system or the like for encouraging passengers to give consideration to persons requiring special attention.

The figure which shows the schematic structure of the guidance system 1. The figure which shows the hardware configuration of a server 2. An example of announcement information 22. The figure which shows the arrangement example of the camera 3, the monitor 4, and the speaker 5 in a vehicle 100. The figure which shows the functional structure of the guidance system 1. A flowchart showing an outline of the guidance method. Example of image 6. The figure explaining the detection of the person requiring consideration. An example of announcement data 222 displayed on the monitor 4. A flowchart showing the flow of determining the necessity of consideration. Example of manifestation mark 10.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

(1. Guidance system 1)
FIG. 1 is a diagram showing a schematic configuration of a guidance system 1 according to an embodiment of the present invention. The guidance system 1 makes an announcement (guidance) to the passengers in the train car 100 to encourage consideration for persons requiring special attention.

Persons requiring special consideration refer to all persons who are subject to consideration to encourage passengers in the guidance system 1, such as wheelchair and stroller users, injured people with crutches, visually impaired people with white canes, pregnant women, etc. As described above, the person needs consideration and assistance regarding getting on the vehicle 100, moving in the vehicle, sitting, and the like.

As shown in FIG. 1, the guidance system 1 is provided in the vehicle 100 and includes a server 2, a camera 3, a monitor 4, a speaker 5, and the like. The camera 3, the monitor 4, and the speaker 5 are communicably connected to the server 2.

The server 2 is an information processing device that executes various processes related to the guidance system 1. The details of the processing of the server 2 will be described later.

FIG. 2 is a diagram showing a hardware configuration of the server 2. As shown in FIG. 2, the server 2 can be realized by a computer having a control unit 201, a storage unit 202, a peripheral device I / F unit 203, an input unit 204, a display unit 205, a communication control unit 206, and the like. However, the configuration of the server 2 is not limited to this, and various configurations can be appropriately taken. Further, the server 2 may be composed of a plurality of computers.

The control unit 201 is composed of a CPU, a ROM, a RAM, and the like. The CPU calls and executes a program stored in a storage medium such as a storage unit 202 and a ROM in a work memory area on the RAM, and drives and controls each unit of the server 2. The ROM permanently holds a computer boot program, a program such as a BIOS, data, and the like. The RAM temporarily holds the loaded program and data, and also includes a work area used by the control unit 201 to perform various processes.

The storage unit 202 is a storage medium such as a hard disk drive, a solid state drive, or a flash memory. The storage unit 202 stores a program executed by the control unit 201, data necessary for program execution, an operating system, and the like.

The peripheral device I / F section 203 is a port for connecting peripheral devices, and data is transmitted / received to / from the peripheral device via the peripheral device I / F section 203. The connection form with peripheral devices may be wired or wireless.
The input unit 204 is an input device such as a touch panel, a keyboard, a mouse, and a numeric keypad, and outputs the input data to the control unit 201.

The display unit 205 includes a display device such as a liquid crystal panel or a CRT monitor.
The communication control unit 206 has a communication control device, a communication port, and the like, and controls communication via a network and the like.

As shown in FIG. 1, in the present embodiment, the learned data 21 and the announcement information 22 are stored in the storage unit 202 of the server 2.

The trained data 21 is a trained model in which the characteristics of the image of the person requiring special attention are learned by performing deep learning on a large number of teacher images. A known method can be used for deep learning, and the description thereof will be omitted. The learned data 21 is created by, for example, a computer (not shown) arranged in a data center or the like, transmitted to the server 2, and stored in the storage unit 202. Alternatively, the learned data 21 can be created by the server 2.

The announcement information 22 is information regarding announcements for encouraging passengers to give consideration to persons requiring special attention. FIG. 3 is an example of the announcement information 22, and the attribute 221 of the person requiring special attention and the announcement data 222 corresponding to the attribute 221 are recorded.

The attribute 221 of the person requiring special care is a record of the attributes of the person requiring special care such as a wheelchair or stroller user, an injured person with a crutch, a visually impaired person with a white cane, and a pregnant woman. In addition, the attribute 221 of the person requiring special consideration may be a person with a large baggage or a large amount of baggage, and is not particularly limited.

The announcement data 222 is data that is actually output by the monitor 4 and the speaker 5 as an announcement to the passengers, and includes video data such as a guidance video and voice data such as guidance voice.

Returning to the description of FIG. The camera 3 is a video camera using an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and is provided in the vehicle 100 to capture an image of the inside of the vehicle as a moving image.

The monitor 4 and the speaker 5 are guidance devices provided in the vehicle 100 for making announcements to passengers. The monitor 4 displays and outputs the video data transmitted from the server 2, and the speaker 5 outputs the audio data transmitted from the server 2.

FIG. 4 is an example of arrangement of the camera 3, the monitor 4, and the speaker 5 in the vehicle 100. In FIG. 4, in addition to the camera 3, the monitor 4, and the speaker 5, the entrance / exit 110 for the platform of the vehicle 100 and the entrance / exit 120 for the adjacent vehicle are shown, and the other parts (seats, hanging straps, windows, etc.) are not shown. ing.

In this example, the camera 3 is arranged at a position corresponding to the entrances 110 and 120 of the vehicle 100 and on the ceiling at the center of the vehicle 100 in the traveling direction. The traveling direction of the vehicle 100 corresponds to the longitudinal direction of the vehicle 100, and may be hereinafter referred to as the vehicle traveling direction.

An example of the camera 3 arranged at the doorway 110 is indicated by reference numeral 3a in the drawing, and the inside of the vehicle is photographed by the camera 3a as shown by the arrow a. Similarly, an example of the camera 3 arranged at the doorway 120 is indicated by reference numeral 3b in the drawing, and the inside of the vehicle is photographed by the camera 3b as shown by the arrow b.

Further, an example of the camera 3 arranged on the ceiling in the central portion in the vehicle traveling direction is indicated by reference numeral 3c in the figure, and the camera 3c indicates the end side (doorway 120 side) in the vehicle traveling direction as shown by the arrow c. ) Is photographed.

The monitor 4 is arranged between the positions corresponding to the entrances 110 and 120 of the vehicle 100 and the front and rear entrances 110 in the vehicle traveling direction.

The speaker 5 is arranged at a position corresponding to the entrances 110 and 120 of the vehicle 100. The speaker 5 may be attached to the camera 3.

(2. Functional configuration of guidance system 1)
FIG. 5 is a diagram showing a functional configuration of the guidance system 1. As shown in FIG. 5, in the guidance system 1, the server 2 includes an analysis means 210, a determination means 220, a transmission means 230, and the like.

In the analysis means 210, the control unit 201 of the server 2 analyzes the image taken by the camera 3, detects that the person requiring consideration has boarded, and acquires the attribute 221 of the person requiring consideration from the image. is there. At the time of image analysis, the learned data 21 in which the characteristics of the person requiring special attention are learned by the deep learning method as described above is used.

In the determination means 220, the control unit 201 of the server 2 determines whether or not consideration for a person requiring special attention is necessary by using an image taken by the camera 3. The details of the determination method will be described later, but in the present embodiment, a predetermined mark possessed by the person requiring consideration, the congestion status of the vehicle 100, the movement of the person requiring consideration, etc. are detected from the image, and the determination using the detection result is performed. Do.

In the transmission means 230, the control unit 201 of the server 2 transmits the announcement data 222 to the monitor 4, the speaker 5, and the like via the communication control unit 206 in order to prompt the passengers to give consideration to the person requiring consideration detected by the analysis means 210. And output. The transmission means 230 transmits the announcement data 222 when the determination means 220 determines that consideration for the person requiring consideration is necessary. The announcement data 222 to be transmitted corresponds to the attribute 221 of the person requiring consideration.

(3. Outline of guidance method)
The guidance method executed by the guidance system 1 will be described with reference to FIG. 6 and the like, focusing on the processing of the server 2. FIG. 6 is a flowchart showing an outline of the guidance method, and each step of FIG. 6 is executed by the control unit 201 of the server 2 controlling each unit of the server 2.

In the present embodiment, as described above, the image inside the vehicle is captured as a moving image by the camera 3, and the server 2 receives the moving image (image) captured by the camera 3 from the camera 3 (S1). FIG. 7 is an example of the image 6 for one frame of the moving image, and the state of the vicinity of the entrance / exit 110 of the vehicle 100 is photographed.

The server 2 analyzes the image 6 (S2) and detects the boarding of a person requiring special attention (S3).

The image analysis of S2 can be performed using the trained data 21. For example, by obtaining the trained data 21 using a large number of images including a stroller user as the teacher image, the stroller can be used when the stroller 61 as shown in FIG. 8 is included in the image 6. Persons can be extracted as persons requiring consideration. At this time, the server 2 acquires the fact that it is a "stroller user" as the attribute 221 of the person requiring consideration, and temporarily stores it in the RAM or the like. Similarly, if image 6 contains a white cane, a visually impaired person is extracted as a person requiring special attention, and if image 6 contains a crutch, an injured person is extracted as a person requiring special care. Is possible.

In the present embodiment, for example, in the image 6 of a plurality of frames in chronological order included in the moving image received from the camera 3, if such a movement of the person requiring special attention moving from the entrance / exit 110 of the vehicle 100 toward the inside of the vehicle can be detected. , Suppose a person requiring special attention gets on board. However, the specific detection method is not limited to this.

When the server 2 does not detect the boarding of the person requiring special attention (S3; No), the server 2 ends the process without making an announcement in particular. On the other hand, when the boarding of the person requiring consideration is detected (S3; Yes), it is determined whether or not consideration is required for the person requiring consideration (S4). The details of this necessity determination will be described later.

When it is determined that consideration for the person requiring special attention is unnecessary (S5; No), the server 2 ends the process without making an announcement.

On the other hand, when it is determined that consideration is necessary (S5; Yes), the server 2 announces the announcement data 222 according to the attribute 221 (for example, "stroller user") of the person requiring consideration acquired from the image 6 earlier. It is acquired from 22 (S6), and the announcement data 222 is transmitted to the monitor 4 and the speaker 5 (S7).

As described above, the announcement data 222 includes video data and audio data, the video data is transmitted to the monitor 4, and the audio data is transmitted to the speaker 5. When the monitor 4 receives the video data, it displays and outputs it, and when the speaker 5 receives the audio data, it outputs the audio.

FIG. 9 is an example of the announcement data 222 displayed on the monitor 4, and according to the above-mentioned attribute 221 of the person requiring special attention, such as "A stroller customer will board. Thank you for your cooperation." A message is displayed. A similar message is output by voice on the speaker 5, and it can be expected that the surrounding passengers who notice that the stroller user has boarded the stroller will take care such as opening a passage for the stroller user.

The above is for a stroller user, but for example, in the case of a visually impaired person, according to the attribute 221 such as "A customer with a visually impaired rides. Please give up your seat." Can output different announcement data 222 on the monitor 4 and the speaker 5. The content of the announcement data 222 is not particularly limited as long as it is intended to encourage passengers to give consideration to persons requiring special attention. For example, just notifying that a person requiring special attention has boarded is an opportunity to give consideration to the person requiring special consideration.

Further, in the present embodiment, when the train is stopped and passengers get on and off, the above processing is performed using the moving image taken by the camera 3, and the above announcement data 222 may be voice only at the timing of getting on and off. For example, output is performed a certain number of times (for example, about 2 times), and for video, it is displayed for a short time (for example, about 1 minute). This is to avoid unnecessary troubles as it may be excessive to keep making such announcements for a long time.

It is also possible to set the positions of the monitor 4 and the speaker 5 for making an announcement according to the position of the doorway 110 on which the person requiring special attention has boarded. The entrance / exit 110 from which the person requiring special attention boarded can be determined by the camera 3 in which the person requiring special attention was detected from the image 6 or the position of the image 6 in which the person requiring special attention was detected. When a person requiring special attention gets on the vehicle from the doorway indicated by reference numeral 110a in FIG. 4, the announcement data 222 is output only by a part of the monitors 4 and the speakers 5 in the vicinity thereof.

(4. Judgment of necessity of consideration)
FIG. 10 is a flowchart showing a flow of determining the necessity of consideration performed in S4. As shown in FIG. 10, the server 2 detects the manifestation mark possessed by the person requiring special attention in S4 from the image 6 (S401).

That is, in the present embodiment, in order to enable the person requiring consideration to indicate whether he / she needs consideration or not, a predetermined mark (intention display mark) is distributed to the person requiring consideration in advance. Shall be. Some of the marks indicate that consideration is required and some indicate that consideration is not required. For example, FIG. 11A shows an example of the manifestation mark 10 indicating that consideration is required, and FIG. 11B shows an example. This is an example of the manifestation mark 10 indicating that consideration is not required. The manifestation mark 10 is in the form of a card that can be carried by a person requiring special attention, but its shape and design are not particularly limited, and it is sufficient that the manifestation mark 10 can be detected from the image 6 in possession.

When the server 2 detects the manifestation mark 10 and indicates that consideration is required (S401; Yes, S402; consideration is required), the server 2 terminates the processing of S4 as it requires consideration (S403). .. When the manifestation mark 10 indicating that consideration is not required is detected (S401; Yes, S402; consideration is not required), it is considered that consideration is not required (S404), and the process of S4 is terminated.

On the other hand, when the server 2 does not detect the manifestation mark 10 from the image 6 (S401; No), the server 2 detects the congestion status in the vehicle from the image 6 (S405). When it is determined from the detection result that the inside of the vehicle is congested (S406; Yes), the server 2 terminates the process of S4, considering that consideration is required (S407).

The specific method for detecting and determining the congestion status is not particularly limited, and a known image processing method or the like can be used. For example, the number of people existing in the image 6 is detected as the congestion situation in the vehicle, and if it is equal to or more than a predetermined value, it can be determined that the vehicle is congested.

On the other hand, when it is not determined in S406 that the inside of the vehicle is congested (S406; No), the server 2 further detects the operation of the person requiring special attention from the image 6 (S408). When it is determined from the detection result that the person requiring special attention is having trouble moving (S409; Yes), the server 2 terminates the process of S4, assuming that consideration is required (S410).

The specific method of detecting and determining the movement of the person requiring special attention is not particularly limited, and a known image processing method or the like can be used. For example, in the image 6 of a plurality of frames in chronological order, the person requiring attention has not moved for a certain period of time, and the face of the person requiring consideration is facing a plurality of directions (that is, the person requiring consideration is wandering around. If a situation such as (looking around) is detected, it is determined that the person requiring special attention is having trouble moving.

On the other hand, if it is not determined that the person requiring consideration is in trouble in moving (S409; No), the server 2 terminates the process of S4, assuming that consideration is unnecessary (S411).

Whether or not consideration is necessary may differ depending on the intention of the person requiring consideration, the congestion situation in the vehicle, the situation of the person requiring consideration, and the like. Therefore, as described above, by determining whether or not consideration for persons requiring special attention, that is, whether or not an announcement is necessary, can be made only when necessary.

As described above, in the guidance system 1 of the present embodiment, it is detected from the image 6 taken by the camera 3 that a person requiring special attention has boarded, and an announcement is made to encourage the passengers to give consideration to the person requiring special consideration. Do it automatically. As a result, it becomes possible to make the surrounding passengers aware of the existence of the person requiring special attention. Persons requiring special attention can make passengers around them aware of their existence without having to speak to them themselves, and can smoothly board and move inside the vehicle. In addition, passengers around can quickly notice the existence of people requiring special attention and can help naturally.

In addition, as mentioned above, there are various people such as wheelchair and stroller users, injured people, visually impaired people, pregnant women, etc. The consideration you want to have is different, such as whether you want to vacate your seat because you are seated. Therefore, in the present embodiment, by making different announcements according to the attribute 221 of the person requiring consideration, it is possible to encourage the passengers to give consideration according to the attribute 221 of the person requiring consideration.

In addition, whether or not consideration is required may differ depending on the intention of the person requiring consideration, the congestion situation in the vehicle, the situation of the person requiring consideration, and the like. Therefore, in the present embodiment, by determining in S4 whether or not consideration is necessary from these viewpoints, the announcement can be made only when necessary.

In particular, in the present embodiment, by using the detection result of the manifestation of intention mark 10 possessed by the person requiring consideration for the determination, it is possible to determine whether or not consideration is necessary according to the intention of the person requiring consideration. The manifestation of intention mark 10 includes not only the one indicating that consideration is necessary but also the one indicating that consideration is not required, and not only when the person requiring consideration needs consideration but also when consideration is not required. , Can clearly show that intention.

Further, in S4, the judgment using the detection result of the congestion status of the vehicle is also performed, and by determining whether or not consideration is necessary according to the congestion status of the vehicle, when the inside of the vehicle is vacant and no particular consideration is required. You can avoid making an announcement to.

In S4, a judgment is also made using the detection result of the movement of the person requiring consideration, and by determining whether or not consideration is necessary according to the situation of the person requiring consideration, for example, the person requiring consideration has trouble moving. If so, you can make an announcement to the passengers.

Further, in the present embodiment, the monitor 4 and the speaker 5 are used as a guidance device for making an announcement to the passengers, and the monitor 4 in the vehicle outputs the announcement and the speaker 5 in the vehicle outputs the announcement voice. Announcements can be effectively linked.

Further, in the present embodiment, since the image analysis is performed in S2 using the learned data 21 in which the characteristics of the person requiring special attention are learned by the deep learning method, the person requiring special consideration can be detected with high accuracy. It should be noted that such learned data 21 can also be used in determining the necessity in S4, and has been similarly learned for, for example, detection of the manifestation of intention mark 10 (S401) and detection of the movement of a person requiring special attention (S408). Data 21 can be used.

However, the present invention is not limited to the above embodiments. For example, the guidance system 1 of the present embodiment has been described by an example provided on a train, but it can be applied not only to a train but also to other vehicles such as a bus. Further, in the guidance system 1, not only when a person requiring special attention gets on the vehicle 100 from the platform of the station via the doorway 110, but also when a person requiring special care gets on the vehicle 100 from an adjacent vehicle via the doorway 120. In the same way, it is possible to detect the boarding of a person requiring consideration and determine the necessity of consideration.

Further, in the present embodiment, the server 2 detects the boarding of the person requiring consideration and determines the necessity of consideration, but it is also possible to perform these processes by the computer (information processing device) provided in the camera 3. Is.

Further, in the present embodiment, the manifestation of intention mark 10 dedicated to this system is distributed in advance to the person requiring special consideration, but predetermined marks already possessed by the person requiring special consideration, such as a help mark, a maternity mark, an ear mark, and a heart. It is also possible to make a determination in S401 and S402 by using a plus mark or the like instead of the manifestation mark 10 indicating that consideration is required. Similarly, instead of the manifestation mark 10 indicating that consideration is required, the stroller, wheelchair, white cane, and crutches themselves can be used as markers indicating that consideration is required, and the determination in S401 and S402 can be made.

Further, in the present embodiment, the detection result of the manifestation of intention mark 10, the detection result of the congestion status of the vehicle, and the detection result of the movement of the person requiring consideration are used for determining the necessity of consideration in S4. Only one or two may be used, or another information obtained from the image 6 may be used. In addition, it is possible to freely set when to make an announcement and when not to make an announcement.

Further, the number and installation positions of the camera 3, the monitor 4, the speaker 5, and the like are not limited to the example of FIG. For example, it is possible to provide the camera 3 in the vicinity of the entrance / exit 110 on the outer surface of the vehicle 100, detect the ride of a person requiring special attention from the image 6 taken by the camera 3, and determine the necessity of consideration.

In addition, in the guidance system 1 of the present embodiment, when it is detected that a person requiring special attention gets off at a predetermined station or platform that requires the support of station staff for movement, etc., the station staff at that station is notified to that effect. It is also possible to do. For example, if a train arrives at a station or platform without an elevator and the disembarkation of a person requiring special attention is detected from the above image 6, the station staff at that station is notified. The notification method is not particularly limited, but for example, the server 2 can send a notification that the person requiring special attention has disembarked to the terminal of the station or the mobile terminal owned by the station staff, and sound an alarm sound.

Although preferred embodiments of the guidance system and the like according to the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modifications or modifications within the scope of the technical idea disclosed in the present application, and these also naturally belong to the technical scope of the present invention. Understood.

1: Guidance system 2: Server 3, 3a, 3b, 3c: Camera 4: Monitor 5: Speaker 6: Image 10: Manifestation mark 21: Learned data 22: Announcement information 61: Stroller 100: Vehicle 110, 120: Doorway 210: Analysis means 220: Judgment means 221: Attribute 222: Announcement data 230: Transmission means

Claims (12)

It is a guidance system for making announcements to passengers in vehicles.
It has a camera, an information processing device, and a guidance device.
The information processing device
An analysis means that analyzes the image taken by the camera and detects the ride of a person requiring special attention.
A transmission means for transmitting announcement data to the guidance device for encouraging passengers to give consideration to the detected persons requiring special attention, and
With
The guidance device is a guidance system characterized by outputting the announcement data. The analysis means acquires the attributes of the person requiring special attention from the image and obtains them.
The guidance system according to claim 1, wherein the transmission means transmits announcement data according to the attribute to the guidance device. The information processing device further has a determination means for determining whether or not consideration for the person requiring consideration is necessary by using the image.
The guidance system according to claim 1 or 2, wherein the transmission means transmits the announcement data to the guidance device when it is determined that consideration for the person requiring consideration is required. The guidance system according to claim 3, wherein the determination means makes a determination using a detection result from the image of a predetermined mark possessed by the person requiring consideration. The guidance system according to claim 4, wherein the predetermined mark includes a mark indicating that consideration is not required. The guidance system according to any one of claims 3 to 5, wherein the determination means makes a determination using the detection result from the image of the congestion state of the vehicle. The guidance system according to any one of claims 3 to 6, wherein the determination means makes a determination using the detection result of the movement of the person requiring special attention from the image. The guidance system according to any one of claims 1 to 7, wherein the guidance device includes a monitor and a speaker. The guidance system according to any one of claims 1 to 8, wherein the analysis means analyzes the image using learned data obtained by learning the characteristics of the person requiring special attention by deep learning. An information processing device that is communicatively connected to a guidance device for making announcements to passengers in a vehicle.
An analysis method that analyzes the image taken by the camera and detects the ride of a person requiring special attention.
A transmission means for transmitting announcement data to the guidance device for encouraging passengers to give consideration to the detected persons requiring special attention, and
An information processing device characterized by being equipped with. An information processing device communicatively connected to a guidance device for making announcements to passengers in the vehicle
Steps to analyze the image taken by the camera and detect the ride of a person requiring special attention,
A step of transmitting announcement data to the guidance device for urging passengers to give consideration to the detected person requiring special attention, and
Guidance method characterized by executing. An information processing device that is communicatively connected to a guidance device for making announcements to passengers in the vehicle.
An analysis method that analyzes the image taken by the camera and detects the ride of a person requiring special attention.
A transmission means for transmitting announcement data to the guidance device for encouraging passengers to give consideration to the detected persons requiring special attention, and
A program to function as.

Images