JP2022167701A - Information processor, information processing program, method for processing information, and mobility signage system - Google Patents

Abstract

To secure the safety of a mobile body and increase the effect as a signage at the same time.SOLUTION: The information processor includes: a display determination unit for acquiring mobile body information of a mobile body having a display device, the display device being capable of displaying an image in the mobile body so that the image can be seen from the outside of the mobile body, and determining whether the display is in an on-state or in an off-state on the basis of the mobile body information; an image acquisition unit for acquiring an image from the image storage device; and a display control unit for turning on or turning off the display by controlling the display device on the basis of the result of determination by the display determination unit.SELECTED DRAWING: Figure 2

Description

The present disclosure relates to an information processing device, an information processing program, an information processing method, and a mobility signage system that display an image on a mobile object (such as a vehicle) to be visible from the outside of the mobile object.

A mobility signage technology has been proposed that displays an image on a vehicle window so that it can be visually recognized from the outside of the vehicle (Patent Document 1).

U.S. Patent Application Publication No. 2019/098268

In the mobility signage technology that displays images on a mobile object so that it can be visually recognized from the outside of the mobile object, it is desirable to ensure the safety of the mobile object while enhancing the effect of the signage.

An information processing device according to one aspect of the present disclosure includes:
a display determination unit that acquires moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, and determines whether to turn on or off the display based on the moving body information; ,
an image acquisition unit that acquires an image from an image storage device;
a display control unit that controls the display device to turn on or off the display of the image based on the determination result of the display determination unit.

According to this embodiment, the display determination unit determines whether the display should be turned on or off based on the mobile object information, so that the safety of the vehicle can be ensured.

The display determination unit
(A) obtaining opening/closing information of a door of the moving body as the moving body information, and determining to turn off the display when determining that the door is opened;
(B) acquiring actuation information of at least one of the winkers of the moving body as the moving body information, and determining to turn off the display when determining that the at least one winker is in operation;
(C) Acquiring operating information of a taximeter of the moving body as the moving body information, determining display OFF when determining that the taximeter is operating, and determining display ON when determining that the taximeter is not operating; to judge
(D) obtaining speed information of the moving body as the moving body information, determining display OFF when determining that the speed is equal to or higher than a first predetermined speed, and determining display ON when determining that the speed is less than the first predetermined speed;
(E) acquiring temperature information inside the moving body as the moving body information, determining to turn off the display when determining that the temperature is equal to or higher than a predetermined temperature, and determining to turn on the display when determining that the temperature is less than the predetermined temperature;
(F) Acquiring moving body presence information indicating whether or not another moving body exists within a first predetermined distance from the moving body as the moving body information; determining that the display is off when it is determined that a body exists, and determining that the display is on when it is determined that another moving body does not exist within the first predetermined distance; or (G) walking from the moving body as the moving body information. The display may be turned off when it is determined that the distance from the moving object to the sidewalk is greater than or equal to a second predetermined distance.

As a result, when there is a risk that the driver will not be able to drive safely, or if there is a risk that pedestrians will not be able to safely and effectively visually recognize the image displayed on the vehicle, the display will be automatically turned off. Safety can be guaranteed.

The display determination unit (A) determines that the door is closed, (B) determines that the at least one turn signal is not operating, (C) determines that the taximeter is not operating, (D) determining that the speed is less than the first predetermined speed; (E) determining that the temperature is less than the predetermined temperature; (F) determining that there is no other moving body within the first predetermined distance; ) When it is determined that the sidewalk is less than a second predetermined distance, it may be determined to turn on the display.

Thus, the display can be turned on only when the driver can drive safely or when the pedestrian can safely and effectively visually recognize the image displayed on the vehicle.

The moving body is capable of automatic operation,
The display determination unit must determine whether to turn on or off the display based on (B) operation information of at least one of the winkers of the moving body and (F) the moving body existence information while the moving body is automatically driving. good too.

When the vehicle is automatically driven, unlike manual driving by the driver, there is no need for the driver to visually confirm, so there is no problem even if an image is displayed on the vehicle. Also, the self-driving vehicle is capable of self-driving in a manner that is safe for other moving objects in the vicinity of the vehicle. In these cases, if the display is continued without changing the display ON state, the effect of the signage can be enhanced, and at the same time, the safety of the moving object can be ensured.

further comprising a switching determination unit that acquires external information of the moving body and determines whether or not to switch the image being displayed based on the external information;
The display control section may control the display device to switch the displayed image based on the determination result of the switching determination section.

According to this embodiment, since the switching determination unit determines whether to switch the image being displayed based on the external information, it is possible to enhance the advertisement effect as signage.

The image acquisition section may acquire a new image from the image storage device when the switching determination section determines to switch the image.

This makes it possible to always display an appropriate image.

The display control section may control the display device based on the determination result of the switching determination section to switch the display mode of the image being displayed.

For example, when the outside of the vehicle is brighter than a predetermined brightness, the display control unit switches the display mode (brightness, etc.) of the image being displayed to brightly display the image being displayed. As a result, the visibility is improved, so that the advertisement effect as a signage can be enhanced.

The switching determination unit
(a) acquiring the position information of the moving body as the external information, and determining that the moving body is in a predetermined area, determining to switch the display to an area image linked to the predetermined area;
(b) determining to switch the display to an emergency image related to the emergency information when emergency information is acquired as the external information;
(c) determining to switch the display to a reservation person image related to the reservation information when the reservation information of the mobile object is acquired as the external information;
(d) determining to switch the display to an operation image related to the operation information when operation information of a transportation system is acquired as the external information;
(e) determining to switch the display to a trouble image related to the trouble information when trouble information of the occupants of the moving object is acquired as the external information; or (f) brightness information outside the moving object as the external information. is acquired, and it is determined that the brightness of the image to be displayed is switched when it is determined that the outside of the moving object has a predetermined brightness or more.

By appropriately switching images, the effect of signage can be enhanced.

Even when the display determination unit determines that the display is turned off, the switching determination unit determines that the display is switched to the trouble image when (e) the trouble information of the occupant of the moving object is acquired as the external information. good.

As a result, the trouble information of the passengers of the moving body can be communicated to the outside at any time, so that the safety of the moving body can be enhanced.

The moving body is capable of automatic operation,
(e) the trouble information of the occupant of the mobile body is the trouble information of the driver of the mobile body;
The switching determination unit may not (e) determine whether to switch the image being displayed based on the trouble information of the driver of the moving body while the moving body is automatically driving.

When a vehicle is in automatic operation, there may be times when there is no driver, unlike in manual operation. In this case, if the display is continued without changing the display ON state, the effect as a signage can be enhanced.

When detecting that an occupant of the moving body has operated an operating device mounted on the moving body for inputting a request for switching an image being displayed, the display control unit controls the display device to display You can also switch images that

Thereby, the displayed image can be switched according to the passenger's intention.

The switching determination unit
When it is determined that the mobile body is on a non-public road or in a specific place, is stopped or the speed is equal to or lower than a second predetermined speed, or that there is no other mobile body within the first predetermined distance, a still image is displayed. It may be determined to switch the display to a slide show or moving image.

As a result, a slide show of still images or moving images can be displayed only when safety is ensured.

The image acquisition unit, from the image storage device,
images not related to the moving object;
An image showing information about the moving object, or an image related to images displayed by one or more other moving objects near the moving object may be acquired.

Thereby, the effect as a signage can be enhanced.

the moving body is a vehicle,
The display device may display images in one or more windows of the vehicle.

By using the windows of vehicles, which exist in large numbers in the environment, are eye-catching, and are the most familiar moving objects, as signage, the effect as signage can be enhanced, and a large profit effect can be expected.

An information processing program according to one aspect of the present disclosure includes
the processor of the information processing device,
a display determination unit that acquires moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, and determines whether to turn on or off the display based on the moving body information; ,
an image acquisition unit that acquires an image from an image storage device;
The display control unit controls the display device based on the determination result of the display determination unit to turn on or off the display of the image.

An information processing method according to one aspect of the present disclosure includes:
Acquiring moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, determining on or off of display based on the moving body information,
retrieving an image from an image store;
The display of the image is turned on or off by controlling the display device based on the judgment result.

A mobility signage system according to one embodiment of the present disclosure includes:
a display device provided in a moving body and capable of displaying an image on the moving body so as to be visible from the outside of the moving body;
a display determination unit that acquires moving body information of the moving body and determines whether to turn on or off the display based on the moving body information;
an image acquisition unit that acquires an image from an image storage device;
and an information processing apparatus comprising: a display control unit that controls the display device to turn on or off display of the image based on a determination result of the display determination unit.

1 is a side view of a mobile object according to an embodiment of the present disclosure; FIG. The hardware configuration of the mobility signage system is shown. 1 shows a functional configuration of an information processing device; 4 is a flow chart showing an overview of the operation of the information processing device; 4 shows an operation flow of a display determination unit; 4 shows the operation flow of the display determination unit (at the time of automatic operation). 4 shows an operation flow of a switching determination unit; 4 shows an operation flow of a switching determination unit (at the time of automatic operation); 10 shows an operation flow of a switching determination unit (at the time of video switching); 1 shows a configuration example of a vehicle control system; Examples of sensing regions are shown.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

1. Outline of moving body

FIG. 1 is a side view of a moving object according to an embodiment of the present disclosure; FIG.

In this embodiment, the moving object is described as a vehicle 1 . The vehicle 1 may be automatically operable or only manually operable. In this embodiment, the vehicle 1 is a taxi. However, the vehicle 1 may be a vehicle other than a taxi (for example, a private car, a bus, a microbus, a truck, a rideshare vehicle, a kitchen car, a delivery vehicle, a commercial vehicle, or other business vehicle). The vehicle 1 has a front window, a rear window, front side door windows on both sides and rear side door windows W1 on both sides.

A vehicle 1 is equipped with a mobility signage system 10 . The mobility signage system 10 displays an image on the vehicle 1 so as to be visible from the outside of the vehicle 1 . Specifically, the mobility signage system 10 displays images on one or more windows of the vehicle 1 . In this example, the mobility signage system 10 displays images on one or both rear side door windows W1 of the vehicle 1 . The image is, for example, an advertisement image or the like. In this manner, the mobility signage system 10 displays advertisement images and the like using the rear side door window W1 of the vehicle 1 as a digital signage screen. In the present embodiment, the term "image" simply means a still image rather than a moving image.

2. Hardware configuration of mobility signage system

FIG. 2 shows an overview of the mobility signage system.

A mobility signage system 10 mounted on a vehicle 1 mainly includes an information processing device 100, a contact and power supply box 200, and a display device 300 (projector) as a hardware configuration. The mobility signage system 10 further includes an operating device 210 , a main switch 220 for supplying power from the vehicle control system 11 to the contacts and the power supply box 200 , and a remote controller 310 as a hardware configuration.

The operating device 210 is a switch operated by a passenger (specifically, a driver) of the vehicle 1 . The operation device 210 functions as a switch for hiding images and a switch for switching displayed images. The operation device 210 is connected to the contact and power supply box 200 and outputs an operation signal to the contact and power supply box 200 . The operating device 210 is installed at a position (that is, near the driver's seat) that is easy for the passenger of the vehicle 1 to operate while riding.

The main switch 220 converts the power supplied from the vehicle control system 11 and supplies the converted power to the contacts and the power supply box 200 .

The contact and power supply box 200 acquires vehicle information (moving body information), which is various types of information about the vehicle 1 , and external information about the vehicle 1 from the vehicle control system 11 . The vehicle information includes, for example, turn signal operation information, taximeter operation information (empty car, rent, etc.), door open/close information, ACC (accessory signal by vehicle key operation), or IG (ignition signal by vehicle key operation). ) information, etc. The contact and power supply box 200 outputs vehicle information and external information to the information processing device 100 . The contact and power box 200 also filters power noise, controls power, and supplies DC power to the display device 300 . The contact and power supply box 200 is housed in the trunk of the vehicle 1, for example.

The information processing device 100 is, for example, a small personal computer. A communication interface 110 is attached to the information processing apparatus 100 . For example, communication interface 110 is configured as a USB dongle. The information processing device 100 is capable of mobile network communication with the server device 20 using the communication interface 110 . The information processing device 100 is connected to the contact and power supply box 200 via a USB cable, and is housed in the trunk of the vehicle 1 together with the contact and power supply box 200 .

The information processing device 100 acquires vehicle information and external information from the contact and power supply box 200 . Based on the vehicle information and the external information, the information processing apparatus 100 determines whether to turn on or off the image display, and further determines whether to switch the image being displayed. The information processing device 100 requests image data from the server device 20 based on the determination result, and acquires the image data. The information processing device 100 converts the image data into an HDMI video signal and outputs it to the display device 300 .

Remote controller 310 is USB-connected to information processing apparatus 100 and outputs an infrared signal to display device 300 . The remote controller 310 is controlled by the information processing apparatus 100 and outputs an infrared signal for controlling power on/off, input switching, image non-display, setting change, etc. to the display device 300 .

The display device 300 (projector) receives power supply from the contact and power supply box 200 . The display device 300 receives the HDMI video signal from the information processing device 100 and displays (projects) an image on the rear side door window W1. The display device 300 receives an infrared signal from a remote controller 310, and performs power on/off, input switching, image non-display, setting change, and the like. The display device 300 is installed on the ceiling of the rear seat of the vehicle 1 . For example, in the case of a right-hand drive vehicle 1 (that is, for left-hand drive), an image is displayed on the left rear side door window W1, so it is installed on the ceiling of the right rear seat. A display device 300 installed on the ceiling projects an image toward the rear side door window W1. As a result, an image is displayed on the rear side door window W1.

The rear side door window W1 is, for example, translucent glass that is sealed with a special film and that is transparent when images are not displayed. A rainproof side visor is installed on the upper part of the rear side door window W1.

The server device 20 is an image storage device that stores images displayed on the vehicle 1 and supplies them to the information processing device 100 . The server device 20 supplies the information processing device 100 with a reproduction display report and the like in addition to the image data. The server device 20 receives various settings from the administrator's personal computer 50 . The server device 20 backs up various data to the backup server device 40 .

3. Functional configuration of information processing device

FIG. 3 shows the functional configuration of the information processing device.

The information processing apparatus 100 functions as a display determination unit 101, a switching determination unit 102, an image acquisition unit 103, and a display control unit 104 by a processor such as a CPU loading an information processing program recorded in a ROM into a RAM and executing the program. Operate.

The display determination unit 101 acquires vehicle information of the vehicle 1 and determines whether the display is on or off based on the vehicle information. The vehicle information includes, for example, (A) door open/close information, (B) operation information of at least one turn signal, (C) taximeter operation information, (e) speed information, and (f) temperature information inside the vehicle 1. , (F) mobile object existence information indicating whether or not another mobile object exists (around the vehicle 1) within a first predetermined distance from the vehicle 1, and (G) indicating the distance from the vehicle 1 to the sidewalk. It is sidewalk distance information and the like.

The switching determination unit 102 acquires external information of the vehicle 1 and determines whether or not to switch the image being displayed based on the external information. The external information includes, for example, (a) location information of the vehicle 1, (b) emergency information, (c) reservation information of the vehicle 1, (e) trouble information of the occupants of the vehicle 1, and (f) brightness outside the vehicle 1. and (f) viewer information around the vehicle 1, and the like.

The image acquisition unit 103 acquires an image from the server device 20 as an image storage device via the network. The image acquisition unit 103 may read an image from a local storage device 105 as an image storage device. The local storage device 105 is a large-capacity non-volatile storage device such as an HDD or SSD. When the switching determination unit 102 determines to switch the image, the image acquisition unit 103 acquires a new image from the server device 20 as an image storage device or the local storage device 105 .

The display control unit 104 controls the display device 300 based on the determination result of the display determination unit 101 to turn on or off the display of the image acquired by the image acquisition unit 103 . The display control unit 104 controls the display device 300 based on the determination result of the switching determination unit 102 to switch the displayed image. The display control unit 104 controls the display device 300 according to the determination result of the switching determination unit 102 to switch the display mode (brightness, etc.) of the image being displayed.

4. Outline of operation of information processing device

FIG. 4 is a flow chart showing an overview of the operation of the information processing device.

As an example of the operation of the information processing device 100 mounted on the vehicle 1, it is assumed that the vehicle 1 is a taxi. As a scenario, vehicle 1 has no passengers (is empty).

The display determination unit 101 of the information processing device 100 acquires door open/close information of the vehicle 1 as vehicle information of the vehicle 1, and determines that the door is opened based on the door open/close information (step S101). When the display determination unit 101 determines that the door is opened, it determines to turn off the display of the image. If the image is displayed, the display control unit 104 controls the display device 300 based on the determination result of the display determination unit 101 to turn off the image display (step S102). The case where the image is displayed means that the vehicle 1 has been vacant for a long time and the door has been opened to pick up passengers. On the other hand, the case where no image is displayed means that a passenger is on board the vehicle 1 and the door is opened for the passenger to get off.

The display determination unit 101 acquires door open/close information of the vehicle 1 as vehicle information of the vehicle 1, and determines that the door is closed based on the door open/close information (step S103). The display determination unit 101 starts measuring time when the door is closed (step S104). After a certain period of time (eg, 5 minutes) has passed (step S105), the display determination unit 101 acquires operation information of the taximeter of the vehicle 1 as vehicle information (step S106). When the display determination unit 101 determines that the taximeter is in operation (that is, the taxi meter is running with the passenger on board), the display determination unit 101 determines to continue turning off the display (step S106, Yes).

On the other hand, when the display determination unit 101 determines that the taxi meter is not operating (that is, the passenger gets off and the taxi is empty) (step S106, No), the display determination unit 101 determines that the display is on. The display control unit 104 controls the display device 300 based on the determination result of the display determination unit 101 to start displaying the image acquired by the image acquisition unit 103 from the server device 20 as an image storage device (step S107).

Thus, in this embodiment, when the door is closed and the rear seats of the vehicle 1 are vacant (the taxi is vacant), an image is displayed on the rear side door window W1. On the other hand, if the door is open or there are passengers in the rear seats of the vehicle 1, the display is turned off. This is because the display device 300 (projector) projects an image toward the rear side door window W1. Therefore, if an image is displayed while the passenger is in the vehicle, the image light interferes with the passenger and the image is not completely displayed. This is because the light may not be present or the passenger may feel dazzling. This is the outline of this embodiment. The determination process of the information processing apparatus 100 will be described in more detail below.

5. Operation flow of the display judgment unit

FIG. 5 shows the operation flow of the display determination unit.

The display determination unit 101 of the information processing device 100 may perform the following determination process at the timing described with reference to FIG. The display determination unit 101 may further perform the following determination processing during image display.

The display determination unit 101 of the information processing device 100 (A) acquires the door open/close information of the vehicle 1 as the vehicle information, and when determining that the door is opened (step S201, Yes), determines that the display is turned off (step S209). ). As described above (steps S102 and S103), when the door is opened, there is a possibility that passengers will get on and off. Therefore, the display is turned off so that the image light does not interfere with the passengers or the image light does not go out of the vehicle 1 through the open door.

When the display determination unit 101 of the information processing device 100 acquires operation information of at least one of the winkers of the vehicle 1 as (B) vehicle information, and determines that at least one of the winkers is operating (step S202, Yes), the display is turned off. (step S209). At least one of the winkers is the left winker in the case of a right-hand drive vehicle 1 (that is, for left-hand drive). When the driver turns left, if an image is displayed on the left rear side door window W1, it is difficult for the driver to visually check the left sidewalk, etc., and safety is poor. Therefore, when the left winker is in operation, the display is turned off so that the driver can visually confirm the left sidewalk or the like.

The display determination unit 101 of the information processing device 100 acquires operation information of the taximeter of the vehicle 1 as (C) vehicle information, and when determining that the taximeter is in operation (step S203, Yes), determines to turn off the display ( step S209). As described above (step S106), the operation of the taximeter means that the passenger is on board. If an image is displayed while riding, the image light interferes with the passenger and the image is not completely displayed, or the passenger feels dazzled, so the display is turned off.

The display determination unit 101 of the information processing device 100 (e) acquires the speed information of the vehicle 1 as the vehicle information, and when determining that the speed is equal to or higher than the first predetermined speed (step S204, Yes), determines to turn off the display (step S209). ). The first predetermined speed is, for example, about the traveling speed on an expressway. When the running speed is high, even if an image is displayed on the vehicle 1, the pedestrians outside cannot visually recognize it accurately, so the display is turned off.

The display determination unit 101 of the information processing device 100 (f) acquires the temperature information inside the vehicle 1 as the vehicle information, and when determining that the temperature is equal to or higher than the predetermined temperature (step S205, Yes), determines to turn off the display (step S209). The display determination unit 101 acquires temperature information from a temperature sensor (described later) of the in-vehicle sensor 26 . When the temperature inside the vehicle 1 reaches a predetermined temperature or higher in summer, etc., and image light is output from the display device 300, the temperature of the display device 300 becomes too high, and devices may not operate normally. The display is turned off because there is a risk that the temperature inside the will rise further.

The display determination unit 101 of the information processing device 100 acquires (F) vehicle information indicating whether or not another moving object exists within a first predetermined distance from the vehicle 1, and acquires the first moving object presence information. If it is determined that another mobile object exists within the predetermined distance (step S206, Yes), it is determined to turn off the display (step S209). The display determination unit 101 acquires moving object presence information from the camera 51, the radar 52, the LiDAR 53, and the ultrasonic sensor 54 (described later) of the external recognition sensor 25. FIG. "Other moving objects" include not only vehicles but also pedestrians, bicycles, motorcycles, and the like. The first predetermined distance means the circumference of the vehicle 1 , in other words, a very short distance of the vehicle 1 . If an image is displayed on the vehicle 1 when there are pedestrians or cyclists very close to the vehicle 1, the pedestrians and cyclists will be distracted by the images, and the pedestrians and cyclists may take dangerous actions. display is turned off.

The display determination unit 101 of the information processing device 100 acquires sidewalk distance information indicating the distance from the vehicle 1 to the sidewalk (the left sidewalk in the case of driving on the left side) as (G) vehicle information, and determines the second predetermined distance to the sidewalk. If it is determined that the above is the case, it is determined to turn off the display (step S207, Yes), and it is determined to turn off the display (step S209). The second predetermined distance is, for example, a distance with a relatively large lane width of about two lanes. If the distance from the vehicle 1 to the sidewalk is longer than the second predetermined distance, that is, the distance from the vehicle 1 to the sidewalk is large, even if an image is displayed on the vehicle 1, pedestrians outside cannot visually recognize it accurately. turn off.

On the other hand, if (A) the door is closed (step S201, No), there is no possibility that the passenger will get on or off the vehicle. I never go out. (B) If at least one of the winkers is not operating (step S202, No), the vehicle 1 is traveling straight ahead. (C) If the taximeter is not operating (step S203, No), no passengers are on board the vehicle 1; (e) If the speed of the vehicle 1 is less than the first predetermined speed (step S204, No), the running speed is not high. (f) When the temperature inside the vehicle 1 is less than the predetermined temperature (step S205, No), the display device 300 does not become too hot. (F) If there is no other moving body within the first predetermined distance from the vehicle 1 (step S206, No), there is no danger to surrounding moving bodies (pedestrians, bicycles, motorcycles, etc.). . (G) If the distance from the vehicle 1 to the sidewalk is not less than the second predetermined distance (step S207, No), the image displayed on the vehicle 1 can be accurately visually recognized by pedestrians outside.

When all of these conditions are satisfied (steps S201 to S207 are all No), the display determination unit 101 of the information processing apparatus 100 determines that the driver can drive safely and that pedestrians and the like are displayed on the vehicle 1. Since it can be visually recognized safely and effectively, it is determined to continue to turn on the display (step S208).

FIG. 6 shows the operation flow of the display determination unit (at the time of automatic operation).

A case where the vehicle 1 can be automatically driven will be described. Only points different from the processing in FIG. 5 (steps S201 to S209) will be described.

The display determination unit 101 of the information processing device 100 does not determine whether to turn on or off the display based on operation information of at least one of the winkers of the vehicle 1 as (B) vehicle information while the vehicle 1 is automatically driving (step S202). This is because when the vehicle 1 is automatically driven, it is not necessary for the driver to visually check the sidewalk on the left side when turning left, unlike in manual driving by the driver. This is because there is no problem even if is displayed.

While the vehicle 1 is automatically driving, the display determination unit 101 of the information processing device 100 detects other mobile objects (vehicles, pedestrians, bicycles, motorcycles, etc.) within a first predetermined distance from the vehicle 1 as (F) vehicle information. Whether the display is on or off is not determined based on the mobile body presence information indicating whether or not there is a mobile object (step S206). This is because the automatically driven vehicle 1 can be automatically driven so as to be safe from other moving objects (vehicles, pedestrians, bicycles, motorcycles, etc.) around the vehicle 1 .

6. Operation flow of switching judgment part

FIG. 7 shows the operation flow of the switching determination unit.

The switching determination unit 102 of the information processing apparatus 100 may perform the following determination process at the timing described with reference to FIG. 4, that is, at the timing when the image display is started (step S107). The switching determination unit 102 may further perform the following determination processing during image display.

When the switching determination unit 102 of the information processing device 100 (a) acquires the position information of the vehicle 1 as the external information and determines that the vehicle 1 is in the predetermined area (step S301, Yes), the switching determination unit 102 is associated with the predetermined area. It is determined to switch the display to the area image (step S308). The image acquisition unit 103 transmits the attributes of the predetermined area determined by the switching determination unit 102 to the server device 20 and acquires from the server device 20 an area image associated with the predetermined area. The switching determination unit 102 acquires position information of the vehicle 1 from a GPS device or the like mounted on the vehicle 1 . The predetermined area is, for example, a downtown area, a business area, a sports facility such as a baseball stadium, or a residential area. The area image linked to the predetermined area is, for example, an advertisement image of facilities and goods (alcohol, karaoke, etc.) linked to the downtown area, an advertisement image of B2B services linked to the business district, and a sports facility. It is an advertisement image of goods (athlete-related goods, sporting goods, etc.) linked to.

When (b) emergency information is acquired as external information (step S302, Yes), the switching determination unit 102 of the information processing apparatus 100 determines to switch the display to an emergency image related to the emergency information (step S308). The image acquisition unit 103 acquires emergency images from the local storage device 105 or the server device 20 . The emergency information is information that notifies the voice of a disaster such as an earthquake. The emergency image is, for example, an alert image.

When the reservation information of the vehicle 1 is acquired as (c) external information (step S303, Yes), the switching determination unit 102 of the information processing device 100 determines to switch the display to a reservation image related to the reservation information (step S308). The image acquisition unit 103 acquires reserved images from the server device 20 . When the vehicle 1 is a taxi or a ride-sharing vehicle, the reservation information is information about the person making the reservation or information about the driver, and is information to be displayed when picking up the vehicle. The information about the reservation person is, for example, information for identifying the reservation person. Information about the driver includes the driver's name, portrait, rating, and the like. The reservation image may be the same image as the screen of the dispatch application displayed on a mobile device such as a smartphone owned by the reservation person. The switching determination unit 102 may transmit a beacon to a mobile device such as a smartphone possessed by the reservation person, and receive information about the reservation person from the mobile device.

The switching determination unit 102 of the information processing device 100 (d) determines to switch the display to the operation image related to the operation information when the operation information of the transportation system is acquired as the external information (step S304, Yes). The image acquisition unit 103 acquires operation images from the server device 20 . The operation image is, for example, an image indicating transportation information (train suspension or delay information, road interruption information), an image indicating road interruption information, or an image indicating public guidance information.

The switching determination unit 102 of the information processing device 100 (e) determines to switch the display to a trouble image related to the trouble information when the trouble information of the occupant of the vehicle 1 is acquired as the external information (step S305, Yes) (step S308). . Note that even when the display determination unit 101 determines that the display is turned off (step S209), the switching determination unit 102 obtains the trouble information of the occupant of the vehicle 1 as (e) external information (step S305, Yes). (step S308). The image acquisition unit 103 acquires trouble images from the local storage device 105 or the server device 20 . The trouble information is information indicating poor physical condition of the driver, information indicating a crime committed by a passenger, or the like. The switching determination unit 102 may acquire the trouble information by in-cabin monitoring of the in-vehicle sensor 26 and the DMS 30 (described later), or by the operation of the operation device 210 by the driver. A trouble image is an image showing an SOS.

When the switching determination unit 102 of the information processing device 100 acquires (f) information about the brightness of the outside of the vehicle 1 as the external information, and determines that the brightness of the outside of the vehicle 1 is equal to or higher than a predetermined brightness (step S306, Yes), the display It is determined to switch the brightness of the image to be displayed (step S308). The image acquisition unit 103 transmits to the server device 20 a notification indicating that the outside of the vehicle 1 has a predetermined brightness or higher, and acquires a brighter image from the server device 20 . The switching determination unit 102 acquires information about brightness outside the vehicle 1 from an illuminance sensor mounted on the vehicle 1, a camera 51 (described later), or the like. The brightness information of the outside of the vehicle 1 may be the illuminance value itself, or may be information linked to the attribute of the area, such as brighter lighting in a downtown area than in a residential area. For example, the switching determination unit 102 may determine to display a vivid bright image in a downtown area, and determine to display an ecological image in terms of illuminance in a residential area.

The display control unit 104 of the information processing device 100 controls the display device 300 based on the determination result of the switching determination unit 102 to switch the image being displayed to the image acquired by the image acquisition unit 103 . Specifically, when the display control unit 104 detects that the occupant (driver) of the vehicle 1 has operated the operation device 210 for inputting a request for switching the image being displayed as a trigger, the display device 300 to switch the displayed image. The operation of the operation device 210 as a trigger for switching the display image may be, for example, not only the operation of the operation device 210 dedicated to switching the display image, but also the operation of a door open/close button.

When the switching determination unit 102 (f) determines that the brightness outside the vehicle 1 is equal to or higher than the predetermined brightness (step S306, Yes), the display control unit 104 controls the display device 300 to change the display mode of the image being displayed ( brightness, etc.) may be switched. That is, (f) when the outside of the vehicle 1 is brighter than a predetermined brightness, the display control unit 104 displays the bright image acquired by the image acquisition unit 103, or brightly displays the image being displayed. The display control unit 104 may have a shade function for blocking sunlight. The display control unit 104 of the information processing device 100 may change the display area according to the degree to which the window is open (the window is lowered).

If all of these conditions are satisfied (No in steps S301 to S306), the switching determination unit 102 of the information processing apparatus 100 determines that there is no need to switch images (step S307).

FIG. 8 shows the operation flow of the switching determination unit (at the time of automatic operation).

A case where the vehicle 1 can be automatically driven will be described. Only points different from the processing in FIG. 7 (steps S301 to S308) will be described.

When the vehicle 1 is automatically driving, the switching determining unit 102 of the information processing device 100 (e) switches the image being displayed based on the trouble information of the driver of the vehicle 1 when the vehicle 1 is automatically driving. is not determined (step S305). This is because when the vehicle 1 is automatically driven, unlike manual driving by the driver, there may be cases where the driver is not present.

FIG. 9 shows the operation flow of the switching determination unit (at the time of video switching).

As described above, simply referring to an “image” in this embodiment means a still image rather than a moving image, and the information processing apparatus 100 controls display of the still image (advertising image, etc.). An example in which the information processing apparatus 100 switches display from a still image display to a slide show of still images or a moving image under predetermined conditions in compliance with laws and regulations will be described below. Laws and regulations mean the laws and regulations of the country or region where this embodiment is implemented at the time of implementation of this embodiment.

When the switching determination unit 102 of the information processing device 100 determines that the vehicle 1 is on a road other than a public road (that is, a private road) (step S401, Yes), it determines to switch the display to a slide show of still images or moving images (step S407). . The switching determination unit 102 may acquire the position information of the vehicle 1 from a GPS device or the like mounted on the vehicle 1 and determine that the vehicle 1 is on a road other than the public road.

When the switching determination unit 102 of the information processing device 100 determines that the vehicle 1 is in the specific location (step S402, Yes), it determines to switch the display to a slide show of still images or moving images (step S407). The specific place is, for example, within an area such as a hotel, a hospital, a shopping facility, or the like. The switching determination unit 102 may acquire the position information of the vehicle 1 from a GPS device or the like mounted on the vehicle 1 and determine that the vehicle 1 is at a specific location.

When the switching determination unit 102 of the information processing device 100 determines that the vehicle 1 is stopped (step S403, Yes), it determines to switch the display to a slide show of still images or moving images (step S407).

When the switching determination unit 102 of the information processing device 100 determines that the speed of the vehicle 1 is equal to or lower than the second predetermined speed (step S404, Yes), it determines to switch the display to a slide show of still images or moving images (step S407). ). The second predetermined speed is, for example, 10 km/h, which is a slow crawl speed.

When the switching determination unit 102 of the information processing device 100 determines that there is no other moving object within the first predetermined distance from the vehicle 1 (around the vehicle 1) (step S405, Yes), a slide show of still images or moving images is performed. (step S407).

When the switching determination unit 102 of the information processing apparatus 100 determines to switch the display to a slide show of still images or moving images (step S407), the image acquisition unit 103 acquires still images or moving images to be slide-showed from the server device 20. FIG. The display control unit 104 controls the display device 300 based on the determination result of the switching determination unit 102 to switch the image being displayed to the image acquired by the image acquisition unit 103 .

On the other hand, if all of these conditions are not satisfied (steps S401 to S405 are all No), the switching determination unit 102 of the information processing apparatus 100 determines to continue displaying the still image (step S406).

7. Embodiment variations

Describe variations of displayed images. The image acquisition unit 103 of the information processing device 100 acquires an advertisement image unrelated to the vehicle 1, an image showing information about the vehicle 1, or one or more other images near the vehicle 1 from the server device 20 as an image storage device. An image associated with the image displayed by the vehicle 1 is obtained. The display control unit 104 controls the display device 300 to display the image acquired by the image acquisition unit 103 .

Images not related to the vehicle 1 include, for example, the area image (step S301), the emergency image (step S302), the operation image (step S304), etc., as described above. Note that the advertisement image is not limited to the area image linked to the predetermined area (step S301), and an advertisement image that is not linked to anything may simply be displayed.

The image showing the information about the vehicle 1 includes, for example, the reservation image (step S303), the trouble image (step S305), etc., as described above. As another example of the image showing information about the vehicle 1, an image showing the temperature inside the vehicle 1, an image showing the cleanliness inside the vehicle 1 (ventilated, sterilized, etc.), a product sold inside the vehicle 1 (bottle drink , foods such as confectionery, sampling products, etc.), and images showing services provided by the vehicle 1 (shared rides, food delivery, passenger-carrying, etc.), and the like. The image showing information about the vehicle 1 for automatic driving includes an image showing information on MRM (Minimum Risk Maneuver), an image showing information on DSSAD (Data Storage System for Automated Driving vehicles), and the like.

Examples of images related to shared-ride services include images showing the number of people who can ride, the destination and direction, the remaining number of people who can ride, and the like. This makes it possible to display information such as the number of people who can ride together, which cannot be displayed with existing lanterns and super signs. Pedestrians can easily use the vehicle 1 by displaying an image related to the sharing service in a predetermined area (for example, an intersection waiting for a traffic light, a taxi stand, etc.). Examples of images related to food delivery services include images of food that is currently being delivered, and images of advertisements, menus, and coupons for restaurants that provide the food. As a result, restaurants can expect not only to simply deliver food, but also to increase advertising effects. Further, an image related to restaurants near the point where the vehicle 1 that is providing the food delivery service is traveling may be displayed.

Displaying an image related to an image displayed by one or more other vehicles 1 in the vicinity of the vehicle 1 means, for example, a plurality of vehicles 1 traveling in a convoy, a plurality of vehicles 1 in the same or a neighboring area, and the like. , display the same image or related images (eg, advertisement images provided by the same advertisement provider).

Even if the switching determination unit 102 of the information processing device 100 acquires viewer information around the vehicle 1 as external information and determines to switch the display to an image linked to the viewer's attribute (age, etc.). good. The switching determination unit 102 acquires viewer information from a camera 51 (described later) or the like mounted on the vehicle 1 .

If the vehicle 1 can only be driven automatically and cannot be driven manually, the window is not required to be transparent. Therefore, display device 300 may not be a projector that projects image light onto a window. As the display device 300, a direct display device (such as an organic EL display) provided at the position of the window may be used. If the display device 300 is a direct display device instead of a projector, the image light does not interfere with the passenger, so the image can be displayed while the passenger is on board.

When the vehicle 1 can be driven automatically, the image can be displayed not only on the rear side door window W1, but also on the front window, the rear window and both front side door windows. This is because when the vehicle 1 is automatically driven, unlike manual driving by the driver, the driver does not need to visually check the surroundings, so there is no problem even if images are displayed in each window.

8. Vehicle configuration

FIG. 10 shows a configuration example of the vehicle control system 11. As shown in FIG.

The vehicle control system 11 is provided in the vehicle 1 and performs processing related to driving support and automatic driving of the vehicle 1 .

The vehicle control system 11 includes a vehicle control ECU (Electronic Control Unit) 21, a communication unit 22, a map information storage unit 23, a position information acquisition unit 24, an external recognition sensor 25, an in-vehicle sensor 26, a vehicle sensor 27, a storage unit 28, a driving It has an assistance/automatic driving control unit 29 , a DMS (Driver Monitoring System) 30 , an HMI (Human Machine Interface) 31 , and a vehicle control unit 32 .

Vehicle control ECU 21, communication unit 22, map information storage unit 23, position information acquisition unit 24, external recognition sensor 25, in-vehicle sensor 26, vehicle sensor 27, storage unit 28, driving support/automatic driving control unit 29, driver monitoring system ( DMS) 30 , human machine interface (HMI) 31 , and vehicle control unit 32 are connected via a communication network 41 so as to be able to communicate with each other. The communication network 41 is, for example, a CAN (Controller Area Network), a LIN (Local Interconnect Network), a LAN (Local Area Network), a FlexRay (registered trademark), or an in-vehicle communication network conforming to a digital two-way communication standard such as Ethernet (registered trademark). It is composed of a communication network, a bus, and the like. The communication network 41 may be used properly depending on the type of data to be transmitted. For example, CAN may be applied to data related to vehicle control, and Ethernet may be applied to large-capacity data. Each part of the vehicle control system 11 performs wireless communication assuming relatively short-range communication such as near field communication (NFC (Near Field Communication)) or Bluetooth (registered trademark), for example, without going through the communication network 41. may be connected directly using

In addition, hereinafter, when each part of the vehicle control system 11 communicates via the communication network 41, the description of the communication network 41 shall be omitted. For example, when the vehicle control ECU 21 and the communication unit 22 communicate via the communication network 41, it is simply described that the vehicle control ECU 21 and the communication unit 22 communicate.

Vehicle control ECU21 is comprised by various processors, such as CPU(Central Processing Unit) and MPU(Micro Processing Unit), for example. The vehicle control ECU 21 controls the functions of the entire vehicle control system 11 or a part thereof.

The communication unit 22 communicates with various devices inside and outside the vehicle, other vehicles, servers, base stations, etc., and transmits and receives various data. At this time, the communication unit 22 can perform communication using a plurality of communication methods.

Communication with the outside of the vehicle that can be performed by the communication unit 22 will be described schematically. The communication unit 22 is, for example, 5G (fifth generation mobile communication system), LTE (Long Term Evolution), DSRC (Dedicated Short Range Communications), etc., via a base station or access point, via a wireless communication system, on the external network communicates with a server (hereinafter referred to as an external server) located in the The external network with which the communication unit 22 communicates is, for example, the Internet, a cloud network, or a provider's own network. The communication method that the communication unit 22 performs with the external network is not particularly limited as long as it is a wireless communication method that enables digital two-way communication at a communication speed of a predetermined value or more and a distance of a predetermined value or more.

Further, for example, the communication unit 22 can communicate with a terminal existing in the vicinity of the own vehicle using P2P (Peer To Peer) technology. Terminals in the vicinity of one's own vehicle are, for example, terminals worn by mobile bodies such as pedestrians and bicycles that move at a relatively low speed, terminals installed at fixed locations such as stores, or MTC (Machine Type Communication) terminal. Furthermore, the communication unit 22 can also perform V2X communication. V2X communication includes, for example, vehicle-to-vehicle communication with other vehicles, vehicle-to-infrastructure communication with roadside equipment, etc., and vehicle-to-home communication. , and communication between the vehicle and others, such as vehicle-to-pedestrian communication with a terminal or the like possessed by a pedestrian.

The communication unit 22 can receive, for example, a program for updating software that controls the operation of the vehicle control system 11 from the outside (Over The Air). The communication unit 22 can also receive map information, traffic information, information around the vehicle 1, and the like from the outside. Further, for example, the communication unit 22 can transmit information about the vehicle 1, information about the surroundings of the vehicle 1, and the like to the outside. The information about the vehicle 1 that the communication unit 22 transmits to the outside includes, for example, data indicating the state of the vehicle 1, recognition results by the recognition unit 73, and the like. Furthermore, for example, the communication unit 22 performs communication corresponding to a vehicle emergency call system such as e-call.

For example, the communication unit 22 receives electromagnetic waves transmitted by a vehicle information and communication system (VICS (registered trademark)) such as radio wave beacons, optical beacons, and FM multiplex broadcasting.

Communication with the inside of the vehicle that can be performed by the communication unit 22 will be described schematically. The communication unit 22 can communicate with each device in the vehicle using, for example, wireless communication. The communication unit 22 performs wireless communication with devices in the vehicle using a communication method such as wireless LAN, Bluetooth, NFC, and WUSB (Wireless USB) that enables digital two-way communication at a communication speed higher than a predetermined value. can be done. Not limited to this, the communication unit 22 can also communicate with each device in the vehicle using wired communication. For example, the communication unit 22 can communicate with each device in the vehicle by wired communication via a cable connected to a connection terminal (not shown). The communication unit 22 performs digital two-way communication at a predetermined communication speed or higher by wired communication such as USB (Universal Serial Bus), HDMI (High-Definition Multimedia Interface) (registered trademark), and MHL (Mobile High-definition Link). can communicate with each device in the vehicle.

Here, the in-vehicle device refers to, for example, a device in the vehicle that is not connected to the communication network 41 . Examples of in-vehicle devices include mobile devices and wearable devices possessed by passengers such as drivers, information devices that are brought into the vehicle and temporarily installed, and the like.

The map information accumulation unit 23 accumulates one or both of an externally acquired map and a map created by the vehicle 1 . For example, the map information accumulation unit 23 accumulates a three-dimensional high-precision map, a global map covering a wide area, and the like, which is lower in accuracy than the high-precision map.

High-precision maps are, for example, dynamic maps, point cloud maps, vector maps, and the like. The dynamic map is, for example, a map consisting of four layers of dynamic information, quasi-dynamic information, quasi-static information, and static information, and is provided to the vehicle 1 from an external server or the like. A point cloud map is a map of a point cloud (point cloud data). A vector map is, for example, a place adapted to ADAS (Advanced Driver Assistance System) and AD (Autonomous Driving) by associating traffic information such as lane and traffic signal positions with a point cloud map.

The point cloud map and the vector map, for example, may be provided from an external server or the like, and based on the sensing results of the camera 51, radar 52, LiDAR 53, etc., as a map for matching with a local map described later. It may be created by the vehicle 1 and stored in the map information storage unit 23 . Further, when a high-precision map is provided from an external server or the like, in order to reduce the communication capacity, map data of, for example, several hundred meters square, regarding the planned route that the vehicle 1 will travel from now on, is acquired from the external server or the like. .

The position information acquisition unit 24 receives GNSS signals from GNSS (Global Navigation Satellite System) satellites and acquires position information of the vehicle 1 . The acquired position information is supplied to the driving support/automatic driving control unit 29 . Note that the location information acquisition unit 24 is not limited to the method using GNSS signals, and may acquire location information using beacons, for example.

The external recognition sensor 25 includes various sensors used for recognizing external conditions of the vehicle 1 and supplies sensor data from each sensor to each part of the vehicle control system 11 . The type and number of sensors included in the external recognition sensor 25 are arbitrary.

For example, the external recognition sensor 25 includes a camera 51 , a radar 52 , a LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) 53 and an ultrasonic sensor 54 . The configuration is not limited to this, and the external recognition sensor 25 may be configured to include one or more types of sensors among the camera 51 , radar 52 , LiDAR 53 , and ultrasonic sensor 54 . The numbers of cameras 51 , radars 52 , LiDARs 53 , and ultrasonic sensors 54 are not particularly limited as long as they are realistically installable in the vehicle 1 . Moreover, the type of sensor provided in the external recognition sensor 25 is not limited to this example, and the external recognition sensor 25 may be provided with other types of sensors. An example of the sensing area of each sensor included in the external recognition sensor 25 will be described later.

Note that the imaging method of the camera 51 is not particularly limited. For example, cameras of various types such as a ToF (Time Of Flight) camera, a stereo camera, a monocular camera, and an infrared camera, which are capable of distance measurement, can be applied to the camera 51 as necessary. The camera 51 is not limited to this, and may simply acquire a photographed image regardless of distance measurement.

Also, for example, the external recognition sensor 25 can include an environment sensor for detecting the environment with respect to the vehicle 1 . The environment sensor is a sensor for detecting the environment such as weather, climate, brightness, etc., and can include various sensors such as raindrop sensors, fog sensors, sunshine sensors, snow sensors, and illuminance sensors.

Furthermore, for example, the external recognition sensor 25 includes a microphone used for detecting sounds around the vehicle 1 and the position of a sound source.

The in-vehicle sensor 26 includes various sensors for detecting information inside the vehicle, and supplies sensor data from each sensor to each section of the vehicle control system 11 . The types and number of various sensors included in the in-vehicle sensor 26 are not particularly limited as long as they are the types and number that can be realistically installed in the vehicle 1 .

For example, in-vehicle sensors 26 may comprise one or more of cameras, radar, seat sensors, steering wheel sensors, microphones, biometric sensors, temperature sensors. As the camera provided in the in-vehicle sensor 26, for example, cameras of various shooting methods capable of distance measurement, such as a ToF camera, a stereo camera, a monocular camera, and an infrared camera, can be used. The camera included in the in-vehicle sensor 26 is not limited to this, and may simply acquire a photographed image regardless of distance measurement. The biosensors included in the in-vehicle sensor 26 are provided, for example, on a seat, a steering wheel, or the like, and detect various biometric information of a passenger such as a driver.

The vehicle sensor 27 includes various sensors for detecting the state of the vehicle 1 and supplies sensor data from each sensor to each section of the vehicle control system 11 . The types and number of various sensors included in the vehicle sensor 27 are not particularly limited as long as the types and number are practically installable in the vehicle 1 .

For example, the vehicle sensor 27 includes a speed sensor, an acceleration sensor, an angular velocity sensor (gyro sensor), and an inertial measurement unit (IMU (Inertial Measurement Unit)) integrating them. For example, the vehicle sensor 27 includes a steering angle sensor that detects the steering angle of the steering wheel, a yaw rate sensor, an accelerator sensor that detects the amount of operation of the accelerator pedal, and a brake sensor that detects the amount of operation of the brake pedal. For example, the vehicle sensor 27 includes a rotation sensor that detects the number of rotations of an engine or a motor, an air pressure sensor that detects tire air pressure, a slip rate sensor that detects a tire slip rate, and a wheel speed sensor that detects the rotational speed of a wheel. A sensor is provided. For example, the vehicle sensor 27 includes a battery sensor that detects the remaining battery level and temperature, and an impact sensor that detects external impact.

The storage unit 28 includes at least one of a nonvolatile storage medium and a volatile storage medium, and stores data and programs. The storage unit 28 is used, for example, as an EEPROM (Electrically Erasable Programmable Read Only Memory) and a RAM (Random Access Memory). And a magneto-optical storage device can be applied. The storage unit 28 stores various programs and data used by each unit of the vehicle control system 11 . For example, the storage unit 28 includes an EDR (Event Data Recorder) and a DSSAD (Data Storage System for Automated Driving), and stores information on the vehicle 1 before and after an event such as an accident and information acquired by the in-vehicle sensor 26 . The information of the vehicle 1 stored in the storage unit 28 may include information of an image displayed on the window by the display device 300 . Before and after an event such as an accident, the image displayed on the window by the display device 300 is stored, so that it is possible to check whether the image was displayed in a legally compliant manner before and after the event such as an accident. It becomes possible to make a judgment after the fact, and it can be used for post-mortem verification and calculation of the percentage of negligence.

The driving support/automatic driving control unit 29 controls driving support and automatic driving of the vehicle 1 . For example, the driving support/automatic driving control unit 29 includes an analysis unit 61 , an action planning unit 62 and an operation control unit 63 .

The analysis unit 61 analyzes the vehicle 1 and its surroundings. The analysis unit 61 includes a self-position estimation unit 71 , a sensor fusion unit 72 and a recognition unit 73 .

The self-position estimation unit 71 estimates the self-position of the vehicle 1 based on the sensor data from the external recognition sensor 25 and the high-precision map accumulated in the map information accumulation unit 23 . For example, the self-position estimation unit 71 generates a local map based on sensor data from the external recognition sensor 25, and estimates the self-position of the vehicle 1 by matching the local map and the high-precision map. The position of the vehicle 1 is based on, for example, the center of the rear wheel versus axle.

The local map is, for example, a three-dimensional high-precision map created using a technique such as SLAM (Simultaneous Localization and Mapping), an occupancy grid map, or the like. The three-dimensional high-precision map is, for example, the point cloud map described above. The occupancy grid map divides the three-dimensional or two-dimensional space around the vehicle 1 into grids (lattice) of a predetermined size, and indicates the occupancy state of objects in grid units. The occupancy state of an object is indicated, for example, by the presence or absence of the object and the existence probability. The local map is also used, for example, by the recognizing unit 73 for detection processing and recognition processing of the situation outside the vehicle 1 .

The self-position estimation unit 71 may estimate the self-position of the vehicle 1 based on the position information acquired by the position information acquisition unit 24 and sensor data from the vehicle sensor 27 .

The sensor fusion unit 72 combines a plurality of different types of sensor data (for example, image data supplied from the camera 51 and sensor data supplied from the radar 52) to perform sensor fusion processing to obtain new information. . Methods for combining different types of sensor data include integration, fusion, federation, and the like.

The recognition unit 73 executes a detection process for detecting the situation outside the vehicle 1 and a recognition process for recognizing the situation outside the vehicle 1 .

For example, the recognition unit 73 performs detection processing and recognition processing of the situation outside the vehicle 1 based on information from the external recognition sensor 25, information from the self-position estimation unit 71, information from the sensor fusion unit 72, and the like. .

Specifically, for example, the recognition unit 73 performs detection processing, recognition processing, and the like of objects around the vehicle 1 . Object detection processing is, for example, processing for detecting the presence or absence, size, shape, position, movement, and the like of an object. Object recognition processing is, for example, processing for recognizing an attribute such as the type of an object or identifying a specific object. However, detection processing and recognition processing are not always clearly separated, and may overlap.

For example, the recognition unit 73 detects objects around the vehicle 1 by clustering the point cloud based on sensor data obtained by the radar 52 or the LiDAR 53 or the like for each cluster of point groups. As a result, presence/absence, size, shape, and position of objects around the vehicle 1 are detected.

For example, the recognition unit 73 detects the motion of objects around the vehicle 1 by performing tracking that follows the motion of the cluster of points classified by clustering. As a result, the speed and traveling direction (movement vector) of the object around the vehicle 1 are detected.

For example, the recognition unit 73 detects or recognizes vehicles, people, bicycles, obstacles, structures, roads, traffic lights, traffic signs, road markings, etc. based on the image data supplied from the camera 51 . Further, the recognition unit 73 may recognize types of objects around the vehicle 1 by performing recognition processing such as semantic segmentation.

For example, the recognition unit 73, based on the map accumulated in the map information accumulation unit 23, the estimation result of the self-position by the self-position estimation unit 71, and the recognition result of the object around the vehicle 1 by the recognition unit 73, Recognition processing of traffic rules around the vehicle 1 can be performed. Through this processing, the recognition unit 73 can recognize the position and state of traffic lights, the content of traffic signs and road markings, the content of traffic restrictions, the lanes in which the vehicle can travel, and the like.

For example, the recognition unit 73 can perform recognition processing of the environment around the vehicle 1 . The surrounding environment to be recognized by the recognition unit 73 includes the weather, temperature, humidity, brightness, road surface conditions, and the like.

The action plan section 62 creates an action plan for the vehicle 1 . For example, the action planning unit 62 creates an action plan by performing route planning and route following processing.

Note that global path planning is the process of planning a rough path from the start to the goal. This route planning is referred to as trajectory planning. In the planned route, trajectory generation (local path planning) that allows safe and smooth progress in the vicinity of the vehicle 1 in consideration of the motion characteristics of the vehicle 1 is performed. It also includes the processing to be performed.

Route following is a process of planning actions for safely and accurately traveling a route planned by route planning within a planned time. The action planning unit 62 can, for example, calculate the target speed and the target angular speed of the vehicle 1 based on the result of this route following processing.

The motion control section 63 controls the motion of the vehicle 1 in order to implement the action plan created by the action planning section 62 .

For example, the operation control unit 63 controls a steering control unit 81, a brake control unit 82, and a drive control unit 83 included in the vehicle control unit 32, which will be described later, so that the vehicle 1 can control the trajectory calculated by the trajectory plan. Acceleration/deceleration control and direction control are performed so as to advance. For example, the operation control unit 63 performs cooperative control aimed at realizing ADAS functions such as collision avoidance or shock mitigation, follow-up driving, vehicle speed maintenance driving, collision warning of own vehicle, and lane deviation warning of own vehicle. For example, the operation control unit 63 performs cooperative control aimed at automatic driving in which the vehicle autonomously travels without depending on the operation of the driver.

The DMS 30 performs driver authentication processing, driver state recognition processing, and the like based on sensor data from the in-vehicle sensor 26 and input data input to the HMI 31, which will be described later. As the state of the driver to be recognized, for example, physical condition, wakefulness, concentration, fatigue, gaze direction, drunkenness, driving operation, posture, etc. are assumed.

It should be noted that the DMS 30 may perform authentication processing for passengers other than the driver and processing for recognizing the state of the passenger. Further, for example, the DMS 30 may perform recognition processing of the situation inside the vehicle based on the sensor data from the sensor 26 inside the vehicle. Conditions inside the vehicle to be recognized include temperature, humidity, brightness, smell, and the like, for example.

The HMI 31 inputs various data, instructions, etc., and presents various data to the driver or the like.

Data input by the HMI 31 will be schematically described. The HMI 31 comprises an input device for human input of data. The HMI 31 generates an input signal based on data, instructions, etc. input from an input device, and supplies the input signal to each section of the vehicle control system 11 . The HMI 31 includes operators such as a touch panel, buttons, switches, and levers as input devices. The HMI 31 is not limited to this, and may further include an input device capable of inputting information by a method other than manual operation using voice, gestures, or the like. Furthermore, the HMI 31 may use, as an input device, a remote control device using infrared rays or radio waves, or an external connection device such as a mobile device or wearable device corresponding to the operation of the vehicle control system 11 .

The presentation of data by HMI 31 will be described schematically. The HMI 31 generates visual information, auditory information, and tactile information for the passenger or outside the vehicle. In addition, the HMI 31 performs output control for controlling the output, output content, output timing, output method, and the like of each generated information. The HMI 31 generates and outputs visual information such as an operation screen, a status display of the vehicle 1, a warning display, an image such as a monitor image showing the situation around the vehicle 1, and information indicated by light. The HMI 31 also generates and outputs information indicated by sounds such as voice guidance, warning sounds, warning messages, etc., as auditory information. Furthermore, the HMI 31 generates and outputs, as tactile information, information given to the passenger's tactile sense by force, vibration, movement, or the like.

As an output device from which the HMI 31 outputs visual information, for example, a display device that presents visual information by displaying an image by itself or a projector device that presents visual information by projecting an image can be applied. . In addition to the display device having a normal display, the display device displays visual information within the passenger's field of view, such as a head-up display, a transmissive display, and a wearable device with an AR (Augmented Reality) function. It may be a device. The HMI 31 can also use a display device provided in the vehicle 1, such as a navigation device, an instrument panel, a CMS (Camera Monitoring System), an electronic mirror, a lamp, etc., as an output device for outputting visual information.

As an output device from which the HMI 31 outputs auditory information, for example, audio speakers, headphones, and earphones can be applied.

As an output device for the HMI 31 to output tactile information, for example, a haptic element using haptic technology can be applied. A haptic element is provided at a portion of the vehicle 1 that is in contact with a passenger, such as a steering wheel or a seat.

The vehicle control section 32 controls each section of the vehicle 1 . The vehicle control section 32 includes a steering control section 81 , a brake control section 82 , a drive control section 83 , a body system control section 84 , a light control section 85 and a horn control section 86 .

The steering control unit 81 detects and controls the state of the steering system of the vehicle 1 . The steering system includes, for example, a steering mechanism including a steering wheel, an electric power steering, and the like. The steering control unit 81 includes, for example, a steering ECU that controls the steering system, an actuator that drives the steering system, and the like.

The brake control unit 82 detects and controls the state of the brake system of the vehicle 1 . The brake system includes, for example, a brake mechanism including a brake pedal, an ABS (Antilock Brake System), a regenerative brake mechanism, and the like. The brake control unit 82 includes, for example, a brake ECU that controls the brake system, an actuator that drives the brake system, and the like.

The drive control unit 83 detects and controls the state of the drive system of the vehicle 1 . The drive system includes, for example, an accelerator pedal, a driving force generator for generating driving force such as an internal combustion engine or a driving motor, and a driving force transmission mechanism for transmitting the driving force to the wheels. The drive control unit 83 includes, for example, a drive ECU that controls the drive system, an actuator that drives the drive system, and the like.

The body system control unit 84 detects and controls the state of the body system of the vehicle 1 . The body system includes, for example, a keyless entry system, smart key system, power window device, power seat, air conditioner, air bag, seat belt, shift lever, and the like. The body system control unit 84 includes, for example, a body system ECU that controls the body system, an actuator that drives the body system, and the like.

The light control unit 85 detects and controls the states of various lights of the vehicle 1 . Lights to be controlled include, for example, headlights, backlights, fog lights, turn signals, brake lights, projections, bumper displays, and the like. The light control unit 85 includes a light ECU that controls the light, an actuator that drives the light, and the like.

The horn control unit 86 detects and controls the state of the car horn of the vehicle 1 . The horn control unit 86 includes, for example, a horn ECU for controlling the car horn, an actuator for driving the car horn, and the like.

FIG. 11 shows an example of sensing areas by the camera 51, the radar 52, the LiDAR 53, the ultrasonic sensor 54, etc. of the external recognition sensor 25 in FIG. 10 schematically shows the vehicle 1 viewed from above, the left end side being the front end (front) side of the vehicle 1, and the right end side being the rear end (rear) side of the vehicle 1.

A sensing region 101F and a sensing region 101B are examples of sensing regions of the ultrasonic sensor 54 . The sensing area 101</b>F covers the periphery of the front end of the vehicle 1 with a plurality of ultrasonic sensors 54 . The sensing area 101B covers the periphery of the rear end of the vehicle 1 with a plurality of ultrasonic sensors 54 .

The sensing results in the sensing area 101F and the sensing area 101B are used for parking assistance of the vehicle 1, for example.

Sensing areas 102F to 102B are examples of sensing areas of the radar 52 for short or medium range. The sensing area 102F covers the front of the vehicle 1 to a position farther than the sensing area 101F. The sensing area 102B covers the rear of the vehicle 1 to a position farther than the sensing area 101B. The sensing area 102L covers the left side of the vehicle 1 at the rear. The sensing area 102R covers the rear periphery of the right side surface of the vehicle 1 .

The sensing result in the sensing area 102F is used, for example, to detect a vehicle, a pedestrian, or the like existing in front of the vehicle 1, or the like. The sensing result in the sensing area 102B is used for the rear collision prevention function of the vehicle 1, for example. The sensing results in the sensing area 102L and the sensing area 102R are used, for example, to detect an object in a blind spot on the side of the vehicle 1, or the like.

Sensing areas 103</b>F to 103</b>B are examples of sensing areas by the camera 51 . The sensing area 103F covers the front of the vehicle 1 to a position farther than the sensing area 102F. The sensing area 103B covers the rear of the vehicle 1 to a position farther than the sensing area 102B. The sensing area 103L covers the periphery of the left side surface of the vehicle 1 . The sensing area 103R covers the right side surface of the vehicle 1 .

The sensing results in the sensing area 103F can be used, for example, in recognition of traffic lights and traffic signs, lane departure prevention support systems, and automatic headlight control systems. A sensing result in the sensing area 103B can be used for parking assistance and a surround view system, for example. Sensing results in the sensing area 103L and the sensing area 103R can be used, for example, in a surround view system.

A sensing area 104 shows an example of the sensing area of the LiDAR 53 . The sensing area 104 covers the front of the vehicle 1 to a position farther than the sensing area 103F. On the other hand, the sensing area 104 has a narrower lateral range than the sensing area 103F.

A sensing result in the sensing area 104 is used for detecting an object such as a surrounding vehicle, for example.

A sensing area 105 is an example of a sensing area of the long-range radar 52 .
The sensing area 105 covers the front of the vehicle 1 to a position farther than the sensing area 104 . On the other hand, the sensing area 105 has a narrower lateral range than the sensing area 104 .

The sensing result in the sensing area 105 is used, for example, for ACC (Adaptive Cruise Control), emergency braking, collision avoidance, and the like.

The sensing regions of the cameras 51, the radar 52, the LiDAR 53, and the ultrasonic sensors 54 included in the external recognition sensor 25 may have various configurations other than those shown in FIG. Specifically, the ultrasonic sensor 54 may also sense the sides of the vehicle 1 , and the LiDAR 53 may sense the rear of the vehicle 1 . Moreover, the installation position of each sensor is not limited to each example mentioned above. Also, the number of each sensor may be one or plural.

9. Conclusion

According to this embodiment, the display determination unit 101 determines whether the display is on or off based on the mobile object information, so the safety of the vehicle 1 can be ensured. Since the switching determination unit 102 determines whether or not to switch the image being displayed based on the external information, it is possible to enhance the advertisement effect as a signage.

According to this embodiment, it is possible to determine the number of viewers in real time using dynamic data of the vehicle 1 and dynamic data of people to measure the effectiveness of the advertisement using the vehicle 1 .

The present disclosure may have the following configurations.

(1)
a display determination unit that acquires moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, and determines whether to turn on or off the display based on the moving body information; ,
an image acquisition unit that acquires an image from an image storage device;
and a display control unit that controls the display device based on the determination result of the display determination unit to turn on or off the display of the image.
(2)
The information processing device according to (1) above,
The display determination unit
(A) obtaining opening/closing information of a door of the moving body as the moving body information, and determining to turn off the display when determining that the door is opened;
(B) acquiring actuation information of at least one of the winkers of the moving body as the moving body information, and determining to turn off the display when determining that the at least one winker is in operation;
(C) Acquiring operating information of a taximeter of the moving body as the moving body information, determining display OFF when determining that the taximeter is operating, and determining display ON when determining that the taximeter is not operating; to judge
(D) obtaining speed information of the moving body as the moving body information, determining display OFF when determining that the speed is equal to or higher than a first predetermined speed, and determining display ON when determining that the speed is less than the first predetermined speed;
(E) acquiring temperature information inside the moving body as the moving body information, determining to turn off the display when determining that the temperature is equal to or higher than a predetermined temperature, and determining to turn on the display when determining that the temperature is less than the predetermined temperature;
(F) Acquiring moving body presence information indicating whether or not another moving body exists within a first predetermined distance from the moving body as the moving body information; determining that the display is off when it is determined that a body exists, and determining that the display is on when it is determined that another moving body does not exist within the first predetermined distance; or (G) walking from the moving body as the moving body information. acquire sidewalk distance information indicating the distance to the sidewalk, and determine to turn off the display when it is determined that the distance from the moving body to the sidewalk is greater than or equal to a second predetermined distance;
The information processing device according to (2) above,
The display determination unit (A) determines that the door is closed, (B) determines that the at least one turn signal is not operating, (C) determines that the taximeter is not operating, (D) determining that the speed is less than the first predetermined speed; (E) determining that the temperature is less than the predetermined temperature; (F) determining that there is no other moving body within the first predetermined distance; ) When it is determined that the distance to the sidewalk is less than a second predetermined distance, it may be determined to turn on the display.
(4)
The information processing device according to (2) or (3) above,
The moving body is capable of automatic operation,
The display determination unit does not determine whether the display should be turned on or off based on (B) operation information of at least one winker of the moving body and (F) the moving body presence information while the moving body is automatically driving. good too.
(5)
The information processing device according to any one of (1) to (4) above,
further comprising a switching determination unit that acquires external information of the moving body and determines whether or not to switch the image being displayed based on the external information;
The display control section may control the display device to switch the displayed image based on the determination result of the switching determination section.
(6)
The information processing device according to (5) above,
The image acquisition section may acquire a new image from the image storage device when the switching determination section determines to switch the image.
(7)
The information processing device according to (5) or (6) above,
The display control section may control the display device based on the determination result of the switching determination section to switch the display mode of the image being displayed.
(8)
The information processing device according to any one of (5) to (7) above,
The switching determination unit
(a) acquiring the position information of the moving body as the external information, and determining that the moving body is in a predetermined area, determining to switch the display to an area image linked to the predetermined area;
(b) determining to switch the display to an emergency image related to the emergency information when emergency information is acquired as the external information;
(c) determining to switch the display to a reservation person image related to the reservation information when the reservation information of the mobile object is acquired as the external information;
(d) determining to switch the display to an operation image related to the operation information when operation information of a transportation system is acquired as the external information;
(e) determining to switch the display to a trouble image related to the trouble information when trouble information of the occupants of the moving object is acquired as the external information; or (f) brightness information outside the moving object as the external information. is acquired, and it is determined that the brightness of the displayed image is switched when it is determined that the brightness of the outside of the moving body is equal to or higher than a predetermined brightness.
(9)
The information processing device according to (8) above,
The switching determination unit determines to switch the display to the trouble image when (e) acquiring trouble information of the occupant of the moving object as the external information even when the display determination unit determines that the display should be turned off. good too.
(10)
The information processing device according to (8) or (9) above,
The moving body is capable of automatic operation,
(e) the trouble information of the occupant of the mobile body is the trouble information of the driver of the mobile body;
The switching determination unit may (e) not determine whether to switch the image being displayed based on the trouble information of the driver of the moving body while the moving body is automatically driving.
(11)
The information processing device according to any one of (1) to (10) above,
When detecting that an occupant of the moving body has operated an operating device mounted on the moving body for inputting a request for switching an image being displayed, the display control unit controls the display device to display You can also switch between images.
(12)
The information processing device according to any one of (1) to (11) above,
The switching determination unit
When it is determined that the mobile body is on a non-public road or in a specific place, is stopped or the speed is equal to or lower than a second predetermined speed, or that there is no other mobile body within the first predetermined distance, a still image is displayed. It may be determined to switch the display to a slide show or moving image.
(13)
The information processing device according to any one of (1) to (12) above,
The image acquisition unit, from the image storage device,
images not related to the moving object;
An image showing information about the moving object, or an image related to images displayed by one or more other moving objects near the moving object may be acquired.
(14)
The information processing device according to any one of (1) to (13) above,
the moving body is a vehicle,
The display device may display images in one or more windows of the vehicle.
(15)
the processor of the information processing device,
a display determination unit that acquires moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, and determines whether to turn on or off the display based on the moving body information; ,
an image acquisition unit that acquires an image from an image storage device;
An information processing program that operates as a display control unit that controls the display device based on the determination result of the display determination unit to turn on or off the display of the image.
(16)
Acquiring moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, determining on or off of display based on the moving body information,
retrieving an image from an image store;
An information processing method for controlling the display device to turn on or off the display of the image based on a determination result.
(17)
a display device provided in a moving body and capable of displaying an image on the moving body so as to be visible from the outside of the moving body;
a display determination unit that acquires moving body information of the moving body and determines whether to turn on or off the display based on the moving body information;
an image acquisition unit that acquires an image from an image storage device;
A mobility signage system comprising: an information processing apparatus comprising: a display control unit that controls the display device to turn on or off display of the image based on a determination result of the display determination unit.
(18)
the processor of the information processing device,
a display determination unit that acquires moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, and determines whether to turn on or off the display based on the moving body information; ,
an image acquisition unit that acquires an image from an image storage device;
A non-transitory computer-readable recording medium recording an information processing program for operating as a display control unit for controlling the display device based on the determination result of the display determination unit to turn on or off the display of the image.

Although the embodiments and modifications of the present technology have been described above, the present technology is not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology. Of course.

1 Vehicle 10 Mobility Signage System 100 Information Processing Device 101 Display Determination Unit 102 Switching Determination Unit 103 Image Acquisition Unit 104 Display Control Unit 105 Storage Device 110 Communication Interface 20 Server Device 300 Display Device

Claims (17)

a display determination unit that acquires moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, and determines whether to turn on or off the display based on the moving body information; ,
an image acquisition unit that acquires an image from an image storage device;
and a display control unit that controls the display device based on the determination result of the display determination unit to turn on or off the display of the image. The information processing device according to claim 1,
The display determination unit
(A) obtaining opening/closing information of a door of the moving body as the moving body information, and determining to turn off the display when determining that the door is opened;
(B) acquiring actuation information of at least one of the winkers of the moving body as the moving body information, and determining to turn off the display when determining that the at least one winker is in operation;
(C) Acquiring operating information of a taximeter of the moving body as the moving body information, determining display OFF when determining that the taximeter is operating, and determining display ON when determining that the taximeter is not operating; to judge
(D) obtaining speed information of the moving body as the moving body information, determining display OFF when determining that the speed is equal to or higher than a first predetermined speed, and determining display ON when determining that the speed is less than the first predetermined speed;
(E) acquiring temperature information inside the moving body as the moving body information, determining to turn off the display when determining that the temperature is equal to or higher than a predetermined temperature, and determining to turn on the display when determining that the temperature is less than the predetermined temperature;
(F) Acquiring moving body presence information indicating whether or not another moving body exists within a first predetermined distance from the moving body as the moving body information; determining that the display is off when it is determined that a body exists, and determining that the display is on when it is determined that another moving body does not exist within the first predetermined distance; or (G) walking from the moving body as the moving body information. an information processing apparatus that acquires sidewalk distance information indicating the distance to the sidewalk, and determines to turn off the display when it is determined that the distance from the moving object to the sidewalk is greater than or equal to a second predetermined distance. The information processing device according to claim 2,
The display determination unit (A) determines that the door is closed, (B) determines that the at least one turn signal is not operating, (C) determines that the taximeter is not operating, (D) determining that the speed is less than the first predetermined speed; (E) determining that the temperature is less than the predetermined temperature; (F) determining that there is no other moving body within the first predetermined distance; ) When determining that the distance to the sidewalk is less than a second predetermined distance, the information processing apparatus determines to turn on the display. The information processing device according to claim 2,
The moving body is capable of automatic operation,
The display determination unit does not determine whether to turn on or off the display based on (B) actuation information of at least one turn signal of the moving body and (F) the moving body existence information while the moving body is automatically driving. Device. The information processing device according to claim 1,
further comprising a switching determination unit that acquires external information of the moving body and determines whether or not to switch the image being displayed based on the external information;
Information processing apparatus, wherein the display control section controls the display device to switch the displayed image based on the determination result of the switching determination section. The information processing device according to claim 5,
The image acquisition unit acquires a new image from the image storage device when the switching determination unit determines to switch the image. The information processing device according to claim 5,
The information processing apparatus, wherein the display control unit controls the display device based on the determination result of the switching determination unit to switch the display mode of the image being displayed. The information processing device according to claim 5,
The switching determination unit
(a) acquiring the position information of the moving body as the external information, and determining that the moving body is in a predetermined area, determining to switch the display to an area image linked to the predetermined area;
(b) determining to switch the display to an emergency image related to the emergency information when emergency information is acquired as the external information;
(c) determining to switch the display to a reservation person image related to the reservation information when the reservation information of the mobile object is acquired as the external information;
(d) determining to switch the display to an operation image related to the operation information when operation information of a transportation system is acquired as the external information;
(e) determining to switch the display to a trouble image related to the trouble information when trouble information of the occupants of the moving object is acquired as the external information; or (f) brightness information outside the moving object as the external information. and determines that the brightness of the displayed image is switched when it is determined that the brightness of the outside of the moving object is equal to or higher than a predetermined brightness. The information processing device according to claim 8,
The switching determination unit determines to switch the display to the trouble image when (e) acquiring the trouble information of the occupant of the moving body as the external information even when the display determination unit determines that the display is turned off. Device. The information processing device according to claim 8,
The moving body is capable of automatic operation,
(e) the trouble information of the occupant of the mobile body is the trouble information of the driver of the mobile body;
(e) the switching determination unit does not determine whether to switch the image being displayed based on the trouble information of the driver of the moving body while the moving body is automatically driving. The information processing device according to claim 1,
When detecting that an occupant of the moving body has operated an operating device mounted on the moving body for inputting a request for switching an image being displayed, the display control unit controls the display device to display An information processing device that switches between images. The information processing device according to claim 1,
The switching determination unit
When it is determined that the mobile body is on a non-public road or in a specific place, is stopped or the speed is equal to or lower than a second predetermined speed, or that there is no other mobile body within the first predetermined distance, a still image is displayed. An information processing device that determines to switch the display to a slide show or moving image. The information processing device according to claim 1,
The image acquisition unit, from the image storage device,
images not related to the moving object;
An information processing apparatus that acquires an image showing information about the moving object, or an image related to images displayed by one or more other moving objects near the moving object. The information processing device according to claim 1,
the moving body is a vehicle,
The display device displays an image on one or more windows of the vehicle. Information processing device. the processor of the information processing device,
a display determination unit that acquires moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, and determines whether to turn on or off the display based on the moving body information; ,
an image acquisition unit that acquires an image from an image storage device;
An information processing program that operates as a display control unit that controls the display device based on the determination result of the display determination unit to turn on or off the display of the image. Acquiring moving body information of the moving body having a display device capable of displaying an image on the moving body so as to be visible from the outside of the moving body, determining on or off of display based on the moving body information,
retrieving an image from an image store;
An information processing method for controlling the display device to turn on or off the display of the image based on a judgment result. a display device provided in a moving body and capable of displaying an image on the moving body so as to be visible from the outside of the moving body;
a display determination unit that acquires moving body information of the moving body and determines whether to turn on or off the display based on the moving body information;
an image acquisition unit that acquires an image from an image storage device;
A mobility signage system comprising: an information processing apparatus comprising: a display control unit that controls the display device to turn on or off display of the image based on a determination result of the display determination unit.

Images