JP7384014B2 - display system - Google Patents

Description

The present invention relates to display systems used by vehicle occupants.

2. Description of the Related Art Techniques for displaying various types of information in the field of view of a vehicle driver or the like are known.

For example, Patent Document 1 discloses that navigation information to destinations, facility guidance information, etc. are mapped to roads, buildings, etc. on a transparent display section of a head-mounted display device that is attached to the head of a vehicle driver. It is stated that the information should be displayed as follows. The document also states that a warning will be displayed if a person or obstacle is detected in front of the vehicle.

Japanese Patent Application Publication No. 2004-219664

The technology described in Patent Document 1 displays current information in association with real scenery, and the driver and the like can only obtain current information.

An object of the present invention is to provide vehicle occupants with new information that has not been provided conventionally regarding events surrounding a traveling vehicle.

The display system according to the present invention includes: an information acquisition device that acquires event information regarding past or future events included in the visual field of a vehicle occupant; and a display information setting unit that receives settings for the event to be displayed on the display device , the event information includes past scenery data and traffic accident data, and the past scenery data includes , including image data of the exterior of the vehicle taken by vehicles that have traveled in the past, and the traffic accident data includes image data taken by the vehicle that caused the traffic accident, and image data taken by vehicles existing around the traffic accident. , or includes image data taken by a fixed surveillance camera of a pedestrian or a road, and the display device adapts the event information to the traveling position of the vehicle in which the occupant rides, and displays an event based on the event information. is displayed, and the event of the past scenery data and the event of the traffic accident data are selected as display targets by the passenger operating the display information setting section. When the traffic accident data exists at the traveling position of the vehicle in which the person is riding, the event of the traffic accident data is displayed preferentially over the event of the past scenery data.
In the display system of the present invention, the display device may clearly indicate the location of the traffic accident when displaying the event of the traffic accident data.
In the display system of the present invention, the event information may include image data that is virtually created regarding an event that is estimated to have occurred in the past.
In the display system of the present invention, the event information may include image data virtually created regarding an event estimated to occur in the future.
In the display system of the present invention, the occupant is a driver, and when displaying the event of the past scenery data, the display device replaces the actual scenery outside the road and displays the event corresponding to the past scenery data. It may also be used to display scenery.
In the display system of the present invention, the occupant is other than the driver, and when displaying the event of the past scenery data, the display device replaces the scenery including the actual road to correspond to the past scenery data. It may also be possible to display a landscape.

Further, the display system according to the present invention includes an information acquisition device that acquires event information regarding past or future events included in the field of view of an occupant of a vehicle; A display device that displays an article image.
In one aspect of the present invention, the information acquisition device acquires, as the event information, image data of an exterior of the vehicle taken by a vehicle that has traveled in the past, and the display device is configured to acquire image data of an exterior of the vehicle taken by a vehicle that has traveled in the past, Adapting the image data to a position and displaying an event based on the image data.

In one aspect of the present invention, the information acquisition device acquires information on past traffic accidents as the event information, and the display device specifies the location of the traffic accident and displays the location of the traffic accident. Display the event.

In one aspect of the present invention, the information acquisition device acquires, as the event information, virtually created image data regarding an event that is estimated to have occurred in the past, and the display device acquires, as the event information, image data that is virtually created regarding an event that is estimated to have occurred in the past; The image data is associated with the traveling position of the vehicle, and events based on the image data are displayed .

In one aspect of the present invention, the information acquisition device acquires, as the event information, image data that is virtually created regarding an event that is estimated to occur in the future, and the display device acquires, as the event information, image data that is virtually created regarding an event that is estimated to occur in the future; The image data is associated with the traveling position of the vehicle, and events based on the image data are displayed .

In one aspect of the present invention, the occupant is a driver, and the display device displays a corresponding scene superimposed on or in place of the actual scene outside the road.

In one aspect of the present invention, the occupant is a person other than the driver, and the display device displays a corresponding scenery overlaying or replacing the scenery including the actual road. be able to.

In one aspect of the present invention, when the weather around the vehicle in which the occupant rides is rainy or snowy, the information acquisition device acquires the image data taken on a sunny or cloudy day in the past; The display device displays a centerline based on the image data, superimposed on the actual centerline or in place of the actual centerline.

According to the present invention, a vehicle occupant can grasp event information about past or future events around the traveling vehicle.

1 is a schematic configuration diagram of an information system according to an embodiment. 1 is a schematic configuration diagram of an image distribution system. 1 is a schematic configuration diagram of an image display system. FIG. 2 is a diagram showing a user who is a driver wearing a wearable device. FIG. 3 is a diagram showing a field of view in which no image is displayed. FIG. 3 is a diagram showing a field of view in which an icon that conveys an outline of a traffic accident is displayed. FIG. 3 is a diagram showing a field of view in which details of a traffic accident are displayed by operating an icon. FIG. 3 is a diagram showing a field of view in which no image is displayed during rainy weather. FIG. 4 is a diagram showing a field of view in which images in clear weather are displayed in rainy weather. FIG. 3 is a diagram showing a field of view in which past scenery is displayed. FIG. 2 is a diagram showing a field of view in which a future virtual landscape is displayed. FIG. 3 is a diagram showing a field of view in which past virtual scenery is displayed.

Embodiments will be described below with reference to the drawings. In the description, in order to facilitate understanding, specific aspects will be shown, but these are merely illustrative embodiments, and various other embodiments can be adopted.

FIG. 1 is a diagram showing a schematic configuration of an information system 10 according to an embodiment. The information system 10 includes a vehicle 20 that collects event information such as image data, an information distribution system 30, and a vehicle 100 that performs processing to display events based on the event information. Here, event information is data that can be displayed about an event, including character data represented by character codes (including numerical symbols, etc.) and two-dimensional or three-dimensional image data that is not represented by character codes. shall be included. Both character codes and image data can display events as images on a display device. Furthermore, an event refers to a thing or event that appears in a form that can be observed by people. Examples of events will be described later. Note that the information system 10 can also handle audio data such as human voices, noises, music, etc. related to character data and image data. The audio data is output as audio by a speaker.

Although there are many vehicles 20 that collect event information such as image data, only one representative vehicle is shown in FIG. In the information system 10, it is possible to use image data taken by the vehicle 20 by entering into a contract or the like with the owner of the vehicle 20 in advance. Note that the vehicle 20 that collects image data and the like may also serve as the vehicle 100 that displays images.

The vehicle 20 is provided with an on-vehicle camera 22, a GNSS 24, and a clock 26. The vehicle-mounted camera 22 is a device that is mounted on the vehicle 20 and photographs the scenery outside or inside the vehicle. The in-vehicle camera 22 is installed, for example, near the front end of the roof inside the vehicle interior, and captures camera image data (hereinafter referred to as image data taken by the in-vehicle camera 22) by photographing the outside of the vehicle on the front side of the vehicle through the front windshield. (sometimes referred to as camera image data to emphasize this). Camera image data is data that provides two-dimensional or three-dimensional visual information. Camera image data is generally moving image data, but may also be still image data taken at appropriate time intervals. In the information system 10, camera image data from the vehicle-mounted camera 22 is transmitted to the information distribution system 30, and then transmitted to the vehicle 100 where the image will be displayed in the future. For this reason, the in-vehicle camera 22 that can obtain camera image data with the resolution necessary for display on the vehicle 100 is installed. In order to ensure resolution or visibility, a plurality of in-vehicle cameras 22 may be provided.

For example, the vehicle-mounted camera 22 may also serve as a drive recorder that records the driving situation of the vehicle 20. Further, for example, when the vehicle 20 has an automatic driving mode, the on-vehicle camera 22 may also serve as a sensor for grasping the traffic situation around the vehicle. Note that although a visible light camera that uses visible light is normally used as the vehicle-mounted camera 22, it is also possible to employ cameras that use various wavelength bands, such as an infrared camera or an ultraviolet camera. Furthermore, the vehicle-mounted camera 22 may be configured to take images of areas other than the front, such as the sides and rear of the vehicle 20.

GNSS 24 is an abbreviation for Global Navigation Satellite System, and is a sensor that detects the position of the traveling vehicle 20 using radio waves from an artificial satellite. The position detection result by the GNSS 24 is used as photographing position data for specifying the photographing position of camera image data. If the photographing position data is tracked in chronological order, the travel route of the vehicle 20 can also be determined.

The clock 26 is a device that displays the timing of year, month, date and time. The output of the clock 26 is used as photographing time data for specifying the timing at which camera image data was photographed.

The photographing position data and the photographing time data are transmitted to the information distribution system 30 in association with camera image data. Transmission is performed, for example, by wireless communication such as Wi-Fi (registered trademark). Note that the vehicle 20 may further include a sensor that acquires weather-related data, such as a solar radiation sensor and a rain sensor. The outputs of these sensors can be used as photographed weather data indicating the weather at the time the camera image data was photographed. The shooting weather data may also be transmitted to the information distribution system 30 in association with the camera image data.

The information distribution system 30 is a system that receives and stores image data transmitted from the vehicle 20 and distributes the stored image data and the like to the vehicle 100. The information distribution system 30 includes a collection server 40, a production server 50, a distribution server 60, and a storage server 80. The information distribution system 30 will be described in detail with reference to FIG. 2.

FIG. 2 is a block diagram showing a schematic configuration of the information distribution system 30. Information distribution system 30 can be configured using one or more computer hardware. Computer hardware may be installed centrally at an information distribution company, for example, or may be connected to a network and distributed in remote locations.

Computer hardware is a device equipped with a memory, a processor, etc., and operates under the control of an installed OS (operating system), application programs, and other software. A collection server 40, a production server 50, a distribution server 60, and a storage server 80 are constructed in the information distribution system 30 by application programs.

The collection server 40 is a device that collects existing image data and the like through a network or the like. The collection server 40 acquires camera image data, corresponding photographing position data, photographing time data, photographing weather data, etc. from the vehicle 20. The collection server 40 classifies the acquired camera image data and the like by the route taken by the vehicle 20, the date and time of the photograph, the weather of the photograph, etc., and then stores the data in the storage server 80.

With the camera image data taken by the vehicle 20, for example, if a large vehicle is present immediately in front of the vehicle 20, there may be a situation in which the scenery cannot be photographed very well. Therefore, the collection server 40 can create data by joining together a plurality of camera image data with low traffic volume, if necessary. Furthermore, in the case where a person's face, vehicle license plate number, etc. are clearly visible in the scenery, the collection server 40 performs a process of blurring them to make them unclear.

In the collection server 40, when collecting camera image data and the like, conditions can be set for the collection target. Specifically, it is collected from vehicles 20 traveling in an area with few vehicles, collected from vehicles 20 traveling on a specific route, or collected from vehicles 20 that are considered to be involved in a traffic accident, such as when an airbag is activated. Examples include collecting information from

The collection server 40 further collects event information regarding traffic accidents in cooperation with external organizations such as the police and insurance companies. Traffic accident event information is obtained, for example, as character data that describes the date and time of occurrence, location, accident situation, damage situation, and the like. Furthermore, event information on traffic accidents may be obtained from external organizations as image data such as photographs and videos. If a surveillance camera is installed on the road, if an in-vehicle camera is installed on the accident vehicle or other vehicles around it, or if nearby pedestrians are taking pictures, an external agency may collect images. Data may be obtained. Furthermore, the collection server 40 may be able to acquire image data including traffic accident event information from the camera image of the vehicle 20.

The production server 50 is a device that produces image data regarding past or future events. The production server 50 produces virtual image data that is assumed to be visible when the vehicle 100 has traveled in the past or the future. The image production itself can be outsourced to an external company, for example. In this case, the production server 50 captures the delivered image and stores it in the storage server 80. Furthermore, character data explaining the image data is also created and stored in the storage server 80. Note that the production server 50 can also produce virtual moving image data or still image data that reproduces the appearance of a traffic accident in an easy-to-understand manner based on the text data about the traffic accident described above.

Distribution server 60 is a device that distributes event information such as image data to vehicle 100. The distribution server 60 includes a receiving device 62, an information selection device 64, and a transmitting device 74. The receiving device 62 receives a request for distribution of image data, etc. from the vehicle 100. When receiving the distribution request, the receiving device 62 also receives information such as the type of event information to be distributed and the position of the vehicle 100.

The information selection device 64 selects event information to be distributed to the vehicle 100. The information selection device 64 includes an information type determination section 66, a driving position determination section 68, a weather determination section 70, and a driver determination section 72.

The information type determination unit 66 selects the type of event information requested to be distributed based on the content received by the receiving device 62. Examples of types of event information to be selected will be described later.

The traveling position determining unit 68 determines the geographical range of the event information to be distributed based on the traveling position data acquired from the vehicle 100. The traveling position determination unit 68 takes into account not only the current position of the vehicle 100 but also the traveling direction, traveling speed, etc., predicts the position where the vehicle 100 will travel in the near future (for example, several seconds to several tens of seconds later), and distributes the event. Determine the scope of information.

The weather determination unit 70 determines the weather near the vehicle based on travel position data acquired from the vehicle 100. In making the determination, for example, weather information provided by meteorological authorities etc. can be utilized. Furthermore, the weather determination unit 70 may determine the weather of the vehicle 100 based on weather data acquired from the vehicle 100.

Driver determination unit 72 determines whether the person requesting distribution in vehicle 100 is the driver. If the requester is only the driver, it is determined that the road scenery (road surface, moving vehicles, pedestrians, traffic lights, signs, etc.) may be omitted from the image data to be distributed. This makes it possible to reduce the amount of information to be distributed.

The transmitting device 74 acquires event information to be distributed from the storage server 80 and transmits it to the vehicle 100.

The storage server 80 is a device that stores event information regarding past or future events to be distributed. The event information stored in the storage server 80 includes traffic accident data 82, past scenery data 84, past virtual data 88, and future virtual data 90.

The traffic accident data 82 is an example of event information about past events, and includes event information about traffic accidents collected by the collection server 40. The traffic accident data 82 to be saved includes traffic accident character data which is character data, and traffic accident image data which is image data. The traffic accident character data includes information such as the date and time of the traffic accident, its location, accident situation, and damage situation. In addition, traffic accident image data includes camera image data of the vehicle that caused the traffic accident, camera image data of vehicles existing around the traffic accident, or image data taken by pedestrians or fixed road surveillance cameras. etc. are included. As the image data of the traffic accident data 82, moving image data or still image data produced by the production server 50 can also be used.

The past scenery data 84 is an example of event information about past events, and includes event information about past actual scenery collected by the collection server 40. Specifically, camera image data captured by the vehicle-mounted camera 22 of the vehicle 20 in the past is included. The past landscape data 84 may also include character data that describes the camera image data, such as the acquisition date and time of the camera image data and the weather at the time of photography.

The past scenery data 84 includes clear weather image data 86. This is camera image data taken during clear weather. As will be described later, the clear weather image data 86 is used to compensate for poor visibility due to rain, snow, etc. Therefore, in addition to sunny weather, it is also possible to use image data in weather other than rain or snow, such as cloudy weather, but in the embodiment, clear weather image data 86 is used in consideration of the clarity of the image.

The past virtual data 88 is an example of event information about past events, and includes past virtual event information created by the creation server 50. The past virtual data 88 includes past virtual image data that is image data and past virtual character data that describes the explanation. The past virtual data 88 is event information created for scenery that may be seen around the vehicle if the vehicle 100 were to travel at an appropriate timing in the past. For example, in the distant scenery (mountains, coasts, rivers, etc.) seen when the vehicle 100 drives along the current road, natural objects such as forests, buildings such as castles and houses, and costumes of the time may be seen. Image data that displays the person wearing the garment is created. Alternatively, for an area where a historical event has occurred in the past, an example may be created in which image data is created to view the event while driving with the vehicle 100. Historical events include political events, religious events, cultural events, festivals, wars, visits of famous people, disasters (volcanic eruptions, earthquakes, fires, etc.), and celestial phenomena (arrival of comets, midnight sun, lunar eclipse, etc.) For example, Furthermore, it may be possible to reproduce past climates such as the Ice Age, or to reproduce animals and plants whose fossils have been excavated. Alternatively, it may be a reproduction of a legend or folktale known in the area.

The future virtual data 90 is an example of event information about future events, and includes future virtual event information created by the creation server 50. The future virtual data 90 includes future virtual image data that is image data and future virtual character data that describes the data. The future virtual data 90 is created for scenery that may be seen if the vehicle 100 were to travel in the future. For example, a mode of creating image data in which natural objects, buildings, people wearing future costumes, etc. estimated to exist in the future are present in the distant background that is visible when the vehicle 100 drives on the current road. can be mentioned. Furthermore, image data simulating events estimated in the future may be created. Examples of buildings estimated to exist in the future include buildings based on city planning by the government, local governments, etc., roads, railways, airports, and the like. It is also estimated that vehicles, clothing, etc. proposed by research institutions and companies will become a reality in the future. Furthermore, disasters based on disaster hazard maps published by local governments can also be said to be events that are estimated to occur in the future.

Next, the vehicle 100 in FIG. 1 will be described with reference to FIG. 3. Vehicle 100 is a vehicle equipped with image display system 110 shown in FIG. As shown in FIG. 3, the image display system 110 includes an in-vehicle system 120 and a wearable device 150.

In-vehicle system 120 is typically a device that is fixedly installed in vehicle 100. The in-vehicle system 120 includes an operation input section 122, a transmission section 128, an image processing device 130, a GNSS 140, a speedometer 142, a reception section 144, and a temporary storage device 146.

The operation input unit 122 is a user interface through which a user, such as a driver of the vehicle 100, makes settings for the image display system 110. The operation input unit 122 is constructed using, for example, a touch panel provided on the instrument panel of the vehicle 100. The operation input section 122 is provided with a display information setting section 124 . The display information setting unit 124 performs various settings regarding event information to be displayed on the wearable device 150.

The user can operate the display information setting section 124 to make settings to display traffic accident data 82, past scenery data 84, past virtual data 88, or future virtual data 90. The user may select only one of these data to be displayed, or may select multiple pieces of data to be displayed. When selecting multiple items, it is also possible to prioritize the display. As an example of prioritization, when traffic accident data 82 and past scenery data 84 are selected, normally past scenery data 84 is displayed, but in a place where traffic accident data 82 exists, traffic accident data 82 is given priority. Examples of settings include display or duplicate display. Furthermore, for example, when selecting the past landscape data 84, if there is a plurality of past landscape data, it is also possible to set the year and season in which the image was taken. Alternatively, for the traffic accident data 82, past virtual data 88, or future virtual data 90, first, only icons with text data or symbols indicating an overview are displayed, and after the user operates the icon to request detailed display. It is also possible to make settings to display image data.

The transmitter 128 transmits an event information distribution request to the information distribution system 30. When making a distribution request, the type of required data, etc. is also specified according to the settings made by the display information setting section 124. In addition, vehicle travel position data indicated by the GNSS 140 is also transmitted at any time. Alternatively, it is also possible to transmit the travel route set in the navigation system of the vehicle 100 all at once as travel position data.

The image processing device 130 is a device that performs image processing for displaying event information received from the information distribution system 30 on the wearable device 150. The image processing device 130 can be constructed by controlling computer hardware including a memory, a processor, and the like using software such as an OS (operating system) and application programs. The image processing device 44 includes a device/pupil position calculation section 132, an image layout calculation section 134, an image switching section 136, and an image composition section 138 using application programs.

The device/pupil position calculation unit 132 calculates the relative position of the wearable device 150 in the vehicle and the relative position of the pupil of the driver 180 based on inputs from the device position sensor 160 and the pupil position sensor 162 of the wearable device 150. do.

The image layout calculation unit 134 calculates which images should be placed at which positions, that is, how the images to be combined should be laid out in order to display the images instructed by the operation input unit 122. In determining the layout, the image layout calculation unit 134 uses the relative position data of each part of the vehicle stored in advance, and also uses the relative position data of the wearable device 150 calculated by the device/pupil position calculation unit 132, Utilizes the relative position data of the pupils. Thereby, it is possible to calculate which position on the organic EL display 166 a straight line connecting the pupil of the user wearing the wearable device 150 and a specific part of the vehicle corresponds to. Then, it is calculated which image should be displayed at which position on the organic EL display 166.

The image switching unit 136 performs image switching processing according to priority order, etc. when a plurality of types of image data are selected as display targets in the display information setting unit 124. It also performs a process of switching the display target from character data to image data or from image data to character data, or a process of displaying both character data and image data.

The image composition section 138 is an example of an information acquisition device, and performs processing to acquire the image data or character data set by the image switching section 136 from the temporary storage device 146 and compose it with the layout calculated by the image layout calculation section 134. conduct. The image synthesis unit 138 synthesizes images corresponding to the running position of the vehicle 100 by acquiring running position data from the GNSS 140 and running speed data from the speedometer 142. The combined image is transmitted to the image control unit 164 of the wearable device 150 and displayed on the organic EL display 166. Transmission can be performed by wired communication or by wireless communication. When employing wireless communication, it is also possible to use short-range wireless communication such as Bluetooth (registered trademark), Wi-Fi (registered trademark), and infrared communication.

GNSS 140 detects the traveling position of vehicle 100 and outputs traveling position data. The traveling position data is transmitted to the information distribution system 30 through the transmitter 128.

Speedometer 142 detects the traveling speed of vehicle 100 and outputs traveling speed data. The traveling speed is data indicating a change in the traveling position of the vehicle over time, and can be used to specify the traveling position of the vehicle 100 together with the traveling position data output by the GNSS 140. Therefore, as described above, the traveling position data and the traveling speed data are sent to the image composition section 138.

The receiving unit 144 receives image data and character data distributed from the information distribution system 30. The received data is stored in temporary storage device 146.

The image data and character data received through the receiving unit 144 are stored in the temporary storage device 146. Since there is uncertainty in the traveling direction of the vehicle 100, the in-vehicle system 120 employs a streaming method that displays received data one after another according to the traveling position. The temporary storage device 146 enables seamless image display by temporarily storing image data and character data in advance based on the results of the prediction of the near future driving position of the vehicle 100 by the driving position determination unit 68. It is said that However, for example, if a travel route is set in the navigation system of the vehicle 100, it is considered that there is a high possibility that the vehicle will travel along that travel route. Therefore, it is also possible to adopt a method of downloading image data and character data along the travel route in advance. Further, all image data and character data regarding areas where vehicles frequently travel can be downloaded to the temporary storage device 146.

The wearable device 150 is a device that is worn like glasses or goggles by a vehicle occupant, including a driver. Wearable device 150 includes a device position sensor 160, a pupil position sensor 162, an image control section 164, an organic EL display 166, and an operation section 168.

Here, the wearable device 150 will be described in detail with reference to FIG. 4. FIG. 4 is a diagram showing a state in which the wearable device 150 is worn by the driver 180. Wearable device 150 is a device formed in the shape of glasses, and is sometimes called smart glasses. Wearable device 150 includes a temple 152, which is a linear frame to be hung on the ear, and a rim 154, which is a frame connected to temple 152, surrounding the eyes, and shaped to be hung on the nose.

An organic EL (Electro Luminescence) display 166, which is an example of a display device, is provided inside the rim 154. The organic EL display 166 is arranged to cover the front of the driver's 180 eyes, but when not forming an image, it exhibits high transparency (high light transmittance), so the driver 180 cannot visually see the front. can do. The organic EL display 166 can form an image in part or all of the area under the control of the image control unit 164.

On the left eye side of the driver 180, a device position sensor 160 is provided near the connection between the rim 154 and the temple 152. Device position sensor 160 is a sensor that detects the position of wearable device 150 within vehicle 100. The device position sensor 160 can be constructed using, for example, a camera that photographs the front. That is, the position and tilt of the camera can be determined by comparing the image taken by the camera with the layout data inside the vehicle. Therefore, if the camera is fixedly installed on the rim 154, the position and tilt of the wearable device 150 can be detected.

A pupil position sensor 162 is provided near the center of the upper part of the rim 154. The pupil position sensor 162 is a sensor that detects the positions of the pupils of the right and left eyes of the driver 180 relative to the rim 154. Similarly to the device position sensor 160, the pupil position sensor 162 can also be formed using a camera or the like.

An image control section 164 is incorporated inside the temple 152. The image control unit 164 is a control device that displays an image on the organic EL display 166 based on data received from the in-vehicle system 120. In the wearable device 150, by displaying an image of the event on the organic EL display 166 through the image control unit 164, it is possible to provide the occupant with a different visual environment than usual.

The operation unit 168 is for operating the object displayed on the organic EL display 166. The organic EL display 166 can display operation target images such as buttons. The operation unit 168 is for operating this button. For example, the operation unit 168 may be operated by the voice of a driver wearing the wearable device 150, or may be operated by the operator's line of sight. The operating section 168 may be realized by providing a mechanical button on the temple 152, rim 154, etc. of the wearable device 150. By providing the operation unit 168, it becomes possible to switch the display, such as first displaying character data or symbols indicating an overview on the organic EL display 166, and then displaying image data after the operation. Note that it is also possible to perform similar operations using the operation input section 122 of a touch panel provided on the instrument panel of the vehicle 100, for example, without providing the operation section 168 on the wearable device 150.

In the image display system 110, real-time processing is performed at short time intervals. That is, the in-vehicle system 120 acquires detection data from the device position sensor 160 and the pupil position sensor 162 of the wearable device 150 at short time intervals. The device/pupil position calculating section 132 quickly calculates the position of the wearable device 150 and the position of the pupil from the acquired detection data. Thereby, it is also possible to obtain the relationship between the range of the driver's 180 field of view in the vehicle 100 and the front windshield 206 and the like. Note that the range of the driver's 180 visual field can be set based on standard human data. Furthermore, for example, in the example shown in FIG. 4, it is also possible to set the range of the organic EL display 166 surrounded by the rim 154 as the range of the visual field. When combined with the driving position data output by the GNSS 140, the relationship between the range of the driver's 180 visual field and the position of the event can be obtained. Therefore, it can be said that the device position sensor 160, the pupil position sensor 162, and the GNSS 140 are an example of range acquisition means. Subsequently, the image layout calculation unit 134 calculates a layout for displaying the image operated from the operation input unit 122. The image composition unit 138 composes the images from the temporary storage device 146 according to the layout and transmits the composite to the wearable device 150.

In the wearable device 150, the received composite image data is processed by the image control unit 164 and displayed on the organic EL display 166. Since the processing up to the image display is performed at high speed, even if the driver 180 shakes his head, it can be followed at high speed. Therefore, the driver 180 wearing the wearable device 150 can visually recognize the outside of the vehicle, which is displayed differently from the actual one, without feeling too uncomfortable.

Note that in the above description, a device using the image control unit 164 and the organic EL display 166 has been exemplified as the wearable device 150. However, wearable device 150 may use other principles. One example is a mode in which a projector is used to project an image onto the retina. Furthermore, the wearable device 150 may be of a type that does not allow visible light from the outside to pass through, and instead displays an image taken with a camera.

Next, examples of image display by the wearable device 150 will be described with reference to FIGS. 5 to 12. 5 to 11 are diagrams schematically showing the field of view of a driver 180 wearing the wearable device 150. Moreover, FIG. 12 is a diagram schematically showing the visual field when the wearable device 150 is worn by an occupant other than the driver. In the coordinate system shown in the figure, the F axis indicates the front direction of the vehicle, the U axis indicates the upward direction, and the R axis indicates the right direction of the occupant. It is assumed that the driver 180 is sitting in a driver's seat provided on the left side of the vehicle and is driving on a road with right-hand traffic.

FIG. 5 is a diagram showing a state in which the wearable device 150 is not displaying an image. In this case, the field of view of the driver 180 is the same as that of the naked eye.

The roof 200 is visible at the top of the field of view. A left A-pillar 202 (sometimes called a left front pillar) and a right A-pillar 204 are visible on the left and right sides of the roof 200. A transparent front windshield 206 (sometimes called a windshield) is provided at a position surrounded by the roof 200, left A-pillar 202, and right A-pillar 204. An interior mirror 208 attached to the roof 200 is visible near the top of the front windshield 206, and reflects the vehicle traveling behind.

On the left side of the driver 180, a left front side windshield 210 (sometimes referred to as a left front side glass) and a left triangular window 212 in front of it are visible. A left front door trim 214 provided on the inside of the left front door is visible below the left front side windshield 210. Further, a left outer mirror 216 is visible on the left front side windshield 210, and a part of the side surface of the host vehicle and a vehicle traveling behind are reflected.

On the right side of the driver 180, a right front side windshield 220 and a right triangular window 222 in front of it are visible. A right front door trim 224 provided on the inside of the right front door is visible below the right front side windshield 220. Further, a right outer mirror 226 is visible on the right front side windshield 220, and a part of the side surface of the host vehicle and a vehicle traveling behind are reflected.

An instrument panel 230 is installed below the front windshield 206. A center console 232 is connected to the lower center of the instrument panel 230. A touch panel 234 and operation buttons 236 are arranged on the instrument panel 230 and the center console 232. The operation input unit 122 of the wearable device 150 worn by the driver 180 is provided on the touch panel 234 or the operation buttons 236, for example.

In front of the driver 180, a steering wheel 238 is provided in front of the instrument panel 230. Both hands of the driver 180 are placed on the steering wheel 238. Also, inside the steering wheel 238, instruments 240 such as a speedometer arranged on the instrument panel 230 are visible.

The scenery outside the vehicle is visible from the front windshield 206. The vehicle is traveling in the right lane of a roadway 300 that extends ahead. A center line 302 is drawn in the center of the roadway 300. A left sidewalk 304 is provided on the left side of the roadway 300, and is separated from the roadway 300 by a curb 306. A right sidewalk 308 is provided on the right side of the roadway 300, and is separated from the roadway 300 by a curb 310.

An oncoming vehicle 320 is traveling in the left lane of the roadway 300. A road sign 322 is provided on the right sidewalk 308. Furthermore, a pedestrian 324 is walking on the right sidewalk 308.

The front of the roadway 300 is a gentle downhill slope (not shown). Therefore, a skyline 330 is formed between the ground and the sky.

FIGS. 6 and 7 are diagrams chronologically showing examples of display on the wearable device 150 based on the traffic accident data 82.

FIG. 6 is a diagram showing a state immediately after FIG. 5, in which an icon 400 with a "!" symbol is displayed in front of the right lane of the roadway 300. This icon 400 is displayed to indicate a location where a traffic accident previously occurred and to alert the driver 180. The image switching unit 136 of the image processing device 130 in the in-vehicle system 120 of the vehicle 100 grasps the running position based on the running position data of the GNSS 140 and the running speed data of the speedometer 142 in the in-vehicle system 120, and also stores the data in the temporary storage device 146. A comparison is made with the saved traffic accident data 82. As a result of the comparison, it is detected that the vehicle 100 approaches the position indicated by the traffic accident data 82, and the icon 400 is displayed. When understanding a traffic accident, it is important to correctly identify the location where the accident occurred, so the icon 400 is displayed to indicate the location where the accident occurred with high accuracy.

Most of the icons 400 are displayed above the skyline 330 so that the driver 180 can secure the field of view necessary for driving. However, the icon 400 merely conveys the location where the traffic accident occurred, but does not convey its details. Therefore, the icon 400 is displayed as an operable button.

FIG. 7 is a diagram showing a case where the driver 180 operates the icon 400 through the operation unit 168 of the wearable device 150 in the state of FIG. A character data display window 402 and an image data display window 404 are displayed on the instrument panel 230 near the passenger seat. This display position is a position that does not obstruct the driver's 180 view to the outside of the vehicle and does not obstruct the driver's 180 view to the steering wheel 238 and instruments 240.

The text data display window 402 briefly states that a collision with an oncoming vehicle occurred one month ago. Further, in the image data display window 404, moving image data immediately before the collision is displayed. This moving image data is camera image data taken by an on-vehicle camera of a vehicle that has encountered a collision. The camera image data clearly shows that a vehicle attempting to overtake an oncoming vehicle traveling in the left lane is traveling into the right lane.

By looking at the display windows 402 and 404, the driver 180 can instantly grasp the outline of the traffic accident. At the position of the icon 400, it is foreseen that an oncoming vehicle traveling in the right lane may come from the other side of the skyline 330. As a result, the driver 180 drives while keeping his eyes on the road ahead, making it possible to prevent similar traffic accidents.

In the example shown in FIG. 6, the icon 400 consists of a frame and a "!" symbol displayed within the frame. However, instead of the "!" symbol, character data such as "frontal collision" or a simple figure or symbol indicating a frontal collision may be displayed to convey slightly more detailed event information to the driver 180. good.

Further, in the example shown in FIG. 7, both a character data display window 402 and an image data display window 404 are shown. However, only one of the display windows 402 and 404 may be shown. The display window 404 can also display still images instead of moving images. Furthermore, it is also possible to display a schematically created image on the display window 404 instead of an image of an actual traffic accident.

Another example is a mode in which the display state of only the icon 400 shown in FIG. 6 is omitted when the vehicle approaches the location where a traffic accident has occurred. That is, it is conceivable to immediately perform a display including the display windows 402 and 404 shown in FIG. 7 to convey the details of the traffic accident to the driver.

Next, the utilization of event information during rainy weather will be described with reference to FIGS. 8 and 9. FIG. 8 is a diagram corresponding to FIG. 5, and is a diagram showing a state in which the wearable device 150 is not displaying an image. Further, FIG. 9 is a diagram showing a state in which the wearable device 150 displays an image.

In FIG. 8, unlike FIG. 5, it is assumed that the weather is rainy. Therefore, the scenery outside the vehicle that can be seen from the front windshield 206 and the like becomes somewhat unclear due to the rain. For example, the oncoming vehicle 320, road sign 322, and pedestrian 324 are slightly more difficult to visually recognize than in FIG. Furthermore, the center line 302, curbs 306, 310, etc. of the roadway 300 are also unclear. Furthermore, in the example of FIG. 8, an obstacle 340 exists in the right lane of the roadway 300.

FIG. 9 shows a state in which an image is displayed on the wearable device 150 based on the clear weather image data 86 in the situation shown in FIG. 8 . An image on a clear day is basically displayed in a part of the scenery outside the road. Therefore, a clear image in clear weather is displayed in the sky above the skyline 330. In addition, images in clear weather are also displayed on the ground to the left of the left sidewalk 304 and to the right of the right sidewalk 308. The displayed image is a moving image, and the moving image is also switched depending on the traveling position of vehicle 100. Therefore, the driver 180 can clearly understand in which area he/she is currently driving.

On the other hand, for road scenes, images taken under clear weather are basically not displayed. Specifically, images are not displayed for the road including the roadway 300, left sidewalk 304, and right sidewalk 308, and for the vehicle 320, road sign 322, and pedestrian 324, and the actual scenery is not visible to the driver. It's reflected in 180 eyes. Therefore, the driver 180 can also visually recognize the obstacle 340 on the roadway 300. Although not shown, for example, if a road is equipped with a traffic light, if there is another vehicle in the right lane, or if the road branches (an intersection exists), etc. do not display images. This is because images are displayed based on the policy of not displaying images in areas where actual event information is necessary to ensure driving safety.

However, in FIG. 9, images of the center line 302 and the curb 310 are displayed under clear weather conditions. This is to clarify the lane in which the vehicle can travel in the right lane and improve driving safety. In particular, since the illustrated right lane is in contact with the left lane, which is an oncoming lane, only by the center line 302, clarifying the center line 302 is useful in preventing collisions with oncoming vehicles. Further, the illustrated right lane is in contact with the right sidewalk 308, and making the curb 310 that is the boundary between the roadway 300 and the right sidewalk 308 clear is useful in preventing contact with pedestrians.

If a white line or the like is drawn between the right sidewalk 308 and the roadway 300 to limit the driving lane instead of or in addition to the curb 310, the white line or the like is drawn as an image instead of the curb 310. Just display it. For example, if the roadway 300 has two lanes on each side, first, clarify the boundaries of the lane in which you are currently driving, and then consider the possibility of changing lanes and change the boundaries of the other lane. It is possible to clarify the boundaries. On the other hand, since the curb 306 between the roadway 300 and the left sidewalk 304 is not directly related to driving, it is not clarified using images.

In the example shown in FIG. 9, the center line 302 and the curb 310 display images of corresponding parts of camera image data taken in the past, that is, images of the center line 302 and the curb 310 cut out from the camera image data. ing. When displaying, image recognition is performed to confirm that the current center line 302 and the past center line 302 almost match, and that the current curb 310 and the past curb 310 almost match. Displaying an image. This makes it possible to prevent the past centerline 302 from being displayed when the centerline 302 is newly redrawn and is in a different state from the past image. Alternatively, for example, if the road surface is covered with snow and the center line 302 cannot be visually recognized, the past center line 302 may be displayed without checking whether the current center line 302 and the past center line 302 match. can also be considered.

If there is an obstacle 340 above the center line 302, a situation may be considered in which the obstacle 340 is hidden by completely replacing the image. Therefore, when displaying the center line 302 based on an image during clear weather, the image during clear weather may be made semi-transparent and displayed in a superimposed manner on the current center line 302. Moreover, since the center line 302 and the curbstone 310 have relatively simple shapes, it is also possible to display a virtually created line instead of an image under clear weather.

In places where the right sidewalk 308 or the left sidewalk 304 is narrow or non-existent, it is possible that a pedestrian or vehicle suddenly jumps out onto the roadway 300 from a building, park, parking lot, etc. located off the road. Therefore, it may be possible to extend the area in which past images are not displayed a little wider than the road. In other words, past images may not be displayed in an area that is outside the road but is close to the road and may affect traffic safety (referred to as the scenery near the road). can. For example, for an appropriate setting range (for example, within 3 m, 5 m, or 10 m) from the edge of the road, it is conceivable that past images are not displayed, as with the road. In addition, if there are buildings such as houses or stores, or objects such as trees within this setting range, past images will be used for the lower part of the object (for example, height of 2 m or less or 3 m or less from the road surface). A mode in which it is not displayed is also conceivable. This makes it possible, for example, to know who is actually going in and out of the store, while also making it possible to clearly recognize the store signboard from an image taken on a clear day.

In the example shown in FIG. 9, no image is displayed for the road sign 322, so that the actual road sign 322 can be seen. However, similarly to the center line 302 and the like, if what the road sign 322 represents can be confirmed by image recognition, an image of the road sign 322 prepared in advance may be displayed. This allows the driver 180 to see the road sign 322 clearly.

Next, an example of displaying past landscape data 84 will be described with reference to FIG. 10. FIG. 10 shows a state in which camera image data taken five years ago in this area is displayed, switching from the state shown in FIG. In this area, no buildings were built around road 300 even five years ago. However, a slightly higher hill 410 was spreading ahead, and trees 412 were also present. In FIG. 10, the scenery outside the road is displayed so as to be replaced with the camera image data from five years ago. The display is performed using a moving image that follows the movement of the vehicle 100. When displaying past camera image data, if there is a large deviation from the current position, the driver 180 will feel uncomfortable. Therefore, adjustments are made to match the actual position with relatively high accuracy.

In FIG. 10, past images are not displayed in the roadway 300, left sidewalk 304, right sidewalk 308, vehicle 320, road sign 322, and pedestrian 324 (ie, road scenery). This is because, similar to the explanation given in FIG. 9, traffic safety was taken into account. Furthermore, in the case of FIG. 10 as well, past images may not be displayed for scenery near the road.

Next, an example of displaying future virtual data 90 will be described with reference to FIG. 11. FIG. 11 is a diagram illustrating a state in which the predicted landscape for this area five years from now is displayed after switching from the state shown in FIG. 5. An airport is currently under construction in this area. The site is being maintained by removing Hill 410, which existed five years ago. For this reason, the plan is for the airport to open in three years.

In FIG. 11, the scenery outside the road is displayed as being replaced with a virtual image based on moving image data created in anticipation of what will happen after the airport opens. Specifically, buildings such as an airport control tower 420 and an aircraft 422 that took off from the airport are displayed. On the other hand, the image based on the future virtual data 90 is not displayed on the road scenery or even the scenery near the road, and priority is given to ensuring traffic safety. The future virtual data 90 allows the driver 180 to enjoy future scenery and grasp future development plans.

In the case of a specific building, the future virtual data 90 is displayed at the location where it will actually be built, thereby increasing the sense of realism. However, since the location of things or events expected in the future, including buildings, is usually not clearly determined, it is not necessary to strictly display them. Therefore, when the vehicle 100 moves forward, accelerates, turns, etc., if the image is displayed in such a way that it changes in accordance with the movement, although this is not strictly necessary, it will give the driver 180 a sufficient sense of realism. It is thought that it will be possible.

In the above description, an example is given in which an image is displayed on the wearable device 150 worn by the driver 180. Similarly, various displays can be displayed on wearable devices 150 worn by passengers other than the driver 180.

FIG. 12 shows a state in which the vehicle 100 is a vehicle that operates in an automatic driving mode, and the passenger 190 sitting in the driver's seat is not actually responsible for driving. The occupant 190 is not operating the steering wheel 238.

FIG. 12 shows a state in which the occupant 190 switches the display of the wearable device 150 to display a past virtual image from the scenery shown in FIG. 5. In the embodiment, it is assumed that this area is famous as an ancient battlefield where armies led by two famous warlords clashed over 400 years ago. Therefore, as past virtual data 88, moving image data that reproduces the battle scene is created.

In FIG. 12, this moving image is displayed on the entire surface of the front windshield 206, the left front side windshield 210, the left triangular window 212, the right front side windshield 220, and the right triangular window 222. Specifically, a hill 410 that existed five years ago and a large number of trees 430 are displayed in the distance. And on the right side, 432 samurai who belong to one military commander's army are holding flags on their backs and holding matchlock guns. In front of the samurai 432 and his friends, a fence 434 is installed to stop the cavalry from advancing. Also, on the left side, horse 436, ridden by a samurai belonging to the other military commander, takes the lead and begins a charge.

The displayed image is not just a drama, but is set so that the viewpoint moves according to the movement of the vehicle 100. In the example shown in FIG. 12, as the vehicle 100 travels, samurai warriors located ahead come into view one after another. However, the actual vehicle speed and the moving speed of the samurai in the image do not necessarily need to correspond perfectly, but only need to be correlated with the movement of the vehicle 100. As the vehicle 100 further travels, the image shifts to a hand-to-hand battle in which both sides fight using spears and swords. Along the way, image data has been created so that you can see military commanders wearing famous armor. In this way, the occupant 190 can enjoy past events as images through the wearable device 150. Sound may be output in accordance with the moving image to give a sense of realism.

In the example shown in FIG. 12, the image is displayed only in the range of the front windshield 206, the left front side windshield 210, the left triangular window 212, the right front side windshield 220, and the right triangular window 222. This is to allow the occupant 190 to enjoy the image while feeling that he or she is riding in the vehicle 100. Further, the occupant 190 can not only operate the touch panel 234 and the operation buttons 236 on which no images are displayed, but can also confirm the presence of the steering wheel 238 and the instruments 240 to obtain a sense of psychological security. However, from the viewpoint of prioritizing image display, the image may be displayed on the left A-pillar 202, the right A-pillar 204, etc., and the image may also be displayed on the roof 200, the instrument panel 230, etc. You can do it like this.

Further, in the example shown in FIG. 12, the scenery of the road including the roadway 300 is entirely replaced with an image based on past virtual data 88. This is because in the automatic driving mode, the occupant 190 is not responsible for driving and does not need to pay attention to anything outside the vehicle. In this way, for people other than the driver 180, it is possible to display images superimposed on the scenery of the road or the scenery near the road. Images can be displayed not only in the past virtual data 88 shown in FIG. 12, but also in the examples shown in FIGS. 5 to 11, without considering traffic safety. Note that passengers in the rear seats or passengers on a bus have a narrower field of view than those in the front seats, so the image should be superimposed on areas other than the windshield. You can.

This embodiment can adopt various other aspects. For example, the display system according to the present embodiment includes an information acquisition device that acquires event information about a past or future event included in the visual field of a vehicle occupant in association with the position of the event; and a display device that displays the event within the visual field of the occupant when the position of the event information is included in the visual field. can.
<Additional notes>
[1]
an information acquisition device that acquires event information about past or future events included in the visual field of a vehicle occupant;
a display device that displays the event within the visual field of the occupant based on the event information;
Equipped with
The information acquisition device acquires, as the event information, image data outside the vehicle taken by a vehicle that has traveled in the past;
The display system is characterized in that the display device adapts the image data to a traveling position of the vehicle in which the occupant rides, and displays events based on the image data.
[2]
an information acquisition device that acquires event information about past or future events included in the visual field of a vehicle occupant;
a display device that displays the event within the visual field of the occupant based on the event information;
Equipped with
The information acquisition device acquires information on past traffic accidents as the event information,
The display system is characterized in that the display device clearly indicates the location of the traffic accident and displays the event of the traffic accident.
[3]
an information acquisition device that acquires event information about past or future events included in the visual field of a vehicle occupant;
a display device that displays the event within the visual field of the occupant based on the event information;
Equipped with
The information acquisition device acquires, as the event information, virtually created image data regarding an event that is estimated to have occurred in the past;
The display system is characterized in that the display device associates the image data with a traveling position of the vehicle in which the occupant rides, and displays events based on the image data.
[4]
an information acquisition device that acquires event information about past or future events included in the visual field of a vehicle occupant;
a display device that displays the event within the visual field of the occupant based on the event information;
Equipped with
The information acquisition device acquires, as the event information, virtually created image data regarding an event that is estimated to occur in the future;
The display system is characterized in that the display device associates the image data with a traveling position of the vehicle in which the occupant rides, and displays events based on the image data.
[5]
In the display system according to any one of [1], [3], and [4] above,
the passenger is a driver;
The display system is characterized in that the display device displays a corresponding scenery superimposed on the actual scenery outside the road or in place of the actual scenery outside the road.
[6]
In the display system according to any one of [1], [3], and [4] above,
The occupant is other than the driver,
The display system is characterized in that the display device is capable of displaying a corresponding scenery overlaying or replacing a scenery including an actual road.
[7]
In the display system described in [1] above,
The information acquisition device acquires the image data taken on a sunny or cloudy day in the past when the weather around the vehicle in which the occupant rides is rainy or snowy;
The display system is characterized in that the display device displays a centerline based on the image data, superimposed on the actual centerline or in place of the actual centerline.

10 information system, 20 vehicle, 22 in-vehicle camera, 24 GNSS, 26 clock, 30 information distribution system, 40 collection server, 44 image processing device, 50 production server, 60 distribution server, 62 receiving device, 64 information selection device, 66 information Type determination unit, 68 Driving position determination unit, 70 Weather determination unit, 72 Driver determination unit, 74 Transmission device, 80 Storage server, 82 Traffic accident data, 84 Past scenery data, 86 Clear weather image data, 88 Past virtual data, 90 future virtual data, 100 vehicle, 110 image display system, 120 in-vehicle system, 122 operation input section, 124 display information setting section, 128 transmission section, 130 image processing device, 132 device/pupil position calculation section, 134 image layout calculation section , 136 image switching section, 138 image composition section, 140 GNSS, 142 speedometer, 144 receiving section, 146 temporary storage device, 150 wearable device, 152 temple, 154 rim, 160 device position sensor, 162 pupil position sensor, 164 image control part, 166 organic EL display, 168 operation part, 180 driver, 190 passenger, 200 roof, 202 left A pillar, 204 right A pillar, 206 front windshield, 208 interior mirror, 210 left front side windshield, 212 left triangular window , 214 Left front door trim, 216 Left outer mirror, 220 Right front side windshield, 222 Right triangular window, 224 Right front door trim, 226 Right outer mirror, 230 Instrument panel, 232 Center console, 234 Touch panel, 236 Operation buttons, 238 Steering, 240 Instruments type, 300 roadway, 302 center line, 304 left sidewalk, 306 curb, 308 right sidewalk, 310 curb, 320 vehicle, 322 road sign, 324 pedestrian, 330 skyline, 340 obstacle, 400 icon, 402 display window, 404 display Window, 410 hill, 412 tree, 420 control tower, 422 aircraft, 430 tree, 432 samurai, 434 fence, 436 horse.

Claims (6)

an information acquisition device that acquires event information about past or future events included in the visual field of a vehicle occupant;
a display device that displays the event within the visual field of the occupant based on the event information;
a display information setting unit that accepts settings regarding the event to be displayed on the display device;
Equipped with
The event information includes past scenery data and traffic accident data,
The past scenery data includes image data of the outside of the vehicle taken by a vehicle that traveled in the past,
The traffic accident data may be image data taken by a vehicle that caused a traffic accident, image data taken by vehicles existing around the traffic accident, or image data taken by a pedestrian or fixed road surveillance camera. including;
The display device adapts the event information to a traveling position of the vehicle in which the occupant rides, and displays an event based on the event information ,
In a case where the event of the past scenery data and the event of the traffic accident data are selected as display targets by the passenger operating the display information setting section, the display device displays the vehicle in which the passenger rides. A display system characterized in that when the traffic accident data exists at a driving position, the event of the traffic accident data is displayed preferentially over the event of the past scenery data. The display system according to claim 1,
The display system is characterized in that the display device clearly indicates the location of the traffic accident when displaying the event of the traffic accident data . The display system according to claim 1 or 2,
A display system characterized in that the event information includes image data that is virtually created regarding an event that is estimated to have occurred in the past. The display system according to any one of claims 1 to 3,
A display system characterized in that the event information includes image data that is virtually created regarding an event that is estimated to occur in the future. The display system according to any one of claims 1 to 4 ,
the passenger is a driver;
The display system is characterized in that, when displaying an event of the past scenery data, the display device replaces an actual scenery outside the road and displays a scenery corresponding to the past scenery data . The display system according to any one of claims 1 to 4 ,
The occupant is other than the driver,
The display system is characterized in that, when displaying an event of the past scenery data, the display device can replace a scenery including an actual road and display a scenery corresponding to the past scenery data. .

Images