JP2019046071A - Information providing device and information provision method - Google Patents

Abstract

To provide an information providing technique with which it is possible to give a sense of safety to people aboard the own vehicle.SOLUTION: The information providing device comprises a generation unit for generating an image that represents a virtual vehicle, and a superimposition unit for superimposing the image that represents the virtual vehicle on a landscape image that represents a landscape around the own vehicle. The image that represents the virtual vehicle is superimposed on an area that corresponds to a location in the landscape image where the own vehicle travel from now. The location where the own vehicle travels from now moves along a scheduled travel route to the destination of the own vehicle, and, with at least one intermediate location is set on the scheduled travel route, when the location where the own vehicle travels from now passes through the intermediate location, an afterimage that represents the virtual vehicle is superimposed on an area in the landscape image that corresponds to the intermediate location.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technology for providing information to a vehicle occupant.

  In recent years, development of vehicles having an automatic driving function has been vigorously promoted. For example, there are commercially available vehicles that can perform parking by automatic driving that requires no driver's operation.

JP, 2016-182891, A

  However, a vehicle having a conventional automatic driving function can not notify the occupant in advance of how the vehicle will behave in automatic driving, so an occupant unfamiliar with the behavior of the vehicle in automatic driving Was afraid to

  In the image display system for a vehicle disclosed in Patent Document 1, when the autonomous driving system tries to cause the vehicle to take an unscheduled traveling action different from the planned traveling action, the unplanned traveling is performed in advance. An image of the action visually represented by a virtual vehicle is displayed in advance. The image display system for a vehicle disclosed in Patent Document 1 assumes that the autonomous driving system tries to cause the vehicle to take an unscheduled traveling action different from the planned traveling action. Can not display an image including a virtual vehicle when it causes the own vehicle to take a planned running action.

  In addition, even in the case of not being driven automatically, an occupant who is not familiar with the vehicle may feel anxious when the prospect of the vehicle traveling from now on is not clear.

  An object of the present invention is to provide an information providing technology capable of giving a sense of security to an occupant of a host vehicle in view of the above-mentioned problems.

  An information providing apparatus according to the present invention includes a generation unit that generates an image representing a virtual vehicle, and a superimposing unit that superimposes an image representing the virtual vehicle on a landscape image representing a landscape around the host vehicle. The image representing the vehicle is superimposed on the area corresponding to the position where the vehicle in the landscape image is to travel from now, and the position at which the vehicle is traveling from now is along the planned travel route to the destination of the vehicle. And at least one intermediate position is provided on the planned travel route, and when the position where the own vehicle travels from now passes the intermediate position, the afterimage of the image representing the virtual vehicle is the one in the landscape image. It is the composition (the 1st composition) superimposed on the field corresponding to an intermediate position.

  In the information providing apparatus of the first configuration, the image representing the virtual vehicle appears at the current position of the vehicle in the landscape image and then moves to the destination (second configuration) It may be.

  In the information providing apparatus of the first or second configuration, when the position where the host vehicle is driving automatically and the position where the host vehicle is traveling passes the intermediate position, an afterimage of an image representing the virtual vehicle is the image in the landscape image. The configuration (third configuration) may be superimposed on the area corresponding to the intermediate position.

  In the information providing device according to any one of the first to third configurations, the afterimage of the image representing the virtual vehicle may be a configuration (fourth configuration) different from the image representing the virtual vehicle.

  In the information provision device according to any one of the first to fourth configurations, the intermediate position may be a configuration (fifth configuration) where the traveling direction of the host vehicle is switched.

  In the information provision device according to any one of the first to fifth configurations, the generation unit generates an image representing a movement route along which the position where the host vehicle is traveling has moved, and the superposition unit is configured to A configuration (sixth configuration) may be adopted in which an image representing the movement path is superimposed.

  An information providing method according to the present invention includes a generation step of generating an image representing a virtual vehicle, and a superimposing step of superimposing an image representing the virtual vehicle on a landscape image representing a scenery around the host vehicle. The image representing the vehicle is superimposed on the area corresponding to the position where the vehicle in the landscape image is to travel from now, and the position at which the vehicle is traveling from now is along the planned travel route to the destination of the vehicle. And at least one intermediate position is provided on the planned travel route, and when the position where the own vehicle travels from now passes the intermediate position, the afterimage of the image representing the virtual vehicle is the one in the landscape image. It is a configuration (seventh configuration) superimposed on the area corresponding to the intermediate position.

  According to the present invention, since it is possible to notify in advance to the occupant of the host vehicle what behavior the host vehicle will perform from now on, it is possible to give a sense of security to the occupant of the host vehicle.

Diagram showing an example of the configuration of an information providing apparatus A diagram illustrating the position where four on-board cameras are placed on the vehicle Figure showing an example of a virtual projection plane Flow chart showing an operation example of the information providing apparatus A diagram showing an example of an output image A diagram showing an example of an output image A diagram showing an example of an output image A diagram showing an example of an output image A diagram showing an example of an output image A diagram showing an example of an output image A diagram showing an example of an output image A diagram showing an example of an output image A diagram showing an example of an output image

  Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings.

<1. Configuration Example of Information Providing Device>
FIG. 1 is a diagram showing an example of the configuration of an information providing apparatus. The information providing device 201 illustrated in FIG. 1 is mounted on a vehicle such as an automobile, for example. Hereinafter, a vehicle on which the information providing device 201 is mounted is referred to as a "vehicle". In addition, a direction in which the host vehicle travels straight ahead, which is directed from the driver's seat to steering, is referred to as "forward". In addition, a direction in which the host vehicle travels straight and is directed from the steering to the driver's seat is referred to as “rearward”. In addition, a direction perpendicular to the straight traveling direction of the vehicle and the vertical line, that is, a direction from the right to the left of the driver facing the front is referred to as “left direction”. Further, a direction perpendicular to the straight traveling direction of the vehicle and the vertical line, that is, a direction from the left to the right of the driver facing the front is referred to as “right direction”.

  The front camera 11, the back camera 12, the left side camera 13, the right side camera 14, the vehicle control ECU 15, the information providing device 201, the display device 31, and the speaker 32 shown in FIG. 1 are mounted on the vehicle.

  FIG. 2 is a view exemplifying the positions at which four on-vehicle cameras (front camera 11, back camera 12, left side camera 13 and right side camera 14) are disposed in the host vehicle V1.

  The front camera 11 is provided at the front end of the host vehicle V1. The optical axis 11a of the front camera 11 is along the front-rear direction of the vehicle V1 in plan view from above. The front camera 11 shoots the front of the host vehicle V1. The back camera 12 is provided at the rear end of the host vehicle V1. The optical axis 12a of the back camera 12 is along the front-rear direction of the vehicle V1 in plan view from above. The back camera 12 shoots the rear of the host vehicle V1. The attachment positions of the front camera 11 and the back camera 12 are preferably at the left and right center of the host vehicle V1, but may be slightly offset from the left and right center in the left and right direction.

  The left side camera 13 is provided on the left side door mirror M1 of the host vehicle V1. The optical axis 13a of the left side camera 13 is along the left-right direction of the vehicle V1 in plan view from above. The left side camera 13 shoots the left direction of the host vehicle V1. The right side camera 14 is provided on the right side door mirror M2 of the host vehicle V1. The optical axis 14a of the right side camera 14 is in the left-right direction of the vehicle V1 in a plan view from above. The right side camera 14 shoots the right direction of the host vehicle V1. When the host vehicle V1 is a so-called door mirrorless car, the left side camera 13 is attached around the rotation axis (hinge part) of the left side door without passing through the door mirror, and the right side camera 14 is the right side door It is attached around the axis of rotation (hinge part) without interposing a door mirror.

  The angle of view θ in the horizontal direction of each on-vehicle camera is 180 degrees or more. Therefore, it is possible to capture the entire circumference of the host vehicle V1 in the horizontal direction by the four on-vehicle cameras (the front camera 11, the back camera 12, the left side camera 13 and the right side camera 14). In the present embodiment, the number of in-vehicle cameras is four, but the number of in-vehicle cameras necessary for creating a bird's-eye-view image to be described later using a captured image of the in-vehicle camera is not limited to four. And multiple cameras are sufficient. As one example, when the horizontal angle of view θ of each on-vehicle camera is relatively wide, a bird's-eye image may be generated based on three captured images acquired from three cameras less than four. Furthermore, as another example, when the horizontal angle of view θ of each on-vehicle camera is relatively narrow, a bird's-eye image may be generated based on five captured images obtained from five or more cameras.

  Returning to FIG. 1, the four on-vehicle cameras (front camera 11, back camera 12, left side camera 13, and right side camera 14) output the photographed image to the information providing device 201. The vehicle control ECU 15 outputs control information regarding automatic driving of the host vehicle to the information providing device 201. The vehicle control ECU 15 uses, for example, an analysis result of a captured image of a vehicle-mounted camera, information output from a radar device mounted on the vehicle, communication with a cloud center, information obtained by inter-vehicle communication, road-vehicle communication, etc. By using or, to plan the planned travel route in automatic driving.

  The information providing device 201 processes the captured image output from the four on-vehicle cameras (front camera 11, back camera 12, left side camera 13, and right side camera 14), and outputs the processed image to the display device 31. Do. Further, the information providing device 201 performs control to output a sound from the speaker 32.

  The display device 31 is provided at a position where the driver of the host vehicle can visually recognize the display screen of the display device 31, and displays an image output from the information providing device 201. Examples of the display device 31 include a display installed on a center console, a meter display installed on the opposite position of the driver's seat, and a head-up display projecting an image on a windshield.

  The speaker 32 outputs sound in accordance with the control of the information providing device 201.

  The information providing apparatus 201 can be configured by hardware such as an application specific integrated circuit (ASIC) or a field-programmable gate array (FPGA), or a combination of hardware and software. When software is used to configure the information providing apparatus 201, a block diagram of a part implemented by software represents a functional block diagram of the part. A function implemented using software may be described as a program, and the function may be implemented by executing the program on a program execution device. Examples of the program execution device include a computer provided with a central processing unit (CPU), a random access memory (RAM), and a read only memory (ROM).

  The information providing device 201 includes a photographed image acquisition unit 21, an image generation unit 22, and an audio control unit 23.

  The captured image acquisition unit 21 has a predetermined cycle (for example, 1/30 second cycle) of analog or digital captured images from four on-vehicle cameras (front camera 11, back camera 12, left side camera 13, and right side camera 14). Obtained continuously in time). Then, if the acquired captured image is analog, the captured image acquisition unit 21 converts the analog captured image into a digital captured image (A / D conversion). The captured image acquisition unit 21 outputs the acquired captured image or the captured and acquired image obtained by conversion to the image generation unit 22.

  The image generation unit 22 includes an overhead image generation unit 22a, a virtual vehicle generation unit 22b, a planned traveling route acquisition unit 22c, and a superposition unit 22d.

  The overhead image generation unit 22a projects the captured image acquired by the captured image acquisition unit 21 on a virtual projection plane and converts it into a projected image. Specifically, the overhead image generation unit 22a projects the photographed image of the front camera 11 onto the first region R1 of the virtual projection plane 100 in the virtual three-dimensional space shown in FIG. Into a first projected image. Similarly, the overhead image generation unit 22a generates the photographed image of the back camera 12, the photographed image of the left side camera 13, and the right side camera 14 in each of the second to fourth regions R2 to R4 of the virtual projection plane 100 shown in FIG. The photographed image of the rear camera 12 is projected, and the photographed image of the back camera 12, the photographed image of the left side camera 13 and the photographed image of the right side camera 14 are converted into second to fourth projected images.

  The virtual projection plane 100 shown in FIG. 3 has, for example, a substantially hemispherical shape (a bowl shape). The central portion (bottom portion of the bowl) of the virtual projection plane 100 is defined as the position where the host vehicle V1 is present. As described above, when the virtual projection plane 100 includes the curved surface, distortion of the image of the object present at the position away from the host vehicle V1 can be reduced. Further, each of the first to fourth regions R1 to R4 has a portion overlapping with another adjacent region. By providing such an overlapping portion, it is possible to prevent the image of the object projected on the boundary of the region from disappearing from the projection image.

  The overhead image generation unit 22a generates a virtual viewpoint image viewed from a virtual viewpoint based on a plurality of projection images. Specifically, the overhead image generator 22a virtually pastes the first to fourth projection images to the first to fourth regions R1 to R4 of the virtual projection plane 100.

  In addition, the overhead image generation unit 22a virtually configures a model of a polygon that indicates the three-dimensional shape of the host vehicle V1. The model of the vehicle V1 is located in the first region R1 at a position (the central portion of the virtual projection surface 100) determined as the position where the vehicle V1 is present in a virtual three-dimensional space in which the virtual projection surface 100 is set Is disposed on the front side, and the fourth region R4 is on the rear side.

  Furthermore, the overhead image generation unit 22a sets a virtual viewpoint in a virtual three-dimensional space in which the virtual projection plane 100 is set. The virtual viewpoint is defined by the viewpoint position and the viewing direction. The viewpoint position and the viewing direction of the virtual viewpoint can be set to any viewpoint position and any viewing direction as long as at least a part of the virtual projection plane 100 is in the field of view. In this embodiment, the viewpoint position of the virtual viewpoint is behind and above the host vehicle, and the viewing direction of the virtual viewpoint is ahead of and below the host vehicle. Thus, the virtual viewpoint image generated by the overhead image generation unit 22a becomes an overhead image. Further, by setting the viewpoint position of the virtual viewpoint behind and above the host vehicle and setting the viewing direction of the virtual viewpoint ahead and below the host vehicle, the driver makes the positional relationship between the host vehicle and a virtual vehicle described later more accurate. Can be confirmed. Note that, unlike the present embodiment, for example, the viewpoint position may be a standard driver eye position, and the viewing direction may be in front of the host vehicle.

  The overhead view image generation unit 22a virtually cuts out an image of a necessary area (area seen from the virtual viewpoint) on the virtual projection plane 100 according to the set virtual viewpoint. Further, the overhead view image generation unit 22a performs rendering on a model of a polygon according to the set virtual viewpoint, and generates a rendering image of the host vehicle V1. Then, the overhead image generation unit 22a generates an overhead image in which the rendering image of the vehicle V1 is superimposed on the clipped image. That is, the overhead image generator 22a generates an image representing the vehicle. In addition, the rendering image of the vehicle V1 (image representing the vehicle) is superimposed on the area corresponding to the current position of the vehicle in the overhead image.

  The virtual vehicle generation unit 22 b generates an image representing the virtual vehicle using CG (Computer Graphics).

  The planned travel route acquisition unit 22c acquires information (scheduled travel route information) on a planned travel route from the current position of the vehicle when the automatic driving is performed to the destination. For example, the planned traveling route acquisition unit 22 c acquires planned traveling route information from the vehicle control ECU 16.

  The superimposing unit 22d superimposes an image representing a virtual vehicle on the overhead image. The image representing the virtual vehicle is superimposed on the area corresponding to the position where the host vehicle in the overhead image automatically drives and travels. The position where the own vehicle performs automatic driving and travels from now moves along the planned travel route to the destination of the own vehicle when the automatic driving is performed.

  The sound control unit 23 causes the speaker 32 to generate a notification sound (for example, an electronic sound of a constant rhythm) notifying that the virtual vehicle is moving, for example, while the virtual vehicle is moving in the overhead image.

<2. Operation Example of Information Providing Device>
FIG. 4 is a flowchart showing an operation example of the information providing apparatus 201. The information provision device 201 starts the flow operation shown in FIG. 4 immediately before the host vehicle performs automatic driving. In the present embodiment, it is assumed that the host vehicle performs automatic parking by automatic driving. Therefore, in the present embodiment, the parking position is the destination.

  When the flow operation illustrated in FIG. 4 is started, first, the captured image acquisition unit 21 acquires captured images from four on-vehicle cameras (front camera 11, back camera 12, left side camera 13, and right side camera 14) ( Step S10).

  Next, the overhead image generation unit 22a generates an overhead image using the captured image acquired by the captured image acquisition unit 21 (step S20). In addition, illustration of a parking vehicle is abbreviate | omitted in the bird's-eye view of FIGS. 5-13 mentioned later.

  Next, the virtual vehicle generation unit 22b generates an image representing the virtual vehicle (step S30).

  Next, the superposing unit 22d superimposes an image representing the virtual vehicle on the overhead image (step S40).

  In the present embodiment, the superimposing unit 22d is configured so that an image representing a virtual vehicle appears at the current position of the vehicle in the overhead image, and then moves to a position where the vehicle performs automatic driving and travels from here. An image representing the vehicle is superimposed on the overhead image.

  Specifically, when the process of step S40 is performed in a state in which the image representing the virtual vehicle is not superimposed on the overhead image, the image representing the virtual vehicle corresponds to the current position of the vehicle in the overhead image. It is superimposed on the area. Therefore, the bird's-eye view image output from the information providing device 201 to the display device 31 changes from, for example, the bird's-eye view shown in FIG. 5 to the bird's-eye view shown in FIG. The rendering image VR1 of the host vehicle is superimposed on the overhead image shown in FIG. 5, and the rendering image VR1 of the host vehicle and an image V2 representing a virtual vehicle are superimposed on the overhead image shown in FIG. In addition, although the image V2 showing a virtual vehicle is not illustrated so that it may have permeability in FIGS. 8-11 mentioned later, it is an image which has permeability actually.

  In addition, when superimposing the image V2 representing the virtual vehicle on the overhead image, the image generation unit 22 stops the automatic driving from the position of the virtual vehicle in the overhead image at the lower left corner of the overhead image shown in FIG. A graph in which the distance to the position and the vertical axis indicate the vehicle speed of the host vehicle in automatic driving at the position of the virtual vehicle in the overhead image is also superimposed on the overhead image. The direction of the vehicle in the graph indicates the traveling direction of the virtual vehicle to the stop position, and FIG. 6 shows that the virtual vehicle advances to the stop position. Black circles in the graph indicate the state (position and speed) of the virtual vehicle. With this graph, it is possible to inform in advance the occupants of the vehicle of the behavior of the vehicle from now on more clearly in automatic driving.

  On the other hand, when the process of step S40 is performed in a state in which the image representing the virtual vehicle is already superimposed on the overhead image, the image representing the virtual vehicle is automatically driven by the host vehicle in the overhead image Is superimposed on the area corresponding to the position where the Therefore, by repeating the process of step S40, the bird's-eye view image output from the information providing device 201 to the display device 31 changes, for example, from the bird's-eye view shown in FIG. 6 to the bird's-eye view shown in FIG. Thereafter, the image representing the virtual vehicle moves to the destination in the overhead image (see FIGS. 8 and 9 described later).

  As described above, the virtual vehicle moves in the overhead image along the planned travel route to the destination of the vehicle in automatic driving, so the behavior of the vehicle in the automatic driving may be determined by the driver of the vehicle. Can be informed in advance. Thereby, the occupant of the host vehicle can feel secure.

  In addition, since the host vehicle and the virtual vehicle are included in the overhead image as described above, the occupant of the host vehicle can intuitively grasp the positional relationship between the host vehicle and the virtual vehicle. Therefore, the occupant of the host vehicle can intuitively grasp what behavior the host vehicle will perform in automatic driving. This increases the sense of security of the occupant of the host vehicle.

  Also, as described above, an image representing a virtual vehicle appears at the current position of the host vehicle, and then the host vehicle performs automatic driving and moves to a position where it will travel from now on, thereby separating the virtual vehicle from the host vehicle Because the driver looks like in the above, the driver can intuitively understand that the traveling route of the virtual vehicle is the planned traveling route to the destination of the own vehicle in automatic driving.

  In step S50 following step S40, the image generation unit 22 determines whether the virtual vehicle has arrived at an intermediate position on the planned travel route. In the present embodiment, in automatic driving, a position at which the traveling direction of the host vehicle switches from forward to reverse is taken as an intermediate position on the planned travel route. Note that the intermediate position on the planned travel route is, for example, a position where the traveling direction of the host vehicle switches from reverse to forward, a position where the host vehicle makes a U-turn, a position where the host vehicle turns left, a position where the host vehicle turns right, etc. May be

  If the virtual vehicle has not arrived at the intermediate position on the planned travel route, the process returns to step S10. On the other hand, if the virtual vehicle has arrived at the intermediate position on the planned travel route, the process proceeds to step S60.

  In step S60, the superposing unit 22d superimposes the afterimage of the image representing the virtual vehicle on the overhead image. The afterimage of the image representing the virtual vehicle is superimposed on the area corresponding to the intermediate position on the planned travel route in the overhead image.

  In step S70 following step S60, the image generation unit 22 determines whether the virtual vehicle has arrived at the destination.

  If the host vehicle has not arrived at the destination, the process immediately returns to step S10. On the other hand, if the virtual vehicle has arrived at the destination, the flow operation is ended.

  For example, the bird's-eye view image immediately before the process of step S60 is executed is as shown in FIG. 8, and the bird's-eye view image just before the end of the flow operation is as shown in FIG. The afterimage A1 of the image representing the virtual vehicle in the overhead image shown in FIG. 9 is an aspect different from the image V2 representing the virtual vehicle. For example, the modes may be different from each other depending on the presence or absence of blinking, the color, and the like. By making the afterimage A1 of the image representing the virtual vehicle different from the image V2 representing the virtual vehicle, it is possible that the occupant of the host vehicle confuses the afterimage A1 of the image representing the virtual vehicle with the image V2 representing the virtual vehicle. It can be prevented.

  By leaving an afterimage of the image representing the virtual vehicle at an intermediate position on the planned travel route as described above, the occupant of the own vehicle can clearly grasp which position on the planned planned route is the intermediate position. it can.

  In addition, by setting the intermediate position to a position at which the traveling direction of the host vehicle is switched during automatic driving, the occupant of the host vehicle can clearly understand the position at which the behavior of the host vehicle changes significantly in automatic driving. Feeling is increased. Here, the position at which the traveling direction of the host vehicle is switched means a position at which the rate of change in the traveling direction of the host vehicle is larger than a threshold. For example, by setting the threshold relatively large, the position at which the traveling direction of the host vehicle is switched is only the position at which the host vehicle is switched between forward and reverse. On the other hand, by setting the threshold relatively small, the position at which the traveling direction of the host vehicle switches includes not only the position at which the host vehicle switches forward and backward but also the position at which the steering angle is largely changed in parallel parking etc. It will be.

<3. Other>
Various technical features disclosed in the present specification can be modified in various ways without departing from the spirit of the technical creation in addition to the above embodiment. Also, the plurality of modifications shown in the present specification may be implemented in combination as far as possible.

  For example, the image generation unit 22 generates an image representing a moving route where the position where the own vehicle travels from now on moves automatically, and the superimposing unit 22 d superimposes an image representing the moving route on the overhead image. It is also good. In this case, the information provision device 201 generates a bird's-eye view shown in FIG. 10 instead of the bird's-eye view shown in FIG. 9 as the bird's-eye view immediately before the end of the flow operation. On the overhead image shown in FIG. 10, an image W1 representing the above moving path is superimposed. As a result, it is possible to notify in advance the occupants of the vehicle of the behavior of the vehicle from now on more clearly in automatic driving.

  Also, for example, when the image representing the virtual vehicle moves backward, the overhead image generation unit 23a changes the viewpoint position of the virtual viewpoint to almost directly above the host vehicle, as in the overhead image shown in FIG. The direction of the field of view may be changed almost directly below (approximately in the direction of gravity). As a result, the occupant of the host vehicle can easily grasp the movement of the image representing the virtual vehicle when the image representing the virtual vehicle moves backward.

  Further, for example, the information providing device 201 generates an overhead image as shown in FIG. 12 when detecting that another vehicle is scheduled to leave immediately before starting the flow operation shown in FIG. 4. It is also good. On the bird's-eye view image as shown in FIG. 12, an index B1 indicating a planned leaving route of another vehicle and an index B2 prompting the vehicle to stop are superimposed. As a result, it is possible to prevent contact between the own vehicle and another vehicle scheduled to leave the house soon. Moreover, it becomes possible to include the parking position of the other vehicle which is scheduled to leave the housing soon, in the planned travel route to the destination of the automatic driving. For example, to detect that another vehicle is about to leave, use the analysis result of the captured image of the onboard camera, or information output from the radar device mounted on the own vehicle, communication with the cloud center, inter-vehicle communication , Information obtained by road-vehicle communication, etc. can be used.

  Further, for example, in addition to the overhead image generated by the overhead image generation unit 22a, the image generation unit 23 generates an image representing a top view schematically showing the surrounding situation of the vehicle, for example, as shown in FIG. A bird's-eye view image generated by the bird's-eye view image generation unit 22a and an image representing a top view schematically showing the surroundings of the vehicle may be simultaneously displayed on the display screen of the display device 31. Thus, the occupant of the host vehicle can easily grasp the peripheral situation of the host vehicle. An image representing a top view schematically showing the surroundings of the host vehicle can be created using, for example, information obtained by communication with a cloud center, inter-vehicle communication, road-vehicle communication, or the like.

  Further, for example, when there are a plurality of candidate routes as the planned travel route to the destination of the automatic driving, the information providing device 201 causes the display device 31 to display an image showing an outline of each candidate route, One of the candidate routes may be selected. Alternatively, when there are a plurality of candidate routes as the planned travel route to the destination of the automatic driving, the information providing apparatus 201 executes the flow operation shown in FIG. One of the candidate routes may be selected.

  Further, in the above-described embodiment, the appearance position of the image representing the virtual vehicle is the current position of the vehicle, but the appearance position of the image representing the virtual vehicle is automatically driven from the appearance appearance It may be a position.

  Further, in the embodiment described above, the captured image is used to generate the image (output image) output from the information providing device 201 to the display device 31. However, CG representing the scenery around the host vehicle without using the captured image Computer Graphics) may be used to generate the output image. In the case of generating an output image using CG representing the scenery around the host vehicle, the information providing device 201 acquires CG representing the scenery around the host vehicle from a navigation device mounted on the host vehicle, for example. Just do it.

  Further, the output image output from the information providing device 201 to the display device 31 may include vehicle speed information of the host vehicle, range information of the shift lever of the host vehicle, and the like.

  Moreover, in the flowchart shown in FIG. 4, steps S50 and S60 may be omitted.

  Further, in the overhead image on which the image representing the virtual vehicle is superimposed, when the distance between the virtual vehicle and the obstacle is equal to or less than the threshold value, the obstacle is close to the virtual vehicle at a position near the obstacle. You may superimpose the index which shows. As a result, the occupant of the host vehicle can know that the automatic driving system can correctly recognize the approach between the virtual vehicle and the obstacle, which increases the sense of security.

  In the above embodiment and the above modification, although the image representing the virtual vehicle is superimposed on the area corresponding to the position where the own vehicle performs automatic driving and travels from now on, the own vehicle travels from now on without performing the automatic driving An image representing the virtual vehicle may be superimposed on the area corresponding to the position where the virtual vehicle is located. In this case, for example, a guidance route guided by the navigation device can be used as the planned travel route to the destination. Then, for example, by providing an intermediate position in the middle of a poor S-curve or a crank path, even when the virtual vehicle is hidden on the output image, the occupant of the host vehicle relies on the afterimage of the virtual vehicle. Thus, it is possible to drive the virtual vehicle to follow the own vehicle. As a result, even when the virtual vehicle is hidden on the output image, the occupants of the own vehicle can be given a sense of security.

  Further, in the embodiment and the modification described above, not only an image representing a virtual vehicle but also an image representing the vehicle are also overhead images so that the driver can intuitively grasp the positional relationship between the vehicle and the virtual vehicle. Although the image is superimposed, an image representing the host vehicle may not be superimposed on the overhead image.

  Further, in the embodiment and the modification described above, the output image output from the information providing apparatus is a bird's eye image, but the output image output from the information providing apparatus is not limited to a bird's eye image, for example, a front camera An image or the like representing a virtual vehicle may be superimposed on the 11 captured images.

21 camera image acquisition unit 22 image generation unit 23 voice control unit 201 information providing apparatus

Claims (7)

A generation unit that generates an image representing a virtual vehicle;
And a superimposing unit that superimposes an image representing the virtual vehicle on a landscape image representing a landscape around the vehicle.
The image representing the virtual vehicle is superimposed on a region corresponding to a position where the vehicle in the landscape image is to travel.
The position where the host vehicle travels from now on moves along the planned travel route to the destination of the host vehicle.
At least one intermediate position is provided on the planned travel route, and when the position where the own vehicle travels from now passes the intermediate position, an afterimage of an image representing the virtual vehicle corresponds to the intermediate position in the landscape image. An information providing device superimposed on the area.   The information providing device according to claim 1, wherein the image representing the virtual vehicle appears at the current position of the vehicle in the landscape image and then moves to the destination.   When the position where the own vehicle performs automatic driving and traveling from here passes the intermediate position, an afterimage of an image representing the virtual vehicle is superimposed on a region corresponding to the intermediate position in the landscape image. Or the information provision apparatus of Claim 2.   The information providing device according to any one of claims 1 to 3, wherein an afterimage of an image representing the virtual vehicle is different from an image representing the virtual vehicle.   The information provision device according to any one of claims 1 to 4, wherein the intermediate position is a position at which the traveling direction of the host vehicle is switched. The generation unit generates an image representing a movement route along which the position at which the host vehicle travels is moved.
The information providing device according to any one of claims 1 to 5, wherein the superimposing unit superimposes an image representing the movement path on the landscape image. Generating an image representing a virtual vehicle;
And a superimposing step of superimposing an image representing the virtual vehicle on a landscape image representing a landscape around the vehicle.
The image representing the virtual vehicle is superimposed on a region corresponding to a position where the vehicle in the landscape image is to travel.
The position where the host vehicle travels from now on moves along the planned travel route to the destination of the host vehicle.
At least one intermediate position is provided on the planned travel route, and when the position where the own vehicle travels from now passes the intermediate position, an afterimage of an image representing the virtual vehicle corresponds to the intermediate position in the landscape image. An information provision method superimposed on the area.