JP3890596B2 - Vehicle information providing device - Google Patents

Description

  The present invention relates to a vehicular information providing apparatus, and more particularly, to a vehicular information providing apparatus that visually informs a vehicle occupant of a set apparent position of an object.

  There is known a vehicle information providing device (navigation device) that provides route information to a set destination to a vehicle occupant to guide the vehicle to the destination (see Patent Document 1). In such a device, the route and other information are transmitted to the vehicle occupant as visual information from a dedicated display screen or audio information from a speaker.

Japanese Patent Laid-Open No. 11-101653

  However, in the vehicle information providing device including the navigation device described above, visual information is transmitted to the driver and other occupants by being displayed on a monitor screen arranged near the center console.

  For this reason, a driver driving while looking forward through the windshield must move his line of sight from the front of the vehicle to a monitor screen near the center console in order to obtain visual information from the vehicle information providing device. I had to. In the case of other occupants as well, in order to obtain visual information, it is necessary to move the line of sight to the monitor screen near the center console.

Also, the image displayed on the monitor screen is an image of a map or illustration, and the image is significantly different from the scenery that is actually viewed. However, when the line of sight is returned from the monitor screen to the actual landscape, it is difficult to identify the object confirmed on the monitor screen in the actual landscape being viewed.
Furthermore, since it is difficult to grasp the perspective on the display on the monitor screen, it is difficult to specify the object confirmed on the monitor screen in the scenery where the object is actually visually recognized.

  The present invention has been made in such a situation, and provides a vehicle information providing apparatus that can surely notify an occupant of an apparent position of an object without causing the occupant to largely move his / her line of sight. Objective.

  According to the present invention, there is provided a vehicle information providing device for visually providing position information of a preset object to a vehicle occupant, wherein the occupant is set to the set object while the vehicle is traveling. When it is determined that the set object is visible, the occupant visually recognizes image information indicating the object that can be visually recognized. A position information display means for visually informing the occupant of the apparent position of the object in the landscape, and detecting the specific accuracy of the object. An information providing apparatus for a vehicle, comprising: an accuracy detecting unit; and a display mode changing unit that changes a display mode of the image information to a mode that is not conspicuous when it is determined that the specific accuracy is poor. Provided.

  Here, “the object can be visually recognized” means that the object is apparently small because the object is away from the vehicle, in addition to the case where the object can be directly identified with the naked eye in a real landscape. Although it cannot be identified with the naked eye, it includes a state where the place (position) where the object exists can be looked over.

  “Vehicle traveling” includes all vehicle use states such as when the vehicle is temporarily stopped, as well as when the vehicle is actually traveling. In addition, "objects" include facilities such as gas stations, convenience stores, restaurants, hotels, hot springs, public or other buildings, or things that can be visually identified such as mountains, rivers, lakes, etc. It is.

  “Specific accuracy” means the accuracy with which the image information (such as an arrow) indicating the target object superimposed on the actual landscape indicates the target object. The information (arrows, etc.) accurately indicates the object in the real landscape, and the specific accuracy is low (bad) means that the image accurately indicates the object in the real landscape. To do.

  According to such a configuration, when the accuracy of identifying the object deteriorates, the image information indicating the object is changed to an inconspicuous aspect, so even if these image information does not accurately indicate the object in the landscape. The feeling of discomfort given to the occupant is reduced.

  According to another preferred aspect of the present invention, the accuracy detecting means includes vehicle vibration, vehicle behavior, vehicle occupant posture change, vehicle current position specifying accuracy, and appearance of a plurality of objects to be displayed. The specific accuracy is detected based on the interval, the apparent size of the object to be displayed, or the distance to the object to be displayed.

According to another preferred aspect of the present invention, the display mode changing means changes the display color of the image information to an inconspicuous color when it is determined that the specific accuracy is poor.
According to such a configuration, the image information (such as an arrow) indicated by the object becomes inconspicuous by changing the display color, so that even if the image information does not accurately indicate the object in the landscape, The feeling of discomfort given is reduced.

According to another preferred aspect of the present invention, the display mode changing means reduces the image information when it is determined that the specific accuracy is poor.
According to such a configuration, image information (such as an arrow) indicating the object becomes inconspicuous by being reduced, so that even if the image information does not accurately indicate the object in the landscape, The feeling of discomfort given is reduced.

According to another preferred aspect of the present invention, the display mode changing means thins out the image information when it is determined that the specific accuracy is poor.
According to such a configuration, the displayed image information (arrows and the like) is reduced, so that the sense of discomfort given to the occupant is reduced even when these image information does not accurately indicate the object in the landscape.

According to another preferred aspect of the present invention, the display mode changing means does not thin out image information indicating a destination or a waypoint in route guidance. According to such a configuration, the image information of the target object whose position information such as the destination is highly important is not thinned out.
According to the other preferable aspect of this invention, the said display mode change means does not thin out the image information of the target object which the said passenger | crew is visually recognizing. According to such a configuration, it is possible to prevent the image information relating to the object being visually recognized from suddenly disappearing and the occupant from feeling uncomfortable.

According to another preferred aspect of the present invention, the display mode changing means thins out image information of a plurality of objects whose apparent intervals are narrow. This is because a plurality of objects having a narrow apparent interval, that is, a plurality of objects that appear densely, are likely to have difficulty in identifying individual positions with image information if the object identification accuracy is poor.
According to another preferred aspect of the present invention, the display mode changing unit thins out image information of an object having a small apparent size. This is because an object having a small apparent size is likely to be difficult to specify the position with image information if the accuracy of specifying the object is poor.

According to the other preferable aspect of this invention, the said display mode change means thins out the image information of the target object which is separated from the said vehicle from the predetermined distance.
According to the other preferable aspect of this invention, the said display mode change means thins out the image information of a target object according to the priority regarding the target object which the said passenger | crew set.
According to the other preferable aspect of this invention, the said display mode change means thins out the image information of the target object located in the advancing direction of the said vehicle.

  According to another aspect of the present invention, there is provided a vehicle information providing method for visually providing position information of a preset object to a vehicle occupant, wherein the occupant sets the setting while the vehicle is traveling. The occupant receives the image information indicating the visible object when it is determined that the set object can be visually recognized; Visually informing the occupant of the apparent position of the object in the landscape by superimposing and displaying it on the actual scenery being visually recognized, and detecting the specific accuracy of the object And a step of changing the display mode of the image information to an inconspicuous mode when it is determined that the specific accuracy is poor, and a vehicle information providing method is provided.

  According to another aspect of the present invention, there is provided a program for operating a vehicular information providing device that visually provides position information of a preset object to a vehicle occupant. It is determined whether or not an occupant can visually recognize the set object, and when it is determined that the set object is visible, image information indicating the object that can be visually recognized is displayed. By superimposing and displaying the actual scenery that the occupant is visually recognizing, the occupant is visually informed of the apparent position of the object in the scenery, and the specific accuracy of the object is detected, When it is determined that the specific accuracy is poor, a program is provided that operates the vehicular information providing apparatus so as to change the display mode of the image information to an inconspicuous mode.

  ADVANTAGE OF THE INVENTION According to this invention, the information provision apparatus for vehicles which can notify a passenger | crew reliably the apparent position of a target object, without a passenger | crew moving a eyes | visual_axis largely is provided.

  Hereinafter, a configuration of a vehicle information providing apparatus according to a preferred embodiment of the present invention will be described with reference to the accompanying drawings. The vehicle information providing apparatus according to this embodiment includes image information related to an object (visible from a vehicle window) including a facility such as a restaurant, a store, a hotel, or a mountain in an actual scenery visually recognized by a vehicle occupant. Is virtually displayed as a virtual image superimposed on the scenery that is actually visually recognized, thereby providing a function of notifying the occupant of the apparent position of the object. Furthermore, it has a function of superimposing a set message, advertisement or the like as a virtual image on a real landscape visually recognized by the occupant and displaying it virtually.

FIG. 1 is a drawing schematically showing a configuration of a vehicle information providing system (virtual real system) including a vehicle information providing apparatus 1 according to an embodiment of the present invention. In FIG. 1, the code | symbol 1 has shown the information provision apparatus for vehicle mounting. In the present embodiment, the vehicle information providing apparatus 1 also has a function as an in-vehicle route guidance device (navigation device) that performs route guidance to a set destination.
The vehicle information providing system is provided with an information center (server) 2 that provides information to the vehicle information providing apparatus 1. It can be connected to the Internet 4 via the vehicle information providing apparatus 1 and the communication station 3 installed in each region, and various information including information relating to map information and virtual images (image information) is received from the information center 2. It is configured to receive.

  This embodiment is configured such that common information is provided between the vehicle information providing devices 1 of a plurality of vehicles traveling in a group, and in FIG. Connected through. A terminal device (personal computer) 6 at the passenger's home and a terminal device (personal computer) 8 of a company, store, etc. that desires distribution of their own advertisements are also connected to the Internet 4.

The information center 2 includes a host computer 10 and a database 12.
As shown in FIG. 2, the database 12 includes map data 14, facility related data 16, customer data 18, and the like. The map data 12 includes three-dimensional data such as the size of a building in addition to information on roads. Therefore, in the present embodiment, it is possible to estimate how the surrounding buildings and scenery look from each position on the road based on this three-dimensional data. The facility-related data 16 includes data such as the position, name, and characteristics of the “object” for which position information is provided in this embodiment.
Further, the customer data 18 includes data related to a vehicle occupant who receives information, data related to a destination and a route set by the vehicle occupant, and the like. The customer data 18 further includes information distribution contract data 20 relating to the contents of the information distribution contract that the occupant has, virtual display data 22 relating to the form of the virtual image set by the occupant, and the like.

  The database 12 further includes image information providing data 24 for providing image information that is virtually displayed superimposed on the landscape. The image information providing data 24 includes a virtual image of an object to be superimposed on a landscape, virtual display image data 26 including a virtual image for route guidance of a preceding vehicle, etc., an advertisement related to an advertisement accepted by a passenger Distribution data 28 and the like are included.

The vehicle information providing device 1 performs a route guidance of the vehicle to the destination based on the input data and the operation of the occupant, and has a function of notifying the vehicle occupant of the preset apparent position of the target object. CPU30 which has.
The vehicle information providing apparatus 1 receives various information such as map information, building information, and information on virtual images from the information center 2 via the Internet 4 and receives various information from the vehicle side. 2 is provided. The transmission / reception device 32 is constituted by, for example, a car phone, a mobile phone, or a dedicated radio transceiver. In addition, the transmission / reception device 32 also functions as a communication unit that transmits / receives voice / information to / from other vehicles in the group during group traveling by a plurality of vehicles.

  The vehicular information providing apparatus 1 further includes an HDD storage device 34 that stores information relating to map information and virtual images received from the information center 2, a monitor screen 36 that displays various information such as map information, and the information center 2. Map information prepared independently on the vehicle side separately from the map information from the vehicle, DVD-ROM 38 for storing building information, destination setting, operation switch 40 for making a map information request to the information center 2, and the information center 2 is provided with a warning device 42 that warns the user when information cannot be received.

  The vehicle information providing apparatus 1 further includes a GPS receiver 44 that detects the current position of the vehicle, a vehicle speed sensor 46, and a gyro sensor 48. The GPS receiver 44 receives radio waves from the satellite to detect the current position of the vehicle, the vehicle speed sensor 46 detects the speed of the vehicle in order to obtain the moving distance, and the gyro sensor 48 detects the moving direction or direction of the vehicle. To do. The vehicle information providing apparatus 1 is configured so that the current position and orientation of the vehicle can be accurately calculated from the detection results of these sensors 46, 46, and 48.

  In addition, the vehicle information providing apparatus 1 detects the position and line of sight of an occupant such as a driver, and based on these, superimposes predetermined virtual image information on an actual landscape visually recognized by the occupant. It has a function. In order to display such a virtual image, the vehicle information providing device 1 includes an eye camera 50, a virtual image display device 52, and a CCD camera 54.

  The eye camera 50 is attached to an upper position in the cabin (a part of the rearview mirror), and by photographing the occupant's pupil, the position of the occupant's pupil, the direction of the line of sight, the distance to the visual object, etc. It is configured so that it can be detected. Here, the eye camera includes, for example, the EOG method, the photoelectric element type EOG (P-EOG) method, the corneal reflection method, the first and fourth Purkinje image detection methods, the contact lens method, the search coil method, and the infrared fundus camera method. Various techniques such as these are applied. The eye camera 50 is preferably capable of detecting the line of sight of each occupant in the vehicle. Further, instead of the eye camera 50, another means for detecting the line of sight of each occupant in the vehicle may be used.

  In this embodiment, the CPU 30 searches the map data based on the position of the occupant's pupil detected by the eye camera 50 and the current position and orientation of the vehicle, and the occupant can visually recognize a predetermined object. When it is possible to visually recognize the object, the virtual image information regarding the object is superimposed on the actual scenery visually recognized by the occupant and is virtually displayed. The virtual image display device 52 is a device that performs such virtual display, and a virtual image that allows only an occupant to visually recognize information about the object such as an arrow pointing to the object and the name of the object by a method such as a hologram. As a device for superimposing and displaying on an actual landscape visually recognized by a passenger.

  The CCD camera 54 is attached to the upper part of the vehicle with the front of the vehicle facing forward. From the captured image, the presence / absence of other vehicles traveling ahead, the traffic volume (the presence / absence of traffic jams and the degree of traffic jam), the presence / absence of pedestrians And the amount, brightness outside the vehicle, weather and the like can be detected. The detection result by the CCD camera 54 is sent to the CPU 30, and the CPU 30 changes or prohibits the display state of the virtual image based on this result.

  The vehicular information providing apparatus 1 further includes a voice interaction device 56. The voice interaction device 56 includes a speaker and a microphone, and has a function of providing voice information to the occupant and receiving an instruction by voice from the occupant.

FIG. 3 is a view showing the periphery of the driver's seat of the vehicle on which the vehicle information providing apparatus 1 of the present embodiment is mounted.
A speaker 58 is attached to the A-pillar in the vicinity of the driver's seat, and the speaker 58 provides voice guidance, notification, etc. to the passenger. A microphone 60 is disposed adjacent to the speaker 58, and is configured so that a voice instruction from an occupant (especially a driver) can be sent to the CPU 30.
An occupant detection sensor is incorporated in the driver seat 62, the passenger seat 64, and other seats (not shown) so that the presence or absence of an occupant can be detected for each seat.

  The main body unit 66 of the vehicle information providing apparatus 1 in which the CPU 30 of the vehicle information providing apparatus 1 is incorporated is attached to the dashboard. A monitor screen 36 of the vehicle information providing apparatus 1 is disposed in the vicinity of the main body unit 66. In this embodiment, the eye camera 50 is incorporated in the rearview mirror 68 so that the position and line of sight of each passenger can be detected. Furthermore, in the present embodiment, a transmission / reception device 32 that exchanges information with the information center 2 via the Internet 4 is attached between the driver seat and the passenger seat.

  In the present embodiment, a virtual image display device 52 using a dashboard hologram is incorporated. In FIG. 3, a virtual image (illustration or photograph) 68 of a gas station that is a set target object, an arrow pointing to the virtual image, and information about the target object (“the target gas station”) are displayed as a virtual image. The display device 52 shows a state in which a hologram is displayed at an apparent position of an object in an actual landscape that is being visually recognized by the occupant so that the occupant can visually recognize it.

Next, the operation of the vehicle information providing system including the vehicle information providing apparatus 1 will be described. FIG. 4 is a flowchart showing the operation of the vehicle information providing system as a whole centered on the processing performed by the vehicle information providing apparatus 1.
A user who is an occupant (for example, a driver) who wishes to receive information provided by a virtual image accesses the information center 2 from a personal computer 6 or the like in his / her home in advance, thereby providing information on the virtual real system, etc. Initial (initial) setting (step S1) is specified. This virtual real system is an aspect of so-called “telematics” that provides information to a vehicle-mounted terminal by wireless communication, and is a pay system in which a user pays a fee according to the amount of information received as an information fee. . It is assumed that the user has already registered necessary personal information such as address and name.

In the initial setting, first, an initial setting I screen for verification / registration related to visual acuity as shown in FIG. 5 is displayed on the screen of the user's personal computer 6. By selecting the item “Verification of visual acuity and verification of visual recognition level”, a screen for inspecting visual acuity / moving body visual acuity, etc. is displayed, and the visual acuity of the user is inspected by this inspection screen, and the inspection result is the visual acuity of the user Is recorded in the customer data 18 of the information center.
Next, when the item of “eye position registration” is selected, the position of the user's eyes in the state of being seated on the vehicle seat is registered based on the image obtained from the in-vehicle eye camera 50 when getting on. For the driver, the eye position may be estimated from the position of the seat and the angle of the room mirror.

Next, an initial setting II screen as shown in FIG. 6 is displayed on the screen of the user's personal computer 6. On the setting screen of this initial setting II, whether or not to display a virtual image and what display method to use are set. Details will be described below.
First, “ON” or “OFF” is selected in the “virtual object display” section to set whether or not to display a virtual image. In the case of “OFF”, this system is not operated. When “ON” is selected, any virtual image can be selected by selecting “ON” or “OFF” in each of the “NAVI display”, “message display”, and “advertising display” items. Decide whether to receive the offer.

When “NAVI display” is set to “ON”, an arrow pointing at a specific object, an image of the object, etc. are superimposed as a virtual image on the actual scenery viewed through the vehicle window while the vehicle is running. The “NAVI display” is executed under a predetermined condition. In this embodiment, an arrow indicating the target and the name of the target are displayed as a default. Therefore, for example, when Mt. Fuji at the destination, which is the set object, can be seen through the windshield while traveling, an arrow pointing to the actual Mt. Fuji and “Mt. The information (name) on the object “is” is displayed superimposed on the scenery that the occupant is viewing.
In addition, by performing a predetermined setting, as shown in FIG. 8, the set objects “gas station”, “restaurant”, and “park” reach a position where they can be seen through the windshield. Then, images of these objects (illustrations, photos, etc.) are displayed at the apparent positions of “gas stations”, “restaurants”, and “parks” in the actual landscape so as to overlap the actual landscape. The arrows indicating the images and the information “Gas station”, “Destination restaurant. The remaining 13 km”, and “◯ △ park” relating to each object are virtually displayed over the actual scenery. The setting of the display mode, such as whether or not to display the image of the object, is performed with the following items.

  When “message display” is set to “ON”, a message (message, graffiti) set by a passenger or a friend is superimposed on a real scene visually recognized as a virtual image under a predetermined condition while the vehicle is running. Virtually displayed “message display” is executed.

  Also, when “Advertisement Display” is set to “ON”, it means that it has been accepted to receive advertisements from companies and stores that have contracted to provide advertisements to this system while the vehicle is running. The “advertisement display” in which the displayed advertisement message is superimposed on the actual landscape visually recognized as a virtual image is displayed under predetermined conditions.

In the example of FIG. 6, “NAVI display”, “message display”, and “advertisement display” are all “ON”.
In the present embodiment, “NAVI display”, “message display”, and “advertisement display” can be selected for each region. For example, in general, “NAVI display” is not necessary in the local area because it is bright in geography. Therefore, “NAVI display” can be set to “OFF” only in a specific area. In addition, when driving to a destination to go for the first time, “NAVI display” can be set to “ON” only in the peripheral area of the destination. The same applies to “message display” and “advertisement display”.

  Next, in “virtual object display object priority setting”, which of the two types of virtual object display objects (virtual images) cannot be executed simultaneously is set. For example, if the display of the virtual image is set to include voice guidance, the voice guidance of “It is Mt. Fuji of the destination” in “NAVI display” and the voice of “Birth of RX-8” in “Advertisement display” Since the guidance may overlap in time, this setting is for dealing with such overlap. In the example shown, Message, 2. NAVI, 3. Priorities are given in the order of advertisements. Therefore, when the message and the NAVI overlap, the “message display” is executed first, and then the “NAVI display” is executed.

  Next, the display state of the virtual object (virtual image) is set in the section “Virtual Object Display Settings”. First, the size of the virtual image (for example, the virtual image of the gas station in FIG. 8) of the object to be virtually displayed and the size of the characters are set in the “magnification” section. The size is selected from “same size”, “2 times”, “3 times” or “automatic”. “Same size” means the same size (same size) as the apparent size of the object from the vehicle, or the default character size. “2 times” and “3 times” It means 2 times or 3 times the same magnification. In addition, “automatic” is a setting in which enlarged display (for example, double display) is performed when the distance to the object is greater than a predetermined value, and switching to the normal display is performed when the distance is less than the predetermined value. In the example of FIG. 6, “same size” is selected.

  Next, the number of virtual images to be displayed at the same time is set in the item “number of simultaneous displays”. This is a setting for preventing an increase in the number of displayed virtual images. In this embodiment, it is configured to select one of “standard”, “minimum”, “less”, “more”, and “most”, and “standard” is set in the example of FIG. This item can also be set for each region.

  Next, in the “superimposed display” section, handling when virtual images overlap is set. In this embodiment, either “prohibited” or “allowed” is selected, and when “prohibited” is selected, either “shifted display” or “prohibited” is selected. When “Allow” is selected, a plurality of virtual images may be displayed overlapping each other. When “shift display” is selected, virtual images that overlap when displayed at a predetermined position are displayed so as not to overlap. If “prohibited” is selected, if the virtual images overlap, all of the overlapping virtual images or other than one are prohibited.

  Finally, in the “target display area” section, it is set in which area the virtual object (virtual image) is displayed. In this embodiment, any one of “standard”, “narrow”, “wide”, and “maximum” is selected. For example, “wide” covers the area through the entire windshield, “standard” covers the area through only the right half of the windshield (the front part of the driver's seat), and “narrow” means the right half of the windshield. It is a setting that targets only a part of (the front part of the driver's seat) through the area, and the maximum is an area through the side glass in addition to the windshield. In the example of FIG. 6, “standard” is selected.

Next, the display duration of the virtual object (virtual image) is set in the section “Virtual Object Display Time”. In this embodiment, two types of “continuous time” and “total time” are specified. “Continuous time” is the duration of one display, and is selected from “While visible” if it is visible, and “15 seconds” when the display is terminated after 15 seconds from display disclosure. . In the example of FIG. 6, “15 seconds” is selected.
In addition, the “total time” indicates that the object (Mt. Fuji) that has become visible becomes invisible for reasons such as a curved road, and is displayed multiple times as when it becomes visible again. The total time is regulated, and “3 minutes” is selected in the example of FIG. Therefore, in the example of FIG. 7, the arrow and the virtual image of “Destination Mt. Fuji” are displayed for a total of only 3 minutes at the longest during traveling.

Finally, in “Other Settings”, the following settings are made: “Simultaneous use of voice guidance”, “Combination of object display”, “Perform display correction for each occupant”, and “Perform enlargement / reduction / deletion function”.
When “Voice Guidance” is set to ON, in the example shown in FIG. 7, a voice image “Destination Mt. Fuji” is simultaneously displayed when a virtual image “Destination Mt. Fuji” is displayed. .
In addition, the present embodiment basically has a configuration in which the apparent position of an object is indicated by an arrow and a name of a virtual image, but when “object display combined use” is set to ON, as shown in FIG. The virtual image of “gas station” by is virtually displayed as an object display at the position of the gas station in the actual landscape, and an arrow and name indicating this virtual image (object) are displayed.

  When a plurality of occupants are on the vehicle, the appearance of the scenery outside the vehicle is different for each occupant due to the difference in the boarding position. As a result, the gas station virtual image displayed in FIG. 8 does not appear to overlap with the actual position of the gas station for all passengers. “Perform display correction for each occupant” is for correcting such a shift. When “Perform display correction for each occupant” is ON, the position of the occupant is detected based on the detection result of the seat sensor, the display position of the virtual image is corrected for each occupant, and each occupant is displayed at an appropriate position. To make the virtual image visible. Note that the corrected virtual image is preferably displayed in a virtual manner in such a way that only the occupant who is the correction target can visually recognize it.

  Finally, the setting of “Perform the enlargement / reduction / deletion function” is performed. When this item is set to ON, the display mode of the virtual image being displayed can be changed by an instruction by voice from the occupant. When “Perform enlargement / reduction / deletion function” is turned ON, when a virtual image as shown in FIG. The virtual image becomes larger. In addition, it is possible to reduce or delete by voice instructions.

  When the setting of the basic items on the screen of FIG. 6 is completed, a setting screen related to NAVI of the initial setting II as shown in the figure is displayed on the screen of the user's personal computer 6. In this setting screen, what kind of display is to be performed in “NAVI display” is set. Details will be described below.

First, in the “display item of virtual object” item, what kind of display is to be performed is selected. In this embodiment, items of “Destination”, “Facilities”, “Leading vehicle”, “Guidance arrow”, and “Mark” are prepared.
When “Destination” is set to ON, the destination set in the route guidance becomes a display target of the virtual image. In other words, when Mt. Fuji is visible during route guidance for “Mt. Fuji” as a destination, a virtual image as shown in FIG. 7 is virtually displayed.
When “facility” is set to ON, facilities such as gas stations, convenience stores, restaurants, hotels, hot springs, public buildings, and other buildings are set as objects on which virtual images are virtually displayed. What kind of facility is displayed is set by other items. Further, when “detailed information” that can be selected when “facility” is ON, detailed information of each facility is displayed in addition to the arrow of the virtual image. For example, if the facility is a hot spring hotel, information about the quality of the hot spring is displayed.

When “leading vehicle” is turned ON, the leading vehicle based on the virtual image is virtually displayed, and route guidance is performed by this leading vehicle. That is, at the intersection to be turned right, the leading vehicle turns to the right, and by following the leading vehicle, the vehicle can arrive at the destination along a predetermined path. Instead of the leading vehicle, a configuration in which an animal or another object leads may be used.
When the “guidance arrow” is set to ON, route guidance is performed with an arrow based on a virtual image. That is, the route guidance similar to the arrow displayed on the monitor screen of a known navigation device is performed by the arrow of the virtual image superimposed on the actual landscape.
When the “mark” is set to ON, a building or the like that serves as a mark on the route is instructed by an arrow on the virtual image during route guidance.

Next, in the “display facility setting” section, it is determined what kind of genre information about the facility is to be notified in the virtual image. In this embodiment, as shown in FIG. 9, “registration facility”, “convenience store”, “road station”, “gas station”, “entertainment relationship”, “food-related relationship”, “event relationship”, The facility genre for which position information is to be obtained is selected from items such as “famous places”.
“Registered facility” is a section for setting a facility set separately by the user manually as a notification target. Using this term, for example, a restaurant on the route to the destination can be registered. In the “convenience store” and “gas station”, it is possible to set a convenience store of a specific chain (for example, 7-Eleven) and a gas station of a specific oil company (Eneos) by detailed setting. Further, in “food and drink relations”, it is possible to specify the type of food to be provided, such as French cuisine, Japanese food, sushi, udon, etc., in detailed settings. Further, in the “event relation” and “famous place”, a detailed genre can be specified similarly.

  Next, in the “target display area” section, the range that is the target of “NAVI display” is specified. As shown in FIG. 9, the present embodiment is configured to set from “standard”, “narrow”, “wide”, and “maximum”. In “standard”, for example, a facility existing within a range of 1 km in front and 500 meters to the side is set as a target of “NAVI display”. By limiting the target display area in this way, it is possible to prevent an extremely large number of virtual images from being displayed in an urban area and obstructing the field of view.

Next, the display duration of the virtual object (virtual image) is set in the section “Virtual Object Display Time”. In this embodiment, two types of “continuous time” and “total time” are specified. “Continuous time” is the duration of one display, and is selected from “While visible” if it is visible, and “15 seconds” when the display is terminated after 15 seconds from display disclosure. . In the example of FIG. 6, “15 seconds” is selected.
In addition, the “total time” is the number of times that a visible item (gas station) once became unrecognizable due to a curved road, etc. The total display time is restricted. In the example of FIG. 9, “3 minutes” is selected.

  Next, in the “Destination Setting Function” section, settings relating to a function that can set the destination while traveling are performed. This “Destination Setting Function” is used when a driver or other occupant identifies an object displayed by a virtual image while traveling, the object is set as the destination, and a route to the destination is set. This is a function to induce. In the present embodiment, “speech” and “pointing” are set as the identification method by the occupant. When “Voice” is turned ON, the destination can be input by voice. That is, in the state where the virtual image as shown in FIG. 8 is displayed, when a passenger such as a driver gives a voice and instructs “the destination is ○ △ park”, the voice dialogue device 56 recognizes this instruction, and ○ △ Park is set as the destination. When “pointing” is turned ON, the destination can be input by pointing. That is, in a state where a virtual image as shown in FIG. 8 is displayed, when an occupant, such as a driver, points “X Park” with his / her finger and inputs this as “Destination”, the operation is performed by the eye camera 50. Is set as a destination.

Finally, registration for group travel is performed. This registration is a registration performed to establish communication by sharing the same information among a plurality of vehicles traveling in a group when traveling in a group. One member of the group, usually a leader, , Register.
First, by inputting the ID (for example, 0001, 0002, 00341, 0055) of the vehicle information providing apparatus 1 mounted on another vehicle that performs group traveling, a member that performs group traveling is specified. Next, the leader in the group is specified. Next, “facility to be displayed by group members” to be displayed in common in the registered group is set. This setting method is the same as the “display facility setting” described above. Information about the facility set here is uniformly provided to all registered groups.

Furthermore, the “notification function” is set. This ventilation function is a function for notifying each vehicle when common information is obtained for all the vehicles traveling in the group. For example, if you can see Mt.Fuji from all the vehicles while driving with a group of five, change the color of the text “Destination Mt. Fuji” in FIG. 7 from white to blue on all vehicles. This function allows all vehicles to recognize that Mt. Fuji can be seen from all vehicles.
In this embodiment, when “notify when information can be shared” or “not notify” is selected and “notify when information can be shared” is selected, a display color is displayed as a notification method. One of “color” that changes and “voice” in which voice guidance such as “Mt. Fuji can be seen from all vehicles” is performed is selected.

  The settings in FIG. 9 are configured so that different settings can be made for “by region”, “by time zone”, “by day of the week”, and “by passenger”.

  Various data registered as described above are stored in the data 18, 20, 22, etc. of the database 12 of the information center 2 (step S2).

Next, when the user who has made the above settings transmits the destination and necessary route information from the vehicle information providing apparatus 1 (or the home personal computer 6) to the information center 2 (step S3), the information center 2 Then, the map information to the set destination is read from the map data 14, and distribution map data relating to the route to the destination is created. Further, the map data is processed to incorporate data for performing NAVI display, message display, and advertisement display based on the virtual image based on the setting in step S1, and the processed data is stored in the vehicle information providing apparatus 1 of the user. Transmit (step S4). It is preferable that an advertisement related to the area displayed on the map displayed on the route to the destination is incorporated in the map data.
The vehicle information providing device 1 of the user's vehicle receives the processed map data that has been transmitted, and starts route guidance to the destination based on the received map data (step S5).

Next, the vehicle information providing apparatus 1 determines whether or not a condition for displaying a virtual image is satisfied (step S6). Regarding NAVI display, it is determined whether or not there is an object to be provided with information by a virtual image. In addition, regarding message display and advertisement display, it is determined whether or not the display condition set in the initial setting is satisfied.
This determination is made based on the vehicle position based on the detection result of the GPS receiver 44, the object to be displayed in the received processed map data, information on the position, and the like. When YES is determined in the step S6, the process proceeds to a step S7 so as to determine whether or not the vehicle occupant can visually recognize the area serving as the background of the object or the message. “Visible” means that the object is too small to be identified with the naked eye because the object is far away from the vehicle, in addition to the case where the object can be directly identified with the naked eye in a real landscape. Although it is not possible, a state where the place (position) where the object exists can be looked over is included.
This determination is based on the position and direction of the own vehicle, three-dimensional data such as buildings around the current position of the vehicle included in the map information, topography, position information of the object, detection result of the presence or absence of the preceding vehicle by the CCD camera 54, and the like. Done. If NO in step S6 or step S7, the process returns to step S6.

When YES is determined in the step S7, the display position and display method of the virtual image to be displayed are calculated (step S8). The display position of the virtual image is set so that the target occupant can recognize that the virtual image is present at a predetermined position in the scenery being viewed. That is, in the example of FIG. 7, the position where the occupant can recognize Mt. Fuji in the actual landscape as being pointed by the arrow is the virtual image arrow and the display position of the information “Mt. Fuji at the destination”. Is set. Similarly, in the case of the example in FIG. 8, the display position is set.
Specifically, the eye position of an occupant (for example, a driver) is estimated from an image of an eye camera, etc., and the occupant visually recognizes the position of the eye, the current position and direction of the vehicle, map data, and the like. The placement position of the virtual image is calculated so that the virtual image is placed at a predetermined position in the actual landscape.
At this time, when there are a plurality of occupants, it is preferable that the positions of the eyes of each occupant are detected and the display position of the virtual image is set for each occupant.

Also, the virtual image display method is based on the initial setting and display with “arrows” and names as shown in FIG. 7, and the virtual image of the object (gas station) and its facility name (gas station) as shown in FIG. ) And the like are appropriately set. In addition, the color and brightness of the displayed virtual image (for example, an arrow) are appropriately set according to the color, brightness, and the like of the actual scenery serving as the background. The color and brightness of the actual scenery as the background are detected from the image of the CCD camera 54 and the like.
Further, the size of the virtual image is also set. The size setting is performed based on the setting in the “magnification ratio” section described with reference to FIG.

  In addition, since there are many cases where the object cannot be visually identified at night or when visibility is poor due to bad weather, the object display may be automatically added under such conditions.

  Next, the process proceeds to step S9, and it is determined whether or not the virtual image display prohibition condition is satisfied. The prohibition condition is a condition that prevents safe operation of the vehicle by displaying a virtual image. Specifically, when the vehicle is turning, when there is a lot of traffic around the vehicle, or when the displayed virtual image overlaps a traffic sign such as a signal or a road sign. Further, when the object for which image information is provided by virtual display is at a very close distance, the display prohibition condition also applies when the number of virtual images to be displayed exceeds a predetermined number.

When YES is determined in the step S9, a display prohibiting process is performed in a step S10, and the process returns to the step S6. If NO in step S9, the process proceeds to step S11 to display a virtual image. When NO in step S9, instead of the display prohibition process in step S10, a process of shifting the display position of the virtual image to a position that does not overlap with the traffic sign or a process of reducing the number of virtual images to be displayed After performing, the structure which progresses to step S11 may be sufficient.
In step S11, for example, virtual display as shown in FIGS. 7 and 8 is executed based on the setting in step S1. When the virtual image is a message display from another person such as a friend, the virtual image may be provided with a function of notifying the sender's friend or the like via the information center 2 that the message display has been executed.

Next, the process proceeds to step S12, and it is determined whether or not the display end condition is satisfied. The end condition is that the occupant is no longer able to see the target object that is being displayed in virtual, the display time is more than the specified number of times, the display time or total display time exceeds the specified value, and the operation is out of the display area. The panel is turned off manually. This end condition is determined for each virtual image. If YES in step S12, the process proceeds to step S13, and the display of the corresponding virtual image is terminated.
Furthermore, it progresses to step S14, it is determined whether it arrived at the destination, a process is complete | finished when it arrives at the destination, and when it has not arrived, it returns to step S6.

  As described above, the vehicular information providing apparatus according to the present embodiment allows the occupant to visually recognize the virtual image based on the current position / orientation of the vehicle, the position / gaze of the occupant's eyes (pupil), map data, and the like. Display to show the object in the landscape. Therefore, if the current position and direction of the vehicle are not accurately input to the vehicle information providing apparatus 1, the position indicated by the virtual image (such as an arrow) becomes inaccurate. The same applies when the position of the passenger's eyes changes. When display using a virtual image is performed in such a state, the virtual image (such as an arrow) shows a position away from the object, giving the passenger a sense of discomfort. In addition, even when the apparent intervals of a plurality of objects to be displayed are narrow, that is, the objects are densely packed, the virtual image cannot accurately indicate the objects, and the passenger may feel uncomfortable.

  For this reason, in the present embodiment, in the calculation of the display position of the virtual image performed in step S8, the accuracy (specific accuracy of the target) that the virtual image (such as an arrow) points to the target is detected. When the image quality is poor, the display mode of the virtual image (such as an arrow) is changed to a non-conspicuous display mode (display mode when the specific accuracy is deteriorated). Hereinafter, this process will be described with reference to the flowchart of FIG.

First, in step S20, the specific accuracy of the object is detected. In the vehicle information providing apparatus 1 according to the present embodiment, various factors can be cited as factors that cause the arrows in the virtual image not to accurately place the object.
This factor can be broadly divided into a factor on the vehicle side and a factor on the object side. The factors on the vehicle side are: when the vehicle vibrates up and down due to bad road driving, when the direction of the vehicle (behavior) changes due to steering operation, when the occupant changes posture and the position of the eyes changes, GPS (GDOP ), The current position specifying accuracy of the vehicle deteriorates. Further, factors of the object side, when the object is thus apparently small arrows deviation, plurality of objects to be displayed, which the arrows because adjacent is pointing to what object indefinitely There are times when it becomes.

In this embodiment, the vibration of the vehicle, the behavior of the vehicle, the posture change of the occupant of the vehicle, the accuracy of specifying the current position of the vehicle, the apparent interval between a plurality of objects to be displayed, and the apparent size of the object to be displayed. The distance to the object to be displayed is assumed as a factor, and each of these factors is given a predetermined weight to calculate the final specific accuracy for each object.
In addition, the structure which does not use all of these, or the structure using another factor may be sufficient.

  In this embodiment, when the vibration of the vehicle is large, when the behavior of the vehicle changes greatly, when the posture change of the vehicle occupant is large, when the current position specifying accuracy of the vehicle is poor, the appearance of a plurality of objects to be displayed When the upper interval is small, when the apparent size of the target object to be displayed is small, and when the distance to the target object to be displayed is not close, the specific accuracy becomes worse. Calculated. Specifically, predetermined weights are given to numerical values of various sensors mounted on the vehicle, and the final specific accuracy for each object is calculated.

Next, the process proceeds to step S21, and the specific accuracy calculated in step S20 is compared with a threshold value to determine whether the specific accuracy is “good”, “bad”, or “very bad”. When “good”, the process proceeds to step S22, and normal display (arrow and name of the object) is set. When “very bad”, the process proceeds to step S23, and display prohibition is set. If display prohibition is set, YES is obtained in step S9, and the process proceeds to step S10, where display is prohibited.
If it is determined as “bad” in step S21, the process proceeds to step S24, and the display mode when the specific accuracy is bad is set.

  FIG. 12 is a diagram schematically illustrating a landscape in which a virtual image of a display mode when the specific accuracy is poor is superimposed. In this embodiment, when the specific accuracy is poor, the display mode of the virtual image is changed from the normal display where the arrows and characters are white (FIG. 11) to the display when the specific accuracy of light gray is poor (FIG. 12). Is done. For convenience of drawing, in FIG. 12, arrows and characters are displayed as white characters, but these white characters mean light-colored characters.

In other words, the arrows and the names of display objects “XX Gymnasium”, “XX Hotel”, “Hotel XX”, “Convenience Store ABC XX Store”, “Convenience Store ABC XX Store”, “GS” The character “” is changed from “white” in the normal display to “light gray” which is an inconspicuous color. It is preferable that the inconspicuous color is appropriately changed according to the background color.
When the deterioration of the specific accuracy is caused by the object side, for example, when the apparent size of a certain object is small, the display mode is changed only for the image information (arrow, name) related to the object.

  The present invention is not limited to the above-described embodiments, and various changes or modifications can be made within the scope of the technical matters described in the claims.

  The above embodiment is a configuration in which the color of the arrow or the like is changed when the accuracy of specifying the object by the virtual image is poor. However, as shown in FIG. 13, the arrow and the name of the display object “XX” The size of the characters “gymnasium”, “XX hotel”, “hotel XX”, “convenience store ABC XX store”, “convenience store ABC XX store”, and “GS” may be reduced.

  Further, as shown in FIG. 14, the virtual image (image information) may be thinned out. In the example of FIG. 14, “XX gymnasium”, “hotel XX”, “convenience store ABC XX store”, and “convenience store ABC XX store” which are objects to be displayed are displayed from the normal display of FIG. The arrow to be inserted and the display of these names are deleted (thinned out).

  In such a configuration, thinning is performed based on any criterion, but is set in advance, and thinning is performed based on this criterion. Specifically, for example, destinations set at the time of route guidance, transit points, and other registered locations designated by the occupant at initials are not subject to thinning, and objects that are visible to the occupant to be displayed Is not subject to thinning, multiple objects with a small apparent interval are subject to thinning, objects with small apparent size are subject to thinning, and objects that are more than a predetermined distance from the vehicle There are standards such as the object of thinning, and these are appropriately combined to set what kind of thinning is performed. As a default, there is a “recommended thinning” pattern, and this may be changed as appropriate.

  In the example of FIG. 14, two convenience stores are thinned because the apparent distance is small, and “XX City Gymnasium” is thinned because the distance is long. On the other hand, “GS” is not thinned because it is visually recognized by the passenger, “XX Hotel” is a destination for route guidance, and “Hotel XX” is thinned because it is not set as a transit point. Absent.

  In addition, a configuration may be used in which the priority of thinning is set for each genre in the initial setting, and thinning is performed according to the priority and the degree of deterioration of the specific accuracy. For example, if the accommodation facility is set to priority (1), then the convenience store is set to priority (2) and the gas station is set to priority (3), according to the deterioration of the specific accuracy, first, image information relating to the accommodation facility The image information regarding the convenience store may be thinned out when the information is thinned and the specific accuracy further deteriorates.

It is drawing which shows roughly the structure of the information provision system for vehicles (virtual real system) containing the information provision apparatus for vehicles of the embodiment of this invention. It is drawing which shows typically the data contained in the database of an information center. It is drawing which shows the circumference | surroundings of the driver's seat of the vehicle by which the vehicle information provision apparatus of this embodiment is mounted. It is a flowchart which shows the operation | movement of the vehicle information provision system whole centering on the process performed with the vehicle information provision apparatus. It is drawing which shows the setting screen of the initial setting I performed with a virtual real system. It is drawing which shows the setting screen of initial setting II performed with a virtual real system. It is drawing which shows an example of the scenery where the virtual image by the NAVI display performed by the information provision apparatus for vehicles was superimposed. It is drawing which shows the other example of the landscape on which the virtual image by the NAVI display performed by the information provision apparatus for vehicles was superimposed. It is drawing which shows the setting screen of initial setting III performed with a virtual real system. It is a flowchart of a part of process in calculation, such as a display position of a virtual image. It is drawing which shows typically the scenery on which the virtual image by the display mode when specific accuracy is good was superimposed. It is drawing which shows typically the scenery on which the example of the virtual image by the display mode when specific accuracy was bad was superimposed. It is drawing which shows typically the scenery on which the virtual image by the display mode of the other example when specific accuracy is bad is superimposed. It is drawing which shows typically the scenery on which the virtual image by the display mode of another example when specific accuracy is bad is superimposed.

Explanation of symbols

1: Vehicle information providing device 2: Information center 4: Internet 10: Host computer 12: Database 30: CPU
32: Transmission / reception device 50: Eye camera 52: Virtual image display device

Claims (3)

A vehicle information providing device that visually provides position information of a preset object to a vehicle occupant,
Visual determination means for determining whether or not the occupant can visually recognize the set object while the vehicle is traveling;
When it is determined that the set object can be visually recognized, the occupant is displayed by superimposing and displaying the image information indicating the visually observable object on the actual scenery that the occupant is visually recognizing. Position information display means for visually informing the apparent position of the object in the landscape;
Accuracy detection means for calculating a specific accuracy representing the accuracy with which the image points to the object based on the current position specific accuracy of the vehicle ;
Display mode changing means for comparing the calculated specific accuracy with a threshold value and reducing the image information or thinning out the image information when it is determined that the specific accuracy is poor. ,
An information providing apparatus for a vehicle characterized by the above. A vehicle information providing device that visually provides position information of a preset object to a vehicle occupant,
Visual determination means for determining whether or not the occupant can visually recognize the set object while the vehicle is traveling;
When it is determined that the set object can be visually recognized, the occupant is displayed by superimposing and displaying the image information indicating the visually observable object on the actual scenery that the occupant is visually recognizing. Position information display means for visually informing the apparent position of the object in the landscape;
Accuracy detection means for calculating a specific accuracy representing the accuracy with which the image points to the object , based on apparent intervals of a plurality of objects to be displayed ;
Display mode changing means for comparing the calculated specific accuracy with a threshold value and reducing the image information or thinning out the image information when it is determined that the specific accuracy is poor. ,
An information providing apparatus for a vehicle characterized by the above. A vehicle information providing device that visually provides position information of a preset object to a vehicle occupant,
Visual determination means for determining whether or not the occupant can visually recognize the set object while the vehicle is traveling;
When it is determined that the set object can be visually recognized, the occupant is displayed by superimposing and displaying the image information indicating the visually observable object on the actual scenery that the occupant is visually recognizing. Position information display means for visually informing the apparent position of the object in the landscape;
An accuracy detecting means for calculating a specific accuracy representing the accuracy with which the image points to the object based on the apparent size of the object to be displayed or the distance to the object to be displayed ;
Comparing the calculated specific accuracy with a threshold value, and when it is determined that the specific accuracy is poor, the display mode changing means for thinning out the image information ,
The display mode changing means thins out image information of an object having a small apparent size.
An information providing apparatus for a vehicle characterized by the above.

Images