JP3931338B2 - Vehicle information providing device - Google Patents

Description

  The present invention relates to a vehicular information providing apparatus, and more particularly, to a vehicular information providing apparatus that visually informs a vehicle occupant of a set apparent position of an object.

  There is known a vehicle information providing device (navigation device) that provides route information to a set destination to a vehicle occupant to guide the vehicle to the destination (see Patent Document 1). In such a device, the route and other information are transmitted to the vehicle occupant as visual information from a dedicated display screen or audio information from a speaker.

Japanese Patent Laid-Open No. 11-101653

  However, in the vehicle information providing device including the navigation device described above, visual information is transmitted to the driver and other occupants by being displayed on a monitor screen arranged near the center console.

  For this reason, a driver driving while looking forward through the windshield must move his line of sight from the front of the vehicle to a monitor screen near the center console in order to obtain visual information from the vehicle information providing device. I had to. In the case of other occupants as well, in order to obtain visual information, it is necessary to move the line of sight to the monitor screen near the center console.

Also, the image displayed on the monitor screen is an image of a map or illustration, and the image is significantly different from the scenery that is actually viewed. However, when the line of sight is returned from the monitor screen to the actual landscape, it is difficult to identify the object confirmed on the monitor screen in the actual landscape being viewed.
Furthermore, since it is difficult to grasp the perspective on the display on the monitor screen, it is difficult to specify the object confirmed on the monitor screen in the scenery where the object is actually visually recognized.

  The present invention has been made in such a situation, and provides a vehicle information providing apparatus that can surely notify an occupant of an apparent position of an object without causing the occupant to largely move his / her line of sight. Objective.

  According to the present invention, there is provided a vehicle information providing device for visually providing position information of a preset object to a vehicle occupant, wherein the occupant is set to the set object while the vehicle is traveling. When it is determined that the set object is visible, the occupant visually recognizes image information indicating the object that can be visually recognized. A position information display means for visually informing the occupant of the apparent position of the object in the landscape, and detecting the specific accuracy of the object. There is provided an information providing apparatus for a vehicle, characterized by comprising: an accuracy detecting unit; and an accuracy notifying unit for notifying the occupant of information relating to the specific accuracy.

  Here, “the object can be visually recognized” means that the object is apparently small because the object is away from the vehicle, in addition to the case where the object can be directly identified with the naked eye in a real landscape. Although it cannot be identified with the naked eye, it includes a state where the place (position) where the object exists can be looked over.

  “Vehicle traveling” includes all vehicle use states such as when the vehicle is temporarily stopped, as well as when the vehicle is actually traveling. In addition, "objects" include facilities such as gas stations, convenience stores, restaurants, hotels, hot springs, public or other buildings, or things that can be visually identified such as mountains, rivers, lakes, etc. It is.

  “Specific accuracy” means the accuracy with which an instruction display (such as an arrow) superimposed on an actual landscape indicates an object, and high (good) identification accuracy indicates an instruction display (such as an arrow) ) Means that the object in the real landscape is accurately pointed out, and the low (bad) specific accuracy means that the image accurately points to the object in the real landscape.

  According to such a configuration, the occupant can know how accurately the image information indicates the object in the actual landscape. That is, the apparent position of the image information may deviate from the predetermined position due to vehicle vibration, vehicle behavior change, or occupant's own posture change. In such a case, the occupant cannot obtain information on the positional deviation of the image information, makes a determination based on the image information that appears at the shifted position, for example, an object that is pointed by an arrow that indicates an incorrect position. May be misunderstood as an object to which an arrow should be originally attached. However, according to such a configuration, such a problem can be prevented in advance.

  According to another preferred aspect of the present invention, the accuracy detecting means includes vehicle vibration, vehicle behavior, vehicle occupant posture change, vehicle current position specifying accuracy, and appearance of a plurality of objects to be displayed. The specific accuracy is detected based on the interval, the apparent size of the object to be displayed, or the distance to the object to be displayed.

According to another preferred aspect of the present invention, the accuracy notification means notifies the cause of the deterioration of the specific accuracy. According to such a configuration, the occupant may be able to improve the accuracy of specifying the object by removing the factor of deterioration of accuracy.
According to another preferred aspect of the present invention, the accuracy notification means notifies a coping method for the cause of the deterioration of the specific accuracy. Even with such a configuration, the occupant may be able to improve the accuracy of specifying the object by removing the factor of deterioration of accuracy.

According to another preferred aspect of the present invention, the image processing apparatus includes object specifying means for specifying the object that is provided with the image information and specified by one of the occupants, and the object specifying means performs the object specifying. The accuracy notification means performs the notification.
According to such a configuration, the occupant can specify the object to which the image information is provided with reference to the accuracy of the position information represented by the image information.

  According to another preferred aspect of the present invention, there is provided a specification prohibiting means for prohibiting the specification of an object by the object specifying means when the specifying accuracy is worse than a predetermined value. According to such a configuration, it is possible to prevent an erroneous target object from being specified due to deterioration in the accuracy of specifying the target object.

  According to another preferred aspect of the present invention, the accuracy notification means always performs the notification. According to such a structure, the passenger | crew can always obtain the information regarding the specific precision of a target object.

According to another preferred aspect of the present invention, the vehicle further includes notification restriction means for restricting the notification by the accuracy notification means when the vehicle is actually running.
According to another preferred aspect of the present invention, when the specific accuracy is worse than a predetermined value, the position information display means delays the change of the display position of the image information in response to the change in the line of sight of the occupant.
According to another preferred aspect of the present invention, the accuracy notification means notifies the information related to the specific accuracy by superimposing the information on the actual scenery that the occupant is viewing.

  According to another aspect of the present invention, there is provided a vehicle information providing method for visually providing position information of a preset object to a vehicle occupant, wherein the occupant sets the setting while the vehicle is traveling. The occupant receives the image information indicating the visible object when it is determined that the set object can be visually recognized; Visually informing the occupant of the apparent position of the object in the landscape by superimposing and displaying it on the actual scenery being visually recognized, and detecting the specific accuracy of the object And a step of notifying the occupant of information relating to the specific accuracy. A vehicle information providing method is provided.

  According to another aspect of the present invention, there is provided a program for operating a vehicular information providing device that visually provides position information of a preset object to a vehicle occupant. It is determined whether or not an occupant can visually recognize the set object, and when it is determined that the set object is visible, image information indicating the object that can be visually recognized is displayed. By superimposing and displaying the actual scenery that the occupant is visually recognizing, the occupant is visually informed of the apparent position of the object in the scenery, and the specific accuracy of the object is detected, There is provided a program characterized by operating a vehicle information providing apparatus so as to notify the occupant of information relating to the specific accuracy.

  ADVANTAGE OF THE INVENTION According to this invention, the information provision apparatus for vehicles which can notify a passenger | crew reliably the apparent position of a target object, without a passenger | crew moving a eyes | visual_axis largely is provided.

  Hereinafter, a configuration of a vehicle information providing apparatus according to a preferred embodiment of the present invention will be described with reference to the accompanying drawings. The vehicle information providing apparatus according to this embodiment includes image information related to an object (visible from a vehicle window) including a facility such as a restaurant, a store, a hotel, or a mountain in an actual scenery visually recognized by a vehicle occupant. Is virtually displayed as a virtual image superimposed on the scenery that is actually visually recognized, thereby providing a function of notifying the occupant of the apparent position of the object. Furthermore, it has a function of superimposing a set message, advertisement or the like as a virtual image on a real landscape visually recognized by the occupant and displaying it virtually.

FIG. 1 is a drawing schematically showing a configuration of a vehicle information providing system (virtual real system) including a vehicle information providing apparatus 1 according to an embodiment of the present invention. In FIG. 1, the code | symbol 1 has shown the information provision apparatus for vehicle mounting. In the present embodiment, the vehicle information providing apparatus 1 also has a function as an in-vehicle route guidance device (navigation device) that performs route guidance to a set destination.
The vehicle information providing system is provided with an information center (server) 2 that provides information to the vehicle information providing apparatus 1. It can be connected to the Internet 4 via the vehicle information providing apparatus 1 and the communication station 3 installed in each region, and various information including information relating to map information and virtual images (image information) is received from the information center 2. It is configured to receive.

  This embodiment is configured such that common information is provided between the vehicle information providing devices 1 of a plurality of vehicles traveling in a group, and in FIG. Connected through. A terminal device (personal computer) 6 at the passenger's home and a terminal device (personal computer) 8 of a company, store, etc. that desires distribution of their own advertisements are also connected to the Internet 4.

The information center 2 includes a host computer 10 and a database 12.
As shown in FIG. 2, the database 12 includes map data 14, facility related data 16, customer data 18, and the like. The map data 12 includes three-dimensional data such as the size of a building in addition to information on roads. Therefore, in the present embodiment, it is possible to estimate how the surrounding buildings and scenery look from each position on the road based on this three-dimensional data. The facility-related data 16 includes data such as the position, name, and characteristics of the “object” for which position information is provided in this embodiment.
Further, the customer data 18 includes data related to a vehicle occupant who receives information, data related to a destination and a route set by the vehicle occupant, and the like. The customer data 18 further includes information distribution contract data 20 relating to the contents of the information distribution contract that the occupant has, virtual display data 22 relating to the form of the virtual image set by the occupant, and the like.

  The database 12 further includes image information providing data 24 for providing image information that is virtually displayed superimposed on the landscape. The image information providing data 24 includes a virtual image of an object to be superimposed on a landscape, virtual display image data 26 including a virtual image for route guidance of a preceding vehicle, etc., an advertisement related to an advertisement accepted by a passenger Distribution data 28 and the like are included.

The vehicle information providing device 1 performs a route guidance of the vehicle to the destination based on the input data and the operation of the occupant, and has a function of notifying the vehicle occupant of the preset apparent position of the target object. CPU30 which has.
The vehicle information providing apparatus 1 receives various information such as map information, building information, and information on virtual images from the information center 2 via the Internet 4 and receives various information from the vehicle side. 2 is provided. The transmission / reception device 32 is constituted by, for example, a car phone, a mobile phone, or a dedicated radio transceiver. In addition, the transmission / reception device 32 also functions as a communication unit that transmits / receives voice / information to / from other vehicles in the group during group traveling by a plurality of vehicles.

  The vehicular information providing apparatus 1 further includes an HDD storage device 34 that stores information relating to map information and virtual images received from the information center 2, a monitor screen 36 that displays various information such as map information, and the information center 2. Map information prepared independently on the vehicle side separately from the map information from the vehicle, DVD-ROM 38 for storing building information, destination setting, operation switch 40 for making a map information request to the information center 2, and the information center 2 is provided with a warning device 42 that warns the user when information cannot be received.

  The vehicle information providing apparatus 1 further includes a GPS receiver 44 that detects the current position of the vehicle, a vehicle speed sensor 46, and a gyro sensor 48. The GPS receiver 44 receives radio waves from the satellite to detect the current position of the vehicle, the vehicle speed sensor 46 detects the speed of the vehicle in order to obtain the moving distance, and the gyro sensor 48 detects the moving direction or direction of the vehicle. To do. The vehicle information providing apparatus 1 is configured so that the current position and orientation of the vehicle can be accurately calculated from the detection results of these sensors 46, 46, and 48.

  In addition, the vehicle information providing apparatus 1 detects the position and line of sight of an occupant such as a driver, and based on these, superimposes predetermined virtual image information on an actual landscape visually recognized by the occupant. It has a function. In order to display such a virtual image, the vehicle information providing device 1 includes an eye camera 50, a virtual image display device 52, and a CCD camera 54.

  The eye camera 50 is attached to an upper position in the cabin (a part of the rearview mirror), and by photographing the occupant's pupil, the position of the occupant's pupil, the direction of the line of sight, the distance to the visual object, etc. It is configured so that it can be detected. Here, the eye camera includes, for example, the EOG method, the photoelectric element type EOG (P-EOG) method, the corneal reflection method, the first and fourth Purkinje image detection methods, the contact lens method, the search coil method, and the infrared fundus camera method. Various techniques such as these are applied. The eye camera 50 is preferably capable of detecting the line of sight of each occupant in the vehicle. Further, instead of the eye camera 50, another means for detecting the line of sight of each occupant in the vehicle may be used.

  In this embodiment, the CPU 30 searches the map data based on the position of the occupant's pupil detected by the eye camera 50 and the current position and orientation of the vehicle, and the occupant can visually recognize a predetermined object. When it is possible to visually recognize the object, the virtual image information regarding the object is superimposed on the actual scenery visually recognized by the occupant and is virtually displayed. The virtual image display device 52 is a device that performs such virtual display, and a virtual image that allows only an occupant to visually recognize information about the object such as an arrow pointing to the object and the name of the object by a method such as a hologram. As a device for superimposing and displaying on an actual landscape visually recognized by a passenger.

  The CCD camera 54 is attached to the upper part of the vehicle with the front of the vehicle facing forward. From the captured image, the presence / absence of other vehicles traveling ahead, the traffic volume (the presence / absence of traffic jams and the degree of traffic jam), the presence / absence of pedestrians And the amount, brightness outside the vehicle, weather and the like can be detected. The detection result by the CCD camera 54 is sent to the CPU 30, and the CPU 30 changes or prohibits the display state of the virtual image based on this result.

  The vehicular information providing apparatus 1 further includes a voice interaction device 56. The voice interaction device 56 includes a speaker and a microphone, and has a function of providing voice information to the occupant and receiving an instruction by voice from the occupant.

FIG. 3 is a view showing the periphery of the driver's seat of the vehicle on which the vehicle information providing apparatus 1 of the present embodiment is mounted.
A speaker 58 is attached to the A-pillar in the vicinity of the driver's seat, and the speaker 58 provides voice guidance, notification, etc. to the passenger. A microphone 60 is disposed adjacent to the speaker 58, and is configured so that a voice instruction from an occupant (especially a driver) can be sent to the CPU 30.
An occupant detection sensor is incorporated in the driver seat 62, the passenger seat 64, and other seats (not shown) so that the presence or absence of an occupant can be detected for each seat.

  The main body unit 66 of the vehicle information providing apparatus 1 in which the CPU 30 of the vehicle information providing apparatus 1 is incorporated is attached to the dashboard. A monitor screen 36 of the vehicle information providing apparatus 1 is disposed in the vicinity of the main body unit 66. In this embodiment, the eye camera 50 is incorporated in the rearview mirror 68 so that the position and line of sight of each passenger can be detected. Furthermore, in the present embodiment, a transmission / reception device 32 that exchanges information with the information center 2 via the Internet 4 is attached between the driver seat and the passenger seat.

  In the present embodiment, a virtual image display device 52 using a dashboard hologram is incorporated. In FIG. 3, a virtual image (illustration or photograph) 68 of a gas station that is a set target object, an arrow pointing to the virtual image, and information about the target object (“the target gas station”) are displayed as a virtual image. The display device 52 shows a state in which a hologram is displayed at an apparent position of an object in an actual landscape that is being visually recognized by the occupant so that the occupant can visually recognize it.

Next, the operation of the vehicle information providing system including the vehicle information providing apparatus 1 will be described. FIG. 4 is a flowchart showing the operation of the vehicle information providing system as a whole centered on the processing performed by the vehicle information providing apparatus 1.
A user who is an occupant (for example, a driver) who wishes to receive information provided by a virtual image accesses the information center 2 from a personal computer 6 or the like in his / her home in advance, thereby providing information on the virtual real system, etc. Initial (initial) setting (step S1) is specified. This virtual real system is an aspect of so-called “telematics” that provides information to a vehicle-mounted terminal by wireless communication, and is a pay system in which a user pays a fee according to the amount of information received as an information fee. . It is assumed that the user has already registered necessary personal information such as address and name.

In the initial setting, first, an initial setting I screen for verification / registration related to visual acuity as shown in FIG. 5 is displayed on the screen of the user's personal computer 6. By selecting the item “Verification of visual acuity and verification of visual recognition level”, a screen for inspecting visual acuity / moving body visual acuity, etc. is displayed, and the visual acuity of the user is inspected by this inspection screen, and the inspection result is the visual acuity of the user Is recorded in the customer data 18 of the information center.
Next, when the item of “eye position registration” is selected, the position of the user's eyes in the state of being seated on the vehicle seat is registered based on the image obtained from the in-vehicle eye camera 50 when getting on. For the driver, the eye position may be estimated from the position of the seat and the angle of the room mirror.

Next, an initial setting II screen as shown in FIG. 6 is displayed on the screen of the user's personal computer 6. On the setting screen of this initial setting II, whether or not to display a virtual image and what display method to use are set. Details will be described below.
First, “ON” or “OFF” is selected in the “virtual object display” section to set whether or not to display a virtual image. In the case of “OFF”, this system is not operated. When “ON” is selected, any virtual image can be selected by selecting “ON” or “OFF” in each of the “NAVI display”, “message display”, and “advertising display” items. Decide whether to receive the offer.

When “NAVI display” is set to “ON”, an arrow pointing at a specific object, an image of the object, etc. are superimposed as a virtual image on the actual scenery viewed through the vehicle window while the vehicle is running. The “NAVI display” is executed under a predetermined condition. In this embodiment, an arrow indicating the target and the name of the target are displayed as a default. Therefore, for example, when Mt. Fuji at the destination, which is the set object, can be seen through the windshield while traveling, an arrow pointing to the actual Mt. Fuji and “Mt. The information (name) on the object “is” is displayed superimposed on the scenery that the occupant is viewing.
In addition, by performing a predetermined setting, as shown in FIG. 8, the set objects “gas station”, “restaurant”, and “park” reach a position where they can be seen through the windshield. Then, images of these objects (illustrations, photos, etc.) are displayed at the apparent positions of “gas stations”, “restaurants”, and “parks” in the actual landscape so as to overlap the actual landscape. The arrows indicating the images and the information “Gas station”, “Destination restaurant. The remaining 13 km”, and “◯ △ park” relating to each object are virtually displayed over the actual scenery. The setting of the display form such as whether or not to display the image of the object is performed by the following items.

  When “message display” is set to “ON”, a message (message, graffiti) set by a passenger or a friend is superimposed on a real scene visually recognized as a virtual image under a predetermined condition while the vehicle is running. Virtually displayed “message display” is executed.

  Also, when “Advertisement Display” is set to “ON”, it means that it has been accepted to receive advertisements from companies and stores that have contracted to provide advertisements to this system while the vehicle is running. The “advertisement display” in which the displayed advertisement message is superimposed on the actual landscape visually recognized as a virtual image is displayed under predetermined conditions.

In the example of FIG. 6, “NAVI display”, “message display”, and “advertisement display” are all “ON”.
In the present embodiment, “NAVI display”, “message display”, and “advertisement display” can be selected for each region. For example, in general, “NAVI display” is not necessary in the local area because it is bright in geography. Therefore, “NAVI display” can be set to “OFF” only in a specific area. In addition, when driving to a destination to go for the first time, “NAVI display” can be set to “ON” only in the peripheral area of the destination. The same applies to “message display” and “advertisement display”.

  Next, in “virtual object display object priority setting”, which of the two types of virtual object display objects (virtual images) cannot be executed simultaneously is set. For example, if the display of the virtual image is set to include voice guidance, the voice guidance of “It is Mt. Fuji of the destination” in “NAVI display” and the voice of “Birth of RX-8” in “Advertisement display” Since the guidance may overlap in time, this setting is for dealing with such overlap. In the example shown, Message, 2. NAVI, 3. Priorities are given in the order of advertisements. Therefore, when the message and the NAVI overlap, the “message display” is executed first, and then the “NAVI display” is executed.

  Next, the display state of the virtual object (virtual image) is set in the section “Virtual Object Display Settings”. First, the size of the virtual image (for example, the virtual image of the gas station in FIG. 8) of the object to be virtually displayed and the size of the characters are set in the “magnification” section. The size is selected from “same size”, “2 times”, “3 times” or “automatic”. “Same size” means the same size (same size) as the apparent size of the object from the vehicle, or the default character size. “2 times” and “3 times” It means 2 times or 3 times the same magnification. In addition, “automatic” is a setting in which enlarged display (for example, double display) is performed when the distance to the object is greater than a predetermined value, and switching to the normal display is performed when the distance is less than the predetermined value. In the example of FIG. 6, “same size” is selected.

  Next, the number of virtual images to be displayed at the same time is set in the item “number of simultaneous displays”. This is a setting for preventing an increase in the number of displayed virtual images. In this embodiment, it is configured to select one of “standard”, “minimum”, “less”, “more”, and “most”, and “standard” is set in the example of FIG. This item can also be set for each region.

  Next, in the “superimposed display” section, handling when virtual images overlap is set. In this embodiment, either “prohibited” or “allowed” is selected, and when “prohibited” is selected, either “shifted display” or “prohibited” is selected. When “Allow” is selected, a plurality of virtual images may be displayed overlapping each other. When “shift display” is selected, virtual images that overlap when displayed at a predetermined position are displayed so as not to overlap. If “prohibited” is selected, if the virtual images overlap, all of the overlapping virtual images or other than one are prohibited.

  Finally, in the “target display area” section, it is set in which area the virtual object (virtual image) is displayed. In this embodiment, any one of “standard”, “narrow”, “wide”, and “maximum” is selected. For example, “wide” covers the area through the entire windshield, “standard” covers the area through only the right half of the windshield (the front part of the driver's seat), and “narrow” means the right half of the windshield. It is a setting that targets only a part of (the front part of the driver's seat) through the area, and the maximum is an area through the side glass in addition to the windshield. In the example of FIG. 6, “standard” is selected.

Next, the display duration of the virtual object (virtual image) is set in the section “Virtual Object Display Time”. In this embodiment, two types of “continuous time” and “total time” are specified. “Continuous time” is the duration of one display, and is selected from “While visible” if it is visible, and “15 seconds” when the display is terminated after 15 seconds from display disclosure. . In the example of FIG. 6, “15 seconds” is selected.
In addition, the “total time” indicates that the object (Mt. Fuji) that has become visible becomes invisible for reasons such as a curved road, and is displayed multiple times as when it becomes visible again. The total time is regulated, and “3 minutes” is selected in the example of FIG. Therefore, in the example of FIG. 7, the arrow and the virtual image of “Destination Mt. Fuji” are displayed for a total of only 3 minutes at the longest during traveling.

Finally, in “Other Settings”, the following settings are made: “Simultaneous use of voice guidance”, “Combination of object display”, “Perform display correction for each occupant”, and “Perform enlargement / reduction / deletion function”.
When “Voice Guidance” is set to ON, in the example shown in FIG. 7, a voice image “Destination Mt. Fuji” is simultaneously displayed when a virtual image “Destination Mt. Fuji” is displayed. .
In addition, the present embodiment basically has a configuration in which the apparent position of an object is indicated by an arrow and a name of a virtual image, but when “object display combined use” is set to ON, as shown in FIG. The virtual image of “gas station” by is virtually displayed as an object display at the position of the gas station in the actual landscape, and an arrow and name indicating this virtual image (object) are displayed.

  When a plurality of occupants are on the vehicle, the appearance of the scenery outside the vehicle is different for each occupant due to the difference in the boarding position. As a result, the gas station virtual image displayed in FIG. 8 does not appear to overlap with the actual position of the gas station for all passengers. “Perform display correction for each occupant” is for correcting such a shift. When “Perform display correction for each occupant” is ON, the position of the occupant is detected based on the detection result of the seat sensor, the display position of the virtual image is corrected for each occupant, and each occupant is displayed at an appropriate position. To make the virtual image visible. Note that the corrected virtual image is preferably displayed in a virtual manner in such a way that only the occupant who is the correction target can visually recognize it.

  Finally, the setting of “Perform the enlargement / reduction / deletion function” is performed. When this item is set to ON, the display mode of the virtual image being displayed can be changed by an instruction by voice from the occupant. When “Perform enlargement / reduction / deletion function” is turned ON, when a virtual image as shown in FIG. The virtual image becomes larger. In addition, it is possible to reduce or delete by voice instructions.

  When the setting of the basic items on the screen of FIG. 6 is completed, a setting screen related to NAVI of the initial setting II as shown in the figure is displayed on the screen of the user's personal computer 6. In this setting screen, what kind of display is to be performed in “NAVI display” is set. Details will be described below.

First, in the “display item of virtual object” item, what kind of display is to be performed is selected. In this embodiment, items of “Destination”, “Facilities”, “Leading vehicle”, “Guidance arrow”, and “Mark” are prepared.
When “Destination” is set to ON, the destination set in the route guidance becomes a display target of the virtual image. In other words, when Mt. Fuji is visible during route guidance for “Mt. Fuji” as a destination, a virtual image as shown in FIG. 7 is virtually displayed.
When “facility” is set to ON, facilities such as gas stations, convenience stores, restaurants, hotels, hot springs, public buildings, and other buildings are set as objects on which virtual images are virtually displayed. What kind of facility is displayed is set by other items. Further, when “detailed information” that can be selected when “facility” is ON, detailed information of each facility is displayed in addition to the arrow of the virtual image. For example, if the facility is a hot spring hotel, information about the quality of the hot spring is displayed.

When “leading vehicle” is turned ON, the leading vehicle based on the virtual image is virtually displayed, and route guidance is performed by this leading vehicle. That is, at the intersection to be turned right, the leading vehicle turns to the right, and by following the leading vehicle, the vehicle can arrive at the destination along a predetermined path. Instead of the leading vehicle, a configuration in which an animal or another object leads may be used.
When the “guidance arrow” is set to ON, route guidance is performed with an arrow based on a virtual image. That is, the route guidance similar to the arrow displayed on the monitor screen of a known navigation device is performed by the arrow of the virtual image superimposed on the actual landscape.
When the “mark” is set to ON, a building or the like that serves as a mark on the route is instructed by an arrow on the virtual image during route guidance.

Next, in the “display facility setting” section, it is determined what kind of genre information about the facility is to be notified in the virtual image. In this embodiment, as shown in FIG. 9, “registration facility”, “convenience store”, “road station”, “gas station”, “entertainment relationship”, “food-related relationship”, “event relationship”, The facility genre for which position information is to be obtained is selected from items such as “famous places”.
“Registered facility” is a section for setting a facility set separately by the user manually as a notification target. Using this term, for example, a restaurant on the route to the destination can be registered. In the “convenience store” and “gas station”, it is possible to set a convenience store of a specific chain (for example, 7-Eleven) and a gas station of a specific oil company (Eneos) by detailed setting. Further, in “food and drink relations”, it is possible to specify the type of food to be provided, such as French cuisine, Japanese food, sushi, udon, etc., in detailed settings. Further, in the “event relation” and “famous place”, a detailed genre can be specified similarly.

  Next, in the “target display area” section, the range that is the target of “NAVI display” is specified. As shown in FIG. 9, the present embodiment is configured to set from “standard”, “narrow”, “wide”, and “maximum”. In “standard”, for example, a facility existing within a range of 1 km in front and 500 meters to the side is set as a target of “NAVI display”. By limiting the target display area in this way, it is possible to prevent an extremely large number of virtual images from being displayed in an urban area and obstructing the field of view.

Next, the display duration of the virtual object (virtual image) is set in the section “Virtual Object Display Time”. In this embodiment, two types of “continuous time” and “total time” are specified. “Continuous time” is the duration of one display, and is selected from “While visible” if it is visible, and “15 seconds” when the display is terminated after 15 seconds from display disclosure. . In the example of FIG. 6, “15 seconds” is selected.
In addition, the “total time” is the number of times that a visible item (gas station) once became unrecognizable due to a curved road, etc. The total display time is restricted. In the example of FIG. 9, “3 minutes” is selected.

  Next, in the “Destination Setting Function” section, settings relating to a function that can set the destination while traveling are performed. This “Destination Setting Function” is used when a driver or other occupant identifies an object displayed by a virtual image while traveling, the object is set as the destination, and a route to the destination is set. This is a function to induce. In the present embodiment, “speech” and “pointing” are set as the identification method by the occupant. When “Voice” is turned ON, the destination can be input by voice. That is, in the state where the virtual image as shown in FIG. 8 is displayed, when a passenger such as a driver gives a voice and instructs “the destination is ○ △ park”, the voice dialogue device 56 recognizes this instruction, and ○ △ Park is set as the destination. When “pointing” is turned ON, the destination can be input by pointing. That is, in a state where a virtual image as shown in FIG. 8 is displayed, when an occupant, such as a driver, points “X Park” with his / her finger and inputs this as “Destination”, the operation is performed by the eye camera 50. Is set as a destination.

Finally, registration for group travel is performed. This registration is a registration performed to establish communication by sharing the same information among a plurality of vehicles traveling in a group when traveling in a group. One member of the group, usually a leader, , Register.
First, by inputting the ID (for example, 0001, 0002, 00341, 0055) of the vehicle information providing apparatus 1 mounted on another vehicle that performs group traveling, a member that performs group traveling is specified. Next, the leader in the group is specified. Next, “facility to be displayed by group members” to be displayed in common in the registered group is set. This setting method is the same as the “display facility setting” described above. Information about the facility set here is uniformly provided to all registered groups.

Furthermore, the “notification function” is set. This ventilation function is a function for notifying each vehicle when common information is obtained for all the vehicles traveling in the group. For example, if you can see Mt.Fuji from all the vehicles while driving with a group of five, change the color of the text “Destination Mt. Fuji” in FIG. 7 from white to blue on all vehicles. This function allows all vehicles to recognize that Mt. Fuji can be seen from all vehicles.
In this embodiment, when “notify when information can be shared” or “not notify” is selected and “notify when information can be shared” is selected, a display color is displayed as a notification method. One of “color” that changes and “voice” in which voice guidance such as “Mt. Fuji can be seen from all vehicles” is performed is selected.

  The settings in FIG. 9 are configured so that different settings can be made for “by region”, “by time zone”, “by day of the week”, and “by passenger”.

  Various data registered as described above are stored in the data 18, 20, 22, etc. of the database 12 of the information center 2 (step S2).

Next, when the user who has made the above settings transmits the destination and necessary route information from the vehicle information providing apparatus 1 (or the home personal computer 6) to the information center 2 (step S3), the information center 2 Then, the map information to the set destination is read from the map data 14, and distribution map data relating to the route to the destination is created. Further, the map data is processed to incorporate data for performing NAVI display, message display, and advertisement display based on the virtual image based on the setting in step S1, and the processed data is stored in the vehicle information providing apparatus 1 of the user. Transmit (step S4). It is preferable that an advertisement related to the area displayed on the map displayed on the route to the destination is incorporated in the map data.
The vehicle information providing device 1 of the user's vehicle receives the processed map data that has been transmitted, and starts route guidance to the destination based on the received map data (step S5).

Next, the vehicle information providing apparatus 1 determines whether or not a condition for displaying a virtual image is satisfied (step S6). Regarding NAVI display, it is determined whether or not there is an object to be provided with information by a virtual image. Further, for message display and advertisement display, it is determined whether or not the display condition set in the initial setting is satisfied.
This determination is made based on the vehicle position based on the detection result of the GPS receiver 44, the object to be displayed in the received processed map data, information on the position, and the like. When YES is determined in the step S6, the process proceeds to a step S7 so as to determine whether or not the vehicle occupant can visually recognize the area serving as the background of the object or the message. “Visible” means that the object is too small to be identified with the naked eye because the object is far away from the vehicle, in addition to the case where the object can be directly identified with the naked eye in a real landscape. Although it is not possible, a state where the place (position) where the object exists can be looked over is included.
This determination is based on the position and direction of the own vehicle, three-dimensional data such as buildings around the current position of the vehicle included in the map information, topography, position information of the object, detection result of the presence or absence of the preceding vehicle by the CCD camera 54, and the like. Done. If NO in step S6 or step S7, the process returns to step S6.

When YES is determined in the step S7, the display position and display method of the virtual image to be displayed are calculated (step S8). The display position of the virtual image is set so that the target occupant can recognize that the virtual image is present at a predetermined position in the scenery being viewed. That is, in the example of FIG. 7, the position where the occupant can recognize Mt. Fuji in the actual landscape as being pointed by the arrow is the virtual image arrow and the display position of the information “Mt. Fuji at the destination”. Is set. Similarly, in the case of the example in FIG. 8, the display position is set.
Specifically, the eye position of an occupant (for example, a driver) is estimated from an image of an eye camera, etc., and the occupant visually recognizes the position of the eye, the current position and direction of the vehicle, map data, and the like. The placement position of the virtual image is calculated so that the virtual image is placed at a predetermined position in the actual landscape.
At this time, when there are a plurality of occupants, it is preferable that the positions of the eyes of each occupant are detected and the display position of the virtual image is set for each occupant.

Also, the virtual image display method is based on the initial setting and display with “arrows” and names as shown in FIG. 7, and the virtual image of the object (gas station) and its facility name (gas station) as shown in FIG. ) And the like are appropriately set. In addition, the color and brightness of the displayed virtual image (for example, an arrow) are appropriately set according to the color, brightness, and the like of the actual scenery serving as the background. The color and brightness of the actual scenery as the background are detected from the image of the CCD camera 54 and the like.
Further, the size of the virtual image is also set. The size setting is performed based on the setting in the “magnification ratio” section described with reference to FIG.

  In addition, since there are many cases where the object cannot be visually identified at night or when visibility is poor due to bad weather, the object display may be automatically added under such conditions.

  Next, the process proceeds to step S9, and it is determined whether or not the virtual image display prohibition condition is satisfied. The prohibition condition is a condition that prevents safe operation of the vehicle by displaying a virtual image. Specifically, when the vehicle is turning, when there is a lot of traffic around the vehicle, or when the displayed virtual image overlaps a traffic sign such as a signal or a road sign. Further, when the object for which image information is provided by virtual display is at a very close distance, the display prohibition condition also applies when the number of virtual images to be displayed exceeds a predetermined number.

When YES is determined in the step S9, a display prohibiting process is performed in a step S10, and the process returns to the step S6. If NO in step S9, the process proceeds to step S11 to display a virtual image. When NO in step S9, instead of the display prohibition process in step S10, a process of shifting the display position of the virtual image to a position that does not overlap with the traffic sign or a process of reducing the number of virtual images to be displayed After performing, the structure which progresses to step S11 may be sufficient.
In step S11, for example, virtual display as shown in FIGS. 7 and 8 is executed based on the setting in step S1. When the virtual image is a message display from another person such as a friend, the virtual image may be provided with a function of notifying the sender's friend or the like via the information center 2 that the message display has been executed.

  Next, the process proceeds to step S12, and it is determined whether one of the displayed virtual images is designated by the occupant. As a designation method, there are a method in which an occupant who has seen a virtual image performs “O Δ Park” by voice and a occupant who has seen the virtual image points to the virtual image and designates “this park”. Such sound is collected by the microphone 60, and the pointing operation is photographed by the CCD camera 54 and sent to the CPU 30 to detect the designated object.

Next, the process proceeds to step S13, and processing for changing the display mode of the designated virtual image is performed. Specifically, processing such as changing the color and size, or changing a virtual image that was visible only to a specific occupant, for example, a driver, to a state that other occupants can also visually recognize is performed. This display mode change is preferably performed by correcting the difference in the boarding position of each occupant.
In addition to the change of the display mode, the detailed information of the object displayed by the virtual image, for example, the origin of the object in the case of a park may be displayed by the virtual image.
Prior to the change of the display mode, the configuration may be such that the occupant who has made the designation confirms whether or not the object whose display mode is to be changed is the target designated by the occupant. This confirmation can be made by changing the color of the virtual image of an object (for example, ΔΔ park) whose display mode is to be changed among the virtual images displayed for the designated occupant, It is preferable to be performed by voice such as “?”.

  Next, the process proceeds to step S14, and it is determined whether or not the display end condition is satisfied. The end condition is that the occupant is no longer able to see the target object that is being displayed in virtual, the display time is more than the specified number of times, the display time or total display time exceeds the specified value, and the operation is out of the display area. The panel is turned off manually. This end condition is determined for each virtual image. If YES in step S14, the process proceeds to step S15, and the display of the corresponding virtual image is terminated.

  Furthermore, it progresses to step S16, it is determined whether it arrived at the destination, a process is complete | finished when it arrives at the destination, and when it has not arrived, it returns to step S6.

  As described above, the vehicle information providing apparatus according to the present embodiment displays an arrow of a virtual image based on the current position / orientation of the vehicle, the position / line of sight of the occupant's eyes (pupil), map data, and the like. Is displayed in such a way that the object is inserted in the scenery that is visually recognized. Therefore, if the current position and direction of the vehicle are not accurately input to the vehicle information providing apparatus 1, the position indicated by the arrow in the virtual image becomes inaccurate. The same applies when the position of the passenger's eyes changes. In such a state, when the display change of the target specified based on the virtual image is performed (step S13), the display change based on the incorrect specification may be performed. That is, there is a possibility that the display of the object that the occupant does not want is changed.

  For this reason, in this embodiment, prior to the designation of the object whose display change is changed in step S13, the accuracy (identification accuracy of the object) that the virtual image (arrow) points to the object is detected, and the detected identification is detected. In addition to notifying the occupant of the accuracy, a process for not specifying the object is performed when the specific accuracy is poor. Hereinafter, this process will be described with reference to the flowchart of FIG.

First, in step S20, the specific accuracy of the object is detected. In the vehicle information providing apparatus 1 according to the present embodiment, various factors can be cited as factors that cause the arrows in the virtual image not to accurately place the object.
This factor can be broadly divided into a factor on the vehicle side and a factor on the object side. The factors on the vehicle side are: when the vehicle vibrates up and down due to bad road driving, when the direction of the vehicle (behavior) changes due to steering operation, when the occupant changes posture and the position of the eyes changes, GPS (GDOP ), The current position specifying accuracy of the vehicle deteriorates. Further, factors of the object side, the apparent object small, when the arrow is deviated, plurality of objects to be displayed, either pointing to any arrow which object since adjacent unclear There are times when it becomes.

In this embodiment, the vibration of the vehicle, the behavior of the vehicle, the posture change of the occupant of the vehicle, the accuracy of specifying the current position of the vehicle, the apparent interval between a plurality of objects to be displayed, and the apparent size of the object to be displayed. The distance to the object to be displayed is assumed as a factor, and each of these factors is given a predetermined weight to calculate the final specific accuracy for each object.
In addition, the structure which does not use all of these, or the structure using another factor may be sufficient.

  In this embodiment, when the vibration of the vehicle is large, when the behavior of the vehicle changes greatly, when the posture change of the vehicle occupant is large, when the current position specifying accuracy of the vehicle is poor, the appearance of a plurality of objects to be displayed When the upper interval is small, when the apparent size of the target object to be displayed is small, and when the distance to the target object to be displayed is not close, the specific accuracy becomes worse. Calculated. Specifically, predetermined weights are given to numerical values of various sensors mounted on the vehicle, and the final specific accuracy for each object is calculated.

  Next, it progresses to step S21 and it is determined whether the vehicle is stopping. When NO, that is, when the vehicle is not stopped, it is determined that accurate designation cannot be performed, and the process is terminated. When YES is determined in the step S21, the process proceeds to a step S22 to display information relating to the specific accuracy as a virtual image. This display is displayed by being superimposed on the scenery that the occupant is viewing in the same manner as other virtual images (an arrow pointing to the object and a name such as “XX City Gymnasium”).

  FIG. 11 is an example of a landscape on which information 70 regarding specific accuracy is superimposed. As shown in FIG. 11, in this embodiment, the information 70 regarding the specific accuracy is displayed at the bottom of the windshield. In the example of FIG. 11, the information 70 regarding the specific accuracy includes an indicator unit 72 that indicates the specific accuracy, a cause display unit 72 that indicates the cause of the specific accuracy deterioration, and a countermeasure display unit 76 that displays a countermeasure to deal with this cause. And.

  In this example, the indicator unit 72 includes three ◯ that can be turned on, and the specific accuracy is indicated by the number of turned on. The cause display unit 72 includes the main causes of the current deterioration of the specific accuracy. In this example, “GDOP deteriorates” and “driver posture change” are listed. The cause of the deterioration of the specific accuracy is detected in the specific accuracy calculation step, which factor is large, and is displayed based on the detection result. Among the causes of the deterioration, since the latter can be dealt with by the occupant, a message “Please stand still” is displayed on the countermeasure display section 76.

  Next, the process proceeds to step S23, and the specific accuracy calculated in step S20 is compared with a threshold value to determine whether the specific accuracy is “good” or “bad”. When “good”, the process proceeds to step S24, and designation of the object whose position information is displayed on the virtual image is permitted. When “bad”, the process proceeds to step S25, and designation of the object whose position information is displayed on the virtual image is prohibited. To do.

The present invention is not limited to the above-described embodiments, and various changes or modifications can be made within the scope of the technical matters described in the claims.
In the above embodiment, when the occupant designates the object based on the virtual, the information on the specific accuracy is displayed. However, such information may be displayed at all times or only when the vehicle is stopped. .
Moreover, the content of information regarding the specific accuracy and the display form are not limited to the example of FIG.

  The vehicle information providing apparatus described above is based on the current position / orientation of the vehicle, the position / line of sight of the occupant's eyes (pupil), map data, and the like. The object is displayed in the middle. Therefore, when the occupant changes his / her posture, the display position of the virtual image is changed following this. However, when the accuracy of identifying the object is poor, the arrows in the virtual image do not point to the appropriate position, so the occupant may unconsciously move his or her posture, that is, the line of sight, to find out what the arrows in the virtual image are pointing to .

  When the arrow of the virtual image quickly follows the movement of the line of sight, the occupant feels that the arrow of the virtual image is chasing when moving the line of sight, which is extremely unpleasant. Therefore, when the specific accuracy is worse than the predetermined value, the above embodiment may adopt a configuration in which the change speed of the display position of the virtual image caused by the movement of the sight line of the occupant is slowed down.

It is drawing which shows roughly the structure of the information provision system for vehicles (virtual real system) containing the information provision apparatus for vehicles of the embodiment of this invention. It is drawing which shows typically the data contained in the database of an information center. It is drawing which shows the circumference | surroundings of the driver's seat of the vehicle by which the vehicle information provision apparatus of this embodiment is mounted. It is a flowchart which shows the operation | movement of the vehicle information provision system whole centering on the process performed with the vehicle information provision apparatus. It is drawing which shows the setting screen of the initial setting I performed with a virtual real system. It is drawing which shows the setting screen of initial setting II performed with a virtual real system. It is drawing which shows an example of the scenery where the virtual image by the NAVI display performed by the information provision apparatus for vehicles was superimposed. It is drawing which shows the other example of the landscape on which the virtual image by the NAVI display performed by the information provision apparatus for vehicles was superimposed. It is drawing which shows the setting screen of initial setting III performed with a virtual real system. It is a flowchart of a part of process in calculation, such as a display position of a virtual image. It is drawing which shows an example of the scenery where the information (virtual image) regarding specific accuracy was superimposed.

Explanation of symbols

1: Vehicle information providing device 2: Information center 4: Internet 10: Host computer 12: Database 30: CPU
32: Transmission / reception device 50: Eye camera 52: Virtual image display device

Claims (5)

A vehicle information providing device that visually provides position information of a preset object to a vehicle occupant,
Visual determination means for determining whether or not the occupant can visually recognize the set object while the vehicle is traveling;
When it is determined that the set object can be visually recognized, the occupant is displayed by superimposing and displaying the image information indicating the visually observable object on the actual scenery that the occupant is visually recognizing. Position information display means for visually informing the apparent position of the object in the landscape;
The apparent distance of a plurality of the visible object, the apparent size of the visible object, and, based on at least one of a distance to the visible object, the image Accuracy detection means for calculating a specific accuracy representing the accuracy with which the information points to the object;
Accuracy notification means for notifying the occupant of the cause of deterioration of the specific accuracy as information on the specific accuracy,
An information providing apparatus for a vehicle characterized by the above. A vehicle information providing device that visually provides position information of a preset object to a vehicle occupant,
Visual determination means for determining whether or not the occupant can visually recognize the set object while the vehicle is traveling;
When it is determined that the set object can be visually recognized, the occupant is displayed by superimposing and displaying the image information indicating the visually observable object on the actual scenery that the occupant is visually recognizing. Position information display means for visually informing the apparent position of the object in the landscape;
Current position identification accuracy of the vehicle, the apparent distance of a plurality of the visible object, the apparent size of the visible object, and at least one of the distance to the visible object Accuracy detection means for calculating a specific accuracy representing the accuracy with which the image information points to the object, based on
Accuracy notification means for notifying the occupant how to deal with the cause of deterioration of the specific accuracy as information on the specific accuracy,
An information providing apparatus for a vehicle characterized by the above. A vehicle information providing device that visually provides position information of a preset object to a vehicle occupant,
Visual determination means for determining whether or not the occupant can visually recognize the set object while the vehicle is traveling;
When it is determined that the set object can be visually recognized, the occupant is displayed by superimposing and displaying the image information indicating the visually observable object on the actual scenery that the occupant is visually recognizing. Position information display means for visually informing the apparent position of the object in the landscape;
Current position identification accuracy of the vehicle, the apparent distance of a plurality of the visible object, the apparent size of the visible object, and at least one of the distance to the visible object Accuracy detection means for calculating a specific accuracy representing the accuracy with which the image information points to the object, based on
Accuracy notification means for notifying the occupant of information relating to the specific accuracy;
When the image information is provided and one of the occupants designates an object, the accuracy notification means performs the notification.
An information providing apparatus for a vehicle characterized by the above. A specific prohibition means for prohibiting designation of an object when the calculated specific accuracy is compared with a threshold value and it is determined that the specific accuracy is poor;
The vehicle information providing apparatus according to claim 3. A vehicle information providing device that visually provides position information of a preset object to a vehicle occupant,
Visual determination means for determining whether or not the occupant can visually recognize the set object while the vehicle is traveling;
When it is determined that the set object can be visually recognized, the occupant is displayed by superimposing and displaying the image information indicating the visually observable object on the actual scenery that the occupant is visually recognizing. Position information display means for visually informing the apparent position of the object in the landscape;
Current position identification accuracy of the vehicle, the apparent distance of a plurality of the visible object, the apparent size of the visible object, and at least one of the distance to the visible object Accuracy detection means for calculating a specific accuracy representing the accuracy with which the image information points to the object, based on
Accuracy notification means for notifying the occupant of information relating to the specific accuracy;
With
When the calculated specific accuracy is compared with a threshold value and it is determined that the specific accuracy is poor, the position information display means delays the change of the display position of the image information in response to the sight line change of the occupant.
An information providing apparatus for a vehicle characterized by the above.

Images