JP3920580B2 - Information presentation system and information presentation method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an information presentation system and an information presentation method for presenting information to be presented in association with a specific position to an occupant of a mobile object.
[0002]
[Prior art]
A navigation system mounted on an automobile is widely used as a system for displaying the current position of the automobile on a display together with a map and navigating the automobile to a destination. In addition, recent navigation systems have become more sophisticated, and various types of information that should be presented in association with a specific location, such as the name of a building existing at a specific location and information on tenants occupying the building, are displayed together with a map. Show on the display. That is, recent navigation systems function as a kind of information presentation system.
[0003]
[Problems to be solved by the invention]
However, the information presentation system according to the conventional technique has the following problems. That is, in the information presentation system according to the conventional technique, various information to be presented in association with a specific position (for example, the name of a building existing at a specific position or information on a tenant occupying the building) is mapped. And display it on the display. However, even if information is displayed in association with a specific position on the map displayed on the display, it may be difficult for the driver of the car to associate such information with the specific position in the real world spreading from the car window. Many.
[0004]
Accordingly, the present invention provides an information presentation system and an information presentation method capable of solving the above problems and presenting information to be presented in association with a specific position to an occupant of a mobile object in an easy-to-understand manner. Let it be an issue.
[0005]
[Means for Solving the Problems]
  In order to solve the above problems, an information presentation system of the present invention is an information presentation system for presenting information to be presented in association with a specific position to an occupant of a mobile object, the position and orientation of the mobile object Information acquisition means for acquiring information on the information, and a line of sight that the passenger of the mobile object sees the specific position and a window of the mobile object based on information on the position and orientation of the mobile object acquired by the information acquisition means A position calculating means for calculating the intersection position with the position on the window determined based on the intersection position calculated by the position calculating meansWhen a symbol indicating that there is information to be presented in association with the specific position is displayed, and the symbol is designated by a passenger of the mobile objectAnd an information display means for displaying information to be presented in association with the specific position.
[0006]
  The intersection position between the line of sight of the specific position of the mobile object and the window of the mobile object is calculated, and information to be presented in association with the specific position is displayed at a position on the window determined based on the cross position. By displaying, the information to be presented in association with the specific position can be presented to the occupant of the moving body while being superimposed on the scenery of the real world spreading from the vehicle window.In particular, the amount of information to be presented is increased by first displaying a symbol indicating that information exists on the window and then displaying the information in accordance with the designation of the symbol by the occupant of the moving object. Even if the information is displayed as it is, it occupies a relatively large area on the window, and the information can be presented effectively.
[0007]
The information presentation system according to the present invention further includes storage means for storing information relating to the specific position and information to be presented in association with the specific position, wherein the position calculation means includes the information acquisition means. Based on the information on the position and orientation of the moving body acquired by the above and the information on the specific position stored in the storage means, the line of sight of the specific position of the occupant of the moving body and the moving body The information display means calculates the specific position stored in the storage means at a position on the window determined based on the intersection position calculated by the position calculation means. It is preferable that information to be presented in association with the position is displayed.
[0008]
The information to be presented in association with the specific position is stored in the storage means, and the information stored in the storage means is read and presented so that the information to be presented in association with the specific position can be simplified and It can be presented quickly.
[0009]
The information presentation system according to the present invention further includes receiving means for receiving information relating to the specific position and information to be presented in association with the specific position, wherein the position calculating means includes the information acquiring means. Based on the information on the position and orientation of the moving body acquired by the above and the information on the specific position received by the receiving means, the line of sight of the specific position of the occupant of the moving body and the moving body The information display means calculates the specific position received by the reception means at a position on the window determined based on the intersection position calculated by the position calculation means. It is preferable that information to be presented in association with is displayed.
[0010]
By receiving the information to be presented in association with the specific position and presenting the received information, the information to be presented in association with the specific position can be sequentially updated.
[0011]
In the information presentation system of the present invention, the information display means displays information to be presented in association with the specific position at a position overlapping the intersection position calculated by the position calculation means. Is preferable.
[0012]
By displaying information to be presented in association with the specific position at a position where the occupant of the mobile body overlaps the position where the line of sight of the specific position and the window of the mobile body overlap, The relationship between the specific position and the information can be recognized very easily.
[0013]
In the information presentation system of the present invention, the information display means displays information to be presented in association with the specific position according to the distance between the mobile object and the specific position. It is preferable that the display is changed.
[0014]
By displaying the information to be presented in association with the specific position according to the distance between the mobile body and the specific position, by changing the display mode, the mobile body and the A sense of distance between a specific position can be easily recognized.
[0015]
In the information presentation system of the present invention, based on the information on the position and orientation of the moving body acquired by the information acquisition unit, the information to be presented in association with the specific position is virtually displayed as the specific position. Generated by the audio signal generating means, the audio signal generating means for generating the audio signal to be output from each of the plurality of speakers in order to reconstruct the sound field in the vicinity of the occupant of the moving body when the sound is output as the sound source It is preferable that the apparatus further comprises audio signal output means for outputting audio signals to be output from each of the plurality of speakers via each of the plurality of speakers.
[0016]
In order to reconstruct the sound field in the vicinity of the occupant of the mobile object when the specific position is output as a virtual sound source, an audio signal to be output from each of the plurality of speakers is generated, and the audio signal is output to the plurality of speakers. By outputting via each of them, it is possible for the occupant of the moving body to easily recognize the sense of distance between the moving body and the specific position and the direction from the moving body to the specific position.
[0017]
  In order to solve the above problem, an information presentation method of the present invention is an information presentation method for presenting information to be presented in association with a specific position to an occupant of a mobile object, the position of the mobile object An information acquisition step for acquiring information on the orientation, and a line of sight of the occupant of the mobile body looking at the specific position and the mobile body based on the information on the position and orientation of the mobile body acquired in the information acquisition step A position calculating step for calculating an intersection position with the window, and a position on the window determined based on the intersection position calculated in the position calculating step.When a symbol indicating that there is information to be presented in association with the specific position is displayed, and the symbol is designated by a passenger of the mobile objectAnd an information display step for displaying information to be presented in association with the specific position.
[0018]
  The intersection position between the line of sight of the specific position of the mobile object and the window of the mobile object is calculated, and information to be presented in association with the specific position is displayed at a position on the window determined based on the cross position. By displaying, the information to be presented in association with the specific position can be presented to the occupant of the moving body while being superimposed on the scenery of the real world spreading from the vehicle window.In particular, the amount of information to be presented is increased by first displaying a symbol indicating that information exists on the window and then displaying the information in accordance with the designation of the symbol by the occupant of the moving object. Even if the information is displayed as it is, it occupies a relatively large area on the window, and the information can be presented effectively.
[0019]
The information presentation method of the present invention further includes a storage step of storing in the storage means information related to the specific position and information to be presented in association with the specific position. Based on the information on the position and orientation of the mobile body acquired in the information acquisition step and the information on the specific position stored in the storage means in the storage step, the occupant of the mobile body determines the specific position. The intersection position between the line of sight to be viewed and the window of the moving object is calculated, and the information display step is performed at the storage step at a position on the window determined based on the intersection position calculated at the position calculation step. Displaying information to be presented in association with the specific position stored in the storage means Door is preferred.
[0020]
The information to be presented in association with the specific position is stored in the storage means, and the information stored in the storage means is read and presented so that the information to be presented in association with the specific position can be simplified and It can be presented quickly.
[0021]
The information presentation method of the present invention further includes a reception step of receiving information on the specific position and information to be presented in association with the specific position, and the position calculation step includes the information acquisition step. Based on the information on the position and orientation of the moving body acquired in step 1 and the information on the specific position received in the reception step, the line of sight of the specific position of the occupant of the moving body and the moving body The information display step calculates the intersection position with the window, and the information display step receives the specific position received in the reception step at a position on the window determined based on the intersection position calculated in the position calculation step. It is preferable that information to be presented in association with is displayed.
[0022]
By receiving the information to be presented in association with the specific position and presenting the received information, the information to be presented in association with the specific position can be sequentially updated.
[0023]
In the information presentation method of the present invention, the information display step displays information to be presented in association with the specific position at a position overlapping the intersection position calculated in the position calculation step. Is preferable.
[0024]
By displaying information to be presented in association with the specific position at a position where the occupant of the mobile body overlaps the position where the line of sight of the specific position and the window of the mobile body overlap, The relationship between the specific position and the information can be recognized very easily.
[0025]
In the information presentation method of the present invention, the information display step may display information to be presented in association with the specific position according to the distance between the mobile object and the specific position. It is preferable that the display is changed.
[0026]
By displaying the information to be presented in association with the specific position according to the distance between the mobile body and the specific position, by changing the display mode, the mobile body and the A sense of distance between a specific position can be easily recognized.
[0027]
Further, in the information presentation method of the present invention, based on the information on the position and orientation of the mobile object acquired in the information acquisition step, the information to be presented in association with the specific position is virtually displayed as the specific position. An audio signal generation step for generating an audio signal to be output from each of a plurality of speakers in order to reconstruct a sound field in the vicinity of an occupant of the moving body when audio is output as a sound source, and generated in the audio signal generation step. Preferably, the method further includes an audio signal output step of outputting audio signals to be output from each of the plurality of speakers via each of the plurality of speakers.
[0028]
  In order to reconstruct the sound field in the vicinity of the occupant of the mobile object when the specific position is output as a virtual sound source, an audio signal to be output from each of the plurality of speakers is generated, and the audio signal is output to the plurality of speakers. By outputting via each of them, it is possible for the occupant of the moving body to easily recognize the sense of distance between the moving body and the specific position and the direction from the moving body to the specific position.
[0029]
DETAILED DESCRIPTION OF THE INVENTION
An information presentation system according to a first embodiment of the present invention will be described with reference to the drawings. First, the configuration of the information presentation system according to the present embodiment will be described. FIG. 1 is a configuration diagram of an information presentation system according to the present embodiment, and FIG. 2 is a diagram of a state in which the information presentation system according to the present embodiment is placed on a vehicle as viewed from the side of the vehicle. These are the figures which looked at a mode that the information presentation system concerning this embodiment was mounted in a car from the upper part of a car.
[0030]
The information presentation system 10 according to the present embodiment is an information presentation system that presents information to be presented in association with a specific position to a driver (occupant) of an automobile (moving body). The unit is configured as a CPU (Central Processing Unit), a storage device such as a memory and a hard disk, and a transmission / reception device.
[0031]
As shown in FIGS. 2 and 3, the information presentation system 10 is stored under a dashboard on the passenger seat side, and includes a projector 100, a navigation system 102, and four speakers (a right front speaker 104, a left front speaker 106). , The right rear speaker 108 and the left rear speaker 110).
[0032]
The projector 100 is stored under the center of the dashboard, and can project an image on the windshield of the automobile. The navigation system 102 is stored under the passenger seat. Further, the navigation system 102 has a function of calculating the position and orientation of the own vehicle based on output signals from a GPS receiver, a wheel speed sensor, a gyro, and the like (not shown). The right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110 are respectively attached to the lower portions of the right front door panel, the left front door panel, the right rear door panel, and the left rear door panel. In addition, the storage position or attachment position of each of the information presentation system 10, the projector 100, the navigation system 102, and the four speakers 104, 106, 108, 110 is not limited to the above-described positions. For example, the information presentation system 10 and the navigation system 102 may be stored inside the trunk, or the projector 100 is stored under the side of the dashboard, and projects an image on the windshield of an automobile from an angle. You may come to do.
[0033]
As shown in FIG. 1, the information presentation system 10 includes a storage unit 12 (storage unit), a presentation information reception unit 14 (reception unit), and a host vehicle information acquisition unit 16 (information acquisition unit). ), Intersection position calculation unit 18 (position calculation unit), display information output unit 20 (information display unit), audio signal generation unit 22 (audio signal generation unit), and audio information output unit 24 (audio signal output unit) ). Hereinafter, each component will be described in detail.
[0034]
The storage unit 12 stores a presentation information database 12a. FIG. 4 is a configuration diagram of the presentation information database 12a. In the presentation information database 12a, information to be provided in association with a specific position, information type to be presented in association with the specific position (video information or audio information), latitude and longitude of the specific position (Information on a specific position) and information indicating an information provider that provides the information are included. Here, as information to be provided in association with a specific location, for example, an advertisement of a store existing at a specific location, an introduction of a famous landmark existing at a specific location, and the like are applicable. In the example of the presentation information database 12a shown in FIG. 4, as the video information to be presented in association with the position of 35 ° 40′12 ″ north latitude and 139 ° 46′12 ″ east longitude, a video image of “Gyudon 300 yen”. It can be seen that there is information, and there is audio information “Gyudon San Biaquen” as audio information to be presented in association with the same position. It can also be seen that the provider of these information is “gyudonya A”. In this example, text is used as an example of video information, but it may be a still image or a moving image.
[0035]
Returning to FIG. 1, the presentation information receiving unit 14 receives information to be presented in association with a specific position and information regarding the specific position. More specifically, the presentation information receiving unit 14 is transmitted from the communication terminal device 112 disposed in a store or the like outside the automobile via the wireless network 114 (for example, a mobile phone network or a network using FM waves). Information to be provided in association with a specific position, type of information to be presented in association with the specific position, latitude and longitude of the specific position, and information indicating an information provider providing the information Receive. Here, the information to be provided in association with the specific position received by the presentation information receiving unit 14, the type of information to be presented in association with the specific position, the latitude and longitude of the specific position, Information indicating an information provider that provides information is stored in the presentation information database 12 a of the storage unit 12. For example, bank B, located at 35 ° 41'14 ″ north latitude and 139 ° 42′13 ″ east longitude, wants to present the video information “5% interest ○○ time deposit” in association with the location of its own store. These information ("5% interest XX time deposit" as information to be presented in association with a specific location from the communication terminal device 112 arranged in the bank via the wireless network 114, "B bank" as the information provider When the latitude (north latitude) “35 ° 41′14 ″”, the longitude (east longitude) “139 ° 42′13 ″”, and the information type “video”) are transmitted, the presentation information receiving unit 14 receives these information. These pieces of information received by the presentation information receiving unit 14 are stored in the presentation information database 12 a of the storage unit 12.
[0036]
The own vehicle information acquisition part 16 acquires the information regarding the position and direction of a motor vehicle. More specifically, the vehicle information acquisition unit 16 inputs the latitude and longitude of the vehicle that is calculated and output by the navigation system 102 and the angle to which the vehicle is facing (the traveling direction when running). Accept. Note that the vehicle information acquisition unit 16 calculates the position and orientation of the vehicle based on output signals from a GPS receiver, a wheel speed sensor, a gyro, etc. (not shown) regardless of the output from the navigation system 102. It may be.
[0037]
The intersection position calculation unit 18 is based on the information on the position and orientation of the vehicle acquired by the host vehicle information acquisition unit 16 and the information on the specific position stored in the presentation information database 12a of the storage unit 12. The intersection position between the line of sight at which the driver sees the specific position and the windshield (window) of the automobile is calculated. More specifically, the intersection position calculation unit 18 first stores the latitude and longitude of the host vehicle acquired by the host vehicle information acquisition unit 16 and the angle to which the host vehicle is facing (the traveling direction when running). Based on the latitude and longitude stored in the presentation information database 12a of the unit 12, it should be displayed from the information to be presented in association with the specific position stored in the presentation information database 12a of the storage unit 12 Extract video information. For example, the intersection position calculation unit 18 stores video information to be displayed in association with a specific position existing within a certain range as viewed from the current vehicle as the video information to be displayed at the current time in the storage unit 12. Extracted from the presentation information database 12a. For example, the predetermined range may be determined as an angle within 20 ° on the left and right sides of the angle at which the vehicle is facing (or the traveling direction when the vehicle is running) and within a distance of 1 km from the position of the vehicle. . Whether the information is video information may be referred to the information type column of the presentation information database 12 a stored in the storage unit 12.
[0038]
For each of the extracted video information, the intersection position calculation unit 18 also connects, as shown in FIG. 5, a straight line L1 connecting the position P1 of the driver's eye of the automobile and the specific position P2 associated with the video information. And the intersection position P3 with the windshield F1 of a motor vehicle is calculated. Here, as the x-coordinate, y-coordinate, and z-coordinate of the eye position P1 of the driver, the longitude of the own vehicle, the latitude of the own vehicle, a predetermined standard eye height of the driver, and the like are used. Good. In this case, by using the eye position measured by the sensor, correcting according to the sitting height of the driver, or correcting according to the positional relationship between the position measuring sensor including the GPS receiver and the driver, Calculation accuracy can be increased. Further, as the x coordinate, y coordinate, and z coordinate of the specific position P2, the latitude, longitude, and 0 of the specific position read from the presentation information database 12a of the storage unit 12 may be used, respectively.
[0039]
Returning to FIG. 1, the display information output unit 20 displays information to be presented in association with the specific position at a position on the windshield determined based on the intersection position calculated by the intersection position calculation unit 18. To do. More specifically, the display information output unit 20 displays, via the projector 100, video information to be displayed in association with the specific position at a position overlapping the intersection position P3 calculated by the intersection position calculation unit 18.
[0040]
Hereinafter, it demonstrates in detail using a specific example. 6 is a diagram showing an external scene as seen by the driver of the automobile through the windshield, and FIG. 7 is a diagram showing an image displayed on the windshield by the display information output unit 20 via the projector 100. FIG. These are figures which show the scene which the driver | operator of a motor vehicle can see ahead. That is, the display information output unit 20 displays video information (for example, “gyudon 300 yen”) to be displayed in association with the specific position P2 through the projector 100 at a position overlapping with the intersection position P3. As shown in FIG. 8, the video information to be displayed in association with the specific position P2 appears to overlap with the specific position P2 in the real world.
[0041]
The display information output unit 20 also displays information to be presented in association with the specific position in accordance with the distance between the car and the specific position, with the display mode changed. More specifically, when the distance between the automobile and the specific position is large (when the specific position is far from the host vehicle), the display information output unit 20 is configured as shown in FIG. When the distance between the vehicle and the specific position is small (when the specific position is close to the vehicle), the information to be presented in association with the specific position is displayed small. As shown in FIG. 9, the information to be presented in association with the specific position is displayed in large size, and the information is presented in association with the specific position according to the distance between the vehicle and the specific position. The information to be displayed is displayed with the size changed. In addition, when the distance between the car and the specific position becomes smaller than a predetermined value, information to be presented in association with the specific position is flashed or displayed in a different color. You may make it do.
[0042]
The audio signal generation unit 22 outputs information to be presented in association with the specific position based on the information on the position and orientation of the vehicle acquired by the own vehicle information acquisition unit 16 using the specific position as a virtual sound source. In order to reconstruct the sound field in the vicinity of the automobile driver in this case, audio signals to be output from the right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110 are generated. First, the audio signal generation unit 22 obtains the latitude and longitude of the host vehicle acquired by the host vehicle information acquisition unit 16 and the angle that the host vehicle is facing (the direction of travel if the vehicle is running), and the presentation information stored in the storage unit 12. Based on the latitude and longitude stored in the database 12a, voice information to be output at the present time is extracted from information to be presented in association with a specific position stored in the presentation information database 12a of the storage unit 12. . For example, the audio signal generation unit 22 stores the audio information to be output in association with a specific position existing within a certain range as viewed from the current vehicle, as the audio information to be output at the present time, stored in the storage unit 12. Extracted from the presentation information database 12a. For example, the predetermined range may be determined as an angle within 20 ° on the left and right sides of the angle at which the vehicle is facing (or the traveling direction when the vehicle is running) and within a distance of 1 km from the position of the vehicle. . Whether the information is voice information may be referred to the information type column of the presentation information database 12 a stored in the storage unit 12.
[0043]
The audio signal generation unit 22 also outputs, for each of the extracted audio information, information in the vicinity of the driver of the automobile when the information to be presented in association with the specific position is output using the specific position as a virtual sound source. In order to reconstruct the field, sound signals to be output from the right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110 are generated.
[0044]
If the simplest example is shown, for example, when the specific position is in a far front position or a front left position, the audio signal generation unit 22 mainly receives both the right front speaker 104 and the left front speaker 106. An audio signal that produces a small audio output is generated. On the other hand, for example, when the specific position is close to the right front, the audio signal generation unit 22 generates an audio signal that mainly outputs a large audio from the right front speaker 104. Here, the accuracy of the reconstructed sound field is further improved by adjusting the phase of the audio signal to be output from each of the right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110. Can do.
[0045]
The audio information output unit 24 outputs audio signals to be output from the right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110, which are generated by the audio signal generation unit 22, to the right front speaker 104, The signals are output via the left front speaker 106, the right rear speaker 108, and the left rear speaker 110, respectively.
[0046]
10 and 11 are diagrams conceptually showing how the audio information is heard by the driver of the automobile. For example, as shown in FIG. 10, when the specific position associated with the audio information to be presented is in a far right front position, the processing of the audio signal generation unit 22 and the audio information output unit 24 causes the vehicle to The driver can hear the audio information as if the sound source is a far right front position. On the other hand, as shown in FIG. 11, when the specific position associated with the audio information to be presented is near the right front, the processing of the audio signal generation unit 22 and the audio information output unit 24 causes the vehicle to The driver sounds as if the audio information is as a sound source near the right front.
[0047]
Then, operation | movement of the information presentation system concerning this embodiment is demonstrated, and the information presentation method concerning embodiment of this invention is demonstrated collectively. FIG. 12 is a flowchart showing a procedure for displaying and outputting information in the information presentation system 10 according to the present embodiment. FIG. 13 is a flowchart showing a procedure for outputting information by voice in the information presentation system 10 according to the present embodiment.
[0048]
Prior to presenting information in the information presentation system 10, the presentation information database 12 a is stored in the storage unit 12. As shown in FIG. 4, the presentation information database 12a includes information to be provided in association with a specific position, information type to be presented in association with the specific position (video information or audio information), The latitude and longitude of the specific position (information on the specific position) and information indicating the information provider that provides the information are included.
[0049]
In addition, information to be provided in association with a specific position from the communication terminal device 112 disposed in a store outside the automobile via the wireless network 114 (for example, a network using a mobile phone network or FM wave) When the type of information to be presented in association with a specific position, the latitude and longitude of the specific position, and information indicating the information provider that provides the information are transmitted, the information is a presentation information receiving unit. 14 is received. The information to be provided in association with the specific position received by the presentation information receiving unit 14, the type of information to be presented in association with the specific position, the latitude and longitude of the specific position, and the information Is stored in the presentation information database 12 a of the storage unit 12.
[0050]
In the case where information is displayed and output in the information presentation system 10, as shown in FIG. 12, first, the vehicle information acquisition unit 16 acquires information on the position and orientation of the vehicle (S12). More specifically, the input of the latitude and longitude of the host vehicle calculated and output by the navigation system 102 and the angle to which the host vehicle is facing (the traveling direction when running) is accepted. Regardless of the output from the navigation system 102, the vehicle information acquisition unit 16 calculates the position and orientation of the vehicle based on output signals from a GPS receiver, a wheel speed sensor, a gyro, and the like (not shown). Also good.
[0051]
Subsequently, based on the information on the position and orientation of the vehicle acquired by the own vehicle information acquisition unit 16 by the intersection position calculation unit 18 and the information on the specific position stored in the presentation information database 12 a of the storage unit 12. The intersection position between the line of sight of the vehicle driver looking at the specific position and the windshield of the vehicle is calculated (S14). More specifically, first, the latitude and longitude of the host vehicle acquired by the host vehicle information acquiring unit 16 and the angle to which the host vehicle is facing (the traveling direction when running) and the presentation information database 12a of the storage unit 12 are described. The video information to be displayed at the present time is extracted from the information to be presented in association with the specific position stored in the presentation information database 12a of the storage unit 12 based on the latitude and longitude stored in. For example, video information to be displayed in association with a specific position existing within a certain range as viewed from the current vehicle is extracted from the presentation information database 12a stored in the storage unit 12 as video information to be displayed at the current time. The For example, the predetermined range may be determined as an angle within 20 ° on the left and right sides of the angle at which the vehicle is facing (or the traveling direction when the vehicle is running) and within a distance of 1 km from the position of the vehicle. . Whether the information is video information may be referred to the information type column of the presentation information database 12 a stored in the storage unit 12.
[0052]
Thereafter, for each of the extracted video information, as shown in FIG. 5, a straight line L1 connecting the position P1 of the driver's eye of the automobile and a specific position P2 associated with the video information, and the windshield F1 of the automobile. The intersection position P3 is calculated. Here, as the x-coordinate, y-coordinate, and z-coordinate of the eye position P1 of the driver, the longitude of the own vehicle, the latitude of the own vehicle, a predetermined standard eye height of the driver, and the like are used. Good. In this case, by using the eye position measured by the sensor, correcting according to the sitting height of the driver, or correcting according to the positional relationship between the position measuring sensor including the GPS receiver and the driver, Calculation accuracy can be increased. Further, as the x coordinate, y coordinate, and z coordinate of the specific position P2, the latitude, longitude, and 0 of the specific position read from the presentation information database 12a of the storage unit 12 may be used, respectively.
[0053]
Subsequently, the display information output unit 20 displays information to be presented in association with the specific position at a position on the windshield determined based on the intersection position calculated by the intersection position calculation unit 18 ( S16). More specifically, video information to be displayed in association with the specific position is displayed via the projector 100 at a position overlapping the intersection position P3 calculated by the intersection position calculation unit 18. As a result, as viewed from the driver of the automobile, as shown in FIG. 8, the video information to be displayed in association with the specific position P2 appears to overlap the specific position P2 in the real world.
[0054]
In this case, according to the distance between the automobile and the specific position, information to be presented in association with the specific position is displayed with the display mode changed. More specifically, when the distance between the automobile and the specific position is large (when the specific position is far from the host vehicle), as shown in FIG. 8, it is presented in association with the specific position. When the information to be displayed is displayed small and the distance between the vehicle and the specific position is small (when the specific position is close to the own vehicle), as shown in FIG. The information to be presented in association with the specific position is large according to the distance between the car and the specific position, such that the information to be presented in association with the specific position is displayed and output. It is displayed by changing the height. In addition, when the distance between the car and the specific position becomes smaller than a predetermined value, information to be presented in association with the specific position is displayed in a blinking manner or the color is changed. Or may be displayed.
[0055]
Even when information is output by voice in the information presentation system 10, as shown in FIG. 13, first, the vehicle information acquisition unit 16 acquires information on the position and orientation of the vehicle (S <b> 22). Here, the procedure for acquiring information related to the position and orientation of the automobile is the same as the procedure for displaying and outputting information in the information presentation system 10.
[0056]
Subsequently, based on the information on the position and orientation of the vehicle acquired by the vehicle information acquisition unit 16 by the audio signal generation unit 22, the information to be presented in association with the specific position is set as the virtual sound source. Audio signals to be output from the right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110 are generated in order to reconstruct the sound field in the vicinity of the driver of the automobile. (S24).
[0057]
More specifically, first, the latitude and longitude of the host vehicle acquired by the host vehicle information acquiring unit 16 and the angle to which the host vehicle is facing (the traveling direction when running) and the presentation information database 12a of the storage unit 12 are described. Is extracted from the information to be presented in association with a specific position stored in the presentation information database 12a of the storage unit 12 based on the latitude and longitude stored in the storage unit 12. For example, audio information to be output in association with a specific position existing within a certain range as viewed from the current vehicle is extracted from the presentation information database 12a stored in the storage unit 12 as audio information to be output at the present time. The For example, the predetermined range may be determined as an angle within 20 ° on the left and right sides of the angle at which the vehicle is facing (or the traveling direction when the vehicle is running) and within a distance of 1 km from the position of the vehicle. . Whether the information is voice information may be referred to the information type column of the presentation information database 12 a stored in the storage unit 12.
[0058]
After that, for each of the extracted audio information, in order to reconstruct the sound field in the vicinity of the driver of the car when information that should be presented in association with the specific position is output as a sound source using the specific position as a virtual sound source Audio signals to be output from the right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110 are generated.
[0059]
In the simplest example, for example, when the specific position is far from the right front or left front, a small audio output is mainly output from both the right front speaker 104 and the left front speaker 106. An audio signal is generated. On the other hand, for example, when the specific position is close to the right front, an audio signal that generates a large audio output mainly from the right front speaker 104 is generated. Here, the accuracy of the reconstructed sound field is further improved by adjusting the phase of the audio signal to be output from each of the right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110. be able to.
[0060]
The audio signal to be output from each of the right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110 generated by the audio signal generation unit 22 is output to the right front speaker by the operation of the audio signal output unit 24. 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110, respectively (S26).
[0061]
As a result, for example, as shown in FIG. 10, when the specific position associated with the audio information to be presented is in a far right front position, the car driver is as far away as the right front. Sounds as if the position is the sound source. On the other hand, as shown in FIG. 11, when the specific position associated with the audio information to be presented is near the right front, the vehicle driver is given a position near the right front as the sound information. Sounds like it is.
[0062]
Then, the effect | action and effect of the information presentation system concerning this embodiment are demonstrated. The information presentation system 10 according to the present embodiment calculates the intersection position between the line of sight of the vehicle driver looking at a specific position and the windshield of the automobile, and the position on the windshield determined based on the intersection position is calculated as described above. Information to be presented in association with a specific position is displayed. Therefore, the information to be presented in association with the specific position can be presented to the driver of the automobile by superimposing it on the scenery of the real world spreading from the vehicle window. As a result, it is possible to present information that should be presented in association with a specific location, such as an advertisement for a store at a specific location and an introduction to a famous landmark that exists at a specific location, in an easy-to-understand manner. Become.
[0063]
In particular, in the information presentation system 10 according to the present embodiment, information to be presented in association with the specific position at a position where the line of sight of the specific position of the driver of the vehicle and the windshield of the vehicle overlaps. Is displayed. Therefore, it is possible for the driver of the automobile to recognize the relationship between the specific position and the information very easily. As a result, information to be presented in association with a specific position can be presented to the driver of the vehicle in an extremely easy-to-understand manner.
[0064]
Furthermore, in the information presentation system 10 according to the present embodiment, the information to be presented in association with the specific position is displayed with the size changed according to the distance between the car and the specific position. . Therefore, the driver of the automobile can easily recognize the sense of distance between the automobile and the specific position. As a result, information to be presented in association with a specific position can be presented to the driver of the vehicle in a more understandable manner.
[0065]
In the information presentation system 10 according to the present embodiment, information to be presented in association with the specific position is stored in the presentation information database 12a of the storage unit 12, and the stored information is read and presented. . Therefore, information to be presented in association with the specific position can be presented simply and quickly.
[0066]
In the information presentation system 10 according to the present embodiment, information to be presented in association with the specific position is received by the presentation information receiving unit 14, and the received information is temporarily stored in the presentation information database 12a of the storage unit 12. After storing, present this information. Therefore, information to be presented in association with a specific position stored in the presentation information database 12a of the storage unit 12 can be sequentially updated with new information. As a result, new information can be sequentially presented to the driver of the car.
[0067]
In the information presentation system 10 according to the present embodiment, the right front speaker 104 and the left front speaker 106 are used to reconstruct the sound field in the vicinity of the driver of the automobile when the specific position is output as a virtual sound source. , Audio signals to be output from the right rear speaker 108 and the left rear speaker 110 are generated, and the audio signals are output via the right front speaker 104, the left front speaker 106, the right rear speaker 108, and the left rear speaker 110, respectively. . Accordingly, the driver of the automobile can easily recognize the sense of distance between the automobile and the specific position and the direction from the automobile to the specific position. As a result, information to be presented in association with a specific position can be presented to the driver of the automobile not only through vision but also through hearing, and information to be presented in association with the specific position can be presented to the automobile. It will be possible to present it more clearly to the driver.
[0068]
In the information presentation system 10 according to the embodiment, as shown in FIGS. 8 and 9, the specific driver is positioned at a position where the line of sight of a specific position of the vehicle driver and the intersection of the windshield of the vehicle overlap. The information to be presented in association with the position is displayed. However, this is not necessarily a position that overlaps the intersection position as long as the position is determined based on the intersection position. For example, as shown in FIG. 14, information to be presented in association with the specific position may be presented at a position moved from the intersection position to the side of the windshield. In this case, the relationship between the specific position and information to be presented in association with the specific position may be clarified by separately displaying an arrow or the like indicating the intersection position.
[0069]
  In the information presentation system 10 according to the above embodiment, information to be presented in association with the specific position is automatically displayed regardless of whether there is an instruction from the driver of the automobile. Information to be presented in association with the specific position may be displayed based on the driver's instruction. That is, when there is information to be displayed in association with a specific position existing within a certain range as viewed from the current vehicle, first, as shown in FIG. 15, on the windshield F1 determined based on the intersection position. A symbol M1 indicating that information exists is displayed at the position. Here, when the designation of the symbol M1 (designation via an input means such as a touch panel, designation by voice, designation by operation, etc.) is performed by the driver, as shown in FIG. 16, it is displayed in association with a specific position. Information W1 to be displayed is displayed. Such an information presentation method is extremely useful when the amount of information to be presented is large and occupies a relatively large area on the windshield, such as when a web page is received and displayed. It is effective. still,Web pageWhen receiving and displaying the information, the information received by the presentation information receiving unit 14 may be directly displayed without storing the content of the web page in the presentation information database 12 a of the storage unit 12.
[0070]
Moreover, the specific position with which the information is associated does not necessarily have to be a fixed position. For example, as shown in FIG. 17, information transmitted from a user of a mobile phone that moves sequentially is displayed on a windshield that overlaps the intersection of a line of sight where a driver of the automobile sees the position of the user and the windshield of the automobile. It can also be displayed at the position. In this case, the location information of the user is sequentially transmitted from the mobile phone user to the information presentation system 10.
[0071]
Moreover, in the said embodiment, although the specific position shown by associating information was made into the two-dimensional position (position specified by the latitude and the longitude), this is further 3 including height. It may be a dimensional position.
[0072]
Moreover, in the said embodiment, the latitude and the longitude were used as the information regarding a specific position, ie, the information which prescribes | regulates a specific position, However, This may not be a latitude and a longitude. For example, the map may be divided by a mesh, and the specific position may be defined by the number of the divided mesh.
[0073]
Moreover, although the example using four speakers was demonstrated in the said embodiment, if this is multiple, it may not be four. In addition, if the information to be presented is limited to video information only, a mode in which a speaker is not used can be considered.
[0074]
Moreover, in the said embodiment, although the information which should be shown is displayed on the windshield, this can also be displayed not only on a windshield but on a side window, a rear glass, etc.
[0075]
In addition, the information presentation system 10 according to the above-described embodiment is an information presentation system that presents information to be presented in association with a specific position to a driver of an automobile. The present invention can also be applied to an information presentation system that presents information to be presented in association with a position to an occupant of a car other than the driver (for example, a taxi or a tourist bus customer). Similarly, the information presentation system of the present invention can also be applied to an information presentation system that presents information to be presented in association with a specific position to a passenger of a moving body other than an automobile (for example, a ship, a train, an airplane). It is.
[0076]
Subsequently, a virtual leading vehicle display system (information presentation system) according to a second embodiment of the present invention will be described with reference to the drawings. In addition, the overlapping description is abbreviate | omitted about the part similar to the information presentation system 10 concerning the said 1st Embodiment.
[0077]
The virtual leading vehicle display system 50 according to the present embodiment is an information presentation system that presents information to be presented in association with a specific position to a driver (occupant) of an automobile (moving body). For example, it is configured as a unit including a CPU (Central Processing Unit), a storage device such as a memory and a hard disk, and a transmission / reception device. Here, the specific position is a position on the planned travel route of the own vehicle that is advanced by a certain distance from the position of the own vehicle, in other words, a certain time has elapsed if the own vehicle proceeds at a constant speed. It is a position that is expected to exist later. Further, the information to be presented in association with the specific position is an image of the virtual leading vehicle.
[0078]
FIG. 18 is a configuration diagram of a virtual leading vehicle display system according to the present embodiment. As shown in FIG. 18, the virtual leading vehicle display system 50 includes a host vehicle information acquisition unit 52 (information acquisition unit), a virtual leading vehicle position calculation unit 54, and an intersection position calculation unit 56 ( Position calculation means) and a virtual leading vehicle display unit 58 (information display means). Hereinafter, each component will be described in detail.
[0079]
The own vehicle information acquisition unit 52 acquires information on the position and orientation of the automobile. Here, the detailed function of the own vehicle information acquisition unit 52 is the same as the function of the own vehicle information acquisition unit 16 of the information presentation system 10 according to the first embodiment.
[0080]
The virtual leading vehicle position calculation unit 54 calculates the position on the planned driving route of the host vehicle based on the position of the vehicle acquired by the host vehicle information acquisition unit 52 and information on the planned driving route of the host vehicle output from the navigation system 102. And a position that is advanced by a certain distance from the position of the vehicle, in other words, a position that is predicted to exist after a certain time if the vehicle travels at a constant speed (hereinafter referred to as a future vehicle position). calculate.
[0081]
The intersection position calculation unit 56 is based on the information on the position and orientation of the vehicle acquired by the vehicle information acquisition unit 52 and the future vehicle position calculated by the virtual leading vehicle position calculation unit 54. Calculates the intersection position between the line of sight of the future vehicle position and the windshield of the vehicle. In addition, the calculation method of the intersection position is the same as the calculation method of the intersection position in the intersection position calculation unit 18 of the information presentation system 10 according to the first embodiment.
[0082]
The virtual leading vehicle display unit 58 displays a predetermined virtual leading vehicle image via the projector 100 at a position on the windshield that overlaps the intersection position calculated by the intersection position calculation unit 56.
[0083]
Hereinafter, it demonstrates in detail using a specific example. FIG. 19 is a diagram showing an external scene as seen by a driver of an automobile through a windshield, and FIG. 20 is a diagram showing an image displayed on the windshield by the virtual leading vehicle display unit 58 via the projector 100. 21 is a view showing a scene that a driver of an automobile can see forward. That is, the future vehicle position calculated by the virtual leading vehicle position calculation unit 54 is P4, and the line of sight of the vehicle driver looking at the future vehicle position P4 calculated by the intersection position calculation unit 56 and the front of the vehicle are calculated. Assuming that the intersection position with the glass F1 is P5, the virtual leading vehicle display unit 58 displays the image of the virtual leading vehicle through the projector 100 at a position overlapping the intersection position P5. As shown in FIG. 21, it will appear as if the leading vehicle is running at the future vehicle position P4 in the real world. In this case, for example, a binocular stereoscopic image may be output from the projector 100, and the driver of the vehicle may wear binocular stereoscopic glasses to form a stereoscopic virtual leading vehicle.
[0084]
20 and 21, the image of the virtual leading vehicle is in the form of a car, but this may be a simple mark such as an arrow or a rectangle.
[0085]
【The invention's effect】
  The information presentation system and the information presentation method of the present invention calculate a crossing position between a line of sight of a specific position of a mobile occupant and a window of the mobile body, and a position on the window determined based on the crossing position (for example, Information to be presented in association with the specific position is displayed at a position overlapping the intersection position. Therefore, the information to be presented in association with the specific position can be presented to the occupant of the moving body while being superimposed on the real-world scenery spreading from the vehicle window. As a result, information to be presented in association with a specific position can be presented in an easy-to-understand manner to the occupant of the mobile object.In particular, the amount of information to be presented is increased by first displaying a symbol indicating that information exists on the window and then displaying the information in accordance with the designation of the symbol by the occupant of the moving object. Even if the information is displayed as it is, it occupies a relatively large area on the window, and the information can be presented effectively.
[0086]
In the information presentation system and information presentation method of the present invention, information to be presented in association with the specific position is stored in the storage means, and the information stored in the storage means is read and presented. Information to be presented in association with the specific position can be presented simply and quickly.
[0087]
In the information presentation system and information presentation method of the present invention, information to be presented in association with the specific position is received, and information to be presented in association with the specific position is presented by presenting the received information. Can be updated sequentially. As a result, new information can be sequentially presented to the occupant of the moving body.
[0088]
Further, in the information presentation system and the information presentation method of the present invention, the mobile occupant presents the information in association with the specific position at the position where the line of sight of the specific position and the intersection of the window of the mobile object overlap. By displaying the power information, it is possible to make the occupant of the moving body recognize the relevance between the specific position and the information very easily. As a result, information to be presented in association with a specific position can be presented to the occupant of the mobile body in an extremely easy-to-understand manner.
[0089]
In the information presentation system and the information presentation method of the present invention, the information to be presented in association with the specific position is changed in the display mode according to the distance between the moving object and the specific position. By displaying, it is possible to make the occupant of the moving body easily recognize the sense of distance between the moving body and the specific position. As a result, the information to be presented in association with the specific position can be presented to the occupant of the mobile body more easily.
[0090]
  Further, in the information presentation system and the information providing method of the present invention, in order to reconstruct the sound field in the vicinity of the occupant of the moving body when the specific position is output as a virtual sound source, the sound is output from each of a plurality of speakers. Generating a sound signal to be output and outputting the sound signal through each of the plurality of speakers, to the passenger of the moving body, the distance between the moving body and the specific position and the specific body from the sense of distance The direction to the position can be easily recognized. As a result, the information to be presented in association with a specific position can be presented to the occupant of the mobile body not only through vision but also through hearing, and the information to be presented in association with the specific position It becomes possible to present it more easily to the occupant of the moving body.
  In the information presentation system and the information providing method according to the present invention, the line of sight and the moving body in which the occupant of the moving body sees the position on the planned traveling route of the moving body and advanced by a certain distance from the position of the moving body. By calculating the intersection position with the window and displaying the image of the virtual leading vehicle at the position on the window determined based on the intersection position, the virtual leading vehicle image is superimposed on the real world scenery spreading from the vehicle window Can be presented to the occupant of the moving body.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of an information presentation system.
FIG. 2 is a view of a state in which the information presentation system is placed on a vehicle as viewed from the side of the vehicle.
FIG. 3 is a diagram of a state where the information presentation system is placed on a vehicle as viewed from above the vehicle.
FIG. 4 is a configuration diagram of a presentation information database.
FIG. 5 is an explanatory diagram showing a method for calculating an intersection position.
FIG. 6 is a view showing an external scene as seen through a windshield by an automobile driver.
FIG. 7 is a diagram illustrating an image displayed on a windshield by a display information output unit via a projector.
FIG. 8 is a view showing a scene that a driver of an automobile can see forward.
FIG. 9 is a view showing a scene that a driver of an automobile can see forward.
FIG. 10 is a diagram conceptually showing how audio information is heard by a driver of an automobile.
FIG. 11 is a diagram conceptually showing how audio information is heard by a driver of an automobile.
FIG. 12 is a flowchart showing a procedure for displaying and outputting information.
FIG. 13 is a flowchart showing a procedure for outputting information by voice.
FIG. 14 is a view showing a scene that a driver of an automobile can see forward.
FIG. 15 is a view showing a scene that can be seen forward by a driver of an automobile.
FIG. 16 is a view showing a scene that a driver of an automobile can see forward.
FIG. 17 is a view showing a scene that a driver of an automobile can see forward.
FIG. 18 is a configuration diagram of a virtual leading vehicle display system.
FIG. 19 is a view showing an external scene as seen through a windshield by a driver of an automobile.
FIG. 20 is a diagram showing an image displayed on the windshield by the virtual leading vehicle display unit via the projector.
FIG. 21 is a view showing a scene that a driver of an automobile can see forward.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 ... Information presentation system, 12 ... Storage part, 14 ... Presentation information receiving part, 16 ... Own vehicle information acquisition part, 18 ... Crossing position calculation part, 20 ... Display information output part, 22 ... Audio | voice signal generation part, 24 ... Audio | voice Information output unit, 50 ... virtual leading vehicle display system, 52 ... own vehicle information acquisition unit, 54 ... virtual leading vehicle position calculation unit, 56 ... intersection position calculation unit, 58 ... virtual leading vehicle display unit

Claims (12)

In an information presentation system that presents information to be presented to a passenger of a mobile object in association with a specific position,
Information acquisition means for acquiring information on the position and orientation of the moving body;
Based on information on the position and orientation of the moving object acquired by the information acquiring means, position calculating means for calculating the intersection position between the line of sight of the specific position and the window of the moving object by the occupant of the moving object When,
A symbol indicating that there is information to be presented in association with the specific position is displayed at a position on the window determined based on the intersection position calculated by the position calculation means. An information presentation system comprising: information display means for displaying information to be presented in association with the specific position when the symbol is designated. Storage means for storing information on the specific position and information to be presented in association with the specific position;
The position calculating means is configured to determine whether the occupant of the moving body is based on the information on the position and orientation of the moving body acquired by the information acquiring means and the information on the specific position stored in the storage means. Calculate the intersection position between the line of sight of the specific position and the window of the moving object,
The information display means displays information to be presented in association with the specific position stored in the storage means at a position on the window determined based on the intersection position calculated by the position calculation means. The information presentation system according to claim 1, wherein: Receiving means for receiving information on the specific position and information to be presented in association with the specific position;
The position calculating means is configured to determine whether the occupant of the moving body is based on the information on the position and orientation of the moving body acquired by the information acquiring means and the information on the specific position received by the receiving means. Calculate the intersection position between the line of sight of the specific position and the window of the moving object,
The information display means displays information to be presented in association with the specific position received by the receiving means at a position on the window determined based on the intersection position calculated by the position calculating means. The information presentation system according to claim 1, wherein the system is an information presentation system. The information display means displays information to be presented in association with the specific position at a position overlapping the intersection position calculated by the position calculation means. The information presentation system according to item. The information display means displays information to be presented in association with the specific position in accordance with a distance between the moving body and the specific position, changing a display mode. Item 5. The information presentation system according to any one of Items 1 to 4. Based on the information on the position and orientation of the mobile object acquired by the information acquisition means, information to be presented in association with the specific position is output by using the specific position as a virtual sound source. Audio signal generating means for generating audio signals to be output from each of the plurality of speakers in order to reconstruct the sound field in the vicinity of the occupant;
The audio signal output means for outputting the audio signal to be output from each of the plurality of speakers generated by the audio signal generation means via each of the plurality of speakers, further comprising: 6. The information presentation system according to any one of items 5. In an information presentation method for presenting information to be presented to a passenger of a mobile object in association with a specific position,
An information acquisition step of acquiring information on the position and orientation of the moving body;
A position calculating step of calculating an intersection position between the line of sight of the specific position of the occupant of the moving body and the window of the moving body based on the information on the position and orientation of the moving body acquired in the information acquiring step. When,
A symbol indicating that there is information to be presented in association with the specific position at a position on the window determined based on the intersection position calculated in the position calculating step, and An information display method comprising: an information display step of displaying information to be presented in association with the specific position when the symbol is designated. A storage step of storing in the storage means information relating to the specific position and information to be presented in association with the specific position;
The position calculating step is based on the information on the position and orientation of the moving body acquired in the information acquiring step and the information on the specific position stored in the storage unit in the storing step. Calculating the intersection position between the line of sight of the occupant looking at the specific position and the window of the moving object;
The information display step presents the position on the window determined based on the intersection position calculated in the position calculation step in association with the specific position stored in the storage means in the storage step. The information presentation method according to claim 7, wherein power information is displayed. A receiving step of receiving information on the specific position and information to be presented in association with the specific position;
In the position calculating step, an occupant of the moving body is based on the information on the position and orientation of the moving body acquired in the information acquiring step and the information on the specific position received in the receiving step. Calculate the intersection position between the line of sight of the specific position and the window of the moving object,
In the information display step, information to be presented in association with the specific position received in the reception step is displayed at a position on the window determined based on the intersection position calculated in the position calculation step. The information presentation method according to claim 7 or 8, characterized in that The information display step displays information to be presented in association with the specific position at a position overlapping the intersection position calculated in the position calculation step. The information presentation method according to the item. The information display step displays information to be presented in association with the specific position according to a distance between the moving body and the specific position, with a display mode being changed. The information presentation method according to any one of Items 7 to 10. Based on the information on the position and orientation of the mobile object acquired in the information acquisition step, information to be presented in association with the specific position of the mobile object when the specific position is output as a virtual sound source. An audio signal generation step for generating an audio signal to be output from each of the plurality of speakers in order to reconstruct the sound field in the vicinity of the occupant;
The audio signal output step of outputting the audio signal to be output from each of the plurality of speakers generated in the audio signal generation step via each of the plurality of speakers, further comprising: 11. The information presentation method according to any one of 11 above.

Images