JP2012242202A - In-vehicle system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an in-vehicle system which provides peripheral information for a user in the vehicle so that the user can immediately grasp interesting information, by augmented reality technology.SOLUTION: A navigation application 110 of an in-vehicle device 1 outputs a navigation screen 500 displaying landmarks of facilities of facility types specified by a user as display target facility types on a map. An AR client application 111 of the in-vehicle device 1 acquires a current location and a current forward direction from the navigation application 110, acquires air-tag information from an AR server 4 via a smart phone 2 by using the current location and the current forward direction as specification information, and displays only air-tag information with which categories corresponding to the display target facility types are registered among the acquired air-tag information at a position in which coordinates registering the air-tag information is presented on a forward image of the vehicle imaged by a front camera 107 (b1).

Description

  The present invention relates to a technique for providing peripheral information to a user in an automobile.

As a technique for providing peripheral information to a user, information on a peripheral point acquired from a server through communication is superimposed and displayed at a position corresponding to the point on a video obtained by photographing a landscape around a real space with a camera. Augmented reality technology is known (for example, Patent Document 1).
Further, as a technology for providing peripheral information to a user in an automobile, only a mark representing a facility of a genre designated by the user among marks representing a peripheral facility is displayed on a map in a navigation device mounted on the automobile. There is known a technique for displaying the image at a position corresponding to the point where the facility is located (for example, Patent Document 2).

JP 2010-238096 A JP 2004-294247 A

  According to the augmented reality technology described above, when there are a large number of pieces of information at peripheral points where information is acquired from the server, the number of pieces of information displayed becomes excessive, and the visibility of each piece of information deteriorates. Further, according to the above-described augmented reality technology, information that is interesting to the user and information that is not interesting are mixed and displayed miscellaneously, making it difficult to immediately grasp the information that the user is interested in.

  Accordingly, an object of the present invention is to provide peripheral information to a user in an automobile so that the user can immediately grasp information of interest by the augmented reality technology.

  In order to achieve the above object, the present invention relates to a point in an area observed when the designated azimuth direction is observed from the designated azimuth in response to an air tag information request designating a designated position and a designated azimuth, and the point Access to the server that provides the air tag information related to the genre, and the in-vehicle system installed in the vehicle corresponding to each facility, the facility type representing the type of the corresponding facility and the corresponding facility type On the map represented by the map data represented by the storage unit storing the facility information indicating the location, the storage unit storing the map data representing the map, the current position calculation unit calculating the current position of the vehicle, A facility in which the current location mark indicating the current location calculated by the current location calculation unit and the facility type set as the display target facility type by the user are registered in the facility information is the map. The navigation unit that generates a navigation screen in which the facility mark represented by is arranged, the camera that images the outside of the automobile, the imaging direction calculation unit that calculates the direction of the imaging direction of the camera, and the current position calculation unit The air tag information request with the current position of the automobile as the designated position and the orientation of the photographing direction of the camera calculated by the photographing direction calculation unit as the designated direction is issued to the server and the issued air tag Among the air tag information acquisition unit that acquires the air tag information provided from the server in response to the information request, and the air tag information acquired by the air tag information acquisition unit, it is related to the genre corresponding to the display target facility type. Corresponding air tag information to the point where the air tag information is related on the image captured by the camera It is obtained by an augmented reality image display unit for displaying an image disposed in that position.

  Here, in such an in-vehicle system, instead of the above-described augmented reality image display unit as an augmented reality image display unit, the facility mark is arranged on the navigation screen among the air tag information acquired by the air tag information acquisition unit. The position corresponding to the point where the air tag information related to the location corresponding to the location corresponding to the location of the facility registered in the facility information of the registered facility is related to the air tag information on the captured image captured by the camera It may be configured to include an augmented reality image display unit that displays an image arranged in the screen.

  According to such in-vehicle systems, using the display target facility type for selecting the facility mark to be displayed in the navigation unit, the air tag information of the genre corresponding to the display target facility type, or the display target facility type Only the air tag information related to the facility can be displayed. And since the display object facility type sets the facility type of the facility that the user is interested in, in this way, only the air tag information related to the facility that the user is interested in is displayed. As a result, the user in the car Will be able to immediately grasp the air tag information about the facility that is interested.

  Note that the above-described in-vehicle system uses the air tag information acquired by the air tag information acquisition unit as the augmented reality image display unit instead of the above-described augmented reality image display unit on the captured image captured by the camera. For the air tag information related to the genre corresponding to the display target facility type, an image arranged in an emphasized form than the other air tag information is displayed at the position corresponding to the point where the air tag information is related. An augmented reality image display unit may be provided.

  Alternatively, the in-vehicle system as described above may replace the augmented reality image display unit described above as the augmented reality image display unit with the air tag information acquired by the air tag information acquisition unit on the captured image captured by the camera. About the air tag information related to the point corresponding to the facility position registered in the facility information of the facility where the facility mark is arranged on the navigation screen at the position corresponding to the point where the air tag information is related May include an augmented reality image display unit that displays an image arranged in a more emphasized form than other air tag information.

  According to such in-vehicle systems, using the display target facility type for selecting the facility mark to be displayed in the navigation unit, the air tag information of the genre corresponding to the display target facility type, or the display target facility type It is possible to display the air tag information related to the facility in a form that is more emphasized than the other air tag information. And since the display object facility type sets the facility type of the facility that the user is interested in, in this way, only the air tag information related to the facility that the user is interested in is highlighted and displayed. It becomes possible to immediately grasp the air tag information related to the facility in which the user is interested.

  Further, in each of the above-described in-vehicle systems, the air tag information related to the genre corresponding to the display target facility type among the air tag information acquired by the air tag information acquisition unit is further displayed on the navigation screen. You may make it provide the navigation screen display part which displays the image arrange | positioned in the position corresponding to the point with which the said air tag information was related on the map contained in the said navigation screen.

  Alternatively, each of the above in-vehicle systems further corresponds to a facility position registered in the facility information of the facility where the facility mark is arranged on the navigation screen among the air tag information acquired by the air tag information acquisition unit. Navigation screen display for displaying an image in which air tag information related to a point to be displayed is arranged at a position corresponding to the point to which the air tag information is related on the map included in the navigation screen on the navigation screen You may make it provide a part.

  Alternatively, in each of the above-mentioned in-vehicle systems, the air tag information acquired by the air tag information acquisition unit corresponds to a point on the navigation screen where the air tag information is related on the map included in the navigation screen. For the air tag information related to the genre corresponding to the display object facility type, a navigation screen display unit for displaying an image arranged in a form emphasized over other air tag information may be provided. Good.

  Alternatively, in each of the above-mentioned in-vehicle systems, the air tag information acquired by the air tag information acquisition unit corresponds to a point on the navigation screen where the air tag information is related on the map included in the navigation screen. The air tag information related to the point corresponding to the facility position registered in the facility information of the facility where the facility mark is arranged on the navigation screen is emphasized more than other air tag information. You may make it provide the navigation screen display part which displays the image arrange | positioned in the form.

  Alternatively, in each of the above-described in-vehicle systems, an air tag information display unit is provided, and the navigation unit corresponds to a point where the air tag information acquired by the air tag information acquisition unit is related among the facility marks arranged on the navigation screen. The facility screen with the facility information registered as the facility location is set as a facility with air tag information, and the navigation screen is generated by arranging the facility mark representing the facility with the air tag information in a form more emphasized than other facility marks. In the air tag information display unit, in response to a user operation on the facility mark representing the facility with the air tag information, the air tag information display unit is related to a point corresponding to the facility position registered in the facility information of the facility with the air tag information. The air tag information may be displayed.

  In order to achieve the above object, the present invention relates to a point in an area observed when observing the designated azimuth direction from the designated azimuth in response to an air tag information request designating a designated position and designated azimuth. Corresponding to the facility type representing the type of the corresponding facility provided for each facility in the in-vehicle system installed in the car that accesses the server that provides the air tag information related to the genre of the point A storage unit that stores facility information indicating a facility position indicating a facility position, map data representing a map, a current position calculation unit that calculates a current position of the vehicle, and a map on which the map data represents In addition, the current position mark representing the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information. A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged, a forward direction calculation unit that calculates a forward direction of the vehicle, and a current position of the vehicle that is calculated by the current position calculation unit are designated The air tag information request having the designated direction as the forward direction of the automobile calculated by the forward direction calculation unit is issued to the server, and from the server in response to the issued air tag information request The air tag information acquisition unit for acquiring the provided air tag information, and the air tag information related to the genre corresponding to the display target facility type among the air tag information acquired by the air tag information acquisition unit on the navigation screen The air tag information is related on the map included in the navigation screen. It is obtained by a navigation screen display unit for displaying an image disposed at a position corresponding to the point.

  Here, in such an in-vehicle system, instead of the navigation screen display unit described above, the facility mark is arranged on the navigation screen among the air tag information acquired by the air tag information acquisition unit as the navigation screen display unit. The location where the air tag information related to the location corresponding to the location corresponding to the facility location registered in the facility information of the facility is related to the air tag information on the map included in the navigation screen on the navigation screen You may make it provide the navigation screen display part which displays the image arrange | positioned in the position corresponding to.

  According to such in-vehicle systems, using the display target facility type for selecting the facility mark to be displayed in the navigation unit, the air tag information of the genre corresponding to the display target facility type, or the display target facility type Only the air tag information related to the facility can be displayed. And since the display object facility type sets the facility type of the facility that the user is interested in, in this way, only the air tag information related to the facility that the user is interested in is displayed. As a result, the user in the car Will be able to immediately grasp the air tag information about the facility that is interested.

  Or each above-mentioned in-vehicle system is replaced with the above-mentioned navigation screen display part as a navigation screen display part, and the air tag information which the air tag information acquisition part acquired is a map contained in the navigation screen on the navigation screen The air tag information related to the genre corresponding to the display target facility type at the position corresponding to the point where the air tag information is related to above is an image arranged in a form emphasized over other air tag information A navigation screen display unit may be provided.

  Or each above-mentioned in-vehicle system is replaced with the above-mentioned navigation screen display part as a navigation screen display part, and the air tag information which the air tag information acquisition part acquired is a map contained in the navigation screen on the navigation screen In the above, the position corresponding to the point where the air tag information is related is related to the point corresponding to the facility position registered in the facility information of the facility where the facility mark is arranged on the navigation screen. About air tag information, you may make it provide the navigation screen display part which displays the image arrange | positioned in the form emphasized rather than the other air tag information.

  According to such in-vehicle systems, using the display target facility type for selecting the facility mark to be displayed in the navigation unit, the air tag information of the genre corresponding to the display target facility type, or the display target facility type It is possible to display the air tag information related to the facility in a form that is more emphasized than the other air tag information. And since the display object facility type sets the facility type of the facility that the user is interested in, in this way, only the air tag information related to the facility that the user is interested in is highlighted and displayed. It becomes possible to immediately grasp the air tag information related to the facility in which the user is interested.

  In addition, an air tag information display unit is provided in the above-described in-vehicle system, and in the navigation unit, among the facility marks arranged on the navigation screen, the air tag information acquired by the air tag information acquisition unit is associated with a point. The facility screen with the corresponding location registered as the facility location is defined as the facility with the air tag information, and the navigation screen is generated by arranging the facility mark representing the facility with the air tag information more emphasized than the other facility marks. In the air tag information display unit, in response to a user operation on the facility mark representing the facility with the air tag information, the air tag information display unit relates to a point corresponding to the facility position registered in the facility information of the facility with the air tag information. The air tag information being displayed may be displayed.

  By doing so, since the facility mark of the facility where the related air tag information exists is highlighted on the navigation screen displayed in the navigation unit, the user immediately knows that the air tag information related to the facility exists. In addition, the air tag information can be confirmed by an easy operation of simply operating the facility mark.

The above-described in-vehicle system may be configured so that a portable device having a communication function can be connected, and the air tag information acquisition unit may access the server via the portable device.
Alternatively, the above in-vehicle system is configured such that the in-vehicle system can be connected to a portable device having a built-in camera and an augmented reality providing function, and the air tag information acquisition unit sends the air tag information request to the portable device. It is issued to the server via the augmented reality providing function of the device, and the air tag information provided to the augmented reality providing function of the portable device is acquired from the server in response to the issued air tag information request. May be. However, the augmented reality providing function issues, to the server, the air tag information request that designates the current position of the portable device as the designated position and designates the shooting direction of the built-in camera as the specified direction. In addition to acquiring the air tag information from the server, an augmented reality image in which the acquired air tag information is arranged at a position corresponding to the point where the air tag information is captured on the captured image captured by the built-in camera is displayed. It is a function.

  As described above, according to the present invention, peripheral information can be provided to a user in an automobile so that the user can immediately grasp information of interest by using augmented reality technology.

It is a block diagram which shows the structure of the augmented reality system which concerns on embodiment of this invention. It is a block diagram which shows the structure of the vehicle-mounted apparatus and smart phone which concern on embodiment of this invention. It is a figure which shows the air tag information which concerns on embodiment of this invention, and the augmented reality function of a smart phone. It is a figure which shows the map data which concern on embodiment of this invention. It is a figure which shows the navigation screen which concerns on embodiment of this invention. It is a flowchart which shows the air tag information acquisition process and air tag information display process which concern on embodiment of this invention. It is a figure which shows the process example of the air tag information display process which concerns on embodiment of this invention. It is a figure which shows the process example of the air tag information display process which concerns on embodiment of this invention. It is a figure which shows the process example of the air tag information display process which concerns on embodiment of this invention. It is a figure which shows the process example of the air tag information display process which concerns on embodiment of this invention.

Hereinafter, embodiments of the present invention will be described.
FIG. 1 shows the configuration of an augmented reality system according to the present embodiment.
As shown in the figure, the augmented reality system includes an in-vehicle device 1 mounted on an automobile, a smartphone 2 that is a portable device that can be connected to the in-vehicle device 1, and an AR (AR) that the smartphone 2 can access via the mobile communication network 3. : Augmented Reality) server 4.

Next, the configuration of the smartphone 2 of the in-vehicle device 1 is shown in FIG.
As shown in the figure, the smartphone 2 includes a GPS receiver 201, an electronic compass 202, a storage unit 203, a mobile communication device 204 for accessing the mobile communication network 3, an operation unit 205, a display 206, and a microphone. Managed by the SP-operating system 210, which is the OS of the smartphone 2, and the SP-operating system 210, which is the OS of the smartphone 2, -It has a plurality of applications running on the operating system 210.

  Here, the smartphone 2 has, as an application running on the SP-operating system 210, a mobile phone application 211 that provides a mobile phone function using the mobile communication device 204, the voice input / output unit 207, and the operation unit 205, and an AR. An application 212 and other applications 213 are provided.

  On the other hand, the in-vehicle device 1 includes a GPS receiver 101, a gyro sensor 102, a vehicle speed sensor 103, a storage device 104 that stores map data, an input device 105, a display device 106, and a front that photographs the front of the vehicle as shown in FIG. A camera 107, a device interface 108 for connecting to the smartphone 2, an H-operating system 109 that is an OS of the in-vehicle device 1, and a plurality of applications that are managed by the H-operating system 109 and run on the H-operating system 109 I have.

Here, the in-vehicle device 1 includes a navigation application 110, an AR client application 111, and other applications 112 as applications running on the H-operating system 109.
Hereinafter, an augmented reality providing operation in such an augmented reality system will be described.
First, the augmented reality providing operation when the smartphone 2 is used alone without being connected to the in-vehicle device 1 will be described.
The AR application 212 of the smartphone 2 acquires the current position of the smartphone 2 from the GPS receiver 201, acquires the direction (the direction of the shooting direction) that the camera 208 of the smartphone 2 faces from the electronic compass 202, acquires the current position The designated position and the acquired azimuth are set as the designated azimuth, and an air tag information request accompanied by information on the designated position and the designated azimuth as designation information is issued to the AR server 4 via the mobile communication device.

On the other hand, the air tag information shown in FIG.
The air tag information includes coordinates associated with the air tag information, a genre, and provision information. The genre represents the genre of the facility at the coordinates to which the air tag information is related. The provided information is information regarding the facility at the coordinates to which the air tag information is related. The provided information can include a title and detailed information. As the detailed information, text, sound, an image, a moving image, or the like can be used. However, in the following, the case where the detailed information is text will be described as an example. Here, when the detailed information is text, a character string corresponding to a predetermined number of characters at the beginning of the text of the detailed information may be used as the title.

  When the AR server 4 receives the air tag information request from the smartphone 2, the AR server 4 is included in the area included in the field of view when the designated azimuth direction is viewed at a predetermined viewing angle from the designated position of the designated information accompanying the air tag information request. The air tag information in which coordinates within a predetermined distance from the designated position are registered is extracted and transmitted to the smartphone 2 as a response to the air tag information request.

  And the smart phone 2 which received air tag information memorize | stores air tag information in the memory | storage part 203. FIG. Then, as shown in FIG. 3b, the image taken by the camera 208 is displayed on the display 206, and the air tag information in which the coordinates in the area reflected in the image taken by the camera 208 are registered is read from the storage unit 203. The balloon 301 corresponding to each read air tag information is displayed on the video of the camera 208 that displays the title, and the title registered in the air tag information corresponding to the balloon 301 is displayed in each balloon 301. Here, each of the balloons 301 is provided so as to blow out from the position in the displayed image of the camera 208 where the coordinates registered in the air tag information corresponding to the balloon 301 are reflected.

  If any of the balloons 301 is selected by the user using the operation unit 205, detailed information 311 of the air tag information corresponding to the selected balloon 301 is displayed as shown in FIG. FIG. 3c shows that the balloon 301 of the title “DD store” in FIG. 3B is selected by the user and the detailed information 311 of the air tag information of the title “DD store” is displayed.

As described above, the augmented reality providing operation when the smartphone 2 is used alone without being connected to the in-vehicle device 1 has been described.
Next, an augmented reality providing operation when the smartphone 2 is connected to the in-vehicle device 1 and used will be described.
First, map data stored in the storage device 104 of the in-vehicle device 1 will be described.
As shown in FIG. 4, the map data includes management data describing production date and time of map data, basic map data representing a map, facility data, and a landmark graphic table.
The basic map data includes a road unit that represents a road network and a drawing unit that defines a display map.
Next, the road unit is data representing a road network, and has a node list and a link table.
Here, in the road unit, the road is expressed as a set of links that are straight lines, and the end point of each link is a node. The node list is data representing the coordinates of each node. The link table is data indicating identification of nodes at both ends of each link, distance and direction of each link, link cost that is a cost for route search given to each link, and the like.

Next, the drawing unit prescribes each character string to be displayed on the map such as a building name, a road name, and an intersection name, etc., which is a geographical display element of the map such as a terrain figure, a road figure, and a building figure It is data to be.
The facility data of the map data indicates information about each facility preset by the map data producer in the map data, and has a facility record provided for each facility. In each facility record, the facility name, the facility type indicating the type of facility such as a gas station / store / restaurant / hotel, the address of the facility, the telephone number of the facility, and the coordinates of the facility are registered. ing.

Further, as shown in FIG. 4, the landmark graphic table for map data includes an entry for each facility type. Each entry includes a corresponding facility type and a corresponding facility type on the map. Graphic data defining a graphic used as a landmark to be displayed is registered.
Next, operation | movement of the navigation application 110 of the vehicle-mounted apparatus 1 is demonstrated.
The navigation application 110 of the in-vehicle device 1 uses the map data recorded in the storage device 104, and uses the GPS receiver 101, the gyro sensor 102, and the vehicle speed sensor 103, and the current position of the own vehicle and the current position of the own vehicle. Calculate the forward direction. The navigation application 110 also accepts the setting of the destination from the user, the minimum cost method using the above-described link cost to the set destination using the map data recorded in the storage device 104, etc. Search for the route by.

  Further, the navigation application 110 accepts the setting of the facility type for displaying the landmark from the user, and sets the accepted facility type as the display target facility type. Here, acceptance of the setting of the facility type from the user may be accepted by designation of a classification for each use of the facility type such as “buy” and “eat”, for example, The facility type included in the designated major classification is set as the display target facility type.

  The navigation application 110 registers a mark indicating the current position and the current forward direction, a route to the destination, and a facility type that matches the set display target facility type on a map around the current position. The navigation screen showing the landmarks representing the facilities in the facility record is output.

  Here, as the landmark of each facility, a graphic defined by the graphic data registered in the facility type entry registered in the facility record of the facility in the landmark graphic table is used. Further, the landmark of each facility is displayed on the map at a position corresponding to the coordinates registered in the facility record of the facility.

  Here, FIGS. 5a1 and a2 show the navigation screen 500 output from the navigation application 110 in this way, and 501 in the figure shows a mark indicating the current position and the current forward direction. 5a1 shows the navigation screen 500 when all the facility types are set as the display target facility types, and FIG. 5a2 shows only the facility type “post office” and the facility type “financial institution” as the display target facility types. The navigation screen 500 when set is shown.

Next, the AR client application 111 of the in-vehicle device 1 performs an air tag information acquisition process and an air tag display process for providing augmented reality when the smartphone 2 is connected to the in-vehicle device 1 and used.
First, the air tag information acquisition process will be described.
FIG. 6a shows the procedure of the air tag information acquisition process.
As illustrated, in this process, the AR client application 111 acquires from the navigation application 110 the current position of the host vehicle and the current forward direction of the host vehicle calculated by the navigation application 110 as described above. (Step 602).

Then, an acquisition request for air tag information is issued to the AR application 212 of the smartphone 2 together with designation information in which the obtained current position is a designated position and the obtained current forward direction is a designated direction (step 604).
On the other hand, if the AR application 212 of the smartphone 2 receives the acquisition request of the air tag information from the AR client application 111 of the in-vehicle device 1, the AR tag 4 sends an air tag information request accompanying the designation information received together with the acquisition request of the air tag information to the AR server 4. As described above, the air tag information is acquired from the AR server 4, and the acquired air tag information is transmitted to the AR client application 111 of the in-vehicle apparatus 1 as a response to the acquisition request for the air tag information.

  When the AR client application 111 of the in-vehicle device 1 acquires the air tag information from the AR application 212 of the smartphone 2 in this way (step 606), the acquired air tag information is stored in the storage device 104 (step 608). Return to the process from step 602.

The air tag information acquisition process performed by the AR client application 111 of the in-vehicle device 1 has been described above.
Next, an air tag display process performed by the AR client application 111 of the in-vehicle device 1 will be described.
FIG. 6b shows the procedure of the air tag display process.
As shown in the figure, in this process, the AR client application 111 of the in-vehicle device 1 checks which of the camera mode and the navigation mode is set as the current operation mode (step 652).
Here, the user can arbitrarily set and switch the operation mode of the AR client application 111 to either the camera mode or the navigation mode.
When the camera mode is set, as shown in FIGS. 7a1 and b1, a camera image 700, which is an image taken by the front camera 107, is displayed as a main image on the display device 106 (step 654), and the camera When the mode is not set, that is, when the navigation mode is set, the above-described navigation screen 500 output from the navigation application 110 is displayed on the display device 106 as a main image as shown in FIGS. 8a1 and b1. (Step 656).

  Then, air tag information in which a genre corresponding to the currently set display object facility type is registered is extracted from the air tag information stored in the storage device 104 (step 658). Here, the genre corresponding to the display target facility type is a genre that is set to represent the same type as the type of the facility indicated by the facility type that is the display target facility type. Therefore, when the same classification is used as the facility type and the genre, the same genre as the facility type that is the display target facility type is a genre corresponding to the display target facility type. On the other hand, when the same classification is not used as the facility type and the genre, the relationship between the facility type and the genre corresponding to the facility type is set in advance.

  In addition, as described above, when the display target facility type is received from the user by specifying the facility type major classification as described above, the genre corresponding to the display target facility type corresponds to the designated major classification. The genre corresponding to the major classification may be a genre representing the classification or the same classification as the major classification or a genre included in the major classification. Also in this case, the relationship between the major classification and the genre corresponding to the major classification is set in advance.

  Next, among the air tag information stored in the storage device 104, the facility record in which the same facility type as the display target facility type currently set is registered from the air tag information not extracted in step 658. The air tag information in which the same coordinates as those registered in is registered is extracted (step 660). However, in step 660, the air tag information in which the coordinates of the facility where the landmark is currently arranged on the navigation screen 500 is registered may be extracted.

  However, the air tag information extracted in steps 658 and 660 is limited to the air tag information in which coordinates within the shooting range of the current front camera 107 are registered when the operation mode is the camera mode, and the operation mode is navigation. In the mode, the coordinates within the map range included in the navigation screen 500 are limited to the registered air tag information.

  Then, as shown in FIGS. 7 a 1, b 1, 8 a 1, b 1, the balloons 301 corresponding to the extracted air tag information are displayed on the displayed main image, and each balloon 301 corresponds to the balloon 301. The title registered in the air tag information is displayed (step 662). 7a1 shows the display when the camera mode is set as the operation mode and all the facility types are set as the display target facility type, and FIG. 7b1 shows the camera mode as the operation mode. The display shows a case where only the facility type “post office” and the facility type “financial institution” are set as the display target facility types. FIG. 8a1 shows the display when the navigation mode is set as the operation mode and all the facility types are set as the display object facility types, and FIG. 8b1 shows the navigation mode as the operation mode. The display shows a case where only the facility type “post office” and the facility type “financial institution” are set as the display target facility types.

  Here, when the operation mode is the camera mode, as shown in FIGS. 7a1 and b1, each balloon 301 is displayed as a main image in which coordinates registered in the air tag information corresponding to the balloon 301 are reflected. Provided to blow out from the position in the camera image 700. On the other hand, when the operation mode is the navigation mode, as shown in FIGS. 8 a 1 and b 1, each balloon 301 is included in the navigation screen corresponding to the coordinates registered in the air tag information corresponding to the balloon 301. Provide to blow out from the position on the map.

Then, it is checked whether or not switching of the operation mode has occurred (step 664). If switching has occurred, the process returns to step 652, and if not, the process returns to step 658. .
The air tag display process performed by the AR client application 111 of the in-vehicle device 1 has been described above.
Here, if any of the balloons 301 displayed by the air tag display process is selected by the user via the input device 105, the AR client application 111 of the in-vehicle device 1 will be shown in FIGS. As shown in FIGS. 8a2 and b2, the process of displaying the detailed information 311 of the air tag information corresponding to the selected balloon 301 is also performed. 7a2 and b2 show that the balloon 301 of the title “aaaa” in FIGS. 7a1 and b1 is selected by the user, and the detailed information 311 of the air tag information of the title “aaaa” is displayed. b2 represents that the balloon 301 of the title “gggg” in FIGS. 8a1 and b1 is selected by the user, and the detailed information 311 of the air tag information of the title “gggg” is displayed.

The embodiment of the present invention has been described above.
As described above, according to the present embodiment, the air tag of the genre corresponding to the display target facility type is used by using the display target facility type set by the user in order to select the landmark to be displayed in the navigation application 110. Only information and air tag information related to the facility of the display target facility type can be displayed. The display target facility type sets the facility type of the facility that the user is interested in, so that the user can immediately grasp the air tag information related to the facility that is interested.

  By the way, in the air tag display process performed by the AR client application 111 of the in-vehicle apparatus 1 described above, the air tag information in which the genre corresponding to the currently set display target facility type is registered, and the currently set display target facility type. Only the air tag information registered with the same coordinates registered in the facility record of the facility type of the same facility type is displayed on the main image, but the display of the air tag information on the main image is as follows You may make it carry out like this.

  That is, it is registered in the air tag information in which the genre corresponding to the currently set display target facility type is registered and in the facility record in which the same facility type as the currently set display target facility type is registered. Air tag information in which the same coordinates as the coordinates are registered is set as main air tag information.

  For example, as shown in FIGS. 9a1 and 9b, in which only the facility type “post office” and the facility type “financial institution” are set as display target facility types, all the air tag information is blown out 301. And the main air tag information balloon 301 (P) is displayed more emphasized than the other air tag information balloons 301. In the illustrated example, the balloon 301 of the main air tag information is emphasized by displaying the balloon 301 of other air tag information with lower brightness than the balloon 301 (P) of the main air tag information.

  Alternatively, as shown in FIGS. 9a2 and 9b, in which only the facility type “post office” and the facility type “financial institution” are set as display target facility types, the main air tag information is detailed information from the beginning. 311 may be displayed, and for other air tag information, a balloon 301 with a title may be displayed.

  By doing so, it is possible to highlight only the air tag information of the genre corresponding to the display target facility type and the air tag information related to the facility of the display target facility type. Therefore, even in this way, the user can immediately grasp the air tag information regarding the facility of interest.

Alternatively, the display of air tag information may be performed as follows when the navigation mode is set as the operation mode.
That is, as shown in FIG. 10a1 showing an example in which only the facility type “post office” and the facility type “financial institution” are set as the display target facility types, the coordinates registered in the main air tag information described above are shown. 10a2 is displayed in accordance with the user's selection operation of the landmark displayed in the highlighted form, in which the landmarks representing the facility whose coordinates are registered in the facility record are highlighted from the other landmarks. As described above, the detailed information 311 of the main air tag information in which the same coordinates as those registered in the facility record of the facility represented by the selected landmark may be displayed. In FIG. 10a1, by displaying the landmarks surrounded by a white frame, the same coordinates as those registered in the main air tag information are highlighted to represent the landmarks representing the facilities registered in the facility records. ing.

  By doing so, since the facility mark of the facility where the related air tag information exists is highlighted on the navigation screen, the user can immediately grasp that the air tag information related to the facility exists. The air tag information can be confirmed by an easy operation only by operating the facility mark.

  In the above embodiment, in the AR client application 111, the air tag information is acquired from the AR server 4 with the front direction of the vehicle as the designated direction. However, the shooting direction of the front camera 107 and the front direction of the vehicle are different. Alternatively, the air tag information may be acquired from the AR server 4 with the shooting direction of the front camera 107 as the designated direction.

Moreover, although the above embodiment demonstrated the case where both camera mode and navigation mode were provided as operation mode, you may make it perform only one of camera mode and navigation mode as operation mode.
In this case, when only the camera mode is provided as the operation mode, the air tag information is acquired from the AR server 4 with the shooting direction of the front camera 107 as the designated direction. When only the navigation mode is provided as the operation mode, the air tag information is acquired from the AR server 4 with the forward direction of the automobile as the designated direction. When only the navigation mode is provided as the operation mode, the function of the AR client application 111 may be provided as the function of the navigation application 110.

In addition, the AR client application 111 may directly access the AR server 4 and acquire the air tag information by using only the communication function of the smartphone 2 without providing the AR application 212 in the smartphone 2.
In addition, the above embodiment can be similarly applied to a case where an arbitrary portable device including the AR application 212 such as a mobile phone, a PDA, a portable game machine, or a portable player is used instead of the smartphone 2.

  DESCRIPTION OF SYMBOLS 1 ... In-vehicle device, 2 ... Smartphone, 3 ... Mobile communication network, 4 ... AR server, 101 ... GPS receiver, 102 ... Gyro sensor, 103 ... Vehicle speed sensor, 104 ... Storage device, 105 ... Input device, 106 ... Display Device 107 107 Front camera 108 Device interface 109 H-Operating system 110 Navigation application 111 AR client application 201 GPS receiver 202 Electronic compass 203 Storage unit 204 Mobile communication Device 205 ... Operation unit 206 ... Display 207 Sound input / output unit 208 Camera 209 Host interface 210 SP-operating system 211 Mobile phone application 212 AR application 301 Callout 500 ... navigation screen, 700 ... camera image.

Claims (20)

In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. An in-vehicle system installed in a car that accesses a server
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A camera for photographing the outside of the car;
A shooting direction calculation unit that calculates the shooting direction of the camera;
The air tag information request is issued to the server with the current position of the vehicle calculated by the current position calculation unit as a specified position and the shooting direction of the camera calculated by the shooting direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
Of the air tag information acquired by the air tag information acquisition unit, the air tag information related to the genre corresponding to the display target facility type is associated with the air tag information on the captured image acquired by the camera. And an augmented reality image display unit for displaying an image arranged at a position corresponding to the vehicle-mounted system. Accessing a server that provides air tag information related to a point in an area observed when observing the designated azimuth direction from the designated azimuth according to an air tag information request designating a designated position and designated azimuth; An in-vehicle system installed in an automobile,
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A camera for photographing the outside of the car;
A shooting direction calculation unit that calculates the shooting direction of the camera;
The air tag information request is issued to the server with the current position of the vehicle calculated by the current position calculation unit as a specified position and the shooting direction of the camera calculated by the shooting direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
Of the air tag information acquired by the air tag information acquisition unit, air tag information associated with a location corresponding to the facility position registered in the facility information of the facility where the facility mark is arranged on the navigation screen, An in-vehicle system, comprising: an augmented reality image display unit that displays an image arranged at a position corresponding to a point associated with the air tag information on a photographed image photographed by the camera. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. An in-vehicle system installed in a car that accesses a server
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A camera for photographing the outside of the car;
A shooting direction calculation unit that calculates the shooting direction of the camera;
The air tag information request is issued to the server with the current position of the vehicle calculated by the current position calculation unit as a specified position and the shooting direction of the camera calculated by the shooting direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
The air tag information acquired by the air tag information acquisition unit is related to the genre corresponding to the display target facility type at a position corresponding to the point where the air tag information is related on the captured image captured by the camera. An in-vehicle system comprising: an augmented reality image display unit that displays an image arranged in a form that is more emphasized than other air tag information. Accessing a server that provides air tag information related to a point in an area observed when observing the designated azimuth direction from the designated azimuth according to an air tag information request designating a designated position and designated azimuth; An in-vehicle system installed in an automobile,
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A camera for photographing the outside of the car;
A shooting direction calculation unit that calculates the shooting direction of the camera;
The air tag information request is issued to the server with the current position of the vehicle calculated by the current position calculation unit as a specified position and the shooting direction of the camera calculated by the shooting direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
The air tag information acquired by the air tag information acquisition unit is the position of the facility where the facility mark is arranged on the navigation screen at a position corresponding to the point where the air tag information is related on the captured image captured by the camera. About the air tag information related to the point corresponding to the facility position registered in the facility information, it has an augmented reality image display unit that displays an image arranged in a form emphasized over other air tag information. A featured in-vehicle system. The in-vehicle system according to claim 1, 2, 3, or 4,
Among the air tag information acquired by the air tag information acquisition unit, the air tag information related to the genre corresponding to the display target facility type is displayed on the navigation screen on the map included in the navigation screen. An in-vehicle system, comprising: a navigation screen display unit that displays an image arranged at a position corresponding to a point related to the. The in-vehicle system according to claim 1, 2, 3, or 4,
Of the air tag information acquired by the air tag information acquisition unit, air tag information associated with a location corresponding to the facility position registered in the facility information of the facility where the facility mark is arranged on the navigation screen, An in-vehicle system, comprising: a navigation screen display unit that displays an image arranged at a position corresponding to a point associated with the air tag information on a map included in the navigation screen on the navigation screen. The in-vehicle system according to claim 1, 2, 3, or 4,
The air tag information acquired by the air tag information acquisition unit corresponds to the display target facility type at a position on the navigation screen corresponding to a point where the air tag information is related on a map included in the navigation screen. An in-vehicle system comprising: a navigation screen display unit that displays images arranged in a form emphasized over other air tag information for air tag information related to a genre. The in-vehicle system according to claim 1, 2, 3, or 4,
The facility mark is displayed on the navigation screen at a position corresponding to a point where the air tag information is associated on the map included in the navigation screen on the navigation screen. For the air tag information related to the point corresponding to the facility position registered in the facility information of the facility that is arranged, a navigation screen display unit that displays an image arranged in a more emphasized form than other air tag information An in-vehicle system characterized by comprising: The in-vehicle system according to claim 1, 2, 3, or 4,
An air tag information display section,
The navigation unit uses the facility tag of the facility information in which the position corresponding to the point associated with the air tag information acquired by the air tag information acquisition unit is registered as the facility position among the facility marks arranged on the navigation screen. As the facility with information, the facility mark representing the facility with the air tag information is arranged in a form emphasized over other facility marks, and the navigation screen is generated and displayed.
The air tag information display unit is associated with a point corresponding to a facility position registered in the facility information of the facility with the air tag information in response to a user operation on the facility mark representing the facility with the air tag information. An in-vehicle system characterized by displaying. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. An in-vehicle system installed in a car that accesses a server
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A forward direction calculation unit for calculating an azimuth in the forward direction of the automobile;
The air tag information request is issued to the server with the current position calculated by the current position calculation unit as a specified position and the forward direction of the vehicle calculated by the forward direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
Among the air tag information acquired by the air tag information acquisition unit, the air tag information related to the genre corresponding to the display target facility type is displayed on the navigation screen on the map included in the navigation screen. And a navigation screen display unit for displaying an image arranged at a position corresponding to the point related to the vehicle-mounted system. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. An in-vehicle system installed in a car that accesses a server
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A forward direction calculation unit for calculating an azimuth in the forward direction of the automobile;
The air tag information request is issued to the server with the current position calculated by the current position calculation unit as a specified position and the forward direction of the vehicle calculated by the forward direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
Of the air tag information acquired by the air tag information acquisition unit, air tag information associated with a location corresponding to the facility position registered in the facility information of the facility where the facility mark is arranged on the navigation screen, An in-vehicle system, comprising: a navigation screen display unit that displays an image arranged at a position corresponding to a point associated with the air tag information on a map included in the navigation screen on the navigation screen. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. An in-vehicle system installed in a car that accesses a server
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A forward direction calculation unit for calculating an azimuth in the forward direction of the automobile;
The air tag information request is issued to the server with the current position calculated by the current position calculation unit as a specified position and the forward direction of the vehicle calculated by the forward direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
The air tag information acquired by the air tag information acquisition unit corresponds to the display target facility type at a position on the navigation screen corresponding to the point where the air tag information is related on the map included in the navigation screen. An in-vehicle system comprising: a navigation screen display unit that displays images arranged in a form emphasized over other air tag information for air tag information related to a genre. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. An in-vehicle system installed in a car that accesses a server
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A forward direction calculation unit for calculating an azimuth in the forward direction of the automobile;
The air tag information request is issued to the server with the current position calculated by the current position calculation unit as a specified position and the forward direction of the vehicle calculated by the forward direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
The facility tag is displayed on the navigation screen at a position corresponding to the point where the air tag information is associated on the map included in the navigation screen on the navigation screen. For the air tag information related to the point corresponding to the facility position registered in the facility information of the facility where the is placed, a navigation screen display that displays an image arranged in a form emphasized over other air tag information The vehicle-mounted system characterized by having a part. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. An in-vehicle system installed in a car that accesses a server
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A forward direction calculation unit for calculating an azimuth in the forward direction of the automobile;
The air tag information request is issued to the server with the current position calculated by the current position calculation unit as a specified position and the forward direction of the vehicle calculated by the forward direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
An air tag information display section,
The navigation unit uses the facility tag of the facility information in which the position corresponding to the point associated with the air tag information acquired by the air tag information acquisition unit is registered as the facility position among the facility marks arranged on the navigation screen. As the facility with information, the facility mark representing the facility with the air tag information is arranged in a form emphasized over other facility marks, and the navigation screen is generated and displayed.
The air tag information display unit is associated with a point corresponding to a facility position registered in the facility information of the facility with the air tag information in response to a user operation on the facility mark representing the facility with the air tag information. An in-vehicle system characterized by displaying. An in-vehicle system according to claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13 or 14.
The in-vehicle system can connect a portable device having a communication function,
The air tag information acquisition unit accesses the server via the portable device. An in-vehicle system according to claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13 or 14.
The in-vehicle system can connect a built-in camera and a portable device having an augmented reality providing function,
The augmented reality providing function issues, to the server, issues the air tag information request that designates the current position of the portable device as the designated position and designates the orientation of the shooting direction of the built-in camera as the designated orientation. A function of acquiring the air tag information from the server and displaying the augmented reality image in which the acquired air tag information is arranged at a position corresponding to the point where the air tag information is related on the captured image captured by the built-in camera. Yes,
The air tag information acquisition unit issues the air tag information request to the server via the augmented reality providing function of the portable device, and from the server to the mobile device, in response to the issued air tag information request. An in-vehicle system that acquires air tag information provided to an augmented reality providing function. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. A computer program that is read and executed by a computer equipped with a camera for photographing the outside of the automobile,
The computer,
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A shooting direction calculation unit that calculates the shooting direction of the camera;
The air tag information request is issued to the server with the current position of the vehicle calculated by the current position calculation unit as a specified position and the shooting direction of the camera calculated by the shooting direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
Of the air tag information acquired by the air tag information acquisition unit, the air tag information related to the genre corresponding to the display target facility type is associated with the air tag information on the captured image acquired by the camera. A computer program that functions as an augmented reality image display unit that displays an image arranged at a position corresponding to the. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. A computer program that is read and executed by a computer equipped with a camera for photographing the outside of the automobile,
The computer,
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A shooting direction calculation unit that calculates the shooting direction of the camera;
The air tag information request is issued to the server with the current position of the vehicle calculated by the current position calculation unit as a specified position and the shooting direction of the camera calculated by the shooting direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
Of the air tag information acquired by the air tag information acquisition unit, air tag information associated with a location corresponding to the facility position registered in the facility information of the facility where the facility mark is arranged on the navigation screen, A computer program that functions as an augmented reality image display unit that displays an image arranged at a position corresponding to a point associated with the air tag information on a photographed image photographed by the camera. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. A computer program that is read and executed by a computer installed in an automobile, accessing a server
The computer,
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A forward direction calculation unit for calculating an azimuth in the forward direction of the automobile;
The air tag information request is issued to the server with the current position calculated by the current position calculation unit as a specified position and the forward direction of the vehicle calculated by the forward direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
Among the air tag information acquired by the air tag information acquisition unit, the air tag information related to the genre corresponding to the display target facility type is displayed on the navigation screen on the map included in the navigation screen. A computer program that functions as a navigation screen display unit that displays an image arranged at a position corresponding to a point associated with the. In response to an air tag information request specifying a specified position and a specified direction, air tag information related to a point in the area observed when the specified direction is observed from the specified direction and the genre of the point is provided. A computer program that is read and executed by a computer installed in an automobile, accessing a server
The computer,
A storage unit that stores facility information registered for each facility, the facility type indicating the type of the corresponding facility and the facility position indicating the position of the corresponding facility, and map data representing the map; ,
A current position calculating unit for calculating a current position of the automobile;
On the map represented by the map data, a facility in which the current position mark indicating the current position calculated by the current position calculation unit and the facility type set as the display target facility type by the user are registered in the facility information A navigation unit that generates a navigation screen in which facility marks represented on a map are arranged;
A forward direction calculation unit for calculating an azimuth in the forward direction of the automobile;
The air tag information request is issued to the server with the current position calculated by the current position calculation unit as a specified position and the forward direction of the vehicle calculated by the forward direction calculation unit as the specified direction. And an air tag information acquisition unit for acquiring air tag information provided from the server in response to the issued air tag information request,
Of the air tag information acquired by the air tag information acquisition unit, air tag information associated with a location corresponding to the facility position registered in the facility information of the facility where the facility mark is arranged on the navigation screen, A computer program that functions as a navigation screen display unit that displays an image arranged at a position corresponding to a point associated with the air tag information on a map included in the navigation screen on the navigation screen.