JP5702476B2 - Display device, control method, program, storage medium - Google Patents

Description

  The present invention relates to a technique for displaying information.

  2. Description of the Related Art Conventionally, a navigation apparatus is known in which a camera that captures a traveling direction is installed on a vehicle and guidance is performed using a real image acquired from the camera. For example, Patent Document 1 discloses a technique for displaying navigation information (guidance information) in a superimposed manner on a landscape image in front of the vehicle.

JP 2008-020288 A

  When superimposing a CG (Computer Graphics) image representing guidance information such as a guidance route on a live-action image, a display corresponding to a road or the like that is actually shielded by a building and is not visible is displayed superimposed on the live-action image. In this case, there is a problem that the sense of depth is lost by superimposing the CG image on the photographed image, and the user has difficulty grasping the sense of distance between the building and the road corresponding to the CG image.

  The present invention has been made to solve the above-described problems, and a display device capable of appropriately maintaining a sense of depth even when guidance information is superimposed and displayed on a live-action image and its display The main purpose is to provide a control method and a program.

The invention according to claim 1, a display device for displaying by superimposing the guidance information to the photographed image, specifying means for specifying the overlapping portion of the tangible before SL in the guidance information with the photographed image, wherein Display control means for superimposing and displaying the guidance information excluding the shielding part on which the tangible object should be displayed in front of the guidance information among the superimposed information, and the display control It means a mark indicating the facility within the photographed image, and displaying by superimposing on the photographed image as the guidance information, the display control means, out of the mark, the mark as a mark for route guidance The display is performed by excluding the shielding portion, and marks other than the mark serving as a mark for the route guidance are displayed without excluding the shielding portion .

The invention according to claim 6, a control method of the display device performs displaying by superimposing the guidance information to the photographed image, identifying the overlapping portion of the pre-Symbol guidance information and tangible in said photographed image And a display control step of displaying the guidance information excluding the shielding portion where the tangible object is to be displayed in front of the guidance information in the superimposition portion so as to be superimposed on the photographed image. In the display control step, a mark indicating the facility in the live-action image is displayed as the guidance information superimposed on the live-action image, and the display control step includes a route guidance mark of the mark. for made mark, the display by excluding the shielding portion, the mark other than a mark serves as a mark of the route guidance, and displaying without excluding the shielding portion.

The invention according to claim 7, a program display unit executes the display by superimposing the guidance information to the photographed image, to identify the overlapping portion of the pre-Symbol guidance information and tangible in said photographed image specification And the display device as display control means for displaying the guidance information excluding the shielding portion where the tangible object is to be displayed in front of the guidance information among the superimposed information, and superimposing it on the photographed image. The display control means displays a mark indicating the facility in the live-action image superimposed on the live-action image as the guide information, and the display control means includes a route guidance mark among the marks. for mark serving as the display by excluding the shielding portion, the mark other than a mark serves as a mark of the route guidance, and displaying without excluding the shielding portion

It is a schematic structure of a navigation apparatus. It is a flowchart which shows the process sequence of a present Example. (A) It is an example of the real image image which the camera image | photographed. (B) This is an example in which a guide route is superimposed and displayed on a live-action image. It is an example of a display concerning a comparative example. It is an example of a display concerning a modification.

  In one preferred embodiment of the present invention, there is provided a display device that superimposes and displays guidance information on a real image photographed by a camera, the photographing position, position information of a building existing in the photographing range of the camera, and Based on the house shape information and the location information of the facility or road corresponding to the guidance information, the specifying means for identifying a superimposed portion of the guidance information and the building in the live-action image, and the guidance information of the superimposed portion Display control means for displaying the guidance information excluding the part where the building should be displayed on the front side, superimposed on the photographed image.

  The display device is, for example, a navigation device, and displays guidance information superimposed on a real image taken by a camera. The display device includes a specifying unit and a display control unit. Based on the shooting position, the position information of the building and the house shape information existing in the shooting range of the camera, and the position information of the facility or road corresponding to the guidance information, the specifying means Specify the overlapping part. The display control means superimposes and displays the guidance information excluding the shielding portion where the building should be displayed in front of the guidance information, in the superimposition portion.

  In general, when guidance information is superimposed on a live-action image, the sense of depth is lost if guidance information corresponding to a road or facility that is actually shielded by a building is not visible. . In consideration of the above, the above-described display device superimposes and displays on the live-action image, excluding the shielding information where the building should be displayed on the front side of the guidance information. In this way, the display device can maintain a sense of depth even when the photographed image and the guidance information are superimposed.

  In one aspect of the display device, the specifying unit renders the building substantially transparent based on the location information and house shape information of the building, and draws the guidance information based on the location information of the facility or road. Thus, the superimposed portion is specified, and the display control means generates a composite image combining the building drawn substantially transparently and the guidance information excluding the shielding portion, and the composite image is taken as the actual image. Overlay the image. According to this aspect, the display device can preferably specify the overlapping portion between the photographed image and the guidance information. In addition, the display device draws the building substantially transparent, so that the display of the building drawn to exclude the shielding portion of the guidance information remains even when the composite image is superimposed on the live-action image. Can be prevented.

  In another aspect of the display device, when generating the composite image, the display control unit draws a substantially transparent building prior to the guidance information, and then, other than the shielding portion of the overlapping portion. For this part, color mixing processing of the building drawn substantially transparent and the guidance information is performed. According to this aspect, the display device can preferably generate a composite image representing the guidance information excluding the shielding portion.

  In another aspect of the display device, the display control unit displays a route on which the moving body should travel as being superimposed on the photographed image as the guidance information. According to this aspect, the display device can preferably hide the portion of the guide route to be displayed that is blocked by the building, and can maintain a sense of depth even when the guide information is superimposed on the photographed image. .

  In another aspect of the above display device, the display control means displays the route display upside down at a position above the road corresponding to the route. Also according to this aspect, the display device can suitably hide the portion of the guide route to be displayed that is blocked by the building, and can maintain a sense of depth even when the guide information is superimposed on the photographed image. it can.

  In another aspect of the display device, the display control unit displays a mark indicating the facility on the position corresponding to the facility in the photographed image as the guide information superimposed on the photographed image. According to this aspect, even if the display device is a mark representing a facility, a portion shielded by a building existing in front of the facility can be suitably hidden.

  In another aspect of the display device, the display control unit excludes the shielding portion only for the mark attached to the facility in the live-action image serving as a guide for route guidance. indicate. By doing in this way, the user can grasp | ascertain correctly, without misidentifying the position of the plant | facility used as a mark at the time of a driving | operation.

  In another preferred embodiment of the present invention, there is provided a display device that displays guidance information superimposed on a live-action image photographed by a camera, wherein the live-action image includes a first building image and the first building image. And a second building image that is an image of a building located far from the camera, and displaying the guidance information indicating a route between the first building image and the second building image in the live-action image The guide information is displayed on the camera side with respect to the second building image in the live-action image, and the first building image is displayed on the camera side while blocking part of the guide information. It is characterized by. Even in this aspect, the display device can suitably maintain the sense of depth when the photographed image and the guidance information are superimposed.

  In one aspect of the display device, the display control unit causes the first building image to be displayed superimposed on the guidance information. According to this aspect, the display device can display the first building image in front of the guidance information, and can preferably maintain a feeling of depth.

  In another preferred embodiment of the present invention, there is provided a control method executed by a display device that superimposes and displays guidance information on a real image taken by a camera, and is present in a shooting position and a shooting range of the camera. Based on the location information and house shape information of the building, and the location information of the facility or road corresponding to the guidance information, a specifying step of identifying a superimposed portion of the guidance information and the building in the live-action image, A display control step of displaying the guidance information excluding the shielding portion on which the building is to be displayed on the front of the guidance information in a superimposed manner on the photographed image. By using this control method, the display device can favorably maintain the sense of depth even when the photographed image and the guidance information are superimposed.

  In another preferred embodiment of the present invention, there is provided a display method for displaying guidance information superimposed on a real image taken by a camera, wherein the real image is a first building image and the first building image. And a second building image that is an image of a building located far from the camera, and displaying the guidance information indicating a route between the first building image and the second building image in the live-action image The guide information is displayed on the camera side with respect to the second building image in the live-action image, and the first building image is displayed on the camera side while blocking part of the guide information. A display control step characterized by the above. Even when this display method is used, the display device can suitably maintain the sense of depth when the photographed image and the guidance information are superimposed.

  In another preferred embodiment of the present invention, there is provided a program executed by a display device that displays guidance information superimposed on a photographed image taken by a camera, wherein the building is located at a shooting position and a shooting range of the camera. Identifying means for identifying a superimposed portion of the guidance information and the building in the live-action image based on the location information and the house shape information of the facility and the location information of the facility or road corresponding to the guidance information, The display device is caused to function as display control means for displaying the guidance information excluding the shielding portion where the building should be displayed in front of the guidance information so as to be superimposed on the photographed image. By executing this program, the display device can preferably maintain a sense of depth even when the photographed image and the guidance information are superimposed. Preferably, the program is stored in a storage medium.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[Configuration of navigation device]
FIG. 1 shows the configuration of the navigation device 1. As shown in FIG. 1, the navigation device 1 includes a self-supporting positioning device 10, a GPS receiver 18, a system controller 20, a disk drive 31, a data storage unit 36, a communication interface 37, a communication device 38, an interface 39, and a display unit 40. , An audio output unit 50, an input device 60, and a camera 61. The navigation device 1 shall superimpose and display a guidance route for arriving at the destination on the photographed image acquired from the camera 61 in accordance with the set destination for the driver of the vehicle.

  The autonomous positioning device 10 includes an acceleration sensor 11, an angular velocity sensor 12, and a distance sensor 13. The acceleration sensor 11 is made of, for example, a piezoelectric element, detects vehicle acceleration, and outputs acceleration data. The angular velocity sensor 12 is composed of, for example, a vibrating gyroscope, detects the angular velocity of the vehicle when the direction of the vehicle is changed, and outputs angular velocity data and relative azimuth data. The distance sensor 13 measures a vehicle speed pulse composed of a pulse signal generated with the rotation of the vehicle wheel.

  The GPS receiver 18 receives radio waves 19 carrying downlink data including positioning data from a plurality of GPS satellites. The positioning data is used to detect the absolute position of the vehicle (hereinafter also referred to as “current position”) from latitude and longitude information.

  The system controller 20 includes an interface 21, a CPU (Central Processing Unit) 22, a ROM (Read Only Memory) 23, and a RAM (Random Access Memory) 24, and controls the entire navigation apparatus 1.

  The interface 21 performs an interface operation with the acceleration sensor 11, the angular velocity sensor 12, the distance sensor 13, and the GPS receiver 18. From these, vehicle speed pulses, acceleration data, relative azimuth data, angular velocity data, GPS positioning data, absolute azimuth data, and the like are input to the system controller 20. The CPU 22 controls the entire system controller 20. The ROM 23 includes a nonvolatile memory (not shown) in which a control program for controlling the system controller 20 is stored. The RAM 24 stores various data such as route data preset by the user via the input device 60 so as to be readable, and provides a working area to the CPU 22.

  A system controller 20, a disk drive 31 such as a CD-ROM drive or a DVD-ROM drive, a data storage unit 36, a communication interface 37, a display unit 40, an audio output unit 50, and an input device 60 are mutually connected via a bus line 30. It is connected to the.

  The disk drive 31 reads and outputs content data such as music data and video data from a disk 33 such as a CD or DVD under the control of the system controller 20. The disk drive 31 may be either a CD-ROM drive or a DVD-ROM drive, or may be a CD and DVD compatible drive.

  The data storage unit 36 is configured by, for example, an HDD and stores various data used for navigation processing such as map data. The map data includes road data and facility information. The facility information includes, in addition to the name of each facility and the position information of each facility, information related to the shape of the building (so-called house shape information) when the facility is a building. The house shape information includes, for example, information such as a building location range and height. The house shape information is used for displaying a city map or the like by a CG image, or used for determining the depth of a guide route for a building to be described later.

  The communication device 38 includes, for example, an FM tuner, a beacon receiver, a cellular phone, a dedicated communication card, and the like, and information distributed from a VICS (Vehicle Information Communication System) center (hereinafter referred to as “VICS information”). Is obtained from the radio wave 39. The interface 37 performs an interface operation of the communication device 38 and inputs the VICS information to the system controller 20 or the like.

  The display unit 40 displays various display data on a display device such as a display under the control of the system controller 20. Specifically, the system controller 20 reads map data from the data storage unit 36. The display unit 40 displays the map data read from the data storage unit 36 by the system controller 20 on the display screen. The display unit 40 includes a graphic controller 41 that controls the entire display unit 40 based on control data sent from the CPU 22 via the bus line 30 and a memory such as a VRAM (Video RAM), and can display image information that can be displayed immediately. A buffer memory 42 that temporarily stores, a display control unit 43 that controls display of a display 44 such as a liquid crystal display or a CRT (Cathode Ray Tube) based on image data output from the graphic controller 41, and a display 44 are provided. . The display 44 functions as an image display unit, and includes, for example, a liquid crystal display device having a diagonal size of about 5 to 10 inches and is mounted near the front panel in the vehicle.

  The audio output unit 50 performs D / A (Digital to Analog) conversion of audio digital data sent from the CD-ROM drive 31, DVD-ROM 32, RAM 24, or the like via the bus line 30 under the control of the system controller 20. A D / A converter 51 to perform, an amplifier (AMP) 52 that amplifies the audio analog signal output from the D / A converter 51, and a speaker 53 that converts the amplified audio analog signal into sound and outputs the sound into the vehicle. It is prepared for.

  The input device 60 includes keys, switches, buttons, a remote controller, a voice input device, and the like for inputting various commands and data. The input device 60 is disposed around the front panel and the display 44 of the main body of the in-vehicle electronic system mounted in the vehicle. When the display 44 is a touch panel system, the touch panel provided on the display screen of the display 44 also functions as the input device 60.

  The camera 61 is an optical machine that has a certain angle of view and photographs a subject within the angle of view. In the present embodiment, the camera 61 is directed to the front of the vehicle and is placed at a position where the road on which the vehicle travels can be imaged. Then, the camera 61 generates an image (referred to as “actual image”) at predetermined intervals and supplies it to the system controller 20.

[Guidance route display method]
Next, a guide route display method performed by the system controller 20 will be described. Schematically, the system controller 20 superimposes and displays an image excluding a portion of the guidance route that is blocked by a building in front and cannot be seen by the driver (also referred to as a “blocking portion”) on the actual image. As a result, the system controller 20 maintains the sense of depth even when the guidance route is superimposed on the photographed image, and allows the driver to accurately grasp the sense of distance.

  This process will be specifically described with reference to FIG. FIG. 2 is an example of a flowchart illustrating a processing procedure according to the present embodiment. The system controller 20 repeatedly executes the processing of the flowchart shown in FIG. 2 every time a photographed image is received from the camera 61, for example. Note that the processing procedure shown in FIG. 2 conforms to the processing procedure of general computer graphics software such as OpenGL (registered trademark) and DirectX (registered trademark), and can be suitably executed by these software. is there. In the following, “mixing (blending) processing” refers to processing for mixing the color of the pixel to be drawn on the pixel being drawn.

  First, the system controller 20 reads house shape information and the like from the data storage unit 36 (step S101). Specifically, first, the system controller 20 specifies the shooting range of the camera 61 based on the current position recognized by the GPS receiver 18. At this time, for example, the system controller 20 specifies a predetermined range as the imaging range from the current position toward the traveling direction of the vehicle. The predetermined range is determined in advance in consideration of, for example, the installation position, installation direction, angle of view, and the like of the camera 61. Next, the system controller 20 refers to the map data to identify a building that exists within the shooting range, and reads the house shape information and position information of the identified building from the map data.

  Next, the system controller 20 draws a transparent polygon representing a building in the three-dimensional coordinate space, and then draws a guide route (step S102). Specifically, first, the system controller 20 generates a three-dimensional coordinate space corresponding to the photographing range with the own vehicle position as the viewpoint, and arranges the polygon generated from the house shape information in the three-dimensional coordinate space. Thereafter, the system controller 20 draws the guidance route at a position overlapping the road on the guidance route. In other words, the system controller 20 determines whether the guidance route is at the same depth as the road corresponding to the guidance route, that is, whether it is the front or the back of an arbitrary building. Draw at the position.

  Next, the system controller 20 performs processing (ie, rasterization) for converting the building and guide route drawn in the three-dimensional coordinate space into position information and color information in units of pixels (step S103). Specifically, the system controller 20 generates a raster image in which a three-dimensional coordinate space in which a polygon representing a building and a guide route are drawn is projected from the position of the camera 61 in the shooting direction. At this time, the system controller 20 first draws the building display for the part where the building polygon and the guidance route overlap, and then further displays the guidance route display in the depth determination process in step S104 described later. Judge whether to do. If the system controller 20 determines that the guidance route should be drawn by the depth determination process, the system controller 20 performs a mixing process in step S105.

  Next, the system controller 20 performs a depth determination process (so-called depth test) that determines a drawing target portion and a non-drawing target portion of the guide route (step S104). Specifically, the system controller 20 determines whether the display of the building and the display of the guidance route overlap for each rasterized pixel. When the display of the building and the display of the guidance route do not overlap, the system controller 20 sets the guidance route as a drawing target in the processing target pixel.

  On the other hand, when the system controller 20 determines that the display of the building and the display of the guidance route overlap in the processing target pixel, the system controller 20 further determines whether or not the display of the building is behind the display of the guidance route. To do. When the building display is behind the guide route display, the system controller 20 sets the guide route as the drawing target in the processing target pixel. On the other hand, when the display of the building is in front of the display of the guidance route, the system controller 20 excludes the display of the guidance route from the drawing target in the processing target pixel. Thereby, the part shielded by the building in the guidance route is excluded from the drawing target.

  As described above, the system controller 20 preferably performs the depth determination process before the mixing process in step S105 described later, so that, even when the polygon representing the building is drawn transparently, the rear side of the polygon is preferably displayed. Can be excluded from the drawing target.

  Next, the system controller 20 performs a mixing (blending) process (step S105). Specifically, the system controller 20 performs the mixing process of the drawing target portion of the guidance route designated as the drawing target in the depth determination process on the image on which the transparent building has already been drawn. Here, since the display color of the building is designated as transparent, as a result, the system controller 20 generates an image in which only the drawing target portion of the guidance route is displayed.

  Then, the system controller 20 superimposes the CG image (composite image) obtained by the mixing process on the photographed image and displays it on the display 44 (step S106). In other words, the system controller 20 displays the CG image on the display 44 using the photographed image as the background image. As a result, the system controller 20 can suitably hide the portion that is blocked by the building after the guidance route, and maintains a sense of depth even when the CG image and the live-action image are superimposed. The driver can get a sense of distance.

[Display example]
Next, with reference to FIGS. 3A and 3B, the display mode of the guidance route according to the present embodiment will be specifically described. FIG. 3A shows a real image captured by the camera 61 while the vehicle is traveling, and FIG. 3B shows an image obtained by superimposing a guide route 46 that is a CG image on the real image.

  In this case, as shown in FIG. 3B, the system controller 20 displays on the display 44 a guide route 46 indicating that the vehicle should turn left at the intersection 47. Specifically, the system controller 20 draws a curve having a thickness corresponding to the road width as a guide route 46 at a position overlapping with the road to be traveled. At this time, the system controller 20 excludes the shielding portions by the polygons of the buildings 45A to 45C according to the processing shown in FIG. 2 based on the house shape information and position information of the buildings 45A to 45C, the position information of the road 48, and the like. The guide route 46 is superimposed on the photographed image.

  Here, the road 48 on the guide route on which the vehicle travels after passing through the intersection 47 exists behind the buildings 45 </ b> A to 45 </ b> C with respect to the viewpoint of the camera 61. As a result, in the live-action image shown in FIG. 3A, a part of the road 48 is hidden by the buildings 45A to 45C and is not displayed. Correspondingly, in the guide route 46 shown in FIG. 3B, the overlapping portions with the buildings 45A to 45C are not displayed in the same manner as the road 48 of the photographed image. Thereby, the user can easily grasp that the road in the back such as the building 45A should be turned left, and can accurately grasp the positional relationship between the road to be turned right and left and the adjacent building. .

  FIG. 4 shows a display according to a comparative example in which a CG image of the guidance route is generated and superimposed on the actual image without considering the positional relationship between the building and the guidance route. As shown in FIG. 4, in the comparative example, some of the buildings 45A to 45C are overlapped by the guide route 46x. As a result, the user cannot intuitively grasp whether the left turn road 48B exists on the front side or the back side of the building 45A or the like. As described above, in the comparative example shown in FIG. 4, the sense of depth is lost by superimposing the CG image and the real image.

  In consideration of the above, in the present embodiment, the system controller 20 performs depth determination processing of the polygons that virtually draw each building and the display of the guide route, and does not display the shielding portion of the guide route by the polygon of the building. And Thereby, the system controller 20 suitably prevents the sense of depth from being lost even when the CG image and the real image are superimposed.

[Modification]
Hereinafter, modified examples suitable for the above-described embodiments will be described. The following modifications may be applied in any combination to the above-described embodiments.

(Modification 1)
The display mode of the guidance route to which the present invention is applicable is not limited to the display mode that is superimposed on the road scheduled to travel as shown in FIG. Instead, the system controller 20 may display the guidance route display at a different position without overlapping the road corresponding to the guidance route.

  FIG. 5 shows a display example of the guidance route according to the modification. As shown in FIG. 5, the system controller 20 displays the guide route 46y by turning it upside down at a position above the planned road. In this case, when the system controller 20 draws the guidance route 46y in the three-dimensional coordinate space in step S102 of FIG. 2, the guidance route 46y is above the road corresponding to the guidance route 46y by a predetermined distance. , Drawing at the same depth as the road. As a result, as shown in FIG. 5, the system controller 20 displays the guide route 46 y so that the portion overlapping the building 45 </ b> A existing in front of the road 48 is hidden.

  Therefore, even with the display mode shown in FIG. 5, the user can easily recognize that the road on the back of the building 45A should be turned to the left, and accurately determine the positional relationship between the road to be turned to the right and the left and the building. I can grasp it.

(Modification 2)
The target for hiding the shielding part by the building is not limited to the guide route. Instead of this, or in addition to this, the navigation apparatus 1 may also hide the portion shielded by the building for the guidance information other than the guidance route. Here, “guidance information” refers to information to be visually recognized by the driver to assist driving, for example, a mark indicating the facility attached to a position corresponding to the facility (also referred to as “facility mark”). , Facilities such as towers that serve as landmarks (landmarks), and traffic lines displayed along congested roads.

  For example, when displaying the facility mark of the facility within the shooting range of the camera 61, the system controller 20 executes the processing of steps S101 to S106 in FIG. 2 for the facility mark. At this time, in step S102, the system controller 20 arranges the building polygons in the three-dimensional coordinate space, and then arranges each facility mark at a display position having the same depth as the corresponding facility. In this way, the system controller 20 prevents the facility mark from being displayed overlapping the building in front of the facility corresponding to the facility mark, and the user misidentifies the correspondence between the facility and the facility mark. Can be reliably suppressed.

  In addition, preferably, the system controller 20 may perform the non-display processing of the shielding portion only in the case of displaying the facility mark to be displayed as a mark when driving according to the guidance route. As a result, the system controller 20 can appropriately recognize the position of the facility that serves as a landmark for driving. Further, the system controller 20 displays other facility marks regardless of the presence or absence of a shielding part, so that the user can easily find a target facility when searching for a facility to stop by.

(Modification 3)
The processing procedure of the flowchart of FIG. 2 is an example, and the processing procedure to which the present invention is applicable is not limited to this. For example, the navigation device 1 identifies a portion of the guide route that overlaps the building based on the house shape information, the location information, the road location information on the guide route, etc. without generating a transparent polygon of the building. Then, an image of the guide route in which the portion is not displayed may be displayed superimposed on the photographed image. In addition, according to the specification of the software to be used, the system controller 20 may appropriately execute the order of a part of the processing.

(Modification 4)
In step S <b> 102 of FIG. 2, the system controller 20 may draw a substantially transparent polygon instead of drawing a completely transparent polygon when drawing a polygon representing a building. For example, the system controller 20 may draw a polygon having a high transmittance so that the polygon representing the building is not conspicuous when the photographed image and the CG image are superimposed. Even in this case, similarly to the embodiment, it is possible to output a display with a sense of depth while hiding the shielding portion of the building on the guide route.

(Modification 5)
In step S102 of FIG. 2, the system controller 20 has drawn all the polygons of the building existing within the shooting range of the camera 61. Instead of this, the system controller 20 may draw polygons of some buildings within the shooting range. Specifically, the system controller 20 may generate polygons only for buildings existing in front of the road corresponding to the guidance route in the traveling direction of the vehicle. Also by this, the system controller 20 can output a display with a sense of depth while hiding the shielded part by the building of the guidance route.

  The present invention can be suitably applied to an apparatus that performs guidance display based on a photographed image taken by a camera.

DESCRIPTION OF SYMBOLS 1 Navigation apparatus 10 Self-supporting positioning apparatus 12 GPS receiver 20 System controller 22 CPU
36 Data storage unit 38 Communication device 40 Display unit 44 Display

Claims (8)

A display device that displays guidance information superimposed on a live-action image,
Specifying means for specifying the overlapping portion of the tangible before SL in the guidance information with the photographed image,
Display control means for displaying the guidance information excluding the shielding part on which the tangible object is to be displayed on the front of the guidance information among the superimposed information, and superimposing it on the photographed image,
Have
The display control means displays a mark indicating the facility in the live-action image superimposed on the live-action image as the guidance information,
Wherein the display control unit, of the mark, the mark as a mark for route guidance, the display by excluding the shielding portion, the mark other than the mark as a mark of the route guidance, the shielding portion A display device characterized by displaying without being excluded . The tangible object is a building;
The specifying means specifies the overlapped portion by drawing the building substantially transparent based on the location information and house shape information of the building and drawing the guidance information based on the location information of the facility or road. And
The display control means generates a composite image in which the building drawn substantially transparent and the guide information excluding the shielding portion are combined, and displays the composite image superimposed on the photographed image. The display device according to claim 1.   When generating the composite image, the display control unit draws a substantially transparent building prior to the guidance information, and then draws substantially transparent on the portion other than the shielding portion of the overlapped portion. The display device according to claim 2, wherein a color mixing process of the building and the guidance information is performed.   The display device according to any one of claims 1 to 3, wherein the display control unit displays a route on which the mobile body should travel as the guidance information superimposed on the photographed image.   The display device according to claim 4, wherein the display control unit displays the display of the route upside down at a position above the road corresponding to the route. A control method executed by a display device that displays guidance information superimposed on a live-action image,
A specifying step of specifying the overlapping portion of the tangible before SL in the guidance information with the photographed image,
A display control step of superimposing the guidance information excluding the shielding part on which the tangible object is to be displayed in front of the guidance information from the superimposition portion, and superimposing it on the live-action image; and
Have
The display control step displays a mark indicating the facility in the live-action image superimposed on the live-action image as the guidance information,
Wherein the display control step, of the mark, the mark as a mark for route guidance, the display by excluding the shielding portion, the mark other than the mark as a mark of the route guidance, the shielding portion A control method characterized by displaying without exclusion . A program executed by a display device that displays guidance information superimposed on a live-action image,
Specifying means for specifying the overlapping portion of the tangible before SL in the guidance information with the photographed image,
The display device is made to function as a display control unit that superimposes and displays the guidance information excluding the shielding part on which the tangible object is to be displayed on the front of the guidance information from the superimposition part,
The display control means displays a mark indicating the facility in the live-action image superimposed on the live-action image as the guidance information,
Wherein the display control unit, of the mark, the mark as a mark for route guidance, the display by excluding the shielding portion, the mark other than the mark as a mark of the route guidance, the shielding portion A program characterized by being displayed without being excluded . A storage medium storing the program according to claim 7 .

Images