JP6228516B2 - Route guidance device, route guidance method, and route guidance program - Google Patents

Description

  The present invention provides a route guidance device that provides information of a route to a destination (for example, a shelter when a disaster such as an earthquake occurs) to a user of a terminal device (typically, a mobile terminal device such as a mobile phone), The present invention relates to a route guidance method and a route guidance program.

  In recent years, a lot of application software using a map has been developed in accordance with enhancement of functions and resolution of portable terminal devices such as cellular phones. As one of such application software, application software called “route search application” for guiding a user (hereinafter referred to as “user”) of a mobile terminal device to a destination is known. By using the route search application, the user can easily reach the destination even when there is no map at hand.

  By the way, when a wide-area disaster such as an earthquake occurs, people need to immediately move to a nearby evacuation center to ensure their safety and necessary materials and information. In recent years, since many large-scale disasters have occurred, it is important to promptly guide people to shelters when disasters occur. In this regard, since mobile terminal devices such as mobile phones have become widespread in recent years, it is considered to guide a user to an evacuation site using a mobile terminal device when a disaster occurs. Specifically, application software specialized for route guidance to an evacuation site (hereinafter referred to as “evacuation guidance app”) is also provided as one of route search applications for mobile terminal devices.

  However, when a disaster such as an earthquake occurs, it may be difficult for a person to panic and make a logical decision, and the map cannot be read correctly. In addition, tourists who are not familiar with the land often do not know the direction based on the current location. In particular, it is more difficult to judge the direction for foreign tourists who cannot read Japanese. For these reasons, it is desired to develop an evacuation guidance application that can promptly guide a user to an evacuation site even if the user is in a panic due to a disaster.

  By the way, in recent years, augmented reality technology (AR technology) has been developed in which a virtual image called an air tag is added to and displayed by a video (hereinafter referred to as “landscape video” for convenience) taken by a camera attached to a mobile terminal device. I am doing. Therefore, in a route search application, an air tag representing various information is added to a landscape video and displayed.

  In relation to the present invention, Japanese Patent Application Laid-Open No. 2007-127437 discloses an invention of an information display device that presents a correspondence relationship between a photographed image and a map image to a user. According to this information display device, when the user designates either one of the photographed image or the map image, the corresponding structure in the other image is highlighted. Japanese Patent Laying-Open No. 2014-2278 discloses an invention of a map display device in which a panorama map that is a part of a panoramic image of a landscape viewed from a predetermined viewpoint and a two-dimensional map are displayed in conjunction with each other.

JP 2007-127437 A JP 2014-2278 A

  If the augmented reality technology described above is used, an air tag as information (evacuation site information, disaster location information, etc.) provided for evacuation route guidance will be added to the landscape video captured by the user in the evacuation guidance app. Can be displayed automatically. Also, a virtual image called a character tag composed of characters can be additionally displayed on a landscape image captured by the user. A character tag is a type of air tag. In this specification, a virtual image represented in the form of a graphic is called an “air tag”, and a virtual image represented in the form of a character. It is called “character tag”. When a landscape video with such an air tag or character tag and a map showing an evacuation route are displayed on one screen, for example, an image (map and video) as shown in FIG. 35 is displayed on the display unit. . In the example shown in FIG. 35, air tags representing shelters, traveling routes, fires, floods, and the like are displayed in the landscape video, and character tags representing information corresponding to the air tags are displayed.

  By the way, in the example shown in FIG. 35, the character tag is arrange | positioned in the vicinity of the air tag. When such an arrangement is performed, there is a possibility that air tags and character tags are densely mixed in an area where buildings and roads are displayed in a landscape video, resulting in a video with poor visibility for the user. Therefore, in order to improve the visibility of the video, for example, as shown in FIG. 36, it is conceivable to arrange the character tag at a position away from the air tag. However, when a landscape video includes many air tags of the same type, it is difficult for the user to accurately associate each air tag with each character tag. Therefore, it is difficult for the user to understand which air tag each character tag represents. For this reason, especially when the user is in a panic due to a disaster, the user's rapid evacuation may be hindered, or the user may accidentally deviate from the evacuation route.

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to realize a route guidance device that has a good visibility and that allows a user to easily grasp what items / events a character tag describes. .

A first invention is a route guidance device for guiding a traveling route to a destination,
A route search means for searching for a route to the destination based on a condition input by the user;
Video display means for displaying a video being shot in a predetermined video display area;
A first augmented reality image, which is an image represented by a graphic of the augmented reality image representing the information provided for the guidance of the travel route, is displayed in a superimposed manner on the captured video displayed by the video display means. 1 augmented reality image display means;
A second augmented reality that displays a second augmented reality image corresponding to the first augmented reality image, which is an image represented by characters in the augmented reality image representing information used for guiding the travel route. Image display means;
Map display means for displaying in a predetermined map display area a map indicating the travel route obtained by the route search means and a landmark corresponding to the second augmented reality image;
One end and one of said first augmented reality image or the landmark at each time point, and a link line display means for displaying the link line to the other end and said second augmented reality image,
The second augmented reality image display means has a range in which each second augmented reality image can be moved by a minute distance during a period in which one or more second augmented reality images are displayed in the same order. In position ,
The link line display means can switch one end of the link line between the first augmented reality image and the landmark .

According to a second invention, in the first invention,
The link line display means includes
Displaying a link line having one end as the first augmented reality image and the other end as the second augmented reality image;
The link line is drawn in real time according to a change in the position of the first augmented reality image displayed in the video display area.

According to a third invention, in the second invention,
When the position of the first augmented reality image when the position of the first augmented reality image corresponding to the second augmented reality image exists outside the video display area is defined as a virtual display position, the link line The display means draws the link line so as to extend from the display position of the second augmented reality image to the virtual display position.

According to a fourth invention, in any one of the first to third inventions,
The display position of each second augmented reality image is completely fixed during a period in which one or more second augmented reality images are displayed in the same order.

According to a fifth invention, in any one of the first to third inventions,
During a period in which one or more second augmented reality images are displayed in the same order, each second augmented reality image can move only a minute distance in one of the vertical direction and the horizontal direction. To do.

According to a sixth invention, in any one of the first to fifth inventions,
The second augmented reality image display means displays the plurality of second augmented reality images so that any two second augmented reality images do not overlap each other when displaying the plurality of second augmented reality images. It is characterized by arranging a real image.

According to a seventh invention, in any one of the first to sixth inventions,
The second augmented reality image display means displays the second augmented reality image in a region above a central portion of the video display region.

In an eighth aspect based on the seventh aspect ,
The second augmented reality image display means displays the second augmented reality image in a region where a video corresponding to the sky of the captured video is displayed.

According to a ninth invention, in any one of the first to eighth inventions,
The second augmented reality image display means displays the second augmented reality image in a character display area provided separately from the video display area and the map display area.

According to a tenth aspect of the invention, in any one of the first to ninth aspects of the invention,
The link line display means displays each link line so that an arbitrary second augmented reality image and a link line corresponding to the second augmented reality image have the same color.

In an eleventh aspect based on the tenth aspect ,
The second augmented reality image display means is configured so that each first augmented reality image and each second augmented reality image corresponding to the first augmented reality image have the same color. It is characterized by displaying a real image.

In a twelfth aspect of the invention based on any one of the first to eleventh aspects of the invention,
The route searching means searches for an evacuation route as a destination and an evacuation route to the evacuation site using information on roads and evacuation sites.

A thirteenth invention is a route guidance method for guiding a travel route to a destination using a terminal device,
A route search step in which the terminal device searches for a travel route to a destination based on a condition input by a user of the terminal device;
A video display step of displaying a video being shot in a predetermined video display area of the terminal device;
A first augmented reality image, which is an image represented by a graphic of the augmented reality image representing the information provided for the guidance of the travel route, is displayed in a superimposed manner on the captured image displayed in the image display step. 1 augmented reality image display step;
A second augmented reality that displays a second augmented reality image corresponding to the first augmented reality image, which is an image represented by characters in the augmented reality image representing information used for guiding the travel route. An image display step;
A map display step for displaying a map indicating the travel route obtained in the route search step and a landmark corresponding to the second augmented reality image in a predetermined map display region of the terminal device;
One end and one of said first augmented reality image or the landmark at each time point, and a link line display step of displaying a link line that the other end and said second augmented reality image,
In the second augmented reality image display step, each of the second augmented reality images is within a range in which the second augmented reality image can move by a minute distance during a period in which one or more second augmented reality images are displayed in the same order. Displayed in the position ,
In the link line display step, one end of the link line can be switched between the first augmented reality image and the landmark .

A fourteenth invention is a route guidance program executed by a terminal device for guiding a traveling route to a destination,
A route search step for searching for a travel route to a destination based on a condition input by a user of the terminal device;
A video display step of displaying a video being shot in a predetermined video display area of the terminal device;
A first augmented reality image, which is an image represented by a graphic of the augmented reality image representing the information provided for the guidance of the travel route, is displayed in a superimposed manner on the captured image displayed in the image display step. 1 augmented reality image display step;
A second augmented reality that displays a second augmented reality image corresponding to the first augmented reality image, which is an image represented by characters in the augmented reality image representing information used for guiding the travel route. An image display step;
A map display step for displaying a map indicating the travel route obtained in the route search step and a landmark corresponding to the second augmented reality image in a predetermined map display region of the terminal device;
Computer included one end and one of said first augmented reality image or the landmark at each time point, and a link line display step of displaying a link line that the other end and said second augmented reality image to the terminal apparatus CPU is executed using memory,
In the second augmented reality image display step, each of the second augmented reality images is within a range in which the second augmented reality image can move by a minute distance during a period in which one or more second augmented reality images are displayed in the same order. Displayed in the position ,
In the link line display step, one end of the link line can be switched between the first augmented reality image and the landmark .

In a fifteenth aspect based on the fourteenth aspect ,
In the link line display step,
A link line having one end as the first augmented reality image and the other end as the second augmented reality image is displayed,
The link line is drawn in real time according to a change in the position of the first augmented reality image displayed in the video display area.

A sixteenth invention, in the fifteenth invention,
When the position of the first augmented reality image when the position of the first augmented reality image corresponding to the second augmented reality image exists outside the video display area is defined as a virtual display position, the link line In the display step, the link line is drawn so as to extend from the display position of the second augmented reality image to the virtual display position.

According to a seventeenth aspect of the invention, in any one of the fourteenth to sixteenth aspects of the invention,
The display position of each second augmented reality image is completely fixed during a period in which one or more second augmented reality images are displayed in the same order.

According to an eighteenth aspect of the invention, in any one of the fourteenth to sixteenth aspects of the invention,
During a period in which one or more second augmented reality images are displayed in the same order, each second augmented reality image can move only a minute distance in one of the vertical direction and the horizontal direction. To do.

According to a nineteenth invention, in any one of the fourteenth to eighteenth inventions,
In the second augmented reality image display step, when the plurality of second augmented reality images are displayed, the plurality of second augmented reality images are prevented from overlapping each other. An augmented reality image is arranged.

In a twentieth invention according to any one of the fourteenth to nineteenth inventions,
In the second augmented reality image display step, the second augmented reality image is displayed in a region above a central portion of the video display region.

The twenty-first invention is the twentieth invention,
In the second augmented reality image display step, the second augmented reality image is displayed in an area where a video corresponding to the sky of the photographed video is displayed.

According to a twenty- second invention, in any one of the fourteenth to twenty-first inventions,
In the second augmented reality image display step, the second augmented reality image is displayed in a character display area provided separately from the video display area and the map display area.

The twenty- third invention is the invention according to any one of the fourteenth to twenty- second inventions,
In the link line display step, each link line is displayed so that an arbitrary second augmented reality image and a link line corresponding to the second augmented reality image have the same color.

24th aspect of the present invention based on the twenty-third,
In the second augmented reality image display step, each second augmented reality image and each second augmented reality image corresponding to the first augmented reality image have the same color. A real image is displayed.

In a twenty-fifth aspect of the present invention, in any one of the fourteenth to twenty- fourth aspects,
In the route search step, a search for the evacuation route to the destination and the evacuation route to the evacuation site is performed using information on the road and the evacuation site.

According to the first aspect, an air tag (first augmented reality image) is displayed together with the captured video in the video display area, and a map indicating a travel route to the destination is displayed in the map display area. A landmark corresponding to the air tag in the video display area is also displayed. In addition, a character tag (second augmented reality image) corresponding to the air tag is displayed in a predetermined area. In the route guidance device display is performed as described above, one of the link lines connecting the link line or character tags and landmark connecting the character tag and Air Tags are displayed at each time point. The user can also switch one end of the link line between the air tag and the landmark. For this reason, it becomes easy to grasp the correspondence between each character tag and the corresponding air tag or landmark. Therefore, the user can easily grasp which thing / event each character tag explains. Each character tag is displayed in a state of being fixed at substantially the same position. For this reason, the fluctuation | variation of the display position of the character tag accompanying a user's movement is suppressed. Thereby, even if the user moves and uses the route guidance device, an image having good visibility is provided to the user. As described above, a route guidance device is realized that has good visibility and allows the user to easily understand what object / event the character tag displayed on the screen describes. The

According to the second aspect , even if the orientation of the device is changed by the user or the position of the device is moved by the user following the traveling path, the air tag and the corresponding character tag are always linked to each other. Tied by.

According to the third aspect , the link line is displayed so as to extend from the display position of the character tag to the virtual display position of the air tag even when the air tag is located outside the range of the viewing angle. For this reason, the user can grasp that the character tag represents information about an object / event outside the range of the viewing angle.

According to the fourth aspect , since the character tag is displayed in a completely fixed state, the display position of the character tag does not fluctuate with the movement of the user. Thereby, an image having very good visibility is provided to the user.

According to the fifth aspect , since the character tag is displayed in a state where it is fixed at substantially the same position, the fluctuation of the display position of the character tag accompanying the movement of the user is suppressed. Here, if the character tag is displayed in a completely fixed state, there is a concern that the user misidentifies the character tag as a button (menu button), for example. In this respect, if the character tag is configured to be able to move by a minute distance, for example, the character tag slightly moves with the movement of the user, so that the above-described misidentification by the user is prevented.

According to the sixth aspect , two character tags are prevented from overlapping each other, so that useful information is reliably provided to the user as characters.

According to the seventh aspect , air tags and character tags are mixedly mixed in the video display area, and useful information is prevented from being hidden by the character tags.

According to the eighth aspect , air tags and character tags are more effectively mixed in the video display area, and useful information is prevented from being hidden by the character tags.

According to the ninth aspect , since the air tag and the character tag are displayed in different areas, it is possible to reliably prevent the air tag and the character tag from being mixed and useful information from being hidden by the character tag.

According to the tenth aspect , the character tag on the screen and the link line corresponding to the character tag are displayed in the same color. For this reason, the user can easily grasp the correspondence between the character tag and the link line. This makes it possible to guide the user to the destination more quickly.

According to the eleventh aspect , the air tag in the video display area and the character tag corresponding to the air tag are displayed in the same color. For this reason, the user can easily grasp the correspondence between the air tag and the character tag. This makes it possible to guide the user to the destination more quickly.

According to the twelfth aspect of the present invention, in the route guidance device for guiding the evacuation route to the user, it is possible to obtain a good visibility with respect to the display image, and the character tag displayed on the screen indicates which object / event. It is possible to easily grasp whether the explanation is given.

According to the thirteenth aspect , the same effect as that of the first aspect can be achieved in the route guidance method invention.

According to the fourteenth to twenty- fifth aspects of the invention, the same effects as the first to twelfth aspects of the invention can be achieved in the route guidance program invention.

It is a block diagram which shows the apparatus structure which implement | achieves the evacuation guidance system which concerns on one Embodiment of this invention. In the said embodiment, it is a block diagram which shows the hardware constitutions of a portable terminal device. In the said embodiment, it is a figure which shows the detail about the area | region in a display part. In the said embodiment, it is a block diagram which shows the detailed functional structure of a portable terminal device. In the said embodiment, it is a figure which shows one screen example of a personal condition input means. In the said embodiment, it is a figure which shows one screen example of the movable distance input means. In the said embodiment, it is a figure which shows the example of a screen of a periphery condition input means. In the said embodiment, it is a figure for demonstrating the display of the map by a map display means, and the display of the landscape image by a video display means. In the said embodiment, it is a figure for demonstrating the display of the landmark by a landmark display means. In the said embodiment, it is a figure for demonstrating a wire frame. In the said embodiment, it is a figure which shows an example of the image | video by which the wire frame was added to the landscape image | video. In the said embodiment, it is a figure for demonstrating the display of the air tag by an air tag display means. In the said embodiment, it is a figure for demonstrating the display of the character tag by a character tag display means. In the said embodiment, it is a figure for demonstrating the display of the character tag by a character tag display means. In the said embodiment, it is a figure for demonstrating the display of the character tag by a character tag display means. In the said embodiment, it is a figure for demonstrating the display of the link line by a link line display means. In the said embodiment, it is a figure for demonstrating the display of the link line by a link line display means. In the said embodiment, it is a flowchart which shows the processing flow in a portable terminal device. In the said embodiment, it is a figure which shows an example of the image | video by which the air tag was added to the landscape image | video. In the said embodiment, it is a figure for demonstrating the display of a several character tag. In the said embodiment, it is a figure for demonstrating the display of a several character tag. In the said embodiment, it is a figure for demonstrating the display position of a character tag. In the said embodiment, it is a figure for demonstrating the display position of a character tag. In the said embodiment, it is a figure for demonstrating the display position of a character tag. In the said embodiment, it is a figure for demonstrating the position of the character tag in a landscape image | video. In the said embodiment, it is a figure for demonstrating the positional relationship of a link line and a character tag. In the said embodiment, it is a figure for demonstrating the positional relationship of a link line and a character tag. In the said embodiment, it is a figure for demonstrating drawing of the link line to the display part in real time. In the said embodiment, it is a figure for demonstrating drawing of a link line when the position of an air tag exists outside an image | video display area. In the said embodiment, it is a figure for demonstrating the effect by arrange | positioning a character tag to the area | region (area | region where the empty image | video is displayed) above a video display area. It is a figure which shows the example of a display in the 1st modification of the said embodiment. It is a figure which shows the example of a display in the 2nd modification of the said embodiment. It is a figure for demonstrating switching of the end of a link line in the 3rd modification of the said embodiment. It is a figure which shows one display example at the time of arrange | positioning a map display area below a display part and arrange | positioning a video display area above a display part regarding the modification of the said embodiment. It is a figure which shows the example of a display in a prior art example. It is a figure which shows the example of a display at the time of arrange | positioning the character tag in the position away from the air tag.

  Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. In the following, “application software” is abbreviated as “application”.

<1. Overall configuration>
FIG. 1 is a block diagram showing a device configuration for realizing an evacuation guidance system according to an embodiment of the present invention. This evacuation guidance system is realized by the mobile terminal device 10 and the server 20. The portable terminal device 10 and the server 20 are connected via a communication line such as the Internet. In the present embodiment, an evacuation guidance application is installed in the mobile terminal device 10 in order to realize this evacuation guidance system. The evacuation guidance application is software for presenting the evacuation route from the current position to the evacuation center when a disaster such as an earthquake occurs. The user can activate the evacuation guidance application by a predetermined operation. By installing such an evacuation guidance application in the mobile terminal device 10, even if a user encounters a disaster in a place where there is no land, for example, the user can easily reach the evacuation site by using the evacuation guidance application. It becomes possible.

  FIG. 2 is a block diagram illustrating a hardware configuration of the mobile terminal device 10. The mobile terminal device 10 includes a CPU 11, a flash ROM 12, a RAM 13, a communication control unit 14, a video photographing unit (camera) 15, a GPS processing unit 16, an input operation unit 17, a display unit 18, and a tilt sensor 19. The CPU 11 performs various arithmetic processes and the like in order to control the entire mobile terminal device 10. The flash ROM 12 is a writable nonvolatile memory, and stores various programs and various data that should be retained even when the power of the mobile terminal device 10 is turned off. The RAM 13 is a writable volatile memory, and temporarily stores an executing program, data, and the like. The communication control unit 14 performs control of data transmission to the outside and control of data reception from the outside. The video shooting unit (camera) 15 shoots a landscape seen from the current position based on an operation by the user. The GPS processing unit 16 acquires position information (latitude / longitude information) for specifying the current position of the user based on radio waves received from GPS satellites. The input operation unit 17 is a touch panel, for example, and accepts an input operation by a user. The display unit 18 displays an image based on a command from the CPU 11. The tilt sensor 19 acquires angle information indicating the tilt of the mobile terminal device 10.

  When shooting using the video shooting unit 15 is performed by the user while the evacuation guidance application is being executed, an area in the display unit 18 is an area for displaying a map (hereinafter, as shown in FIG. 3 for example). , “Map display area”) 18a and an area (hereinafter referred to as “video display area”) 18b for displaying a video (landscape video) obtained by shooting by the video shooting unit 15. In the present embodiment, as shown in FIG. 3, a map display region 18 a is disposed above the display unit 18, and a video display region 18 b is disposed below the display unit 18.

  In the mobile terminal device 10, an evacuation guidance program for realizing an evacuation guidance application is stored in the flash ROM 12. When the user gives an instruction to start the evacuation guidance application, the evacuation guidance program stored in the flash ROM 12 is read out to the RAM 13, and the CPU 11 executes the evacuation guidance program read into the RAM 13, whereby the evacuation guidance is performed. App functionality is provided to users. Note that the evacuation guidance program is typically downloaded from a predetermined server (not shown) to the mobile terminal device 10 via a communication line such as the Internet, and installed in the flash ROM 12 in the mobile terminal device 10. Thus, the route guidance device according to the present invention is realized by the mobile terminal device 10 by installing the evacuation guidance program in the mobile terminal device 10.

<2. Functional configuration>
FIG. 4 is a block diagram illustrating a detailed functional configuration of the mobile terminal device 10. The mobile terminal device 10 includes a GPS information acquisition unit 100, a sightseeing function selection unit 110, a user information transmission unit 120, a data reception unit 121, a data storage unit 130, an evacuation route search unit 140, a personal situation input unit 141, and a movable distance input. Means 142, surrounding state input means 143, map display means 150, sightseeing information display means 160, video display means 170, air tag display means 180, link line display means 181, and character tag display means 182. The map display means 150 includes landmark display means 152.

  In the present embodiment, the route search means is realized by the evacuation route search means 140, the first augmented reality image display means is realized by the air tag display means 180, and the second augmented reality image is realized by the character tag display means 182. A display means is realized.

  The GPS information acquisition unit 100 acquires position information (latitude / longitude information) for specifying the current position of the user based on radio waves received from GPS satellites, and outputs GPS data Gda indicating the position information. The GPS information acquisition unit 100 is realized by a GPS processing unit 16 (see FIG. 2) as hardware.

  The sightseeing function selection means 110 is a means for allowing the user to select a sightseeing function desired by the user (presentation of various information on tourist facilities, guidance on sightseeing courses, introduction of accommodation facilities / restaurants / souvenir shops, etc.). When the user selects a sightseeing function, the sightseeing function selection means 110 outputs function selection data Fda indicating the sightseeing function selected by the user. As described above, the evacuation guidance application according to the present embodiment can provide information for sightseeing to the user in normal times. However, the present invention is not limited to this, and the function for providing tourist information to the user may not necessarily be provided in the mobile terminal device 10.

  The user information transmission unit 120 transmits the GPS data Gda and the function selection data Fda to the server 20 as user data Yda. The GPS data Gda is transmitted from the mobile terminal device 10 to the server 20 at the timing when the user activates the evacuation guidance app and when the user performs some operation using the evacuation guidance app, for example. Further, the GPS data Gda may be transmitted from the mobile terminal device 10 to the server 20 every predetermined period while the user is using the evacuation guidance application.

  The data receiving unit 121 receives server data Sda transmitted from the server 20. The server data Sda includes significant data Mda that is useful for searching for an evacuation route, air tag data Ada for displaying an air tag as information provided for evacuation route guidance, and evacuation route guidance. Character tag data Cda for displaying a character tag as information to be displayed, and tourism data Kda that is data corresponding to the tourism function selected by the user by the tourism function selection means 110 are included. In addition to the basic data Bda such as map data, road data, and shelter data, the significant data Mda includes, for example, data indicating the degree of congestion of each road. The significant data Mda of the server data Sda transmitted from the server 20 is stored in the data storage unit 130. The data storage means 130 is realized by a flash ROM 12 or RAM 13 (see FIG. 2) as hardware. In addition, when the evacuation guidance program is installed in the mobile terminal device 10, by downloading the significant data Mda to the data storage unit 130, it is possible to search for an evacuation route regardless of the communication state when a disaster occurs. It becomes.

  The personal situation input means 141 is a means for causing the user to input the disaster situation and exercise ability (ability to avoid and overcome obstacles on the evacuation route) when the disaster occurs. The personal status input means 141 is realized by displaying a screen as shown in FIG. As shown in FIG. 5, for example, “climbing”, “running”, “flat only”, “wheelchair”, “foot injury”, “cannot walk”, “stretcher”, “children”, “pram”, etc. Button is displayed. The user only has to press a button indicating the corresponding state. The personal situation data Ida indicating the content input by the personal situation input unit 141 is used by the evacuation route search unit 140.

  Note that the screen shown in FIG. 5 is an example, and the screen layout and items displayed on the screen are not limited thereto. This also applies to the movable distance input means 142 (see FIG. 6) and the surrounding situation input means 143 (see FIG. 7) described later.

  The movable distance input means 142 is a means for allowing the user (a disaster victim) to input a moving means and a movable distance when a disaster occurs. This movable distance input means 142 is realized by displaying a screen as shown in FIG. As shown in FIG. 6, for example, buttons indicating moving means such as “walking”, “bicycle”, “car”, and an input box capable of inputting a movable distance are displayed. The user presses a button indicating the corresponding moving means and inputs the movable distance. The moving ability data Dda indicating the content input by the movable distance input unit 142 is used by the evacuation route searching unit 140.

  The surrounding situation input means 143 is a means for allowing the user to input the surrounding situation of the user (disaster) when a disaster occurs. This peripheral condition input means 143 is realized by displaying a screen as shown in FIG. As shown in FIG. 7, the surrounding situation input means 143 is configured to be able to input, for example, a disaster situation and a congestion situation. The area for entering the disaster status includes, for example, buttons indicating the type of disaster such as “fire”, “water damage”, “collapse”, “cracking”, “strong”, “strong”, “medium” , A button indicating the intensity of the disaster such as “weak” and an input box capable of inputting the scale of the disaster are displayed. In the area for entering the congestion status, for example, buttons indicating the degree of congestion such as “Danger”, “Strong”, “Normal”, “Slightly”, and an input box in which the range of congestion can be input. Is displayed. The user selects the type of disaster, the intensity of the disaster, and the degree of congestion, and inputs the scale of the disaster and the range of congestion. The surrounding situation data Pda indicating the contents input by the surrounding situation input unit 143 is used by the evacuation route searching unit 140.

  The evacuation route searching means 140 is transmitted from the server 20 and stored in the data storage means 130 with the GPS data Gda, data input by the user (personal situation data Ida, mobility capability data Dda, and surrounding situation data Pda). Based on the significant data Mda, the optimum evacuation site / evacuation route for the user is searched. The tourism information display means 160 displays the tourism data Kda on the display unit 18.

  The map display means 150 displays a map in the map display area 18 a in the display unit 18 based on the basic data Bda stored in the data storage means 130. At that time, if the evacuation route search means 140 has already searched for the evacuation site / evacuation route, the search result Re is reflected on the map. Thereby, as shown in FIG. 8, for example, the map and the evacuation route as the search result Re are displayed in the map display area 18a. The map display means 150 has a heading-up mode and a north-up mode as display modes. The heading-up mode is a mode in which the map is displayed while rotating according to the direction of travel of the user so that the direction of travel of the user is always upward on the screen. The north up mode is a mode in which the map is displayed so that the north direction is an upward direction on the screen. Further, the map display means 150 is configured to be able to enlarge / reduce / scroll the map by a pinch operation (operation to pinch or push the screen with a plurality of fingers) or the like.

  The landmark display means 152 is based on the air tag data Ada received by the data receiving means 121, and corresponds to an air tag displayed in the video display area 18b by the air tag display means 180 (to be described later). Corresponding to the character tag displayed by the character tag display means 182.) is displayed in the map display area 18a. The landmark display means 152 displays, for example, a landmark indicating a refuge and a landmark indicating a disaster location such as a fire or flood. As a result, a map with landmarks is displayed in the map display area 18a as shown in FIG. 9, for example. Each landmark is displayed on the map at the position of the thing / event represented by the air tag corresponding to the landmark. That is, the landmark display means 152 displays the landmark corresponding to the air tag at the position associated with the air tag displayed in the video display area 18b among the positions on the map displayed in the map display area 18a. indicate.

  The video display means 170 displays a landscape video obtained by the above-described shooting by the video shooting unit 15 in the video display area 18 b in the display unit 18. Thereby, for example, as shown in FIG. 8, a landscape video is displayed in the video display area 18b. By the way, in this evacuation guidance application, as shown in FIG. 10, in order to easily understand the correspondence between the air tag displayed in the video display area 18b and the position on the map displayed in the map display area 18a. An image called “wire frame” is displayed in the video display area 18b. As shown in FIG. 10, the wire frame includes a vertical axis extending in the traveling direction and a horizontal axis extending in a direction perpendicular to the traveling direction. A distance X between two adjacent vertical axes and a distance Y between two adjacent horizontal axes represent a certain distance determined by the evacuation guidance application.

  By the way, this wire frame is displayed using a perspective method so that the center of the video display area 18b becomes a vanishing point when the mobile terminal device 10 is perpendicular to the ground surface. Therefore, if the mobile terminal device 10 is perpendicular to the ground surface, one end point of all the vertical axes exists at the center of the video display area 18b. Further, the middle line in the vertical direction of the video display area 18b when the mobile terminal device 10 is perpendicular to the ground surface is regarded as the horizontal line (horizon line) in the landscape video. Therefore, the vanishing point exists on the horizontal line (horizon line) in the landscape video. Further, the interval between the horizontal axes of the wire frames becomes narrower as it approaches the center of the video display area 18b. By adding the wire frame as described above to the landscape video, a video as shown in FIG. 11 is displayed in the video display area 18b. When the mobile terminal device 10 is facing upward (when the image capturing direction by the image capturing unit 15 is upward from the horizontal direction), the vanishing point is located below the center of the image display area 18b. When the mobile terminal device 10 is facing downward (when the shooting direction by the video shooting unit 15 is lower than the horizontal direction), the vanishing point is located above the center of the video display area 18b.

  Based on the air tag data Ada received by the data receiving means 121, the air tag display means 180 displays an air tag (augmented reality image) representing information that is useful to the user when the user evacuates following the evacuation route. , And overlaid on the landscape video that was shot by the user. As a result, for example, an air tag representing a refuge, an air tag representing a disaster (fire, flood, etc.), an air tag representing a congestion situation, an arrow-shaped air tag representing a travel route, and the like are displayed in the video display area 18b. For example, in the video display area 18b shown in FIG. 12, an air tag 31 representing a traveling route, an air tag 32 representing a shelter, and an air tag 33 representing water damage are displayed. In addition, by displaying the air tag 31 representing the traveling route in the video display area 18b, the user can easily grasp the direction to be aimed even if the user is in a panic state.

  By the way, each air tag is displayed using the result of perspective transformation based on the position corresponding to the air tag and the current position (user position). For this reason, when focusing on air tags representing the same type of information, an air tag representing information closer to the current position is displayed larger, and an air tag representing information farther from the current position is displayed smaller. For example, an air tag representing a fire occurring at a position close to the current position is displayed large, and an air tag representing a fire occurring at a position far from the current position is displayed small. Further, since the wire frame is added to the landscape video as described above, the user can display the thing represented by the air tag (for example, based on the positional relationship between the air tag and the wire frame in the video display area 18b). The geographical location and direction of evacuation centers and events (eg fire) can be estimated to some extent.

  When the air tag is displayed by the air tag display means 180, the inclination of the portable terminal device 10 is detected by the inclination sensor 19, and the display position of the air tag in the video display area 18b is determined according to the inclination. Specifically, the air tag is displayed in the lower part of the video display area 18b as the mobile terminal device 10 is directed upward (the imaging direction by the video imaging unit 15 is upward), and the mobile terminal device 10 is directed downward (video). The air tag is displayed in the upper part of the video display area 18b (as the shooting direction by the shooting unit 15 becomes lower).

  Based on the character tag data Cda received by the data receiving means 121, the character tag display means 182 displays in the video display area 18b a character tag representing information related to the air tag displayed in the video display area 18b. . For example, a virtual image as shown in FIG. 13 (a) representing the information of the refuge, a virtual image as shown in FIG. 13 (b) representing the location of the fire as characters, and the like are used as the character tags. Is displayed. The character tag is typically displayed in an area corresponding to the sky in a landscape video. As described above, for example, an image as shown in FIG. 15 is displayed on the display unit 18 by adding a character tag to the image as shown in FIG. It is not always necessary to display the corresponding character tags for all the air tags displayed in the video display area 18b. A more detailed explanation about the display of the character tag will be described later.

  Based on the position data PA of each air tag displayed in the video display area 18b and the position data PM of the character tag corresponding to each air tag, the link line display means 181 and the air tag in the video display area 18b and the characters corresponding thereto. A line connecting the tags (hereinafter referred to as “link line”) is displayed on the display unit 18. For example, as shown in FIG. 16A, when an air tag A1 representing a refuge is displayed in the video display area 18b and a character tag M1 corresponding to the air tag A1 is displayed, the link line display means 181 As shown in FIG. 16B, a link line LK connecting the air tag A1 and the character tag M1 is displayed on the display unit 18. Thus, for example, when an image (map and video) as shown in FIG. 15 is displayed on the display unit 18, a link line is displayed as shown in FIG. In the example shown in FIG. 17, as a link line, a link line LK1 connecting an air tag representing a building or the like (station in this example) and a character tag corresponding to the air tag, an air tag representing a shelter, and characters corresponding to the air tag Link lines LK2 to LK4 connecting the tags are displayed. More detailed description regarding the display of the link line will be described later. In FIG. 17, the link line LK4 is displayed so as to extend out of the video display area 18b. This will also be described later.

  In the present embodiment, the first augmented reality image is realized by the air tag, and the second augmented reality image is realized by the character tag.

<3. Processing flow>
Next, a processing flow in the mobile terminal device 10 will be described with reference to the flowchart shown in FIG. In the mobile terminal device 10, first, an evacuation guidance application is activated (step S100). After starting the evacuation guidance application, the user selects a route search function (step S110). Then, the GPS information acquisition unit 100 acquires the GPS data Gda and transmits the GPS data Gda to the server 20 (step S120). Thereafter, server data Sda based on the GPS data Gda is received (step S130). That is, in step S <b> 130, the mobile terminal device 10 receives significant data Mda, air tag data Ada, character tag data Cda, and the like from the server 20.

  Next, the user inputs the personal status such as the user's disaster status and athletic ability using the personal status input means 141 (step S140). In addition, the user inputs the moving means and the movable distance through the movable distance input means 142 (step S150). Further, the user inputs a peripheral situation such as a disaster situation or a congestion situation around the user by the peripheral situation input unit 143 (step S160).

  After the user inputs the personal situation, the moving means / movable distance, and the surrounding situation, an evacuation route search process (a process for searching for an evacuation site / evacuation route) by the evacuation route searching means 140 is executed (step) S170). After execution of the evacuation route search process, the user captures a landscape video by the video imaging unit (camera) 15 and displays the landscape video in the video display area 18b of the display unit 18 (step S180).

  Thereafter, the map display means 150 displays the map, road, shelter, and evacuation route in the map display area 18a of the display unit 18 (step S190). Then, an air tag as information provided for the guidance of the evacuation route is superimposed on the landscape video displayed in the video display area 18b (step S200). Also, landmarks corresponding to each air tag are displayed on the map in the map display area 18a (step S210). Further, a character tag corresponding to each air tag is displayed in the video display area 18b (step S220). Furthermore, a link line connecting the air tag and the character tag is displayed on the display unit 18 (step S230).

  As described above, for example, an image as shown in FIG. 11 is displayed on the display unit 18 at the end of step S190, and an image as shown in FIG. 19 is displayed on the display unit 18 at the end of step S200. At the end of step S210, an image as shown in FIG. 14 is displayed on the display unit 18. At the end of step S220, an image as shown in FIG. 15 is displayed on the display unit 18, and the end of step S230 is completed. At the time, an image as shown in FIG. 17 is displayed on the display unit 18. However, since the processing time from step S190 to step S230 is extremely short, an image as shown in FIG. 17 is immediately perceived by human eyes.

  In the present embodiment, the route search step is realized by step S170, the video display step is realized by step S180, the map display step is realized by step S190, and the first augmented reality image display step is executed by step S200. The step S220 realizes the second augmented reality image display step, and the step S230 realizes the link line display step.

<4. Character tag>
Next, the character tag displayed in the video display area 18b by the character tag display means 182 will be described in detail.

<4.1 Display of multiple character tags>
When a plurality of character tags are displayed in the video display area 18b, the arrangement positions of the character tags in the video display area 18b are determined so that the plurality of character tags do not overlap each other. If two character tags (character tag M2 and character tag M3) are arranged side by side in the horizontal direction on the screen and the two character tags overlap each other as shown in FIG. 20 (a), they are shown in FIG. 20 (b). Thus, the arrangement position in the vertical direction on the screen is made different between the character tag M2 and the character tag M3. In this way, regarding any two character tags displayed in the video display area 18b, the two character tags are prevented from overlapping each other.

  For example, as shown in FIG. 21A, when the total number of characters of two character tags (character tag M4 and character tag M5) is relatively small, these two character tags are arranged side by side. The In contrast, as shown in FIG. 21B, when the total number of characters of the two character tags (character tag M6 and character tag M7) is relatively large, one character tag (this In the example, the character tag M7) is arranged below the other character tag (in this example, the character tag M6).

  Further, in the present embodiment, when a plurality of character tags are arranged in the vertical direction as shown in FIG. 21B, the character tag representing an object / event at a distance far from the current position (user's position). It is arranged above the video display area 18b. However, the present invention is not limited to this, and a character tag representing an object / event that is closer to the current position may be arranged above the video display area 18b, or a plurality of characters according to other predetermined rules. A tag may be arranged in the video display area 18b.

<4.2 Character tag display position>
In the present embodiment, when a character tag is displayed, the character tag is displayed in a state of being fixed at substantially the same position. Specifically, the character tag is displayed at a position within a limited range that can move by a minute distance. In other words, the character tag is not fixed at the exact same position during the displayed period and can move a small distance. For example, when the character tag M8 is displayed as shown in FIG. 22, the character tag M8 can move within the range indicated by the dotted line 50. As described above, the character tag is displayed in a state where it can move by a minute distance in the vertical direction and the horizontal direction.

  However, when the arrangement order of the character tags changes with the change in the distance from the current position to the thing / event corresponding to each character tag, each character tag can move greatly. For example, assume that four character tags M11 to M14 are displayed as shown in FIG. Here, attention is paid to the character tag M12 and the character tag M13. In the example shown in FIG. 23A, the distance from the shelter corresponding to the character tag M12 to the current position is longer than the distance from the shelter corresponding to the character tag M13 to the current position. The character tag M12 is also arranged on the upper side. Here, it is assumed that the distance from the shelter corresponding to the character tag M13 to the current position becomes longer than the distance from the shelter corresponding to the character tag M12 to the current position due to the user following the evacuation route. . In this case, as shown in FIG. 23B, the character tag M13 is disposed above the character tag M12. Further, it is assumed that four character tags M11 to M14 are displayed as shown in FIG. Here, it is assumed that a new character tag M15 is to be displayed due to the user following the evacuation route. At this time, if the distance from the object (here, the station) corresponding to the character tag M15 to the current position is the longest, as shown in FIG. 24B, the character tag M15 is arranged at the uppermost position, and the character tags M11 to M11. M14 is arranged below the original position.

  As described above, in the present embodiment, during a period in which one or more character tags are displayed in the same order, each character tag is fixed at substantially the same position (a position within a range that can be moved by a minute distance). It is displayed in the state. However, the present invention is not limited to this. During the period when one or more character tags are displayed in the same order, the display position of each character tag may be completely fixed, or each character tag may be moved by a minute distance in only one of the vertical and horizontal directions. You may make it possible. In this regard, if the character tag is displayed in a completely fixed state, there is a concern that the user misidentifies the character tag as, for example, a button (menu button). In this respect, if the character tag is configured to be able to move by a minute distance, for example, the character tag slightly moves with the movement of the user, so that the above-described misidentification by the user is prevented.

<4.3 Position of character tag in landscape video>
When the user captures a landscape video using the video imaging unit 15, as shown in FIG. 25, an empty video of the landscape video is displayed in the area above the video display area 18b (area indicated by reference numeral 40). Is often displayed. Even if various kinds of information are displayed in the area where such an empty image is displayed, it is considered that the various kinds of information do not hinder the user from evacuating while looking at the screen. Therefore, in the present embodiment, a character tag is arranged in an area above the video display area 18b (an area where an empty video is displayed). At this time, as described above, when a plurality of character tags are displayed, the arrangement positions of the character tags are determined so that the plurality of character tags do not overlap each other.

<5. Link line>
Next, the link line displayed on the display unit 18 by the link line display unit 181 will be described in detail.

<5.1 Relationship between link lines and character tags>
In the present embodiment, when the air tag and the character tag are connected by the link line, the end of the link line on the character tag side is arranged at the substantially central portion in the longitudinal direction of the character tag. Accordingly, the link line is displayed as shown in FIG. 26, for example. In this way, by arranging one end portion of all the link lines almost at the center portion in the longitudinal direction of the character tag, for example, when a plurality of character tags M16 to M18 are displayed as shown in FIG. It can be easily understood that the character tag M16 corresponds to the link line LK16, the character tag M17 corresponds to the link line LK17, and the character tag M18 corresponds to the link line LK18. Note that the end of the link line on the character tag side is not necessarily arranged at the substantially central portion in the longitudinal direction of the character tag. For example, the end of the link line on the character tag side may be arranged at one end in the longitudinal direction of the character tag.

<5.2 Link line color>
In this embodiment, the color of each link line is the same as the color of the corresponding air tag and the color of the corresponding character tag. This makes it easy for the user to grasp the correspondence between the air tag, the character tag, and the link line. However, the present invention is not limited to this, and the color of the link line is not necessarily the same as the color of the corresponding air tag and the color of the corresponding character tag.

<5.3 Drawing link lines>
When the orientation of the mobile terminal device 10 is changed by the user or when the position of the mobile terminal device 10 is moved by the user following the evacuation route, the position of the air tag displayed in the video display area 18b changes. The link line follows such a change in the position of the air tag. That is, the link line display means 181 draws the link line in real time according to the change in the position of the air tag displayed in the video display area 18b.

  For example, assume that the air tag A20, the character tag M20, and the link line LK20 are displayed as shown in FIG. Here, for example, it is assumed that the position of the air tag A20 is moved as indicated by an arrow 51 in FIG. 28B in the video display area 18b due to the user changing the traveling direction. At this time, the link line LK20 changes from the state shown in FIG. 28A to the state shown in FIG. 28C in accordance with the change in the position of the air tag A20.

  By the way, in the evacuation guidance system according to the present embodiment, display setting is performed such that, for example, an air tag representing an object / event within a predetermined range from the current position is displayed in the video display area 18b. However, for things / events that are outside the range of the viewing angle of the user, even if they are within a predetermined range from the current position, the air tag representing the things / events is not displayed in the video display area 18b. In such a case, in this embodiment, the character tag corresponding to the air tag is displayed in the video display area 18b. Then, a link line is displayed so as to extend from the character tag displayed in the video display area 18b to the virtual display position of the air tag outside the video display area 18b. In other words, if the position of the air tag corresponding to the character tag is outside the video display area 18b and the position of the air tag is defined as the virtual display position, the link line display means 181 moves from the character tag display position to the virtual display position. A link line is displayed so as to extend.

  For example, assume that at a certain point in time, the air tag A21, the character tag M21, and the link line LK21 are displayed as shown in FIG. Here, for example, it is assumed that the position of the air tag A21 has moved as indicated by the arrow 52 in FIG. 29B due to the user following the evacuation route (the position of the air tag A21 after the movement is the video display area). 18b). At this time, the link line LK21 changes from the state shown in FIG. 29A to the state shown in FIG. 29C in accordance with the change in the position of the air tag A21.

<6. Effect>
According to the present embodiment, the mobile terminal device 10 has an evacuation route search means 140 for searching for an evacuation route, a map display means 150 for displaying a map indicating the evacuation route in the map display area 18a, and a user taking a picture. Image display means 170 for displaying a landscape image, air tag display means 180 for displaying an air tag as information provided for evacuation route guidance superimposed on the landscape image, and information for evacuation route guidance. Character tag display means 182 for displaying a character tag and link line display means 181 for displaying a link line connecting the air tag and the character tag are provided. With the above configuration, an air tag as information useful for evacuation and a character tag corresponding to the air tag are displayed together with a landscape video in the video display area 18b, and a map indicating the evacuation route is displayed in the map display area 18a. . The air tag and the character tag are connected by a link line. For this reason, it becomes easy to grasp the correspondence between each air tag and the corresponding character tag. Therefore, the user can easily grasp which air tag each character tag is explaining. Each character tag is displayed in a state of being fixed at substantially the same position. For this reason, the fluctuation | variation of the display position of the character tag accompanying a user's movement is suppressed. Thereby, even if the user moves and uses the evacuation guidance application, an image having good visibility is provided to the user. As described above, according to the present embodiment, the user can easily understand which things / events the character tag displayed on the screen has good visibility and explain. A possible evacuation guidance system is realized.

  In addition, according to the present embodiment, by providing the character tag display means 182, information useful for tracing the information of each air tag, that is, the evacuation route (for example, the detailed location where the fire has occurred). Information) can be provided to the user in text. Thereby, when a disaster occurs, more detailed information is provided to the user, and the user can evacuate safely and reliably.

  Furthermore, according to the present embodiment, the air tag, the character tag, and the link line corresponding to each other have the same color. For this reason, the user can easily grasp the correspondence between the air tag, the character tag, and the link line. This makes it possible to evacuate the user more quickly.

  Furthermore, according to the present embodiment, the character tag is arranged in the area above the video display area 18b (area where an empty video is displayed). If a character tag is arranged in the vicinity of an air tag corresponding to the character tag, as shown in FIG. 30 (a), air tags and character tags are closely mixed in the area where the buildings and roads are displayed in the landscape video. Will be. Thus, an image in which air tags and character tags are densely mixed is an image with poor visibility for the user. In addition, there is a concern that useful information during evacuation may be hidden by character tags. From the above, when a character tag is displayed as shown in FIG. 30A, it is difficult for the user to quickly and correctly grasp the direction of travel, especially when the user is in a panic due to a disaster. . In this regard, according to the present embodiment, as shown in FIG. 30B, the character tag is displayed in an area 40 (an area where an empty image is displayed) above the image display area 18b. For this reason, air tags and character tags are not mixed closely in the video display area 18b, and useful information is not hidden by the character tags. In addition, the character tag can provide the user with detailed information regarding an object (for example, a shelter) or an event (for example, a fire) indicated by the air tag. Furthermore, as described above, since the air tag and the character tag are connected by the link line, even if the character tag is displayed at a position away from the air tag, the user can easily grasp the correspondence between the character tag and the air tag. It becomes possible.

<7. Variations>
<7.1 First Modification>
In the above embodiment, the character tag is displayed in the video display area 18b. However, the present invention is not limited to this. In this modification, as shown in FIG. 31, a character display area 18c dedicated to character tags is provided separately from the map display area 18a and the video display area 18b. All the character tags are displayed in the character display area 18c.

  In this modification, the air tag is displayed in the video display area 18b, and the character tag is displayed in the character display area 18c. That is, the air tag and the character tag are displayed in different areas. Therefore, the air tag and the character tag are not mixed. In addition, since the character tag is displayed in an area dedicated to the character tag, useful information is not hidden by the character tag. Furthermore, since the air tag and the character tag are connected by a link line as in the above embodiment, the user can easily grasp the correspondence between the character tag and the air tag.

<7.2 Second Modification>
In the above embodiment, the character tag and the air tag are connected by the link line. However, the present invention is not limited to this, and the character tag and the landmark in the map display area 18a may be connected by a link line (configuration of this modification).

  In this modification, the link line display means 181 is based on the position data of each character tag displayed in the video display area 18b and the position data of the landmark corresponding to each character tag. A link line connecting the character tag and the corresponding landmark is displayed on the display unit 18. Thus, for example, as shown in FIG. 32, an image in which the character tag in the video display area 18b and the landmark in the map display area 18a are connected by the link line is displayed on the display unit 18.

<7.3 Third Modification>
In the above embodiment, the character tag and the air tag are connected by the link line. In the second modification, the character tag and the landmark are connected by a link line. In this regard, in each mobile terminal device 10, one end of the link line may be switched between the air tag and the landmark (configuration of the present modification). According to such a configuration, when setting that one end of the link line is an air tag is performed in the mobile terminal device 10, a link line connecting the character tag and the air tag is displayed as shown in FIG. Is done. Further, when setting is performed to make one end of the link line a landmark in the mobile terminal device 10, a link line connecting the character tag and the landmark is displayed as shown in FIG. In this way, the user can switch the connection destination of the link line as necessary.

<7.4 Other>
In the above embodiment, the map display area 18a is arranged above the display unit 18, and the video display area 18b is arranged below the display unit 18 (see FIG. 3 and the like). However, the present invention is not limited to this, and as shown in FIG. 34, a map display region 18 a may be disposed below the display unit 18, and a video display region 18 b may be disposed above the display unit 18.

  Moreover, in the said embodiment, although the route guidance apparatus based on this invention showed the example implement | achieved by the portable terminal device 10, this invention is not limited to this. For example, the route guidance device according to the present invention can be realized by a terminal device other than the mobile terminal device 10 such as a head-mounted display (head-mounted display device).

  Furthermore, in the said embodiment, although the evacuation guidance system was mentioned and demonstrated as an example, this invention is not limited to this. The present invention can also be applied to a general navigation system for guiding a travel route from a current position to a destination to a user.

DESCRIPTION OF SYMBOLS 10 ... Portable terminal device 18 ... Display part 18a ... Map display area 18b ... Video display area 20 ... Server 130 ... Data storage means 140 ... Evacuation route search means 150 ... Map display means 152 ... Landmark display means 170 ... Video display means 180 ... Air tag display means 181 ... Link line display means 182 ... Character tag display means

Claims (25)

A route guidance device for guiding a travel route to a destination,
A route search means for searching for a route to the destination based on a condition input by the user;
Video display means for displaying a video being shot in a predetermined video display area;
A first augmented reality image, which is an image represented by a graphic of the augmented reality image representing the information provided for the guidance of the travel route, is displayed in a superimposed manner on the captured video displayed by the video display means. 1 augmented reality image display means;
A second augmented reality that displays a second augmented reality image corresponding to the first augmented reality image, which is an image represented by characters in the augmented reality image representing information used for guiding the travel route. Image display means;
Map display means for displaying in a predetermined map display area a map indicating the travel route obtained by the route search means and a landmark corresponding to the second augmented reality image;
One end and one of said first augmented reality image or the landmark at each time point, and a link line display means for displaying the link line to the other end and said second augmented reality image,
The second augmented reality image display means has a range in which each second augmented reality image can be moved by a minute distance during a period in which one or more second augmented reality images are displayed in the same order. In position ,
The link line display means can switch one end of the link line between the first augmented reality image and the landmark . The link line display means includes
Displaying a link line having one end as the first augmented reality image and the other end as the second augmented reality image;
The route guidance device according to claim 1, wherein the link line is drawn in real time according to a change in the position of the first augmented reality image displayed in the video display area. When the position of the first augmented reality image when the position of the first augmented reality image corresponding to the second augmented reality image exists outside the video display area is defined as a virtual display position, the link line The route guidance apparatus according to claim 2 , wherein the display unit draws the link line so as to extend from the display position of the second augmented reality image to the virtual display position. The display position of each second augmented reality image is completely fixed during a period in which one or more of the second augmented reality images are displayed in the same arrangement order. 4. The route guidance device according to any one of up to 3 . During a period in which one or more second augmented reality images are displayed in the same order, each second augmented reality image can move only a minute distance in one of the vertical direction and the horizontal direction. The route guidance device according to any one of claims 1 to 3 . The second augmented reality image display means displays the plurality of second augmented reality images so that any two second augmented reality images do not overlap each other when displaying the plurality of second augmented reality images. The route guidance device according to any one of claims 1 to 5 , wherein a real image is arranged. The said 2nd augmented reality image display means displays the said 2nd augmented reality image in the area | region above the center part of the said image | video display area, Any of Claim 1-6 characterized by the above-mentioned. The route guidance device according to claim 1. Said second augmented reality image display means, and displaying said second augmented reality image in a region corresponding to the image is being displayed on the blank of the captured image, according to claim 7 Route guidance device. The second augmented reality image display means displays the second augmented reality image in a character display area provided separately from the video display area and the map display area. 9. The route guidance device according to any one of items 1 to 8 . The link line display means displays each link line so that an arbitrary second augmented reality image and a link line corresponding to the second augmented reality image have the same color. Item 10. The route guidance device according to any one of items 1 to 9 . The second augmented reality image display means is configured so that each first augmented reality image and each second augmented reality image corresponding to the first augmented reality image have the same color. The route guidance apparatus according to claim 10 , wherein a real image is displayed. It said route search means uses the information of the roads and shelters, and performs a search for escape routes to the shelter and the shelter is a destination, one of the claims 1 to 11 1 The route guidance device according to item. A route guidance method for guiding a travel route to a destination using a terminal device,
A route search step in which the terminal device searches for a travel route to a destination based on a condition input by a user of the terminal device;
A video display step of displaying a video being shot in a predetermined video display area of the terminal device;
A first augmented reality image, which is an image represented by a graphic of the augmented reality image representing the information provided for the guidance of the travel route, is displayed in a superimposed manner on the captured image displayed in the image display step. 1 augmented reality image display step;
A second augmented reality that displays a second augmented reality image corresponding to the first augmented reality image, which is an image represented by characters in the augmented reality image representing information used for guiding the travel route. An image display step;
A map display step for displaying a map indicating the travel route obtained in the route search step and a landmark corresponding to the second augmented reality image in a predetermined map display region of the terminal device;
One end and one of said first augmented reality image or the landmark at each time point, and a link line display step of displaying a link line that the other end and said second augmented reality image,
In the second augmented reality image display step, each of the second augmented reality images is within a range in which the second augmented reality image can move by a minute distance during a period in which one or more second augmented reality images are displayed in the same order. Displayed in the position ,
In the link line displaying step, one end of the link line can be switched between the first augmented reality image and the landmark . A route guidance program executed by a terminal device for guiding a traveling route to a destination,
A route search step for searching for a travel route to a destination based on a condition input by a user of the terminal device;
A video display step of displaying a video being shot in a predetermined video display area of the terminal device;
A first augmented reality image, which is an image represented by a graphic of the augmented reality image representing the information provided for the guidance of the travel route, is displayed in a superimposed manner on the captured image displayed in the image display step. 1 augmented reality image display step;
A second augmented reality that displays a second augmented reality image corresponding to the first augmented reality image, which is an image represented by characters in the augmented reality image representing information used for guiding the travel route. An image display step;
A map display step for displaying a map indicating the travel route obtained in the route search step and a landmark corresponding to the second augmented reality image in a predetermined map display region of the terminal device;
Computer included one end and one of said first augmented reality image or the landmark at each time point, and a link line display step of displaying a link line that the other end and said second augmented reality image to the terminal apparatus CPU is executed using memory,
In the second augmented reality image display step, each of the second augmented reality images is within a range in which the second augmented reality image can move by a minute distance during a period in which one or more second augmented reality images are displayed in the same order. Displayed in the position ,
In the link line display step, one end of the link line can be switched between the first augmented reality image and the landmark . In the link line display step,
A link line having one end as the first augmented reality image and the other end as the second augmented reality image is displayed,
15. The route guidance program according to claim 14 , wherein the link line is drawn in real time according to a change in the position of the first augmented reality image displayed in the video display area. When the position of the first augmented reality image when the position of the first augmented reality image corresponding to the second augmented reality image exists outside the video display area is defined as a virtual display position, the link line 16. The route guidance program according to claim 15 , wherein in the display step, the link line is drawn so as to extend from the display position of the second augmented reality image to the virtual display position. During the one or more of said second augmented reality image is displayed in the same order, the display position of each second augmented reality image is characterized by being completely fixed, claim 14 The route guidance program according to any one of up to 16 . During a period in which one or more second augmented reality images are displayed in the same order, each second augmented reality image can move only a minute distance in one of the vertical direction and the horizontal direction. The route guidance program according to any one of claims 14 to 16 . In the second augmented reality image display step, when the plurality of second augmented reality images are displayed, the plurality of second augmented reality images are prevented from overlapping each other. The route guidance program according to any one of claims 14 to 18 , wherein an augmented reality image is arranged. In said second augmented reality image display step, and said second augmented reality image over the regions are displayed than the center portion of the image display area, from the claims 14 to 19 The route guidance program according to any one of the above items. In said second augmented reality image display step, and said second augmented reality image to the region image corresponding to the empty of said photographic image is being displayed is displayed, in claim 20 The described route guidance program. The second augmented reality image display step displays the second augmented reality image in a character display area provided separately from the video display area and the map display area. The route guidance program according to any one of 14 to 21 . In the link line display step, each link line is displayed so that an arbitrary second augmented reality image and a link line corresponding to the second augmented reality image have the same color, The route guidance program according to any one of claims 14 to 22 . In the second augmented reality image display step, each second augmented reality image and each second augmented reality image corresponding to the first augmented reality image have the same color. The route guidance program according to claim 23 , wherein a real image is displayed. 25. The route search step according to any one of claims 14 to 24 , characterized in that a search for an evacuation route to a destination and the evacuation route to the evacuation site is performed using road and evacuation site information. The route guidance program according to item 1.

Images