JP2011179967A - Map display controller, map display control method and map display control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve the convenience of a service using a digital map. <P>SOLUTION: A map display controller comprises: a first storage means for storing a two-dimensional map image and coordinate information mapped to each other; a second storage means for storing a three-dimensional map image, the coordinate information and the sight line direction mapped to each other; a first display control means for implementing a control for reading the two-dimensional map image having the coordinate information corresponding to a current position from the first storage means, identifying the three-dimensional map image having the coordinate information corresponding to a predetermined position from the second storage means with regard to the predetermined position existing on a route from the current position to a destination, and displaying and overlapping the two-dimensional map image with three-dimensional map direction information representing the sight line direction of the identified three-dimensional map image; a second display control means for implementing a control for displaying the three-dimensional map image stored in the second storage means; and a switch means for controlling so that the two-dimensional map image and the three-dimensional map image are switched and displayed. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a technique for controlling map display, and more particularly to a technique for controlling display of a two-dimensional map and a three-dimensional map.

  Various services using digital maps are provided. Patent Document 1 describes a navigation device mounted on a vehicle as an example of such a service. The navigation device displays a two-dimensional map in which the first intersection and the second intersection fit on the display screen when the first intersection on the route is bent, and the second intersection when the second intersection is bent. A two-dimensional map with a scale higher than that of the three-dimensional map is displayed on the display screen, and then a three-dimensional map based on the vehicle is displayed on the display screen.

Japanese Patent No. 4077304

  With the rapid spread of mobile terminals, the Internet, navigation systems, etc., the use of digital maps is expanding in various scenes. As a result, there is a growing need among users for improving the convenience of services using digital maps. For example, a new service using a three-dimensional map that is intuitive and easy to understand is expected among users of mobile terminals.

  However, in a portable terminal such as a cellular phone, there are restrictions on the physical size, processing capability, cost, etc. of the device. For this reason, it is difficult to directly apply a configuration in which map information read from a CD-ROM is stored in the device or a navigation controller is provided, as in the navigation device described in Patent Document 1. . Since a 3D map has a larger amount of data and a longer processing time than a 2D map, when handling a 3D map on a mobile terminal, it is necessary to consider problems such as processing capacity of the mobile terminal and network communication load. is there.

  For example, in the navigation device described in Patent Literature 1, the 3D map is continuously displayed along the route so that the line-of-sight direction of the 3D map always matches the line-of-sight direction of the user. However, it is difficult to generate a three-dimensional map in real time along a route in a portable terminal with limited processing capability. Therefore, for example, it is conceivable to reduce the processing burden by preparing a three-dimensional map in a predetermined line-of-sight direction in advance for the corresponding part. However, in such a case, since the line-of-sight direction of the 3D map is specified, if the line-of-sight direction of the 3D map does not match the user's line-of-sight direction at the time of switching from the 2D map, the user It is not possible to move smoothly from a map to a 3D map.

  Further, the two-dimensional map has an advantage that the sense of distance and the positional relationship can be easily grasped, whereas the three-dimensional map has an advantage that the situation of the place is easy to grasp. As described above, since the two-dimensional map and the three-dimensional map each have merits according to the display form, which map is more convenient depends on the reading ability and preferences of the user, and the map. Varies depending on the situation when using. Therefore, if the two-dimensional map and the three-dimensional map are always automatically switched as in the navigation device described in Patent Document 1, the convenience for the user may be lowered.

  Therefore, the present invention is to provide a map display control device that can further improve the convenience of service using a digital map by appropriately using both a two-dimensional map and a three-dimensional map.

  The map display control device according to the present invention includes a first storage means for storing a two-dimensional map image and coordinate information in association with each other, and a second storage means for storing a three-dimensional map image, coordinate information and a line-of-sight direction in association with each other. Then, a two-dimensional map image having coordinate information corresponding to the current position is read from the first storage means, and for a predetermined position existing on the route from the current position to the destination, coordinate information corresponding to the predetermined position is obtained. A first three-dimensional map image is specified from the second storage means, and three-dimensional map direction information indicating the line-of-sight direction of the specified three-dimensional map image is controlled to be superimposed on the two-dimensional map image. Display control means; second display control means for controlling the 3D map image stored in the second storage means to be displayed; and switching between the 2D map image and the 3D map image. And switching means for controlling so as to be displayed, comprising.

  The first display control means specifies a three-dimensional map image having a line-of-sight direction corresponding to the direction along the route for the predetermined position from the second storage means, and the line-of-sight direction of the specified three-dimensional map image Control may be performed so that the three-dimensional map direction information representing is superimposed on the two-dimensional map image.

  The second display control means may perform control so that line-of-sight direction information representing the line-of-sight direction of the three-dimensional map image is superimposed and displayed on the three-dimensional map image.

  The first display control means links a building tag to a building having coordinate information in the map area of the two-dimensional map image, the building tag is superimposed and displayed at the position of the corresponding building on the two-dimensional map image, You may control so that the attribute information of the building linked | linked with the building tag is displayed on the same screen as the said building tag.

  The second display control means associates a building tag with a building having coordinate information within the display area of the two-dimensional map image, the building tag is superimposed and displayed at the position of the corresponding building on the three-dimensional map image, You may control so that the attribute information of the building linked | linked with the building tag is displayed on the same screen as the said building tag.

  When the two-dimensional map image is displayed by the first display control means, the switching means is provided on the condition that the current position updated in accordance with the movement of the user substantially matches the predetermined position on the route. In addition, the two-dimensional map image may be controlled to be displayed by switching to the three-dimensional map image.

  When the two-dimensional map image is displayed by the first display control unit, the switching unit is configured to display the two-dimensional map image on the condition that a switching instruction to the three-dimensional map image is input. You may control to switch to a three-dimensional map image and display.

  When the additional information specified based on the current position and the direction of the line of sight of the camera at the time of shooting is combined and displayed on the captured image displayed on the display, the switching unit is configured to display the additional information combined and displayed. Instead of the video, the first display control means may be controlled so that a two-dimensional map image specified based on the current position is displayed.

  When the additional information specified based on the current position and the direction of the line of sight of the camera at the time of shooting is combined and displayed on the captured image displayed on the display, the switching unit is configured to display the additional information combined and displayed. Instead of the video, the second display control means may be controlled so that a three-dimensional map image specified based on the current position and the line-of-sight direction is displayed.

  The present invention is also a map image control method in a map image display control device, wherein a two-dimensional map having coordinate information corresponding to a current position from a first storage device that stores a two-dimensional map image and coordinate information in association with each other. An image is read, and for a predetermined position existing on the route from the current position to the destination, a three-dimensional map image having coordinate information corresponding to the predetermined position is associated with the three-dimensional map image, the coordinate information, and the line-of-sight direction. And a first display control step for controlling the 3D map direction information indicating the line-of-sight direction of the specified 3D map image to be superimposed and displayed on the 2D map image. Switching the screen including the 2D map image to the screen including the 3D map image, and displaying the 3D map image stored in the second storage device A second display control step of controlling comprises.

  Further, the present invention is also realized as a program for causing a computer to execute the above steps. This program can be installed or loaded on a computer through various recording media such as an optical disk such as a CD-ROM, a magnetic disk, and a semiconductor memory, or via a communication network.

  Further, in this specification and the like, the term “means” does not simply mean a physical means, but includes a case where the functions of the means are realized by software. Further, the function of one means may be realized by two or more physical means, or the functions of two or more means may be realized by one physical means.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide the map display control apparatus which can improve the convenience of the service using a digital map more appropriately by using both a 2D map and a 3D map. .

It is a block diagram which shows schematic structure of a map display control system. It is a block diagram which shows schematic structure of a portable terminal. It is a figure which shows an example of the two-dimensional map screen displayed on a portable terminal. It is a figure which shows an example of the three-dimensional map screen displayed on a portable terminal. It is a figure which shows an example of the screen transition displayed on a portable terminal. It is a flowchart which shows an example of the flow of a map display control process. It is a figure which shows the other example of the screen transition displayed on a portable terminal.

  Hereinafter, in the embodiment of the present invention, as an example, a two-dimensional map (hereinafter also referred to as “2D map” or “two-dimensional map image”) and a three-dimensional map (hereinafter referred to as “3D map” or “three-dimensional map image”). A map display control apparatus suitable for providing a map display service using a mobile terminal such as a mobile phone will be described.

  In the present embodiment, the 2D map and the 3D map generated on the map display control device side are transmitted to the mobile terminal in consideration of the processing capability and network communication load of the mobile terminal.

  In this embodiment, information representing the position and line-of-sight direction of a 3D map that can be used on the route of the 2D map (hereinafter referred to as “3D map direction information”) is superimposed on the 2D map. it's shown. According to this, since the user can grasp in advance the line-of-sight direction of the 3D map at the time of switching, for example, the traveling direction (north) at the time when the user arrives at the intersection and the 3 displayed at the intersection. Even when the line-of-sight direction (east) of the three-dimensional map does not match, it is possible to smoothly shift to the three-dimensional map without being confused.

  In this embodiment, in order to display an optimum map according to the user's preference and usage situation, a screen for displaying a 2D map (hereinafter referred to as “2D map screen”) and a 3D map are displayed. The screen (hereinafter referred to as a “three-dimensional map screen”) is configured so that the user can switch arbitrarily.

  Other features of the map display control device according to the present embodiment will be described in more detail with reference to the drawings. In each description, the same elements are denoted by the same reference numerals, and redundant description is omitted.

[Configuration of map display control system]
FIG. 1 is a block diagram showing a schematic configuration of a map display control system 100 to which the map display control device according to the present embodiment is applied. The map display control system 100 includes a map display control device 10 and a mobile terminal 20, and is configured by connecting them via a network N.

  The map display control apparatus 10 includes a main control unit 101, a storage unit 102, a communication unit 103, a route guide unit 104, a first display control unit 105, a second display control unit 106, a switching unit 107, and an augmented reality (AR). ) Mainly includes various function realizing means such as the processing means 108.

  Although not shown, the map display control device 10 has a CPU, a memory such as a ROM and a RAM, an external storage device for storing various information, an input interface, an output interface, a communication interface, and a bus connecting these. Alternatively, a general-purpose server computer can be applied. For example, when the CPU executes a predetermined program stored in a ROM or the like, it functions as each of the function realizing means. Note that the map display control device 10 may be configured by a single computer or may be configured by a plurality of computers distributed on a network.

  The main control means 101 controls the entire operation of the map display control apparatus 10 and the operation of each means described above. The storage means 102 includes 2D map data for displaying a 2D map, 3D map data for displaying a 3D map, building information (building information) regarding a building (building) in the map area, And has a function as a database. The storage means 102 is also called a two-dimensional map data storage means, a three-dimensional map data storage means, and a building information storage means.

  Although there is no particular limitation on the data structure of each data in the storage unit 102, for example, a map image (two-dimensional map image) and coordinate information (latitude and longitude) of the map are associated with the two-dimensional map data. ing. The two-dimensional map image corresponds to, for example, a mesh map, but is not limited thereto. The three-dimensional map data includes, for example, a photographed image (still image) of a landscape on a map photographed by a camera, a CG image (three-dimensional map image) created using a virtual camera, coordinate information of the map, The line-of-sight direction of the camera is associated. In the present embodiment, a three-dimensional map image corresponding to a landscape in a predetermined direction at a predetermined position in the map area is stored. The predetermined position and the line-of-sight direction are not particularly limited.

  The building information is information regarding a predetermined building included in the map area. For example, identification information (building ID) for uniquely identifying a building and building attribute information are associated with each other. The building attribute information is, for example, building coordinate information, height, store information related to stores housed in the building, and the like. The store information includes a store name and other detailed information (address, telephone number, etc.).

  Here, building information can be used to superimpose and display a building tag and store information on a two-dimensional map and a three-dimensional map. The bill tag is a tag for uniquely specifying a predetermined building in the map area in the map area, and the store information is information on stores accommodated in the building corresponding to the building tag. There is no particular limitation on the method of superimposing and displaying the bill tag and the store information on the map. For example, the information is synthesized with a 2D / 3D map image in advance or synthesized in real time according to a request from the terminal device 20. There are ways to do it. As for the building tag, for example, a building having coordinates in the map area of a two-dimensional map (or three-dimensional map) is identified from the building information, and the tag is associated with the identified building (for example, the building is numbered in order). ), The linked tag can be synthesized at a position corresponding to the coordinates (and height) of the building on the map. For store information, for example, store information of a building to which a tag is attached is specified from the building information, and the specified store information is combined with a map image. The building tag and store information of the 2D map and 3D map displaying the same map area are synchronized, and the same building tag is displayed. Hereinafter, in the present embodiment, a case where the building tag and the store information are preliminarily synthesized with the 2D / 3D map image data and stored in the storage unit 102 will be described.

  The communication means 103 is an interface for transmitting and receiving various types of information by communicating with the mobile terminal 20 via the network N. The communication unit 103 also functions as a reception unit that receives current position specifying information and destination specifying information transmitted from the mobile terminal 20.

  The route guidance unit 104 specifies the current position (coordinates) based on the current position specifying information received by the communication unit 103, and specifies the destination (coordinates) based on the destination specifying information. Then, a route (route) from the identified current position to the destination is determined, and route guidance information is generated. The route guidance information corresponds to, for example, various types of information displayed on the map (an arrow indicating the traveling direction, a line indicating the entire route, a distance to the destination), voice information for guiding the user, and the like.

  The first display control unit 105 reads a two-dimensional map image corresponding to the current position from the storage unit 102 and transmits it to the portable terminal 20. The 2D map screen displayed based on the 2D map image will be described with reference to FIG.

  FIG. 3 is an example of the two-dimensional map screen 402. As shown in the figure, a two-dimensional map screen 402 includes a two-dimensional map image 402i, a bill tag 402a, store information 402b, store detailed information 402c, a guide sign 402d, three-dimensional map direction information 402e, route guide information 402f, and a photograph. A button 402g and a user position 402h are included. The display mode of various information included in the two-dimensional map screen 402 is not limited to that shown in the figure, and can be changed as appropriate according to the design.

  Specifically, a building tag 402a associated with a building is displayed superimposed on the two-dimensional map 402 image i, and store information 402b of a store housed in the building is displayed adjacent to the two-dimensional map image 402i. Yes. Further, detailed information 402c of the store selected by the user from the store information 402b is further superimposed and displayed. The user can easily check the buildings existing in the vicinity of the current position and the stores in the building by using the two-dimensional map 402 image i, the building tag 402a, the store information 402b, and the detailed information 402c. The detailed information can be acquired.

  In addition, when the user selects a destination, route guidance information for guiding a route from the current position to the destination can be displayed on the two-dimensional map screen 402. In the figure, as a result of the user selecting a predetermined store from the store information 402b, a route from the current position to the building containing the store is searched, and route guidance information 402f indicating the searched route is displayed. A user position 402h indicating the current position is displayed. The building tag (3) corresponding to the destination building is displayed in a display mode that is distinguishable from other building tags.

  In addition, when a 3D map image that can be displayed on the route from the current position to the destination is stored in the storage unit 102, the 2D map screen 402 represents the position and line-of-sight direction of the 3D map image. Information (three-dimensional map direction information) is superimposed and displayed on the two-dimensional map 402i. The 3D map image that can be displayed on the path of the 2D map image is, for example, a 3D map having coordinate information on the path displayed on the 2D map image. The first display control unit 105 determines the presence or absence of a 3D map image that can be displayed on the route by referring to the 3D map data stored in the storage unit 102, and if the determination result is correct, Three-dimensional map direction information is generated based on the coordinate information and the line-of-sight direction included in the three-dimensional map data, and the generated three-dimensional map direction information is combined with a two-dimensional map image. The presence or absence of a three-dimensional map image that can be displayed on the route is, for example, when the coordinate information of the three-dimensional map image is included in the coordinate information constituting the route, or the coordinate information of the three-dimensional map image is a predetermined position on the route It is possible to match the coordinate information. In addition to the coordinate information, other requirements can be added to the determination criteria. For example, a case where the traveling direction at a predetermined position on the route and the line-of-sight direction of the camera of the three-dimensional map are added is added. Also good. When the position and the line-of-sight direction are used as determination criteria, the three-dimensional map image that the user confirms on the route becomes a landscape along the traveling direction of the user, so that the user can more easily confirm the route.

  The display mode of the 3D map direction information is not particularly limited. For example, the 3D map direction information can be displayed by an arrow extending in the visual line direction from the vicinity of the coordinates of the 3D map image. In the figure, three-dimensional map direction information 402e is displayed on a route 402f from the user position 402h to the destination (building tag 3).

  Further, on the extension of the line-of-sight direction indicated by the three-dimensional map direction information 402e, as an example of information for guiding the direction (hereinafter referred to as “signpost information”), a sign (in FIG. No. "To Honjo Station") 402d is displayed. For example, the first display control unit 105 corresponds to the coordinate information and the line-of-sight direction of the three-dimensional map direction information 402e by referring to a table (not shown) in which the coordinate information, the line-of-sight direction, and the place name are stored in association with each other. A place name can be specified, sign information can be generated based on the specified place name, and the generated sign information can be synthesized at the line-of-sight direction extension position of the three-dimensional map direction information 402e.

  When there are a plurality of 3D map images that can be used on the route, a 3D map image can be selected according to a predetermined condition, and the 3D map direction information can be superimposed on the selected 3D map image. For example, all available 3D map images may be selected, or one or more 3D map images closest to the current position may be selected.

  The 2D map screen 402 displays switching instruction input means for inputting a switching instruction from the 2D map screen to the 3D map screen. As shown in the figure, a photo button 402g is superimposed on the two-dimensional map screen 402 as an example of a switching instruction input unit.

  The second display control unit 105 reads out a 3D map image corresponding to the current position and camera direction or 3D map direction information from the storage unit 102 and transmits it to the mobile terminal 20. It should be noted that the 3D map image corresponding to the 3D map direction information is when a point where the 3D map image can be used (hereinafter referred to as “3D map available point”) is away from the current position, that is, Even when the user has not arrived at the 3D map available point, it can be displayed. The 3D map screen displayed based on the 3D map image will be described with reference to FIG. The display mode of various information included in the three-dimensional map screen 403 is not limited to that shown in the figure, and can be changed as appropriate according to the design.

  FIG. 4 is an example of the 3D map screen 403. As shown in the figure, the 3D map screen 403 includes a 3D map image 403i, a bill tag 403a, store information 403b, detailed store information 403c, sign information 403d, line-of-sight information 403e, and a map button 403g. .

  Specifically, the building tag 403a set for each building is displayed superimposed on the 3D map image 403i, and the store information 403b of the store accommodated in the building is displayed adjacent to the 3D map image 403i. ing. Further, the detailed information 403c of the store selected from the store information 403b is further superimposed and displayed. Since these building information is the same as the building information on the two-dimensional map screen 402, description thereof is omitted.

  Further, on the three-dimensional map 403i, information (hereinafter referred to as “line-of-sight direction information”) 403e indicating the line-of-sight direction of the three-dimensional map image is superimposed and displayed. The line-of-sight direction information 403e can be generated based on the coordinate information of the three-dimensional map image and the camera line-of-sight direction, and the display mode is not particularly limited, but is represented by, for example, an arrow extending in the line-of-sight direction. In FIG. 6, the line-of-sight direction information 403e is displayed along the destination (building tag 3) direction from the substantially lower center of the three-dimensional map image 403i.

  In addition, sign information 403d (“To Honjo Station” in the drawing) is displayed on the extension of the direction indicated by the line-of-sight direction information 403e. The line-of-sight direction information 403e and the sign information 403d correspond to the three-dimensional map direction information 402e and the guide sign 402d on the two-dimensional map screen, respectively.

  In addition, a switching instruction input unit for inputting a switching instruction from the 3D map screen to the 2D map screen is superimposed and displayed on the 3D map screen 403. As shown in the figure, a map button 403g is superimposed on the 3D map screen 403 as an example of a switching instruction input unit.

  According to the two-dimensional map screen 402 and the three-dimensional map screen 403, the user grasps the sense of distance and the positional relationship from the current position to the destination with reference to the two-dimensional map screen, and also the three-dimensional map screen. The landscape in a predetermined direction on the route can be confirmed in advance with reference to FIG. Therefore, it is possible to reach the destination more reliably than when only the route is confirmed. Also, if you check the 2D map and 3D map in advance and memorize the route and scenery, you can skip the task of viewing the map each time you walk along the route, so you can more efficiently follow the destination. You will be able to arrive. Furthermore, when it is difficult to store a route or a landscape in advance, the user can move along the route while viewing the two-dimensional map, and can view the three-dimensional map at a timing that he / she thinks necessary. In addition, since common information is displayed on the two-dimensional map and the three-dimensional map, it is possible to smoothly shift from the map before switching to the map after switching.

  The switching unit 107 controls the first display control unit 105 and the second display control unit 106 so that the 2D map screen and the 3D map screen are switched and displayed on the mobile terminal 20. Switching by the switching means 107 can be performed based on, for example, a switching request (a switching request from a 2D map to a 3D map / a switching request from a 3D map to a 2D map) transmitted from the mobile terminal 20. . The switching means 107 may automatically switch according to a predetermined condition set in advance. For example, when both the two-dimensional map image and the three-dimensional map image are stored in the storage unit 102, the predetermined condition may be set so that the three-dimensional map screen is preferentially displayed. Note that the switching unit 107 is not limited to switching between the 2D map screen and the 3D map screen, but can also switch between an AR screen, which will be described later, and these 2D map and 3D map.

  The AR processing means 108, in the portable terminal 20, shows a building or the like present in the camera direction at the time of photographing when the subject image photographed by the photographing means (camera) 206 attached to the portable terminal 20 is projected on the display. Control is performed so that the additional information to be displayed is synthesized and displayed on the video image displayed on the display. The additional information is not particularly limited, but is, for example, building information of a building. The AR screen will be described with reference to FIG.

  FIG. 5 is an example of the AR screen 401. The AR screen 401 shown in the figure includes a video 401a, a building tag 401b, store information 401c, and route guidance information 401d as a result of the peripheral information search and route search performed by the user. However, it can be seen that it is difficult to recognize the background image 401a itself on the AR screen 401 in FIG. This is because the video used in the AR screen 401 is an actual landscape, and for example, when used at night or in the rain, the video becomes dark or cloudy. Even when used in the daytime in fine weather, if an obstacle such as a large car or a passerby is interposed between the mobile terminal 20 and the building intended by the user, it should be superimposed on the building. The bill tag is superimposed on the obstacle. In such a case, it is difficult to recognize the surrounding situation from the video of the AR screen, so it is desirable to switch the AR screen to another screen. Therefore, in the present embodiment, the switching unit 107 is configured to be able to arbitrarily switch the screen between the AR screen, the two-dimensional map screen, and the three-dimensional map screen.

  The mobile terminal 20 is a mobile phone, PDA, personal computer, portable navigation device, or other terminal device that can display map data. As shown in FIG. 2, the portable terminal 20 includes various function realizing means such as a main control means 201, a storage means 202, an input means 203, a display means 204, a communication means 205, a photographing means 206, and a position / orientation measuring means 207. Prepare.

  Although not shown, the portable terminal 20 includes a CPU that controls processing and operations of the portable terminal, a memory such as a ROM and a RAM, an external storage device that stores various information, an input interface, an output interface, a communication interface, a camera A dedicated or general-purpose computer including a GPS receiver, an electronic compass, and a bus connecting them can be applied. In addition, although the one portable terminal 20 is described in FIG. 1, the some portable terminal 20 can also be connected with the map display control apparatus 10 according to a utilization form. When the mobile terminal 20 receives information input from a user by executing a predetermined program stored in a memory or an external storage device, the mobile terminal 20 displays a map display request or the like based on the received information. When transmitting to the control device 10 and receiving map data or the like from the map display control device 10, a function of displaying a map image on the display based on this is realized.

  The network N is a communication line for transmitting and receiving information between the map display control device 10 and the mobile terminal 20. For example, it may be any of the Internet, a LAN, a dedicated line, a packet communication network, a telephone line, a corporate network, other communication lines, combinations thereof, and the like, regardless of whether they are wired or wireless.

[Map display control processing]
Next, the outline | summary of operation | movement of the map display control system 100 comprised as mentioned above is demonstrated. FIG. 6 is a flowchart showing the flow of map display control processing by the map display control device 10. In addition, each processing step to be described later can be executed in any order or in parallel as long as there is no contradiction in processing contents, and other steps may be added between the processing steps. . Further, a step described as one step for convenience can be executed by being divided into a plurality of steps, while a step described as being divided into a plurality of steps for convenience can be grasped as one step.

  In this embodiment, as an example of the map display control process, a case where the user performs peripheral information and route search, and the screen displaying the result transitions in the order of the AR screen, the 2D map screen, and the 3D map screen. Explained. However, the screen transition is not limited to this. For example, the map display control process is similarly applied to other screen transitions such as a screen transition in the order of a 2D map screen, a 3D map screen, and an AR screen. be able to.

  As a premise, the mobile terminal 20 displays a captured image on a display (AR screen) in accordance with a user operation. In this state, the mobile terminal 20 transmits a search request for additional information (building information) to the map display control device 10 based on a user operation input (S101). The building information search request includes current position specifying information for specifying the current position of the mobile terminal 20 and direction specifying information for specifying the camera direction at the time of shooting. Note that the additional information combined with the video on the AR screen is not limited in content, but here it is the building information described above.

  When the map display control device 10 receives a building information search request from the mobile terminal 20, the map display control device 10 corresponds to the current position specified by the current position specifying information included in the search request and the camera direction specified by the direction specifying information. Building information is generated by referring to the building information stored in the storage means 102 and transmitted to the portable terminal 20 (S102). The building information is, for example, a building tag of a building existing in the camera direction from the current position, and store information accommodated in the building.

  The portable terminal 20 receives the building information and superimposes it on the video displayed on the display (S103). FIG. 5 shows an example of an AR screen in which building information is superimposed on the video. On the AR screen 401, a building tag 401b representing a building and store information 401c in the building are superimposed and displayed on the video 401a in the camera direction. The user can select an arbitrary store as the destination from the store information 401b.

  Next, when an arbitrary store is selected by the user, the mobile terminal 20 transmits information on the selected store to the map display control device 10 as destination specifying information (S104).

  When receiving the destination specifying information, the map display control device 10 specifies the destination based on the received destination specifying information, determines the route from the current position to the destination, and provides route guidance representing the determined route. Information is transmitted to the portable terminal 20 (S105).

  The mobile terminal 20 receives the route guidance information, and superimposes it on the video displayed on the display (S106). In the AR screen 401 of FIG. 3, route guidance information 401d indicating the traveling direction is superimposed on the video 401a. This figure is an example when the user uses the AR screen when it is raining, and it is difficult to recognize the video 401a because it is dark and cloudy.

  When the mobile terminal 20 displays the AR screen, the mobile terminal 20 determines whether the AR screen is difficult to recognize. If the mobile terminal 20 determines that the AR screen is difficult to recognize, the mobile terminal 20 transmits a screen switching request to the map display control device 10 (S107). ). Moreover, the portable terminal 20 can also transmit a screen switching request | requirement to the map display control apparatus 10, when the screen switching instruction | indication is input from the user (S107).

  Upon receiving a request for switching from the AR screen to the 2D map screen or the 3D map screen, the map display control device 10 determines whether to switch to the 2D map screen or the 3D map screen according to a predetermined switching condition. (S108). The content of the switching condition is not particularly limited. For example, when a 3D map image corresponding to the current position and the camera direction is stored in the storage unit 102, the 3D map screen is selected, and the current position and When the 3D map image corresponding to the camera direction is not stored in the storage unit 102, the 2D map screen can be set to be selected. In addition, when designated in advance by the user, the designated map screen may be selected.

  When the two-dimensional map screen is selected, the map display control device 10 reads out a two-dimensional map image (a building tag or store information is synthesized) corresponding to the current position from the storage means 102 and can use it on the route. When a three-dimensional map image is stored in the storage means 102, three-dimensional map direction information and sign information of the three-dimensional map image are generated and combined with the two-dimensional map image, and the combined two-dimensional map image Is transmitted to the portable terminal 20 (S109). The portable terminal 20 receives the two-dimensional map image and displays a two-dimensional map screen on the display based on the two-dimensional map image (S110). FIG. 2 shows an example of a two-dimensional map screen displayed on the mobile terminal 20.

  In addition, when the 3D map screen is selected, the map display control device 10 can display a 3D map image corresponding to the current position and the camera direction (where the building tag and store information are combined), or the 3D screen direction. A three-dimensional map image corresponding to the information is read from the storage means 102, line-of-sight direction information and sign information are generated and combined with the three-dimensional map image data, and the combined three-dimensional map image is transmitted to the mobile terminal 20 (S111). ). The mobile terminal 20 receives the 3D map image and displays a 3D map screen on the display based on the received 3D map image (S112). FIG. 3 shows an example of a three-dimensional map screen displayed on the mobile terminal 20.

  The user can confirm the route to the current position and the destination on the two-dimensional map screen displayed on the mobile terminal 20. In addition, a landscape at a predetermined position on the route can be confirmed on the three-dimensional map screen. When the user wants to switch the displayed map screen to another map screen, the user selects a photo button on the 2D map screen or a map button on the 3D map screen. Further, the user can move toward the destination on the route while referring to the two-dimensional map screen.

  The portable terminal 20 transmits a screen switching request to the map display control device 10 based on the user's operation input (S113). Moreover, the portable terminal 20 transmits the current position specifying information updated with the movement to the map display control device 10 (S114).

  The map display control device 10 switches between the two-dimensional map screen and the three-dimensional map screen based on the screen switching request or the current position (S115). For example, when receiving the screen switching request, the map display control device 10 selects the map screen specified in the screen switching request.

  On the other hand, the map display control device 10 updates the current position of the user based on the current position specifying information updated with the movement of the user, and the updated current position is coordinate information specified by the three-dimensional map direction information. Is substantially the same, the 3D map screen is selected. On the other hand, when the updated current position does not substantially match the coordinate information specified by the 3D map direction information, the 2D map screen is maintained. When the 2D map screen is selected, the map display control device 10 proceeds to S109, and when the 3D map screen is selected, the map display control device 10 proceeds to S111.

  As described above, according to the present embodiment, both the two-dimensional map and the three-dimensional map can be appropriately used, so that the convenience of the service using the digital map can be further improved. In particular, since the 3D map direction information is superimposed and displayed on the 2D map, the user can grasp in advance the line-of-sight direction of the 3D map at the time of switching. As a result, even when the line-of-sight direction of the 3D map does not match the user's line-of-sight direction at the time of switching from the 2D map, the user can smoothly transition to the 3D map without being confused. In addition, the user can efficiently reach the destination by appropriately switching between the two-dimensional map and the three-dimensional map on the route at a desired timing. Also, if both the two-dimensional map and the three-dimensional map are confirmed in advance, the work of confirming the map each time on the route can be omitted.

[Other Embodiments]
The present invention is not limited to the above-described embodiment, and can be implemented in various other forms without departing from the gist of the present invention. The above-described embodiment is merely an example in all respects, and is not construed as limiting.

  In the above-described embodiment, the case where the screen transition is performed in the order of the AR screen, the 2D map screen, and the 3D map screen has been described. May be. For example, the map display control device 10 transmits a peripheral information search screen 400 as shown in FIG. 7 to the mobile terminal 20. The portable terminal 20 displays the peripheral information search screen 400 on the display. The user can select gourmet information “Restaurant / Cafe / Izakaya” as a search key and a map form (map, photo) for guiding the search result. When the user selects a map form, the mobile terminal 20 transmits a search request including the current position, direction, and selection information (search key and selected map form) to the map display control device 10. The map display control device 10 determines the display form (2D map / 3D map) of the map based on the selection information, and the determined 2D map or 3 time dimension corresponding to the current position included in the search request. Map image data is read from the storage means 102 and transmitted to the portable terminal 20. In FIG. 7, a 2D map screen 402 including a 2D map corresponding to the current position and a 3D map screen 403 including a 3D map close to the current position are displayed.

DESCRIPTION OF SYMBOLS 10 ... Map display control apparatus, 20 ... Terminal device, 100 ... Map display control system, 101 ... Main control means, 102 ... Memory | storage means, 103 ... Communication means, 104 ... Route guidance means, 105 ... first display control means, 106 ... second display control means, 107 ... switching means, 108 ... AR processing means, 109 ... storage means, 201 ... Main control means 202 ... storage means 203 ... input means 204 ... display means 205 ... communication means 206 ... photographing means 207 ... position / orientation measuring means, N ... Network

Claims (11)

First storage means for storing a two-dimensional map image and coordinate information in association with each other;
Second storage means for storing a three-dimensional map image, coordinate information, and line-of-sight direction in association with each other;
A two-dimensional map image having coordinate information corresponding to the current position is read out from the first storage means, and a predetermined position existing on the route from the current position to the destination has coordinate information corresponding to the predetermined position. First display control for specifying a three-dimensional map image from the second storage means and controlling so that three-dimensional map direction information representing the line-of-sight direction of the specified three-dimensional map image is superimposed on the two-dimensional map image Means,
Second display control means for controlling the 3D map image stored in the second storage means to be displayed;
Switching means for controlling the two-dimensional map image and the three-dimensional map image to be switched and displayed;
A map display control device comprising: The first display control means includes
For the predetermined position, a 3D map image having a line-of-sight direction corresponding to a direction along the route is specified from the second storage unit, and 3D map direction information indicating the line-of-sight direction of the specified 3D map image is provided. The map display control apparatus according to claim 1, wherein the map display control apparatus controls the display so as to be superimposed on the two-dimensional map image. The second display control means includes
3. The map display according to claim 1, wherein gaze direction information representing a gaze direction of the three-dimensional map image is displayed on the three-dimensional map image in a superimposed state. Control device. The first display control means includes
A building tag is linked to a building having coordinate information in the map area of the two-dimensional map image, the building tag is displayed superimposed on the position of the corresponding building on the two-dimensional map image, and the building tag is linked to the building tag. 4. The map display control device according to claim 1, wherein the attribute information is controlled to be displayed on the same screen as the bill tag. 5. The second display control means includes
A building tag is linked to a building having coordinate information in the display area of the two-dimensional map image, the building tag is superimposed on the position of the corresponding building on the three-dimensional map image, and the building tag is linked to the building tag. 4. The map display control device according to claim 1, wherein the attribute information is controlled to be displayed on the same screen as the bill tag. 5. When the two-dimensional map image is displayed by the first display control means,
The switching means is
Control is performed so that the two-dimensional map image is displayed by switching to the three-dimensional map image on condition that the current position updated in accordance with the movement of the user substantially matches the predetermined position on the route. The map display control apparatus according to any one of claims 1 to 5, wherein When the two-dimensional map image is displayed by the first display control means,
The switching means is
6. The control is performed so that the two-dimensional map image is displayed by switching to the three-dimensional map image on condition that an instruction to switch to the three-dimensional map image is input. The map display control apparatus of any one of Claims. When additional information specified based on the current position and the line-of-sight direction of the camera at the time of shooting is combined and displayed on the captured image displayed on the display,
The switching means is
2. The first display control unit is controlled so that a two-dimensional map image specified based on the current position is displayed instead of a captured image in which the additional information is synthesized and displayed. The map display control device according to any one of 7 to 7. When additional information specified based on the current position and the line-of-sight direction of the camera at the time of shooting is combined and displayed on the captured image displayed on the display,
The switching means is
The second display control means is controlled so that a three-dimensional map image specified based on the current position and the line-of-sight direction is displayed instead of a captured image in which the additional information is synthesized and displayed. The map display control device according to any one of claims 1 to 7. A map image control method in a map image display control device, comprising:
A two-dimensional map image having coordinate information corresponding to the current position is read from the first storage device that stores the two-dimensional map image and coordinate information in association with each other, and a predetermined position existing on the route from the current position to the destination is read. The 3D map image having the coordinate information corresponding to the predetermined position is identified from the second storage device that stores the 3D map image, the coordinate information, and the line-of-sight direction in association with each other, and the line-of-sight of the identified 3D map image A first display control step for controlling so that 3D map direction information representing a direction is superimposed and displayed on the 2D map image;
Switching the screen containing the two-dimensional map image to a screen containing a three-dimensional map image;
A second display control step for controlling the three-dimensional map image stored in the second storage device to be displayed;
A map display control method comprising: On the computer,
A two-dimensional map image having coordinate information corresponding to the current position is read from the first storage device that stores the two-dimensional map image and coordinate information in association with each other, and a predetermined position existing on the route from the current position to the destination is read. The 3D map image having the coordinate information corresponding to the predetermined position is identified from the second storage device that stores the 3D map image, the coordinate information, and the line-of-sight direction in association with each other, and the line-of-sight of the identified 3D map image A first display control step for controlling so that 3D map direction information representing a direction is superimposed and displayed on the 2D map image;
Switching the screen containing the two-dimensional map image to a screen containing a three-dimensional map image;
A second display control step for controlling the three-dimensional map image stored in the second storage device to be displayed;
A program for running