JP2017102172A - Map image display system, map image display method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a map image display system, a map image display method, and a computer program, which can display a photographed image actually having photographed the surrounding environment along a route desired by a user.SOLUTION: When a drag operation for drawing a trajectory on a map image displayed on a liquid crystal display by a user is received, a trajectory route in which a map-matching of the trajectory drawn by the user is performed on the map is acquired, a photographed image having photographed the surrounding environment along the trajectory route is acquired from a photograph image DB in association with the photographing position at which the photographed image is photographed, a plurality of base points is set from a start point of the trajectory route to an end point, and a plurality of photographed images 66 in which each base point is associated as the photographing position is sequentially switched and displayed in photographing position from the start point of the trajectory route in the order of nearness.SELECTED DRAWING: Figure 26

Description

  The present invention relates to a map image display system that performs guidance using a map image displayed on a display device, a map image display method, and a computer program.

  2. Description of the Related Art In recent years, a navigation device is often mounted on a vehicle that provides vehicle travel guidance so that a driver can easily arrive at a desired destination. Here, the navigation device detects the current position of the vehicle by a GPS receiver or the like, acquires map data corresponding to the current position through a recording medium such as a DVD-ROM or HDD or a network, and displays it on a liquid crystal monitor. It is a device that can do. Further, the navigation device has a route search function for searching for a recommended route from the vehicle position to the destination when a desired destination is input, and sets the searched recommended route as a guide route. A map image around the vehicle position is displayed on the screen, and when approaching an intersection, the user is surely guided to a desired destination by guiding the right and left turn directions. In recent years, some mobile phones, smartphones, tablet terminals, personal computers, and the like have functions similar to those of the navigation device.

  Further, conventionally, as a guide to the vehicle, in addition to displaying a map image and guiding a left / right turn direction at an intersection, a captured image of a real image obtained by actually capturing the surrounding environment has also been displayed. . For example, in Japanese Patent Laid-Open No. 2012-226089, when the current location of a vehicle approaches within a predetermined distance from the destination, the captured image obtained by capturing the appearance of the destination is displayed on the display of the navigation device. Proposals have been made on techniques for arriving without misunderstanding the ground.

JP 2012-226089 A (5th page, FIG. 2)

  However, in the technique disclosed in Patent Document 1, the captured image is displayed only when the destination is set by the navigation device and the vehicle approaches the destination. Moreover, since the content of the captured image displayed is only an image obtained by capturing the appearance of the destination, there is a problem that the captured image required by the user cannot be displayed at an arbitrary timing.

  For example, if a captured image that captures the appearance of the destination is displayed, the user can grasp the appearance of the destination, but the user can visually recognize the appearance of the destination only on the way to the destination. The location of the destination cannot be specified in correspondence with the surrounding environment (intersection or surrounding facility that serves as a landmark). In some cases, the user may wish to display a captured image obtained by capturing a point other than the destination. Such a point where a user desires a captured image includes a point where the user wants to grasp the situation, such as a difficult intersection or a waypoint on the route to the destination.

  The present invention has been made to solve the above-described conventional problems, and a map image display system and a map image that can display a captured image obtained by actually capturing a surrounding environment along a route desired by a user. An object is to provide a display method and a computer program.

  In order to achieve the above object, a map image display system according to the present invention includes an image display means for displaying a map image on a display device, and an operation for accepting an operation for a user to draw a locus on the map image displayed on the display device. Receiving means; map matching means for acquiring a corrected locus obtained by map-matching the locus drawn by the user on a map; and a captured image obtained by capturing the captured image of the surrounding environment along the modified locus. And a plurality of base images set between the start point and end point of the trajectory path, and a plurality of the captured images in which the plurality of base points are associated as the imaging positions. And picked-up image display means for sequentially switching and displaying the picked-up positions in order from the start point of the trajectory path.

  The map image display method according to the present invention is a method for displaying a captured image taken along a route designated by the user on the map image. Specifically, an image display means displays a map image on a display device, an operation accepting means accepts an operation in which a user draws a locus on the map image displayed on the display device, and a map A matching unit that obtains a corrected trajectory obtained by map-matching a trajectory drawn by the user on a map; and an image data acquiring unit that captures a captured image obtained by imaging the surrounding environment along the corrected trajectory. The step of acquiring in association with the imaged imaging position and the captured image display means set a plurality of base points between the start point and end point of the trajectory path, and the plurality of base points are associated as the image pickup positions. And sequentially switching and displaying the plurality of captured images in the order in which the imaging positions are closer to the start point of the trajectory path.

  The computer program according to the present invention is a program for displaying a captured image captured along a route designated by the user on a map image. Specifically, the computer displays image display means for displaying a map image on a display device, operation accepting means for accepting an operation in which a user draws a locus on the map image displayed on the display device, and drawing by the user Image data for acquiring a map matching means for acquiring a corrected locus obtained by map-matching the detected locus on a map, and a captured image obtained by imaging the surrounding environment along the corrected locus in association with an imaging position where the captured image is captured A plurality of base points are set between an acquisition means and a start point to an end point of the trajectory path, and a plurality of the captured images in which the plurality of base points are associated as the imaging positions are set, and the imaging position is the trajectory path It is made to function as a picked-up image display means for switching and displaying sequentially in the order from the start point.

  According to the map image display system, the map image display method, and the computer program according to the present invention having the above-described configuration, when the user performs an operation of drawing a locus on the map image, the periphery along the route according to the drawn locus Since the captured images of the environment are sequentially switched and displayed, it is possible to display the captured images of the surrounding environment along the route desired by the user. As a result, for example, the user can easily specify the position of the destination from the displayed captured image in association with the surrounding environment. It is also possible to display a picked-up image of a point where a user wants to grasp the situation, such as a difficult intersection or a waypoint on the route to the destination.

It is a schematic structure figure showing a map image display system concerning this embodiment. It is the figure which showed the captured image memorize | stored in an information server. It is the block diagram which showed the navigation apparatus which concerns on this embodiment. It is a flowchart of the captured image display processing program which concerns on this embodiment. It is the figure which showed the driving guidance screen displayed on a liquid crystal display. It is a flowchart of the sub process program of the acquisition information setting process for taps. It is a figure explaining tap operation by a user. It is a figure explaining the setting method of the imaging direction of the captured image displayed on a liquid crystal display, when the tap operation by a user is performed and a touch position is on the road around a destination. It is the figure which showed an example of the captured image displayed on a liquid crystal display, when the tap operation by a user is performed and a touch position is on the road around a destination. It is a figure explaining the setting method of the imaging direction of the captured image displayed on a liquid crystal display, when the tap operation by a user is performed and a touch position is on roads other than the periphery of the destination. It is the figure which showed an example of the captured image displayed on a liquid crystal display, when the tap operation by a user is performed and a touch position is on roads other than the periphery of the destination. It is a figure explaining the setting method of the imaging direction of the captured image displayed on a liquid crystal display in case a tap operation by a user is performed and a touch position is a destination. It is the figure which showed an example of the captured image displayed on a liquid crystal display in case a tap operation by a user is performed and a touch position is a destination. It is a figure explaining the setting method of the imaging direction of the captured image displayed on a liquid crystal display, when the tap operation by a user is performed and the touch position is not a destination and on the road. It is the figure which showed an example of the captured image displayed on a liquid crystal display, when the tap operation by a user is performed and a touch position is not on the destination and on the road. It is a flowchart of the sub process program of the acquisition information setting process for drag | drug. It is a figure explaining drag operation by a user. It is a flowchart of the sub process program of an imaging position determination process. It is a figure explaining the setting method of a base point. It is a flowchart of the sub process program of an imaging direction determination process. It is a figure explaining the imaging direction of the captured image set with respect to the base point where the destination, a specific facility, and a specific point are not near. It is a figure explaining the imaging direction of the captured image set with respect to the base point where the destination, a specific facility, and a specific point are near. It is the figure which showed the imaging direction set to each base point, when the drag operation by a user is performed and there is no destination, a specific facility, and a specific point around the end point of the locus | trajectory drawn by the user. It is the figure which showed an example of the picked-up image displayed on a liquid crystal display, when drag operation by a user is performed and there is no destination, a specific facility, and a specific point around the end point of the locus | trajectory drawn by the user. . It is the figure which showed the imaging direction set to each base point, when the drag operation by a user is performed and there exists a destination, a specific facility, and a specific point around the end point of the locus | trajectory drawn by the user. It is the figure which showed an example of the captured image displayed on a liquid crystal display, when a user's drag operation is performed and there exists a destination, a specific facility, and a specific point around the end point of the locus | trajectory drawn by the user. .

  DETAILED DESCRIPTION Hereinafter, a map image display system according to an embodiment of the present invention will be described in detail with reference to the drawings based on an embodiment. First, a schematic configuration of the map image display system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a schematic configuration diagram showing a map image display system 1 according to the present embodiment.

  As shown in FIG. 1, the map image display system 1 according to the present embodiment basically includes an information server 3 included in the information management center 2 and a navigation device 5 mounted on a vehicle on which the user 4 rides. ing. The navigation device 5 may be an information terminal having a navigation function, and may be a mobile phone, a PDA, a tablet terminal, a smartphone, a personal computer, or the like in addition to the navigation device. The information management center 2 and the navigation device 5 are configured to be able to transmit and receive electronic data to and from each other via the communication network 6.

  Here, the information server 3 stores map information regarding road networks and facilities in various places in the map information DB 7. Moreover, the captured image DB8 which memorize | stores actually the surrounding environment along the road contained in map information is memorize | stored in captured image DB8. And it is a server apparatus which provides the captured image memorize | stored in DB in response to the request | requirement of the navigation apparatus 5. FIG. Here, the captured image stored in the captured image DB 8 is an image captured by a camera that is actually mounted on a vehicle that has traveled on roads throughout the country, and is a 360-degree panoramic image centered on the imaging position. The 360-degree panoramic image may be stored as a single image, or may be stored as a plurality of images divided into predetermined angle units (for example, 120-degree units). The captured image DB 8 stores a captured image 10 in association with each captured position 9 on the road as shown in FIG. In addition, the space | interval of the imaging position 9 can be set suitably, for example, shall be 5m-20m. Further, the imaging positions 9 do not have to be set on all roads in the whole country, and narrow streets and the like may be excluded.

  On the other hand, the navigation device 5 searches for a recommended route to the destination, obtains it from the server, or stores the map image of the area around the current position of the user 4 or an arbitrary area based on the map data stored at a predetermined scale. Or the current position of the user 4 in the displayed map image, or movement guidance along the set guidance route. Note that the navigation device 5 does not have to have all of the above functions, and the present invention can be configured as long as it has a function of displaying a map image of the area around the current position of the user 4 or an arbitrary area. It is.

  The communication network 6 includes a large number of base stations arranged in various parts of the country and a communication company that manages and controls each base station. The base station and the communication company are connected to each other by wire (optical fiber, ISDN, etc.) or wirelessly. It is configured by connecting. Here, the base station has a transceiver (transmitter / receiver) for communicating with the navigation device 5 and an antenna. The base station performs wireless communication between the communication companies, and relays the communication of the navigation device 5 that is at the end of the communication network 6 within the range (cell) of the base station to and from the information server 3. Have a role to play.

  Next, a schematic configuration of the navigation device 5 included in the map image display system 1 will be described with reference to FIG. FIG. 3 is a block diagram schematically showing a control system of the navigation device 5 according to the present embodiment.

  As shown in FIG. 1, the navigation device 5 according to the present embodiment includes a current position detection unit 11 that detects a current position of a vehicle on which the navigation device 5 is mounted, a data recording unit 12 that records various data, Based on the input information, the navigation ECU 13 that performs various arithmetic processes, the touch panel 14 that receives operations from the user, the liquid crystal display 15 that displays guidance information related to maps and facilities around the vehicle, and routes Communication is performed between a speaker 16 that outputs voice guidance related to guidance, a DVD drive 17 that reads a DVD as a storage medium, and an information center such as an information management center 2 or a VICS (registered trademark: Vehicle Information and Communication System) center. And a communication module 18 for performing.

Below, each component which the navigation apparatus 5 has is demonstrated in order.
The current position detection unit 11 includes a GPS 21, a vehicle speed sensor 22, a steering sensor 23, a gyro sensor 24, and the like, and can detect the current vehicle position, direction, vehicle traveling speed, current time, and the like. . Here, in particular, the vehicle speed sensor 22 is a sensor for detecting a moving distance and a vehicle speed of the vehicle, generates a pulse according to the rotation of the driving wheel of the vehicle, and outputs a pulse signal to the navigation ECU 13. And navigation ECU13 calculates the rotational speed and moving distance of a driving wheel by counting the generated pulse. Note that the navigation device 5 does not have to include all of the four types of sensors, and the navigation device 5 may have only one or more types of these sensors.

  The data recording unit 12 is also a hard disk (not shown) as an external storage device and a recording medium, and a driver for reading the map information DB 31 and a predetermined program recorded on the hard disk and writing predetermined data on the hard disk And a recording head (not shown). The data recording unit 12 may be configured to have a memory card, an optical disk such as a CD or a DVD, instead of the hard disk. Moreover, the navigation apparatus 5 is good also as a structure which acquires map information from the information server 3 by communication, without having map information DB31.

  Here, the map information DB 31 displays, for example, link data 32 relating to roads (links), node data 33 relating to node points, point data 34 relating to points such as facilities, search data used for processing related to route search, and maps. Storage means for storing map display data for searching, intersection data for each intersection, search data for searching points, and the like.

  The link data 32 includes, for each link constituting the road, the width of the road to which the link belongs, the gradient, the cant, the bank, the road surface state, the number of road lanes, the number of lanes that decrease, The data representing the narrowing point, railroad crossing, etc., the corner, the radius of curvature, the intersection, the T-junction, the corner entrance and the exit, etc. The data representing the downhill road, the uphill road, etc. Regarding types, in addition to general roads such as national roads, prefectural roads and narrow streets, data representing toll roads such as national highways, urban highways, general toll roads, and toll bridges are recorded.

  Further, as the node data 33, the actual road junctions (including intersections, T-junctions, etc.) and the coordinates (positions) of node points set for each road according to the radius of curvature, etc. Node attribute indicating whether a node is a node corresponding to an intersection, etc., a connection link number list that is a list of link numbers of links connected to the node, and an adjacency that is a list of node numbers of nodes adjacent to the node via the link Data relating to the node number list, the height (altitude) of each node point, and the like are recorded.

  Further, as the point data 34, information regarding points such as a departure point, a destination, a facility to be guided in the navigation device 5 is stored. For example, accommodation facilities such as hotels and inns, refueling facilities such as gas stations, commercial facilities such as shopping malls, supermarkets, shopping centers and convenience stores, entertainment facilities such as theme parks and game centers, restaurants, bars and pubs Information on facilities such as facilities, parking facilities such as public parking lots, transportation facilities, religious facilities such as temples and churches, public facilities such as museums and museums, and the like. The point data 34 includes, for each point, a point number that is an identifier of the point, a point name indicating the name of the point, and a genre of the facility (“parking lot”, “post office”, A facility genre indicating “restaurant” and the like, a position coordinate indicating the position of the point, and the like. In particular, regarding facilities, in addition to position coordinates, the facility also has information for specifying an area occupied by the facility (hereinafter referred to as a polygon area).

  The navigation ECU (Electronic Control Unit) 13 is an electronic control unit that controls the entire navigation device 5, and includes a CPU 41 as an arithmetic device and a control device, and a working memory when the CPU 41 performs various arithmetic processes. Read out from the ROM 43 and the ROM 43 in which a RAM 42 that stores route data when a route is searched, a control program, a captured image display processing program (FIG. 4) described later, and the like are recorded. And an internal storage device such as a flash memory 44 for storing the program. The navigation ECU 13 has various means as processing algorithms. For example, the image display means displays a map image on the liquid crystal display 15. The operation accepting unit accepts an operation in which the user draws a locus on the map image displayed on the liquid crystal display 15. The map matching means obtains a trajectory path obtained by map matching the trajectory drawn by the user on the map. The image data acquisition means acquires a captured image obtained by capturing the surrounding environment along the trajectory path in association with an imaging position where the captured image is captured. The captured image display means sets a plurality of base points from the start point to the end point of the trajectory path, and captures a plurality of captured images in which the plurality of base points are associated as image capturing positions, the image capturing positions being close to the start point of the trajectory path. The images are sequentially switched and displayed.

The touch panel 14 is arranged in front of the display area of the liquid crystal display 15, and is used to select a point or section for displaying a captured image as described below when scrolling a map image or selecting a button arranged in the display area. It is operated when specifying on the map image. Then, the navigation ECU 13 performs “touch-on” in which the user touches the touch panel 14 from a state in which the user does not touch the touch panel 14 based on a detection signal output from the touch panel 14 by the operation of the touch panel 14, Detects “touch-off” that shifts from a touched state to a non-touched state. Further, touch coordinates that are coordinates of a point touched by the user (touch point) and displacement of touch coordinates when an operation for moving the touch point in a touched state (that is, drag operation or flick operation) is received are also detected. . Then, the navigation ECU 13 performs control to execute various operations corresponding to the detected touch operation, touch coordinates, and the like.
Note that an operation unit such as a tablet may be used instead of the touch panel 14 as an operation unit that receives a user's touch operation.

  The liquid crystal display 15 includes a map image including a road, traffic information, operation guidance, operation menu, key guidance, guidance route from the departure point to the destination, guidance information along the guidance route, news, weather forecast, Time, mail, TV program, etc. are displayed. Moreover, in this embodiment, it is used also when displaying the picked-up image which imaged the surrounding environment along the path | route designated by the user 4 as mentioned later. In place of the liquid crystal display 15, HUD or HMD may be used.

  Further, the speaker 16 outputs voice guidance for guiding traveling along the planned traveling route and traffic information guidance based on an instruction from the navigation ECU 13.

  The DVD drive 17 is a drive that can read data recorded on a recording medium such as a DVD or a CD. Based on the read data, music and video are reproduced, the map information DB 31 is updated, and the like. A card slot for reading / writing a memory card may be provided instead of the DVD drive 17.

  The communication module 18 is a communication device for receiving traffic information composed of information such as traffic jam information, regulation information, and traffic accident information transmitted from a traffic information center, for example, a VICS center or a probe center. For example, a mobile phone or DCM is applicable. Moreover, in this embodiment, it is used also for receiving the captured image stored in captured image DB8 from the information server 3. FIG.

  Next, a captured image display processing program executed by the CPU 41 in the navigation device 5 having the above configuration will be described with reference to FIG. FIG. 4 is a flowchart of the captured image display processing program according to the present embodiment. Here, the captured image display processing program is executed after the ACC power supply (accessory power supply) of the vehicle is turned on, and a captured image obtained by capturing the surrounding environment of the point or section designated by the user's touch operation on the map image. This is a program to be displayed. The programs shown in the flowcharts of FIGS. 4, 6, 16, 18, and 20 below are stored in the RAM 42 and ROM 43 provided in the navigation device 5 and are executed by the CPU 41.

  First, in step (hereinafter abbreviated as S) 1 in the captured image display processing program, the CPU 41 displays a map image around the current position of the vehicle on the liquid crystal display 15. Also, the user can scroll the displayed map image in an arbitrary direction or change the scale by performing a flick operation, a drag operation, a pinch operation, or the like on the map image displayed using the touch panel 14. It is possible to arbitrarily change the area to be displayed of the map image. A current position mark indicating the current position of the vehicle is also displayed on the map image.

  Further, when a guidance route (scheduled route for the user) is set in the navigation device 5, a mark indicating the guidance route or the destination is also displayed on the map image. Here, FIG. 5 is a diagram showing an example of a travel guidance screen 50 displayed on the liquid crystal display 15 in a state where a guidance route is set in the navigation device 5. The travel guidance screen 50 includes a map image 51 around the current position of the vehicle, a guidance route 52, a destination 53, a vehicle position mark 54 indicating the current position of the vehicle matched on the map, a specific facility, A POI (Point of Interest) icon 55 indicating the position and genre of the point and various operation icons 56 to 60 operated when performing point registration or route search are displayed. Then, by referring to the travel guidance screen 50, the user can grasp the facility information and road shape around the current vehicle, the currently set guidance route, and the like.

  Next, in S <b> 2, the CPU 41 determines whether a user's touch operation on the map image displayed on the liquid crystal display 15 has been received based on a signal transmitted from the touch panel 14. Here, as a touch operation of the user with respect to the map image, a “tap operation” that is released (tapped) immediately after touching one point on the map image displayed on the liquid crystal display 15, and the map displayed on the liquid crystal display 15 is displayed. In addition to a “drag operation” that draws a trajectory by moving on the map image after touching one point on the image, there are a flick operation, a pinch-in operation, a pinch-out operation, and the like.

  And when it determines with having received the user's touch operation with respect to a map image (S2: YES), it transfers to S3. On the other hand, when it is determined that the user's touch operation on the map image is not accepted (S2: NO), the captured image display processing program is terminated.

  In S <b> 3, the CPU 41 determines whether or not a “tap operation” has been particularly received as the user's touch operation on the map image. The “tap operation” corresponds to an operation of releasing (hitting) a point on the map image displayed on the liquid crystal display 15 immediately after touching.

  If it is determined that the “tap operation” is received as the user's touch operation on the map image (S3: YES), the process proceeds to S6. On the other hand, when it is determined that an operation other than the “tap operation” is accepted (S3: NO), the process proceeds to S4.

  In S <b> 4, the CPU 41 determines whether or not a “drag operation” is particularly accepted as the user's touch operation on the map image. The “drag operation” corresponds to an operation of drawing a locus by touching a point on the map image displayed on the liquid crystal display 15 and then moving it on the map image in a touched state.

  When it is determined that the “drag operation” is received as the user's touch operation on the map image (S4: YES), the process proceeds to S7. On the other hand, when it is determined that an operation other than the “drag operation” is accepted (S4: NO), the process proceeds to S5.

  In S5, the CPU 41 executes various processes corresponding to the received user operation. For example, there are a map image scroll process, a scale change process, and the like.

  On the other hand, in S6, the CPU 41 executes an after-tap acquisition information setting process (FIG. 6). The tap acquisition information setting process is a process of setting the number of captured images to be displayed on the liquid crystal display 15, the imaging position, the imaging direction, and the like based on the accepted tap operation of the user. Thereafter, the process proceeds to S10.

  In S7, the CPU 41 executes a drag acquisition information setting process (FIG. 16) described later. The acquisition information setting process for dragging is a process for setting the number of captured images to be displayed on the liquid crystal display 15, the imaging position, the imaging direction, and the like based on the received drag operation of the user.

  Thereafter, in S8, the CPU 41 executes an imaging position determination process (FIG. 18) described later. In the imaging position determination processing, particularly when a user's drag operation is received, which imaging position corresponds in particular among the captured images 10 stored in the captured image DB 8 based on each information set in S7. This is a process for determining in detail whether the attached captured image is to be displayed on the liquid crystal display 15.

  Subsequently, in S9, the CPU 41 executes an imaging direction determination process (FIG. 20) described later. In the imaging direction determination process, in particular, in the case where a user's drag operation is received, which imaging direction is specifically captured from the captured images 10 stored in the captured image DB 8 based on the information set in S7. This is a process for determining in detail whether the captured image is to be displayed on the liquid crystal display 15.

  Thereafter, in S10, the CPU 41 acquires a captured image to be displayed on the liquid crystal display 15 from the captured images 10 stored in the captured image DB 8 based on the information set in S6 to S9.

  Finally in S11, the CPU 41 displays the captured image acquired from the captured image DB 8 in S10 on the liquid crystal display 15. Thereafter, the displayed captured image is deleted after a predetermined time has elapsed since the captured image was displayed, or after a predetermined operation by the user is accepted. The captured image may be displayed on the entire screen of the liquid crystal display 15 or may be configured to be displayed so as to be superimposed on a partial area of the travel guide screen 50. When a plurality of captured images are acquired in S10, the captured images are switched and displayed at a predetermined interval (for example, every 1 second) and in a predetermined order. Note that how the captured image is specifically displayed will be described in detail later for each type of user operation received (FIGS. 9, 11, 13, and 15).

  Next, a sub-process of the tap acquisition information setting process executed in S6 will be described with reference to FIG. FIG. 6 is a flowchart of a sub-processing program of the tap acquisition information setting process.

  First, in S <b> 21, the CPU 41 acquires coordinates (hereinafter referred to as touch coordinates) of a point touched by the user in the tap operation (hereinafter referred to as touch point) based on the detection signal transmitted from the touch panel 14. When the touch panel 14 is a resistance film type or a capacitance type, the touch coordinates are detected by detecting the position of the current that flows based on the pressure at the touch point or the change in capacitance. For example, as shown in FIG. 7, when the user taps a point X on the map image 51, the coordinates of the point X are acquired. Note that the coordinates acquired in S21 are coordinates (latitude, longitude) on the map, not a coordinate system for specifying the position of the liquid crystal display 15 on the screen.

  Next, in S22, the CPU 41 performs map matching of the touch point on the map based on the touch coordinates acquired in S21 and the map information stored in the map information DB 31. Note that map matching is a process of correcting the position of a point to be processed by drawing it on the road when the point to be processed is in the vicinity of the road (link) of the map image. Therefore, if the touch point is in the vicinity of the road, the touch point is corrected to a point on the road. When the touch point is corrected, the touch coordinates acquired in S21 are also corrected to the coordinates of the touch point after correction. Since map matching is a known technique, details of the processing are omitted.

  Subsequently, in S23, the CPU 41 determines whether or not the touch point map-matched in S22 is located on a road (link).

  And when it determines with the touch point by which the map matching was carried out by said S22 being located on a road (S23: YES), it transfers to S24. On the other hand, if it is determined that the touch point map-matched in S22 is not located on the road (S23: NO), the process proceeds to S28.

  In S24, the CPU 41 determines whether or not the destination is set in the navigation device 5.

  And when it determines with the destination being set in the navigation apparatus 5 (S24: YES), it transfers to S25. On the other hand, when it is determined in the navigation device 5 that the destination is not set (S24: NO), the process proceeds to S27.

  In S25, the CPU 41 determines that the touch point map-matched in S22 is the destination based on the touch coordinates acquired in S21 (or touch coordinates after correction if corrected in S22) and the position of the destination. It is determined whether or not it is located in the vicinity. For example, it is determined whether or not it is located within 300 m from the destination. In addition, when specifying the position of the destination by coordinates, the determination is made based on the distance from the coordinates of the destination to the touch point. On the other hand, when the position of the destination is specified by the polygon area (area occupied by the destination), it may be determined by the distance from the polygon area to the touch point, or when the touch point is included in the polygon area It may be determined that the touch point is located around the destination.

  If it is determined that the touch point map-matched in S22 is located around the destination (S25: YES), it is estimated that the user particularly wants to display a captured image obtained by imaging the periphery of the destination. Then, the process proceeds to S26. On the other hand, when it is determined that the touch point map-matched in S22 is not located around the destination (S25: NO), the process proceeds to S27.

In S <b> 26, the CPU 41 sets the conditions of the captured image to be displayed on the liquid crystal display 15 based on the accepted user tap operation as follows.
(A) Number of captured images: 1 (B) Captured position of captured image: Touch point map-matched in S22 (C) Captured image capture direction: direction from destination to destination

  As described above, the picked-up image DB 8 of the information server 3 stores picked-up images of 360 degrees around the picked-up images at the respective pick-up positions (FIG. 2), but the navigation device 5 acquires and displays the picked-up images. In this case, not all 360 degrees are acquired and displayed, but only within a predetermined angle range is acquired and displayed. In the following description, a range that is acquired from the captured image DB 8 and is displayed on the liquid crystal display 15 of the navigation device 5 is defined using the “imaging direction”. Specifically, the “imaging direction” is defined as an optical axis direction for capturing an image of a range to be displayed from the imaging position in the 360-degree panoramic image 10 as shown in FIG. In other words, an image within a predetermined angle α centered on the “imaging direction” is displayed among the captured images 10 of the 360-degree panoramic image (α is appropriately set depending on the size of the display to be displayed, for example, 120 degrees. To do). In S26, the imaging direction X is set in the direction from the touch point 61 to the destination 65 as shown in FIG.

  Thereafter, the process proceeds to S10, and the CPU 41 obtains one captured image corresponding to the condition set in S26 from the captured image DB 8. Specifically, it is a captured image in which the touch point map-matched in S22 is associated with the imaging position, and a range in which the direction of the destination from the imaging position (touch point) is the imaging direction (for example, the imaging direction) The captured image (within 120 degrees with respect to the center) is acquired from the captured image DB 8. If there is no captured image associated with the imaging position set in S26 in the captured image DB 8, a captured image associated with the closest imaging position is acquired. The acquired captured image is displayed on the liquid crystal display 15 (S11).

  In S26, as described above, the “imaging direction” is the direction from the touch point map-matched in S22 to the destination. Therefore, as shown in FIG. A captured image 66 obtained by capturing the direction of 65 is displayed. When there is no shield between the touch point and the destination 65, the destination 65 is included in the vicinity of the center of the captured image 66.

On the other hand, in S27, the CPU 41 sets the conditions of the captured image to be displayed on the liquid crystal display 15 based on the accepted user tap operation as follows.
(A) Number of captured images: Multiple (for example, 8)
(B) Image pickup position of the picked-up image: touch point map-matched in S22 (C) Image pickup direction of the picked-up image: direction obtained by dividing 360 degrees around the image pickup position into a plurality

  In S27, a plurality of imaging directions are set, and the number of set imaging directions is the number of captured images to be displayed. For example, as shown in FIG. 10, if the direction displaced 45 degrees from the touch point 61 is taken as the imaging direction X, the imaging direction X is a total of 8 directions, and 8 captured images corresponding to each imaging direction are displayed. The Rukoto.

  Thereafter, the process proceeds to S10, and the CPU 41 acquires a plurality of captured images corresponding to the conditions set in S27 from the captured image DB 8. Specifically, the touch point map-matched in S22 is a captured image associated with the imaging position, and a range having a plurality of directions around the imaging position (touch point) as the imaging direction (for example, imaging) A captured image (within 120 degrees centered on the direction) is acquired from the captured image DB 8. If there is no captured image associated with the imaging position set in S27 in the captured image DB 8, a captured image associated with the closest imaging position is acquired. The acquired captured image is displayed on the liquid crystal display 15 (S11). The display order of the captured images is displayed, for example, by first displaying the captured images with the imaging direction facing north, and then switching the captured images at predetermined time intervals (for example, 1 second intervals) in the order in which the imaging direction is clockwise. To do. Thereafter, after all the acquired captured images are displayed, the initially displayed captured image is displayed again, and thereafter the display switching of the captured image is repeatedly performed a predetermined number of times.

  As a result, as shown in FIG. 11, a picked-up image 66 that picks up the surroundings from the touch point is sequentially switched and displayed in a predetermined direction (for example, clockwise) on the liquid crystal display 15.

  On the other hand, the CPU 41 determines whether or not the destination is set in the navigation device 5 in S28 that is executed when it is determined that the map-matched touch point is not located on the road in S22.

  And when it determines with the destination being set in the navigation apparatus 5 (S28: YES), it transfers to S29. On the other hand, when it is determined that the destination is not set in the navigation device 5 (S28: NO), the process proceeds to S31.

  In S29, the CPU 41 determines that the touch point map-matched in S22 is the destination based on the touch coordinates acquired in S21 (or corrected touch coordinates if corrected in S22) and the position of the destination. It is determined whether it is located in. When specifying the position of the destination by coordinates, the touch point may be regarded as being located at the destination as long as the coordinates are within a predetermined distance even if the coordinates do not completely match. Also, when the position of the destination is specified by a polygon area (area occupied by the destination), it is considered that the touch point is located at the destination when the touch coordinates are included in the polygon area.

  If it is determined in S22 that the map-matched touch point is located at the destination (S29: YES), it is estimated that the user particularly desires to display a captured image obtained by imaging the periphery of the destination. To S29. On the other hand, when it is determined that the touch point map-matched in S22 is not located at the destination (S29: NO), the process proceeds to S31.

In S <b> 30, the CPU 41 sets the conditions of the captured image to be displayed on the liquid crystal display 15 based on the accepted user tap operation as follows.
(A) Number of captured images: 1 (B) Capture position of captured image: Point on road near destination (C) Capture direction of captured image: Direction from destination to destination

  Note that the “location on the road near the destination” as the imaging position of the captured image may be any location where the destination can be visually recognized with a sufficiently large size, but in this embodiment, it is the closest to the destination. A point on the road to be. For example, as shown in FIG. 12, when the touch point 61 is located at the destination 65, the point 68 on the road 67 closest to the destination 65 is obtained. Therefore, the imaging direction X is a direction from the point 68 toward the destination 65.

  Thereafter, the process proceeds to S10, and the CPU 41 obtains one captured image corresponding to the condition set in S30 from the captured image DB 8. Specifically, the point on the road near the destination is a picked-up image associated with the image pickup position, and the direction of the destination from the image pickup position (point on the road near the destination) is set as the image pickup direction. A captured image within a range (for example, within 120 degrees centered on the imaging direction) is acquired from the captured image DB 8. If there is no captured image associated with the imaging position set in S30 in the captured image DB 8, a captured image associated with the closest imaging position is acquired. The acquired captured image is displayed on the liquid crystal display 15 (S11).

  In S30, as described above, the "imaging direction" is set to the direction from the road near the destination to the destination, so that the liquid crystal display 15 displays the destination from the road near the destination 65 as shown in FIG. A captured image 66 obtained by capturing the direction of 65 is displayed, and an image of the destination 65 viewed from the front is included in the vicinity of the center of the captured image 66.

On the other hand, in S31, the CPU 41 sets the conditions of the captured image to be displayed on the liquid crystal display 15 based on the accepted user tap operation as follows.
(A) Number of captured images: 1 (B) Capture position of captured image: Point on the road near the touch point map-matched in S22 (C) Capture direction of captured image: From the capture position to the touch point direction

  The “point on the road near the touch point” as the image pickup position of the picked-up image may be any point as long as the touch point can be visually recognized nearby, but in the present embodiment, it is on the road closest to the touch point. The point. For example, as shown in FIG. 14, when the touch point 61 is located outside the road, the point 69 on the road 67 closest to the touch point 61 is obtained. Accordingly, the imaging direction X is a direction from the point 69 toward the touch point 61.

  Thereafter, the process proceeds to S10, and the CPU 41 obtains one captured image corresponding to the condition set in S31 from the captured image DB 8. Specifically, the point on the road near the touch point map-matched in S22 is a picked-up image associated with the image pickup position, and the touch point from the image pickup position (point on the road near the touch point) A captured image in a range in which the direction is the imaging direction (for example, within 120 degrees centered on the imaging direction) is acquired from the captured image DB 8. If there is no captured image associated with the imaging position set in S31 in the captured image DB 8, a captured image associated with the closest imaging position is acquired. The acquired captured image is displayed on the liquid crystal display 15 (S11).

  In S31, since the “imaging direction” is the direction from the road near the touch point to the touch point as described above, the liquid crystal display 15 displays the touch point from the road near the touch point 61 as shown in FIG. The captured image 66 obtained by capturing the direction 61 is displayed, and the touch point 61 is included in the vicinity of the center of the captured image 66.

  Next, the sub-process of the drag acquisition information setting process executed in S7 will be described with reference to FIG. FIG. 16 is a flowchart of the sub-processing program for the acquisition information setting process for dragging.

  First, in S41, based on the detection signal transmitted from the touch panel 14, the CPU 41 obtains a history of a series of touch coordinates touched by the user in the drag operation (that is, a locus drawn by the user). When the touch panel 14 is a resistance film type or a capacitance type, the touch coordinates are detected by detecting the position of the current that flows based on the pressure at the touch point or the change in capacitance. For example, when the user drags from point S to point G on the map image 51 as shown in FIG. Note that the coordinates acquired in S41 are coordinates (latitude, longitude) on a map, not a coordinate system for specifying the position of the liquid crystal display 15 on the screen.

  Next, in S42, the CPU 41 performs map matching on the map of the trajectory drawn by the user by the drag operation based on the history of touch coordinates acquired in S41 and the map information stored in the map information DB 31. Specifically, each coordinate point constituting the trajectory acquired in S41 is map-matched. A trajectory constituted by the map-matched coordinate points becomes a map-matched trajectory. Since map matching is a known technique, details of the processing are omitted.

  Subsequently, in S43, the CPU 41 determines whether or not the trajectory map-matched in S42 is located on a road (link).

  And when it determines with the locus | trajectory map-matched by said S42 being located on a road (S43: YES), it transfers to S44. On the other hand, if it is determined that the map-matched trajectory is not located on the road in S42 (S43: NO), the captured image is not displayed on the liquid crystal display 15 and the process ends. In the following description, the trajectory map-matched on the road in S42 is referred to as a “trajectory route”.

  In S <b> 44, the CPU 41 determines whether or not a destination is set in the navigation device 5.

  And when it determines with the destination being set in the navigation apparatus 5 (S44: YES), it transfers to S45. On the other hand, when it is determined that the destination is not set in the navigation device 5 (S44: NO), the process proceeds to S49.

  In S45, the CPU 41 determines whether or not the end point of the trajectory path is located around the destination based on the coordinates of the end point of the trajectory path and the position of the destination. For example, it is determined whether or not it is located within 300 m from the destination. When specifying the position of the destination by coordinates, the determination is made based on the distance from the coordinates of the destination to the end point of the trajectory path. On the other hand, when specifying the position of the destination in the polygon area (area occupied by the destination), it may be determined by the distance from the polygon area to the end point of the trajectory path, or the end point of the trajectory path in the polygon area May be determined that the end point of the trajectory route is located around the destination. Further, the coordinates of the end point of the trajectory path are the touch coordinates of the end point when the drag operation is finished (touch-off), and are the last (newest) detected touch coordinates in the touch coordinate sequence acquired in S41. . In addition, when it is corrected by the map matching in S42, it becomes the touch coordinates after correction.

  If it is determined that the end point of the locus route is located around the destination (S45: YES), it is estimated that the user particularly desires to display a captured image obtained by imaging the periphery of the destination, and the process proceeds to S46. Transition. On the other hand, when it is determined that the end point of the locus route is not located around the destination (S45: NO), the process proceeds to S47.

In S <b> 46, the CPU 41 sets the conditions of the captured image to be displayed on the liquid crystal display 15 based on the received user drag operation as follows.
(A) Number of captured images: Plural sheets (B) Captured position of captured images: Predetermined intervals along the trajectory path from the start point to the end point (C) Imaging direction of captured images: Basically direction on the end point side along the trajectory path However, within a predetermined distance from the destination, the direction (D) angle adjustment of the destination from the imaging position is: Yes

  Thereafter, in an imaging position determination process (S8) and an imaging direction determination process (S9), which will be described later, performed based on the above-described setting conditions, the captured image that is specifically displayed on the liquid crystal display 15, that is, acquired from the captured image DB8. A target captured image is determined. Details will be described later.

  On the other hand, in S47, the CPU 41 determines whether or not the end point of the trajectory path is located around a specific facility or point based on the coordinates of the end point of the trajectory path and the map information DB 31. For example, it is determined whether or not it is located within 300 m from a specific facility or point. Here, the “specific facility or point” is a facility or a point for which a POI icon (see FIG. 5) is displayed, such as a supermarket, a gas station, a parking lot, or the like. In addition, when the position of the facility is specified by coordinates, it is determined by the distance from the facility coordinates to the end point of the trajectory path. On the other hand, when the location of a facility is specified by a polygon area (area occupied by the facility), it may be determined by the distance from the polygon area to the end point of the trajectory path, or the end point of the trajectory path is included in the polygon area. The end point of the locus route may be determined to be located around the facility.

  If it is determined that the end point of the trajectory path is located around the specific facility or point (S47: YES), the user particularly desires to display a captured image obtained by capturing the periphery of the specific facility or point. And the process proceeds to S48. On the other hand, when it is determined that the end point of the trajectory route is not located in the vicinity of the specific facility or point (S47: NO), the user simply wants to display a captured image obtained by imaging the periphery along the route. And the process proceeds to S49.

In S <b> 48, the CPU 41 sets the conditions of the captured image to be displayed on the liquid crystal display 15 based on the received user drag operation as follows.
(A) Number of captured images: Plural sheets (B) Captured position of captured images: Predetermined intervals along the trajectory path from the start point to the end point (C) Imaging direction of captured images: Basically direction on the end point side along the trajectory path However, within a predetermined distance from a specific facility or point, the direction (D) angle adjustment of the specific facility or point from the above imaging position: Yes

  Thereafter, in an imaging position determination process (S8) and an imaging direction determination process (S9), which will be described later, performed based on the above-described setting conditions, the captured image that is specifically displayed on the liquid crystal display 15, that is, acquired from the captured image DB8. A target captured image is determined. Details will be described later.

On the other hand, in S49, the CPU 41 sets the conditions of the captured image to be displayed on the liquid crystal display 15 as follows based on the received drag operation of the user.
(A) Number of captured images: Plural sheets (B) Captured position of captured images: A predetermined interval along the trajectory path from the start point to the end point (C) Capture direction of captured image: Direction on the end point side along the trajectory path (D) Angle adjustment: None

  Thereafter, in an imaging position determination process (S8) and an imaging direction determination process (S9), which will be described later, performed based on the above-described setting conditions, the captured image that is specifically displayed on the liquid crystal display 15, that is, acquired from the captured image DB8. A target captured image is determined. Details will be described later.

  Next, sub processing of the imaging position determination processing executed in S8 will be described with reference to FIG. FIG. 18 is a flowchart of a sub-processing program for imaging position determination processing.

  First, in S51, the CPU 41 reads the setting information set in S46, S48 or S49 in the above-described drag acquisition information setting process (FIG. 16).

  Next, in S52, the CPU 41 obtains a locus route. As described above, the locus path is a locus obtained by performing map matching in S42 on the locus drawn by the user in the drag operation. Specifically, in S52, the start point of the trajectory path (corresponding to the point where the user started drawing the trajectory by the drag operation) and the end point (corresponding to the point where the user finished drawing the trajectory by the drag operation). Point) and a coordinate sequence of touch coordinates between the start point and the end point are acquired.

  Subsequently, in S53, the CPU 41 sets a base point for the trajectory path acquired in S52. Here, as shown in FIG. 19, the base points 70 are set at predetermined distance intervals (for example, 50 m intervals) along the trajectory path 71 from the start point S to the end point G of the trajectory path 71. The starting point S and the ending point G of the trajectory path 71 are also included in the base point.

  In the present embodiment, as described later, a captured image captured at the base point (that is, a captured image with the base point as the imaging position) is displayed on the liquid crystal display 15. That is, the number of base points set in S53 is the number of captured images to be displayed. Further, the set distance interval of the base points can be changed as appropriate. If the set distance interval of the base point is shortened, more captured images are displayed, so that detailed guidance can be performed, but the time required for guidance becomes longer.

  The following processing of S54 to S59 is performed for each base point set in S53. First, the process is performed on the start point, and then the base point to be processed is switched in the order closer to the start point. Then, after the process is performed for the end point, the process proceeds to S9.

  First, in S <b> 54, the CPU 41 acquires information related to the base point to be processed. Specifically, information for specifying the position of the base point counting from the start point and the position coordinates of the base point are acquired.

  Next, in S55, the CPU 41 is set to “present” for “(D) angle adjustment” among the setting information set in S46, S48 or S49 in the above-described drag acquisition information setting process (FIG. 16). It is determined whether or not. Here, as described above, when the end point of the trajectory path is located around the destination or the specific facility or point, it is set to “present” (S46, S48), and the end point of the trajectory path is set to the destination or the specific point. If it is not located around the facility or point, it is set to “None” (S49). “(D) Angle adjustment” indicates whether or not to change the setting reference of the imaging direction for each base point depending on the position of the base point, and “Yes” indicates the imaging direction of each base point depending on the position of the base point. Indicates that the setting standard is changed.

  If it is determined that “Yes” is set for “(D) Angle adjustment” (S55: YES), the process proceeds to S57. On the other hand, if it is determined that “(D) angle adjustment” is set to “none” (S55: NO), the process proceeds to S56.

  In S56, the CPU 41 associates the angle adjustment flag OFF with the base point to be processed. The ON / OFF state of the angle adjustment flag associated with each base point is stored in the flash memory 44 or the like.

  On the other hand, in S57, when the end point of the locus route is located around the destination, the CPU 41 calculates the distance from the base point to be processed to the destination. On the other hand, when the end point of the trajectory path is located around a specific facility or point, the distance from the base point to be processed to the specific facility or point is calculated. Note that the straight line distance may be calculated, or the distance along the road along the road may be calculated.

  Next, in S58, the CPU 41 determines whether or not the distance from the processing target base point calculated in S57 to the destination, a specific facility, or a point is less than a predetermined distance. For example, the predetermined distance is 300 m.

  When it is determined that the distance from the base point to be processed to the destination, the specific facility, or the point is less than the predetermined distance (S58: YES), the process proceeds to S59. On the other hand, when it is determined that the distance from the base point to be processed to the destination, the specific facility or the point is equal to or greater than the predetermined distance (S58: NO), the process proceeds to S56.

  In S59, the CPU 41 links the angle adjustment flag ON to the base point to be processed. The ON / OFF state of the angle adjustment flag associated with each base point is stored in the flash memory 44 or the like.

  After that, the processing of S54 to S59 is performed on all the base points set in S53, and then the process proceeds to S9.

  Next, the sub-process of the imaging direction determination process executed in S9 will be described with reference to FIG. FIG. 20 is a flowchart of a sub-processing program for imaging direction determination processing.

  First, in S61, the CPU 41 acquires the base point set for the locus path in S53. As described above, the base points are set at predetermined distance intervals (for example, 50 m intervals) along the trajectory path from the start point S to the end point G of the trajectory path (see FIG. 19). The starting point S and end point G of the trajectory path are also included in the base point.

  The following processes in S62 to S67 are performed for each base point acquired in S61. First, the process is performed on the start point, and then the base point to be processed is switched in the order closer to the start point. Then, after the process is performed for the end point, the process proceeds to S10.

  First, in S <b> 62, the CPU 41 acquires information related to a processing target base point. Specifically, the information for specifying the position of the base point counted from the start point, the position coordinates of the base point, and the angle adjustment flag linked in S56 or S59 are acquired.

  Next, in S63, the CPU 41 determines whether or not the angle adjustment flag associated with the processing target base point is ON. The angle adjustment flag is used when the end point of the trajectory path is located around the destination, the specific facility or the point, and the base point where the distance to the destination, the specific facility or the point is less than the predetermined distance. On the other hand, “ON” is linked (S59).

  And when it determines with the angle adjustment flag linked | related with the base point of a process target being ON (S63: YES), it transfers to S66. On the other hand, when it is determined that the angle adjustment flag associated with the base point to be processed is OFF (S63: NO), the process proceeds to S64.

  In S <b> 64, the CPU 41 acquires information on the next base point (hereinafter referred to as the next base point) adjacent to the end point side with respect to the base point to be processed. Specifically, the position coordinates of the base point are acquired.

  Thereafter, in S65, the CPU 41 sets the direction from the processing target base point to the next base point as an imaging direction with respect to the processing target base point. However, when the base point to be processed is the end point, the tangential direction of the correction locus is set as the imaging direction. As a result, as shown in FIG. 21, the imaging direction X is set to the direction of the end point along the trajectory path 71, that is, the traveling direction of the moving body assumed to move from the start point to the end point of the trajectory path 71.

  On the other hand, in S66, the CPU 41 acquires, from the map information DB 31, position information of a destination, a specific facility, or a spot determined to be around the end point of the locus route.

  Next, in S67, the CPU 41 sets the direction of the destination, the specific facility, or the point determined to be around the end point of the locus route from the processing target base point as the imaging direction with respect to the processing target base point. As a result, as shown in FIG. 22, for example, when the destination 65 is around the end point of the trajectory path 71, the imaging direction X is set in the direction from the base point 70 to the destination 65.

  Thereafter, the process proceeds to S10, and the CPU 41 acquires a plurality of captured images corresponding to the conditions set in S8 and S9 from the captured image DB 8 in association with the imaging positions. Specifically, the position of the base point set in S53 is a captured image associated with the imaging position, and a range corresponding to the imaging direction set in the base point in S65 or S67 (for example, the imaging direction) The captured image (within 120 degrees with respect to the center) is acquired from the captured image DB 8. When a plurality of base points are set, a captured image corresponding to each base point is acquired from the captured image DB 8. When there is no captured image in the captured image DB 8 in which the same position as the base point position is associated with the captured position, a captured image associated with the closest captured position is acquired (that is, the base point position is Will be corrected). The acquired captured image is displayed on the liquid crystal display 15 (S11).

The captured image display processing in S11 will be described in detail below.
First, the CPU 41 displays on the liquid crystal display 15 a captured image in which the start point of the trajectory path is associated as the imaging position among the captured images corresponding to the base points acquired in S10. Thereafter, the captured images are sequentially switched and displayed in the order from the start point of the trajectory path, and finally, the captured image in which the end point of the trajectory path is associated as the imaging position is displayed on the liquid crystal display 15. In addition, although the interval which switches a captured image can be set suitably, it is set as 1 second interval, for example.

  As a result, the liquid crystal display 15 first displays a captured image captured at the start point S of the trajectory path, and then gradually switches to a captured image captured at a position close to the end point G along the trajectory path. Become.

  Further, the range to be displayed in the captured image is determined by the “imaging direction” set for each base point. As described above, the imaging direction basically set as the base point is the direction of the next base point adjacent to the end point side, that is, the direction of the end point side along the trajectory path (S65).

  Therefore, when there is no destination or specific facility or point at the end point of the trajectory path, the imaging direction X of each base point 70 is always the direction on the end point G side along the trajectory path 71 as shown in FIG. . As a result, as shown in FIG. 24, the liquid crystal display 15 continuously displays the picked-up image 66 with the straight road direction as the image pickup direction.

  On the other hand, when there is a destination or a specific facility or point at the end point of the trajectory path, the imaging direction X of each base point 70 is predetermined from the destination 65 (or a specific facility or point) as shown in FIG. The base point 70 located at a position more than the distance is in the direction of the end point G along the trajectory path 71. On the other hand, the base point 70 located at a position less than a predetermined distance from the destination 65 (or a specific facility or point) is in the direction from the base point 70 to the destination 65 (or a specific facility or point) (S67).

  As a result, as shown in FIG. 26, first, a picked-up image 66 with the straight direction of the road as the image pickup direction X is displayed on the liquid crystal display 15 as shown in FIG. Thereafter, according to switching of the captured image 66 to be displayed, the imaging direction X of the captured image 66 to be displayed is changed from the direction on the end point side along the trajectory path to the destination 65 (or a specific facility or point) side. Specifically, the imaging direction X is changed when the base point 70 that is the display target of the captured image 66 becomes less than a predetermined distance to the destination 65 (or a specific facility or point). In particular, in the present embodiment, as described above, the imaging direction X is the direction from the base point 70 (imaging position) to the destination 65 (or a specific facility or point), so the objective included in the displayed captured image 66 is included. The ground 65 is located near the center of the image. Therefore, the position of the destination 65 can be easily specified from the captured image 66 displayed by the user in association with the surrounding environment (roads, surrounding facilities, etc.). In addition, it is possible to grasp the appearance and landmarks of the destination 65.

  When changing the imaging direction of the captured image displayed on the liquid crystal display 15, the change amount of the imaging direction per stage is within a predetermined amount (for example, within 5 degrees) in order to ensure continuity with the previous frame. Is desirable. As a result, the change amount of the vanishing point of the continuously switched captured image 66 can be reduced (for example, several percent or less within the angle of view), and a series of continuously switched captured images 66 can have continuity. It becomes possible.

  The display of the captured image 66 may be terminated when a captured image with the end point of the trajectory path as the imaging position is displayed, or after the captured image with the end point of the trajectory path as the imaging position is displayed, the trajectory path is displayed again. It is also possible to display a picked-up image with the starting point of the picked-up position as the picked-up position and repeatedly switch the display of the picked-up image from the starting point to the end point.

  As described above in detail, in the map image display system 1 according to the present embodiment, the map image display method by the map image display system 1, and the computer program executed by the map image display system 1, the map displayed on the liquid crystal display 15 is displayed. When the user accepts a drag operation for drawing a trajectory on the image, a trajectory path obtained by map-matching the trajectory drawn by the user on the map is acquired (S42), and a captured image obtained by capturing the surrounding environment along the trajectory path is acquired. The captured image is acquired from the captured image DB 8 in association with the captured image position (S10), a plurality of base points are set from the start point to the end point of the trajectory path (S53), and each base point corresponds to the image capturing position. The plurality of attached captured images 66 are sequentially switched and displayed in the order in which the imaging positions are closer to the start point of the trajectory path (S11). The captured image of the route along the surrounding environment of the desired over The it is possible to display. As a result, for example, the user can easily specify the position of the destination from the displayed captured image in association with the surrounding environment. It is also possible to display a picked-up image of a point where a user wants to grasp the situation before traveling, such as difficult intersections and waypoints on the route to the destination. Furthermore, if the user draws a locus at a timing at which the user can check the captured image, such as when the vehicle is stopped (for example, when the red signal is stopped), the captured image can be easily confirmed.

Note that the present invention is not limited to the above-described embodiment, and various improvements and modifications can be made without departing from the scope of the present invention.
For example, in the present embodiment, the captured image to be displayed by the navigation device 5 is acquired from the DB of the information server 3, but the captured image may be stored in the DB of the navigation device 5 in advance. In this case, the map image display system 1 can be configured with the navigation device 5 alone.

  Further, in the present embodiment, as a timing to start changing the imaging direction to the destination (or specific facility or point) side, the base point that is the display target of the captured image is predetermined to the destination (or specific facility or point). The condition is that the distance is less than 300 m (for example, 300 m), but other conditions may be set. For example, it may be the latest timing at which the direction in which the destination exists is changed with respect to the base point that is the display target of the captured image.

  In this embodiment, a drag operation on the touch panel 14 is described as an example of an operation for drawing a trajectory on the map image 51. However, an operation other than a drag operation on the touch panel 14 is an operation for drawing a trajectory. May be. For example, an operation using a tablet or an operation of drawing a locus by operating a pointer displayed on the screen of the liquid crystal display 15 may be used.

  In this embodiment, when a user's drag operation is accepted and there is a destination (or a specific facility or point) around the end point of the locus drawn by the user, a predetermined distance from the destination The direction of the destination from the base point is displayed as the imaging direction for the captured image in which the base point of less than is associated as the imaging position (FIG. 25), but the base point less than a predetermined distance from the end point of the trajectory path corresponds as the imaging position. It is good also as a structure which displays the direction of the destination from a base point as an imaging direction about the attached captured image.

  In the present embodiment, the CPU 41 of the navigation device 5 is configured to execute each step of the captured image display processing program (FIG. 4), but the CPU of the information server 3 and other external servers partially or entirely process. It is good also as a structure which performs.

  Moreover, the present invention can apply various information terminals having a function of displaying a map image instead of the navigation device 5 included in the map image display system 1. For example, the present invention can be applied to a mobile phone, a smartphone, a tablet terminal, a personal computer, and the like.

  Moreover, although the Example which actualized the map image display system which concerns on this invention was demonstrated above, the map image display system can also have the following structures, and there exists the following effect in that case.

For example, the first configuration is as follows.
An image display means (41) for displaying a map image (51) on the display device (15), an operation accepting means (41) for accepting an operation for a user to draw a locus on the map image displayed on the display device, A map matching means (41) for acquiring a locus route (71) obtained by map-matching a locus drawn by the user on a map, and a captured image (66) obtained by imaging the surrounding environment along the locus route. And a plurality of base points (70) between the start point and the end point of the trajectory path, and a plurality of base points at the image pickup position. And a captured image display means (41) for sequentially switching and displaying the plurality of captured images associated with each other in the order that the imaging position is closer to the start point of the trajectory path.
According to the map image display system having the above configuration, since the user performs an operation of drawing a locus on the map image, the captured images of the surrounding environment along the route according to the drawn locus are sequentially switched and displayed. A captured image of the surrounding environment along the route desired by the user can be displayed. As a result, for example, the user can easily specify the position of the destination from the displayed captured image in association with the surrounding environment. It is also possible to display a picked-up image of a point where a user wants to grasp the situation before traveling, such as difficult intersections and waypoints on the route to the destination.

The second configuration is as follows.
The start point of the trajectory path (71) corresponds to the point where the user starts drawing the trajectory, and the end point of the trajectory path corresponds to the point where the user finishes drawing the trajectory.
According to the map image display system having the above-described configuration, it is possible to display a captured image in which the imaging position moves in a direction desired by the user. As a result, when the user moves, the captured image can be displayed in association with the scenery that the user will actually see.

The third configuration is as follows.
Destination setting means (41) for setting a destination is provided, and the captured image display means (41) displays the captured image (66 displayed when the end point of the trajectory path (71) is around the destination. ), The imaging direction of the captured image to be displayed is changed from the direction on the end point side along the trajectory path to the destination side.
According to the map image display system having the above configuration, since the destination included in the displayed captured image is located near the center of the image, the user can determine the surrounding environment (roads and surroundings) from the displayed captured image. The location of the destination can be easily specified in association with the facility. It is also possible to grasp the appearance and landmarks of the destination.

The fourth configuration is as follows.
The captured image display means (41) is configured such that the captured image (66) in which the base point (70) that is a predetermined distance or more away from the destination is associated as the imaging position is the path (71) from the base point. The direction of another base point adjacent to the end point side of the image is displayed as the imaging direction, and the captured image in which the base point less than a predetermined distance from the destination is associated as the imaging position is displayed from the base point to the destination. The direction is displayed as the imaging direction.
According to the map image display system having the above configuration, when the imaging position of the captured image to be displayed approaches a position where the destination can be visually recognized, the image is switched to the captured image with the destination as the imaging direction, so that the user is displayed. It is possible to easily specify the position of the destination from the captured image in correspondence with the surrounding environment (roads, surrounding facilities, etc.). It is also possible to grasp the appearance and landmarks of the destination.

The fifth configuration is as follows.
It has a position acquisition means (41) that acquires the position of a specific facility or point on the map image (51), and the captured image display means (41) has an end point of the trajectory path (71) as the specific position. When the area is around a facility or point, the imaging direction of the captured image to be displayed is changed from the direction of the end point along the trajectory path to the specific facility or point according to the switching of the captured image (66) to be displayed. To do.
According to the map image display system having the above-described configuration, the specific facility or spot included in the displayed captured image is located near the center of the image. It is possible to easily specify the position of a specific facility or point in correspondence with a road or a surrounding facility. It is also possible to grasp the appearance and landmarks of a specific facility or point.

The sixth configuration is as follows.
The captured image display means (41) is configured such that the captured image (66) in which the base point (70) separated from the specific facility or point by a predetermined distance or more is associated as the imaging position is The direction of another base point adjacent to the end point side of (71) is displayed as the imaging direction, and the captured image in which the base point less than a predetermined distance from the specific facility or point is associated as the imaging position is The direction of the specific facility or point from the base point is displayed as the imaging direction.
According to the map image display system having the above configuration, when the imaging position of the captured image to be displayed approaches a position where a specific facility or point can be visually recognized, the image is switched to a captured image with the specific facility or point as the imaging direction. Therefore, it becomes possible to easily specify the position of a specific facility or point in correspondence with the surrounding environment (roads, surrounding facilities, etc.) from the captured image displayed. It is also possible to grasp the appearance and landmarks of a specific facility or point.

DESCRIPTION OF SYMBOLS 1 Map image display system 2 Information management center 3 Information server 4 User 5 Navigation apparatus 8 Captured image DB
9 Imaging position 10 Captured image 14 Touch panel 41 CPU
42 RAM
43 ROM
51 Map Image 61 Touch Point 65 Destination 66 Captured Image 70 Base Point 71 Trajectory Path

Claims (8)

Image display means for displaying a map image on a display device;
Operation accepting means for accepting an operation in which a user draws a locus on the map image displayed on the display device;
Map matching means for acquiring a locus route obtained by map matching the locus drawn by the user on a map;
Image data acquisition means for acquiring a captured image obtained by imaging the surrounding environment along the trajectory path in association with an imaging position where the captured image is captured;
A plurality of base points are set between a start point and an end point of the trajectory path, and a plurality of the captured images in which a plurality of the base points are associated as the imaging positions are set such that the imaging position is close to the start point of the trajectory path A map image display system comprising captured image display means for sequentially switching and displaying.   The map according to claim 1, wherein a start point of the trajectory path corresponds to a point where the user starts drawing the trajectory, and an end point of the trajectory path corresponds to a point where the user finishes drawing the trajectory. Image display system. Having destination setting means for setting the destination,
The captured image display means includes:
When the end point of the trajectory path is around a destination, the imaging direction of the captured image to be displayed is changed from the direction of the end point side along the trajectory path to the destination side according to switching of the captured image to be displayed. The map image display system according to claim 1 or 2. The captured image display means includes:
The captured image in which the base point that is more than a predetermined distance away from the destination is associated as the imaging position displays the direction of another base point adjacent to the end point side of the trajectory path from the base point as the imaging direction,
The map image display system according to claim 3, wherein the captured image in which the base point less than a predetermined distance from the destination is associated as the imaging position displays the direction of the destination from the base point as the imaging direction. Having position acquisition means for acquiring the position of a specific facility or point on the map image;
The captured image display means includes:
When the end point of the trajectory path is around the specific facility or point, the imaging direction of the captured image to be displayed is changed from the direction on the end point side along the trajectory path according to the switching of the captured image to be displayed. The map image display system according to claim 1, wherein the map image display system is changed to a facility or a point side. The captured image display means includes:
The captured image in which the base point that is a predetermined distance or more away from the specific facility or point is associated as the imaging position displays the direction of another base point adjacent to the end point side of the trajectory path from the base point as the imaging direction. And
6. The captured image in which the base point less than a predetermined distance from the specific facility or point is associated as the imaging position displays the direction of the specific facility or point from the base point as an imaging direction. Map image display system. An image display means for displaying a map image on a display device;
A step of receiving an operation in which a user draws a locus on the map image displayed on the display device;
A step of acquiring a trajectory path obtained by map-matching a trajectory drawn by the user on a map;
An image data acquisition means for acquiring a captured image obtained by imaging the surrounding environment along the trajectory path in association with an imaging position where the captured image is captured;
The captured image display means sets a plurality of base points between a start point and an end point of the trajectory path, and a plurality of the captured images in which a plurality of the base points are associated as the image pickup positions, A map image display method comprising: sequentially switching and displaying in order from the start point of the locus route. Computer
Image display means for displaying a map image on a display device;
Operation accepting means for accepting an operation in which a user draws a locus on the map image displayed on the display device;
Map matching means for acquiring a locus route obtained by map matching the locus drawn by the user on a map;
Image data acquisition means for acquiring a captured image obtained by imaging the surrounding environment along the trajectory path in association with an imaging position where the captured image is captured;
A plurality of base points are set between a start point and an end point of the trajectory path, and a plurality of the captured images in which a plurality of the base points are associated as the imaging positions are set such that the imaging position is close to the start point of the trajectory path Captured image display means for sequentially switching and displaying;
Computer program to make it function.

Images