JP2017026453A - Route guide system, route guide method and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a route guide system, route guide method and computer program that allow users to specify a location of a destination from photographing images in which a user is displayed in association with the location thereof with surrounding environments.SOLUTION: A taken image in which surrounding environments along a guide route 52 set by a navigation device 5 are taken is acquired in association with an image-taken location where the taken-image is taken, and a virtual location 61 of a vehicle moving toward a destination along the guide route 52 is defined, and the taken image associated with an arrival point of the virtual location 61 as the image-taken location is displayed while sequentially switching following a movement of the virtual location 61. A route guide system is configured so as to gradually change an image-taken direction of the taken image to be displayed from a travelling direction of the virtual location 61 to a destination side as the virtual location 61 approaches the destination.SELECTED DRAWING: Figure 13

Description

  The present invention relates to a route guidance system, a route guidance method, and a computer program that perform guidance related to a guidance route.

  2. Description of the Related Art In recent years, a navigation device is often mounted on a vehicle that provides vehicle travel guidance so that a driver can easily arrive at a desired destination. Here, the navigation device detects the current position of the vehicle by a GPS receiver or the like, acquires map data corresponding to the current position through a recording medium such as a DVD-ROM or HDD or a network, and displays it on a liquid crystal monitor. It is a device that can do. Further, the navigation device has a route search function for searching for a recommended route from the vehicle position to the destination when a desired destination is input, and sets the searched recommended route as a guide route. A guide route is displayed on the screen, and when the user approaches an intersection, the user is surely guided to a desired destination by voice guidance. In recent years, some mobile phones, smartphones, tablet terminals, personal computers, and the like have functions similar to those of the navigation device.

  Furthermore, conventionally, as a means for specifically guiding the details of the guide route by the user, a technique for displaying a captured image obtained by actually capturing the surrounding environment along the guide route has been proposed. For example, in Japanese Patent Laid-Open No. 2006-84184, when a request is made from a navigation device, the navigation device displays a captured image obtained by imaging an intersection or a landmark on the guidance route along the traveling direction of the vehicle on the guidance route. The technology for sequentially distributing the captured images distributed in the navigation device and displaying them is described.

JP 2006-84184 A (page 5-7, FIG. 8)

  Here, in the technique of Patent Document 1, a virtual position of a vehicle moving at a predetermined speed along the guidance route toward the destination side is defined, and corresponds to the field of view of a user who rides on the vehicle assumed to be at the virtual position. The captured images to be displayed are sequentially switched and displayed. Specifically, an image obtained by capturing the traveling direction of the vehicle (the direction along the guide route) from the virtual position is displayed. Therefore, for the section in which the virtual position of the vehicle goes straight on the road, an image that captures the straight direction of the road is displayed, and the direction of the picked-up image that is displayed along the right-left turn direction when reaching the right-left turn point Will change.

  And in the structure which switches and displays the picked-up image of a surrounding environment according to the virtual position of the vehicle which moves to the destination side along a guidance path | route like the said patent document 1, especially until a virtual position reaches | attains a destination. By displaying the captured image, the following effects can be expected. First, it is possible to identify the location of the destination in correspondence with the surrounding environment (roads, surrounding facilities, etc.) that the user will visually recognize compared to the case of identifying the location of the destination on the map. It becomes. Second, it becomes possible to grasp the appearance and landmarks of the destination. However, in the said patent document 1, the said effect was not fully exhibited for the following reasons.

  That is, as shown in FIG. 15, the guide route 102 set for the destination 101 is a straight line along the road until just before the destination 101, and then turns right and left into the destination 101 and enters. Therefore, until the virtual position 103 of the vehicle moving along the guide route 102 arrives immediately before the destination 101, the captured image 104 that captures the straight direction of the road is displayed, and the virtual position 103 is the destination 101. The captured image 104 obtained by capturing the direction of the destination 101 is displayed at the last timing of reaching.

  As a result, the user cannot grasp which facility or point included in the captured image 104 is the destination unless the virtual position 103 reaches immediately before reaching the destination 101. On the other hand, the captured image 104 displayed when the virtual position 103 arrives immediately before the destination 101 is an image in which only the destination 101 is captured while facing the direction of the destination 101, so that the user It was difficult to identify the location of the destination 101 in correspondence with the surrounding environment. Further, such a display of the captured image 104 may be performed during the stop time of the running vehicle (for example, when the red signal is stopped), but the display is interrupted when the vehicle resumes running. There are many cases, and it is inconvenient for the user that the position and appearance of the destination cannot be specified unless it is visible to the end.

  The present invention has been made in order to solve the above-described conventional problems, and when a captured image obtained by actually capturing the surrounding environment along the guide route is sequentially switched and displayed, the user can start from the captured image displayed on the periphery. It is an object of the present invention to provide a route guidance system, a route guidance method, and a computer program that can easily identify a destination position in correspondence with an environment.

  In order to achieve the above object, a route guidance system according to the present invention captures a picked-up image of a guide route setting means for setting a guide route to a destination, and a picked-up image of the surrounding environment along the guide route. The image data acquisition means that is acquired in association with the imaging position, the virtual position of the moving body that moves along the guide route toward the destination, and the point at which the virtual position of the moving body has reached is defined as the imaging position Captured image display means for sequentially switching and displaying the associated captured images as the virtual position of the moving body moves, and the captured image display means has the virtual position of the moving body as the virtual position. As the vehicle approaches the destination, the imaging direction of the captured image to be displayed is changed stepwise from the traveling direction of the virtual position of the moving body to the destination side.

  In addition, the route guidance method according to the present invention is a method for performing more detailed guidance on a set guidance route using a captured image actually taken along the guidance route. Specifically, the guide route setting unit sets the guide route to the destination, and the image data acquisition unit captures the captured image obtained by imaging the surrounding environment along the guide route. A step of acquiring in association with a position; and a captured image display means defines a virtual position of a moving body that moves toward the destination along the guide route, and a point at which the virtual position of the moving body has reached the imaging position And sequentially switching and displaying the captured image associated with the position as the virtual position of the moving object moves, and the captured image display means includes the virtual position of the moving object as the target. As the user approaches the ground, the imaging direction of the captured image to be displayed is changed stepwise from the traveling direction of the virtual position of the moving body to the destination side.

  The computer program according to the present invention is a program for performing more detailed guidance on a set guidance route using a captured image actually taken along the guidance route. Specifically, the computer acquires a guidance route setting means for setting a guidance route to the destination, and a captured image obtained by imaging the surrounding environment along the guidance route in association with an imaging position where the captured image is captured. The captured image in which the image data acquisition means to be defined and the virtual position of the moving body moving toward the destination along the guide route are defined, and the point at which the virtual position of the moving body has reached is associated as the imaging position Is a computer program for functioning as a captured image display means for sequentially switching and displaying as the virtual position of the moving body moves, wherein the captured image display means has a virtual position of the moving body. As the vehicle approaches the destination, the imaging direction of the captured image to be displayed is changed stepwise from the traveling direction of the virtual position of the moving body to the destination side.

  According to the route guidance system, route guidance method, and computer program of the present invention having the above-described configuration, the set virtual position is moved on the guidance route, and the surrounding environment along the guidance route is actually moved along with the movement of the virtual position. When the captured image is sequentially switched and displayed, the imaging direction of the captured image to be displayed is gradually changed from the traveling direction of the virtual position to the destination side as the virtual position approaches the destination. The position of the destination can be easily specified from the captured image on which is displayed in correspondence with the surrounding environment. It is also possible to grasp the appearance and landmarks of the destination. As a result, after the user reaches the vicinity of the destination, it is possible to reliably reach the destination without misidentifying the destination from the surrounding environment visually recognized by the user, the appearance of the facility, the landmark, and the like. In particular, in a navigation device that performs movement guidance of a moving body, there is a problem that the movement guidance ends when the moving body reaches the periphery of the destination, but this problem can also be solved. Furthermore, the user can specify the position and appearance of the destination without having to look at the captured images displayed by switching sequentially.

It is a schematic structure figure showing a route guidance system concerning this embodiment. It is the figure which showed the captured image memorize | stored in an information server. It is the block diagram which showed the navigation apparatus which concerns on this embodiment. It is a flowchart of the route guidance processing program which concerns on this embodiment. It is the figure which showed the driving guidance screen displayed on a liquid crystal display. It is the figure which showed the virtual position of the vehicle. It is a figure explaining the imaging direction at the normal time. It is a figure explaining the imaging direction when the virtual position of a vehicle approaches the destination. It is the figure which showed the start conditions which start the change of an imaging direction. It is the figure which showed the start conditions which start the change of an imaging direction. It is the figure which showed the start conditions which start the change of an imaging direction. It is the figure which showed the imaging direction in the process in which the virtual position of a vehicle moves to a destination along a guidance route. It is the figure which showed the captured image displayed on the liquid crystal display in the process in which the virtual position of a vehicle moves to a destination along a guidance route. It is the figure shown about the vanishing point of a captured image. It is a figure explaining the problem of the prior art.

  Hereinafter, based on one embodiment which materialized a route guidance system concerning the present invention, it explains in detail, referring to drawings. First, a schematic configuration of the route guidance system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a schematic configuration diagram showing a route guidance system 1 according to the present embodiment.

  As shown in FIG. 1, a route guidance system 1 according to the present embodiment basically includes an information server 3 included in an information management center 2 and a navigation device 5 mounted on a vehicle on which a user 4 gets. Yes. The navigation device 5 may be an information terminal having a navigation function, and may be a mobile phone, a PDA, a tablet terminal, a smartphone, a personal computer, or the like in addition to the navigation device. The information management center 2 and the navigation device 5 are configured to be able to transmit and receive electronic data to and from each other via the communication network 6.

  Here, the information server 3 stores map information regarding road networks and facilities in various places in the map information DB 7. Moreover, the captured image DB8 which memorize | stores actually the surrounding environment along the road contained in map information is memorize | stored in captured image DB8. And it is a server apparatus which provides the captured image memorize | stored in DB in response to the request | requirement of the navigation apparatus 5. FIG. Here, the captured image stored in the captured image DB 8 is an image captured by a camera that is actually mounted on a vehicle that has traveled on roads throughout the country, and is a 360-degree panoramic image centered on the imaging position. The captured image DB 8 stores a captured image 10 in association with each captured position 9 on the road as shown in FIG. Note that the interval between the imaging positions 9 can be set as appropriate, for example, 2 m to 3 m. Further, the imaging positions 9 do not have to be set on all roads in the whole country, and narrow streets and the like may be excluded.

  On the other hand, the navigation device 5 searches for a recommended route to the destination, displays a map image around the current position of the user 4 at a predetermined scale based on map data obtained from a server or stored in a memory. In the displayed map image, it has a function of displaying the current position of the user 4 and performing movement guidance along the set guidance route. Note that the navigation device 5 does not have to have all of the above functions, and the present invention can be configured as long as it has at least a function of performing movement guidance along a set guidance route.

  The communication network 6 includes a large number of base stations arranged in various parts of the country and a communication company that manages and controls each base station. The base station and the communication company are connected to each other by wire (optical fiber, ISDN, etc.) or wirelessly. It is configured by connecting. Here, the base station has a transceiver (transmitter / receiver) for communicating with the navigation device 5 and an antenna. The base station performs wireless communication between the communication companies, and relays the communication of the navigation device 5 that is at the end of the communication network 6 within the range (cell) of the base station to and from the information server 3. Have a role to play.

  Next, a schematic configuration of the navigation device 5 included in the route guidance system 1 will be described with reference to FIG. FIG. 3 is a block diagram schematically showing a control system of the navigation device 5 according to the present embodiment.

  As shown in FIG. 1, the navigation device 5 according to the present embodiment includes a current position detection unit 11 that detects a current position of a vehicle on which the navigation device 5 is mounted, a data recording unit 12 that records various data, A navigation ECU 13 that performs various arithmetic processes based on the input information, an operation unit 14 that receives operations from the user, a liquid crystal display 15 that displays guidance information about a map and facilities around the vehicle to the user, Communication between a speaker 16 that outputs voice guidance related to route guidance, a DVD drive 17 that reads a DVD as a storage medium, and an information center such as an information management center 2 or a VICS (registered trademark: Vehicle Information and Communication System) center And a communication module 18 for performing.

Below, each component which the navigation apparatus 5 has is demonstrated in order.
The current position detection unit 11 includes a GPS 21, a vehicle speed sensor 22, a steering sensor 23, a gyro sensor 24, and the like, and can detect the current vehicle position, direction, vehicle traveling speed, current time, and the like. . Here, in particular, the vehicle speed sensor 22 is a sensor for detecting a moving distance and a vehicle speed of the vehicle, generates a pulse according to the rotation of the driving wheel of the vehicle, and outputs a pulse signal to the navigation ECU 13. And navigation ECU13 calculates the rotational speed and moving distance of a driving wheel by counting the generated pulse. Note that the navigation device 5 does not have to include all of the four types of sensors, and the navigation device 5 may have only one or more types of these sensors.

  The data recording unit 12 is also a hard disk (not shown) as an external storage device and a recording medium, and a driver for reading the map information DB 31 and a predetermined program recorded on the hard disk and writing predetermined data on the hard disk And a recording head (not shown). The data recording unit 12 may be configured by a memory card, an optical disk such as a CD or a DVD, instead of the hard disk. Moreover, the navigation apparatus 5 is good also as a structure which acquires map information from the information server 3 by communication, without having map information DB31.

  Here, the map information DB 31 includes, for example, link data 33 relating to roads (links), node data 34 relating to node points, search data 35 used for processing relating to route search, point data 36 relating to points such as facilities, and maps. The storage means stores map display data for display, intersection data for each intersection, search data for searching for points, and the like.

  The link data 33 includes the width of the road to which the link belongs, the gradient, the cant, the bank, the road surface state, the number of lanes on the road, the number of lanes decreasing, The data representing the narrowing point, railroad crossing, etc., the corner, the radius of curvature, the intersection, the T-junction, the corner entrance and the exit, etc. The data representing the downhill road, the uphill road, etc. Regarding types, in addition to general roads such as national roads, prefectural roads and narrow streets, data representing toll roads such as national highways, urban highways, general toll roads, and toll bridges are recorded.

  The node data 34 includes actual road branch points (including intersections, T-junctions, etc.) and the coordinates (positions) of node points set for each road according to the radius of curvature, etc. Node attribute indicating whether a node is a node corresponding to an intersection, etc., a connection link number list that is a list of link numbers of links connected to the node, and an adjacency that is a list of node numbers of nodes adjacent to the node via the link Data relating to the node number list, the height (altitude) of each node point, and the like are recorded.

  Further, as the search data 35, various data used for route search processing for searching for a route from a departure place (for example, the current position of the vehicle) to a set destination as described later are recorded. Specifically, the cost of quantifying the appropriate degree as a route to an intersection (hereinafter referred to as an intersection cost), the cost of quantifying the appropriate degree as a route to a link constituting a road (hereinafter referred to as a link cost), etc. Cost calculation data used for calculating the search cost is stored.

Here, the intersection cost is set for each node corresponding to the intersection included in the route for which the search cost is to be calculated. The presence or absence of a traffic light, the travel route of the vehicle when passing through the intersection (that is, straight, right and left turns) The value is calculated according to the type of
The link cost is set for each link included in the route for which the search cost is calculated. Based on the link length, the link attribute, road type, road width, number of lanes, traffic conditions, etc. of the link are considered. Is calculated.

  Further, as the point data 36, information on points such as a departure point, a destination, a facility to be guided in the navigation device 5 is stored. For example, accommodation facilities such as hotels and inns, refueling facilities such as gas stations, commercial facilities such as shopping malls, supermarkets, shopping centers and convenience stores, entertainment facilities such as theme parks and game centers, restaurants, bars and pubs Information on facilities such as facilities, parking facilities such as public parking lots, transportation facilities, religious facilities such as temples and churches, public facilities such as museums and museums, and the like. The point data 36 includes, for each point, a point number that is an identifier of the point, a point name indicating the name of the point, and a genre of the facility (“parking lot”, “post office”, A facility genre indicating “restaurant” and the like, a position coordinate indicating the position of the point, and the like.

  The navigation ECU (Electronic Control Unit) 13 is an electronic control unit that controls the entire navigation device 5, and includes a CPU 41 as an arithmetic device and a control device, and a working memory when the CPU 41 performs various arithmetic processes. Read out from the ROM 43 and the ROM 43 in which a route guidance processing program (FIG. 4) described later is recorded in addition to the RAM 42 and the control program for storing the route data when the route is searched. An internal storage device such as a flash memory 44 for storing the program is provided. The navigation ECU 13 has various means as processing algorithms. For example, the guide route setting means sets a guide route to the destination. The image data acquisition unit acquires a captured image obtained by imaging the surrounding environment along the guide route in association with an imaging position where the captured image is captured. The captured image display means defines a virtual position of the vehicle moving toward the destination along the guide route, and displays a captured image in which the point at which the virtual position of the vehicle has arrived is associated as the imaging position of the vehicle's virtual position. The display is sequentially switched with the movement. The movement guide means guides the movement of the vehicle along the guide route. The map image display means displays a map image around the moving body at a predetermined scale.

  The operation unit 14 is operated when inputting a starting point as a travel start point and a destination as a travel end point, and has a plurality of operation switches (not shown) such as various keys and buttons. Then, the navigation ECU 13 performs control to execute various corresponding operations based on switch signals output by pressing the switches. The operation unit 14 may have a touch panel provided on the front surface of the liquid crystal display 15. Moreover, it is good also as a structure which has a microphone and a speech recognition apparatus.

  The liquid crystal display 15 includes a map image including a road, traffic information, operation guidance, operation menu, key guidance, guidance route from the departure point to the destination, guidance information along the guidance route, news, weather forecast, Time, mail, TV program, etc. are displayed. Moreover, in this embodiment, it is used also when displaying the picked-up image which imaged the surrounding environment along the guidance route | root set by the navigation apparatus 5 as mentioned later. In place of the liquid crystal display 15, HUD or HMD may be used.

  Further, the speaker 16 outputs voice guidance for guiding traveling along the planned traveling route and traffic information guidance based on an instruction from the navigation ECU 13.

  The DVD drive 17 is a drive that can read data recorded on a recording medium such as a DVD or a CD. Based on the read data, music and video are reproduced, the map information DB 31 is updated, and the like.

  The communication module 18 is a communication device for receiving traffic information composed of information such as traffic jam information, regulation information, and traffic accident information transmitted from a traffic information center, for example, a VICS center or a probe center. For example, a mobile phone or DCM is applicable. Moreover, in this embodiment, it is used also for receiving the captured image stored in captured image DB8 from the information server 3. FIG.

  Next, a route guidance processing program executed by the CPU 41 in the navigation device 5 having the above configuration will be described with reference to FIG. FIG. 4 is a flowchart of the route guidance processing program according to the present embodiment. Here, the route guidance processing program is executed after the ACC power supply (accessory power supply) of the vehicle is turned on, and the guidance image is obtained by sequentially switching and displaying captured images obtained by capturing the surrounding environment along the guidance route in the traveling direction of the vehicle. This program provides route guidance. Note that the program shown in the flowchart of FIG. 4 below is stored in the RAM 42 or the ROM 43 provided in the navigation device 5 and is executed by the CPU 41.

  First, in step (hereinafter abbreviated as S) 1 in the route guidance processing program, the CPU 41 obtains a guidance route (a user's scheduled travel route) currently set in the navigation device 5. The guidance route is a recommended route from the starting point to the destination set by the navigation device 5, and is searched using, for example, a known Dijkstra method. The navigation route 5 may be searched for the guidance route, or may be searched by an external server (for example, the information server 3). Further, the departure point may be the current position of the user or an arbitrary point selected by the user (for example, home). On the other hand, the destination is set based on, for example, a user operation (for example, a registration point reading operation, facility search or selection operation) received in the operation unit 14.

  Next, in S <b> 2, the CPU 41 communicates with the information server 3 to acquire the captured image 10 obtained by capturing the surrounding environment along the guide route from the captured image DB 8 included in the information server 3. The captured image 10 is a 360-degree panoramic image centered on the imaging position 9 as described above, and the captured image 10 is stored in the captured image DB 8 in association with each imaging position 9 on the road ( (See FIG. 2).

  Therefore, in S2, the CPU 41 first transmits to the information server 3 a request for the captured image 10 as well as information for specifying the guide route acquired in S1 (for example, the link number of the link row constituting the guide route). And the information server 3 which received the request | requirement of the captured image 10 extracts the captured image 10 by which the imaging position 9 was matched with the guide route transmitted especially among the captured images 10 memorize | stored in captured image DB8. To the requesting navigation device 5. More specifically, the information server 3 transmits the extracted image data of the captured image 10 in association with the coordinates of the imaging position where the captured image 10 was captured.

  In addition, the CPU 41 may acquire only the captured image 10 to be displayed in the navigation device 5 instead of acquiring all the captured images 10 associated with the imaging positions 9 on the guidance route in S2. good. Here, in the route guidance system 1 of the present embodiment, the captured images 10 along all the guidance routes from the departure point to the destination are not displayed, but only the captured images 10 in the peripheral area around the destination are displayed. And Therefore, it is good also as a structure which acquires only the captured image 10 with which the imaging position 9 was matched on the guidance path | route included in the peripheral area of the destination. Further, the acquisition of the captured image 10 in S2 may be performed in parallel with the display (S8) of the captured image 10 described later. That is, the processing after S3 may be performed in parallel with the acquisition of the captured image 10.

  Subsequently, in S <b> 3, the CPU 41 acquires the current position of the vehicle based on the detection result of the current position detection unit 11. A map matching process for specifying the current position of the vehicle on the map data is also performed. Furthermore, it is desirable to specify the current position of the vehicle in detail using high-precision location technology. Here, the high-accuracy location technology detects the white line and road surface paint information captured from the camera behind the vehicle by image recognition, and further compares the white line and road surface paint information with a previously stored map information DB, thereby driving the vehicle. This is a technology that makes it possible to detect lanes and highly accurate vehicle positions. The details of the high-accuracy location technology are already known and will be omitted.

After that, in S4, the CPU 41 determines whether or not a guidance start condition for starting guidance of the guidance route using the captured image 10 is satisfied based on the current position of the vehicle acquired in S3 and the operation status of the navigation device 5. judge. Here, for example, the following conditions (A) to (D) are set as the guidance start conditions.
(A) The travel guidance based on the guidance route by the navigation device 5 has ended.
(B) The vehicle has passed the final branch point in front of the destination of the guide route (a branch point that intersects the narrow street may be excluded).
(C) The destination is included in the map image around the current position of the vehicle displayed on the liquid crystal display 15.
(D) The vehicle has reached within a predetermined distance (for example, within 300 m) from the destination.
In S4, it may be determined whether at least one of the above conditions (A) to (D) is satisfied, or a plurality of conditions (for example, all of (A) to (D) may be determined. It may be determined whether or not the above condition is satisfied.

  If it is determined that the guidance start condition for starting the guidance of the guidance route using the captured image 10 is satisfied (S4: YES), the process proceeds to S5. On the other hand, when it is determined that the guidance start condition for starting the guidance of the guidance route using the captured image 10 is not satisfied (S4: NO), the process waits until the guidance start condition is satisfied.

  In S <b> 5, the CPU 41 determines whether or not the current state of the vehicle satisfies a feasible condition that can guide the guidance route using the captured image 10. It should be noted that the feasible condition is that the display of the captured image 10 is in a condition that does not affect the running of the vehicle. For example, the condition is that the vehicle is stopped and the side brake is operating.

  And when it determines with the present condition of a vehicle satisfy | filling the feasible conditions which can implement guidance of the guidance route using the captured image 10 (S5: YES), it transfers to S6. On the other hand, when it is determined that the current situation of the vehicle does not satisfy the feasible conditions for enabling guidance of the guidance route using the captured image 10 (S5: NO), the process returns to S4.

  In S <b> 6, the CPU 41 newly displays a guidance start button for starting guidance on the guidance route using the captured image 10 on the liquid crystal display 15. Here, FIG. 5 is a diagram showing a travel guidance screen 50 displayed on the liquid crystal display 15 in a state in which a guidance route is set in the navigation device 5. The travel guidance screen 50 displays a map image 51 around the current position of the vehicle, a guide route 52, a destination 53 (only when the destination is included in the map image), and the current position of the vehicle matched on the map. A displayed vehicle position mark 54 and various buttons 55 to 59 for selecting the navigation device 5 to execute a predetermined function are displayed. Then, by referring to the travel guidance screen 50, the user can grasp the facility information and road shape around the current vehicle, the currently set guidance route, and the like.

  On the travel guidance screen 50, a guidance start button 60 is newly displayed when the guidance start condition and the feasible condition are satisfied (S4). Note that a guidance start button 60 may be displayed in advance on the travel guidance screen 50, and the operation of the guidance start button 60 may be validated in S4. When the guidance start button 60 is operated by the user 4, display of a captured image along the guidance route is started instead of the travel guidance screen 50 on the liquid crystal display 15 as will be described later.

  Next, in S7, the CPU 41 determines whether or not the guidance start button displayed in S6 has been operated by the user. And when it determines with the guidance start button having been operated by the user (S7: YES), it transfers to S8. On the other hand, when it is determined that the guidance start button is not operated by the user (S7: NO), the process returns to S5.

  In S <b> 8, the CPU 41 starts displaying the captured image around the guidance route acquired from the information server 3 in S <b> 2 on the liquid crystal display 15. Specifically, first, the CPU 41 defines a virtual position 61 of the vehicle that moves along the guide route 52 toward the destination 53 as shown in FIG. The initial position of the virtual position 61 may be the current position of the vehicle, or may be a point a predetermined distance (for example, 300 m before) from the destination along the guide route. The moving speed of the virtual position 61 can be set as appropriate, but is set to 10 km / h, for example. Subsequently, the CPU 41 sequentially switches and displays the captured image in which the point at which the virtual position 61 of the vehicle has reached is associated as the captured position among the captured images acquired in S <b> 2 as the virtual position 61 of the vehicle moves. To do.

  As a result, the liquid crystal display 15 first displays a captured image captured at the initial position (for example, the current position of the vehicle) of the virtual position 61 of the vehicle, and then the virtual position 61 of the vehicle is displayed on the guide route 52 on the destination. As the image is moved to the 53 side, the displayed captured image is gradually switched to the captured image captured at the imaging position close to the destination 53. The captured image may be displayed on the entire screen of the liquid crystal display 15, or the liquid crystal display 15 may be configured to have a two-screen configuration and the driving guide screen 50 (FIG. 5) may be continuously displayed on one side. .

  The captured image acquired from the information server 3 in S2 is a 360-degree panoramic image captured at the imaging position (FIG. 2). When the captured image is displayed on the navigation device 5, all 360 degrees are displayed. Instead of displaying, only a certain range is displayed. It is desirable that the display target range correspond to the user's field of view when the user who actually gets on the vehicle moves along the guide route toward the destination. Here, since it is considered that the user who gets on the vehicle basically visually recognizes the traveling direction of the vehicle, the traveling direction of the virtual position 61 in the guide route 52 (direction along the guide route) as shown in FIG. ) Is the display target. However, in this embodiment, when the virtual position 61 approaches the destination in order to more easily identify the location of the destination in correspondence with the surrounding environment (roads, surrounding facilities, etc.) that the user will visually recognize. In FIG. 8, as the vehicle approaches the destination, the range to be displayed is gradually changed from the traveling direction of the vehicle to the destination side as shown in FIG.

  In the following description, a range to be displayed on the liquid crystal display 15 of the navigation device 5 among the captured images that are 360-degree panoramic images acquired from the information server 3 is defined using the “imaging direction X”. Specifically, the “imaging direction X” is an optical axis direction for capturing an image in a range to be displayed from the virtual position 61 in the 360-degree panoramic image 10 as shown in FIGS. Define. In other words, among the picked-up images 10 of the 360-degree panoramic image, an image within a predetermined angle α centered on the “imaging direction X” is displayed (α is set as appropriate depending on the size of the display to be displayed).

  In the present embodiment, as described above, the “imaging direction X” is set as the traveling direction of the virtual position 61 in the guide route 52 (direction along the guide route) during normal operation. On the other hand, when the virtual position 61 approaches the destination, the “imaging direction X” is gradually changed from the traveling direction of the virtual position 61 to the destination side as the virtual position 61 approaches the destination. Here, for example, the following conditions (a) to (c) are set as timing for starting the change of the “imaging direction X” to the destination side. In particular, in this embodiment, when both the conditions (a) and (b) are satisfied, or when both the conditions (a) and (c) are satisfied, the “imaging direction X” is changed to the destination side. Although it is set as the timing to start, it is good also as timing which satisfy | filled all the conditions of (a)-(c). Moreover, it is good also as the timing which satisfy | filled any conditions of (a)-(c). However, if only the condition (a) is satisfied without satisfying the condition (b) or (c), the distance from the virtual position to the destination is within a predetermined distance (for example, within 150 m). It is desirable to add. Further, the “image pickup direction X” may be changed to the destination side simultaneously with the start of display of the picked-up image in S8.

  (A) As shown in FIG. 9, the CPU 41 performs a process in which the virtual position 61 of the vehicle moves to the destination 53 side along the guide route 52 based on the shape of the guide route 52 and the coordinates of the destination 53 in advance. The direction P from the virtual position 61 of the vehicle to the destination 53 (more specifically, the direction of a straight line connecting the coordinates of the destination 53 with the coordinates of the virtual position 61) and the traveling direction Y of the virtual position 61 of the vehicle The angle θ formed by is calculated. The first condition is that the angle θ is equal to or greater than a predetermined angle (for example, 5 degrees).

  (B) The CPU 41 advances the virtual position 61 when the virtual position 61 of the vehicle moves to the destination 53 side along the guide path 52 based on the shape of the guide path 52 and the coordinates of the destination 53 in advance. Among the points where the direction in which the destination 53 exists with respect to the direction changes, the final change point that is the point closest to the destination 53 is specified. For example, in the example shown in FIG. 10, the destination 53 is on the right side with respect to the traveling direction of the virtual position 61 before passing through the point Q, and after passing through the point Q, the virtual is continued until the destination 53 is reached. A destination 53 is on the left side with respect to the traveling direction of the position 61. Therefore, the point Q becomes the final change point. The second condition is that the virtual position 61 has passed the final change point in the process of moving the virtual position 61 of the vehicle along the guide route 52 toward the destination 53. Therefore, in this embodiment, in the process of moving the virtual position 61 of the vehicle along the guide route 52 toward the destination 53, the virtual position 61 has passed the final change point and the angle θ is a predetermined angle. After that, the “imaging direction X” is changed to the destination side.

  (C) Based on the shape of the guide route 52 and the coordinates of the destination 53, the CPU 41 preliminarily moves from the virtual position 61 to the destination in the process of moving the virtual position 61 of the vehicle along the guide route 52 toward the destination 53. Changes in the angle θ formed by the direction P toward the ground 53 (more specifically, the direction of a straight line connecting the coordinates of the destination 53 with the coordinates of the virtual position 61) and the traveling direction Y of the virtual position 61 of the vehicle. Is calculated. Then, the final switching point that is the closest point to the destination 53 among the points where the angle θ switches from decreasing to increasing is specified. FIG. 11 is a diagram showing how the angle θ changes when the calculated virtual position 61 is moved from the starting point to the destination. For example, in the example shown in FIG. 11, the point closest to the destination 53 is the point R among the points where the angle θ switches from decrease to increase. Therefore, the point R becomes the final switching point. The third condition is that the virtual position 61 has passed the final switching point in the process of moving the virtual position 61 of the vehicle along the guide route 52 toward the destination 53 side. Therefore, in the present embodiment, in the process of moving the virtual position 61 of the vehicle along the guide route 52 toward the destination 53, the virtual position 61 is after the final switching point and the angle θ is a predetermined angle. After that, the “imaging direction X” is changed to the destination side.

  Therefore, in S8, the CPU 41 sets the “imaging direction X” of the virtual position 61 in the guide route 52 until the conditions (a) and (b) or (a) and (c) are satisfied as shown in FIG. Let it be the traveling direction (direction along the guide route). On the other hand, after satisfying the above conditions (a) and (b) or (a) and (c), the “imaging direction X” advances in the virtual position 61 as the virtual position 61 approaches the destination. Change from direction to destination. In particular, in this embodiment, after satisfying the above conditions (a) and (b) or (a) and (c), the direction from the virtual position 61 of each point to the destination 53 (more specifically, (The direction of a straight line connecting the coordinates of the destination 53 with the coordinates of the virtual position 61) is taken as the imaging direction.

  As a result, as shown in FIG. 13, the liquid crystal display 15 displays a captured image 65 in which the straight direction of the road is the imaging direction X immediately after the start of display. Thereafter, after satisfying the above conditions (a) and (b) or (a) and (c), the imaging direction X is gradually changed from the traveling direction of the virtual position 61 to the destination side. Further, in the present embodiment, since the imaging direction X is particularly the direction from the virtual position 61 to the destination 53 as described above, the destination 53 included in the displayed captured image 65 is positioned near the center of the image. Will be. Therefore, the user can easily specify the position of the destination 53 in correspondence with the surrounding environment (roads, surrounding facilities, etc.) from the captured image 65 displayed. It is also possible to grasp the appearance, landmarks, and the like of the destination 53.

  In S8, the CPU 41 may sequentially switch and display the captured images captured at all the imaging positions reached by the virtual position 61 along the guide route, or may select a part of the imaging positions (for example, every other imaging position). Or every other two images may be sequentially switched and displayed. However. When the imaging direction of the captured image displayed on the liquid crystal display 15 is changed in stages, the change amount of the imaging direction per stage is within a predetermined amount (for example, within 5 degrees) in order to ensure continuity with the previous frame. ) Is desirable. As a result, as shown in FIG. 14, the change amount D of the vanishing point S of the captured image 65 that is continuously switched can be small (for example, several percent or less within the angle of view), and a series of captured images 65 that are continuously switched. Can be made continuous.

  Thereafter, in S9, the CPU 41 determines whether or not the display on the liquid crystal display 15 of the captured image around the guide route started in S8 is completed. The process may be terminated when the virtual position of the vehicle reaches the destination, or after the virtual position of the vehicle reaches the destination, the virtual position is returned to the initial position again, and the virtual position is returned to the destination multiple times. You may display a captured image repeatedly until it arrives.

  Then, when it is determined that the display of the captured image around the guidance route started in S8 on the liquid crystal display 15 is completed (S9: YES), the process proceeds to S10. On the other hand, when it is determined that the display of the captured image around the guidance route started in S8 on the liquid crystal display 15 is not completed (S9: NO), the captured image is continuously displayed.

  In S10, the CPU 41 determines whether or not the vehicle has arrived at the destination. The determination of the arrival of the vehicle at the destination may be performed based on the current position of the vehicle detected by the current position detection unit 11 and the position coordinates of the destination, or may be based on the position of the shift lever or the operation state of the side brake. You may determine based on.

  And when it determines with the vehicle having arrived at the destination (S10: YES), the said route guidance process program is complete | finished. On the other hand, when it is determined that the vehicle has not arrived at the destination (S10: NO), the process returns to S4.

  As described above in detail, in the route guidance system 1 according to the present embodiment, the route guidance method by the route guidance system 1 and the computer program executed by the route guidance system 1, the guidance route 52 set by the navigation device 5 is used. A vehicle that acquires (S1) and acquires a captured image obtained by capturing the surrounding environment along the guide route 52 in association with an image pickup position where the captured image is captured (S2), and moves along the guide route 52 toward the destination. The virtual position 61 is defined, and the captured image in which the point at which the virtual position 61 has reached is associated as the imaging position is sequentially switched and displayed as the virtual position 61 moves (S8). As the camera approaches the destination, the imaging direction of the captured image to be displayed is changed stepwise from the traveling direction of the virtual position 61 to the destination side. Runode, it is possible to easily specify the position of the destination in association with the surrounding environment from the captured image by the user is displayed. It is also possible to grasp the appearance and landmarks of the destination. As a result, after the user reaches the vicinity of the destination, it is possible to reliably reach the destination without misidentifying the destination from the surrounding environment visually recognized by the user, the appearance of the facility, the landmark, and the like. In particular, in the navigation device 5 that performs vehicle movement guidance, there is a problem that the movement guidance ends when the vehicle reaches the vicinity of the destination, but this problem can also be solved. Furthermore, the user can specify the position and appearance of the destination without having to look at the captured images displayed by switching sequentially.

Note that the present invention is not limited to the above-described embodiment, and various improvements and modifications can be made without departing from the scope of the present invention.
For example, in the present embodiment, the captured image to be displayed by the navigation device 5 is acquired from the DB of the information server 3, but the captured image may be stored in the DB of the navigation device 5 in advance. In that case, it is also possible to configure the route guidance system 1 with the navigation device 5 alone.

  In the present embodiment, the conditions (A) to (D) are set as the guidance start conditions for starting the guidance of the guidance route using the captured image, but other than (A) to (D) These conditions may be set. For example, it may be a condition that the vehicle has passed a branch point that is a final right / left turn target before the destination of the guide route.

  In the present embodiment, the above conditions (a) to (c) are set as the timing to start changing the imaging direction to the destination side. However, conditions other than (a) to (c) are set. May be. For example, it may be a condition that the virtual position 61 of the vehicle is within a predetermined distance (for example, 300 m) to the destination.

  In the present embodiment, the CPU 41 of the navigation device 5 is configured to execute each step of the route guidance processing program (FIG. 4), but the CPU of the information server 3 and other external servers perform part or all of the processing. It is good also as a structure to perform.

  Further, in the present invention, various information terminals having a function of performing route guidance can be applied instead of the navigation device 5 constituting the route guidance system 1. For example, the present invention can be applied to a mobile phone, a smartphone, a tablet terminal, a personal computer, and the like. Moreover, when using another information terminal instead of the navigation apparatus 5, you may comprise so that a virtual position may define the virtual position of moving bodies other than a vehicle (for example, a pedestrian, a bicycle, etc.).

  Moreover, although the embodiment which actualized the route guidance system according to the present invention has been described above, the route guidance system can also have the following configuration, and in that case, the following effects can be obtained.

For example, the first configuration is as follows.
A guide route setting means (41) for setting a guide route (52) to the destination, and a captured image (10) obtained by imaging the surrounding environment along the guide route as an imaging position (9) for capturing the captured image. The image data acquisition means (41) to be acquired in association with each other and the virtual position (61) of the moving body moving toward the destination along the guide route are defined, and the point where the virtual position of the moving body has reached is Captured image display means (41) for sequentially switching and displaying the captured image associated as the imaging position with the movement of the virtual position of the moving body, and the captured image display means As the virtual position of the body approaches the destination, the imaging direction of the captured image to be displayed is gradually changed from the traveling direction of the virtual position of the moving body to the destination side.
According to the route guidance system having the above configuration, the user can easily specify the position of the destination in correspondence with the surrounding environment from the captured image displayed. It is also possible to grasp the appearance and landmarks of the destination. As a result, after the user reaches the vicinity of the destination, it is possible to reliably reach the destination without misidentifying the destination from the surrounding environment visually recognized by the user, the appearance of the facility, the landmark, and the like. In particular, in a navigation device that performs movement guidance of a moving body, there is a problem that the movement guidance ends when the moving body reaches the periphery of the destination, but this problem can also be solved. Furthermore, the user can specify the position and appearance of the destination without having to look at the captured images displayed by switching sequentially.

The second configuration is as follows.
The captured image display means (41) sets the direction from the virtual position (61) of the moving body to the destination as the imaging direction of the displayed captured image (10).
According to the route guidance system having the above configuration, since the destination included in the displayed captured image is located near the center of the image, the user can determine the surrounding environment (roads and surrounding facilities) from the displayed captured image. Etc.), the location of the destination can be easily specified. It is also possible to grasp the appearance and landmarks of the destination.

The third configuration is as follows.
When the virtual position (61) of the moving body moves to the destination along the guide route (52), the direction in which the destination exists changes with respect to the traveling direction of the virtual position of the moving body. Among the points, there is a final change point specifying means (41) for specifying a final change point that is the point closest to the destination, and the captured image display means (41) is configured such that the virtual position of the moving body is the guide route In the process of moving along the path, after the virtual position of the moving body passes the final change point, the imaging direction of the captured image (10) to be displayed is changed from the traveling direction of the virtual position of the moving body to the destination side. Change in stages.
According to the route guidance system having the above-described configuration, it is possible to suppress the imaging direction of the captured image to be displayed from significantly changing from side to side with respect to the traveling direction of the virtual position of the moving body. Therefore, the user can more easily specify the position of the destination from the captured image displayed.

The fourth configuration is as follows.
When the virtual position (61) of the moving body moves to the destination along the guide route (52), the direction from the virtual position of the moving body to the destination and the progress of the virtual position of the moving body Among the points where the angle formed by the direction is switched from decrease to increase, there is final switch point specifying means (41) for specifying the final switch point that is the closest point to the destination, and the captured image display means (41) In the process of moving the virtual position of the moving body along the guide route, the imaging direction of the captured image to be displayed is changed after the virtual position of the moving body passes the final switching point. Change from the direction of travel to the destination side step by step.
According to the route guidance system having the above-described configuration, it is possible to suppress the imaging direction of the captured image to be displayed from changing in various directions. Therefore, the user can more easily specify the position of the destination from the captured image displayed.

The fifth configuration is as follows.
The captured image display means (41) moves the virtual position (61) of the moving body from the virtual position of the moving body to the destination and the movement in the process of moving along the guide route (52). After the angle formed by the traveling direction of the virtual position of the body becomes a predetermined angle or more, the imaging direction of the captured image to be displayed is changed stepwise from the traveling direction of the virtual position of the moving body to the destination side.
According to the route guidance system having the above-described configuration, when the direction of the destination with respect to the virtual position of the moving body deviates from the traveling direction of the virtual position, the change of the imaging direction is started. In a situation where it is difficult to specify the destination position in the state of being fixed in the traveling direction, it is possible to easily specify the destination position.

The sixth configuration is as follows.
When the captured image display means (41) changes the imaging direction of the captured image to be displayed stepwise from the traveling direction of the virtual position (61) of the moving body to the destination side, the amount of change per step Is within a predetermined amount.
According to the route guidance system having the above-described configuration, it is possible to reduce the amount of change in vanishing points of continuously switched captured images, and it is possible to provide continuity to a series of captured images that are continuously switched.

The seventh configuration is as follows.
The moving guide means (41) for guiding the moving body along the guide route (52) is provided, and the captured image display means (41) Display of the captured image is started.
According to the route guidance system having the above configuration, even after the movement guidance of the moving body is completed, the user can surely reach the destination without misidentifying the destination.

The eighth configuration is as follows.
The captured image display means includes a movement guide means (41) for guiding the movement of the moving body along the guide route (52) and a position acquisition means (41) for acquiring the position of the moving body. (41) starts displaying the captured image after the moving body moving along the guide route has passed the final branch point in front of the destination.
According to the route guidance system having the above configuration, since the display of the captured image is started at the timing when the destination can be visually recognized by the user, the displayed captured image and the user's field of view are associated with each other to accurately determine the destination. It becomes possible to specify.

The ninth configuration is as follows.
Movement guide means (41) for guiding the movement of the mobile body along the guide route (52), and map image display means (41) for displaying a map image (51) around the mobile body at a predetermined scale. The captured image display means (41) starts displaying the captured image after the destination is included in the map image displayed by the map image display means.
According to the route guidance system having the above configuration, since the display of the captured image is started at a timing when the user can specify the destination on the map image, the destination is obtained by combining the displayed captured image and the map image. Can be specified accurately.

DESCRIPTION OF SYMBOLS 1 Route guidance system 2 Information management center 3 Information server 4 User 5 Navigation apparatus 8 Captured image DB
9 Imaging position 10 Captured image 41 CPU
42 RAM
43 ROM
50 Travel Guide Screen 52 Guide Route 53 Destination 61 Virtual Position of Vehicle

Claims (11)

Guide route setting means for setting a guide route to the destination;
Image data acquisition means for acquiring a captured image obtained by imaging the surrounding environment along the guide route in association with an imaging position where the captured image is captured;
The virtual position of the moving body that moves toward the destination on the guide route is defined, and the captured image in which the point at which the virtual position of the moving body has reached is associated as the imaging position is defined as the virtual position of the moving body. Captured image display means for sequentially switching and displaying as the position moves,
The captured image display means gradually changes the imaging direction of the captured image to be displayed from the traveling direction of the virtual position of the moving body to the destination side as the virtual position of the moving body approaches the destination. Route guidance system.   The route guidance system according to claim 1, wherein the captured image display means sets a direction from the virtual position of the moving body to the destination as an imaging direction of the captured image to be displayed. When the virtual position of the moving body moves to the destination along the guide route, the destination is the most among the points where the direction in which the destination exists changes with respect to the traveling direction of the virtual position of the moving body. Having a final change point identifying means for identifying a final change point that is a point close to the ground,
The captured image display means includes:
In the process of moving the virtual position of the moving body along the guide route,
2. The imaging direction of the captured image to be displayed is gradually changed from a traveling direction of the virtual position of the moving body to a destination side after the virtual position of the moving body passes the final change point. 2. The route guidance system according to 2. When the virtual position of the moving body moves to the destination along the guide route, an angle formed by the direction from the virtual position of the moving body to the destination and the traveling direction of the virtual position of the moving body is Among the points to switch from decrease to increase, it has a final switching point identification means to identify the final switching point that is the closest point to the destination,
The captured image display means includes:
In the process of moving the virtual position of the moving body along the guide route,
2. The method according to claim 1, wherein after the virtual position of the moving body passes the final switching point, the imaging direction of the captured image to be displayed is changed stepwise from the traveling direction of the virtual position of the moving body to the destination side. 2. The route guidance system according to 2. The captured image display means includes:
In the process of moving the virtual position of the moving body along the guide route,
After the angle formed by the direction from the virtual position of the moving body to the destination and the traveling direction of the virtual position of the moving body is equal to or larger than a predetermined angle, the imaging direction of the captured image to be displayed is set to the virtual position of the moving body. The route guidance system according to any one of claims 1 to 4, wherein the route is changed stepwise from a traveling direction of the position to the destination side. The captured image display means includes:
6. The amount of change per step is set within a predetermined amount when the imaging direction of the captured image to be displayed is changed stepwise from the traveling direction of the virtual position of the moving body to the destination side. The route guidance system in any one of. Movement guide means for performing movement guidance of the moving body along the guide route;
The route guidance system according to any one of claims 1 to 6, wherein the captured image display means starts displaying the captured image after movement guidance by the movement guidance means is completed. Movement guide means for performing movement guidance of the moving body along the guide route;
Position acquisition means for acquiring the position of the moving body,
The imaged image display means starts displaying the imaged image after the moving body moving along the guide route passes a final branch point in front of the destination. The route guidance system in any one. Movement guide means for performing movement guidance of the moving body along the guide route;
Map image display means for displaying a map image around the moving body at a predetermined scale,
The route according to any one of claims 1 to 6, wherein the captured image display means starts displaying the captured image after the destination is included in a map image displayed by the map image display means. Guidance system. A guide route setting means for setting a guide route to the destination;
An image data acquisition means for acquiring a captured image obtained by imaging the surrounding environment along the guide route in association with an imaging position where the captured image is captured;
The captured image display means defines the virtual position of the moving body that moves toward the destination along the guide route, and the captured image in which the point at which the virtual position of the moving body has reached is associated as the imaging position is displayed. And sequentially switching and displaying as the virtual position of the moving body moves,
The captured image display means gradually changes the imaging direction of the captured image to be displayed from the traveling direction of the virtual position of the moving body to the destination side as the virtual position of the moving body approaches the destination. Route guidance method. Computer
Guide route setting means for setting a guide route to the destination;
Image data acquisition means for acquiring a captured image obtained by imaging the surrounding environment along the guide route in association with an imaging position where the captured image is captured;
The virtual position of the moving body that moves toward the destination on the guide route is defined, and the captured image in which the point at which the virtual position of the moving body has reached is associated as the imaging position is defined as the virtual position of the moving body. A computer program for functioning as a captured image display means for sequentially switching and displaying as the position moves,
The captured image display means gradually changes the imaging direction of the captured image to be displayed from the traveling direction of the virtual position of the moving body to the destination side as the virtual position of the moving body approaches the destination. Computer program.

Images