JP2013032949A - Display processing system for vehicle, display processing method for vehicle, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily indicate a landscape image which a user wants to display on a display part.SOLUTION: A display processing system for vehicles displays a command display image 71 on a display. The command display image includes: a time bar 72 that acquires landscape images continuously photographed by an on-vehicle camera, stores each of the landscape images associated with a photographing time in image data DB, and corresponds to the photographing time from a start to an end of photographing the landscape images; a slider 73 that represents a position on the time bar 72 such that a user can indicate it; and landmark icons 74a-74d that represent landmarks being present along a travel route when photographing the landscape image, at corresponding positions on the time bar 72. Further, the display processing system causes the display to display a landscape image that corresponds to the position of the slider 73 on the time bar 72 out of the landscape images and is associated with the photographing time. This configuration can indicate the landscape image represented in such a manner as obtaining a time-series position of the landmarks on the travel route.

Description

  The present invention relates to a vehicle display processing system, a vehicle display processing method, and a program, and more particularly to a vehicle display processing system, a vehicle display processing method, and a program for displaying an image on a display unit.

  Conventionally, as this type of vehicle display processing system, when recording a constantly recorded image in front of the vehicle together with necessary information on a memory card of a drive recorder, when displaying the recorded constantly recorded image on the display unit of the playback device, There has been proposed a technique in which a time graph in which an event such as a sudden change in vehicle acceleration is marked is created, and an image is reproduced from a few seconds before the occurrence time of the corresponding event when the mark is selected (for example, Patent Document 1). reference). In this system, it is possible to easily reach an image to be viewed in a recorded image at all times.

JP 2010-130577 A

  However, depending on an event such as a sudden change in vehicle acceleration as described above, a user such as a driver cannot remember the scenery in front of the vehicle that he / she was viewing while driving, and the recorded scenery image is reproduced. In some cases, it was not possible to easily reach the image to be viewed. For example, in a navigation system, when referring to a landscape image taken in the past when registering a point on a map, it is not possible to easily reach the image you want to see from an event such as a sudden change in vehicle acceleration, and register the point. In some cases, it took time.

  A vehicle display processing system, a vehicle display processing method, and a program according to the present invention are mainly intended to make it possible to more easily designate a landscape image to be displayed on a display unit.

  The vehicle display processing system, the vehicle display processing method, and the program according to the present invention employ the following means in order to achieve the above-described main object.

The vehicle display processing system of the present invention includes:
A vehicle display processing system for displaying an image on a display unit,
Landscape image acquisition means for acquiring landscape images continuously captured by an in-vehicle camera that captures a landscape in front of the vehicle;
Landscape image storage processing means for storing each of the continuously photographed landscape images in a storage unit in association with the photographing time;
A user can specify a time-series line item that indicates a shooting time from the start to the end of shooting of the continuously photographed landscape images as a line in time series, and a position on the time-series line item. A time-series item including a time-position item to be displayed, and a landmark item indicating a landmark existing along a travel route when the continuous landscape image is captured at a corresponding position on the time-series line item. The instruction display is displayed in a predetermined instruction display area in the display area of the display unit, and the photographing time corresponding to the position of the time position item on the time-series line item in the continuous landscape image is displayed. Display processing means for displaying a landscape image associated with a predetermined landscape image display area in the display area of the display unit;
It is a summary to provide.

  In this vehicle display processing system of the present invention, landscape images continuously captured by an in-vehicle camera that captures a landscape in front of the vehicle are acquired, and each of the continuously captured landscape images is stored in association with the shooting time. Store in the department. The user can specify the time series line item that shows the shooting time from the start to the end of the shooting of landscape images taken continuously as a line in time series, and the position on the time series line item. A time-series instruction display including a time-position item to be displayed and a landmark item indicating a landmark existing along the travel route when a continuous landscape image is taken at a corresponding position on the time-series line item. Is displayed in a predetermined instruction display area in the display area of the display unit. Furthermore, the landscape image associated with the shooting time corresponding to the position of the time position item on the time-series line item among the continuous landscape images is displayed in a predetermined landscape image display area in the display area of the display unit. Let Therefore, in the instruction display area of the display unit, the landmark item indicating the landmark existing along the travel route when the landscape image is taken is displayed in the corresponding position on the time-series line item. The person can specify the position of the time position item on the time-series line item (for example, a change instruction or a selection instruction). As a result, the user can obtain a landscape image to be displayed in the landscape image display area among the continuously captured landscape images (that is, as a moving image) in a state where the time-series position of the landmark on the travel route is grasped. Can be directed. As a result, considering that the landmark is likely to remain in memory when viewed by a user such as a driver while traveling, a landscape image to be displayed on the display unit can be more easily indicated. Here, the “landmark” is a point or an object that can be a landmark, and includes facilities, buildings, scenic spots, and the like. The “shooting time” may be represented by a combination of a date representing the date of the year, month, or day and a time representing an hour, minute, second or hour, minute, or a time representing an hour, minute, second or hour and minute. It may be represented.

  In such a vehicle display processing system of the present invention, the landscape image storage processing means sets each of the continuously photographed landscape images to a photographing position indicating the own vehicle position on the map at the time of photographing together with the photographing time. In addition to displaying the time-series instruction display in the instruction display area and displaying the landscape image in the landscape image display area, the display processing unit associates and stores the time-series instruction display in the time-series instruction display area. The shooting position associated with the landscape image together with the shooting time corresponding to the position of the time position item on the line item is displayed in a predetermined map display area in the display area of the display unit together with a map around the shooting position. It can also be displayed. By doing so, it is possible to display a map including the shooting position together with a landscape image to be displayed on the display unit. Here, the map around the shooting position can be a predetermined scale, and can include landmarks on the map according to the scale of the map. Also, the map around the shooting position can be displayed for location registration, for example. When a map around the shooting position is displayed for point registration, the user can register a point at any point on the map around the shooting position while viewing the landscape image from the shooting position.

  In the display processing system for a vehicle according to the aspect of the present invention in which the photographing position is displayed on the display unit together with the map around the photographing position, the display processing unit is any of the landmark items displayed on the instruction display area. When is selected, the position of the time position item on the time-series line item is changed so as to correspond to the position of the selected landmark item on the time-series line item. You can also. In this way, by selecting the landmark item, it is possible to display a landscape image at the shooting time corresponding to the landmark on the travel route and to display a map including the shooting position of the landscape image. . Here, for example, the map around the shooting position may be a predetermined scale, a map that includes landmarks on the map according to the scale of the map, or a map that is displayed for point registration. it can. When displaying a map around the shooting position for point registration, the user can register a point at any point on the map around the shooting position while viewing the landscape image at the shooting time corresponding to the selected landmark. it can. In this case, when the landmark is visually recognized by a user such as a driver while traveling, it is easy for the user to register a spot.

  In the vehicle display processing system of the present invention in which the position of the time position item is changed in accordance with the position of the selected landmark item, an arbitrary selected by the user on the map displayed on the display unit A point registration unit for performing point registration using the point as a registration point; and a route guidance unit for performing route guidance to the set destination when the destination is set, wherein the point registration unit includes the display When performing spot registration with selection of any of the landmark items displayed on the instruction display area of the means, the registration spot is associated with the landmark indicated by the selected landmark item. The route guidance means performs route guidance by setting the registered point associated with the landmark as a destination. Kiniwa, the landmark associated with the registration point performs route guidance using the at least one by the guide of the map display and the audio output may be a thing. In this way, it is possible to perform route guidance using the landmarks associated with the registered points as well as associating the landmarks with the registered points. Also, considering that landmarks are likely to be memorized when viewed by a user such as a driver while driving, the landmarks and registered points when the location registration is performed with the selection of landmark items. Can be considered highly related to each other in the user's memory. Therefore, route guidance can be performed more appropriately by performing route guidance using landmarks associated with registered points in this way. Here, when performing point registration with selection of one of the displayed landmark items, a map including the landmark corresponding to the landmark item selected by the selection of the landmark item is displayed on the map. When performing point registration within a range where a predetermined map display process (for example, a process that does not stop the point registration process, such as changing the scale of the map or scrolling the map) is performed from the state displayed in the area Etc. are included.

  In the display processing system for a vehicle according to the present invention that performs route guidance by associating the registered point with the landmark and performing route guidance, the distance from the landmark associated with the registered point to the registered point and the right at the intersection The vehicle includes a travel difficulty level determination unit that determines whether the travel difficulty level based on at least one of the number of left turns is less than a predetermined level, and the point registration unit has the travel difficulty level less than the predetermined level. Only when it is determined that the registration point is associated with the landmark, the point registration may be performed. In this case, the point registration means may perform point registration without associating the registration point with the landmark when it is determined that the degree of difficulty in traveling is equal to or greater than the predetermined level. In this way, it is possible to suppress the use of landmarks that are highly difficult to travel from the landmark to the registration point among the landmarks corresponding to the selected landmark item for route guidance. Here, as the “predetermined degree”, a predetermined value as a lower limit of a range where it is not effective to use the landmark for route guidance to the registration point can be used.

  The vehicle display processing system according to the present invention further includes landmark recognition means for recognizing the landmark by performing predetermined image recognition processing on the landscape image, and the display processing means includes the landmark recognition means. The landmark item indicating the landmark recognized by the means at a corresponding position on the time-series line item may be displayed in the instruction display area. In this way, a landmark item indicating a landmark that is highly likely to be actually viewed by a user such as a driver while the vehicle is traveling can be displayed on the time-series line item. In this case, the landmark recognition means may recognize a specific type of landmark selected in advance among a plurality of types of landmarks. In this way, it is possible to suppress the amount of calculation due to a predetermined image recognition process for recognizing the landmark. In addition, by selecting in advance landmarks that are particularly memorable when the user visually recognizes them as specific types of landmarks, the user can more easily specify a landscape image to be displayed on the display unit. it can.

  Furthermore, in the vehicle display processing system according to the present invention, the display processing means may select one of the selected landmark items when any one of the landmark items displayed on the instruction display area is selected. It is also possible to display in the instruction display area a predetermined time including a shooting time corresponding to a position on the time-series line item as a time range in which the time-series line item is displayed. In this way, if the time from the start of shooting to the end of shooting of continuously shot landscape images is relatively long, by selecting the landmark item, it corresponds to the position of the landmark item on the time-series line item It is possible to easily identify the photographing time to be performed. Here, as the “predetermined time”, it is possible to use a predetermined time that makes it easy to identify the shooting time on a time-series line item.

  Alternatively, in the vehicle display processing system of the present invention, the time-series instruction display includes a time bar corresponding to a time from the start of shooting of the continuous landscape image to the end of shooting and a slider that can slide on the time bar. Can be included as the time-series line item and the time position item, respectively.

  Further, in the vehicle display processing system of the present invention, the time-series instruction display includes a shooting route indicating a travel route of the vehicle on a map from the start of shooting of the continuous landscape image to the end of shooting, and on the shooting route. And a predetermined mark whose position can be changed with the time-series line item and the time position item, respectively, and a map with a maximum scale capable of displaying the entire photographing route in the instruction display area. You can also Here, as the “predetermined mark”, a mark indicating a vehicle or the like can be used.

The vehicle display processing method of the present invention includes:
A vehicle display processing method for displaying an image on a display unit,
(A) acquiring landscape images continuously captured by an in-vehicle camera that captures a landscape in front of the vehicle;
(B) storing each of the continuously photographed landscape images in a storage unit in association with the photographing time;
(C) A time-series line item indicating a time-series line from the start to the end of capturing of the continuously photographed landscape images, and a position on the time-series line item by the user. A time position item that can be indicated, and a landmark item that indicates a landmark that exists along a travel route when the continuous landscape image is taken at a corresponding position on the time-series line item. A time-series instruction display is displayed in a predetermined instruction display area in the display area of the display unit, and corresponds to the position of the time position item on the time-series line item in the continuous landscape image. Displaying a landscape image associated with a shooting time to be displayed in a predetermined landscape image display area of the display area of the display unit;
It is characterized by including.

  In the vehicle display processing method of the present invention, in the instruction display area of the display unit, the landmark item indicating the landmark existing along the travel route when the landscape image is taken corresponds to the corresponding position on the time-series line item. In this state, the user can specify the position of the time position item on the time series line item (for example, change instruction or selection instruction). As a result, the user can obtain a landscape image to be displayed in the landscape image display area among the continuously captured landscape images (that is, as a moving image) in a state where the time-series position of the landmark on the travel route is grasped. Can be directed. As a result, considering that the landmark is likely to remain in memory when viewed by a user such as a driver while traveling, a landscape image to be displayed on the display unit can be more easily indicated. Here, the “landmark” is a point or an object that can be a landmark, and includes facilities, buildings, scenic spots, and the like. The “shooting time” may be represented by a combination of a date representing the date of the year, month, or day and a time representing an hour, minute, second or hour, minute, or a time representing an hour, minute, second or hour and minute. It may be represented.

  The program of this invention is for making each step of the display processing method for vehicles mentioned above implement | achieve one or more computers. This program may be recorded on a computer-readable recording medium (for example, hard disk, ROM, FD, CD, DVD, etc.), or from a computer via a transmission medium (communication network such as the Internet or LAN). It may be distributed to another computer, or may be exchanged in any other form. If this program is executed by one computer or shared by a plurality of computers, each step of the above-described vehicle display processing method is realized, so that the same effect as the display processing method can be obtained. It is done.

1 is a configuration diagram showing an outline of a configuration of a navigation system 10 including a navigation device 20 as an embodiment of the present invention. 7 is a flowchart illustrating an example of a landscape image processing routine executed by a point registration processing unit 64 of the electronic control unit 30 in cooperation with an image processing unit 68. 4 is a flowchart showing an example of a spot registration processing routine executed by a spot registration processing unit 64 of the electronic control unit 30. 4 is a flowchart showing an example of a route guidance processing routine executed by a route guidance processing unit 66 of the electronic control unit 30. 4 is an explanatory diagram showing an example of a scene image stored in the HDD 40 together with its shooting information and an example of data stored in the HDD 40. FIG. It is explanatory drawing which shows an example of the imaging | photography route designation | designated screen 70. FIG. It is explanatory drawing which shows an example of the combination of the instruction | indication display area 23a, the landscape image display area 23b, and the map display area 23c among the display areas 23 of the display 22. FIG. It is explanatory drawing which shows an example of the combination of the instruction | indication display image 71, the landscape image 76, and the map image 78. FIG. It is explanatory drawing which shows an example of a mode that point registration is performed without selection of a landmark item. It is explanatory drawing which shows an example of the mode of a display when the landmark icon 74b on the time bar 72 is selected. It is explanatory drawing which shows an example of a mode when point registration is performed with selection of the landmark icon 74b. It is explanatory drawing which shows an example of a mode that route guidance is performed using the selected landmark corresponding to the landmark icon. It is explanatory drawing which shows an example of a mode that route guidance is performed without using the landmark which was not selected corresponding to the landmark icon 89. FIG. It is explanatory drawing explaining an example when a route guidance using the selection landmark linked | related with the registration point (destination) is prohibited. It is explanatory drawing explaining an example of a mode when the route guidance using the selection landmark linked | related with the registration point (destination) is permitted. It is explanatory drawing which shows a mode that the instruction | indication display image 171 of a modification is displayed. It is explanatory drawing which shows a mode that the instruction | indication display image 271 of a modification is displayed. It is explanatory drawing which shows a mode that the instruction | indication display image 371 of a modification is displayed. It is explanatory drawing which shows a mode that the landscape image 476 of a modification is displayed.

  Next, the form for implementing this invention is demonstrated using an Example.

  FIG. 1 is a configuration diagram showing an outline of a configuration of a navigation system 10 including a navigation device 20 as an embodiment of the present invention. The navigation system 10 according to the embodiment includes an in-vehicle device 12 centering on various sensors mounted on a vehicle (automobile) (not shown) and a navigation device 20 that operates by receiving power supply from an in-vehicle battery (not shown). As shown in the drawing, the navigation device 20 of the embodiment has a rectangular screen for displaying characters and images, for example, a display 22 configured as a liquid crystal display, an organic electroluminescence display, and the like, and is attached to the screen of the display 22. For example, a touch panel 24 using a resistance film method or a capacitance method, an electronic control unit 30 for controlling the entire apparatus, and a hard disk drive (hereinafter referred to as HDD) 40 as a large-capacity memory for storing various application software and map data. With.

  The electronic control unit 30 is configured as a microprocessor centered on the CPU 32. In addition to the CPU 32, the ROM 34 that stores various processing programs, the RAM 36 that temporarily stores data, and the nonvolatile that holds the stored data. Flash memory 38 and an input / output port (not shown). In addition to the signal from the touch panel 24 for detecting the touch position of the operator and the data read from the HDD 40, various signals from the in-vehicle device 12 are input to the electronic control unit 30 via the in-vehicle network via the input port. Yes. The signal from the in-vehicle device 12 includes a signal from a GPS receiver 50 that receives a signal from a GPS (Global Positioning System) satellite via a GPS antenna, and a pulse signal every time a vehicle drive shaft or wheel rotates a certain amount. A signal from a vehicle speed sensor 52 that outputs a signal, a signal from an azimuth sensor 54 composed of, for example, a gyro sensor that detects a traveling direction of the vehicle and its change, a moving image or a still image of a landscape image installed in front of the vehicle And a signal (captured image) from the camera 56 that can be photographed. From the electronic control unit 30, a display signal to the display 22, an audio signal to the speaker 26 with a built-in amplifier, data to be written to the HDD 40, and the like are output via an output port.

  In the navigation device 20 of the embodiment, the electronic control unit 30 reads out necessary application software and map data from the HDD 40 and executes various processes. For example, as shown in the functional block of FIG. 1 representing functions realized by hardware or software or a combination thereof, the electronic control unit 30 is based on a signal from the GPS receiver 50, a signal from the direction sensor 54, or the like. Location processing by the location processing unit 60 that identifies the vehicle position that is the current position of the vehicle, map display processing by the map display processing unit 62 that displays a map on the display 22 using map data, and registration of an arbitrary point on the map A point registration process by the point registration processing unit 64 that performs point registration as a point, a travel route from the departure point such as the own vehicle position to a destination such as the registered point, and the map display by the map display processing unit 62 or from the speaker 26 Route guidance processing by the route guidance processing unit 66 for performing route guidance by voice output of Such as the execution various image processing by the image processing unit 68 to be. The map data is stored in a map data database (hereinafter referred to as a map data DB) 42 of the HDD 40, and the map data DB 42 includes road information and facility information. The road information includes, for example, the position (latitude and longitude) on the map indicated by the nodes at both ends of each road, the distance of each road, the region (city area, suburb), the type (general road, highway), the gradient, and the number of traffic lights. Etc. are included. The facility information includes information about landmarks. Landmarks include facilities, buildings, scenic spots, and more specifically, landmarks including characteristic store marks (such as marks on store walls and signs) and building shapes. It is a point or object to get.

  The point registration process by the electronic control unit 30 is basically performed by the user as an operation of the touch panel 24 on a map of a predetermined scale or larger (detailed side) displayed on the display 22 so that the point can be registered. When touched, the position (latitude and longitude) of the touched point on the map is stored in a predetermined area of the flash memory 38 as a registered point. The registered points are stored together with names inputted as necessary by the user, information on icons (marks) that can be hidden on the map, and the like. In addition, in the point registration process of the embodiment, the scenery image in front of the vehicle is photographed continuously (as a moving image) by the camera 56 while the vehicle is running, and stored in the HDD 40 together with the photographing information, thereby storing the scenery image. A map around the shooting position of the landscape image is displayed on the display 22 so that the point can be registered while the moving image is reproduced. When the user touches any point on the map, the touched point is displayed in a predetermined area of the flash memory 38. It is also memorized as a registration point. Data relating to landscape images is stored in a landscape image data database (hereinafter referred to as image data DB) 44 of the HDD 40.

  Next, the operation of the navigation device 20 of the embodiment configured as described above, particularly when storing a landscape image taken with a moving image, when performing point registration while reproducing a landscape image taken with a moving image, and to the registered point The operation when performing route guidance will be described. FIG. 2 is a flowchart showing an example of a landscape image processing routine executed by the point registration processing unit 64 of the electronic control unit 30 in cooperation with the image processing unit 68. FIG. FIG. 4 is a flowchart showing an example of a route guidance processing routine executed by the route guidance processing unit 66 of the electronic control unit 30. The routine of FIG. 2 is repeatedly executed every predetermined time during the traveling of the vehicle from when the user gives an instruction to start taking a landscape image until the end of the shooting is instructed. The routine of FIG. The routine is executed when the start of the process is instructed, and the routine of FIG. 4 is executed when the destination is set by the user. The predetermined time that is the execution interval of the routine of FIG. 2 is a time corresponding to the reciprocal of the frame rate at the time of shooting and playback of a landscape image as a moving image shot by the camera 56 (for example, every several tens of milliseconds or several hundreds of milliseconds) ) Is used in advance. Hereinafter, description will be made in the order of landscape image processing, point registration processing, and route guidance processing.

  When the landscape image processing routine of FIG. 3 is executed, the CPU 32 of the electronic control unit 30 first takes one landscape image taken by the camera 56 when this routine is executed, and when this landscape image is taken. Necessary for landscape image processing such as the vehicle position (hereinafter referred to as shooting position) and date and time (hereinafter referred to as shooting time), information indicating a predetermined specific type of landmark (hereinafter referred to as specific type landmark information), etc. Data is input (step S100), and the input landscape image, shooting position, and shooting time are associated with each other and stored in the HDD 40 (step S110). Here, as the landscape image, one of images continuously captured as a moving image by the camera 56 is input from the camera 56. As the landscape image capturing position, the vehicle position specified by the location processing unit 60 when this routine is executed is input. As the landscape image capturing time, the current time, which is timed by a timer (not shown) and expressed in year / month / day / hour / minute / second (for example, 1 msec unit), is input. Further, the specific type landmark information is information indicating a specific type of landmark selected by the user among a plurality of types of landmarks that can be displayed on a map by executing a specific type landmark selection routine (not shown) in advance. The data stored in the flash memory 38 is input.

  FIG. 5 shows an example of how a landscape image is stored in the HDD 40 together with the shooting information, and an example of data stored in the HDD 40. As shown in the drawing, the landscape image photographed by the camera 56 is sequentially stored in the image data DB 44 of the HDD 40 together with photographing information such as a photographing position and photographing time. Further, in the map data DB 42 of the HDD 40, as the information regarding the landmark, for each landmark, the type of landmark, the position (latitude and longitude) on the map, the icon (mark) used for displaying the map, the scenery image, etc. Data consisting of combinations such as collation data used for predetermined image recognition processing for recognizing landmarks from the inside is stored. In the figure, the map data DB 42 exemplifies a total of four sets of information on landmarks of types “A store”, “B store”, “Company C”, and “D building”. Hereinafter, in the embodiment, four types of landmarks “A store”, “B store”, “Company C”, and “D building” are selected in advance by the user from among a plurality of types of landmarks that can be displayed on the map. The description will be made assuming that the landmark is a specific type of landmark. In the figure, the specific type landmark information as a part of the shooting information stored in the image data DB 44 may be stored as a part of the shooting information or may not be stored as a part of the shooting information. Details will be described later.

  When the data is input and stored in this way, a specific type of landmark is used within a predetermined recognizable distance from the shooting position (vehicle position) of the landscape image along the road of the vehicle using the map data in the map data DB 42. If there is no specific type of landmark within the recognizable distance from the shooting position using the map data (step S130), landscape image processing is performed as it is. End the routine. Here, in the embodiment, the recognizable distance is obtained by an experiment or the like in advance as an upper limit value of a distance range in which a driver can visually recognize the presence of a landmark in front of the vehicle (for example, several tens of times). Meters and hundreds of meters). Further, whether or not there is a landmark along the traveling road of the vehicle, whether or not the landmark is within a recognizable distance from the shooting position, and whether or not the landmark is of a specific type is determined by the map data DB 42. Road information (information on the position and distance of the road) and facility information (information on the type and position of the landmark) can be confirmed. Thus, when it is confirmed that there is no specific type of landmark within the recognizable distance from the shooting position, and when this routine is finished, one of the landscape images viewed from the vehicle during driving is displayed along with the shooting position and the shooting time on the image of the HDD 40. It is stored in the data DB 44. In this case, the specific type landmark information is not stored as part of the shooting information. In the embodiment, the storage capacity of the image data DB 44 in the HDD 40 is sufficiently large so that data can be stored by performing a plurality of runs from the start of shooting a landscape image to the end of shooting, When all of the storage capacity of the image data DB 44 is used, the landscape image corresponding to the oldest run in the time series and its shooting information are deleted from the image data DB 44.

  When it is confirmed using the map data that there is a specific type of landmark within the recognizable distance from the shooting position (step S130), the landscape image input and stored is determined in advance for landmark recognition. By performing the obtained image recognition processing (hereinafter referred to as landmark image recognition processing) (step S140), it is determined whether or not there is a specific type of landmark in the landscape image (step S150). The determination by the landmark image recognition process can be performed as follows, for example. First, an image of a region where a specific type of landmark may exist is extracted from the photographed landscape image, and feature points are extracted and binarized by performing edge detection processing on the extracted image. The created feature point image is created, and noise removal processing or the like is performed on the created feature point image to create determination data. Then, in the created determination data, it is checked whether or not there is a portion corresponding to collation data (see map data DB 42 in FIG. 5) obtained by extracting and binarizing a feature point of a specific type of landmark, When it is determined that there is a portion corresponding to the collation data in the determination data, it is determined that there is a specific type of landmark in the landscape image. Note that edge detection processing, noise removal processing, and the like as landmark image recognition processing are well-known techniques in image recognition processing, and thus will not be described in further detail.

  If the landmark image recognition process does not recognize (determine) that there is a specific type of landmark in the landscape image (steps S140 and S150), the landmark exists on the map but is not visible to the driver. Judgment is made, and the scenery image processing routine is finished as it is. On the other hand, when it is recognized (determined) that there is a specific type of landmark in the landscape image by the landmark image recognition processing (steps S140 and S150), it is determined that the landmark existing on the map is visible to the driver. Then, the specific type landmark information is associated with the shooting time of the landscape image and stored together with the landscape image as a part of the shooting information (step S160), and the landscape image processing routine is ended. Thus, when the landmark image recognition process recognizes that there is a specific type of landmark in the landscape image and terminates this routine, one of the landscape images viewed from the vehicle while traveling is the shooting position and shooting time. It is stored in the image data DB 44 of the HDD 40 together with the specific type landmark information. In this landscape image processing, only when it is confirmed using map data that there is a specific type of landmark within the recognizable distance from the shooting position, the landscape image is identified by performing the landmark image recognition processing. Since the presence / absence of the type of landmark is determined, the amount of calculation by the image recognition processing for recognizing the landmark for the landscape image can be suppressed. The scenery image processing routine of FIG. 2 is executed by the point registration processing unit 64 of the electronic control unit 30 except that the predetermined image recognition processing in step S140 is executed by the image processing unit 68. The landscape image processing has been described above. Next, the point registration process will be described.

  When the point registration processing routine of FIG. 4 is executed, the CPU 32 of the electronic control unit 30 firstly travels from the start of shooting to the end of shooting when shooting a landscape image with the camera 56 (hereinafter also referred to as shooting route). Is not specified (step S200), and if the shooting route is not specified, normal processing is performed as point registration processing (step S210), and the point registration processing routine is terminated. Here, as described above, the normal process is performed when the user touches an arbitrary point as an operation of the touch panel 24 on a map of a predetermined scale or larger (detailed side) displayed so as to be able to register the display 22 points. The location (latitude and longitude) of the touched point on the map is stored in a predetermined area of the flash memory 38 as a registered point. In addition, in the embodiment, the determination as to whether or not the shooting route is designated is performed by specifying one or more (two in the example of FIG. 6) shooting route designation on the shooting route designation screen 70 illustrated in FIG. This routine is performed by determining whether one of the buttons 70a and 70b is touched and selected to execute this routine. In FIG. 6, the shooting route designation button 70a corresponds to a travel route when traveling from 13:05 on August 1, 2011 to 15:36 on the same day as the shooting start time and shooting end time of the landscape image. The shooting route designation button 70b corresponds to a travel route when traveling before a travel route corresponding to the shooting route designation button 70a. Information necessary for displaying the shooting route designation buttons 70a and 70b can be created using information in the image data DB 44 and the like.

  When the shooting route is specified, an instruction for instructing the shooting time of the landscape image to be displayed on the display 22 (hereinafter referred to as a display target shooting time) among the shooting times of the landscape image in the specified shooting route. A display image, a landscape image corresponding to the display target shooting time, and a map image corresponding to the display target shooting time, in the initial state, each of a predetermined instruction display area and a landscape in the display area of the display 22 are displayed. The initial display to be displayed in the image display area and the map image display area is performed (step S220), and the update of the instruction display image is started (specifically, the movement of the slider on the time bar described later is started) (step S230). At this time, in the embodiment, the update of the display target photographing time automatically starts from the photographing start time in the photographing route with the update of the instruction display image. Furthermore, the reproduction of the landscape image displayed on the display 22 and the update of the map image are started so as to correspond to the display target photographing time (step S240). FIG. 7 shows an example of a combination of an instruction display area 23a, a landscape image display area 23b, and a map display area 23c in the display area 23 of the display 22, and FIG. 8 shows an instruction display image 71, a landscape image 76, and a map image. An example of a combination with 78 is shown. The initial display of each image in step S220 is performed by displaying an image corresponding to the initial value of the display target shooting time (shooting start time), and reproduction and update of each image in steps S230 and S240 is designated. This is done by displaying a display corresponding to the display target shooting time that is updated (changed) in the range from the shooting start time to the shooting end time in the shooting path. Next, each image and display target shooting time will be described in detail.

  As shown in FIG. 7, in the embodiment, the instruction display area 23a extends along the lower end of the rectangular display area 23, and the right half of the display area 23 including the back surface of the instruction display area 23a is displayed as a landscape image. It is assumed that the map display area 23c occupies the left half of the display area 23 including the back side of the instruction display area 23a. Further, as shown in FIG. 8, the instruction display image 71 is a photograph of a landscape image photographed as a moving image in a designated photographing route (in the example of FIG. 8, a route corresponding to the photographing route designation button 70a in FIG. 6). A time bar 72 corresponding to the shooting time from the start time (13: 5 in the example of FIG. 8) to the shooting end time (15:36 in the example of FIG. 8) and the time bar 72 by the user's drag operation. Slider 73 that slides on the time bar 72 from the left to the right as time elapses, and the landscape image processing of FIG. 2 among the landmarks that exist on the map data along the designated shooting route. The landmarks recognized by the landmark image recognition processing in the routine (specifically, the specific type landmarks stored as part of the shooting information in the image data DB 44). And a landmark icons 74a~74d showing a landmark) corresponding at corresponding positions on the time bar 72 to the information.

  In the embodiment, as shown in FIG. 8, the display target shooting time is a shooting time corresponding to the position of the slider 73 on the time bar 72 and is determined by the position of the slider 73 on the time bar 72. Here, the slider 73 indicates the position on the time bar 72 corresponding to the shooting time (display target shooting time) of the landscape image displayed in the landscape image display area 23b among the landscape images shot as a moving image. It can be said that the indication is possible. The landmark icons 74a to 74d on the time bar 72 are displayed as a part of the shooting information in the shooting time from the shooting start time to the shooting end time of the landscape image on the shooting path stored in the image data DB 44. A landscape image in which the specific type landmark information is stored is selected, and the shooting time and the specific type landmark information of the selected landscape image are read out, corresponding to the read shooting time in the time range displayed by the time bar 42. An icon indicating a landmark corresponding to the read specific type landmark information is read from the map data DB 42 and displayed at the position. In the embodiment, as a result of using the landscape image stored in the image data DB 44 and its shooting information, a plurality of the same landmark items are continuously displayed on the time bar 72, and the visibility of the landmark items is reduced. In order to prevent this, only the first landmark item is displayed on the time bar 72 in a range in which the same landmark item continues. Further, as the landscape image 76 illustrated in FIG. 8, the landscape at the shooting time (display target shooting time) corresponding to the position of the slider 73 on the time bar 72 among the landscape images shot as moving images in the designated shooting path. The image stored in the image data DB 44 is displayed. Further, as the map image 78 illustrated in FIG. 8, the shooting position stored in the image data DB 44 as part of the shooting information together with the shooting time (display target shooting time) corresponding to the position of the slider 73 on the time bar 72. Is indicated by a predetermined shooting position mark 79 (a mark such as any figure may be used as long as it is a predetermined mark, but in the example of FIG. 8, a mark indicating the vehicle position used for map display). At the same time, a map of a predetermined point registration scale that includes this shooting position, for example, at the center of the map or slightly below the center, displays a map of the traveling direction of the vehicle when shooting a landscape image using map data. It is displayed above the area 23c (with so-called heading up). The scale for point registration is determined in advance as a scale of a range in which points can be registered on the map image 78 (that is, buildings such as facilities and houses can be selected as registered points). In the following description, it is assumed that the instruction display image 71 including the time bar 72, the slider 73, and the landmark icons 74a to 74d illustrated in FIG. 8 is used.

  In this way, the slider 73 slides (moves) on the time bar 72 and at the same time, the landscape image reproduction (moving image reproduction) and the map image update (map scrolling and shooting position mark) according to the update of the display target shooting time corresponding to the position of the slider 73. 79 on the map), it is determined whether or not the point registration process is to be ended when the display target shooting time becomes the shooting end time on the shooting route (step S250), and the point registration process is ended. When it is determined that the touch panel 24 has not been operated, it is determined whether or not the touch panel 24 has been operated (step S260). When it is determined that the touch panel 24 has not been operated, the process returns to step S250. When it is determined in step S250 that the point registration process is to be ended because the display time is the photographing end time while the processes in steps S250 and S260 are repeated, the registered point is newly stored in the flash memory 38. Then, the point registration processing routine is terminated.

  When it is determined in step S260 that the touch panel 24 has been operated, it is determined whether or not the operation is a point registration request operation (step S270). It is determined whether or not any of the landmark icons 74a to 74d on 72 is selected (step S280). Here, the determination of whether or not the operation is a point registration request can be made by determining whether or not a building such as a facility or a house that can be registered on the map has been touched. Whether or not the landmark icon 74a to 74d has been selected can be determined by determining whether or not the landmark icon 74a to 74d in the instruction display image 71 has been touched.

  When the operation of the touch panel 24 is not a point registration request operation nor a selection of any of the landmark icons 74a to 74d, for example, a drag operation of the slider 73 on the time bar 72, a map scroll operation, or a map scale change In the case of operation, pause of moving image reproduction of landscape images, etc., processing corresponding to the operation is performed (step S290), and the process returns to step S250. For example, when the drag operation of the slider 73 on the time bar 72 is performed, the shooting time corresponding to the position of the slider 73 on the time bar 72 becomes the display target shooting time. A map image of a scale for point registration indicating a shooting position mark is displayed at a shooting position corresponding to the display target shooting time, and a moving image of the landscape image is reproduced according to the update of the display target shooting time as the slider 73 moves. And update the map image again.

  When it is determined in step S270 that the operation is a point registration request, a value 0 is set as an initial value, and a value 1 is set when one of the landmark icons 74a to 74d on the time bar 72 is selected in this routine. The selection flag F1 to be set is checked (step S300). When the selection flag F1 is 0, it is determined that the landmark icons 74a to 74d have not been selected, and the point where the point registration is requested is set as the registered point in the flash memory 38. The spot registration stored in the predetermined area is performed (step S310), and the spot registration processing routine is terminated. FIG. 9 shows an example of a state where point registration is performed without selecting a landmark item. In the drawing, the position of the slider 73 on the time bar 72 indicates a state when the position is moved to the position of the landmark icon 74b of “Store B” by the passage of time or the user's drag operation. At this time, the landscape image 80 includes a landmark 81 of “Store B” and a building 82 for which the user requests location registration. The map image 84 includes a shooting position mark 85, a landmark icon 86 of “Store B”, and a building image 87 showing the building 82. When the building image 87 is touched in the map image 84 of FIG. 9, the location registration is performed using the position of the building 82 on the map as the registration location.

  When it is determined in step S280 that any one of the landmark icons 74a to 74d has been selected, a value 1 is set in the selection flag F1 (step S320), and the position corresponds to the position of the selected landmark item on the time bar 72. Thus, the position of the slider 73 on the time bar 72 is changed (step S330). At this time, the shooting time corresponding to the position of the slider 73 on the time bar 72 becomes the display target shooting time. Subsequently, the time range displayed by the time bar 72 without changing the size of the time bar 72 in the instruction display area 23a is set in advance to include the display target shooting time, for example, at the center or slightly before the center. The selected display range time is changed (step S340), and the movement of the slider 73 is started on the time bar 72 in which the display time range is changed to start updating the display target shooting time and the display target shooting time is updated. Accordingly, the reproduction of the landscape image and the update of the map image are started (step S350), and the process returns to step S250. Here, the selected display range time is set so that a relatively fine time can be easily specified before and after the shooting time (display target shooting time) corresponding to the selected landmark item on the time bar 72, that is, the shooting time. Is predetermined (for example, 10 minutes, 30 minutes, 1 hour, etc.). FIG. 10 shows an example of a display state when the landmark icon 74b on the time bar 72 is selected. In FIG. 10, similarly to FIG. 9, a landscape image 80 and a map image 84 at the shooting time (display target shooting time) corresponding to the position of the landmark icon 74 b on the time bar 72 are displayed. However, in FIG. 10, unlike FIG. 9, the time range displayed by the time bar 72 is a selection display range time including the display target shooting time (in FIG. 10, 30 minutes including the display target shooting time as the center). On the time bar 72, only two of the four landmark icons 74b and 74c are displayed.

  When it is determined that the operation of the touch panel 24 is a point registration request operation in a state where the landmark item is selected and the selection flag F1 is set to 1 (step S270), the selection flag F1 is set to the value 1 (Step S300), the landmark indicated by the landmark item selected when the value 1 is set in the selection flag F1 (hereinafter referred to as the selected landmark) and the point where the point registration is requested ( Hereinafter, the cost C on the map with the request point is calculated (step S360). Here, the cost C between the selected landmark and the requested point indicates the degree of difficulty in traveling from the selected landmark to the requested point. In the embodiment, using the map data, The calculation is made such that the longer the distance from the selected landmark to the requested point, the larger, and the larger the number of right / left turns at the intersection from the selected landmark to the requested point, the greater the number. Note that the latter left / right turn number can be based on the number of right / left turns at the intersection in the travel route from the selected landmark searched for by the route guidance processing unit 66 to the requested point.

  Subsequently, the calculated cost C is compared with the threshold value Cref (step S370). When the cost C is equal to or greater than the threshold value Cref, the point registration is performed with the request point as the registration point (step S310), and the cost C is less than the threshold value Cref. In some cases, the point registration is performed using the request point as a registration point, and the registration point and information indicating the selected landmark are associated with each other and stored in a predetermined area of the flash memory 38 (step S380), and the point registration processing routine is terminated. Here, the threshold value Cref to be compared with the cost C is for determining whether or not it is effective to use the selected landmark for route guidance to the requested point, and the route to the requested point is used as the route to the requested point. As a lower limit value or the like of a range that is not effective for guidance, a value determined in advance through experiments or the like can be used. Thus, when performing point registration with selection of any one of the landmark icons 74a to 74d, the selected landmark corresponding to the selected landmark item and the registered point are stored in association with each other. In addition, the selected landmark can be used for route guidance to the registered point. In the embodiment, when the point registration request is made and the selection flag F1 is 1, the registration point and the selected landmark are stored in association with each other according to the cost C. However, the landmark item is selected. The selection flag F1 set to the value 1 is a predetermined map display process (for example, map scrolling or map scale change) from the state in which the map image including the selected landmark is displayed by the selection of the landmark item. When the point registration is performed within a range where the point registration process is not canceled), the value 1 is not changed. Further, in the embodiment, when the landmark registration is performed after the landmark item is selected a plurality of times, only the selected landmark corresponding to the landmark item selected last is stored in association with the registered spot. . FIG. 11 shows an example of a state when the point registration is performed with the selection of the landmark icon 74b. The example of FIG. 11 shows a state where the building 82 is registered as a location immediately after the state of FIG. 10 when the landmark icon 74b on the time bar 72 is selected. In the figure, a flag 88 indicating a registered location is displayed on the building image 87. The point registration process has been described above. Next, route guidance processing will be described.

  When the route guidance processing routine of FIG. 4 is executed, the CPU 32 of the electronic control unit 30 first inputs a destination set by the user (step S400), and the input destination is associated with the selected landmark. It is then determined whether it is one of the registered points stored in the predetermined area of the flash memory 38 (step S410). When the destination is not a registered point associated with the selected landmark, normal processing as route guidance processing is performed (step S420), and the route guidance processing routine is terminated. Here, in the normal process, the map display processing unit 62 searches for the travel route to the destination set from the departure place such as the vehicle position specified by the location process using the map data. It is performed by guiding by a map display or voice output from the speaker 26.

  When the destination is a registered point associated with the selected landmark, the route display from the departure point to the destination is performed by the map display by the map display processing unit 62 using the selected landmark and the sound output from the speaker 26. (Step S420), the route guidance processing routine is terminated. Here, as the map display using the selected landmark, for example, the icon on the map corresponding to the selected landmark is blinked, or the route from the selected landmark to the destination is particularly emphasized (the color or pattern of the route). Changing, blinking the route, or displaying a road that is thicker than usual). The audio output using the selected landmark is, for example, the distance from the selected landmark to the destination when the vehicle position approaches a range of a predetermined short distance to the selected landmark on the travel route. It is conceivable that the route from the selected landmark to the destination is described including, for example, the order of turning left and right. FIG. 12 shows an example of route guidance using the selected landmark corresponding to the landmark icon 86. In the figure, the point indicated by the building image 87 is a registered point stored in association with the selected landmark corresponding to the landmark icon 86. In the example of FIG. 12, the route from the selected landmark to the registered point (destination) is emphasized, and the distance from the selected landmark to the registered point (destination) is notified. In the embodiment, as shown in FIG. 13, in addition to the selected landmark and the registration point (destination) associated with each other, the landmark recognized by the landscape image processing along the travel route (the landmark in the figure). Even if there is “Store A” corresponding to the icon 89, such a landmark is not associated with a registration point (destination), so even if the landmark map is displayed, it is used especially for route guidance. It will not be possible.

  Now, consider a case where the user has found a point to be registered while the vehicle is traveling, but cannot register the point by operating the navigation device 20 because the user is driving. In this case, it is conceivable that the user stops the vehicle (parking etc.) and tries to remember the place to be registered by reproducing the landscape image taken during the past travel. By simply operating the slider 73 on the time bar 72 that can indicate the location, it is not possible to easily display the image that you want to see, especially when you are traveling in an area where there is no land intuition. There is a case that cannot be done. On the other hand, in the navigation device 20 of the embodiment, the icon of the landmark recognized from the landscape image is displayed at the corresponding position on the time bar 72, that is, it may be visually recognized by the user while traveling. Considering that a landmark icon is likely to remain in the user's memory because a high landmark icon is displayed, the user can more easily designate a landscape image to be displayed with the landmark icon as a landmark. Since the shooting position as the vehicle position at the time of shooting the landscape image and the surrounding map are displayed together with the landscape image, the user can perform point registration on the map while viewing the landscape image.

  Furthermore, in the navigation device 20 of the embodiment, when a location registration is performed with one selection of a landmark icon, the selected landmark and the registration location are stored in association with each other, and the selected landmark is registered to the registration location. Used for route guidance. Thus, when the selected landmark and the registration point are associated with each other, it can be considered that the relevance between them is particularly high in the user's memory. Therefore, by performing route guidance using the selected landmark associated with the registration point in this way, it is possible to perform route guidance that is more convenient and more convenient for the user. Moreover, in the navigation device 20 according to the embodiment, when the cost C from the selected landmark to the registration point is equal to or higher than the threshold value Cref, the association is not performed, so that the combination having high relevance in the user's memory is provided. However, it is not always effective to actually use it for route guidance to a registered point (for example, the distance is long, the number of right / left turns at an intersection is large and the route is complicated), and the selected landmark is used for route guidance. Can be suppressed. In addition, since the navigation device 20 according to the embodiment recognizes the specific type of landmark selected by the user from the landscape image, the amount of calculation of the landmark image recognition process can be suppressed. A specific type of landmark that is particularly memorable when the user visually recognizes the vehicle from inside the vehicle (for example, attachment) can be selected in advance, and the landmark recognized after being selected in this way is shown. By referring to the landmark item, the user can more easily designate a landscape image or a map image to be viewed.

  In the embodiment, as shown in FIG. 14, even when the selected landmark (“Store A” in the lower part of the figure) corresponding to the landmark icon 90a and the registration point (destination) 90b are associated with each other, When there is a landmark of the same type ("Store A" corresponding to the landmark icon 90c in the figure) within a predetermined distance of the selected landmark, in principle, route guidance using the selected landmark is prohibited. did. This is because the user may be confused by route guidance using the selected landmark. However, as shown in FIG. 15, when the selected landmark (“Store A” in the lower part of the figure) corresponding to the landmark icon 90a and the registration point (destination) 90b are associated with each other, Even when there is a landmark of the same type within the predetermined distance (“Store A” corresponding to the landmark icon 90d in the figure), there is a difference in guidance by voice output regardless of the route guidance using any landmark. If it does not occur, route guidance using the selected landmark is permitted.

  According to the navigation device 20 of the embodiment described above, landscape images continuously photographed by the on-vehicle camera 56 are acquired, and each of the continuously photographed landscape images is associated with the photographing time in the image data DB 44. And a time bar 72 corresponding to the shooting time from the start of shooting to the end of shooting of continuously taken landscape images, and a slider 73 that indicates a position on the time bar 72 that can be designated by the user. An indication display image 71 including landmark icons 74 a to 74 d indicating landmarks along the travel route when a landscape image is taken at corresponding positions on the time bar 72 is displayed in the display area 23 of the display 22. Further, the slider 7 on the time bar 72 is displayed on a predetermined instruction display area 23a, and among the continuous landscape images. Since the landscape image associated with the shooting time corresponding to the position of the vehicle is displayed in the predetermined landscape image display area 23b of the display area 23 of the display 22, the time-series position of the landmark on the travel route is grasped. In this state, the user can designate a landscape image to be displayed in the landscape image display area 23b among the landscape images continuously captured as a moving image. As a result, considering that the landmark is likely to remain in memory when viewed by a user such as a driver while traveling, a landscape image desired to be displayed on the display 22 can be designated more easily.

  Further, according to the navigation apparatus 20 of the embodiment, the shooting position associated with the landscape image together with the shooting time corresponding to the position of the slider 73 on the time bar 72 is displayed together with the map around the shooting position on the display area of the display 22. Since a map is displayed in a predetermined map display area 23c of 23, a map including the shooting position can be displayed together with a landscape image desired to be displayed on the display 22, and spot registration can be performed. Further, when any one of the landmark icons 74a to 74d displayed on the instruction display area 23a is selected, the time bar of the slider 73 is set so as to correspond to the position on the time bar 72 of the selected landmark item. Since the position on 72 is changed, by selecting a landmark item, it is possible to display a landscape image and a map image at the shooting time corresponding to the landmark on the travel route, and the user can easily register a point. Can be performed.

  In addition, according to the navigation device 20 of the embodiment, when performing point registration with selection of any of the landmark icons 74a to 74d displayed on the instruction display area 23a of the display 22, the registration point is selected. When performing point registration in association with the selected landmark indicated by the landmark item, and setting the registered point associated with the selected landmark as the destination for route guidance, the selected landmark associated with the registered landmark Is used for guidance by map display and voice output, so if the landmark is easily seen by a user such as a driver while driving, the route guidance is performed more appropriately. be able to.

  In the navigation device 20 according to the embodiment, when the location registration is performed with the selection of the landmark item on the time bar 72, the selected landmark corresponding to the selected landmark item and the registered location are stored in association with each other. However, even when the location registration is performed without selecting the landmark item on the time bar 72, the landmark and the registered location may be associated with each other and stored. For example, referring to FIG. 9, when the location registration is performed when the slider 73 on the time bar 72 is between the two landmark icons 74b and 74c, the land on the near side of the registered location on the shooting route is displayed. The mark icon 74b may be stored in association with the registration point, or the two landmark icons 74b and 74c on both sides of the registration point in the shooting route may be stored in association with the registration point.

  In the navigation device 20 of the embodiment, when performing route guidance using the registration point associated with the selected landmark as the destination, the route guidance is performed using the selected landmark for guidance by map display and voice output. Alternatively, route guidance may be performed by using the selected landmark only for guidance by map display, or route guidance may be performed by using the selected landmark only for guidance by voice output.

  In the navigation device 20 of the embodiment, when the cost C from the selected landmark to the registration point is equal to or higher than the threshold Cref, the selected landmark is not stored in association with the registration point. The selected landmark may be stored in association with the registered point (without calculating the cost C).

  In the navigation device 20 of the embodiment, the landmark image recognized processing is performed on the landscape image captured by the camera 56 to associate the landmark recognized as being in the landscape image with the shooting time of the landscape image. By storing, the landmark item of the recognized landmark is displayed at the corresponding position on the time bar 72, but the map data is displayed without performing the landmark image recognition processing on the landscape image. It is also possible to recognize landmarks present along the shooting route and to display landmark items of the landmarks thus recognized at corresponding positions on the time bar 72.

  In the navigation device 20 of the embodiment, when it is recognized that a specific type of landmark preselected by the user is in the landscape image, the recognized specific type of landmark is associated with the shooting time of the landscape image. It is supposed to be memorized, but not limited to a specific type of landmark, when any one of the types of landmarks on the map data is recognized as being in the landscape image, the recognized landmark is displayed as a landscape. The image may be stored in association with the shooting time of the image.

  In the navigation device 20 of the embodiment, when any one of the landmark items on the time bar 72 is selected, the time range displayed by the time bar 72 is changed to the selected display range time including the display target shooting time. However, the time range displayed by the time bar 72 may not be changed. In addition, the time range displayed by the time bar 72 may be freely changed by the user by operating the touch panel 24 (such as an operation of speaking or bringing two fingers on the time bar 72). .

  In the navigation device 20 of the embodiment, the shooting of the landscape image by the camera 56 is performed while the vehicle is traveling from when the user gives an instruction to start shooting until the end of shooting is given. It may be started when turned on and terminated when turned off.

  In the navigation device 20 of the embodiment, the landscape image is reproduced as a moving image and the map image is scroll-displayed. However, when the landscape image or the map image is initially displayed, the slider 73 on the time bar 72 is displayed. When a drag operation is performed, when a landmark item on the time bar 72 is selected, the landscape image is temporarily displayed as a still image, and the landscape remains as a still image according to the drag operation of the slider 73 on the time bar 72. The image may be updated or the map image may be scrolled. In this case, when reproduction as a moving image is started by a user instruction, reproduction of a landscape image and scroll display of a map image may be started.

  In the navigation device 20 of the embodiment, the time bar 72 corresponds to the shooting time from the start of shooting the landscape image to the end of shooting, and is displayed with a certain length on the entire instruction display area 23a of the display 22. However, for example, as illustrated in FIG. 16, a time bar 172 having a different length in the instruction display area 23a may be used depending on the length of the shooting time from the start of shooting a landscape image to the end of shooting. That is, the size of the indication display image 171 including the time bar 172, the slider 173, and the landmark item may be different depending on the length of the shooting time.

  In the navigation device 20 of the embodiment, when registering a spot, the instruction display image 71 including the time bar 72, the slider 73, and the landmark item is displayed in the instruction display area 23a extending to the lower end of the display area 23. For example, as illustrated in FIG. 17, an instruction display image 271 including a time bar 172, a slider 173, and landmark items is displayed at the right end and the left end of the display area 23 with the vertical direction as the longitudinal direction. You may do it. The time bar displayed in this way is not limited to a straight line, and may be displayed as a curve. That is, the instruction display image may be displayed in a curved shape such as a ring shape.

  In the navigation device 20 of the embodiment, when registering a spot, an instruction display image 71 including a time bar 72, a slider 73, and a landmark item, landscape images 76 and 80 corresponding to the display target shooting time, and display target shooting. The map images 78 and 84 corresponding to the time are displayed. However, the items indicating the time series from the start of shooting the landscape image to the end of shooting as a time series line, and the time series corresponding to the shooting time of the displayed landscape image. It is only necessary to display at least an instruction display image including an item indicating that the upper position can be indicated, a landmark item, and a landscape image. Accordingly, as illustrated in FIG. 18, the landscape image 376 is displayed on a part of the display area 23 (the right half in the example in the figure), and the travel route of the vehicle on the map from the start of the capture of the landscape image to the end of the capture An instruction display image 371 including a shooting path 372 indicating a shooting position mark 373 that can be changed by the user by operating the touch panel 24 on the shooting path 372, and landmark items 374 a to 374 d. It may be displayed as a map with a maximum scale capable of displaying the entire photographing path 372 in a part (left half in the example in the figure). That is, the instruction display image that can instruct the shooting time of the landscape image to be displayed is not limited to the one including the time bar 72 and the slider 73. Also, in the case of the example of FIG. 18, similarly to the navigation device 20 of the embodiment, the landscape image storage process can be executed, and the map image 371 is operated by operating the touch panel 24 (speaking two fingers) at the point registration. The scale image can be changed by an operation such as moving or approaching, and when the landmark item is selected, the landscape image 376 is updated so as to correspond to the shooting time, or the selected landmark and the registration point are stored in association with each other. In the route guidance process, the selected landmark can be used for route guidance to the registered point.

  In the navigation device 20 of the embodiment, when registering a spot, the instruction display image 71 including the time bar 72, the slider 73, and the landmark item, the landscape images 76 and 80 corresponding to the display time, and the display time are supported. Although the map images 78 and 84 are displayed, regardless of whether or not the point registration is performed, the items indicating the time series from the start of shooting to the end of shooting as a time-series line and the landscape to be displayed It is only necessary to display at least an item indicating that a position on the time series corresponding to the shooting time of the image can be indicated, an indication display image including a landmark item, and a landscape image. Accordingly, as illustrated in FIG. 19, the instruction display image 71 and the landscape image 476 displayed on almost the entire display area 23 may be displayed without displaying the map image.

  In the embodiment, the vehicular display processing system of the present invention is applied to the navigation device 20 including the display 22 and the HDD 40. However, for example, the electronic control unit 30 is connected to a server communicably connected to the navigation device including the display. The function of the point registration processing unit 64, the function of the route guidance processing unit 66, and a part of the function of the image processing unit 68 necessary for landscape image processing, etc. are performed, and this server is displayed for the vehicle of the present invention. It is good also as what functions as a processing system, and it is good also as what comprises the display processing system for vehicles as a whole by sharing a function with a navigation apparatus and a server. Further, instead of the navigation device 20, devices such as a digital camera, a portable terminal, and a drive recorder may function as the vehicle display processing system of the present invention. In this case, such a device may be installed in the vehicle interior, and scenery image processing, point registration processing, and route guidance processing may be performed using a landscape image captured by a camera included in the device.

  In the embodiment, the vehicle display processing system of the present invention is applied to the navigation device 20. However, the vehicle display processing method may be used, and one or more steps of the vehicle display processing method may be used. It is good also as a form of the program for making a computer realize. Further, such a program may be stored in a recording medium.

  The correspondence between the main elements of the embodiment and the main elements of the invention described in the column of means for solving the problems will be described. In the embodiment, the display 22 corresponds to the “display unit”, the HDD 40 (image data DB 44) corresponds to the “storage unit”, and the electronic control unit 30 executes the process of step S100 of the landscape image processing routine of FIG. The point registration processing unit 64 corresponds to a “landscape image acquisition unit”, and the point registration processing unit 64 of the electronic control unit 30 that executes the process of step S110 of the landscape image processing routine of FIG. 2 serves as the “landscape image storage processing unit”. Correspondingly, the point registration processing unit 64 of the electronic control unit 30 that executes the processing of steps S220 to S240 of the point registration processing routine of FIG. 3 corresponds to “display processing means”. Further, the point registration processing unit 64 of the electronic control unit 30 that executes the processing of steps S210, S310, and S380 of the point registration processing routine of FIG. 3 corresponds to “point registration means” and executes the route guidance processing routine of FIG. The route guidance processing unit 66 of the electronic control unit 30 that corresponds to “route guidance means”, and the point registration processing unit 64 of the electronic control unit 30 that executes the processing of steps S360 and S370 of the point registration processing routine of FIG. The image processing unit 68 of the electronic control unit 30 that executes step S140 of the landscape image processing routine of FIG. 2 corresponds to “landmark recognition means”.

  The correspondence between the main elements of the embodiment and the main elements of the invention described in the column of means for solving the problem is the same as that of the embodiment described in the column of means for solving the problem. Therefore, the elements of the invention described in the column of means for solving the problems are not limited. That is, the interpretation of the invention described in the column of means for solving the problems should be made based on the description of the column, and the examples are those of the invention described in the column of means for solving the problems. It is only a specific example.

  As mentioned above, although the form for implementing this invention was demonstrated using the Example, this invention is not limited at all to such an Example, In the range which does not deviate from the summary of this invention, it is with various forms. Of course, it can be implemented.

  The present invention is applicable to the manufacturing industry of vehicle display processing systems.

  DESCRIPTION OF SYMBOLS 10 Navigation system, 12 Vehicle-mounted apparatus, 20 Navigation apparatus, 22 Display, 23 Display area, 23a Instruction display area, 23b Landscape image display area, 23c Map display area, 24 Touch panel, 26 Speaker, 30 Electronic control unit, 32 CPU, 34 ROM, 36 RAM, 38 flash memory, 40 hard disk drive (HDD), 50 GPS receiver, 52 vehicle speed sensor, 54 bearing sensor, 56 camera, 60 location processing unit, 62 map display processing unit, 64 point registration processing unit, 66 Route guidance processing unit, 68 Image processing unit, 70 Shooting route designation screen, 70a, 70b Shooting route designation button, 71, 171, 271, 371 Instruction display image, 72, 172 Time bar, 73, 173 Slider, 74 74d, 86, 89, 90a, 90c, 90d, 374a to 374d Landmark icon, 76, 80, 376, 476 Landscape image, 78, 84 Map image, 79, 85 Shooting position mark, 81 Landmark, 82 Building, 87 building image, 88 flag, 90b registration point, 372 shooting route, 373 shooting position mark.

Claims (12)

A vehicle display processing system for displaying an image on a display unit,
Landscape image acquisition means for acquiring landscape images continuously captured by an in-vehicle camera that captures a landscape in front of the vehicle;
Landscape image storage processing means for storing each of the continuously photographed landscape images in a storage unit in association with the photographing time;
A user can specify a time-series line item that indicates a shooting time from the start to the end of shooting of the continuously photographed landscape images as a line in time series, and a position on the time-series line item. A time-series item including a time-position item to be displayed, and a landmark item indicating a landmark existing along a travel route when the continuous landscape image is captured at a corresponding position on the time-series line item. The instruction display is displayed in a predetermined instruction display area in the display area of the display unit, and the photographing time corresponding to the position of the time position item on the time-series line item in the continuous landscape image is displayed. Display processing means for displaying a landscape image associated with a predetermined landscape image display area in the display area of the display unit;
A vehicle display processing system. The vehicle display processing system according to claim 1,
The landscape image storage processing means stores each of the continuously photographed landscape images in the storage unit in association with the photographing position indicating the own vehicle position on the map at the time of photographing together with the photographing time,
In addition to the display of the time-series instruction display in the instruction display area and the display of the landscape image in the landscape image display area, the display processing means is configured to display the time position item on the time-series line item. The shooting position associated with the landscape image together with the shooting time corresponding to the position is displayed on a predetermined map display area in the display area of the display unit together with a map around the shooting position.
Vehicle display processing system. The vehicle display processing system according to claim 2,
When one of the landmark items displayed on the instruction display area is selected, the display processing unit corresponds to the position of the selected landmark item on the time-series line item. Changing the position of the time position item on the time series line item,
Vehicle display processing system. The vehicle display processing system according to claim 3,
Point registration means for performing point registration with an arbitrary point selected by the user on the map displayed on the display unit as a registered point;
Route guidance means for performing route guidance to the set destination when the destination is set;
With
When the point registration unit performs point registration with selection of any one of the landmark items displayed on the instruction display area of the display unit, the registered point is the selected landmark item. Perform location registration in association with the landmark indicated by
When the route guidance means performs the route guidance by setting the registered point associated with the landmark as a destination, the route guidance unit guides the landmark associated with the registered point by at least one of map display and voice output. To provide route guidance,
Vehicle display processing system. The vehicle display processing system according to claim 4,
A travel difficulty degree determination unit that determines whether or not the degree of travel difficulty based on at least one of the distance from the landmark associated with the registration point to the registration point and the number of right / left turns at an intersection is less than a predetermined level. With
The spot registration means performs spot registration by associating the registration spot with the landmark only when it is determined that the degree of difficulty of travel is less than the predetermined degree.
Vehicle display processing system. A vehicle display processing system according to any one of claims 1 to 5,
Landmark recognition means for recognizing the landmark by performing predetermined image recognition processing on the landscape image;
The display processing means displays the landmark item indicating the landmark recognized by the landmark recognition means at a corresponding position on the time-series line item in the instruction display area.
Vehicle display processing system. The vehicle display processing system according to claim 6,
The landmark recognition means recognizes a specific type of landmark selected in advance among a plurality of types of landmarks,
Vehicle display processing system. The vehicle display processing system according to any one of claims 1 to 7,
The display processing unit corresponds to a position of the selected landmark item on the time-series line item when any one of the landmark items displayed on the instruction display area is selected. Display in the instruction display area as a time range in which the time-series line item displays a predetermined time including a photographing time;
Vehicle display processing system. A vehicle display processing system according to any one of claims 1 to 8,
The time-series instruction display includes a time bar corresponding to a time from the start to the end of shooting of the continuous landscape image and a slider that can slide on the time bar, respectively, and the time-series line item and the time. Including as a position item,
Vehicle display processing system. The vehicle display processing system according to claim 1,
The time-series instruction display includes a shooting route indicating a travel route of a vehicle on a map from the start of shooting to the end of shooting of the continuously shot landscape images, and a predetermined mark whose position can be changed on the shooting route. Is a map at the maximum scale that can display the whole of the shooting route in the instruction display area, respectively, as the time-series line item and the time position item.
Vehicle display processing system. A vehicle display processing method for displaying an image on a display unit,
(A) acquiring landscape images continuously captured by an in-vehicle camera that captures a landscape in front of the vehicle;
(B) storing each of the continuously photographed landscape images in a storage unit in association with the photographing time;
(C) A time-series line item indicating a time-series line from the start to the end of capturing of the continuously photographed landscape images, and a position on the time-series line item by the user. A time position item that can be indicated, and a landmark item that indicates a landmark that exists along a travel route when the continuous landscape image is taken at a corresponding position on the time-series line item. A time-series instruction display is displayed in a predetermined instruction display area in the display area of the display unit, and corresponds to the position of the time position item on the time-series line item in the continuous landscape image. Displaying a landscape image associated with a shooting time to be displayed in a predetermined landscape image display area of the display area of the display unit;
A vehicle display processing method including:   A program for causing one or more computers to implement each step of the vehicle display processing method according to claim 11.

Images