JP4415263B2 - Image processing system and image processing method - Google Patents

Description

  The present invention provides an image processing system including a processing device that associates position data acquired by a position acquisition unit with captured image data acquired by an image data acquisition unit, position data acquired by the position acquisition unit, and an image The present invention relates to an image processing method that associates photographed image data acquired by a data acquisition unit with a processing device.

  As technologies related to the image processing system configured as described above, there are those disclosed in Patent Document 1 and Patent Document 2. That is, Patent Literature 1 stores image data, voice data, and the like as additional information in association with guide route data to a destination or actually traveled trajectory data, and displays the guide route data and trajectory data on a display device. The navigation device is configured to output the associated captured image data, music data, and the like when displayed. This navigation device displays the current position detected by the position detector (the position acquisition means of the present invention) on a map by map matching processing, and performs a route search operation when a destination or a waypoint is input. Guide route data is displayed on the map, and when this guide route is registered, additional information such as arbitrary image data related to the guide route is stored in association with the guide route in accordance with the operation of the user. The stored additional information can be selectively recalled and displayed.

  In Patent Document 2, a basic processing form of a navigation device is set so that road map data and its own position are displayed on a display panel by map matching processing, and specific data for identifying a spot and a real image of the spot (Spotted image data of the present invention), image display position data for displaying a real image, and link data for linking a real image to road map data are fetched from a DVD-ROM, and a spot is designated By registering the real image, the registered real image can be displayed on the road map displayed on the display panel.

JP 2002-81955 A (Claim 1, paragraph numbers [0011] to [0034], FIGS. 1 to 5) JP 2003-269981 A (paragraph numbers [0057] to [0079], FIGS. 1 and 2)

In the car navigation system, considering the process of associating image data with the route traveled by the vehicle, when associating multiple image data, the process of designating a specific position on the route and designating pre-selected image data The processing associated with the selected position is performed. In this regard, Patent Document 1 has an editing function for storing input additional information in association with trajectory data by performing artificial editing. In Patent Document 2, link data for linking a spot real image with map data is used. The link data creates an icon from the real image, and a location such as XX city XX town (location number) ) And a name and the like.

  In recent years, digital cameras have become more sophisticated and less expensive. When you travel to a sightseeing spot with your own car, you carry a digital camera. I often take snapshots against these backgrounds. Ideally, the image data shot in this way is printed on photographic paper and stored as an album. However, since the captured image data captured by the digital camera can be easily displayed on a home computer, the captured image data is viewed on the computer after the trip and is not considered after this.

  From another point of view, when you travel to the direction you have visited once with a private car, you can enjoy the pleasure of traveling by making it possible to view snapshots of sightseeing spots you visited previously for each sightseeing point. Although it doubles, as mentioned above, there is a tendency to print out the captured image data, and even if you have made a photo album in a tourist spot you have visited before, bring that album to your trip This is bothersome and there is room for improvement.

  Therefore, it is conceivable to display image data on a map displayed on the display of the car navigation system as shown in Patent Documents 1 and 2, but the number of photographed image data photographed at a sightseeing spot is relatively large. There is room for improvement in that it takes too much time to associate a lot of captured image data with high accuracy on a map.

  An object of the present invention is to rationally configure a system capable of recognizing a position where photographed image data photographed by a digital camera is photographed.

A feature of the present invention is an image processing system including a processing device that associates position data acquired by a position acquisition unit with captured image data acquired by an image data acquisition unit.
An image data storage unit that stores map image data indicating an existing position of the position data, and a display that displays an image as an output unit that outputs the captured image data.
The position acquisition means is configured to acquire the position data as the vehicle travels, and to acquire timing data for specifying a date and time when the position data is acquired;
The processing device uses the position data as a shooting point so that the shooting date and time data associated with the shot image data correspond to the timing data, and associates the position data and the shot image data with link data. A link processing unit and an output control unit;
The output control means displays the map image data on the display, displays a route on which the vehicle has traveled on the map image data, and sequentially designates a plurality of timing data dates and times along a time axis. , updated by extracting the position data corresponding to the designated timing data, the output control means displays in a form vehicle symbol is traveling on the route based on the updated the location data, the update The captured image data associated with the position data by link data is displayed on the display.

With this configuration, the link processing unit generates link data and associates it based on the timing data of the position data acquired by the position acquisition unit as the vehicle travels and the shooting date / time data attached to the captured image data. For example, it is possible to automatically perform processing for associating photographed image data photographed by a digital camera at a position where a vehicle exists with the position data. Also, the map image data and the route the vehicle has traveled on the map image data are displayed on the display , and the corresponding position data is updated by sequentially specifying the date and time of multiple timing data along the time axis. , based on the updated location data is displayed in a form that vehicle symbol is traveling on the route, the captured image data that is associated with link data in position data is displayed on the display. As a result, by using the timing data of the position data acquired by the position acquisition means and the shooting date / time data attached to the shot image data, the shot image data is associated with the position data without trouble, and shooting is performed at that position. A system capable of recognizing the captured image data was constructed.

In the present invention, the processing device includes a route storage unit that stores a plurality of position data acquired by the position acquisition unit as a route, and the output control unit outputs the map image data displayed on the display. The route stored in the route storage means is displayed, a vehicle symbol is displayed at a position corresponding to the position data updated on the route, and the link data is associated with the position data on the route. The captured image data associated with the updated position data by the link data may be displayed .

With this configuration, map image data is displayed on the display, route data is displayed on the map image data, shooting points are displayed on the route data, and shooting image data associated with the shooting points can be displayed. .

The present invention displays a confirmation screen on the display, the map image data on the confirmation screen, a shooting point associated with the link data among position data, and the link data associated with the shooting point. When the operator determines that the shooting point and the shooting position of the shooting image data are offset, the operator displays the original shooting point on the confirmation screen by shifting the shooting date and time. Then, the photographing date / time data of the plurality of photographed image data obtained by the image data obtaining means may be corrected by the shift time by the operator's confirmation operation .

With this configuration, a confirmation screen is displayed on the display, and the operator captures the shooting point and the captured image data associated with the shooting point by link data on the confirmation screen. When it is determined to do so, the shift time is acquired by the operation of the operator, and the shooting date and time of the plurality of shot image data can be corrected collectively by the shift time.

In the present invention, the position acquisition means may be constituted by a GPS unit constituting a car navigation system, and the map image data may be constituted by map data used in the car navigation system .

With this configuration, by using the GPS unit constituting the car navigation system, for example, taken image data taken by a digital camera with respect to the position data traveled by the private car, such as when traveling by private car Can be associated with each other, and map data used in the car navigation system can be used.

The present invention, the image data acquisition means, with consists of a plurality of semiconductor drives for acquiring photographic image data from a semiconductor type storage medium used in a digital camera, a plurality of vehicle plurality of semiconductor drives It may be arranged in the vicinity of the seat.

  With this configuration, for example, in a vehicle equipped with a plurality of seats such as a sightseeing bus, a semiconductor drive is arranged in each seat, thereby storing photographed image data photographed by each tourist's digital camera. The captured image data stored in this manner can be associated with the position data and displayed on the display or stored in the storage medium.

The present invention relates to an image processing method in which position data acquired by a position acquisition unit and captured image data acquired by an image data acquisition unit are associated by a processing device.
Storing map image data indicating the location of the position data in an image data storage unit;
The position acquisition means acquires the position data as the vehicle travels, acquires timing data specifying the date and time when the position data was acquired,
The processing device associates the position data with the photographed image data by link data , using the position data as a photographing point so that the photographing date / time data accompanying the photographed image data corresponds to the timing data. While performing the link process,
The processing device displays the map image data on the display, displays a route on which the vehicle has traveled on the map image data, and sequentially designates a plurality of timing data dates and times along a time axis, updates to extract position data corresponding to the specified timing data, updated by said display in a form vehicle symbol is traveling on the route, based on the position data, linked to this updated the position data You may perform the output process which displays the picked-up image data linked | related with data on the said display.

With this configuration, the link processing unit generates link data based on the timing data of the position data acquired by the position acquisition unit as the vehicle travels and the shooting date / time data attached to the shot image data, and the position data and the shot image are generated. Since the association with the data is performed, for example, it is possible to automatically perform processing for associating the captured image data photographed by the digital camera at the position where the vehicle exists with the position data. Also, the map image data and the route the vehicle has traveled on the map image data are displayed on the display , and the corresponding position data is updated by sequentially specifying the date and time of multiple timing data along the time axis. , based on the updated location data is displayed in a form that vehicle symbol is traveling on the route, the captured image data that is associated with link data in position data is displayed on the display. As a result, by using the timing data of the position data acquired by the position acquisition means and the shooting date / time data attached to the shot image data, the shot image data is associated with the position data without trouble, and shooting is performed at that position. The captured image data can be recognized.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment]
As shown in FIG. 1 and FIG. 2, a system main body B to which a signal from a GPS satellite received by an antenna unit A and a vehicle speed pulse signal from a vehicle speed sensor S provided in a vehicle driving system is input. A drive unit E (an example of a media drive: an image data acquisition unit and an output unit) having a display C (an example of an output unit) on the front surface of the system main body B, a processing device D inside, and a structure separated from the system main body B The navigation system is also configured.

  A plurality of switches 1, a speaker 2 for outputting audio information, an infrared sensor 4 for receiving an infrared signal from a remote controller 3, and an input / output terminal 5 for accessing captured image data are provided on the front surface of the system main body B. And.

  This navigation system is attached to the console 102 on the side of the meter panel 101 at the front position of the driver's seat 100 of the private car, and is based on the signal from the GPS satellite and the vehicle speed pulse signal from the vehicle speed sensor S. An example of map data (map image data indicating the position of the position data) is obtained in real time for the position data (longitude data / latitude data) where the vehicle is present when traveling, and the display C corresponds to the position data. ) Is displayed on the display C at a set enlargement ratio, and the position where the vehicle is present on the map data is displayed with a vehicle symbol. In addition, this navigation system has a capability of displaying a route to be traveled to reach that point on a map by designating a destination and guiding (navigating) during travel. The navigation system having such a performance is not fundamentally different from the conventional one, and the navigation system of the present invention stores a plurality of captured image data in association with each other on the route traveled by the vehicle, and stores in this way. The present invention is characterized in that the process for displaying the captured image data on the display C and the process for storing the electronic album including the captured image data in the storage medium can be performed.

  The display C includes a liquid crystal display unit 6 that displays necessary data such as map data and captured image data, and a touch panel unit 7 that detects a touch operation such as a fingertip. The plurality of switches 1 realize processing such as display mode switching including ON / OFF of the navigation system. The remote controller 3 realizes necessary operations from a position separated from the system main body B. The speaker 2 is used for performing guidance or the like in human language, and for reproducing music data to be described later.

  The drive unit E (an example of a medium drive / image data acquisition unit) acquires data from a semiconductor medium Ms (an example of a storage medium) such as a flash memory in which captured image data captured by the digital camera 105 is stored ( Read) semiconductor drive 8 and disk drive 9 that enables acquisition and storage (writing) of data from multiple types of large-capacity disk-shaped media Md (an example of a storage medium) such as a CD-R or DVD-R And. The semiconductor drive 8 includes a plurality of insertion portions so as to be compatible with types of flash memories such as CompactFlash (registered trademark), SmartMedia (registered trademark), and Memory Stick (registered trademark).

  The input / output terminal 5 (an example of image data acquisition means) is stored in the digital camera 105 via a cable 106 such as a USB (Universal Serial Bus) standard or an IEEE 1394 standard disposed between the digital camera 105 and the digital camera 105. It functions to acquire captured image data. Note that the present invention does not exclude the case where the captured image data of the digital camera 105 is acquired wirelessly, but as the image data acquisition means that transmits the captured image data using wireless, such as Bluetooth (Bluetooth). It may be adopted.

  The configuration of this navigation system can be shown as shown in FIG. That is, the system main body B includes an input / output interface 10 that realizes access to information to the microprocessor, and the position acquisition means L (an example of a GPS unit) and the liquid crystal display unit are connected to the input / output interface 10. 6, a signal system for accessing data from each of the touch panel 7, the plurality of switches 1, the speaker 2, the infrared sensor 4, the input / output terminal 5, the semiconductor drive 8, the disk drive 9, and the hard disk HD. Forming.

  The position acquisition means L captures the radio wave from the GPS satellite received by the antenna unit A and simultaneously captures the vehicle speed pulse signal from the vehicle speed sensor S, thereby obtaining vehicle position data (longitude / latitude data) in real time. And the time when this position data was acquired is acquired as timing data. Further, the position acquisition means L may acquire position information by radio waves from a plurality of radio wave transmission sources on the ground, and may be a gyroscope that detects the attitude of the vehicle, or an acceleration sensor that detects the acceleration of the vehicle. Alternatively, the accuracy of the position information of the vehicle may be improved by using radio waves from a ground source.

  The hard disk HD has a function of storing photographed image data, functions as a map database of map data (an example of an image data storage unit) that stores map data of a preset area, and stores music data. It functions as a music database.

  The processing device D includes a semiconductor memory RAM / ROM connected to a data bus from a microprocessor, a nonvolatile memory EEPROM, a map matching means 11, a navigation means 12, a route storage means 13, an image data storage processing means 14, and a link processing means. 15), output control means 16 and storage processing means 17. Incidentally, in order to realize control in this processing device D, a control bus and an address bus are required in addition to a data bus, but in order to avoid complication, the drawing shows a control bus and an address bus. Does not show interfaces.

  The map matching means 11 extracts map data corresponding to the position data from the position acquisition means L from the map database stored in the hard disk HD and displays it on the display C at a preset magnification. I do. The navigation means 12 extracts a route to a preset destination from the map data and displays the route on the map data in a line shape. Necessary operations such as a right turn and a left turn at a point such as an intersection are displayed on the display C. A process of displaying and outputting necessary operations such as a right turn and a left turn in the human language from the speaker 2 is performed.

  The route storage means 13 writes the position data acquired for each interval set by the position acquisition means L into the hard disk HD or the semiconductor memory RAM at each timing when each position data is acquired, so that the vehicle has traveled. A process of storing position data as a route is performed. Incidentally, when the route 110 stored in the route storage means 13 is displayed on the display C, it is displayed as shown by a broken line in FIG. 7, and a vehicle symbol 111 is shown on the route 110, and this route 110 The shooting point P described later is shown above.

  The image data storage processing means 14 performs processing for holding and storing the captured image data acquired via the semiconductor drive 8, the disk drive 9, or the input / output terminal 5 in the hard disk HD. When the image data is stored in the hard disk HD, a selection screen 20 that enables the captured image data to be taken in is displayed on the display C as shown in FIG. 5, and a necessary image is designated on the selection screen 20. It functions to store a plurality of selected photographed image data (this function will be described later).

  The link processing means 15 includes a timing data acquisition unit that acquires timing data for specifying the timing at which the position data is acquired, a shooting date / time data acquisition unit that acquires shooting date / time data from Exif data attached to the shot image data, A link data generation unit that generates link data from the timing data and the shooting date / time data is provided. The timing data acquisition unit, the shooting date / time data acquisition unit, and the link data generation unit each function effectively when the captured image data is converted into an electronic album as described later.

  The Exif data is attached to the photographed image data as a header of a file constituting photographed image data photographed by the digital camera 105, and an example of the structure can be represented as shown in FIG. The main information of this Exif data stores the manufacturer name and model name of the digital camera. In addition to exposure time, image width, and image height data as sub-information, the original shooting date / time is year, month, day, time. Are stored in units of minutes and seconds, and the shooting date and time acquisition unit of the link processing unit 15 acquires the data of the original shooting date and time as shooting date and time data.

  The output control means 16 performs processing for displaying captured image data associated with position data on the display C.

  The storage processing unit 17 includes data of the selected route 110, a plurality of photographed image data associated with a plurality of position data (photographing points) existing on the route 110, map data corresponding to the route 110, When the associated music data exists, the music data is stored as an electronic album in a storage medium such as the disk-shaped medium Md (control form will be described later). A storage medium (for example, a DVD-R) in which data is stored as an electronic album can reproduce map data, photographed image data, and the like on a personal computer.

  When the storage medium storing the data as an electronic album is played back by a personal computer, the map data and the route 110 are displayed on the display as shown in FIG. 7, and the vehicle symbol 111 travels on the route 110. Each time the vehicle symbol 111 reaches the shooting point P by this simulation, a process of displaying the shot image data associated with the shooting point P (position data) on the display C is performed. It should be noted that the present invention is not intended only for electronic albums that are automatically reproduced, but simply stores route 110 data, photographed image data, map data, etc. By clicking or operating a specific key on the keyboard, an electronic album having a data structure that simply displays captured image data associated with each shooting point on the route 110 in the order of shooting is generated as an electronic album. It may be a thing.

  In the present invention, the map matching means 11, navigation means 12, route storage means 13, image data storage processing means 14, link processing means 15, output control means 16, and storage processing means 17 are software that can be developed on a semiconductor memory RAM. Although hardware (program) is assumed, part or all of the hardware (program) may be configured by hardware such as logic.

  The navigation system of the present invention displays the processing menu 30 shown in FIG. 4 on the display C by operating the switch 1 or the remote controller 3, and the album creation button 31 displayed on the processing menu 30 and the reproduction mode are displayed. The selected process can be executed by selecting a process in which the finger is brought into contact with any one of the play button 32 in the (simulation mode) and the play button 33 in the actual travel mode.

  Specifically, the creation of an electronic album is realized by operating the album creation button 31 in the processing menu 30. In this system, before the album creation button 31 is operated, the position where the vehicle has traveled Is automatically acquired, and a processing mode is set so as to acquire a plurality of captured image data at an arbitrary timing.

  That is, in the navigation system of the present invention, as shown in the flowchart of FIG. 10, every time the position acquisition means L acquires position data at a preset interval, the position data is acquired and stored (step # 01). An image data acquisition routine (step # 100) for acquiring captured image data at any timing is executed. Such a process is continuously performed until a process for creating an electronic album is selected (step # 02). When a process for creating an album is selected (when the album creation button 31 is operated). The link processing means 15 generates link data (step # 200), sets map data corresponding to position data associated with the photographed image data by the link data, sets a title, and sets music data. After that, the created electronic album is stored in the hard disk HD, and when the processing for storing in the medium is selected, the electronic album is stored in the disk-shaped medium Md (for example, DVD-R) as the storage medium. The storing process is performed (# 03 to # 05, steps # 300).

  As shown in the flowchart of FIG. 11, the image data acquisition routine (# 100 step) grasps the situation in which the captured image data can be acquired as in the case where the storage medium Md is set in the semiconductor drive 8. Only when the selection is made, the selection screen 20 shown in FIG. 5 is displayed on the display C (steps # 101 and # 102). The selection screen 20 displays all the captured image data stored in the storage medium in the thumbnail format in the image display area 21. By operating the scroll bar 22, all the captured image data is displayed. Can be confirmed. Of the photographed image data displayed in the image display area 21 as described above, information 23 that has been determined to be already stored based on the file number of the photographed image data is attached with information 23 such as <stored>. The processing mode is set so that all remaining captured image data except the already stored captured image data is automatically selected as a storage target (step # 103).

  For those that are not automatically reflected from the ones that were automatically selected as described above, or those that are judged to be unnecessary for the album, the selection button is used after the operator designates the captured image data in contact with the finger. The selection can be canceled by operating the finger 24 in contact with the finger. When the selection is performed again after the selection is canceled, the selection switch 25 can be operated to select the selection. In addition, when the rotation button 26 is operated after the photographed image data is designated, the designated photographed image data can be rotated in units of 90 degrees. After the selection is made as described above, the selected photographed image data is stored in the hard disk HD (step # 105) by operating the OK button 27 (step # 104). The process for selecting the photographed image data is realized by the operation via the touch panel unit 7 of the display C. However, the photographed image data is designated by operating the switch 1 or the remote controller 3. The interface may be set to perform necessary operations.

  In addition, when the electronic album is created after storing the position data and the captured image data, the processing menu 30 is displayed on the display C, and the album creation button 31 on the screen is operated ( # 02 step yes).

  After this operation, the process of generating the link data is executed as shown in the flowchart of FIG. That is, the timing data acquisition unit of the link processing unit 15 extracts the timing data stored in the hard disk HD, and the imaging date acquisition unit of the link processing unit 15 captures from the Exif data attached to each captured image data. Extract date and time data. Next, the link generation unit of the link processing unit 15 generates link data that associates a plurality of timing data with a plurality of shooting date and time data that match and those that approximate each other (steps # 201 and # 202). . The process in step # 202 corresponds to the process in the automatic link mode. After the link data is generated in this way, the route 110 is displayed on the display C as shown in FIG. 6 (details will be described later). The shooting point P (single or plural) of the shot image data is displayed on the route 110 (step # 203).

  When the shooting point P is displayed in this way, the operator determines whether there is an error from the actual shooting position. This error is caused by the time error between the timing data generated by the position acquisition means L and the clock built in the digital camera 105. If there is an error, it is necessary to correct the shooting date / time data. By performing the operation, the shooting date / time data of all the shot image data shot by the corresponding digital camera 105 is corrected at once (steps # 204 to # 206), link data is generated again, and the route 110 is updated. The shooting point P is displayed on the screen for confirmation, and the process ends when the error is resolved. Also, the processes in steps # 205 and # 206 correspond to the process in the correction link mode.

  The processing in step # 202 is realized by displaying the confirmation screen 40 on the display C as shown in FIG. That is, the map data is displayed on the confirmation screen, the route 110 and the photographing point P as the “link position” are displayed on the map data, and the photographing image data associated with the photographing point P by the link data. Is displayed in the display area 41. In this display state, for example, when the operator confirms that the original photographing point Px where the photographed image data was photographed is offset by the distance X as shown in the figure, it is displayed on the screen. By operating the time setting slider 42, it is possible to move the shooting point P on the route 110 to match the original shooting point Px, and the shooting date and time for the time corresponding to the amount of movement of the shooting point P. A process of shifting the data and displaying the shift time on the shift time display unit 43 is performed. More specifically, the position data is acquired at relatively short intervals (several times or more per minute), and timing data is also acquired together with the position data. Therefore, even when the shooting date / time data is shifted and an accurate shooting date / time is set, it is possible to easily extract timing data that matches or approximates the accurate shooting date / time. Therefore, it is possible to easily associate photographed image data in which an accurate photographing date and time is set with the position data including the image data, and as a result, the photographed image data can be displayed in association with an appropriate photographing point on the route 110. is there.

  In the drawing, the display form is set so that the display area 41 is displayed in a small size on the map data. For example, the display area 41 is formed to fill the screen, and a window is opened in a part of the display area 41. It is also possible to set the display form so as to display the map data in the form, and in the present invention, the display form and display size of the map data and captured image data displayed on the screen can be arbitrarily set It has become.

  Furthermore, if necessary, the photographed image data can be switched by operating the buttons 41F and 41R below the display area 41, and the photographing point P in a plurality of photographed image data can be confirmed. After this confirmation, by operating the OK button 44, the correction of the shooting date / time data of all the shot image data shot by the corresponding digital camera 105 is completed. In this navigation system, it is also possible to acquire and process captured image data captured by a plurality of digital cameras 105. In this way, when captured image data captured by a plurality of digital cameras 105 is acquired. In this case, the captured image data captured by any digital camera 105 is processed by shifting the captured date and time extracted from the Exif data attached to the captured image data captured by each digital camera 105 for each digital camera 105. In addition, the shooting date / time data can be corrected collectively to generate highly accurate link data.

  In the process shown in the flowchart of FIG. 12, the operator confirms the shooting point P and the original shooting point Px on the map in order to eliminate the error. You may set a processing form so that it may input. Incidentally, the link data has a simple data structure recorded by comparing position data (longitude and latitude data) with the file number of the captured image data.

  Next, although the process at the step # 03 is not shown in the drawing, the keyboard is displayed on the display C, the character information is input in such a form that the finger is brought into contact with the keyboard, the title is set, and the title is stored in advance. A list of music information titles is displayed on the display C, and if necessary, the music information is selected in a form in which a finger touches the music information to be set in the BGM from the list by performing a trial listening. As a result, the selected music is set in the BGM.

  In step # 04, position data, captured image data, link data, and title are stored, and the electronic album is associated with the selected music as described above in the hard disk HD. It is memorized.

  The storage process in step # 300 can be shown as in the flowchart of FIG. That is, a title is stored in a disc-shaped medium Md such as a DVD-R as a storage medium, a plurality of position data (can be understood as route data), map data corresponding to the route data, and photographed image data. Then, link data and music data are stored, and a reproduction program is stored (steps # 301 to # 303).

  When the processing menu 30 is displayed on the display C and the reproduction button 32 is operated in the reproduction mode after the series of processes is completed as described above, a reproduction screen 50 is displayed as shown in FIG. The process shown in the flowchart of FIG. 14 is executed. That is, when the process is started, the title is displayed on the display C, the music is played, the map data is displayed on the display C, the position data is updated along the time axis at the set intervals, and the route is updated. On 110, vehicle symbol 111 is displayed at a position corresponding to the updated position data (steps # 401 to # 403). Thus, by displaying the vehicle symbol 111 at a position corresponding to the position data updated at the set interval, the vehicle symbol 111 is displayed in a form (simulation form) that moves along the route 110. Become.

  Next, the presence or absence of the associated position data is determined by comparing the position data and the link data. If there is matching link data, the captured image data associated with the position data is displayed in the display area. 51 is executed (steps # 404 to # 406). When displaying captured image data in this way, there are many cases where a plurality of captured image data is captured at the same capturing point. In such a case, all of the captured image data associated with the position data is displayed. Until the display is completed, a process for stopping the update of the position data is performed. The present invention assumes that a symbol indicating the shooting point P is displayed on the route 110 in a dot shape. However, this symbol is not displayed, or the captured image data is displayed on the route 110 in the thumbnail format. It is also conceivable to set the processing mode to display.

  In addition, on this playback screen 50, a control button 52 that realizes control for executing playback, fast forward, and the like is displayed, and an indicator 53 that displays the playback status on the timeline is displayed. For example, fast forward, rewind, and indicator are displayed. When the position data is changed by the operation of 53, the process of setting the changed position data and displaying the photographed image data as described above is continuously performed until this process ends (#). 407, # 408, # 409 steps). The reproduction screen 50 is provided with a counter 54 for displaying the total number of photographed image data and the current display number.

  When the processing menu 30 is displayed on the display C and the playback button 33 is operated in the actual running mode, the playback screen 60 is displayed as shown in FIG. 8, and the flowchart of FIG. Execute the process. That is, the map data corresponding to the position data acquired by the position acquisition means L is displayed on the display C, and at the same time, a normal navigation process is executed in which the vehicle symbol 111 is displayed at the position corresponding to the position data (step # 501). ), The position data acquired by the position acquisition means L during the navigation is compared with the link data, and when there is matching or close link data, the captured image data associated with the link data is displayed in the display area. The process is continuously performed until the process of displaying on 61 is completed (steps # 502 to # 505). Even in such processing, it is assumed that the symbol indicating the shooting point P is displayed on the route 110 in a dot shape. However, this symbol is not displayed or the thumbnail 110 is captured on the route 110. It is also conceivable to set the processing mode so as to display image data.

  In addition, when an electronic album is created by storing data on a DVD-R, when the playback program is executed with the DVD-R set in a personal computer, the playback is exactly the same as in the playback mode described above. A screen 50 is displayed on the display of the personal computer. That is, the vehicle symbol 111 is displayed in the form of moving along the route 110 by updating the position data at the set interval. If there is link data in which the position data and the link data match, the captured image data associated with the position data is displayed in the display area 51. When displaying captured image data in this way, there are many cases where a plurality of captured image data is captured at the same capturing point. In such a case, all of the captured image data associated with the position data is displayed. Until the display is completed, a process for stopping the update of the position data is performed.

  In addition, on this playback screen 50, a control button 52 that realizes control for executing playback, fast forward, and the like is displayed, and an indicator 53 that displays the playback status on the timeline is displayed. For example, fast forward, rewind, and indicator are displayed. When the position data is changed by the operation of 53, the position data after the change is set, and the process of displaying the photographed image data is continuously performed as described above, and the number of the photographed image data displayed Can be grasped by the counter 54.

  As described above, according to the present invention, when the captured image data captured by the digital camera 105 is stored in association with the position data acquired by the car navigation system or the like, the timing data acquired from the position data For example, the position data and the captured image data can be obtained by simply acquiring the shooting date / time data from the Exif data attached to the captured image data, and setting the processing mode so as to associate the timing data and the shooting date / time data via the link data. It is possible to associate a plurality of captured image data with a plurality of position data in a lump without taking time as in the case of associating in a form of displaying and editing on the screen. It will be a thing. In particular, the image data captured by a general digital camera 105 usually includes Exif data. When the position acquisition means L is of the GPS type, time data is acquired when the position is acquired. Because it is necessary, it is easy to store this position data in the form of accompanying timing data, and it is relatively easy to compare each time data and associate the matching or approximated data with each other. The association process can be performed simply by performing the process.

  Further, it is assumed that a relatively large error is included between the time indicated by the clock built in the digital camera 105 and the actual time, but the captured image data captured by the digital camera 105 Since the shooting date / time data extracted from the Exif data includes an error equal to the shooting date / time of all the shot image data, when the error of the shooting date / time data of the shooting image data to be associated with one position data is corrected, the error is detected. By shifting the shooting date / time data of all the other shot image data shot by the digital camera 105 for a time equal to, the shooting date / time of all the shot image data can be made appropriate and highly accurate association is possible It becomes.

[Second Embodiment]
In addition to the above-described embodiment, the present invention may be configured as follows (in the second embodiment, the same function and number as those of the above embodiment are used for those having the same functions as those of the above embodiment). Attached).

  As shown in FIG. 16, in a sightseeing bus provided with a large number of seats 81 in the vehicle body 80, a display E comprising a liquid crystal display unit 82 and a touch panel unit 83 as shown in FIG. In addition, an input terminal F (an example of an image data acquisition unit) including the semiconductor drive 84 is arranged, and a processing device D is provided via a communication path 85 so that data can be accessed to each input terminal F. The processing device D receives position data from position acquisition means L that acquires position data in real time by receiving a signal from a GPS satellite, displays information on a display C that displays processing information, and a disk drive. 9 is controlled. It is assumed that the operation is performed by a specific person such as a passenger through the display C provided in the processing device D.

  In the input terminal F, when the semiconductor medium Ms storing the photographed image data photographed by the digital camera is set in the semiconductor drive 84, the same as described in the flowchart of FIG. 11 in the first embodiment. The display E is requested to select what should be stored with the selection screen displayed, and the captured image data selected by the operator (passenger) is transmitted to the processing device D via the communication path 85 and stored. A processing form is set. Further, in the processing device D, when storing the captured image data, the terminal F is identified, information on the manufacturer name and model of the digital camera included in the Exif data of the captured image data, and the captured image data file The digital camera is specified from the file number attached to the, and the captured image data captured by the digital camera is stored for each group in an identifiable format.

  When the captured image data is stored in this way, the timing data indicating the timing at which the position data is acquired and the captured date / time data included in the Exif data match each other, and the approximated data are associated with each other by link data. Processing is performed. Also in this second mode, the processing mode is set so that the operator corrects the shooting date and time, and the tour operator or the like checks the contents of the shot image data to correct the shooting date and time for each group. Also good.

  The configuration of the processing device D is not fundamentally different from the configuration described in the above embodiment, but the basic processing mode when creating an electronic album is also shown in the flowchart of FIG. 13 in the first embodiment. It is not different from the processing shown. In addition, this system assumes a process of storing data in a storage medium such as a DVD-R to create and store an electronic album and handing the storage medium to each passenger when the trip is completed. In the second embodiment, the storage medium storing the electronic album created in this way is set in a personal computer, and the playback program playback mode is slightly different from the previous embodiment.

  That is, as shown in the flowchart of FIG. 18, when the process is started, the playback screen 50 shown in FIG. 7 is displayed on the display, the title is displayed on this screen, music is played, and the selection screen is displayed on the display. Then, a part of the photographed image data photographed for each digital camera is displayed on this screen to obtain a selection (Steps # 601 and # 602). The process for obtaining the selection is for selecting a process for displaying only a group of photographed image data photographed by the user and a process for displaying all photographed image data (all groups).

  After the group is set in this way, the map data is displayed on the display, the position data is updated at the set interval, and the vehicle symbol 11 is displayed on the route 110 at a position corresponding to the updated position data. (Steps # 603 and # 604). Thus, by displaying the vehicle symbol 111 at a position corresponding to the position data updated at the set interval, the vehicle symbol 111 is displayed in a form that moves along the route 110.

  Next, the presence or absence of the associated position data is determined by comparing the position data and the link data. If there is matching link data, the captured image data associated with the position data is displayed in the display area. 51 is executed (steps # 605 to # 607). When displaying captured image data in this way, there are many cases where a plurality of captured image data is captured at the same capturing point. In such a case, all of the captured image data associated with the position data is displayed. Until the display is completed, a process for stopping the update of the position data is performed. The present invention assumes that a symbol indicating the shooting point P is displayed on the route 110 in a dot shape. However, this symbol is not displayed, or the captured image data is displayed on the route 110 in the thumbnail format. It is also conceivable to set the processing mode to display.

  In addition, on this playback screen 50, a control button 52 that realizes control for executing playback, fast forward, and the like is displayed, and an indicator 53 that displays the playback status on the timeline is displayed. For example, fast forward, rewind, and indicator are displayed. When the position data is changed by the operation of 53, the process of setting the changed position data and displaying the photographed image data as described above is continuously performed until this process ends (#). 608, # 609, # 610 steps). The reproduction screen 50 is provided with a counter 54 for displaying the total number of photographed image data and the current display number.

  As described above, in another embodiment, when a large number of passengers take a landscape or a snapshot using the digital camera 105 at the same sightseeing spot, such as when traveling on a sightseeing bus, different digital cameras are used. It is possible to automatically store the image data taken at the same time in association with the same shooting point (position data) even if it was taken at the same time. By storing the image data in a storage medium such as a DVD-R and handing it to each passenger, the passenger can watch the electronic album by setting it on a personal computer at home. It is also possible to view the photographed image data or to view only the photographed image data photographed by a specific person.

[Another embodiment]
The present invention may be configured as follows in addition to the embodiment described above.

(A) When a shooting point P that has been visited once is visited again and a picture is taken with the digital camera 105, the shot image data is stored in a form to be added to the already set shooting point, It is also possible to set the processing mode so as to store the captured image data at the time of previous visit to the shooting point P on the route when visited again. When such processing is performed, the processing mode when the link processing unit 15 performs association may be changed, and when the captured image data is reproduced, the past captured image data, the subsequent captured image data, Can be displayed and viewed in a combined form.

(B) When the captured image data is displayed on the display C, a display form with the map data as the background has been adopted. Instead, the captured image data is displayed on the entire screen of the display C, and this captured image is displayed. It is also possible to set the display form so that the map data is displayed in a part of the image data.

(C) Map data when playing an electronic album is not limited to map data that includes details of the region, or maps or maps such as illustrations or sightseeing maps. It may be a simple one indicating the route traveled by. In addition, when adopting a data structure that simply shows the route data for only the road corresponding to the route as the map data, this route does not need to completely match the shape of the trajectory actually traveled by the vehicle. As long as the route on which the vehicle has traveled can be determined. In particular, even when the image data is associated with the position data constituting the route, it is not necessary to strictly associate the shooting point with the position data.

The figure which shows the structure of the navigation system of 1st Embodiment. The figure which shows the navigation system with which the passenger car of 1st Embodiment was equipped. Block circuit diagram of the navigation system of the first embodiment The figure which shows the process menu of 1st Embodiment. The figure which shows the selection screen of 1st Embodiment The figure which shows the display content at the time of correcting date data based on an imaging | photography point and an original imaging | photography point in the confirmation screen of 1st Embodiment The figure which shows the reproduction | regeneration screen in the reproduction mode of 1st Embodiment. The figure which shows the reproduction | regeneration screen in the actual driving mode of 1st Embodiment. The figure which shows the structure of Exif data of 1st Embodiment The flowchart showing the process at the time of electronic album creation of a 1st embodiment Flowchart of image data acquisition routine of the first embodiment Flowchart of link data generation routine of the first embodiment Flowchart of the storage processing routine of the first embodiment The flowchart showing the reproduction process in the reproduction mode of the first embodiment The flowchart showing the reproduction process in the actual travel mode of the first embodiment. The block diagram which shows the structure of 2nd Embodiment. The perspective view which shows the input terminal of 2nd Embodiment The flowchart showing the reproduction process in the reproduction mode of the second embodiment

Explanation of symbols

5 Image Data Acquisition Unit 15 Link Processing Unit 16 Output Control Unit 105 Digital Camera C Output Unit, Display E Output Unit, Medium Drive D Processing Device L Position Acquisition Unit

Claims (6)

An image processing system including a processing device that associates position data acquired by a position acquisition unit with captured image data acquired by an image data acquisition unit,
An image data storage unit that stores map image data indicating an existing position of the position data, and a display that displays an image as an output unit that outputs the captured image data.
The position acquisition means is configured to acquire the position data as the vehicle travels, and to acquire timing data for specifying a date and time when the position data is acquired;
The processing device uses the position data as a shooting point so that the shooting date and time data associated with the shot image data correspond to the timing data, and associates the position data and the shot image data with link data. A link processing unit and an output control unit;
The output control means displays the map image data on the display, displays a route on which the vehicle has traveled on the map image data, and sequentially designates a plurality of timing data dates and times along a time axis. , updated by extracting the position data corresponding to the designated timing data, the output control means displays in a form vehicle symbol is traveling on the route based on the updated the location data, the update An image processing system for displaying, on the display, captured image data associated with the position data thus obtained by link data. The processing apparatus includes route storage means for storing a plurality of position data acquired by the position acquisition means as a route,
The output control means displays the route stored in the route storage means for the map image data displayed on the display, and displays a vehicle symbol at a position corresponding to the position data updated on the route. And displaying the captured image data associated with the updated position data by the link data, and displaying the image data associated with the link data among the position data on the route. 1. The image processing system according to 1. The confirmation screen is displayed on the display, the map image data is displayed on the confirmation screen, the photographing point associated with the link data among the position data, and the photographing image data associated with the photographing point by the link data. And
When the operator determines that the shooting point and the shooting position of the shot image data are offset, the operator displays the original shooting point on the confirmation screen by shifting the shooting date and time, and the operator's confirmation operation The image processing system according to claim 1 or 2, wherein shooting date / time data of the plurality of shooting image data acquired by the image data acquisition unit is corrected by the shift time.   The said position acquisition means is comprised by the GPS unit which comprises a car navigation system, and the said map image data is comprised by the map data used for this car navigation system. Image processing system.   The image data acquisition means is composed of a plurality of semiconductor drives for acquiring photographed image data from a semiconductor-type storage medium used in a digital camera, and the plurality of semiconductor drives are located in the vicinity of a plurality of seats of a vehicle. The image processing system according to any one of claims 1 to 4, wherein the image processing system is disposed on the screen. An image processing method for associating position data acquired by a position acquisition unit with captured image data acquired by an image data acquisition unit by a processing device,
Storing map image data indicating the location of the position data in an image data storage unit;
The position acquisition means acquires the position data as the vehicle travels, acquires timing data specifying the date and time when the position data was acquired,
The processing device associates the position data with the photographed image data by link data , using the position data as a photographing point so that the photographing date / time data accompanying the photographed image data corresponds to the timing data. While performing the link process,
The processing device displays the map image data on the display, displays a route on which the vehicle has traveled on the map image data, and sequentially designates a plurality of timing data dates and times along a time axis, updates to extract position data corresponding to the specified timing data, updated by said display in a form vehicle symbol is traveling on the route, based on the position data, linked to this updated the position data An image processing method for performing output processing for displaying captured image data associated with data on the display.

Images