JP2009174970A - Image output device, data generating device, navigation system, and data structure of point data - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To mutually link a plurality of picked up images. <P>SOLUTION: A navigation device includes: an EEPROM for storing point data by associating with an image, the point data containing an image, the position and direction on a map, a storage position showing the position storing the stored image, and a replay position, showing, in the case of a dynamic image, the position in the dynamic image; position acquisition parts (S21, S24) for accepting the position on the map; direction acquisition parts (S22, S27) for accepting the direction on the map; and output control part (S23, S37, S39, S41) for extracting point data containing a position on the map within a predetermined range from the acquired position on the map and the acquired direction from the stored point data, reading out and outputting the image specified by the storage position contained in the point data extracted from images stored in the EEPROM. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image output device, a data generation device, a navigation system, and a data structure of point data, and in particular, an image output device that outputs one of a plurality of captured images, and a plurality of captured images. The present invention relates to a data generation device that generates point data capable of selecting one from the above, a navigation system including them, and a data structure of point data.

  In recent years, some navigation devices mounted on vehicles have a route search function for searching for a route from a current location to a destination and displaying the route superimposed on a map. However, the driver cannot know the scenery that he / she actually sees by simply displaying the route on the map. If you have traveled in the past and remember the scenery of the location on the map, you can think of the scenery with your head, but you can't remember the scenery with inexperienced routes.

  In Japanese Patent Laid-Open No. 10-115529 (Patent Document 1), road map data including data of nodes representing road inflection points or intersections and links as directional vectors connecting the nodes is prepared in advance. A vehicle that reads from the road map storage means, creates road data along the optimum route based on the read road map data, and travels using three-dimensional computer graphics technology based on the road data An in-vehicle navigation device comprising a road moving image creating means for creating a moving image of a road viewed from the above and a display means for displaying a moving image created by the road moving image creating means is described. Yes.

  However, in the conventional in-vehicle navigation device, since the moving image of the road viewed from the vehicle traveling using the three-dimensional computer graphics technology is displayed, an image different from the scenery actually seen by the driver is displayed. Is done. For this reason, there is a problem that the driver is required to work to match the displayed image with the actual scenery.

It is possible to display an image close to reality by recording an image actually captured by the camera while the vehicle is running and displaying the image. However, since the captured image does not include position information, the image cannot be displayed in accordance with the position at which the image is displayed. For this reason, there is a problem that it is difficult to select an image to be displayed next from among a plurality of images obtained by fragmentary imaging and to display the image continuously.
JP-A-10-115529

  The present invention has been made to solve the above-described problems, and one object of the present invention is to provide an image output apparatus and a navigation system capable of linking a plurality of captured images to each other. That is.

  Another object of the present invention is to provide a data generation apparatus capable of generating data for linking a captured image with another image.

  Still another object of the present invention is to provide a data structure of point data capable of linking a plurality of captured images.

  In order to achieve the above object, according to one aspect of the present invention, an image output device indicates image storage means for storing an image, a position and orientation on a map, and a position at which the stored image is stored. Point data storage means for storing point data including a storage position and a reproduction position indicating a position in the moving image when the image is a moving image in association with the stored image, and a position on the map The position acquisition means, the direction acquisition means for acquiring the direction on the map, and the position on the map within a predetermined range from the position on the map acquired from the stored point data, and acquired A point data extraction unit that extracts point data including a direction and an image specified by a storage position included in the point data extracted from the images stored in the image storage unit are read. And, and an output means for outputting.

  According to this aspect, when the position and orientation on the map are acquired, the point data including the position on the map within the predetermined range from the position on the map is extracted from the point data. Then, an image specified by the storage position included in the point data extracted from the stored images is read and output. For this reason, an image captured at the same position and orientation as the position and orientation on the map can be displayed. Further, as the position and orientation on the map change, the image specified by the position and orientation is extracted sequentially from the plurality of images, so that the image can be output continuously. As a result, an image output device capable of linking a plurality of images to each other can be provided.

  Preferably, a map storage unit that stores a road map is further provided, and the point data extraction unit extracts new point data when the direction acquired by the direction acquisition unit changes while the output unit outputs an image. The output means reads an image specified by the storage position included in the point data newly extracted by the point extraction means from the image storage means and outputs the image.

  According to this aspect, when the azimuth changes while outputting the image, new point data is extracted, and the image specified by the storage position included in the newly extracted point data is read and output. The For example, when the azimuth changes at an intersection, an image taken in the changed azimuth is output. For this reason, since the image output until then is linked to the image to be output next in accordance with the change in direction, it is possible to link the two images so that the output image is not interrupted. . Further, if the point data includes a storage position indicating the position of the intersection, new point data can be easily extracted.

  Preferably, the point data extraction unit includes a position on the map within a predetermined range from a position on the map newly acquired by the position acquisition unit, and includes a direction newly acquired by the direction acquisition unit. New point data is extracted from the stored point data, and the output means is included in the newly extracted point data when new point data is extracted by the point data extraction means while outputting the image. An image specified by the storage position is read from the image storage means and output.

  According to this aspect, new point data including the position on the map within a predetermined range from the position on the newly acquired map and including the newly acquired direction is extracted from the point data. In this case, an image specified by the storage position included in the newly extracted point data is read and output. Since the output image and the image specified by the new point data existing after the position change are linked, the two images can be linked so that the output image is not interrupted.

  Preferably, the apparatus includes an operation receiving unit that receives a user operation, the point data extracting unit extracts new point data when a predetermined operation is received by the operation receiving unit, and the output unit is operated by the point extracting unit. A moving image or a still image specified by the storage position included in the newly extracted point data is read from the image storage means and output.

  According to this aspect, when a predetermined operation is accepted, new point data is extracted, and an image specified by the storage position included in the newly extracted point data is read and output. Since an image to be output next is specified by a user operation, two images can be linked at an arbitrary timing.

  Preferably, when the moving image is stored in the storage position included in the extracted point data, the output unit reads out the moving image and reproduces it from the reproduction position included in the extracted point data; Display means for reading and displaying the still image when the still image is stored at the storage position included in the extracted point data.

  According to this aspect, when a moving image is stored in the storage position included in the extracted point data, the moving image is reproduced from the reproduction position included in the extracted point data. For this reason, since the moving image is reproduced by matching the position where the moving image was captured with the acquired position, the moving image captured at the acquired position can be output.

  Preferably, the point data extraction unit extracts new point data when the moving image reproduced by the reproduction unit is completed, and the output unit stores the memory included in the point data newly extracted by the point extraction unit. An image specified by the position is read from the image storage means and output.

  According to this aspect, when the reproduced moving image ends, new point data is extracted, and an image specified by the storage position included in the newly extracted point data is read and output. . For this reason, since the image shot at the position after the reproduced moving image ends is output, the output image and the next output image are output so that the output image is not interrupted. Can be linked.

  Preferably, the apparatus further includes position detection means for detecting a current position on the map, and the position acquisition means acquires the detected position.

  According to this aspect, since the current position on the map is detected and acquired, an image can be output in synchronization with a change in the actual position.

  Preferably, the map storage means for storing the road map, the route reception means for receiving the first position and the second position on the road map, and the route from the received first position to the second position Search means for searching, and the position acquisition means acquires a position on the searched route.

  According to this aspect, a route from the first position to the second position is searched, and a position on the searched route is accepted, so that an image can be output in synchronization with a virtual position change. it can.

  According to another aspect of the present invention, a data generation device is a data generation device mounted on a vehicle, and includes a map storage unit that stores a road map, an imaging unit that captures an image, and a captured image. An image storage means for storing, a position acquisition means for acquiring the current position on the map, an orientation acquisition means for acquiring the direction in which the vehicle travels, and a timing determination means for determining the timing for generating point data The position and orientation on the map respectively acquired by the position acquisition means and the orientation acquisition means according to the determined timing, the storage position where the image captured by the imaging means is stored, and the moving image if the image is a moving image Point data generation means for generating point data including a reproduction position indicating a position in the image, and point data storage for storing the generated point data The timing determining means, when imaging by the imaging means is started, when the position acquired by the position acquisition means is indicated as an intersection in the stored road map, and when the detected orientation has changed And at least one selected from when the predetermined time has elapsed is determined as the timing for generating the point data.

  According to this aspect, at least selected from when imaging is started, when the acquired position is shown as an intersection on the road map, when the acquired orientation is changed, and when a predetermined time has elapsed One is point data including a position and orientation on the acquired map, a storage position where the captured image is stored, and a reproduction position indicating a position in the moving image when the image is a moving image. Generated and stored. The point data includes the position and orientation on the map at the time when the image was captured, the storage position where the captured image is stored, and the playback position indicating the position in the moving image if the image is a moving image. Therefore, the image captured and stored from the position and orientation on the map can be linked to another image. As a result, it is possible to provide a data generation device capable of generating data for linking a captured image with another image.

  According to still another aspect of the present invention, the data structure of the point data includes a position on the map, an orientation, a storage position indicating a position where an image captured at the position and orientation on the map is stored, and a storage When the image stored at the position specified by the position is a moving image, it includes a reproduction position corresponding to the position on the map in the moving image.

  According to this aspect, since the point data includes a position on the map, an azimuth, and a storage position indicating a position where an image captured at the position and azimuth on the map is stored, the point data is captured from the point data. An image captured at a position and orientation on the map can be specified from among a plurality of images. In addition, when the read image is a moving image, the point data includes a reproduction position corresponding to the position on the map in the moving image, so that the position of the moving image captured at the position on the map is specified. Can do. As a result, it is possible to provide a data structure of point data that can link a plurality of captured images.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a diagram showing an overall outline of a navigation system in the present embodiment. Referring to FIG. 1, navigation system 1 includes a plurality of navigation devices 10, 10 </ b> A, 10 </ b> B and a server 200. The server 200 is a general computer and is connected to the Internet 100.

  Each of the navigation devices 10, 10A, 10B can wirelessly communicate with any of the access points 101, 101A, 101B connected to the Internet 100, and wirelessly communicate with any of the access points 101, 101A, 101B. 100 can be connected. Therefore, each of the navigation devices 10, 10 </ b> A, and 10 </ b> B can communicate with the server 200.

  Each of the navigation devices 10, 10A, 10B functions as a data generation device and an image output device. Further, since the navigation devices 10, 10A, and 10B have the same configuration and function, the navigation device 10 will be described here.

  FIG. 2 is a block diagram illustrating an example of a hardware configuration of the navigation device. Referring to FIG. 2, the navigation device 10 includes a central processing unit (CPU) 11 for controlling the entire navigation device 10, a GPS receiver 13, a direction sensor 14, a radio circuit 15, and a memory interface ( I / F) 17, serial communication I / F 19, ROM (Read Only Memory) 21 for storing programs executed by the CPU 11, RAM (Random Access Memory) 23 used as a work area of the CPU 11, EEPROM 25, A liquid crystal display (LCD) 27, a touch screen 29, operation keys 31, an audio codec 33, an amplifier 35 connected to the audio codec 33, a speaker 37 connected to the amplifier 35, and a video decoder 39. , Including camera 41

  The GPS receiver 13 receives radio waves transmitted from GPS satellites in the global positioning system (GPS), and measures the current position on the map. Then, the measured position is output to the CPU 11. The CPU 11 reads the map data stored in the EEPROM 25 and displays an image on the LCD 27 where the current position input from the GPS receiver 13 is recorded on the map.

  The direction sensor 14 detects the direction in which the vehicle on which the navigation device 10 is mounted faces in the traveling direction, and outputs the detected direction to the CPU 11.

  The radio circuit 15 is controlled by the CPU 11 and is connected to a network of a communication system of WiMAX (Worldwide Interoperability for Microwave Access). The WiMAX communication method is also called Wireless MAN (Wireless Metropolitan Area Network), and is a standard that provides high-speed wireless communication for an urban area called IEEE 802.16. Specifically, the wireless circuit 15 wirelessly communicates with any of the access points 101, 101A, and 101B connected to the WiMAX network. A radio signal transmitted from any of the access points 101, 101A, 101B is received by the antenna. The radio circuit 15 receives a radio signal received by the antenna and outputs a signal obtained by demodulating the radio signal to the CPU 11. When the transmission signal is input from the CPU 11, the wireless circuit 15 outputs a wireless signal obtained by modulating the transmission signal to the antenna. A radio signal transmitted from the antenna is received by any of the access points 101, 101A, and 101B. For this reason, the CPU 11 can communicate with the server 200 via the wireless circuit 15.

  Here, an example is shown in which the wireless circuit 15 is connected to a WiMAX network. However, the wireless circuit 15 is not limited to a WiMAX network as long as it is a wireless LAN. For example, BLUETOOTH (registered trademark), WiFi (registered trademark) Or the like.

  The LCD 27 is controlled by the CPU 11 and displays an image. Instead of the LCD 27, an organic EL (Electro Luminescence) display or the like may be used.

  The touch screen 29 is made of a transparent member and is provided on the display surface of the LCD 27. The touch screen 29 detects the position on the display surface of the LCD 27 designated by the user with a finger or the like, and outputs it to the CPU 11. The CPU 11 displays various buttons on the LCD 27 and receives various operation instructions in combination with the instructed position detected by the touch screen. The operation screen displayed on the LCD 27 by the CPU 11 includes an operation screen for operating the navigation device 10.

  The video decoder 39 includes a decoding circuit that converts input digital data into an analog video signal. The video decoder 39, which is controlled by the CPU 11 and receives video data compressed and encoded, converts it into an analog video signal and outputs it to the LCD 27.

  The audio codec 33 includes a circuit that converts analog audio signals into digital data and a circuit that converts digital data into analog audio signals, and processes the audio data. When the compression-coded digital data is input, the audio codec 33 converts the digital data into an analog audio signal and outputs the analog audio signal to the amplifier 35. The amplifier 35 amplifies the audio signal input from the audio codec 33 and outputs it to the speaker 37. Thereby, a sound is output from the speaker 37.

  The camera 41 includes a lens and a photoelectric conversion element such as a CMOS (Complementary Metal Oxide Semiconductor) sensor. The light focused by the lens is imaged on the CMOS sensor, and the CMOS sensor photoelectrically converts the received light to convert the image to the CPU 11. Output to. The camera 41 is controlled by the CPU 11, starts imaging in response to an instruction from the CPU 11, and outputs an obtained image to the CPU 11. The image includes a still image or a moving image. The camera 41 includes an image processing circuit that performs image processing for improving image quality, and an A / D conversion circuit that converts an image from analog to digital. The CPU 11 displays the still image or moving image output from the camera 41 on the LCD 16 or encodes the still image or moving image by the compression encoding method, and stores the image on the memory card 17A mounted on the EEPROM 25 or the memory I / F 17. Remember.

  When the navigation apparatus 10 is mounted on a vehicle, the camera 41 is preferably installed so that the field of view seen by the driver is within the imaging range. Thereby, the camera 41 can image the same scenery as the driver sees, and an image obtained by imaging is recorded in the EEPROM 25 or the memory card 17A mounted on the memory I / F 17.

  A removable memory card 17A is mounted on the memory I / F 17. When the video data compressed and encoded in accordance with a standard such as MPEG (Moving Picture Experts Group) is stored in the memory card 17A, the CPU 11 reads the video data and outputs it to the video decoder 39 and the audio codec 33. To do.

  FIG. 3 is a block diagram illustrating an example of the hardware configuration of the server. Referring to FIG. 3, server 200 includes a CPU 201 for controlling the entire server 200, a ROM 202 for storing a program executed by CPU 201, a RAM 203 used as a work area for CPU 201, and server 200. A network I / F 204 for connecting to the Internet 100, an HDD 205 as a large-capacity storage device, a display unit 206, and an operation unit 207 that receives an input of a user operation are included.

  The navigation device 10 in the present embodiment functions as a data generation device or an image playback device. When the navigation device 10 functions as a data generation device, the navigation device 10 is mounted on a vehicle, and the CPU 11 executes a data generation program stored in the ROM 21. When the navigation device 10 functions as an image playback device, the CPU 11 executes an image playback program stored in the ROM 21. Therefore, the navigation apparatus 10 functions as a data generation apparatus or an image reproduction apparatus by switching the program to be executed.

  FIG. 4 is a functional block diagram showing an example of functions of the CPU included in the navigation device functioning as a data generation device, together with data stored in the EEPROM 25. With reference to FIG. 4, the CPU 11 receives an image, receives an image 51, stores an image in the EEPROM 25, stores an image 53, acquires an azimuth acquisition unit 55, and acquires a position on the map. Unit 59, timing determination unit 61 that determines the timing for generating point data based on the azimuth and position, point data generation unit 57 that generates point data at the determined timing, and for accepting user operations An operation receiving unit 71.

  The image receiving unit 51 controls the camera 41 and receives an image captured and output by the camera 41. The image output by the camera 41 includes a still image and a moving image. Further, the image receiving unit 51 reads the image stored in the memory card 17A via the memory I / F 17. The image reception unit 51 outputs an image received from the camera 41 or the memory I / F 17 to the image storage unit 53 and outputs a signal indicating that the image has been received to the timing determination unit 61.

  The image storage unit 53 stores the image received from the image reception unit 51 in the EEPROM 25 and outputs a storage position indicating the position in the EEPROM 25 of the image stored in the EEPROM 25 to the point data generation unit 57. The storage location includes, for example, an image file name. Further, when accepting a moving image, the image storage unit 53 uses a request from the point data generation unit 57 to display a reproduction position indicating a position in the moving image accepted from the image accepting unit 51 when the request is accepted, as point data. The data is output to the generation unit 57.

  The bearing acquisition unit 55 receives the bearing of the vehicle output by the bearing sensor 14. The direction acquisition unit 55 outputs the received direction to the point data generation unit 57 and the timing determination unit 61. The position acquisition unit 59 receives the current position on the map output by the GPS receiver 13. The position acquisition unit 59 outputs the received position to the point data generation unit 57 and the timing determination unit 61. When the navigation device 10 does not include the azimuth sensor 14, the azimuth may be detected from two positions output by the position acquisition unit 59 at different times.

  The timing determination unit 61 determines the timing at which the point data generation unit 57 generates point data. Specifically, (1) when an image is captured by the camera 41, (2) when the vehicle is located at an intersection, (3) when the traveling direction of the vehicle changes, (4) when a predetermined time elapses Is determined at the timing of generating the point data. The timing determination unit 61 outputs a generation instruction to the point data generation unit 57 when the image reception unit 51 receives an image from the camera 41. When the position input from the position acquisition unit 59 indicates an intersection in the map data stored in the EEPROM 25, the timing determination unit 61 outputs a generation instruction to the point data generation unit 57. Further, the timing determination unit 61 outputs a generation instruction to the point data generation unit 57 when the direction input from the direction acquisition unit 55 changes from the previously input direction. The azimuth change may be any change as long as the vehicle bends the intersection, for example, about 30 degrees. Further, the timing determination unit 61 outputs a generation instruction to the point data generation unit 57 at predetermined time intervals.

  Here, the timing at which the point data generation unit 57 generates the point data is the time of (1) to (4), but may be at least one timing selected from these timings. As the number of point data increases, the number of point data extracted by the point data extraction unit 77 to be described later increases. When the point data extraction unit 77 extracts point data at the intersection, the timing at which the point data generation unit 57 generates the point data is (2) when the vehicle is located at the intersection, and (3) the vehicle. It is preferable to include at least the time when the traveling direction changes. This is because the azimuth and position at the extraction timing coincide with the azimuth and position where the point data is generated, so that reproduction becomes easy.

  The operation receiving unit 71 receives image attributes input by the user to the touch screen 29 or the operation keys 31 when an image is captured by the camera 41. The attribute includes, for example, the genre to which the image belongs. The genre includes, for example, navigation, advertisement, and tourism. An image whose genre is navigation is an image captured by the camera 41 for navigation. The advertisement image and the tourist image are images stored in the memory card 17A. For example, an image produced for an advertisement of a store or an accommodation facility located around the location, or a scenic spot located around the location. This image was created to introduce The operation accepting unit 71 accepts a genre that the user inputs to the touch screen 29 or the operation key 31 every time the image accepting unit 51 accepts an image from the camera 41 or the memory card 17A. Output.

  When the generation instruction is input from the timing determination unit 61, the point data generation unit 57 generates point data and stores it in the EEPROM 25. As a result, the point data 303 is stored in the EEPROM 25. The point data includes the storage position input from the image storage unit 53, the position input from the position acquisition unit 59, the direction input from the direction acquisition unit 55, the time at that time, and a moving image or a still image. And a category indicating. In addition, when the image storage unit 53 stores a moving image, the point data generation unit 57 requests a reproduction position from the image storage unit 53, and determines the position in the moving image that the image storage unit 53 receives from the image reception unit 51. Point data further including the reproduction position shown is generated and stored in the EEPROM 25.

  When the reception of the image by the image reception unit 51 is completed, the transmission unit 63 transmits the image 301 newly stored in the EEPROM 25 and the newly stored point data 303 to the server 200 via the wireless circuit 15. As a result, the image 301 and the point data 303 stored in the navigation device 10 are stored in the HDD 205 provided in the server 200.

  When the image 301 and the point data 303 are transmitted from the navigation devices 10A and 10B different from the navigation device 10, the server 200 stores them in the HDD 205.

  FIG. 5 is a diagram illustrating an example of a format of point data. Referring to FIG. 5, point data 303 includes a point name item, a storage position item, a reproduction position item, a map position item, a direction item, a road name item, and an intersection name. Items and attribute items. In the item of point name, identification information for identifying the point data 303 is set. In the storage position item, a position where the image 301 corresponding to the point data 303 is stored in the EEPROM 25 is set. Here, the item of the storage position is a file name attached to the image. It may be a URL (Uniform Resource Locator).

  The item of the reproduction position is set when the image 301 is a moving image, and the position in the moving image recorded when the point data is generated among the moving images is set. The playback position may be, for example, a time after starting playback of a moving image, or may be an address of a moving image.

  In the item on the map position, the position on the map at the time point data is generated is set. In the direction item, the direction in which the vehicle faces when the point data is generated is set. In the item of road name, the name of the road indicated by the map data at the position on the map when the point data is generated is set. In the item of intersection name, the name of the intersection indicated by the map data at the position on the map when the point data is generated is set.

  The attribute item is an attribute of an image corresponding to the point data, and includes a time item, a category item, a genre item, and a data property URL item. In the time item, the date and time when the image is captured is set. When the corresponding image is a moving image, the date and time when reproduction is started is set. The category item is set to be a moving image or a still image for the corresponding image. The item of genre is set for navigation, advertisement, and sightseeing for the corresponding image. In the data property URL item, a URL assigned to information (property) related to the corresponding image is set.

  FIG. 6 is a diagram illustrating an example of image properties. The properties of the image include a URL or file name (file URL / name) indicating the position in the Internet 100 where the image is stored, a file type (file type), a file size (file size), and a playback time (play time). A resolution, a bit rate, a read count, and a created time. The generation time is the same as the value set for the time of the point data.

  FIG. 7 is a functional block diagram showing an example of functions of a CPU included in a navigation device functioning as an image playback device, together with data stored in the EEPROM. Referring to FIG. 7, the CPU 11 obtains a route between two points on the map, a data acquisition unit 73 that acquires images and point data, an orientation acquisition unit 55, a position acquisition unit 59, an operation reception unit 71. A route search unit 91 for searching, a simulation unit 93 for simulating traveling of the searched route, a point data extraction unit 77 for extracting point data based on the direction and position, and an output control unit for outputting an image 89.

  When the data acquisition unit 73 communicates with the server 200 via the wireless circuit 15, transmits a transmission request to the server 200, and the server 200 transmits the image 301 and the point data 303 stored in the HDD 205 included in the server 200, Receive them from the server 200. The image 301 and the point data 303 received from the server 200 include the image 301 and the point data 303 transmitted to the server 200 by the other navigation devices 10A and 10B. For this reason, the data acquisition unit 73 acquires the image 301 stored by the other navigation device 10 and the generated point data 303 from the server 200. The data acquisition unit 73 adds the image 301 and point data 303 acquired from the server 200 to the EEPROM 25 and stores them.

  The route search unit 91 reads the map data 305 from the EEPROM 25 and displays the map on the LCD 27. Then, the route search unit 91 acquires two map positions that the user inputs to the touch screen 29. The two positions on the map are referred to here as a start position and an end position. The route search unit 91 searches for a route from the start position to the end position with reference to the map data 305. Then, the searched route is output to the simulation unit 93.

  The simulation unit 93 displays the route input from the route search unit 91 in order from the start position to the end position. When the simulation unit 93 sequentially displays the map from the start position to the end position, the simulation unit 93 outputs the position and orientation on the route to be displayed on the map to the point data extraction unit 77.

  The point data extraction unit 77 operates in two operation modes: a reproduction mode during running and a reproduction mode during simulation. The point data extraction unit 77 operates from the point data 303 stored in the EEPROM 25 based on the position output by the position acquisition unit 59 and the direction output by the direction acquisition unit 55 when operating in the playback mode during travel. Extract one. In addition, when operating in the simulation playback mode, the point data extraction unit 77 extracts one of the point data 303 stored in the EEPROM 25 based on the position and orientation output from the simulation unit 93. . The operation of the point data extraction unit 77 differs only in the position and direction to be processed in the reproduction mode during running and the reproduction mode during simulation.

  The point data extraction unit 77 includes a point list generation unit 79, a moving image end extraction unit 81, an instruction reception extraction unit 83, a new point presence extraction unit 85, and an intersection extraction unit 87.

  The point list generation unit 79 sets the position within the first range from the position input from the position acquisition unit 59 or the simulation unit 93 out of the point data 303 stored in the EEPROM 25 as the item on the map. The extracted point data is extracted, and a point list including the extracted point data is generated. The first range may be a predetermined distance range. The timing at which the point list generation unit 79 generates the point list may be a predetermined time interval. The predetermined time may be determined in advance, but in the driving regeneration mode, it is preferable to set the time shorter as the vehicle speed increases.

  The point list generation unit 79 outputs the generated point list to the moving image end extraction unit 81, the instruction reception extraction unit 83, the new point presence extraction unit 85, and the intersection extraction unit 87, respectively. . The video end time extraction unit 81, the instruction reception time extraction unit 83, the new point presence time extraction unit 85, and the intersection time extraction unit 87 receive one point data from the point list instead of the point data 303. Since it only has to be extracted, the amount of data to be searched is reduced and the processing speed can be increased.

  The server 200 has the function of the point list generation unit 79, and the point data extraction unit 77 transmits the position input from the position acquisition unit 59 or the simulation unit 93 to the server 200. May be generated. In this case, the CPU 11 outputs the point list received from the server 200 to the moving image end time extraction unit 81, the instruction reception time extraction unit 83, the new point presence time extraction unit 85, and the intersection time extraction unit 87. .

The moving image end time extraction unit 81, the instruction reception time extraction unit 83, the new point presence time extraction unit 85, and the intersection time extraction unit 87 are each of the positions of the point data included in the point list at predetermined timings. A position within the second range from the position input from the acquisition unit 59 or the simulation unit 93 is set as the item on the map, and the direction input from the direction acquisition unit 55 or the simulation unit 93 Point data whose approximate direction is set in the direction item is extracted, and the extracted point data is output to the output control unit 89. The second range is narrower than the first range. In addition, if the extraction condition is that the same name as the road name indicated by the current position on the map is the point data set in the road name item, the point data can be extracted more accurately. it can. When there are a plurality of pieces of point data to be extracted, the data is narrowed down to one point data in accordance with setting conditions predetermined by the user. An example of user setting conditions predetermined by the user is shown below.
(1) Narrow down to point data in which moving images are set in the category item.
Since the moving image has a larger amount of information than the still image, a large amount of information can be displayed.
(2) Filter by genre item. For example, the data is narrowed down to point data set for advertisement. This is useful when you want to obtain information about nearby facilities.
(3) The time set in the date / time item is narrowed down to point data close to the current time. Since the brightness of the scenery varies depending on the time, it is possible to display the same image as the scenery actually seen as much as possible.
(4) Filter to point data with a high bit rate or resolution item in the image properties. A higher quality image can be displayed.
(5) Narrow down to point data corresponding to the remaining images with long playback times.
The remaining playback time can be obtained by calculating the time from the playback time of the image property and the playback position of the point data to the end of the playback of the image. If the remaining reproduction time is long, it is possible to lengthen the time until the next image switching.

  The moving image end extraction unit 81 receives a position and orientation acquisition unit 55 or a simulation unit 93 input from the position acquisition unit 59 or the simulation unit 93 when an output control unit 89 (to be described later) finishes reproducing the moving image. Based on the input azimuth, one point data is extracted from the point data included in the point list, and the extracted point data is output to the output control unit 89. For this reason, a moving image can be reproduced without interruption.

  Of the point data included in the point list, the position input from the position acquisition unit 59 or the simulation unit 93 when the output control unit 89 finishes playing the moving image is set as the item of the map position. There may be no point data. In this case, from the point data included in the point list, point data in which the azimuth approximated to the azimuth input from the azimuth acquisition unit 55 or the simulation unit 93 is set in the azimuth item is extracted. Point data that can include the position input from the position acquisition unit 59 or the simulation unit 93 as the reproduction position is specified. Then, the distance from the position set in the reproduction position item of the specified point data to the position input from the position acquisition unit 59 or the simulation unit 93 is calculated, and further, the elapsed time is calculated from the calculated distance and the moving speed. Calculate time. The moving speed is calculated from two positions input from the position acquisition unit 59 or the simulation unit 93 at different times. Then, a new reproduction position is calculated based on the reproduction position set in the item of the reproduction position of the specified point data and the image property information. Then, the position set in the map position item of the specified point data is changed to the position input from the position acquisition unit 59 or the simulation unit 93, and the playback position set in the playback position item is changed. Temporary point data is generated by changing to the calculated new reproduction position. The temporary point data may be added to the EEPROM 25 and stored, or may be discarded after the output control unit 89 described later outputs an image.

  The instruction receiving time extraction unit 83 is input from the position and orientation acquisition unit 55 or the simulation unit 93 input from the position acquisition unit 59 or the simulation unit 93 when an operation for instructing switching is input by the user. Based on the azimuth, one point data is extracted from the point data included in the point list, and the extracted point data is output to the output control unit 89. When a predetermined key of the operation keys 31 is pressed by the user, an operation for instructing switching is accepted. For this reason, since the image to be output next is specified by the user's operation, the two images can be linked at an arbitrary timing.

  It should be noted that the position input from the position acquisition unit 59 or the simulation unit 93 is set in the item of the map position when an operation for instructing switching is input from the point data included in the point list. Point data may not exist. In this case, similar to the moving image end extraction unit 81, new point data is generated.

  The new point presence extraction unit 85 sets the position within the second range from the position input from the position acquisition unit 59 or the simulation unit 93 to the item of the map position in the point data included in the point list. And when there is new point data in which the azimuth approximated to the azimuth input from the azimuth acquisition unit 55 or the simulation unit 93 is set in the azimuth item, the new point data is extracted. The extracted new point data is output to the output control unit 89. For this reason, since the image specified by the new point data existing after the position change is determined as the next image to be displayed, the next image can be displayed so that the image is not interrupted.

  The intersection time extraction unit 87 indicates that the position input from the position acquisition unit 59 or the simulation unit 93 indicates an intersection on the map, and then the direction input from the direction acquisition unit 55 or the simulation unit 93 changes. Based on the position input from the position acquisition unit 59 or the simulation unit 93 and the azimuth input from the direction acquisition unit 55 or the simulation unit 93, one point data is selected from the point data included in the point list. The extracted point data is output to the output control unit 89. For this reason, when the azimuth changes at the intersection, an image taken in the changed azimuth is displayed. As a result, since the displayed image is linked to the image to be displayed next in accordance with the orientation change, the two images can be linked so that the output image is not interrupted. In addition, since the point data is sometimes created at the position of the intersection, the point data can be easily extracted.

  When the point data 303 is input from the moving image end time extraction unit 81, the instruction reception time extraction unit 83, the new point presence time extraction unit 85, and the intersection time extraction unit 87 of the point data extraction unit 77, the output control unit 89 receives the point data 303. The image at the storage position set in the storage position item of the point data 303 is read out from the EEPROM 25. If the category item is set as a moving image, it is read out from the playback position set in the playback position item. A moving image is reproduced and displayed on the LCD 27. If the category item is set to a still image, the read still image is displayed on the LCD 27.

  FIG. 8 is a flowchart illustrating an example of the flow of point data generation processing. The point data generation process is a process executed by the CPU 11 when the CPU 11 included in the navigation device functioning as a data generation device executes a point data generation program. When the navigation device 10 functions as a data generation device, the navigation device 10 is mounted on a vehicle. For this reason, the point data generation process is executed while the vehicle is traveling.

  Referring to FIG. 8, CPU 11 determines whether an attribute setting has been accepted (step S01). An image attribute input by the user to the touch screen 29 or the operation key 31 is received. The attribute includes the genre to which the image belongs. The genre includes, for example, navigation, advertisement, and tourism. In step S02, the accepted attribute is set. Specifically, it is temporarily stored in the RAM 23. In the next step S03, it is determined whether an instruction to start imaging is accepted. When the user inputs an instruction to cause the camera 41 to capture an image on the touch screen 29 or the operation key 31, an instruction to start imaging is accepted. If an instruction to start imaging is accepted, imaging is started and the process proceeds to step S04. If not, the process returns to step S01. When the camera 41 starts imaging, the image output by the camera 41 is stored in the EEPROM 25.

  Next, the current position of the vehicle output from the GPS receiver 13 is acquired (step S04), and the direction of the traveling direction of the vehicle output from the direction sensor 14 is acquired (step S05). Then, point data at the time of imaging is generated (step S06), and the generated point data is stored in the EEPROM 25 (step S07). Point data is generated and stored at the time when imaging is started by the camera 41. The point data generated here is the position of the vehicle at the time when imaging is started by the camera 41, the position in the traveling direction of the vehicle, the position in the moving image (reproduction position), and here the position of the head of the moving image. At least.

  In the next step S08, the current position of the vehicle output by the GPS receiver 13 is acquired. In step S04, the position at the time when the imaging is started by the camera 41 is acquired, whereas in step S08, the position is acquired when the vehicle travels after step S04 is executed. Then, the map data 305 stored in the EEPROM 25 is read (step S09). In the next step S10, it is determined whether or not the position acquired in step S08 indicates an intersection on the map. If it indicates an intersection, the process proceeds to step S11; otherwise, the process proceeds to step S13.

  In step S11, point data at the intersection is generated, and the generated point data is stored in the EEPROM 25 (step S12). The point data generated here includes at least the position of the intersection, the direction of travel of the vehicle, and the position (playback position) in the moving image because the vehicle is located at the intersection.

  In step S13, the azimuth in the traveling direction of the vehicle output by the azimuth sensor 14 is acquired. In step S05, the azimuth at the time when imaging was started by the camera 41 is acquired, whereas in step S13, the azimuth is acquired when the vehicle travels after step S04 is executed. In step S14, it is determined whether the acquired orientation has changed from the previously acquired orientation. The direction change may be a change that detects that the vehicle changes its course at an intersection. For example, when the angle changes about 30 degrees, it may be determined that the direction has changed. If the orientation has changed, the process proceeds to step S15; otherwise, the process proceeds to step S17.

  In step S15, point data at the time of changing the direction is generated, and the generated point data is stored in the EEPROM 25 (step S16). The point data generated here includes at least the position when the vehicle changes the course, the azimuth in the traveling direction after changing the course of the vehicle, and the position (reproduction position) in the moving image. Therefore, when the vehicle turns right or left at the intersection, the point data generated before changing the course at the intersection is stored in the EEPROM 25 in step S12, and the points generated after changing the course after turning right or left Data is stored in the EEPROM 25 in step S16.

  In step S17, it is determined whether a predetermined time has elapsed. The predetermined time is an elapsed time since the next step S17A was first executed. If the predetermined time has elapsed, the process proceeds to step S17A; otherwise, the process proceeds to step S18. In step S17A, point data at a predetermined interval is generated, and the generated point data is stored in the EEPROM 25 (step S17B).

  In step S18, it is determined whether or not imaging by the camera 41 is completed. When the user inputs an instruction to end image capturing to the camera 41 on the touch screen 29 or the operation key 31, an instruction to end image capturing is received and it is determined that the image capturing has ended. If imaging has ended, the process proceeds to step S19; otherwise, the process returns to step S08. Therefore, point data is generated and stored in the EEPROM 25 when the imaging starts, when the imaging is started, when the vehicle is located at the intersection, and when the vehicle changes the course. Is done.

  In step S19, the image 301 and point data 303 stored in the EEPROM 25 are transmitted to the server 200. As a result, the image 301 and the point data 303 are stored in the HDD 205 of the server 200, and the other navigation devices 10A and 10B are ready for acquisition.

  FIG. 9 is a flowchart illustrating an example of a flow of image output processing during travel. The running image output process is a process executed by the CPU 11 when the CPU 11 included in the navigation device 10 functioning as an image reproducing device executes the running image output program. The running image output process is executed while the vehicle on which the navigation device 10 is mounted is running.

  Referring to FIG. 9, CPU 11 first acquires the current position of the vehicle output from GPS receiver 13 (step S21), and acquires the azimuth of the traveling direction of the vehicle output from azimuth sensor 14 (step S22). ). Then, a point list is generated (step S22A). From the point data 303 stored in the EEPROM 25, the point data in which the position within the first range is set as the item on the map is extracted from the position acquired in step S21, and the extracted point data is Generate a list of points to include. The first range is a predetermined distance range. In the next step S23, an image determination output process is executed.

  FIG. 10 is a flowchart illustrating an example of the flow of the image determination output process. The image determination output process is a process executed in steps S23, S37, S39, and S41 in FIG. Referring to FIG. 10, CPU 11 extracts point data in which the azimuth approximated to the azimuth obtained in step S <b> 23 or step S <b> 27 in FIG. 9 is set in the azimuth item from the point data included in the point list. (Step S51).

  In the next step S52, it is determined whether or not there are a plurality of extracted point data. If a plurality of point data has been extracted, the process proceeds to step S53, and if not, the process proceeds to step S54. In step S53, the plurality of point data is narrowed down to one under the user setting conditions described above, and the process proceeds to step S54.

  In step S54, point data to be processed is determined. If there are a plurality of point data extracted from the point list in step S51, one point data narrowed down in step S53 is determined as a processing target. If there is one point data extracted from the point list in step S51, the point data is determined. Determine the data to be processed.

  In the next step S55, it is determined whether or not a moving image is set in the item of the category of the point data determined to be processed. If a moving image has been set, the process proceeds to step S55; otherwise, the process proceeds to step S56.

  In step S55, the moving image stored in the storage position set in the item of the storage position of the point data determined to be processed is read from the EEPROM 25, the reproduction of the read moving image is started, and the process is performed. Return to the time image output process. As a result, the moving image is displayed on the LCD 27. On the other hand, in step S56, the still image stored in the storage position set in the item of the storage position of the point data determined to be processed is read from the EEPROM 25, the read still image is displayed on the LCD 27, and the processing is performed. Is returned to the image output processing during driving.

  Returning to FIG. 9, in step S24, the current position of the vehicle output by the GPS receiver 13 is acquired, and in the next step S25, the direction of travel of the vehicle output by the direction sensor 14 is acquired. Then, a point list is generated (step S26).

  In the next step S27, the direction of the traveling direction of the vehicle output from the direction sensor 14 is acquired. Then, from the point data 303 included in the point list generated in step S26, the point data 303 whose azimuth item approximates the azimuth acquired in step S27 is extracted. In the next step S29, it is determined whether or not the extracted point list includes a plurality of point data. If a plurality of point data has been extracted, the process proceeds to step S30; otherwise, the process proceeds to step S31. In step S30, a plurality of point data is narrowed down to one under the user setting conditions described above, and the process proceeds to step S31. In step S31, point data to be processed is determined. When a plurality of point data is extracted from the point list, one point data narrowed down in step S30 is determined as a processing target, and if one point data is extracted from the point list, the extracted point data is Determine to be processed.

  In the next step S32, it is determined whether or not the point data determined to be processed is new point data different from the point data corresponding to the currently output image. It is determined whether or not the currently reproduced moving image is stored in the storage position set in the item of the storage position of the point data determined to be processed. If it is new point data, the process proceeds to step S33; otherwise, the process proceeds to step S36.

  In step S33, it is determined whether or not a moving image is set in the item of the category of point data determined to be processed. If a moving image has been set, the process proceeds to step S34; otherwise, the process proceeds to step S35.

  In step S34, the moving image stored in the storage position set in the item of the point data storage position determined as the processing target is read from the EEPROM 25, and the item of the playback position of the point data determined as the processing target is read. Playback of the moving image read out from the playback position set in step S36 is started, and the process proceeds to step S36. As a result, the moving image is displayed on the LCD 27. On the other hand, in step S35, the still image stored in the storage position set in the item of the storage position of the point data determined to be processed is read from the EEPROM 25, the read still image is displayed on the LCD 27, and the processing is performed. Advances to step S36. As a result, when new point data in which the storage position of an image different from the currently displayed image is set as the storage position is extracted, the image specified by the point data is displayed. For this reason, an image can be displayed without interruption.

  In the next step S36, it is determined whether or not the orientation acquired in step S27 has been changed from the previously acquired orientation. If the orientation has been changed, the process proceeds to step S37; otherwise, the process proceeds to step S38. In step S37, an image determination output process is executed, and the process proceeds to step S38. Since the image determination output process is executed when the vehicle changes its course at the intersection, it is possible to display an image obtained by imaging the azimuth after changing the course.

  In the next step S38, it is determined whether or not an operation for instructing switching has been input by the user. If an operation to instruct switching is input, the process proceeds to step S39; otherwise, the process proceeds to step S40. In step S39, an image determination output process is executed, and the process proceeds to step S40. Since the image determination output process is executed when the user inputs an operation for instructing switching, the image to be displayed can be switched at an arbitrary timing.

  In step S40, it is determined whether or not the reproduction of the moving image being reproduced has ended. If the reproduction of the moving image is finished, the process proceeds to step S41; otherwise, the process proceeds to step S42. In step S41, an image determination output process is executed, and the process proceeds to step S42. When the reproduction of the moving image is finished, the image determination output process is executed, so that the moving image can be reproduced without interruption.

  In step S42, it is determined whether an end instruction has been accepted. It is determined whether an operation for ending the process is input by the user. If an end instruction is input by the user, the process is completed; otherwise, the process returns to step S24.

  FIG. 11 is a flowchart illustrating an example of the flow of image output processing during simulation. The simulation image output process is a process executed by the CPU 11 by executing the CPU 11 simulation image output program provided in the navigation device 10 functioning as an image playback device.

  Referring to FIG. 11, CPU 11 receives a start position (step S61) and receives an end position (step S62). The map data 305 stored in the EEPROM 21 is read out, the map is displayed on the LCD 27, and two positions on the map that the user instructs on the touch screen 29 are accepted as a start position and an end position, respectively. Then, a route from the start position to the end position is searched with reference to the map data 305 (step S63).

  Next, a position at the start position is acquired (step S64), and an orientation at the start position is acquired (step S65). Then, a point list is generated (step S65A). From the point data 303 stored in the EEPROM 25, the point data in which the position in the first range is set as the item on the map is extracted from the position acquired in step S64, and the extracted point data is Generate a list of points to include. In the next step S66, the image determination output process shown in FIG. 10 is executed, and the process proceeds to step S67. Thereby, an image obtained by capturing the direction of the azimuth at the start position is displayed on the LCD 27.

  In step S67, the position on the route searched in step S63 is moved. The processes in steps S68 to S85 are the same as those in steps S24 to S41 of the running image output process shown in FIG. 9 except for steps S68 and S79. Therefore, the description will not be repeated here. In step S68, in step S67, the position output by the GPS receiver 13 is acquired in that the position on the path after the position is moved on the path is acquired. And different. Further, step S79 is different from step S35 in which the azimuth output from the azimuth sensor 14 is acquired in that the azimuth at the position on the route after the position is moved on the route in step S67 is acquired.

  FIG. 12 is a flowchart illustrating an example of the flow of data acquisition processing. The data acquisition process is a process executed in the navigation device 10 functioning as an image reproduction device before the above-described travel time image output process or simulation time image output process is executed. Referring to FIG. 12, CPU 11 transmits a transmission request to server 200 (step S91), and receives an image and point data transmitted from server 200 (step S92). Then, the received image and point data are added to the EEPROM 25 and stored (step S93). As a result, the images stored in the other navigation devices 10A and 10B and the point data generated by them are stored in the EEPROM 25.

  FIG. 13 is a flowchart illustrating an example of the flow of data management processing. The data management process is a process executed in the server 200 when the CPU 201 included in the server 200 executes a data management program. Referring to FIG. 13, CPU 201 provided in server 200 determines whether an image and point data have been received (step S101). If an image and point data transmitted from any one of navigation devices 10, 10A, and 10B are received, the process proceeds to step S102; otherwise, the process proceeds to step S103. In step S102, the received image and point data are stored in HDD 205. Thereby, the images stored in each of the navigation devices 10, 10 </ b> A, and 10 </ b> B and the point data generated by them are stored in the HDD 205.

  In the next step S103, it is determined whether or not a transmission request is received from any one of the navigation devices 10, 10A, and 10B. If a transmission request is received, the process proceeds to step S104. If not, the process returns to step S101. In step S104, the point data and image stored in HDD 205 in step S102 are transmitted to the navigation apparatus 10, 10A, 10B that has transmitted the transmission request.

  As described above, when the navigation apparatus according to the present embodiment functions as an image reproduction apparatus, the navigation apparatus stores an image captured by the own apparatus and an image received from the server 200 in the EEPROM 25 and is generated by the own apparatus. The point data and the pointed captured image received from the server 200 or the point data received from the server 200 are stored in the EEPROM 25. Then, when the position and orientation on the map are accepted, the point data including the position on the map within the predetermined range from the position on the map is extracted from the point data, and the point data including the orientation is extracted and stored. An image specified by the storage position included in the point data extracted from the existing images is output. For this reason, the image imaged at the position and orientation on the map can be displayed. In addition, as the position and orientation on the map change, the images specified by the position and orientation are extracted in order from the plurality of images, so that the images can be output continuously, Images can be linked to each other.

  In addition, when an image is displayed, the position on the map is shown as an intersection on the road map, and the direction changes thereafter, new point data is extracted and specified by the storage position included in the newly extracted point data Display the image to be displayed. When the azimuth changes at the intersection, an image shot in the changed azimuth is output, so that the output image can be linked to the next output image according to the conversion of the azimuth. Further, since the point data includes a storage position indicating the position of the intersection, new point data can be easily extracted.

  Further, when the position changes, when there is new point data including the position after the change and including the orientation at the position after the change, an image specified by the storage position included in the new point data is displayed. . Since the output image is linked to the image specified by the new point data existing after the position and orientation change, it is possible to display the image so that the output image is not interrupted.

  Further, when an operation is accepted by the user, new point data is extracted, and an image specified by the storage position included in the newly extracted point data is displayed. For this reason, two images can be linked at an arbitrary timing.

  Further, since the moving image is reproduced from the reproduction position included in the point data, the moving image captured at the accepted position is displayed.

  Further, when the reproduction of the moving image being reproduced is completed, new point data is extracted, and an image specified by the storage position included in the newly extracted point data is displayed. For this reason, since the image captured at the position after the reproduced moving image ends is displayed, the image can be displayed so as not to be interrupted.

  Further, when the navigation apparatus 10 functions as a data generation apparatus, the image is acquired by the camera 41, the position acquired from the GPS receiver 13 is indicated as an intersection on the road map, or acquired from the direction sensor 14. When the obtained orientation is changed, the acquired position and orientation on the map, the storage position where the captured image is stored, and the reproduction position indicating the position in the moving image when the image is a moving image The included point data is generated and stored in the EEPROM 25. The point data includes the position and orientation on the map at the time when the image was captured, the storage position where the captured image is stored, and the playback position indicating the position in the moving image if the image is a moving image. Therefore, it is possible to generate point data 303 that can link an image captured and stored from a position and orientation on a map with another image.

  In the present embodiment, when the navigation device 10 functions as an image playback device, the position input from the position acquisition unit 59 or the simulation unit 93 indicates an intersection, and the direction acquisition unit 55 or the simulation unit 93 New point data is determined when the input direction is changed, when an instruction from the user is accepted, or when a moving image being played back is finished, but the position and direction are changed before those times. Prediction may be performed, a point list may be generated based on the predicted position and orientation, and point data may be determined. Thereby, the time until the image is output can be shortened.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

<Appendix>
(1) The image output device according to claim 1, further comprising data acquisition means for acquiring the image and point data from the outside and storing them in the image storage means and the point data storage means, respectively.
(2) The point data includes attribute information indicating attributes of related images,
The image according to claim 1, wherein the point data extraction unit extracts one of the plurality of point data based on the attribute information when there are a plurality of point data satisfying the condition. Output device.
(3) The data generation device according to claim 9, further comprising transmission means for transmitting the stored image and the generated point data to the outside.
(4) The image output device according to claim 9, wherein the data reproduction device is mounted on a moving body.
(5) A navigation system including the data generation device according to claim 9, the image output device according to claim 1, and a server,
The server receives the image stored by the data generation device and the generated point data from the data generation device, and collects data storage means for storing,
A navigation system comprising: data transmission means for transmitting an image and point data stored in the collected data storage means in response to a request from the image output device.

It is a figure which shows the whole outline | summary of the navigation system in this Embodiment. It is a block diagram which shows an example of the hardware constitutions of a navigation apparatus. It is a block diagram which shows an example of the hardware constitutions of a server. 3 is a functional block diagram illustrating an example of functions of a CPU included in a navigation device functioning as a data generation device, together with data stored in an EEPROM 25. FIG. It is a figure which shows an example of point data. It is a figure which shows an example of the property of an image. It is a functional block diagram which shows with a data memorize | stored in EEPROM an example of the function which CPU with which the navigation apparatus which functions as an image reproduction apparatus has has. It is a flowchart which shows an example of the flow of a point data generation process. It is a flowchart which shows an example of the flow of the image output process at the time of driving | running | working. It is a flowchart which shows an example of the flow of an image determination output process. It is a flowchart which shows an example of the flow of the image output process at the time of simulation. It is a flowchart which shows an example of the flow of a data acquisition process. It is a flowchart which shows an example of the flow of a data management process.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Navigation system 10, 10A, 10B Navigation apparatus, 11 CPU, 13 Receiver, 14 Direction sensor, 15 Wireless circuit, 17 Memory I / F, 17A Memory card, 19 Serial communication I / F, 21 ROM, 23 RAM, 25 EEPROM, 27 LCD, 29 touch screen, 31 operation keys, 33 audio codec, 35 amplifier, 37 speaker, 39 video decoder, 41 camera, 51 image reception unit, 53 image storage unit, 55 orientation acquisition unit, 57 point data generation Unit, 59 position acquisition unit, 61 timing determination unit, 63 transmission unit, 71 operation reception unit, 73 data acquisition unit, 77 point data extraction unit, 79 point list generation unit, 81 moving image end extraction unit, 83 instruction reception extraction Part, 85 new poi Extraction unit, 87 intersection extraction unit, 89 output control unit, 91 route search unit, 93 simulation unit, 100 Internet, 101, 101A, 101B access point, 200 server, 201 CPU, 202 ROM, 203 RAM, 204 network I / F, 205 HDD, 206 display unit, 207 operation unit, 301 image, 303 point data, 305 map data.

Claims (10)

Image storage means for storing images;
Point data including a position and orientation on a map, a storage position indicating a position where the stored image is stored, and a reproduction position indicating a position in the moving image when the image is a moving image, Point data storage means for storing in association with the stored image;
Position acquisition means for acquiring a position on a map;
Bearing acquisition means for acquiring bearing,
Point data extraction means for extracting point data including a position on a map within a predetermined range from a position on the acquired map from the stored point data and including the acquired orientation;
An image output apparatus comprising: output means for reading out and outputting an image specified by the storage position included in the extracted point data from among images stored in the image storage means. Map storage means for storing the road map,
The point data extraction unit extracts new point data when the direction acquired by the direction acquisition unit changes while the output unit outputs the image,
The image output device according to claim 2, wherein the output unit reads and outputs an image specified by the storage position included in the point data newly extracted by the point extraction unit from the image storage unit. The point data extraction unit includes a position on the map within a predetermined range from a position on the map newly acquired by the position acquisition unit, and a new one including the direction newly acquired by the direction reception unit To extract point data from the stored point data,
In the case where new point data is extracted by the point data extraction unit while outputting an image, the output unit outputs an image specified by the storage position included in the newly extracted point data. The image output device according to claim 1, wherein the image output device reads out and outputs from the image. Including an operation accepting means for accepting a user operation,
The point data extracting means extracts new point data when a predetermined operation is accepted by the operation accepting means,
The output means reads out and outputs a moving image or a still image specified by the storage position included in the point data newly extracted by the point extraction means from the image storage means. An image output apparatus according to claim 1. When the moving image is stored in the storage position included in the extracted point data, the output unit reads out the moving image and reproduces it from the reproduction position included in the extracted point data. When,
The image output apparatus according to claim 1, further comprising: a display unit that reads and displays the still image when a still image is stored at the storage position included in the extracted point data. The point data extracting means extracts new point data when the moving image being reproduced by the reproducing means is completed,
The image output device according to claim 5, wherein the output unit reads and outputs an image specified by the storage position included in the point data newly extracted by the point extraction unit from the image storage unit. It further comprises position detecting means for detecting the current position on the map,
The image output apparatus according to claim 1, wherein the position acquisition unit acquires the detected position. Map storage means for storing a road map;
Route receiving means for receiving the first position and the second position on the road map;
Search means for searching for a route from the accepted first position to the second position;
The image output apparatus according to claim 1, wherein the position acquisition unit acquires a position on the searched route. A data generation device mounted on a vehicle,
Map storage means for storing a road map;
An imaging means for capturing an image;
Image storage means for storing the captured image;
Position acquisition means for acquiring the current position on the map;
Direction acquisition means for acquiring the direction in which the vehicle travels;
Timing determining means for determining timing for generating point data;
According to the determined timing, the position and direction on the map acquired by the position acquisition unit and the direction acquisition unit, the storage position where the image captured by the imaging unit is stored, and the image is a moving image Point data generating means for generating point data including a reproduction position indicating a position in the moving image in the case of
Point data storage means for storing the generated point data,
The timing determination unit is configured such that when imaging by the imaging unit is started, when the position acquired by the position acquisition unit is indicated as an intersection in the stored road map, when the acquired orientation is changed, and A data generation device that determines at least one selected from when a predetermined time has elapsed as a timing for generating the point data. On the map,
Direction,
A storage position indicating a position on the map and a position where an image captured in the direction is stored;
When the image stored at the position specified by the storage position is a moving image, a data structure of point data including a reproduction position corresponding to the position on the map in the moving image.

Images