JP2007135068A - Imaging reproducing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To record position information corresponding to moving image data efficiently, and to display the position information precisely during reproduction. <P>SOLUTION: The position information on an imaging place contained in a designated moving image file is read from change point position information 531, and map information covering each position of the position information entirely is acquired from a map information database 800 by a map information acquisition section 352. A map drawer 360 draws a map based on the position information and map information. An overlap section 380 overlaps the drawn map to a moving image reproduced by a moving image reproducer 310 for displaying on a display unit 390. A corresponding position on the map blinks according to the progress of reproduction for pointing out the imaging place explicitly. Attribute information corresponding to the imaging position is displayed at the imaging position according to color, patterns, or the like. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an imaging / playback apparatus for moving images, and more particularly, to an imaging apparatus, a playback apparatus, an imaging / playback apparatus, a processing method therefor, and a program for causing a computer to execute the method.

  Imaging devices for capturing moving images have become widespread, and many users can easily capture moving images. Since the user can capture a moving image by a simple operation, the user captures a cityscape or landscape without hesitation, and as a result, a large amount of captured moving image data is accumulated.

If a large amount of moving image data is accumulated in this way, it becomes difficult for the user to memorize all the captured positions even if the user captured the images. Therefore, it is necessary to associate the captured moving image data with the imaging position in some form. For example, a recording system that correlates and records image data captured by a camera unit and position data acquired from a GPS (Global Positioning System) has been proposed (see, for example, Patent Document 1).
Japanese Patent Laying-Open No. 2003-18506 (FIG. 5)

  In the above-described prior art, the position display based on the position data is performed during the reproduction of the image data by recording the image data and the position data. However, in this prior art, the recording timing of position data is not clear. If all the position data is recorded at regular intervals during moving image capturing, there is a risk that a large data area will be consumed depending on the interval. On the other hand, when position data is recorded in units of moving image files, there is a possibility that an accurate imaging position cannot be recorded when imaging is performed while moving between places.

  In addition, when imaging is performed while moving from place to place, it is desirable to be able to easily grasp the geographical distribution of imaging positions that are candidates for moving image reproduction and the imaging positions during moving image reproduction.

  Accordingly, an object of the present invention is to efficiently record position information corresponding to moving image data, and to clearly display the position information during reproduction.

  The present invention has been made in order to solve the above-mentioned problems. The first aspect of the present invention is to provide a moving image reproducing means for reproducing moving image data and outputting it to a reproduction display screen, and position information associated with the moving image data. A position information acquisition means for acquiring, a map information acquisition means for acquiring map information covering a plurality of positions included in the position information, and a map in which the plurality of positions are marked based on the map information and the position information. Map drawing means for drawing on a map display screen, overlay means for overlaying the reproduction display screen and the map display screen on the same screen, and display means for displaying the superimposed screen This is a moving image playback device. This brings about the effect that the map covering a plurality of positions relating to the moving image data and the reproduction display screen of the moving image data are displayed in an overlapping manner.

  In the first aspect, the moving image data can be realized as one moving image file. Thereby, a plurality of positions are recorded in one moving image file, and the screen display is performed from the plurality of positions.

  In the first aspect, the plurality of positions may be recorded as positions indicating changes in position information at the time of imaging. That is, only when a change occurs in the position information, the position is recorded, and the position is used at the time of reproduction, thereby improving the processing efficiency.

  Further, in the first aspect, the information processing device further includes map information holding means for holding map information corresponding to the position information, and the map information acquisition means includes the map information holding means by searching for the map information holding means. Map information covering a plurality of positions may be acquired. This brings about the effect that the map information is acquired by the moving image playback device alone without using an external database.

  Further, in the first aspect, the information processing device further includes place name information acquisition means for acquiring place name information corresponding to the position information, and the map drawing means corresponds to the place names included in the place name information for each of the plurality of positions. You may make it add to a thing. This brings about the effect that each position on the map is presented more clearly.

  In the first aspect, the map drawing means may apply a special effect to the mark corresponding to the moving image data reproduced by the moving image reproducing means among the plurality of position marks. This brings about the effect that the position where the moving image being reproduced is captured is presented more clearly.

  In the first aspect, the map drawing means may indicate an attribute related to the reliability of the position information for the plurality of position marks. This brings about the effect of clearly presenting the degree of accuracy of each position.

  In the first aspect, the map drawing unit may indicate the order in which the plurality of position marks are imaged in time series. This brings about the effect of clearly presenting the imaging order of the moving image data.

  Further, in this first aspect, reproduction position information acquisition means for acquiring position information corresponding to the reproduction time of the moving image data by the moving image reproduction means as reproduction position information, and position information before the reproduction time is reproduced last time. A previous reproduction position information holding unit for holding as position information; and a reproduction position information comparison unit for comparing the reproduction position information with the previous reproduction position information to detect a mismatch, and when the mismatch is detected. The map drawing means applies a special effect to the mark corresponding to the reproduction position information among the plurality of position marks, and the previous reproduction position information holding means holds the reproduction position information as new previous reproduction position information. You may make it do. This brings about the effect that the position is more clearly presented each time the position changes with the progress of reproduction. Further, at this time, it further includes a display update timer for measuring the acquisition interval of the reproduction position information, and the reproduction position information acquisition means acquires the reproduction position information each time the display update timer measures the acquisition interval. You may do it. This brings about the effect that position information is acquired at regular intervals.

  According to a second aspect of the present invention, there is a moving image recording unit that records a captured image as moving image data, and an imaging position information acquisition unit that acquires position information of an imaging location as imaging position information during recording of the moving image data. The previous imaging position information holding means for holding the imaging position information acquired by the imaging position information acquisition means as the previous imaging position information, and the imaging position information by comparing the imaging position information with the previous imaging position information. Change point detecting means for detecting a change point indicating that the position indicated by the position changed from the position indicated by the previous image pickup position information, and a change for recording the image pickup position information as change point position information when the change point is detected. Point position information recording means, moving picture reproducing means for reproducing the moving picture data and outputting it to the reproduction display screen, and for obtaining the change point position information associated with the moving picture data. Information acquisition means, map information acquisition means for acquiring map information covering a plurality of positions included in the change point position information, and a map in which the plurality of positions are marked based on the map information and the change point position information A map drawing means for drawing the image on the map display screen, an overlay means for overlaying the playback display screen and the map display screen on the same screen, and a display means for displaying the superimposed screen. The imaging position holding means is an imaging reproduction apparatus that holds the imaging position information as new previous imaging position information when the change point is detected. As a result, a change point is detected at the time of moving image capturing, and positional information and a reduced image at that time are recorded, and at the time of reproduction, a map covering a plurality of positions related to the moving image data and a reproduction display screen of the moving image data are superimposed It brings about the effect of displaying.

  The third aspect of the present invention provides a procedure for acquiring position information associated with moving image data, a procedure for acquiring map information covering a plurality of positions included in the position information, the map information, and the position A procedure for drawing a map with the plurality of positions marked on the map display screen based on the information; and a procedure for displaying the reproduction display screen for the moving image data and the map display screen on the same screen. Or a program for causing a computer to execute these procedures. This brings about the effect that the map covering a plurality of positions relating to the moving image data and the reproduction display screen of the moving image data are displayed in an overlapping manner.

  According to the present invention, the position information corresponding to the moving image data can be efficiently recorded, and the position information can be clearly displayed during reproduction.

  Next, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating a configuration example of an imaging apparatus 100 according to an embodiment of the present invention. The imaging apparatus 100 includes an operation unit 110, a camera unit 120, a memory 130, a display unit 140, a recording unit 150, and a control unit 160.

  The operation unit 110 receives an operation input from a user. The operation unit 110 can be realized as an operation button provided in the imaging apparatus or a touch panel integrated with the display unit 140.

  The camera unit 120 images a subject and includes an optical block such as a lens and a signal conversion unit such as a CCD (Charge Coupled Devices). The memory 130 is a work area for temporarily storing moving image data captured by the camera unit 120, and a volatile memory is generally used.

  The display unit 140 displays a moving image being captured or a reproduced moving image on a display such as an LCD (Liquid Crystal Display). The display unit 140 may be integrated with the operation unit 110 as described above.

  The recording unit 150 records captured moving image data and information associated with the moving image data, and generally uses a non-volatile recording medium. The control unit 160 controls each unit of the imaging apparatus 100, and is realized by, for example, a program-controlled microcomputer.

  In addition, the imaging apparatus 100 can incorporate or externally connect the GPS receiver 170 and the speed / acceleration sensor 180. The GPS receiving unit 170 receives information (position information) related to the position of the imaging device 100 from a GPS satellite. The speed / acceleration sensor 180 is a sensor that senses the speed and acceleration of the imaging apparatus 100. For example, a gyro sensor that senses angular velocity or an acceleration sensor that senses acceleration can be used.

  FIG. 2 is a diagram illustrating a functional configuration example for recording a moving image in the imaging apparatus 100 according to the embodiment of the present invention. Here, the position measurement unit 210, the imaging position information acquisition unit 220, the previous imaging position information holding unit 230, the change point detection unit 240, the position measurement timer 250, the system timer 260, the thumbnail generation unit 270, A speed / acceleration measuring unit 280 is assumed.

  The position measurement unit 210 measures the location of the imaging device 100, and for example, a GPS outside the imaging device 100 is used. The imaging position information acquisition unit 220 acquires position information of the imaging location from the position measurement unit 210 during imaging of a moving image, and corresponds to the GPS reception unit 170 in FIG. The previous imaging position information holding unit 230 holds the position information of the imaging location acquired by the imaging position information acquisition unit 220 as the previous imaging position information. Here, the position information may be, for example, information on latitude and longitude acquired from the GPS receiver 170, and country name, city name, and region name acquired using the place name information database 700 described in FIG. It may be information on place names such as.

  The change point detection unit 240 compares the imaging position information acquired by the imaging position information acquisition unit 220 with the previous imaging position information held in the previous imaging position information holding unit 230, and the position indicated by the imaging position information And the position indicated by the previous imaging position information are detected as “change points”. For example, when the information about the latitude and longitude held in the previous imaging position information holding unit 230 is compared with the information about the latitude and longitude indicated by the imaging position information, and it is detected that the distance is a predetermined distance, the “change point” is detected. In addition, the place name held in the previous shooting position information holding unit 230 may be compared with the place name indicated by the shooting position information, and if the place names are different, they may be detected as “change points”. Good. For example, as the predetermined distance, it is desirable that the place name corresponding to the position information can be changed. For example, several hundred meters to several kilometers can be assumed.

  When the change point is detected, the change point detection unit 240 causes the previous image pickup position information holding unit 230 to hold the position indicated by the image pickup position information as new previous image pickup position information. Further, at the start of recording of moving image data, the previous imaging position information holding unit 230 may hold the imaging position information when the recording operation is started as the previous imaging position information.

  When the change point is detected by the change point detection unit 240, the imaging position information acquired by the imaging position information acquisition unit 220 is held in the previous imaging position information holding unit 230 as new previous imaging position information. In this case, the imaging position information acquired by the imaging position information acquisition unit 220 is recorded in the change point position information 531 in the metadata 530. Further, at this time, a reduced image of the moving image being captured corresponding to the change point position information 531 is generated as a thumbnail (representative image) by the thumbnail generation unit 270 and recorded in the change point thumbnail 532 in the metadata 530.

  The position measurement timer 250 is a timer that times the position information acquisition interval in the imaging position information acquisition unit 220. Thereby, the imaging position information acquisition unit 220 can acquire position information from the position measurement unit 210 at regular intervals.

  The system timer 260 measures the current time. The current time by the system timer 260 is recorded as part of the change point position information 531 or accompanying information.

  The thumbnail generation unit 270 generates a reduced image of a moving image being captured as a thumbnail when the change point is detected by the change point detection unit 240. As described above, the thumbnail created by the thumbnail generation unit 270 is recorded in the change point thumbnail 532.

  The speed / acceleration measuring unit 280 is a sensor that senses a motion state including the speed and acceleration of the imaging apparatus 100, and corresponds to the speed / acceleration sensor 180 of FIG. Therefore, for example, a gyro sensor that detects angular velocity or an acceleration sensor that detects acceleration can be used.

  The metadata 530 holds information accompanying the moving image data, and includes the above-described change point position information 531 and the change point thumbnail 532. The data structure of the metadata 530 will be described later.

  FIG. 3 is a diagram showing an example of the recording timing of the metadata 530 in the embodiment of the present invention. Here, it is assumed that a moving image is captured by the imaging device between times t1 and t4. The imaging position information acquisition unit 220 acquires position information from the position measurement unit 210 at regular intervals defined by the position measurement timer 250.

First, when the imaging is started at time t1, the position information of the position A by the image pickup position information acquisition unit 220 is acquired, the position information is recorded as change point position information L _A. At this time, thumbnail generator 270 is generated, the thumbnail is recorded as a change point thumbnail P _A. Thereafter, the position information is acquired by the imaging position information acquisition unit 220 after a certain interval has elapsed, but the metadata is not recorded because it is not a predetermined distance from the previous position.

Further, when the imaging position information acquisition unit 220 acquires position information at time t2 after a certain interval has elapsed, the position information of the acquired position _B is recorded as change point position information L _B because it is a predetermined distance away from the previous position A. Is done. At this time, thumbnail generator 270 is generated, the thumbnail is recorded as a change point thumbnail P _B.

When such an operation is repeated and then the imaging position information acquisition unit 220 acquires the position information at time t3, the position information of the acquired position C is changed by the change point position information L because it is a predetermined distance away from the previous position B. Recorded as _C. At this time, thumbnail generator 270 is generated, the thumbnail is recorded as a change point thumbnail P _C.

  In this way, efficient recording of metadata is performed by recording position information and thumbnails at a predetermined distance from the previous position.

  FIG. 4 is a diagram showing an example of the file structure of the moving image file 500 according to the embodiment of the present invention. The moving image file 500 includes a file header 510, moving image data 520, metadata 530, and other data 540.

  The file header 510 is an area for recording header information of the moving image file 500 and holds the position (address) of the moving image data 520 and the metadata 530 in the moving image file 500. The moving image data 520 is for recording the content of the moving image, and uses a compression method such as MPEG (Moving Picture Experts Group) format.

  The metadata 530 is an area for recording information accompanying the moving image data 520 and includes change point position information 531, a change point thumbnail 532, and the like. The change point position information 531 records the position information of the imaging apparatus 100 when the change point is detected by the change point detection unit 240. The change point thumbnail 532 records a thumbnail of the moving image that was being imaged when the change point was detected by the change point detection unit 240.

  FIG. 5 is a diagram illustrating an example of a data structure of the position information 600 according to the embodiment of the present invention. The position information 600 recorded in the change point position information 531 in FIG. 4 includes common information 610, individual information 620, a start time 601, and an end time 602.

  The common information 610 records information common to the entire position information 600. The individual information 620 records individual information corresponding to each change point. The start time 601 and the end time 602 record the start time and end time of the moving image corresponding to the individual information 620, respectively.

  Thus, in the position information 600, the individual information 620 regarding a plurality of imaging positions and the start time and end time of the moving image are recorded.

  FIG. 6 is a diagram illustrating an example of a data structure of the common information 610 of the position information 600 according to the embodiment of the present invention. This common information 610 holds a GPS tag version 611 of 4 bytes (1 byte is 8 bits) and a geodetic system 612 of 7 bytes.

  The GPS tag version 611 indicates the version of the format used in the individual information 620. The geodetic system 612 indicates a latitude and longitude geodetic standard used in the individual information 620. As this geodetic system 612, for example, a Japanese geodetic system called Tokyo Datum or a world geodetic system such as WGS-84 is used.

  FIG. 7 is a diagram illustrating an example of a data structure of the individual information 620 of the position information 600 according to the embodiment of the present invention. The individual information 620 includes a 100-byte essential item 630 and a 30-byte option item 640.

  The required items 630 are a 2-byte north-south section 621, a 24-byte latitude 622, a 2-byte east-west section 623, a 24-byte longitude 624, a 1-byte altitude section 625, an 8-byte altitude 626, It consists of a 2-byte GPS receiver state 627, an 8-byte positioning reliability 628, a 24-byte positioning time 629, a 3-byte number of used satellites 631, and a 2-byte GPS positioning method 632. These data correspond to the data measured by the position measurement unit 210.

  Latitude 622 indicates the latitude measured by GPS. The north-south section 621 indicates whether the latitude 622 is north or south. The longitude 624 shows the longitude measured by GPS. The east-west section 623 indicates whether the longitude 624 is east longitude or west longitude. The altitude 626 indicates the altitude measured by the GPS. The altitude class 625 indicates a class such as the altitude 626 above sea level.

  The GPS receiver state 627 indicates whether the positioning in GPS is successful or unsuccessful. The positioning reliability 628 indicates the DOP (Dilution Of Precision) value at the time of positioning in the GPS, that is, the degree of deterioration of the measurement accuracy, and, for example, an index of about four stages (A to D, etc.) according to the degree. Can be granted. The positioning time 629 indicates the time at which positioning has been performed. The number of used satellites 631 indicates the number of GPS satellites used for positioning. The GPS positioning method 632 indicates whether the two-dimensional positioning or the three-dimensional positioning is performed.

  The option item 640 includes a 2-byte speed unit 641, an 8-byte speed 642, a 2-byte traveling direction unit 643, an 8-byte traveling direction 644, a 2-byte image orientation unit 645, and 8 bytes. Image orientation 646. These data correspond to the data measured by the speed / acceleration measuring unit 280.

  A speed 642 indicates the measured speed. The speed unit 641 indicates a unit of the speed 642. A traveling direction 644 indicates a traveling direction of the imaging apparatus 100. The traveling direction unit 643 indicates a unit of the traveling direction 644. The image orientation 646 indicates the orientation of the image being captured. The image orientation unit 645 indicates a unit of the image orientation 646.

  FIG. 8 is a diagram illustrating a functional configuration example for moving image reproduction of the imaging apparatus 100 according to the embodiment of the present invention. Here, the moving image reproduction unit 310, the reproduction position information acquisition unit 320, the previous reproduction position information holding unit 330, the reproduction position information comparison unit 340, the place name information acquisition unit 351, the map information acquisition unit 352, the map drawing It is assumed that unit 360, display update timer 370, overlay unit 380, display unit 390, operation receiving unit 410, place name information database 700, and map information database 800 are included.

  The moving image reproduction unit 310 reproduces a moving image in the moving image data 520. The reproduction time of the moving image by the moving image reproduction unit 310, that is, the time corresponding to the reproduced moving image part is used as an index of the change point position information 531.

  The reproduction position information acquisition unit 320 indexes the change point position information 531 according to the reproduction time of the moving image by the moving image reproduction unit 310, and acquires position information at which the reproduced moving image part is captured as reproduction position information. . That is, by comparing the start time 601 and end time 602 in the position information 600 with the reproduction time, the corresponding moving image part is specified, and the individual information of the corresponding location is acquired.

  The previous reproduction position information holding unit 330 holds position information before the reproduction time of the moving image by the moving image reproduction unit 310 as the previous reproduction position information. The reproduction position information comparison unit 340 compares the reproduction position information acquired by the reproduction position information acquisition unit 320 with the previous reproduction position information held in the previous reproduction position information holding unit 330, and detects a mismatch between them. It is.

  When the discrepancy is detected in the reproduction position information comparison unit 340, the reproduction position information acquired by the reproduction position information acquisition unit 320 is held in the previous reproduction position information holding unit 330 as new previous reproduction position information.

  The place name information database 700 is a database that holds place name information in association with position information. The place name information acquisition unit 351 indexes the place name information database 700 based on the reproduction position information acquired by the reproduction position information acquisition unit 320 when the reproduction position information comparison unit 340 detects a mismatch, and obtains related place name information. To get.

  The map information database 800 is a database that holds map information for drawing a map in association with position information based on latitude and longitude. The map information acquisition unit 352 indexes the map information database 800 based on the reproduction position information acquired by the reproduction position information acquisition unit 320 when a mismatch is detected in the reproduction position information comparison unit 340, and displays related map information. To get.

  The map drawing unit 360 determines the imaging position based on the map information acquired by the map information acquisition unit 352, the reproduction position information acquired by the reproduction position information acquisition unit 320, and the place name information acquired by the place name information acquisition unit 351. It draws the map described. In addition, the map drawing unit 360 clearly indicates the imaging position by applying a special effect such as lighting or blinking to the corresponding position as the reproduction progresses.

  The display update timer 370 measures the acquisition interval of the reproduction position information in order to update the display on the display unit 390. The reproduction position information acquisition unit 320 acquires reproduction position information from the change point position information 531 each time the display update timer 370 measures the acquisition interval.

  The superimposing unit 380 superimposes the map drawn by the map drawing unit 360 and the moving image reproduced by the moving image reproducing unit 310 to generate display data for one screen. The display unit 390 displays the display data generated by the overlay unit 380 on a display such as an LCD. The operation accepting unit 410 accepts an operation instruction input from a user. For example, an operation button provided in the imaging apparatus, a touch panel integrated with the display unit 390, or the like can be assumed.

  FIG. 9 is a diagram showing a display example of the pre-video playback screen in the embodiment of the present invention. When the operation reception unit 410 receives an instruction to select a moving image file, the display unit 390 displays a map display screen 391 and a reproduction display screen 392 in an overlapping manner.

  On the map display screen 391, the imaging positions (three locations in this example) of the moving image included in the selected moving image file are drawn and marked on the map. These imaging positions are acquired from the change point position information 531 of the metadata 530 by the reproduction position information acquisition unit 320. The map is acquired from the map information database 800 by the map information acquisition unit 352. In addition, the place names (in this example, place A, place B, and place C) given to the imaging positions are obtained from the place name information database 700.

  Attribute information corresponding to the imaging position can be displayed on the imaging position mark by a color, a pattern, or the like. For example, when the GPS receiver state 627 of the position information indicates that the positioning has failed, the color of the imaging position can be changed to red to indicate that the imaging position is estimated. Further, the degree of correctness (probability) of the imaging position can be displayed by changing the color from blue to red according to the positioning reliability 628 of the position information.

  Here, a circle is used as the shape of the mark at the imaging position, but the shape is not limited to this, and it may be a polygon or a star.

  On the playback display screen 392, the first image (frame) of the selected moving image file is displayed as a still image. The playback display screen 392 displays that an operation instruction is received. When playback is instructed by an operation button or a touch panel, a playback operation is performed from the beginning of the moving image file. Note that the display of a moving image as content on a map in this way is referred to as content-on-map.

  FIG. 10 is a diagram showing a display example of a moving image playing screen according to the embodiment of the present invention. When the moving image reproduction is started, the image display position of the moving image being reproduced on the reproduction display screen 392 is displayed on the map display screen 393. As this display method, for example, the imaging position can be displayed by applying a special effect such as lighting or blinking to the mark of the corresponding imaging position.

  The display of the imaging position image can be updated each time the display update timer 370 times the acquisition interval. When the display update timer 370 measures the acquisition interval, it is checked whether or not the imaging position of the moving image being reproduced at that time is different from the imaging position displayed last time, and if it is different, it is updated to the latest imaging position. . In this way, control is performed so that the mark of the imaging position during moving image reproduction is displayed such as blinking.

  When an instruction to stop playback is given from the playback state of FIG. 10, the playback of the moving image is stopped and the state again shifts to the same state as in FIG. When a reproduction operation instruction is given in FIG. 9, the state again shifts to the reproduction state of FIG. In addition, when an operation instruction for selecting a mark at an imaging position on the map display screen 391 or 393 is given regardless of the playback state, the state shifts to a playback state of a moving image captured at that position.

  In addition, on the map display screen 391 or 393, the imaging order may be clearly shown in time series for each imaging position. For example, a serial number may be assigned as the imaging order, and the imaging time may be indicated. Further, the imaging positions may be connected by arrows so as to follow the imaging order.

  FIG. 11 is a diagram showing another display example of the pre-movie playback screen in the embodiment of the present invention. FIG. 9 shows a display example of content-on-map in which a moving image as content is displayed on the map. However, even if the map display screen 396 is displayed over the playback display screen 395 as shown in FIG. Good. Such a display of a map on a moving image as content is called map-on-content.

  Note that switching between content-on-map and map-on-content can be selected by the user, and the operation reception unit 410 receives the selection instruction. The operation reception unit 410 instructs the superposition unit 380 to switch the operation. In addition, when overlapping is performed in the overlapping unit 380, the screen positioned in front may be displayed semi-transparently by a method such as α blending.

  FIG. 12 is a flowchart showing an example of a processing procedure until reproduction of a moving image according to the embodiment of the present invention. When a moving image file is designated, the change point position information 531 of the metadata 530 of the moving image file is read by the reproduction position information acquisition unit 320, and all position information in the moving image file is acquired (step S911). .

  Map information that covers all the positions included in the acquired position information is acquired by the map information acquisition unit 352 (step S912), and place name information of each position is acquired by the place name information acquisition unit 351 (step S913). . Based on the acquired position information, map information, and place name information, a map to be displayed on the map display screen 391 is drawn by the map drawing unit 360 (step S914).

  The map display screen 391 generated in this manner is superimposed on the reproduction display screen 392 by the first frame of the moving image file by the overlay unit 380 and displayed on the display unit 390 (step S916). Thereafter, when the operation accepting unit 410 accepts a moving image reproduction instruction (step S917), the moving image reproducing unit 310 starts reproducing the moving image (step S920).

  FIG. 13 is a flowchart showing an example of a processing procedure of moving image reproduction in the embodiment of the present invention. While the video is being played, the display update timer 370 performs a timekeeping operation, and when the time to update the display comes (step S922), the playback time is acquired from the video playback unit 310 (step S923). ), The corresponding position information is acquired by the reproduction position information acquisition unit 320 (step S924). At this time, if the acquired position information is not valid due to positioning failure or the like, error processing is performed and position display is stopped (step S930).

  If the acquired position information indicates a position different from the previous position, a special effect such as blinking of a mark is applied at the corresponding position on the map to clearly indicate the imaging position (step S928). The position information acquired this time is held in the previous reproduction position information holding unit 330 as new previous position information (step S929).

  These operations are repeatedly executed until the reproduction of the moving image is completed (step S921).

  As described above, according to the embodiment of the present invention, the position indicated by the position information acquired by the reproduction position information acquisition unit 320 corresponds to a position on the map when a different position is indicated by the progress of reproduction. By performing blinking of the mark at the position, the position display at the time of moving image reproduction can be clearly performed.

  Note that although an example has been described in which the playback position information acquisition unit 320 acquires the change point position information 531 and the playback position information comparison unit 340 detects a mismatch during video playback, the present invention is not limited to this. In the case of reproducing moving image data in which only the position information of the change point is associated and recorded, the reproduction position information comparison unit 340 can detect the change point of the position information from the associated meta information without detecting a mismatch. The position information may be superimposed and displayed together with the moving image while being detected and switched at the change point.

  Further, the embodiment of the present invention shows an example for embodying the present invention, and has a corresponding relationship with the invention specific matter in the claims as shown below, but is not limited thereto. However, various modifications can be made without departing from the scope of the present invention.

  That is, in claim 1, the moving image reproducing means corresponds to, for example, the moving image reproducing unit 310. The position information acquisition unit corresponds to the reproduction position information acquisition unit 320, for example. The map information acquisition unit corresponds to the map information acquisition unit 352, for example. The map drawing means corresponds to the map drawing unit 360, for example. The superimposing means corresponds to the superimposing unit 380, for example. The display means corresponds to the display unit 390, for example.

  Further, in claim 4, map information holding means corresponds to the map information database 800, for example.

  Further, in claim 5, the place name information acquisition means corresponds to the place name information acquisition unit 351, for example.

  Further, in claim 9, reproduction position information acquisition means corresponds to the reproduction position information acquisition unit 320, for example. The previous reproduction position information holding unit corresponds to the previous reproduction position information holding unit 330, for example. A reproduction position information comparison unit corresponds to the reproduction position information comparison unit 340, for example.

  Further, in claim 10, the display update timer corresponds to, for example, the display update timer 370.

  Further, in claim 11, the moving image recording means corresponds to the recording unit 150, for example. The imaging position information acquisition unit corresponds to the imaging position information acquisition unit 220, for example. The previous imaging position information holding unit corresponds to the previous imaging position information holding unit 230, for example. The change point detecting means corresponds to the change point detecting unit 240, for example. The change point position information recording unit corresponds to the change point position information 531, for example. The moving image reproducing means corresponds to the moving image reproducing unit 310, for example. The position information acquisition unit corresponds to the reproduction position information acquisition unit 320, for example. The map information acquisition unit corresponds to the map information acquisition unit 352, for example. The map drawing means corresponds to the map drawing unit 360, for example. The superimposing means corresponds to the superimposing unit 380, for example. The display means corresponds to the display unit 390, for example.

  Further, in claim 12 or 13, the procedure for acquiring position information accompanying moving image data corresponds to, for example, step S911. A procedure for acquiring map information covering a plurality of positions included in the position information corresponds to, for example, step S912. The procedure for drawing a map with a plurality of positions marked on the map display screen based on the map information and the position information corresponds to, for example, step S914. Further, the procedure for displaying the moving image data reproduction display screen and the map display screen so as to overlap each other corresponds to, for example, step S915.

  The processing procedure described in the embodiment of the present invention may be regarded as a method having a series of these procedures, and a program for causing a computer to execute these series of procedures or a recording medium storing the program May be taken as

It is a figure showing an example of 1 composition of imaging device 100 in an embodiment of the invention. It is a figure which shows the function structural example for the moving image recording of the imaging device 100 in embodiment of this invention. It is a figure which shows an example of the recording timing of the metadata 530 in embodiment of this invention. It is a figure which shows an example of the file structure of the moving image file 500 in embodiment of this invention. It is a figure which shows an example of the data structure of the positional information 600 in embodiment of this invention. It is a figure which shows an example of the data structure of the common information 610 of the positional information 600 in embodiment of this invention. It is a figure which shows an example of the data structure of the separate information 620 of the positional information 600 in embodiment of this invention. It is a figure which shows the function structural example for the moving image reproduction of the imaging device 100 in embodiment of this invention. It is a figure which shows the example of a display of the screen before moving image reproduction in embodiment of this invention. It is a figure which shows the example of a display of the moving image reproduction | regeneration screen in embodiment of this invention. It is a figure which shows another example of a display of the screen before moving image reproduction in embodiment of this invention. It is a flowchart which shows an example of the process sequence until the moving image reproduction | regeneration in embodiment of this invention. It is a flowchart which shows an example of the process sequence of the moving image reproduction in embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Imaging device 110 Operation part 120 Camera part 130 Memory 140 Display part 150 Recording part 160 Control part 170 GPS receiving part 180 Speed / acceleration sensor 210 Position measurement part 220 Imaging position information acquisition part 230 Previous imaging position information holding part 240 Change point detection Unit 250 position measurement timer 260 system timer 270 thumbnail generation unit 280 speed / acceleration measurement unit 310 moving image reproduction unit 320 reproduction position information acquisition unit 330 previous reproduction position information holding unit 340 reproduction position information comparison unit 351 place name information acquisition unit 352 map information acquisition Unit 360 map drawing unit 370 display update timer 380 overlay unit 390 display unit 410 operation reception unit 500 moving image file 510 file header 520 moving image data 530 metadata 531 change point position information 532 change Point thumbnail 700 Place name information database 800 Map information database

Claims (13)

Video playback means for playing back video data and outputting it to a playback display screen;
Position information acquisition means for acquiring position information associated with the moving image data;
Map information acquisition means for acquiring map information covering a plurality of positions included in the position information;
Map drawing means for drawing a map with the plurality of positions marked on the map display screen based on the map information and the position information;
Superimposing means for superimposing the reproduction display screen and the map display screen on the same screen;
A moving image reproducing apparatus comprising: display means for displaying the superimposed screen.   The moving image reproducing apparatus according to claim 1, wherein the moving image data is one moving image file.   2. The moving image reproducing apparatus according to claim 1, wherein the plurality of positions are positions indicating changes in position information at the time of imaging. Map information holding means for holding map information corresponding to the position information,
2. The moving image reproducing apparatus according to claim 1, wherein the map information acquiring unit acquires map information covering a plurality of positions included in the position information by searching the map information holding unit. Further comprising place name information acquisition means for acquiring place name information corresponding to the position information;
2. The moving image reproducing apparatus according to claim 1, wherein the map drawing means appends a place name included in the place name information to a corresponding one of the plurality of positions.   2. The moving image reproducing apparatus according to claim 1, wherein the map drawing unit applies a special effect to the plurality of position marks corresponding to the moving image data reproduced by the moving image reproducing unit.   2. The moving image reproducing apparatus according to claim 1, wherein the map drawing means shows an attribute relating to reliability of the position information for the plurality of position marks.   2. The moving image reproducing apparatus according to claim 1, wherein the map drawing means indicates the order of imaging with respect to the plurality of position marks in time series. Reproduction position information acquisition means for acquiring position information corresponding to the reproduction time of the moving image data by the moving image reproduction means as reproduction position information;
Previous reproduction position information holding means for holding position information before the reproduction time as previous reproduction position information;
Replay position information comparing means for comparing the replay position information and the previous replay position information to detect a mismatch,
The map drawing means performs a special effect on the one corresponding to the reproduction position information among the plurality of position marks when the mismatch is detected,
2. The moving image reproducing apparatus according to claim 1, wherein the previous reproduction position information holding unit holds the reproduction position information as new previous reproduction position information when the mismatch is detected. Further comprising a display update timer for timing the reproduction position information acquisition interval;
10. The moving image playback apparatus according to claim 9, wherein the playback position information acquisition unit acquires the playback position information every time the display update timer times the acquisition interval. Moving image recording means for recording captured images as moving image data;
Imaging position information acquisition means for acquiring position information of an imaging location as imaging position information during recording of the moving image data;
Previous imaging position information holding means for holding the imaging position information acquired by the imaging position information acquisition means as previous imaging position information;
Change point detection means for comparing the imaging position information with the previous imaging position information and detecting a change point indicating that the position indicated by the imaging position information has changed from the position indicated by the previous imaging position information;
Change point position information recording means for recording the imaging position information as change point position information when the change point is detected;
Video playback means for playing back video data and outputting it to a playback display screen;
Position information acquisition means for acquiring the change point position information associated with the moving image data;
Map information acquisition means for acquiring map information covering a plurality of positions included in the change point position information;
Map drawing means for drawing a map showing the plurality of positions on the map display screen based on the map information and the change point position information;
Superimposing means for superimposing the reproduction display screen and the map display screen on the same screen;
Display means for displaying the superimposed screen,
The previous image pickup position holding unit holds the image pickup position information as new previous image pickup position information when the change point is detected. The procedure to get the location information attached to the video data,
A procedure for acquiring map information covering a plurality of positions included in the position information;
A procedure for drawing a map showing the plurality of positions on the map display screen based on the map information and the position information;
A moving image reproducing method comprising: a step of displaying the moving image data reproduction display screen and the map display screen so as to overlap each other. The procedure to get the location information attached to the video data,
A procedure for acquiring map information covering a plurality of positions included in the position information;
A procedure for drawing a map showing the plurality of positions on the map display screen based on the map information and the position information;
A program for causing a computer to execute a procedure for displaying the moving image data reproduction display screen and the map display screen so as to overlap each other.

Images