JP2009076084A - Device and method for supporting image creation, computer program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To support the generation of an image to be pasted onto a polygon, by generating a still image without a shift from a moving image photographed in an interlace system. <P>SOLUTION: A device 100 for supporting the generation of an image to be pasted has three functions. A synchronization control part 120 and a display control part 130 synchronously display the trajectory of a photography position and a video image on displays 50, 60, on the basis of video image data and history data. A specification part 140 automatically specifies a frame wherein a feature for which an image to be pasted is to be generated is appropriately photographed, from the video image data on the basis of the history data, photography conditions and the position of the feature. A generation part 170 copies odd-line data of odd-field image data into even lines to generate a still image for generating the image to be pasted. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a technique for supporting generation of an image of a feature.

  Car navigation devices that are mounted on vehicles and perform route search and route guidance are widespread. The car navigation apparatus includes an image display panel, and displays a map when guiding a route. Some of these car navigation devices can display a three-dimensional image in order to realistically represent features such as roads and buildings that intersect three-dimensionally when displaying a map. Polygons using computer graphics technology are used for this three-dimensional image.

  In recent years, in order to display features more realistically, it has been proposed to paste an image (pasted image) extracted from a still image actually taken on a polygon. A still image is generated by capturing a feature using a digital still camera or capturing a part of a moving image captured using a digital video camera.

  When using a digital video camera, for example, an image can be obtained in a relatively short time by installing the digital video camera in a vehicle and continuously photographing a plurality of features while running.

  In the digital video camera, an interlace system is generally used. The interlace method is a method of generating one frame image by alternately photographing an odd field for displaying odd-numbered lines and an even field for displaying even-numbered lines.

  However, in an image shot by the interlace method, for example, in the NTSC method, there is a 1/60 second difference between the shooting time of the even-numbered line and the shooting time of the odd-numbered line. For this reason, when a feature is photographed while moving, if a still image is generated by simply synthesizing both, a shifted image is obtained.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to support the generation of a still image without a shift from a moving image shot by an interlace method.

In order to solve at least a part of the above-described problems, the present invention employs the following configuration.
The first image generation support device of the present invention includes:
An image generation support device that supports generation of an image of a feature,
An image data input unit for inputting any of field data in which line data is intermittently recorded from video image data in which the features photographed while moving are recorded in an interlaced manner;
A generation unit that generates the image by generating other line data that is not input by copying the input line data or interpolating between the line data;
It is a summary to provide.

  As described above, the video image data used to generate an image used in the present invention is obtained by mounting an interlace video camera on a vehicle or the like and moving it. Examples of “field data” include odd field image data for displaying odd-numbered lines (odd lines) and even-numbered field image data for displaying even-numbered lines (even lines).

  “Generate other line data that has not been entered by copying input line data” means, for example, when odd field image data is input as field data, This means that even-numbered line data for displaying an uninputted even-numbered line is generated. Also, “generate other line data that has not been input by interpolation between line data” means that, for example, when odd field image data is input as field data, it is adjacent to some odd line data. This means that even line data for displaying uninput even lines is generated by interpolation (for example, average) with odd line data.

  As described above, since each field data has a different shooting time, when a still image is generated by simply combining the field data, a shifted image is obtained. In the present invention, since any one of the field data is used, a still image without deviation can be generated. Furthermore, using this still image, it is possible to generate a pasted image on a polygon with no displacement.

The second image generation support apparatus according to the present invention includes:
An image generation support device that supports generation of an image of a feature,
Image data for inputting at least one frame of field data in which line data is intermittently recorded from video image data in which the features captured while moving are recorded in an interlaced manner. An input section;
A generation unit that generates the image by correcting a horizontal shift amount caused by a difference in shooting timing between the field data and combining the field data with an image for one frame;
It is a summary to provide.

  The field data for one frame includes, for example, odd field image data and even field image data recorded continuously. According to the present invention, a shift in shooting timing between field data can be compensated for one frame, so that a still image without a shift can be generated. Furthermore, using this still image, it is possible to generate a pasted image on a polygon with no displacement.

In the second image generation support device of the present invention,
A shooting condition input unit for inputting a predetermined shooting condition that affects the shift amount;
The generation unit may calculate the deviation amount based on the photographing condition and perform the correction.

  In the above configuration, since the generation unit can calculate the amount of horizontal deviation between field data, appropriate correction can be performed.

In the image generation support device,
The shooting condition includes, for example, at least one of a moving speed at the time of shooting, a field angle of the camera, a distance between a shooting position and a feature, and a camera angle at the time of shooting. Can do.

In the second image generation support device of the present invention,
The generation unit may correct the shift amount by sequentially shifting at least one of the field data in the horizontal direction while evaluating the shift amount based on a predetermined parameter. .

  By so doing, appropriate correction based on the evaluation can be performed.

In the image generation support device,
The parameter may be a parameter representing a variation in gradation value between pixels arranged in the vertical direction with respect to the frame.

  An example of a parameter that represents a variation in gradation values is dispersion. A still image without deviation can be generated by sequentially shifting at least one of the field data in the horizontal direction so that the variation in gradation value between pixels is minimized.

  In addition, the generation unit may evaluate the shift amount for an area specified by a user in each field data.

  When a plurality of features are captured in one frame image, it may be inappropriate to evaluate the shift amount over the entire frame image. For example, this is a case where the distribution of gradation values of the entire frame image becomes too wide. According to the present invention, since the shift amount is evaluated for an area arbitrarily designated by the user, it is possible to appropriately evaluate and correct the shift amount for a desired feature.

The third image generation support device of the present invention is
An image generation support device that supports generation of an image of a feature,
A video image display unit for displaying video image data recording the feature photographed while moving;
A history data input unit for inputting history data in which the shooting positions of the video image data are recorded in time series;
Based on the history data, on the electronic map, a shooting position display unit that displays a moving image of the locus of the shooting position on the same time scale as the video image data;
It is a summary to provide.

  Here, “history data” is, for example, data recorded in a time series in which shooting positions such as latitude and longitude are associated with shooting times. The locus of the shooting position can be traced by the history data. Further, “moving image display” means that the screen moves within a predetermined time, and may be a continuous image display or a frame advance image display. According to the present invention, the user can easily visually grasp when and where the displayed video image was taken. Therefore, it is possible to easily know which feature on the electronic map the displayed feature corresponds to.

  In the image generation support device, the user adjusts the start time of the video image display and the shooting position trajectory so that the correspondence between the content of the video image and the shooting position trajectory is appropriate, and does not perform synchronous control. In addition, the display of the video image and the display of the trajectory of the shooting position may be displayed independently and in parallel, and a synchronization control unit for controlling the synchronization between the video image display unit and the shooting position display unit is further provided. It is preferable to provide.

  For example, the synchronization control unit can include the shooting time data in the video image data, and can control the synchronization between the video image shooting time and the history data shooting time. In this way, the correspondence between the content of the video image and the trajectory of the shooting position can be displayed more accurately.

The fourth image generation support device of the present invention is:
An image generation support device that supports generation of an image of a feature,
For video image data recording the feature photographed while moving, a history data input unit for inputting history data in which shooting positions are recorded in time series, and
A shooting condition input unit for inputting shooting conditions including a camera angle and a camera angle at the time of shooting;
A relative position specifying unit that specifies a relative position of the feature within the angle of view based on the position of the feature, the history data, and the imaging condition;
In the video image data, an output unit that outputs frame specifying information for specifying a frame that satisfies a predetermined condition in which the relative position is set in advance;
It is a summary to provide.

  By doing so, it is possible to easily specify the field data to be input to the above-described first or second image generation support device of the present invention. As a result, image generation can be supported.

In the image generation support device,
It is preferable that the predetermined condition is, for example, a condition in which the feature exists at approximately the center of the angle of view.

  If the object to be photographed deviates from the center of the field angle of the camera, the image may be distorted. With the configuration described above, it is possible to select a frame with a small distortion of the image at the time of shooting from a plurality of frames in which the feature to be shot is within the frame of the image.

In the fourth image generation support device of the present invention,
The frame specifying information is preferably, for example, a shooting time of the frame.

  By doing so, the photographing time and the frame can be associated with each other, so that a desired frame can be easily specified from a large number of frames.

  The present invention can be configured as an invention of a method for supporting generation of an image in addition to the configuration as the above-described image generation support apparatus. Further, the present invention can be realized in various modes such as a computer program that realizes these, a recording medium that records the program, and a data signal that includes the program and is embodied in a carrier wave. In addition, in each aspect, it is possible to apply the various additional elements shown above.

  When the present invention is configured as a computer program or a recording medium on which the program is recorded, the entire program for driving the image generation support apparatus may be configured, or only a part that performs the function of the present invention is configured. It may be a thing. The recording medium includes a flexible disk, a CD-ROM, a DVD-ROM, a magneto-optical disk, an IC card, a ROM cartridge, a punch card, a printed matter on which a code such as a barcode is printed, a computer internal storage device (RAM or Various types of computer-readable media such as a memory such as a ROM and an external storage device can be used.

Hereinafter, embodiments of the present invention will be described in the following order based on examples.
A. Configuration of the pasted image generation support device:
B. Synchronous display processing:
C. Frame identification processing:
D. Still image data generation processing (first embodiment):
E. Still image data generation processing (second embodiment):
F. Still image data generation processing (third embodiment):
G. Variations:

A. Configuration of the pasted image generation support device:
FIG. 1 is an explanatory diagram showing a configuration of a pasted image generation support apparatus 100 as an embodiment of the present invention. This pasted image generation support device 100 generates still image data from video image data photographed by an interlaced digital video camera 10 and supports the generation of a pasted image for pasting on a polygon as described above. Device. In this embodiment, the video image data is data obtained by photographing a feature such as a building while running with a digital video camera installed in a vehicle equipped with a so-called car navigation device. In the video image data of this embodiment, it is assumed that the shooting time of each frame is recorded together with the image data. The pasted image generation support device 100 corresponds to the image generation support device of the present invention.

  The pasted image generation support apparatus 100 includes a computer including a CPU, RAM, ROM, and the like, and a hard disk for storing various programs and data. The pasted image generation support apparatus 100 also includes two displays 50 and 60 and input devices such as an operation panel and a mouse (not shown) for inputting instructions from the user.

  The pasted image generation support apparatus 100 includes the functional blocks shown in the figure as software. These may be provided in hardware. Each of these functional blocks is controlled by a control unit (not shown).

  The input unit 110 inputs video image data recorded by the digital video camera 10, history data 20 in which shooting history is recorded, shooting condition data 30, and map data 40 from a recording medium such as a hard disk. The input unit 110 also inputs a user instruction from an input device such as an operation panel or a mouse.

  FIG. 2 is an explanatory diagram showing an example of the history data 20. As shown in the drawing, the history data 20 records the position information of the vehicle in which the digital video camera 10 is installed, that is, the latitude and longitude of the shooting position and the shooting time in association with each other. The latitude and longitude are detected by a position detection device such as a GPS antenna provided in the car navigation device.

  The shooting condition data 30 includes parameters that affect the amount of image shift caused by a difference in shooting timing between even-numbered field image data and odd-numbered field image data when shot with the digital video camera 10 while moving. . In this embodiment, as the shooting condition data 30, the installation state (camera angle) of the digital video camera 10 in the vehicle and the angle of view of the digital video camera 10 are used. In addition to these, the traveling speed of the vehicle at the time of shooting, the distance between the shooting position and the feature to be shot, the size of the image sensor of the digital video camera 10, the focal length of the lens, and the like may be included.

  The map data 40 is so-called electronic map data, in which data on the position (latitude, longitude) of features such as roads and buildings and their shapes are recorded together with attribute data such as their names.

  The pasted image generation support device 100 has three functions.

  The first function is a function (synchronous display processing) of displaying the shooting position locus and the video image in synchronization with the displays 50 and 60. This is mainly realized by the input unit 110, the synchronization control unit 120, and the display control unit 130. The synchronization control unit 120 synchronizes the locus of the shooting position and the video image based on the shooting time included in the video image data input to the input unit 110 and the shooting time of the history data. The display control unit 130 displays the shooting position p together with the electronic map map on the display 50 at the timing synchronized by the synchronization control unit 120, and the display 60 displays the video image pic of the building BLD taken from the shooting position p. Is displayed.

  With this first function, the correspondence between the content of the video image displayed on the display 60 and the locus of the shooting position displayed on the display 50 can be accurately displayed. Therefore, the user can easily visually grasp when and where the displayed video image was taken. In addition, it is possible to easily know which feature on the electronic map corresponds to the feature displayed on the display 60.

  The second function is a function for automatically specifying a frame in which a feature for which a pasted image is to be generated is appropriately captured from the video image data (frame specifying process). This is mainly realized by the input unit 110, the specifying unit 140, and the output unit 150. The specifying unit 140 specifies the relative position of the feature within the angle of view of the digital video camera 10 based on the history data input to the input unit 110, the shooting conditions, and the position of the feature. Details of this specifying method will be described later. The output unit 150 calculates a shooting time of a frame in which the relative position of the feature specified by the specifying unit 140 is the center of the angle of view of the digital video camera 10 and outputs the frame to the storage unit 160. The storage unit 160 stores the feature and the shooting time in association with each other.

  If the object to be photographed deviates from the center of the field angle of the camera, the image may be distorted. In the second function, by specifying the frame in which the feature exists in the center of the angle of view of the digital video camera 10, the feature to be photographed can be selected from among a plurality of frames in the image frame. It is possible to specify a frame with a small distortion of the image at the time of shooting. In addition, since the shooting time and the frame can be associated with each other, by outputting the shooting time of the specified frame, an appropriate frame used in the third function described below can be selected from a large number of frames. Can be easily identified.

  The third function is a function for generating a still image for generating a pasted image from video image data (still image data generation processing). This is mainly realized by the input unit 110 and the generation unit 170. The generation unit 170 acquires from the storage unit 160 the shooting time of the frame where the feature for which the pasted image is to be generated is the center of the angle of view of the digital video camera 10, and acquires image data corresponding thereto. And using this image data, still image data is produced | generated by the still image data production | generation process mentioned later. The still image data generated by the generation unit 170 is stored in the still image data storage unit 70.

  With this third function, as will be described later, it is possible to generate a still image without deviation from a moving image shot by the interlaced digital video camera 10 and generate an image pasted on a polygon.

  Hereinafter, the flow of processing corresponding to the three functions described above will be described.

B. Synchronous display processing:
FIG. 3 is a flowchart showing the flow of the synchronous display process. This is a process executed by the CPU of the pasted image generation support apparatus 100. First, the CPU acquires video image data using the input unit 110 (step S100). In this video image data, as described above, shooting time data is also recorded. Next, the history data 20 is acquired (step S110). Then, the synchronization control unit 120 synchronizes the shooting time included in the video image data and the shooting time included in the history data 20 (step S120). Then, the display control unit causes the display 50 to display the shooting position p together with the electronic map map, and causes the display 60 to display a video image of the feature shot from the shooting position p. (Step S130). These processes are performed until an instruction to interrupt or end the process is input by the user or display of all video image data is completed.

C. Frame identification processing:
FIG. 4 is a flowchart showing the flow of the frame specifying process. This is a process executed by the CPU of the pasted image generation support apparatus 100. First, the CPU acquires the history data 20 through the input unit 110 (step S200). Next, the photographing condition data 30 is acquired (step S210). Next, the position information of the feature is acquired from the map data 40 (step S220). Then, the specifying unit 140 specifies the relative position of the feature at the angle of view of the digital video camera (step S230), and the output unit 150 determines a frame in which the feature exists at the center of the angle of view of the digital video camera 10. Search is performed (step S240), and the shooting time of the frame is output (step S250). The above processing is performed for each feature for which a pasted image is to be generated.

  FIG. 5 is an explanatory diagram showing a frame specifying method in steps S230 and S240 described above. In the upper part and the lower part of FIG. 5A, display examples of the display 50 and the display 60 at time t1 are shown, respectively. In the upper part and the lower part of FIG. 5B, display examples of the display 50 and the display 60 at time t2 are shown, respectively. 5A and 5B, the building PLD position Pb (LAT1, LON1), the shooting positions Pc1 (LATx1, LONY1) and Pc2 (LATx2, LONY2) at each time, and the shooting conditions. (The camera angle θh and the angle of view θ of the digital video camera 10) are also shown. FIG. 5 illustrates a state in which the building BLD is located on the right side of the angle of view θ of the digital video camera 10 at the time t1, and is located on the left side at the time t2.

  Each parameter value described above can be acquired from the map data 40, the history data 20, and the shooting condition data 30, and using these, the relative position of the building BLD at the angle of view θ of the digital video camera 10 is determined by a predetermined calculation. Can be calculated. Furthermore, it is possible to calculate the time when the building BLD is located at the center of the angle of view θ of the digital video camera 10.

  In the illustrated example, the vector Vm of the moving direction of the shooting position P, the vector Vpc1pb of the direction from the shooting position Pc1 to the building BLD at the time t1, and the vector Vpc2pb of the direction from the shooting position Pc2 to the building BLD at the time t2 are It can be obtained from each position information.

The angle θt1 formed by the vector Vm and the vector Vpc1pb is
θt1 = cos-1 (Vm ・ Vpc1pb / (| Vm | * | Vpc1pc |))
It is. Here, Vm · Vpc1pb represents the inner product of the vector Vm and the vector Vpc1pv, and | Vm | and | Vpc1pb | represent the sizes of the vector Vm and the vector Vpc1pb.

The angle θt2 formed by the vector Vm and the vector Vpc2pb is
θt2 = cos-1 (Vm ・ Vpc2pb / (| Vm | * | Vpc2pc |))
It is. Here, Vm · Vpc2pb represents the inner product of the vector Vm and the vector Vpc2pv, and | Vm | and | Vpc2pb | represent the magnitudes of Vm and Vpc2pb.

  At time t1, the angle θt1 is smaller than the camera angle θh of the digital video camera 10, so the building BLD is located to the right of the angle of view of the digital video camera 10. At time t2, the angle θt2 is larger than the camera angle θh of the digital video camera 10, so the building BLD is located to the left of the angle of view of the digital video camera 10.

  The time when the building BLD is located at the center of the angle of view θ of the digital video camera is the time when the angle between the vector Vm and the vector in the direction of the building BLD from the shooting position coincides with the camera angle θh of the digital video camera 10. What is necessary is just to obtain | require this time.

  By such a frame specifying process, it is possible to easily specify field data used for a still image data generating process to be described later.

D. Still image data generation processing (first embodiment):
FIG. 6 is a flowchart showing the flow of still image data generation processing of the first embodiment. This is a process executed by the CPU of the pasted image generation support apparatus 100. First, the CPU acquires from the storage unit 160 the shooting time of a frame in which the feature for which the pasted image is to be generated exists at the center of the angle of view of the digital video camera 10 (step S300). Next, the odd field image data of the image data of the frame photographed at the photographing time is acquired (step S310). Then, even line data is generated by copying each odd line data (step S320). Then, the line data are combined (step S330) to generate still image data. Then, the generated still image data is stored in the still image data storage unit 70 in association with the feature (step S340). The association between the still image data and the feature may be performed individually by the user or may be associated with the position information of the feature. Moreover, when the name of the feature is included in the map data 40, it may be associated with the name of the feature.

  FIG. 7 is an explanatory diagram schematically showing how even line data is generated by copying odd line data. Each square in the figure represents a pixel. For example, the data of the even line even1 can be generated by copying each data of the odd line odd1 to the adjacent lower line. Accordingly, the RGB gradation values of the pixel B of the even line even1 are the same as the gradation values of the pixel A of the odd line odd1. Each gradation value of RGB of the pixel D of the even line even2 is the same as each gradation value of the pixel C of the odd line odd2.

  In the example described above, even line data is generated by copying odd line data. However, even line data may be generated by interpolation between odd line data. For example, the even line data even1 can be generated by interpolation (for example, average) of the odd line data odd1 and odd2. In this case, for example, each gradation value of the pixel B is an average value of each gradation value of the pixel A and each gradation value of the pixel B.

  In the still image data generation process of the first embodiment, a still image is generated using only odd field image data, so that the difference in shooting time between odd field image data and even field image data is not reflected in the still image data. . Therefore, it is possible to generate a still image without deviation and generate a pasted image on a polygon.

E. Still image data generation processing (second embodiment):
In the still image data generation process of the first embodiment described above, still image data is generated using odd field image data. In the second embodiment, still image data is generated using field data for one frame. .

  FIG. 8 is a flowchart showing the flow of still image data generation processing of the second embodiment. This is a process executed by the CPU of the pasted image generation support apparatus 100. First, the CPU obtains the shooting time of the frame in which the feature for which the pasted image is to be generated exists in the center of the angle of view of the digital video camera from the storage unit 160 (step S400). Next, the input unit 110 acquires image data of one frame taken at the shooting time (step S410). That is, the odd-numbered field image data and the even-numbered field image data closest to the shooting time acquired in step S400 are acquired. Next, shooting conditions are acquired (step S420).

  Next, based on the shooting conditions, the amount of horizontal shift due to the difference in shooting timing between the odd field image data and the even field image data is calculated (step S430). Since differences in specifications such as the number of pixels of the digital video camera 10 and shooting timing are known, the amount of deviation can be calculated by a predetermined calculation using the shooting conditions described above.

  FIG. 9 is an explanatory diagram showing a method of calculating the amount of horizontal displacement caused by the difference in shooting timing between odd field image data and even field image data. First, in order to facilitate understanding, an explanation will be given by taking as an example a case where shooting is performed while horizontally moving in a state where the distance between the shooting position and the shooting target is almost unchanged (see FIG. 9A). Consider the case of shooting with a digital video camera having a CCD with a size of N (mm) per pixel, shown enlarged on the right side of FIG. When the focal length of the digital video camera lens is f (mm) and the distance to the object to be photographed is L (mm), when the object to be photographed moves M (mm) in the horizontal direction, the image on the CCD is M · (F / L) (mm). That is, M · (f / L) / N pixels are moved.

  For example, using a digital video camera including a CCD having a lens focal length of 5 (mm) and a size of 0.005 (mm) per pixel, a building separated by 30 (m) is converted into 40 (km / In the case of shooting while horizontally moving in h), the shooting position moves about 185 (mm) in 1/60 (s). That is, the building moves relatively about 185 (mm). At this time, the image on the CCD moves about 0.03 (= 185 · (5/30000)) (mm), that is, about 6 pixels.

  In the example described above, in FIG. 9B, a digital video camera is installed on the vehicle in the direction of 90 degrees to the left with respect to the traveling direction (the direction of the vector Vma), while moving in the direction of the vector Vma at point p. This corresponds to the case where the building BLD1 existing 90 degrees to the left with respect to the traveling direction is photographed.

  Next, a digital video camera is installed in the vehicle in the direction of θh degrees to the left with respect to the traveling direction, and the building exists at θh degrees to the left with respect to the traveling direction while moving in the direction of the vector Vma at point p. A case where the BLD 2 is photographed will be described. In this case, as shown in FIG. 9B, the vector Vma is decomposed into a vector Vma2 in the installation direction of the digital video camera and a vector Vma1 orthogonal to the vector Vma2, as in the case described above. I can understand. That is, the magnitude of the vector Vma1 corresponds to the moving speed in the horizontal direction. Since the moving distance between 1/60 (s) is obtained from this moving speed, the horizontal shift amount between the odd field image data and the even field image data can be calculated. Here, a change in the distance between the photographing position point p and the building BLD2 due to the vector Vma2 is not considered.

  In this manner, the horizontal shift amount between the odd field image data and the even field image data can be calculated. In this embodiment, the moving speed of the shooting position is not input, but the moving speed of the shooting position can be easily calculated from the history data. In addition, the distance to the photographing object can be easily calculated from the photographing position and the position of the photographing object.

  When the shift amount is calculated in step S430 of FIG. 8, the shift amount is corrected by shifting at least one of the odd field image data and the even field image data in the horizontal direction according to the calculated value (step S440). In this embodiment, correction is performed by shifting even field image data in the horizontal direction, and corrected even field image data is generated. At this time, by performing correction, the image data of the pixels protruding from the image frame is deleted, and the image data for displaying black is added to the image data of the insufficient pixels.

  Then, the odd field image data and the corrected even field image data are synthesized (step S450) to generate still image data. Then, the generated still image data is stored in the still image data storage unit 70 in association with the feature (step S460).

  FIG. 10 is an explanatory diagram schematically showing how still image data is generated in the second embodiment. Each square in the figure represents a pixel. As can be seen from the figure, the odd-numbered field image data and the even-numbered field image data before correction are shifted in the horizontal direction (left figure). The generation unit 170 calculates that even-numbered field image data is shifted to the right by two pixels, and performs correction to shift this to the left by two pixels (right diagram). Note that the right diagram in FIG. 10 also shows pixels that have been removed from the frame of the image by correction, and pixels that have been added in shortage.

  In the still image data generation process of the second embodiment, the amount of horizontal deviation due to the difference in shooting time between field data can be calculated based on the shooting conditions, so that appropriate correction can be performed. . As a result, it is possible to generate a still image without deviation and generate a pasted image on a polygon.

F. Still image data generation processing (third embodiment):
In the still image data generation process of the second embodiment described above, the correction is performed by shifting the line data based on the calculated shift amount. However, in the still image data generation process of the third embodiment, the line data is sequentially updated. While performing a predetermined evaluation, the optimal shift amount is determined and corrected.

  FIG. 11 is a flowchart showing the flow of still image data generation processing of the third embodiment. This is a process executed by the CPU of the pasted image generation support apparatus 100. First, the CPU acquires the shooting time of a frame in which the feature for which the pasted image is to be generated exists in the center of the angle of view of the digital video camera (step S500). Next, the input unit 110 obtains one frame of image data taken at the shooting time (step S510), and synthesizes this to generate still image data (step S520).

  Next, a designated area on the image data designated by the user is acquired (step S530). In this embodiment, the image data generated in step S520 is displayed on the display 60, and the user designates and inputs an area on the display screen using a mouse.

  Next, the variation in gradation value is calculated for the pixels in the designated area (step S540). In this embodiment, variance is used as a parameter representing variation. Parameters other than dispersion may be used. Then, the variance value as the evaluation value is temporarily stored (step S542). Next, the even field image data is shifted in the horizontal direction (step S543), and is synthesized again to generate still image data (step S544). Then, the variation in gradation value is calculated again for the pixels in the designated area (step S546). Then, the evaluation value is temporarily stored (step S548). Next, it is determined whether or not the variance value has a minimum value (step S550). When there is a minimum value, the shift amount when the minimum value is obtained is determined as the optimum shift amount. Then, correction is performed by shifting even field image data by this shift amount (step S560), and corrected even field image data is generated. If there is no minimum value, steps S543 to S550 are repeated.

  Then, the odd field image data and the corrected even field image data are synthesized (step S570), and still image data is generated. Then, the generated still image data is stored in the still image data storage unit 70 in association with the feature (step S580).

  FIG. 12 is an explanatory diagram schematically showing how still image data is generated in the third embodiment. The upper part of FIG. 12 shows the state of the image when sequential correction is performed. In the figure, the designated region R is also indicated by a broken line. “State 1” indicates an image as it is input. “State 2” indicates an image in which even-field image data is shifted to the left by one pixel. “State 3” indicates an image obtained by shifting even-numbered field image data by two pixels. “State 4” indicates an image obtained by shifting even-numbered field image data by three pixels.

  The lower part of FIG. 12 shows the dispersion value in each state. In the illustrated example, it can be seen that in “state 3”, the variance has a minimum value. Therefore, the “state 3” image obtained by shifting the even field image data to the left by 3 pixels from the “state 1” image is the still image to be finally saved.

  In the still image data generation process according to the third embodiment, the amount of horizontal deviation caused by the difference in shooting time between field data can be corrected while evaluating based on the variance, so that appropriate correction is performed. Can do. As a result, it is possible to generate a still image without deviation and generate a pasted image on a polygon.

G. Variations:
As mentioned above, although several embodiment of this invention was described, this invention is not limited to such embodiment at all, and implementation in a various aspect is possible within the range which does not deviate from the summary. It is. For example, the following modifications are possible.

G1. Modification 1:
In the still image data generation process of the first embodiment, even line data is generated using odd field image data, but the present invention is not limited to this. In general, the present invention generates non-input line data by using any field data and generates still image data by combining them. Therefore, odd line data is generated by using even field image data. It is good also as what to do.

G2. Modification 2:
In the still image data generation processing of the second and third embodiments, the correction is performed by shifting the even field image data in the horizontal direction. However, the present invention is not limited to this. In the present invention, correction is generally performed by shifting one of the field data in the horizontal direction. For example, the odd field image data may be shifted, or both may be shifted.

  In the second still image data generation process, field data for one frame is input. However, field data for two or more frames is input, and the horizontal data between the field data is input using these data. The amount of deviation may be calculated.

G3. Modification 3:
In the still image data generation process of the third embodiment, the variation of the gradation value between pixels is evaluated for the designated area designated by the user, but the predetermined area is arranged in the vertical direction. Alternatively, evaluation of variations in gradation values between pixels may be performed.

G4. Modification 4:
In the embodiment described above, the pasted image generation support apparatus 100 includes the synchronization control unit 120, but may not include this. In this case, for example, the user matches the start time of the display of the video image displayed on the display 60 and the locus of the shooting position displayed on the display 50, and displays both of them independently and in parallel on the same time scale. You may make it make it.

G5. Modification 5:
In the frame specifying process of the above-described embodiment, the feature specifies the frame that exists in the center of the angle of view of the digital video camera 10, but the present invention is not limited to this. A frame that satisfies a predetermined condition may be specified.

G6. Modification 6:
In the frame specifying process of the above-described embodiment, the captured various objects are set as the processing targets of the frame specifying process, but the present invention is not limited to this. For example, on the electronic map map displayed on the display 50, the user may individually specify the feature to be processed. Since the position information of the designated feature can be identified from the map data 40, the frame in which the designated feature exists at the center of the angle of view is identified as described above with reference to FIG. be able to. By enabling the user to specify the features to be processed, the user can extract only the frames where the features necessary for generating the pasted image are taken, so the processing time can be shortened. .

G7. Modification 7:
In the above embodiment, the video image data to be handled is video image data recorded by the interlaced digital video camera 10, but the present invention is not limited to this. The first and second functions of the pasted image generation support apparatus 100 described above can also be applied to video image data recorded by a progressive digital video camera.

G8. Modification 8:
In the above embodiment, the pasted image generation support apparatus 100 has the three functions described above. However, the pasted image generation support apparatus may be configured to independently include at least one of the functions. Good.

It is explanatory drawing which shows the structure of the sticking image generation assistance apparatus 100 as one Example of this invention. It is explanatory drawing which shows an example of the historical data. It is a flowchart which shows the flow of a synchronous display process. It is a flowchart which shows the flow of a frame specific process. It is explanatory drawing which shows the identification method of a flame | frame. It is a flowchart which shows the flow of the still image data generation process of 1st Example. It is explanatory drawing which shows typically a mode that even line data is produced | generated by copying odd line data. It is a flowchart which shows the flow of the still image data generation process of 2nd Example. It is explanatory drawing which shows the calculation method of the deviation | shift amount of the horizontal direction resulting from the difference in the imaging | photography timing of odd field image data and even field image data. It is explanatory drawing which shows typically the mode of the production | generation of the still image data in 2nd Example. It is a flowchart which shows the flow of the still image data generation process of 3rd Example. It is explanatory drawing which shows typically the mode of the production | generation of the still image data in 3rd Example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Digital video camera 20 ... History data 30 ... Shooting condition data 40 ... Map data 50, 60 ... Display 70 ... Still image data memory | storage part 100 ... Paste image generation support Device 110 ... Input unit 120 ... Synchronization control unit 130 ... Display control unit 140 ... Specification unit 150 ... Output unit 160 ... Storage unit 170 ... Generation unit R ... Designation region

Claims (6)

An image generation support device that supports generation of an image of a feature,
A history data input unit for inputting, from a first recording medium, history data in which shooting positions are recorded in time series for video image data in which the features photographed while moving are recorded;
A shooting condition input unit for inputting shooting conditions including a camera angle at the time of shooting and a field angle of the camera from a second recording medium;
A relative position specifying unit that specifies a relative position of the feature within the angle of view based on the position of the feature, the history data, and the imaging condition;
In the video image data, an output unit that outputs frame specifying information for specifying a frame that satisfies a predetermined condition in which the relative position is set in advance;
An image generation support apparatus. The image generation support device according to claim 1,
The predetermined condition is a condition in which the feature exists at approximately the center of the angle of view.
Image generation support device. The image generation support device according to claim 1,
The frame specifying information is a shooting time of the frame.
Image generation support device. An image generation support method for supporting generation of an image of a feature,
(A) a step in which a computer acquires history data in which shooting positions are recorded in time series for video image data in which the features shot while moving are recorded from a first recording medium;
(B) the computer obtaining a shooting condition including a camera angle at the time of shooting and a field angle of the camera from a second recording medium;
(C) the computer specifying a relative position of the feature within the angle of view based on the position of the feature, the history data, and the imaging condition;
(D) the computer outputting frame specifying information for specifying a frame satisfying a predetermined condition in which the relative position is preset in the video image data;
An image generation support method comprising: A computer program for controlling an image generation support apparatus that supports generation of an image of a feature,
A function of acquiring, from the first recording medium, history data in which shooting positions are recorded in time series for video image data recorded with the features photographed while moving;
A function of acquiring shooting conditions including a camera angle at the time of shooting and a field angle of the camera from a second recording medium;
A function for specifying the relative position of the feature within the angle of view based on the position of the feature, the history data, and the imaging condition;
A function of outputting frame specifying information for specifying a frame that satisfies a predetermined condition in which the relative position is preset in the video image data;
A computer program for realizing a computer.   A recording medium on which the computer program according to claim 5 is recorded so as to be readable by a computer.

Images