JP2009171110A - Photographing apparatus, picture synthesizing device, photographing method, and picture synthesizing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing apparatus applicable to a product, and to provide the photographing apparatus which has high convenience for photographing a panorama picture. <P>SOLUTION: The photographing apparatus is composed to be provided with: an photographing means (1, 2); a means (8) for detecting a position of the photographing apparatus; a means (6) which relates position information of the photographing apparatus to a picture signal; a means (7) for discriminating overlapping of a first picture signal which is associated with first position information of the photographing apparatus detected at a first object photographing time and a second picture signal which is associated with second position information of the photographing apparatus detected at a second object photographing time by means of the first position information and the second position information, and synthesizes the signals so as to add a non-overlapping part of the first picture signal and the second picture signal; and a means (3) for recording the synthesized picture signal. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

The present invention relates to a photographing apparatus. The present invention also relates to a photographing apparatus that combines a plurality of photographed videos.

In recent years, photographing apparatuses for photographing a subject have become widespread. A method for synthesizing photographed images has been proposed.
In Patent Document 1, in the synthesis of a panoramic image or a high resolution image from a moving image, a large number of frame images input one after another are processed and recorded in real time without delay,
A technique is disclosed that enables an indicator display indicating the progress and result of the synthesis process to be executed simultaneously.

Specifically, this technique includes a display unit that displays a moving image being shot, a unit that sequentially captures frame images from the moving image, compares two frame images having different capturing times, and calculates a movement amount; Means for recording a difference image between two frame images and the amount of movement; means for creating indicator information symbolizing a composite image synthesized from the stored amount of movement and the captured frame image; and the difference Means is provided for synthesizing a panoramic image using the image and the movement amount.

However, this Patent Document 1 discloses a technique for processing an image in real time. For example, a new part of the first video signal and the second video signal is added, that is, a part where they do not overlap is added. Thus, no technique for synthesizing is disclosed. For this reason, it was not yet sufficient in terms of application to products.
JP2000-244814

Accordingly, the present invention has been made in consideration of the above-described circumstances, and an object thereof is to provide a photographing apparatus applicable to a product. It is another object of the present invention to provide a photographing apparatus that is highly convenient for photographing panoramic images.

An imaging apparatus according to the present invention is an imaging unit that captures an image of a subject, converts the captured image into a video signal and outputs the image, a position detection unit that detects a position of the imaging device at the time of imaging, and is detected when the subject is captured. Further, the position information association means for associating the position information of the photographing apparatus with the output video signal, and the first video signal associated with the first position information of the photographing apparatus detected at the time of photographing the first subject. The partial area deleting means for deleting a partial area, the first video signal from which the partial area has been deleted, and the second position information of the imaging apparatus detected at the time of shooting the second subject are associated with each other. A combining unit that combines the second video signal using the first position information and the second position information; and a recording unit that records the combined video signal. .

An imaging apparatus according to the present invention is an imaging unit that captures an image of a subject, converts the captured image into a video signal and outputs the image, a position detection unit that detects a position of the imaging device at the time of imaging, and is detected when the subject is captured. Position information association means for associating the position information of the photographing apparatus with the output video signal, and a first video signal associated with the first position information of the photographing apparatus detected at the time of photographing the first subject. The overlap of the second video signal associated with the second position information of the photographing device detected at the time of photographing the second subject is determined using the first position information and the second position information. The first video signal and the second video signal are combined so as to add a portion that does not overlap, and the recording unit records the synthesized video signal.

An image synthesizing apparatus according to the present invention includes a photographing means for photographing a subject, converting the photographed video into a video signal, and outputting, a position detecting means for detecting the position of the photographing device at the time of photographing, and detecting at the time of photographing the subject. A first video signal in which the positional information association means for associating the positional information of the imaging device thus obtained with the output video signal is associated with the first positional information of the imaging device detected at the time of photographing the first subject And overlapping of the second video signal associated with the second position information of the photographing device detected at the time of photographing the second subject is determined using the first position information and the second position information. Then, the first video signal and the second video signal are combined so as to add a portion that does not overlap.

The photographing method according to the present invention includes a step of photographing a subject, converting the photographed video into a video signal and outputting the video signal, a step of detecting a position of the photographing device at the time of photographing, and the photographing detected at the time of photographing the subject. Associating the position information of the apparatus with the output video signal and the first position information associated with the first position information of the photographing apparatus detected at the time of photographing the first subject
Of the first video signal and the second video signal associated with the second position information of the photographing apparatus detected at the time of photographing the second subject, the first position information and the second position information are The first video signal and the second video signal are combined so as to add a portion that does not overlap, and the combined video signal is recorded.

The image composition method according to the present invention includes a step of photographing a subject, converting the photographed video into a video signal, outputting the video signal, a step of detecting a position of the photographing device at the time of photographing, and the above-described detection detected at the time of photographing the subject. A step of associating position information of the photographing device with the output video signal, a first video signal associated with the first position information of the photographing device detected at the time of photographing the first subject, and a second subject. An overlap of the second video signal associated with the second position information of the photographing apparatus detected at the time of photographing is determined using the first position information and the second position information, and the first position information is determined. The video signal and the second video signal are combined so as to add a portion that does not overlap.

According to the configuration described above, it is possible to provide a photographing apparatus applicable to a product. In addition, it is possible to provide a photographing apparatus that is highly convenient for photographing panoramic images.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a photographing apparatus according to an embodiment of the present invention.
Reference numeral 1 is an imaging unit, reference numeral 2 is an image processing unit, reference numeral 3 is a memory, reference numeral 4 is a display, reference numeral 5 is an operation unit (touch panel), reference numeral 6 is a microcomputer, reference numeral 7 is a panoramic image generation unit, reference numeral 8
Denotes a gyro sensor, and reference numeral 10 denotes a photographing device (video camera).

Here, a video camera will be described as an example of the photographing apparatus 10. The video camera 10 includes an imaging unit 1, an image processing unit 2, a memory 3, a touch panel 5 and a display 4. Furthermore, a gyro sensor 8 for detecting the movement of the camera, a microcomputer 6 having a panoramic still image processing function, and a panoramic still image generating unit 7 are configured.

The imaging unit 1, the image processing unit 2, and the memory 3 store the image data of the subject photographed using the imaging unit 1 in the memory 3 in an optimal form.
The display 4 displays a moving image called from the memory 3 and a panoramic still image created by the photographing apparatus 10.
The touch panel 5 has means for accepting an operation from the user such as a panorama still image deletion range designation or a frame image arrangement method change, and transmits the information to the microcomputer 6 according to the user operation.

The gyro sensor 8 is used to detect position information, and is used to measure how much the camera position at the time of the second photographing has moved relative to the camera position at the time of the first photographing.

The microcomputer 6 is connected to the gyro sensor 8 and recognizes the position where the video camera 10 is shooting using a signal including position information transmitted from the gyro sensor 8. Arrange according to the information and create a panoramic image. Also, a part of a predetermined panoramic still image is deleted or the arrangement of the frame image is changed based on information obtained via the display 4 in accordance with a user operation.

Here, the gyro sensor 8 is used as the position information detecting means. However, if there is another means for detecting the position information, it can be replaced with this.
FIG. 2 is a flowchart for creating a panoramic still image according to the embodiment of the present invention.
Here, the gyro sensor indicates the positional relationship between the latest frame image at the time when the second video signal (second image) is called from the memory 3 and the panoramic still image (first video signal) being created. 8 is recognized and added to the panoramic still image according to the set arrangement method.

In the photographing apparatus (video camera) 10 according to the embodiment of the present invention, it is possible to generate a panoramic still image by superimposing a plurality of images acquired from a moving image or the like.

Reference numeral 100 is a start step here. Subsequently, the process proceeds to the step denoted by reference numeral 101.
Reference numeral 101 denotes a step of shooting a moving image. That is, a photographing device (video camera)
10, the display (liquid crystal unit) 4 of the photographing apparatus (video camera) 10 is performing an operation of superimposing a plurality of images obtained there while creating a panoramic still image while photographing. The panoramic still image created at that time is displayed as needed. Subsequently, the process proceeds to the step denoted by reference numeral 102.

Reference numeral 102 denotes a step of determining whether or not to create a panoramic image. When it is determined that a panoramic image is to be created, the process proceeds to the step denoted by reference numeral 103 (Yes). If it is not determined to create a panoramic image, the process proceeds to the step denoted by reference numeral 105 (No).

In the embodiment of the present invention, the photographer (user) can delete any part of the panoramic still image and continuously perform the above operation again while performing the operation of displaying the panoramic still image as needed. It is.

Reference numeral 103 denotes a step in which the photographer (user) determines whether or not to delete an arbitrary portion of the panoramic still image during the operation of displaying the panoramic still image as needed. When it is determined to delete any part of the panoramic still image, the process proceeds to the step denoted by reference numeral 104 (Yes).
If it is not determined to delete any part of the panoramic still image, the process proceeds to the step denoted by reference numeral 105 (No).

Reference numeral 104 denotes a step of calling the latest frame from the memory 3. Followed by sign 10
Go to step marked 5.
Reference numeral 105 detects position information using the gyro sensor 8 as described above, and the photographing apparatus 10.
This is a step of detecting the movement of When determining an arrangement position, it progresses to the step attached with the code | symbol 106. FIG. When selecting the deletion range, the process proceeds to the step denoted by reference numeral 112.

Reference numeral 112 denotes a step of selecting a deletion range. Subsequently, the process proceeds to the step denoted by reference numeral 113.
Reference numeral 106 denotes a step of determining an arrangement position. Subsequently, the process proceeds to the step denoted by reference numeral 107.
Reference numeral 107 denotes a step of detecting whether or not images to be panorama synthesized overlap each other. If it is detected that there is an overlap between images to be panorama synthesized, the process proceeds to the step denoted by reference numeral 108 (Yes). If it is detected that there is no overlap between the images to be panorama synthesized, the process proceeds to the step marked 110 (No).

In the embodiment of the present invention, when a panoramic still image is created from a plurality of frame images with respect to an operation for displaying a panoramic still image as needed, there is a portion where the panoramic still image and the new image overlap at that time. In this case, it is possible to perform an operation for creating a panoramic still image (hereinafter referred to as “addition”) by adding only a new part without changing the panoramic still image.

In addition, an operation (hereinafter referred to as overwriting) of deleting a panoramic still image of an overlapping portion and overwriting a new image from above is also possible.
In addition, it is possible to switch overwriting and overwriting operations for creating a panoramic still image according to the preference of the photographer (user).
Reference numeral 108 denotes a step of detecting whether or not the above writing and overwriting are performed. When adding or overwriting, the process proceeds to the step denoted by reference numeral 109 (Yes). If no writing or overwriting is performed, the process proceeds to the step denoted by reference numeral 113 (No).

Reference numeral 109 denotes a step of processing a frame image in order to perform the above addition or overwriting. Subsequently, the process proceeds to the step denoted by reference numeral 110.
Reference numeral 113 is a step of deleting the panoramic still image of the overlapping portion. Next, sign 11
Go to step marked with 0.
Reference numeral 110 denotes a step of arranging a frame image in order to create the panoramic still image. Subsequently, the process proceeds to the step denoted by reference numeral 111.
Reference numeral 111 denotes frame image data arranged to create the panoramic still image.
This is a step of displaying on the display 4 and updating and recording in the memory 3. The panoramic still image (first video signal) completed at that time and the moving image being captured (second video signal)
It is displayed on the display as shown in FIG. 3 (described later). Subsequently, the process proceeds to the step denoted by reference numeral 114.

Reference numeral 114 denotes a step of determining the end of panoramic still image creation. If it is determined that the panoramic still image creation is to end, the process proceeds to the step denoted by reference numeral 115 (Yes). If it is not determined that the panoramic still image creation is to be terminated, the process proceeds to the step denoted by reference numeral 103 and the above process is repeated (No).

Reference numeral 115 is an end step, and the processing here ends.
That is, in the embodiment of the present invention, in the flow for creating a panoramic still image, it is possible to change the arrangement of the frame images and delete any part of the panoramic still image for editing.

Here, the change of the arrangement will be described.
For example, in the flowchart shown in FIG. 2, the arrangement can be changed as needed by overwriting and adding in accordance with a user operation. And if there is a part that overlaps the panoramic still image and the frame image, if it is overwritten, only the part that overlaps the panoramic still image is deleted,
If it is added, only the overlapping part of the frame image is deleted.

An example of changing the arrangement in the case of writing is shown in FIG. 5 (described later).
The deletion of the panoramic still image will be described.
For example, in the flowchart shown in FIG.
If an operation of deleting a predetermined portion of the panoramic still image created at that time is performed, the deletion operation is executed without acquiring the frame image from the memory in the next flow.
When this deletion operation ends, the process returns to the basic flow again.

Note that the position information is continuously acquired from the gyro sensor 8 even during the execution of this deletion flow.
For this reason, the positional relationship between the frame image and the panoramic still image can be grasped. This operation is continued until an instruction to end panoramic still image creation is received.

FIG. 3 is a diagram showing a moving image and still image display method according to the embodiment of the present invention.
The symbol a is a first video that has already been shot and recorded in the memory 3. The symbol b is
This is a video currently being shot, that is, a second video. The second video b is a moving image. Here, the first video a and the second video b are displayed in a panoramic arrangement.

As described above, the imaging device 10 according to the embodiment of the present invention determines the positional relationship between the latest frame image recorded in the memory 3 and the panoramic still image being created when the second video b is captured. This is recognized using the gyro sensor 8 and added to the panoramic still image being created in accordance with a preset arrangement method. And the panoramic still image (the first
Video a) and the moving image being captured (second video b) are displayed on the display 4.

Reference numeral 4a denotes a second video b (moving image). Here, it is displayed on the left side of the display 4. Reference numeral 4b denotes a panoramic still image (first video a) and a moving image being captured (second video b).
) Is a panoramic still image with the image processed from the above. Here, it is displayed on the right side of the display 4.

FIG. 4 is a diagram showing a time series when performing display and editing operations of moving images and still images according to another embodiment of the present invention.
Reference numeral 21a is a panoramic still image (first video a) that is completed at that time. Reference numeral 21b denotes the moving image being captured (second video b). The panoramic image edited as described above from the panoramic still image (first video a) 21a and the moving image being captured (second video b) 21b is a panoramic image to which reference numeral 31 is attached.

Here, the moving image capturing range shows the current location and the display on the display arranged in time series. The time elapses in the order of time1 → time2 → time3 → time4.

Here, the panoramic image 31 is a panoramic image edited at time time1.
Then, as described above, panorama images are created continuously.
Reference numeral 32 denotes a panoramic image edited at time time 2 by the continuous creation of panoramic images. Reference numeral 33 denotes a panoramic image edited at time time3. Reference numeral 34 denotes a panoramic image edited at time time4.

In the embodiment of the present invention, a panoramic still image is created as time passes, and the panoramic still image that has been created at that time can be displayed at any time. Also, time ti
After me3, delete any part of panorama still image (Edit part 20) and then again time4
It is possible to shoot a moving image and correct the deleted part.

FIG. 5 is a diagram showing how the arrangement of the frame image is changed (added) according to the embodiment of the present invention. As shown in the figure, here, the frame 1 → frame 2 → frame 3 and the shooting range changes in time series. Further, a panoramic image is created as described above in accordance with the changed shooting range.

By configuring as described above, in the embodiment of the present invention, there is an effect that it is possible to provide a photographing apparatus applicable to a product. In addition, there is an effect that it is possible to provide a highly convenient photographing apparatus for panoramic image photographing. In addition, when editing a panoramic image, if there is a portion where the panoramic still image and the new image overlap, it is possible to create a panoramic still image by adding only the new portion without changing the panoramic still image. effective. Further, there is an effect that it is possible to delete the panoramic still image of the overlapping portion and overwrite the new image from above. In addition, there is an effect that it is possible to switch overwriting and overwriting operations for creating a panoramic still image according to user preferences.

Note that the present invention is not limited to the above-described embodiment as it is, and various modifications can be made to the constituent elements without departing from the spirit of the invention at the implementation stage.

The block diagram which shows the structure of the imaging device based on Embodiment of this invention. The flowchart which produces a panoramic still image based on embodiment of this invention. The figure which shows the display method of the moving image and still image based on embodiment of this invention. The figure which shows the time series at the time of performing the display and edit operation | movement of a moving image and a still image based on other embodiment of this invention. The figure which shows the change (addition) of arrangement | positioning of the frame image based on embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Imaging part, 2 ... Image processing part, 3 ... Memory, 4 ... Display, 5 ... Operation part (touch panel), 6 ... Microcomputer, 7 ... Panoramic image generation part, 8 ... Gyro sensor, 10 ... Image pick-up device (camera) .

Claims (9)

In a photographic device that synthesizes and records captured images,
Photographing means for photographing a subject, converting the photographed video into a video signal, and outputting;
Position detecting means for detecting the position of the imaging device at the time of imaging;
Position information associating means for associating position information of the photographing apparatus detected at the time of photographing an object with the output video signal;
The first associated with the first position information of the photographing device detected at the time of photographing the first subject
A partial area deleting means for deleting a partial area from the video signal of
A first video signal in which the partial area is deleted and a second video signal in which second position information of the photographing apparatus detected at the time of second subject photographing is associated with the first position. Combining means for combining information and the second position information;
An imaging apparatus comprising recording means for recording the synthesized video signal. In a photographic device that synthesizes and records captured images,
Photographing means for photographing a subject, converting the photographed video into a video signal, and outputting;
Position detecting means for detecting the position of the imaging device at the time of imaging;
Position information associating means for associating position information of the photographing apparatus detected at the time of photographing an object with the output video signal;
The first associated with the first position information of the photographing device detected at the time of photographing the first subject
Of the first video signal and the second video signal associated with the second position information of the photographing apparatus detected at the time of photographing the second subject, the first position information and the second position information are And combining means for adding so as to add a portion where the first video signal and the second video signal do not overlap, and recording means for recording the combined video signal. Shooting device. In an image synthesizer that outputs captured video,
Photographing means for photographing a subject, converting the photographed video into a video signal, and outputting;
Position detecting means for detecting the position of the imaging device at the time of imaging;
Position information associating means for associating position information of the photographing apparatus detected at the time of photographing an object with the output video signal;
The first associated with the first position information of the photographing device detected at the time of photographing the first subject
Of the first video signal and the second video signal associated with the second position information of the photographing apparatus detected at the time of photographing the second subject, the first position information and the second position information are An image synthesizing apparatus comprising: a synthesizing unit that synthesizes the first video signal and the second video signal so as to add a portion that does not overlap. Using the first position information and the second position information, the movement of the photographing apparatus is detected and synthesized so as to add a portion where the first video signal and the second video signal do not overlap. The photographing apparatus or the image synthesizing apparatus according to claim 1. The photographing apparatus or the image synthesizing apparatus according to claim 4, wherein the position detecting unit uses a gyro sensor. 6. The photographing apparatus or the image synthesizing apparatus according to claim 5, wherein the synthesized video signal is a still image. Shooting a subject, converting the shot video into a video signal and outputting the video signal;
Detecting the position of the imaging device at the time of imaging;
Associating position information of the photographing device detected at the time of subject photographing with the output video signal;
The first associated with the first position information of the photographing device detected at the time of photographing the first subject
Removing a part of the area from the video signal of
A first video signal in which the partial area is deleted and a second video signal in which second position information of the photographing apparatus detected at the time of second subject photographing is associated with the first position. Combining using information and the second position information;
An imaging method comprising the step of recording the synthesized video signal. Shooting a subject, converting the shot video into a video signal and outputting the video signal;
Detecting the position of the imaging device at the time of imaging;
Associating position information of the photographing device detected at the time of subject photographing with the output video signal;
The first associated with the first position information of the photographing device detected at the time of photographing the first subject
Of the first video signal and the second video signal associated with the second position information of the photographing apparatus detected at the time of photographing the second subject, the first position information and the second position information are And a step of combining the first video signal and the second video signal so as to add a portion that does not overlap, and a step of recording the combined video signal. . Shooting a subject, converting the shot video into a video signal and outputting the video signal;
Detecting the position of the imaging device at the time of imaging;
Associating position information of the photographing device detected at the time of subject photographing with the output video signal;
The first associated with the first position information of the photographing device detected at the time of photographing the first subject
Of the first video signal and the second video signal associated with the second position information of the photographing apparatus detected at the time of photographing the second subject, the first position information and the second position information are And a step of synthesizing the first video signal and the second video signal so as to add a portion that does not overlap.

Images