KR102090271B1 - Photographing apparatus - Google Patents

Abstract

The present invention relates to an imaging device, and the imaging device according to an embodiment of the present invention rapidly overlaps a still image captured at the same time by optimizing the position of each imaging device for imaging still images constituting a panoramic image. Even if the subject is moving, it is possible to quickly capture a panoramic image while preventing the same subject from being duplicated and present in the panoramic image.

Description

Imaging apparatus {Photographing apparatus}

The present invention relates to an imaging device, and more particularly to an imaging device for imaging a panoramic image.

In general, a panoramic image is generated by capturing each still image so as to have an overlapping portion, and performing synthesis by overlapping and overlapping the overlapping portions. Therefore, it is difficult to generate a panoramic image when each still image does not overlap properly, such as when the portions where the still images overlap each other are insufficient.

As a conventional technique for appropriately overlapping each still image constituting a panoramic image, a single camera and a computer are connected, and a full-size still image captured from the camera is transmitted to the computer, and the size is smaller than that of the still image. Images are always sent. Then, the camera is moved so that the confirmation image at the time of capturing the still image displayed on the screen of the computer and the current confirmation image are properly overlapped, and the position of the camera when capturing the next still image is set. In this way, it is possible to rapidly capture a panoramic image.

According to an embodiment of the present invention, by optimizing the positions of respective imaging devices that respectively capture still images constituting a panoramic image, still images captured at the same time can be quickly overlapped, and the same subject overlaps even when the subject moves. It is to provide an imaging device capable of quickly capturing a panoramic image while preventing it from being present in the panoramic image.

In order to achieve the above technical problem, an imaging apparatus for imaging a panoramic image according to an embodiment of the present invention includes imaging means for imaging a moving image and a still image; Transmitting means for transmitting the moving images and still images captured by the imaging means to another imaging device; Receiving means for receiving a moving image and a still image respectively captured by the other imaging device from the other device; For detecting a common portion between the moving image captured by the imaging means and the moving image received by the receiving means, and the common portion between the still image captured by the imaging means and the still image received by the receiving means, respectively. Common part detection means; The moving image captured by the imaging means and at least a portion of the moving image captured by the other imaging device received by the receiving means and the common portion detected by the common portion detecting means are superimposed on each other and synthesized. A composite moving image generating means for generating a composite moving image displayed to grasp the relative positional relationship of the other imaging device; Display means for displaying the composite moving image generated by the composite moving image generating means; And a panorama in which a still image captured by the imaging means and a still image captured by the other imaging device and a common portion detected by the common portion detecting means are superimposed and combined with each other according to the relative positional relationship. It is characterized by including image generating means.

An imaging device according to an embodiment of the present invention transmits and receives a moving image and a still image captured by an imaging device and another imaging device to each other, and detects a common portion between the moving images and the still images. Then, at least a portion of a moving image captured by the imaging device and a moving image captured by another imaging device are superimposed and combined with each other so that the relative positional relationship between the imaging devices is grasped. Then, a panoramic image is generated by synthesizing the common portions detected by superimposing the still images captured by the respective imaging devices in the corresponding positional relationship. Thereby, by optimizing the positions of the respective imaging devices for imaging still images constituting the panoramic image, it is possible to quickly overlap still images captured at the same time. Therefore, even when the subject moves, it is possible to quickly capture the panoramic image while preventing the same subject from overlapping and existing in the panoramic image.

1 is a block diagram of an imaging device according to a first embodiment of the present invention.
2 is a view showing an example of a composite moving image.
3 is a diagram showing another example of a composite moving image.
4 is a flowchart showing the operation of the imaging device when imaging a panoramic image by the imaging device.
5 is a view showing a screen of a display unit of an imaging device in which a composite moving image and a panoramic moving image are simultaneously displayed.
FIG. 6 is a view showing a screen for instructing the movement of an imaging position with respect to another imaging device and a screen on which the movement of the imaging device is displayed in another imaging device.
7 is a function of sequentially capturing a plurality of still images in each imaging device and selecting a combination of any one of the plurality of captured still images in response to a user's instruction to capture a single still image; It is an explanatory diagram.
8 is a block diagram of an imaging device according to a second embodiment of the present invention.
9 is an explanatory diagram showing the imaging directions of the imaging device and other imaging devices, and a composite moving image displayed on each imaging device, respectively.
Fig. 10 is an explanatory diagram showing an imaging direction of each imaging device and a composite moving image displayed on each imaging device when there is no difference in the relative orientation between the imaging device and the imaging device.

The present invention can be applied to a variety of transformations and may have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all conversions, equivalents, and substitutes included in the spirit and scope of the present invention. In the description of the present invention, when it is determined that a detailed description of known technologies related to the present invention may obscure the subject matter of the present invention, the detailed description will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by terms. The terms are used only to distinguish one component from other components.

Terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "include" or "have" are intended to indicate the presence of features, numbers, steps, actions, components, parts or combinations thereof described herein, one or more other features. It should be understood that the existence or addition possibilities of fields or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, and in describing with reference to the accompanying drawings, identical or corresponding components will be given the same reference numbers and redundant description thereof will be omitted. do.

Hereinafter, the imaging device according to the embodiment of the present invention will be described in detail.

(First embodiment)

1 is a block diagram of an imaging device according to a first embodiment of the present invention.

As shown in Fig. 1, the imaging device 1 includes an imaging unit 101, a communication unit 102, an operation instruction unit 103, a temporary storage unit 104, a control unit 105, a device position detection unit 106, It has an image processing section 107, a recording control section 108, a display control section 109, a recording section 110, and a display section 111. The imaging device 1 may be composed of one camera.

Here, the imaging means and flash means described in the claims are included in the imaging unit 101. The receiving means and transmitting means are included in the communication unit 102. The common part detection means is included in the control unit 105 and the device position detection unit 106. The combined moving image generating means, the panoramic image generating means, and the panoramic moving image generating means are included in the control unit 105, the device position detecting unit 106, the temporary storage unit 104, and the image processing unit 107. The display means is included in the display control unit 109 and the display unit 111. The control unit 105 includes imaging condition determining means, timing signal generating means, main imaging device determining means, external device inducing means, external device adjusting means, and timer means.

The imaging unit 101 includes an optical system composed of a lens and an aperture, and an imaging element composed of a CCD (Charge Coupled Device), a Complementary Metal Oxide Semiconductor (CMOS), or the like. In addition, the imaging unit 101 may further include a flash that temporarily irradiates a subject during imaging of a still image.

The imaging unit 101 captures a still image and a moving image of a subject by receiving an image of an optical signal from an optical system by an imaging element and converting the received optical signal into an electric signal.

Still images constitute part of a panoramic image. That is, a panorama image is generated by performing a synthesis in which a still image having overlapping portions overlaps and overlaps the overlapping portions.

The moving image forms part of the composite moving image. That is, a panorama moving image is generated by synthesizing overlapping portions of moving images having portions overlapping each other and then matching them.

The imaging unit 101 transmits the captured still images and moving images to the control unit 105 or the temporary storage unit 104.

The communication unit 102 is an interface for wireless communication, and may be configured by, for example, a wireless local area network (LAN) card. Also, the communication unit 102 may be an interface for wired communication. The communication unit 102 transmits and receives an image between the imaging device 1 and another imaging device. Another imaging device means one or more imaging devices other than the imaging device 1. In addition, for convenience of description, another imaging device is demonstrated as having the same function as the imaging device 1.

The image includes a still image, a moving image, a panoramic image, a panoramic moving image, and a composite moving image described later.

The communication unit 102 searches for other imaging devices and communicates with other searched devices. At this time, by providing unique identification information to other imaging devices, even when there are a plurality of different imaging devices, a plurality of different imaging devices can be recognized respectively. The communication unit 102 transmits an image received from another imaging device to the temporary storage unit 104. Further, the communication unit 102 transmits the image received from the temporary storage unit 104 to another imaging device.

The operation instruction unit 103 may be configured by various input buttons or a touch panel. The operation instruction unit 103 receives inputs of various instructions from the user, and transmits the instructions received to the control unit 105. In the operation instruction unit 103, a panoramic image is collectively formed by swinging the imaging apparatus 1 and other imaging apparatus to simultaneously capture a still image, an imaging instruction to move the position of another imaging apparatus, and an imaging apparatus 1 to swing. A switching instruction for switching the imaging device 1 is input to a device having a function that enables imaging.

The temporary storage unit 104 is composed of volatile or nonvolatile storage elements. The temporary storage unit 104 may be configured by, for example, dynamic random access memory (DRAM) or hard disk drive (HDD).

The temporary storage unit 104 temporarily stores the received various data. The temporary storage unit 104 stores data relating to an image or control received from the imaging unit 101, the communication unit 102, and the control unit 105.

The control unit 105 may be configured by a central processing unit (CPU).

The control unit 105 controls each component of the imaging device 1 and performs various calculations while transmitting and receiving various data.

The control unit 105 generates a timing signal for simultaneously capturing a still image on the imaging unit 101 and another imaging device based on an imaging instruction according to a user. The control unit 105 causes the display to induce movement of the imaging position with respect to another imaging device based on the instruction to guide the user. In addition, the control unit 105 is a panorama in which a plurality of still images captured by the imaging device 1 during a swing is synthesized by the image processing unit 107 by swinging the imaging device 1 based on a switching instruction according to a user The imaging device 1 is switched to an imaging device that captures an image.

The device position detection unit 106 may be configured by a program. In addition, the device position detection unit 106 may be configured to include a global positioning system (GPS).

The device position detection unit 106 detects the positional relationship between the imaging device 1 and another imaging device. In addition, the device position detection unit 106 detects a common portion of the moving image captured by the imaging unit 101 and the moving image captured by another imaging device. Detection of the common part can be done by extracting feature points from each moving picture and combining them. Similarly, the device position detection unit 106 detects a common portion of a still image captured by the imaging unit 101 and a still image captured by another imaging device. Then, it is determined that the imaging devices having the largest common portion of each other are imaging devices having the closest positional relationship to each other, thereby detecting the positional relationship between the imaging device 1 and another imaging device. You can.

When the common portion of the moving image captured by the imaging unit 101 and the moving image captured by another imaging device is detected by the device position detection unit 106, the control unit 105 captures the image by the imaging unit 101 You may zoom the moving image to the wide angle side. Thereby, since the probability that a common portion exists in a moving image imaged by each imaging device can be increased, the time required for detection of a common portion of each moving image can be shortened. In addition, the control unit 105 may display the display unit 111 to zoom the moving image to the wide-angle side, and may inform the user to zoom the moving image to the wide-angle side.

The device position detection unit 106 transmits the positional relationship between the imaging device 1 and another imaging device to the control unit 105 together with information of the common parts of each moving picture and the common parts of each still picture. The control unit 105 transmits and stores information on the positional relationship between each received image pickup device and the common portion of each moving image and the common portion of each still image to the temporary storage unit 104.

The image processing unit 107 may be configured by an MPU. The image processing unit 107 may be configured by a program.

The image processing unit 107 generates panoramic images, panoramic moving images, and composite moving images by performing image processing such as synthesis and processing on the received image.

The image processing unit 107 generates a panoramic moving image by synthesizing each moving image by overlapping the common portion based on information of each moving image stored in the temporary storage unit 104 and each moving image's common portion. Similarly, the image processing unit 107 generates a panoramic image by synthesizing each still image by overlapping the common portion based on the information of the common portion of each still image and each still image stored in the temporary storage unit 104.

Further, the image processing unit 107 includes at least a moving image captured by the imaging unit 101 and a moving image captured by another imaging device adjacent to the imaging device 1 among the moving images stored in the temporary storage unit 104. A composite moving image is generated by synthesizing some of the common parts by overlapping each other. When generating a composite moving image, the image processing unit 107 can use the positional relationship of each of the imaging devices stored in the temporary storage unit 104. The user can grasp the relative positional relationship between the imaging device 1 and the other imaging device by the synthesized moving image.

2 is a view showing an example of a composite moving image.

As shown in Fig. 2, the composite moving image 2 is constituted by superimposing and synthesizing a common portion of a moving image captured by the imaging device 1 and another image captured by another imaging device adjacent to the imaging device. The frame 200 represents a frame of a moving image captured by the imaging device 1, and the frame 210 represents a frame of a moving image captured by another imaging device. Therefore, it can be seen that the moving images of the first to third objects are captured by the imaging device 1, and the moving images of the third to fifth objects are captured by another imaging device adjacent to the imaging device 1, respectively. have. In addition, in the composite moving image shown in Fig. 2, for ease of explanation, a portion that is not originally included in each moving image captured by each imaging device located outside each frame 200 or 210 is also displayed.

The common portion 220 that is an area generated by the overlapping of the frame 200 and the frame 210 represents a common portion of a moving image captured by the imaging device 1 and a moving image captured by another imaging device.

The positional relationship between the frame 200 and the frame 210 reflects the positional relationship between the imaging device 1 and another imaging device. Therefore, the user can grasp the relative positional relationship between the imaging device 1 and another imaging device by the synthesized moving image. In the example of FIG. 2, since the frame 210 is located at a lower position than the frame 200, the positional relationship between both that the other imaging device is out of position lower than the imaging device 1 is grasped. Accordingly, the user can recognize that the entire first subject can be imaged by moving the imaging device 1 to the left or by pointing the imaging direction (optical axis direction) to the left. In addition, the user can recognize that the height of the imaging device 1 can be lowered or the imaging direction can be lowered to match the height of other imaging devices.

3 is a diagram showing another example of a composite moving image.

As shown in Fig. 3, the composite moving image 3 is constituted by superimposing and synthesizing a common portion of a moving image captured by the imaging device 1 and a moving image captured by another imaging device adjacent to the imaging device. The difference between the composite moving image of FIG. 3 and the composite moving image of FIG. 2 is that the composite moving image of FIG. 2 includes all of the moving images captured by other imaging devices, whereas the composite moving image of FIG. 3 includes moving images captured by other devices. It is only partly included.

In the composite moving image 3, only the common portion 220 common to the imaging device 1 among the moving images captured by the other imaging device is displayed together with a part 211 of the frame of the moving image captured by the other imaging device. Through such a composite moving image, a frame 200 of the moving image captured by the imaging device 1 and a portion 211 of the frame 200 of the moving image captured by the frame 200 and another imaging device identifiably displayed in the frame 200 ), The relative positional relationship between the imaging device 1 and another imaging device can be grasped. In addition, since the displacement of the imaging position between the imaging device 1 and another imaging device is emphasized by displaying such a composite moving image, the relative positional relationship of each imaging device can be more clearly displayed.

The recording control unit 108 may be configured by a driving circuit that writes data to the recording unit 110. The recording control unit 108 records the panoramic image received from the control unit 105 in the recording unit 110. In addition, the recording control unit 108 is controlled by the control unit 105 to record various data in the recording unit 110.

The recording unit 110 may be configured as a memory card.

The storage unit 110 is driven by the recording control unit 108 to record various data such as panoramic images.

The display control unit 109 may be configured by a driving circuit that drives the display unit 111. The display control unit 109 causes the display unit 111 to display a panoramic image, a panoramic moving image, and a composite moving image received from the control unit 105. The display unit 111 may be configured by a liquid crystal display. The display unit 111 is driven by the display control unit 109 to display panoramic images, panoramic moving images, and composite moving images.

The operation of the imaging device 1 when the panoramic image is captured by the imaging device 1 will be described.

4 is a flowchart showing the operation of the imaging device when imaging a panoramic image by the imaging device.

When power is supplied to the imaging device 1, the imaging unit 101 captures a moving image of the subject (S401).

The communication unit 102 receives a moving image captured by another imaging device (S402).

The image processing unit 107 synthesizes a composite moving image by overlaying or synthesizing a common portion of both a moving image captured by the imaging unit 101 and a moving image captured by another imaging device adjacent to the imaging device 1. To create. In addition, the image processing unit 107 generates a panoramic moving image by synthesizing a moving image captured by the imaging unit 101 and a moving image captured by all other imaging devices by overlaying a common portion. Then, the display unit 111 displays the composite moving image and the panoramic moving image generated by the image processing unit 107 (S403).

5 is a view showing a screen of a display unit of an imaging device in which a composite moving image and a panoramic moving image are simultaneously displayed.

As shown in Fig. 5, a panoramic moving image 5 is displayed at the top and a composite moving image 3 is displayed at the bottom on the screen of the display 111. Thus, a composite moving image obtained by synthesizing a common portion of a moving image captured by the imaging device 1 and another image adjacent to the imaging device 1 and a moving image captured by all imaging devices is synthesized. The panoramic moving image is displayed on the display unit 111. Thereby, the user can adjust the imaging position of each imaging device by grasping the relative positional relationship of the other imaging device adjacent to the child device, and at the same time can grasp in advance the image or the imaging range of the whole panoramic image.

Further, the panoramic moving image may be synthesized by receiving the composite moving image synthesized by any one of the other imaging devices and using the received composite moving image.

The user adjusts the relative positional relationship with other adjacent imaging devices to be appropriate based on the relative positional relationship with other imaging devices displayed observably in the composite moving image displayed on the display unit 111 (S404).

At this time, by transmitting a signal for inducing the movement of the imaging position to the other imaging device from the imaging device 1 and displaying the induction on the other imaging device, the movement of the imaging position can be instructed to the user of the other imaging device. . Such an instruction is made when it is considered that it is appropriate for the user of the imaging device 1 to change the imaging position of another device than to change the imaging position of the imaging device 1.

FIG. 6 is a view showing a screen for instructing the movement of the imaging position with respect to another imaging device and a screen on which the movement of the imaging device is displayed in another imaging device.

Fig. 6A is a view showing a screen for inducing movement of the imaging position with respect to another imaging device. The user can input an instruction to move the imaging position with respect to another imaging device by touching and sliding the common portion 220 displayed as part of the composite moving image 3 displayed on the screen of the display unit 111 with a finger. . In Fig. 6A, the user instructs the other imaging device to move the imaging position so that a part 211 of the frame of the moving image captured by the other imaging device moves in the direction of the arrow. That is, the user instructs the other imaging device to move to the right so that the common portion 220 becomes smaller. The movement instruction of the imaging position with respect to this other imaging device is transmitted from the imaging device 1 to another imaging device.

FIG. 6B is a view showing a screen on which the movement instruction of the imaging device is displayed in another imaging device. The composite moving image 3A is also displayed on another imaging device, and the moving instruction of the imaging position to the other imaging device received from the imaging device 1 is displayed on the composite image 3A. The movement instruction of the imaging position with respect to the other imaging device indicates the frame 211A and the direction in which the frame 211A should be moved, which is captured by the imaging device 1 displayed in the composite moving picture 3A. It is easily realized by displaying the arrow and the frame 212A after the frame 211A is moved. That is, a user of another imaging device recognizes that the frame 211A should be moved to the position of the frame 212A by this indication, and can be induced to move the imaging position of the other imaging device to the right direction. In addition, in order to clarify the movement instruction to the other imaging device, in the composite moving image 3A displayed on the other device, the movement of the imaging position by a character such as "Please move it to the right so that the common portion is within the range of the dashed line" Induction may be displayed.

Thereby, the user of the imaging device 1 can accurately induce the movement of the imaging position of the other imaging device so that the relative positional relationship between the imaging device 1 and the other imaging device becomes appropriate.

The screen of FIG. 6A can be displayed as the composite moving image 3 at the bottom of FIG. 5.

In addition, at the bottom of Fig. 5, a composite external moving image obtained by superimposing and synthesizing common portions of moving images respectively captured by different imaging devices adjacent to each other may be displayed. It is also possible to select a position to be displayed as the composite moving image 3 at the bottom of FIG. 5 in the panoramic moving image displayed at the top of FIG. 5. By displaying the screen of FIG. 6A as a composite moving image 3 or a composite external moving image at the bottom of FIG. 5, relative positional relationship between the imaging device 1 and all other imaging devices adjacent to each other By displaying in stages, it is possible to instruct the user of each of the other imaging devices to move the imaging position.

After the imaging position of each imaging device is adjusted, if an image capturing instruction of the still image is input to the operation instructing unit 103 by the user of the imaging device 1 by pressing the shutter button, the control unit 105 displays a still image according to the user. The imaging instruction of is detected (S405).

When detecting the imaging instruction of the still image, the control unit 105 generates a timing signal that determines the timing at which the imaging unit 101 and another imaging device simultaneously image the still image (S406).

The timing signal is generated by the imaging device 1 and the imaging device determined as a target imaging device for generating a panoramic image among all other imaging devices. The control unit 105 targets any one of the imaging device 1 and all other imaging devices based on the positional relationship between the imaging device 1 and other imaging devices detected by the device position detecting unit 106. It can be determined by the device. For example, an imaging device positioned at the left end or center may be determined as the main imaging device. Thereby, the imaging timing of each still image constituting the panoramic image can be flexibly matched with high precision.

In addition, the control unit 105, in order to improve the accuracy of the imaging timing when imaging a still image at the same time to each imaging device by the timing signal, the reference time of another imaging device when the still image is captured by the timing signal It is also possible to make preliminary adjustments to match the reference time of the imaging device 1.

In addition, the control unit 105 determines the waiting time from the timing by the timing signal to the first and second imaging of the still images by the imaging means and other imaging devices after the user is instructed to shoot the still images according to the user. It can have a timer function. When the still image is instructed to shoot, the control unit 105 captures the still image by the timer function when the still image is captured multiple times at the same time by the imaging means and other imaging devices. The time interval may be further determined. The waiting time and the imaging time interval determined by the timer function are respectively transmitted by the communication unit 102 to other imaging devices. Thereby, even when imaging a panoramic image using a timer function, it is possible to flexibly and accurately match the imaging timing of each still image constituting the panoramic image.

Further, the control unit 105 may operate other imaging devices to simultaneously irradiate each subject with a flash function of each imaging device when simultaneously capturing still images to each imaging device by a timing signal. Thereby, the time of the flash performed by each imaging device over all the areas of the panoramic image can be matched with high precision.

Hereinafter, for convenience of description, the imaging device 1 is described as a main imaging device.

The control unit 105 transmits a timing signal from the communication unit 102 to another imaging device (S407). When a timing signal is received by another imaging device, the imaging unit 101 and another imaging device simultaneously capture a still image based on the timing signal (S408).

Fig. 7 is a function for continuously capturing a plurality of still images in each imaging device and selecting a combination of any one of the plurality of captured still images in response to a user's instruction to take a single still image. It is an explanatory diagram.

As shown in FIG. 7, the still image 30 by the imaging device 1 and the still image 30A by the other imaging device are time t1 for the imaging instruction of one still image according to the user, respectively. At t2, t3), three still images are continuously captured. In addition, a combination of images most suitable for synthesizing a panoramic image among the three captured still images may be selected by the user.

For example, in the case where the user selects the priority of the coincidence of the imaging position of each imaging device, the combination of the still images with the smallest deviation in the relative positional relationship of the respective imaging devices is a combination of still images to synthesize a panoramic image. Is selected. In this case, if the combination of the still image captured on the first sheet by the imaging device 1 and the still image captured on the third sheet by the other imaging device is a combination of the still images with the smallest deviation in the relative positional relationship between the respective imaging devices The combination is selected. Since the imaging positions of the imaging device 1 and other imaging devices are not fixed, and each user of each imaging device makes each imaging device to capture a still image, it is difficult to match the angle of view between each imaging device. Therefore, although the so-called camera shake effect is concerned, the effect of the camera shake can be reduced by selecting a combination of still images having the smallest deviation in the relative positional relationship of each imaging device.

In addition, for example, when the user selects the priority of the coincidence of the imaging time of each still image, a combination of still images that synthesize a panoramic image can be selected as follows. That is, among the combination of each still image captured at time t1, the combination of each still image captured at time t2, and the combination of each still image captured at time t3, the result of the synthesis of the panoramic image is most desirable. You can choose. In addition, the imaging time of each still image may be determined by adding the imaging time to the still image received by the communication unit 102, and based on the imaging time added during imaging of the still image.

It is preferable that the imaging conditions of each still image by each imaging device are unified. Thus, the control unit 105 may capture a still image under the determined imaging conditions by determining the common imaging conditions of all the imaging devices and transmitting the determined imaging conditions to other imaging devices. Here, the imaging conditions refer to various settings at the time of imaging to determine the quality of a still image, for example, shutter speed, brightness, or number of pixels. Thereby, it is possible to prevent an unnatural panoramic image from being imaged because the imaging conditions of each still image are scattered.

In addition, the control unit 105 receives specifications of other imaging devices as imaging capabilities, extracts imaging capabilities common to the imaging unit 101 and all other imaging devices, and is common to all imaging devices based on the extracted imaging capabilities. It is determined as the imaging conditions of a still image. Then, the determined imaging conditions may be transmitted to other imaging devices, and the imaging unit 101 and the other imaging devices may be imaged with still images under common imaging conditions. For example, if one of the imaging devices has imaging capability capable of imaging at a high shutter speed of 1/8000, other imaging devices have imaging capabilities that cannot capture images exceeding a shutter speed of 1/4000. , The controller 105 extracts a shutter speed of 1/4000 as a common imaging performance. Then, a common imaging condition is determined with a shutter speed of 1/4000.

If the imaging unit 101 and all other imaging devices have no imaging performance common, the control unit 105 cannot extract imaging capabilities common to the imaging unit 101 and all other imaging devices. It is possible to stop the imaging of the still image by the imaging unit 101 and all other imaging devices. In addition, when imaging performances common to all other imaging apparatuses and imaging units 101 are present by excluding any one of the other imaging apparatuses, imaging performances common to all other imaging apparatuses and imaging units 101 are It may be extracted. In this case, the image processing unit 107 generates a panoramic image by synthesizing only all other remaining imaging devices and still images captured by the imaging unit 101. At that time, another excluded imaging device may be notified that it has been excluded from the object of imaging of the panoramic image, and its purpose may be displayed on the other imaging device.

Further, the imaging conditions may be determined by other imaging devices. In that case, the imaging specifications of the imaging device 1 are transmitted from the imaging device 1 to another imaging device, and imaging conditions determined by another imaging device are received by the imaging device 1 from another imaging device. Then, a still image under the imaging conditions received from another imaging device is captured by the imaging unit 101.

The communication unit 102 receives a still image captured by the other imaging device from another imaging device (S409).

The image processing unit 107 combines the still images captured by the imaging unit 101 and the still images captured by all other imaging devices by combining the common parts detected by the device position detecting unit 106 with each other to synthesize a panoramic image. It is created (S410).

The recording unit 110 records the generated panoramic image (S411).

The imaging device according to the first embodiment of the present invention has been described above, but the present embodiment achieves the following effects. That is, in an imaging device that captures a moving picture and a still picture, a moving picture and a still picture captured by another imaging device are received from the other imaging device, and common parts between the moving picture and the still picture are detected. Then, at least a portion of a moving image captured by the imaging device and a moving image captured by another imaging device are superimposed and combined with each other so that the relative positional relationship between the imaging devices can be grasped. Then, a panoramic image is generated by synthesizing the common portions detected by superimposing the still images captured by the respective imaging devices in the corresponding positional relationship. Thereby, by optimizing the positions of the respective imaging devices for imaging still images constituting the panoramic image, it is possible to quickly overlap still images captured at the same time. Therefore, even when the subject is moving, it is possible to quickly capture the panoramic image while preventing the same subject from overlapping and existing in the panoramic image.

In addition, according to the present embodiment, it is possible to combine the advantages of taking a panoramic image with a plurality of cameras and the advantages of taking a panoramic image with a single camera. That is, it has the advantage of a plurality of cameras that can grasp the image and the imaging range of a panoramic image in advance by a panoramic moving image, can cope with a moving subject, and can also capture a linear flat image without distortion. . In addition, since the imaging device is not fixed and there is no limit to the number of imaging devices in which a still image is participated in imaging, it is possible to freely set the angle of view, and at the same time, an inexpensive and flexible panoramic image imaging system can be constructed. .

(Second embodiment)

The imaging device according to the second embodiment of the present invention will be described. The difference between the present embodiment and the first embodiment is as follows. That is, in this embodiment, the relative orientation difference in the imaging direction of the imaging device and the other imaging device is grasped and displayed in a composite moving picture so that the user can adjust the imaging direction of each imaging device so as to reduce the relative orientation difference. About the other points, since it is the same as 1st Embodiment, description overlapping with 1st Embodiment is abbreviate | omitted.

8 is a block diagram of an imaging device according to a second embodiment of the present invention.

The orientation detection unit 112 may be configured by a digital orientation system.

The orientation detection unit 112 detects the direction of the optical axis of the imaging unit 102 as the imaging direction. The control unit 105 calculates the relative orientation difference between the imaging direction detected by the orientation detection unit 112 and the imaging direction of another imaging device received by the communication unit 102, and enables the user to grasp the relative orientation difference It is displayed on the display unit 111.

9 is an explanatory diagram showing the imaging directions of the imaging device and other imaging devices, and a composite moving image displayed on each imaging device, respectively.

Fig. 9A is an explanatory diagram showing imaging directions of the imaging device and another imaging device.

As shown in A of FIG. 9, the first to third objects are captured by the imaging device 10, and the imaging direction 91 of the imaging device 10 is shown in the direction of the arrow. Further, the third to fifth subjects are imaged by another imaging device 10A, and the imaging direction 91A of the other imaging device 10A is shown in the direction of the arrow. It can be seen from A of FIG. 9 that the imaging directions of the imaging device 1 and other imaging devices do not coincide and are shifted.

Fig. 9B is an explanatory diagram showing a composite moving image displayed on an imaging device and another imaging device, respectively.

As shown in B of FIG. 9, since the imaging directions of the imaging device 10 and the imaging device 10A are different, in some cases, the first to third objects having the same height may be differently imaged. There are cases. Thus, by displaying the relative orientation difference 90 in the imaging direction of the imaging device and the other imaging device as the arrow angle in the composite moving image 3, the user deviates from the imaging direction of the imaging device 10 and the other imaging device 10A. Can grasp

FIG. 10 is an explanatory diagram showing an imaging direction of each imaging device and a composite moving image displayed on each imaging device when there is no difference in the relative orientation between the imaging device and the imaging device.

Fig. 10A is an explanatory diagram showing the imaging direction of each imaging device when there is no relative orientation difference between the imaging device and the imaging direction of the other imaging device.

10A, it can be seen that the imaging direction 91 of the imaging device 1 coincides with the imaging direction 91A of another imaging device.

FIG. 10B is an explanatory diagram showing a composite moving image displayed on the imaging device when the relative orientation difference between the imaging device and the other imaging device does not have a relative orientation difference.

10B, since the imaging directions of the imaging device 10 and the other imaging device 10A are identical, the first to third subjects having the same height are imaged as subjects having the same height. . In the composite moving image 3, the relative orientation difference 90 in the imaging direction of the imaging device and the other imaging device is 0, which is indicated by a parallel arrow angle. Thereby, the user can grasp | ascertain that there is no shift | offset | difference of the imaging direction of the imaging device 10 and another imaging device 10A, and can recognize that adjustment of the imaging direction of the imaging device 1 and another imaging device is not necessary.

Since the user is able to grasp the relative orientation difference between the imaging direction of the moving image by the imaging device 1 and the imaging direction of the moving image by another imaging device so as to be grasped in the composite moving image, the imaging device 10 and another imaging device 10A The displacement of the imaging direction of the can be recognized. For this reason, the user adjusts the imaging direction of the imaging device 1 or the imaging direction of another imaging device so that the relative azimuth difference is eliminated, and by capturing the still images by each imaging device in an adjusted state and synthesizing them, distortion is avoided. A small planar panoramic image can be captured.

The imaging device according to the second embodiment of the present invention has been described above, but the present embodiment achieves the following effects. That is, the imaging direction of the moving image by the imaging device different from the imaging direction of the moving image by the imaging device is detected, and the relative orientation difference of the imaging direction is grasped and displayed in a composite moving image. Then, the imaging direction of each imaging device is adjusted to eliminate the relative orientation difference, and a still image captured by each imaging device after adjustment is superimposed and combined with each other to generate a panoramic image. Thereby, a planar panoramic image with little distortion can be captured.

The imaging device according to the embodiment of the present invention has been described above, but the present invention is not limited to the above-described embodiment.

For example, all other imaging devices may be operated by one specific imaging device of each imaging device of the imaging device and other imaging devices. At that time, the operation of the imaging device other than the specific imaging device according to the user of the imaging device other than the specific imaging device becomes invalid. Moreover, the specific imaging device may be determined based on the positional relationship of each imaging device. For example, the imaging device located in the center may be determined as the specific imaging device. Further, a method of determining the specific imaging device may be selected by a user of the imaging device. For example, the user may select the imaging device located at the center or the imaging device located on the left side as the specific imaging device by the user's selection of the imaging device. Thereby, a panoramic image in which the user's intention is properly reflected can be quickly captured.

Further, the communication unit receives at least one of a moving image captured by at least one of the other imaging devices and a composite moving image of moving images captured by at least one of the other imaging devices from another imaging device. Further, the image processing unit may generate a panoramic moving image by combining at least one of the received moving image and the composite moving image. That is, for example, the imaging device may generate a panoramic moving picture by using a synthesized moving picture synthesized by another imaging device and synthesizing a moving picture not included in the combined moving picture. Thereby, a panoramic moving picture can be generated flexibly and quickly.

Further, the imaging time may be added to a moving image captured by another imaging device. By synchronizing the imaging time added to the moving image with the imaging time of the moving image captured by the imaging unit, the time required for the synthesis of the combined moving image and the panoramic moving image can be shortened.

1, 10: imaging device
200: frame of a moving image captured by the imaging device
210: frame of a moving image captured by another imaging device
211: Part of the frame of a moving image captured by another imaging device
211A: Frame of moving image captured by imaging device displayed on another imaging device
212A: Frame after movement of moving image captured by imaging device displayed on another imaging device
220: common part
3: Synthetic video
30: Still image captured by the imaging device
30A: Still image captured by another imaging device
5: Panoramic video

Claims (20)

An imaging device for imaging a panoramic image,
An imaging unit that captures a moving image or a still image;
A communication unit communicating with another imaging device that captures a moving image or a still image by the imaging unit;
The common portion between the moving image captured by the imaging unit and the moving image of the other imaging device received by the communication unit, the still image captured by the imaging unit, and the still image received from the other imaging device by the communication unit The image pickup device is configured by detecting a common portion of each other and synthesizing at least a portion of a moving image captured by the imaging unit and a moving image captured by the other imaging device received by the communication unit and the common portion by overlapping each other. Generates a composite moving image that is displayed so that the relative positional relationship of the other imaging device can be grasped, and a still image captured by the imaging unit and a still image captured by the other imaging device according to the relative positional relationship An image that creates a panoramic image by overlaying and combining them with each other Rib;
When the imaging device is determined as the main imaging device, when an imaging instruction according to a user is inputted, a standby until the still images are first captured by the imaging unit and the other imaging device according to the timing by the timing signal, respectively. A control unit for determining at least one of a time interval for imaging a still image multiple times at the same time by the imaging unit and the other imaging device at a timing by the timing signal after the time and the imaging instruction are made;
And a display unit for displaying the composite moving image or the panoramic image,
The communication unit,
And the standby time and the time interval determined by the control unit are transmitted to the other imaging device. According to claim 1,
The image processing unit generates a panoramic moving image by overlaying and synthesizing the moving image captured by the imaging unit and the moving image captured by the other imaging device received by the communication unit with the common portion,
The display unit, the imaging device, characterized in that for displaying the panoramic video. The method according to claim 1 or 2,
The display unit,
When the moving image captured by the imaging unit and the moving image captured by the other imaging device received by the communication unit and the common portion detected by the image processing unit overlap each other, they are present in the frame of the moving image captured by the imaging device. By displaying a part of the moving image captured by the other imaging device, the frame of the moving image captured by the imaging device and the frame of the moving image captured by the other imaging device are discriminatively adjacent to the imaging device and the imaging device. An imaging device, characterized in that the display to display the relative positional relationship of the other imaging device. The method according to claim 1 or 2,
The image processing section determines imaging conditions common to the imaging section and the other imaging apparatus, and
The communication unit,
Transmitting the imaging conditions to the other imaging device to image a still image on the other imaging device under the imaging conditions determined by the image processing unit,
Receiving the imaging conditions determined by the other imaging device from the other imaging device,
The imaging unit,
An imaging device characterized by imaging a still image under the imaging condition determined by the image processing unit or the imaging condition received by the communication unit. The method according to claim 1 or 2,
The control unit generates a timing signal for simultaneously capturing a still image on the imaging unit and the other imaging device based on an imaging instruction according to a user,
The communication unit,
The timing signal generated by the control unit is transmitted to the other imaging device,
The imaging unit,
A still image is captured in accordance with the timing by the timing signal,
The communication unit,
The still image captured by the other imaging device is received from the other imaging device according to the timing by the timing signal transmitted by the control unit,
The image processing unit,
An imaging device characterized in that the panoramic image is generated by synthesizing a still image captured by the imaging unit and a still image captured by the other imaging device received by the communication unit in accordance with the timing by the timing signal. The method according to claim 1 or 2,
And imaging direction detecting means for detecting the imaging direction of the imaging section,
The communication unit transmits the imaging direction of the imaging unit detected by the imaging direction detection means to the other imaging device, receives the imaging direction of the other imaging device from the other imaging device,
The display unit,
The relative orientation difference between the imaging direction detected by the imaging direction detection means and the imaging direction received by the communication unit is displayed so that the composite moving picture can grasp the difference.
The image processing unit,
An imaging device characterized in that the panoramic image is generated by synthesizing a still image captured by the imaging unit and a still image captured by the other imaging device and the common portion by overlapping each other according to a difference in relative orientation of the imaging direction. . The method of claim 5,
The imaging device and the other imaging device further comprises an adjacent relationship detecting means for detecting an adjacent relationship with each other,
The control unit determines one of the imaging device and the other imaging device as a main imaging device that transmits the timing signal based on the adjacent relationship detected by the adjacent relationship detecting means,
The communication unit,
In order to image a still image on the other imaging device in accordance with the timing by the timing signal transmitted from the main imaging device determined by the control unit, signals for specifying the main imaging device are respectively transmitted to the other imaging device. An imaging device, characterized in that. According to claim 4,
The communication unit,
Transmitting the imaging performance of the imaging device to the other imaging device,
Receiving the imaging performance of the other imaging device from the other imaging device,
The imaging device extracts imaging capability based on imaging capability of the imaging unit and imaging capability of the other imaging device received by the communication unit to extract imaging capabilities common to the imaging unit and the other imaging device from imaging capabilities. Further comprising means,
The control unit,
And the imaging condition is determined based on the imaging performance extracted by the imaging performance extraction means. The method of claim 8,
If there is no imaging capability common to the other imaging device and the imaging unit, if the imaging performance extraction means cannot extract the imaging performance, the imaging unit stops imaging the still image. Imaging device to do. The method of claim 8,
When there is imaging performance common to all other imaging devices and the imaging unit by excluding any one of the other imaging devices,
The imaging performance extraction means,
The imaging performance common to all the other imaging devices and the imaging unit is extracted,
The image processing unit,
An image pickup device, wherein the panoramic image is generated by combining still images captured by the other image pickup units and the remaining image pickup units. The method according to claim 1 or 2,
And before the common portion is detected by the image processing unit, further comprising zooming means for zooming a moving image captured by the imaging unit to a wide angle side or displaying an identifier to be zoomed on the display unit. Imaging device. The method according to claim 1 or 2,
The image processing unit,
A composite external moving image that displays at least a portion of one moving image and another moving image received by the communication unit by overlapping the common portions detected by the image processing unit so that the relative positional relationship between the other imaging devices adjacent to each other can be grasped. Create
The display unit,
An image pickup apparatus characterized in that the composite external moving image and the composite moving image are displayed so as to be switchable with each other. The method according to claim 1 or 2,
An imaging device, further comprising an external device operating means that operates the other imaging device and invalidates operation by the other imaging device. The method according to claim 1 or 2,
And an external device inducing means for displaying a movement of the position of the other imaging device on any one of the other imaging devices based on a user's instruction. According to claim 2,
The communication unit,
Receiving at least one of a moving image captured by at least one of the other imaging devices and a composite moving image captured by at least one of the other imaging devices from at least one of the other imaging devices,
The image processing unit,
Generating the panoramic moving image by combining at least one of a moving image captured by at least one of the other imaging devices received by the communication unit and a composite moving image captured by at least one of the other imaging devices. Imaging device. The method according to claim 1 or 2,
The control unit captures a still image by the other imaging device so that the time serving as a timing reference for imaging a still image by the imaging unit coincides with a time serving as a timing reference for imaging a still image by the other imaging device. And adjusting the time serving as a timing reference for the image. According to claim 2,
An imaging time is added to the moving image received by the communication unit, and the image processing unit includes:
The synthesized moving image is generated by synchronizing the imaging time of the moving image captured by the imaging unit with at least a part of the imaging time of the moving image captured by the other imaging device,
An imaging device, wherein the panoramic moving image is generated by synchronizing the imaging time of the moving image captured by the imaging unit and the imaging time of each moving image captured by the other imaging device. The method according to claim 1 or 2,
The imaging unit and the other imaging device respectively capture a plurality of still images in one imaging instruction,
The image processing unit,
An imaging device characterized in that a panorama image is generated by combining each still image of a combination selected by a user from a combination of each still image captured by the imaging unit and each still image captured by the other imaging device. . delete The method of claim 18,
The image processing unit may be any one of the combinations of closest shooting times or the smallest misalignment of the relative positional relationship among the combinations of each still image captured by the imaging unit and each still image captured by the other imaging device. A panoramic image is generated by synthesizing each still image of the image.

Images