JP2009278475A - Camera apparatus, composite image creation supporting device, composite image creation supporting method, and composite image creation supporting program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve a support for easily and surely photographing a plurality of images covering a wider range than an angle of view in photographing. <P>SOLUTION: A camera photographing section 2 captures an image, and a CPU 7 acquires the angle of view in the camera photographing section 2. An azimuth sensor 3 detects an azimuth angle of a photographing range, and a tilt sensor 4 detects a rotation angle and an elevation angle of the photographing range. A memory 5 holds the photographed image and parameters representing the photographing range such as the angle of view, the azimuth angle, the rotation angle, the elevation angle. Then, the CPU 7 displays the image under photographing at present on a screen of a view finder 8 in accordance with parameters representing the photographing range of the image and simultaneously displays the photographed images in the memory 5 on the screen of the view finder 8 in accordance with parameters of the images. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a camera apparatus such as a so-called digital still camera, a composite image creation support apparatus, a composite image creation support method, and a program suitable for generating an image having a wider range than the angle of view at the time of shooting.

  For example, Japanese Patent Application Laid-Open No. 9-322060 discloses a technique for generating a panoramic image from a plurality of images taken with a digital camera. That is, in this published patent publication, a still image after shooting is transparently displayed on the screen, and a part of the photographed image that is transparently displayed and a part of the image in the unphotographed range are overlapped on the screen. A technique for supporting generation of a panoramic image by moving a camera or the like by itself is disclosed. This publication also discloses a technique for automatically extracting feature points of a photographed still image and an image photographed from now on and letting the photographer know the degree of overlap between the two images using these feature points.

  Japanese Unexamined Patent Application Publication No. 2006-33353 (Patent Document 2) discloses a technique for generating a single panoramic image from a plurality of still images that do not overlap each other. This published patent document describes that a single panoramic image is generated by complementing a plurality of non-overlapping images with another image.

  In addition, in Japanese Patent Application Laid-Open No. 2006-129391 (Patent Document 3), the tilt angle of the camera body is detected and stored in association with a captured image at the time of shooting, and when the stored image is displayed or the like, A technique for correcting the tilt of an image according to the tilt angle at the time of shooting is disclosed.

Japanese Patent Laid-Open No. 9-322060 (FIG. 4) JP 2006-33353 A (FIG. 1) JP 2006-129391 A (FIG. 15)

  By the way, in the case of generating an image in a wider range than the angle of view at the time of shooting, conventionally, a plurality of images are joined together as in the techniques described in Patent Document 1 and Patent Document 2, for example. A method of synthesizing is adopted.

  However, when generating such a wide range of images, the photographer must shoot the images so as to cover all the shooting ranges necessary to generate the wide range of images. In other words, in order to perform image capturing that covers all these image capturing ranges, which range must be captured at the time of each image capture, and which range is currently being captured. The photographer himself must judge this. Such a determination is very troublesome and difficult for the photographer.

  In the case of Patent Document 1 described above, the photographed still image is transparently displayed, so that the photographer can know to some extent the range to be connected to the photographed still image. However, it is very difficult for the photographer to determine what other range and how many other ranges must be taken in order to generate an image that covers the entire desired wide range.

  Further, in the case of Patent Document 2, it is effective as a technique for connecting and synthesizing a plurality of captured images. However, when a photographer actually performs photographing, a desired wide range of images is generated. No consideration is given to shooting support to cover the entire shooting range required for the camera.

  The present invention has been proposed in view of such a situation, and a camera capable of realizing support for easily and surely photographing a plurality of images covering a wider range than the angle of view at the time of photographing. An object is to provide a device, a composite image creation support device, a composite image creation support method, and a composite image creation support program.

  The camera device of the present invention includes an image capturing unit, an image display unit, an operation input unit, an image holding unit, a parameter detection unit, a parameter holding unit, and a control calculation unit. The image holding unit stores information on an image captured by the image capturing unit in response to an instruction input to start image capturing from the operation input unit. The parameter detection unit detects a parameter indicating a shooting range at the time of image shooting by the image pickup unit, and the parameter holding unit holds the parameters of the image held in the image holding unit. The control calculation unit displays the image being captured by the image capturing unit on the screen of the image display unit according to the parameter detected by the parameter detection unit, and at the same time displays the image held in the image holding unit. The image is displayed on the screen of the image display unit in accordance with the parameters held in the parameter holding unit. Thereby, this invention solves the subject mentioned above.

In the composite image creation support apparatus, composite image creation support method, and composite image creation support program of the present invention, a parameter representing a shooting range during image capture is acquired, the acquired parameter is retained, and the captured image is captured. Holds information about the image. In the present invention, the image being captured is displayed on the screen of the image display unit according to the acquired parameter, and at the same time, the retained image is displayed on the screen according to the parameter of the retained image. Thus, the present invention solves the above-described problem. That is, according to the present invention, an image of the shooting range to be shot is displayed on the screen and, at the same time, an already shot image is displayed when the image is shot. Is displayed on the screen in accordance with a parameter representing the shooting range. Accordingly, for example, when a new image for generating a panorama composite image is captured, the photographer can recognize which imaging range should be captured.

  In the present invention, the image being captured is displayed on the screen according to the parameter representing the current shooting range, and at the same time, the captured image is displayed on the screen according to the parameter. In addition, a plurality of images covering a wide range can be easily and reliably photographed.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  In the following description, a digital still camera is taken as an example of application of the present invention, but of course it is merely an example, and the present invention is not limited to this example. For example, a mobile phone terminal with a camera function, etc. It is also applicable to.

[Schematic configuration of digital still camera]
FIG. 1 shows a schematic internal configuration example of a digital still camera 1 according to an embodiment of the present invention.

  In the present embodiment, the camera photographing unit 2 captures, as main components, a camera lens including an autofocus mechanism, a zoom mechanism, a diaphragm mechanism, and the like, and a subject image incident through the camera lens by photoelectric conversion. It has an image sensor for converting data and its peripheral circuits. Note that the CPU unit 7 controls imaging in the camera photographing unit 2, autofocus of the camera lens, and the like.

  The viewfinder unit 8 includes a display device including a screen for displaying an image before the shooting button is pressed, a captured image, and the like, and its peripheral circuits. Note that the CPU 7 controls image display in the viewfinder unit 8. Illustration and description of the shooting button and other operation input devices are omitted.

  The tilt sensor unit 4 includes a tilt sensor that detects the tilt of the digital still camera 1 at the time of shooting and its peripheral circuit. In the present embodiment, the tilt of the digital still camera 1 is specifically detected as a rotation angle and an elevation angle. That is, as shown in FIG. 2, the rotation angle is obtained as the rotation angle θ that the still image SI captured by the image sensor has with respect to the gravitational horizontal plane HF. Further, as shown in FIG. 3, the elevation angle is obtained as an elevation angle φ at which the optical axis AL of the camera lens (a line perpendicular to the focal plane FF) is directed with respect to the gravitational horizontal plane HF at the time of photographing. Note that the CPU unit 7 controls the tilt detection operation in the tilt sensor unit 4 and calculates the rotation angle θ and the elevation angle φ based on the detection data of the tilt sensor unit 4. In the present embodiment, each of the rotation angle θ and the elevation angle φ is one of the parameters representing the shooting range by the digital still camera.

  The azimuth sensor unit 3 includes an azimuth sensor that detects the photographing azimuth of the digital still camera 1 at the time of photographing, and its peripheral circuit. In the present embodiment, as shown in FIG. 4, the shooting direction includes the direction in which the optical axis AL (line perpendicular to the focusing plane FF) of the camera lens is directed, and a certain reference direction BO (0 °). Is obtained as an azimuth angle ζ. The CPU 7 performs control of the direction detection operation in the direction sensor unit 3 and calculation of the azimuth angle ζ using the detection data of the direction sensor unit 3. In the present embodiment, the azimuth angle ζ is one of the parameters representing the shooting range of the digital still camera.

  The memory unit 5 includes captured image data, synthesized image data to be described later, a storage element for storing parameters representing the imaging range, and peripheral circuits. The CPU unit 7 controls the storage and reading of image data and the like in the memory unit 5. The memory unit 5 also stores various programs including a composite image creation support program (a program for a panoramic image shooting mode described later) of the present invention. Various programs such as the composite image creation support program according to the present invention stored in the memory unit 5 are stored via a disk-shaped recording medium, an external semiconductor memory, or the like, or stored via a cable or wirelessly via an external interface. It may be what was done.

  The image processing unit 6 generates image data to be displayed on the screen of the viewfinder unit 8 from the imaging data of the camera photographing unit 2. The image processing unit 6 also performs a composite image generation process, which will be described later. Further, the image processing unit 6 also stores and reads image data with respect to the memory unit 5. Note that the CPU unit 7 controls image data generation processing and composite image generation processing.

  The CPU unit 7 performs control of each unit of the digital still camera 1, various data processing, calculation processing, and the like. That is, the CPU unit 7 controls the camera photographing unit 2, the orientation sensor unit 3, the tilt sensor unit 4, the image processing unit 6, and the viewfinder unit 8, and performs various data processing. The CPU unit 7 also calculates the angle of view ε as shown in FIG. 4 based on the zoom information of the camera lens of the camera photographing unit 2. In addition, in calculating the angle of view ε, it is actually necessary to consider the size of the imaging surface of the imaging element in addition to the zoom information of the camera lens, but the size of the imaging surface is a predetermined value. Therefore, the CPU unit 7 calculates the angle of view ε using only zoom information. In the present embodiment, the angle of view ε is one of the parameters representing the shooting range of the digital still camera.

(Viewfinder display in panoramic image shooting mode)
In the digital still camera 1 of the present embodiment, the operation in the shooting mode for generating an image in a wider range than the angle of view at the time of shooting will be described with reference to the viewfinder display examples of FIGS. In the following description, a shooting mode for generating an image having a wider range than the angle of view at the time of shooting is referred to as a panoramic image shooting mode.

  FIG. 5 shows a screen display example of the viewfinder unit 8 when the first image is shot in the panoramic image shooting mode.

  That is, in the panoramic image shooting mode, when the first image is shot, the image 11 currently captured by the camera shooting unit 2 is displayed on substantially the entire surface of the viewfinder screen 10 as shown in FIG. Is done.

  In the panoramic image shooting mode, when the user (photographer) presses the shooting button and the first image is shot, the image data is recorded in the memory unit 5. In the panoramic image shooting mode, information on the angle of view ε, the rotation angle θ, the elevation angle φ, and the azimuth angle ζ when the image is shot is held in the memory unit 5 as a parameter representing the shooting range.

  FIG. 6 shows a screen display example of the viewfinder unit 8 when shooting the second image in the panoramic image shooting mode.

  When shooting the second image, the digital still camera 1 represents a parameter indicating a shooting range when the first image is shot and a shooting range when shooting the second image. Using the parameters, the relative positional relationship and size between the two images are calculated. The digital still camera 1 maintains both the first image 21 and the second image 22 while maintaining the relative positional relationship and size between the first image and the second image. Is displayed on the viewfinder screen 20 so that the

  Here, as an example only, the relative positional relationship between the two images is based on the rotation angle θ, the elevation angle φ, and the azimuth angle ζ when the first image is taken, respectively. It can be obtained by calculating the difference between the rotation angle θ, the elevation angle φ, the azimuth angle ζ and the above reference values when the first image is taken. That is, for example, when the elevation angle φ at the time of shooting the first image is set as the reference elevation angle, the difference between the elevation angle φ at the time of shooting the second image and the reference elevation angle is relative to the elevation angle between the two images. It is required as a general positional relationship. In addition, when the azimuth angle ζ at the time of shooting the first image is set as the reference azimuth angle, the difference between the azimuth angle ζ at the time of shooting the second image and the reference azimuth is the difference between the two images. It is calculated | required as a relative positional relationship regarding an azimuth. Similarly, when the rotation angle θ at the time of shooting the first image is set as the reference rotation angle, the difference between the rotation angle θ at the time of shooting the second image and the reference rotation angle is the difference between the two images. It is calculated | required as a relative positional relationship regarding the rotation angle. Thereby, the relative positional relationship between both images is obtained.

  This is also an example, but the relative size between the two images is based on the angle of view ε when the first image is taken, and the second image is taken. It can be obtained by calculating the difference between the angle of view ε and the reference value. That is, for example, when the angle of view ε at the time of shooting the first image is set as the reference angle of view, the difference between the angle of view ε at the time of shooting the second image and the reference angle of view is the difference between both images. It is calculated as the relative size of.

  In the panoramic image shooting mode, when the second image is shot by pressing the shooting button, the image data is recorded in the memory unit 5. Further, information on the angle of view ε, the rotation angle θ, the elevation angle φ, and the azimuth angle ζ when the second image is captured is held in the memory unit 5 as a parameter representing the image capturing range of the image. Further, when the second image is recorded, the viewfinder screen when the second image is taken is also held in the memory unit 5 at the same time. That is, a composite image corresponding to a viewfinder screen in which both the images are accommodated while maintaining the relative positional relationship and size between the first and second images is stored in the memory unit 5. Retained.

  Furthermore, the digital still camera 1 at this time uses the composite image as a reference image for obtaining a relative positional relationship and size with the image at the next shooting. The composite image that is the reference image is hereinafter referred to as a composite reference image. In addition, the digital still camera 1 has an angle of view ε, a rotation angle θ, an elevation angle φ, and an azimuth angle ζ of the first image, and an angle of view ε, a rotation angle θ, an elevation angle φ, and an azimuth angle ζ of the second image. Then, a composite field angle, a composite rotation angle, a composite elevation angle, and a composite azimuth angle corresponding to the composite reference image are calculated, and these are stored in the memory unit 5 as parameters representing the shooting range of the composite reference image. It should be noted that, as an example only, the composite field angle, composite rotation angle, composite elevation angle, and composite azimuth angle corresponding to the composite reference image are the field angle ε, rotation angle θ, elevation angle φ, and azimuth angle of the first image. The angle of view ε, the rotation angle θ, the elevation angle φ, and the azimuth angle ζ can be calculated as intermediate values of ζ and the second image.

  FIG. 7 shows a screen display example of the viewfinder unit 8 when the third image is captured in the panoramic image capturing mode.

  When shooting the third image, the digital still camera 1 uses each parameter indicating the shooting range of the composite reference image and a parameter indicating the shooting range when shooting the third image, The relative positional relationship and size between the composite reference image and the third image are calculated. At this time, the digital still camera 1 maintains the relative positional relationship and size between the composite reference image and the third image, and the composite reference image 31 and the third image. The image 32 is displayed on the viewfinder screen 30 so that both of the images 32 can be accommodated.

  Here, at the time of photographing the third image, the relative positional relationship between the composite reference image and the third image is the composite rotation angle, composite elevation angle, composite azimuth angle corresponding to the composite reference image. Can be obtained by calculating differences between the rotation angle θ, the elevation angle φ, the azimuth angle ζ, and the respective reference values when the third image is captured. . That is, for example, the difference between the elevation angle φ when the third image is captured and the reference elevation angle is obtained as a relative positional relationship regarding the elevation angle between the two images. Further, the difference between the azimuth angle ζ and the reference azimuth angle when the third image is captured is obtained as a relative positional relationship regarding the azimuth angle between the two images. Similarly, the difference between the rotation angle θ when the third image is captured and the reference rotation angle is obtained as a relative positional relationship regarding the rotation angle between the two images. Thereby, the relative positional relationship between both images is obtained.

  Further, the relative size between the images at the time of photographing the third image is an image when the third image is photographed with a composite angle of view corresponding to the composite reference image as a reference value. It can be obtained by calculating the difference between the angle ε and the reference value of the composite angle of view. That is, for example, when the composite field angle corresponding to the composite reference image is set as the reference field angle, the difference between the field angle ε when the third image is captured and the reference field angle of the composite reference image is It is calculated as a relative size between images.

  In the panoramic image shooting mode, when the shooting button is pressed and the third image is shot, the image data is recorded in the memory unit 5. In addition, information on the angle of view ε, the rotation angle θ, the elevation angle φ, and the azimuth angle ζ when the third image is captured is held in the memory unit 5 as a parameter representing the imaging range. Further, when the third image is recorded, the viewfinder screen when the third image is taken is also held in the memory unit 5 at the same time. That is, a viewfinder screen in which the respective images are accommodated in a state where the relative positional relationship and size between the first and second composite images and the third image are maintained. Is stored in the memory unit 5.

  Further, the digital still camera 1 at this time is a new one for obtaining the relative positional relationship and size of the first, second, and third composite images with the next image. The composite reference image is used. In addition, the digital still camera 1 includes a composite field angle, a composite rotation angle, a composite elevation angle, and a composite azimuth angle of the first and second composite images, and a field angle ε, a rotation angle θ, and an elevation angle of the third image. From φ and the azimuth angle ζ, a composite field angle, a composite rotation angle, a composite elevation angle, and a composite azimuth angle corresponding to the new composite reference image are calculated, and these are used as parameters representing the imaging range of the new composite reference image. It is held in the memory unit 5. Note that, as an example only, the composite field angle, composite rotation angle, composite elevation angle, and composite azimuth angle corresponding to the composite reference image are the composite field angle and composite rotation angle of the first and second composite images. , The composite elevation angle, the composite azimuth angle, and the field angle ε, rotation angle θ, elevation angle φ, and azimuth angle ζ of the third image can be calculated as intermediate values.

  FIG. 8 illustrates another screen display example of the viewfinder unit 8 when the third image is captured in the panoramic image capturing mode. That is, FIG. 8 shows an example of a screen display when an attempt is made to capture a shooting range that is further away from the example of FIG. 7 as the third image.

  In the example of FIG. 8, as in the case of FIG. 7, when the third image is taken, the digital still camera 1 corresponds to the combined reference image obtained by combining the first and second images. Relative positional relationship between the composite reference image and the third image, using each parameter representing the captured image range and a parameter representing the shooting range when the third image is captured, and Calculate the size. The digital still camera 1 maintains both the composite reference image 41 and the third image 42 while maintaining the relative positional relationship and size between the composite reference image and the third image. Is displayed on the viewfinder screen 40 so that the

  In the case of FIG. 8, the shooting range that is further away from the example of FIG. 7 is to be shot as the third image, so the size of the composite reference image 41 displayed on the viewfinder screen 40 and the three images are displayed. The size of the eye image 42 is relatively smaller than that of the example of FIG. That is, in this example, since the relative positional relationship between the synthesis reference image and the third image is separated, both the synthesis reference image 41 and the third image 42 are accommodated in the viewfinder screen 40. In this case, the sizes of the composite reference image 41 and the image 42 are smaller than those in the example of FIG.

  On the other hand, when the shooting range of the third image (that is, the direction of the camera lens) is gradually moved from the state shown in FIG. 8 toward the composite reference image, for example, the digital still camera 1 The size of the composite reference image and the size of the third image displayed on the viewfinder screen are gradually increased from the state shown in FIG. In other words, when the relative positional relationship between the composite reference image and the third image approaches, the composite reference image and the third image are displayed relatively large on the viewfinder screen. Is done.

  FIG. 9 shows the orientation of the camera lens from the state shown in FIG. 8 so that the shooting range of the third image is closer to the direction of the first and second composite reference images (arrow directions in the figure). An example of the screen display of the viewfinder unit 8 when is moved is shown.

  As in the example of FIG. 9, when the direction of the camera lens is moved so that the shooting range of the third image approaches the direction of the composite reference image, the digital still camera 1 is displayed on the viewfinder screen. The size of the composite reference image 51 and the size of the third image 52 are gradually increased. Note that the display range 53 in FIG. 9 is obtained by moving the camera lens so that the third image capturing range is closer to the direction of the composite reference image, so that each image has a positional relationship as shown in FIG. This shows the range displayed on the viewfinder screen when.

[Flowchart in panoramic image shooting mode]
FIG. 10 shows a flowchart of processing executed by the CPU unit 7 of the digital still camera 1 executing the composite image creation support program of the present invention that realizes the above-described panoramic image shooting mode.

  In FIG. 10, when the composite image creation support program is activated in step S1 and the panoramic image shooting mode is started, the CPU unit 7 first displays an image obtained by the camera shooting unit 2 as a process in step S2. 8 is displayed on the screen. At this time, for example, the image as shown in FIG. 5 is displayed.

  Next, the CPU unit 7 determines whether or not the photographing button has been pressed for photographing the first image as the process of step S3. If it is determined in step S3 that the shooting button has been pressed, the process proceeds to step S4.

  In step S4, the CPU unit 7 causes the camera photographing unit 2 to perform photographing. Then, the CPU unit 7 records each parameter representing the above-described photographing range at the time of photographing in the memory unit 5 in step S5, and simultaneously records the photographed image in the memory unit 5 in step S6. Further, the CPU at the time of step S6 also stores the display image of the viewfinder screen at the time of capturing the image in the memory unit 5.

  Next, when the process proceeds to step S7, the CPU unit 7 determines whether it is necessary to combine with an image captured before that. Note that when the first image is shot, there is no previous shot image, so the CPU unit 7 skips the determination process in step S7 and proceeds to step S8.

  In step S8, the CPU unit 7 stores the image recorded in the memory unit 5 in step S6 in the memory unit 5 as a composite reference image, and then proceeds to step S9. Note that the composite reference image at this point is the first photographed image.

  In step S9, the CPU unit 7 determines whether it is time to update the display on the viewfinder screen. The update time may be, for example, a so-called moving image frame time (1/30 second), or a time such as 1/15 second or 1/10 second in order to make the processing lighter. When determining that the update time has come in step S9, the CPU 7 advances the process to step S10.

  When the processing proceeds to step S10, the CPU unit 7 updates the display of the viewfinder screen and acquires each parameter representing the updated imaging range.

  In addition, as a process of step S11, the CPU unit 7 performs the composite reference image (in this case, the first image) after the update and an image (in this case, two images) obtained from the camera photographing unit 2 at that time. The relative positional relationship and size between the eye) are calculated.

  Further, as a process in step S12, the CPU unit 7 maintains both the relative positional relationship and the size obtained in step S11 (in this case, the first image and the second image). ) Are displayed on the viewfinder screen.

  Then, the CPU unit 7 determines whether or not the shooting button has been pressed for image shooting as the processing of step S13. If the shooting button is not pressed in step S13, the process returns to step S9. If the shooting button is pressed, the process returns to step S4.

  When returning to the process of step S4, the CPU unit 7 causes the camera photographing unit 2 to start photographing the second image. Accordingly, in step S5, each parameter representing the shooting range of the second shot image is recorded in the memory unit 5, and in step S6, the data of the second shot image is recorded in the memory unit 5. become. At the time of the step S6, the display image on the viewfinder screen at the time of shooting the second image, that is, the viewfinder image of FIG. 6, for example, is also stored in the memory unit 5.

  Next, when the process proceeds to step S7, the CPU unit 7 determines whether it is necessary to combine with an image captured before that. In this case, the CPU unit 7 determines that it is necessary to combine the first captured image and the second captured image, and proceeds to step S20.

  In step S20, the CPU unit 7 combines the first image and the second image. In addition, as a process of step S21, the CPU unit 7 records the image obtained by combining the first and second images in the memory unit 5 as a combined reference image. Further, the CPU unit 7 calculates a parameter representing a shooting range corresponding to the composite reference image as the process of step S <b> 22, and stores it in the memory unit 5. Then, the CPU unit 7 displays the composite reference image on the viewfinder screen as the process of step S23. That is, in this case, as shown in FIG. 7 described above, the composite reference image obtained by combining the first and second images and the image to be photographed on the third image are displayed on the viewfinder screen. It will be.

  Next, the CPU unit 24 determines whether or not an instruction to end shooting is input from the user, and when the instruction to end shooting is not input, the process returns to step S9.

  When returning to step S9, the CPU 7 determines whether or not it is time to update the display of the viewfinder screen as described above, and proceeds to step S10 when it is determined that the update time is reached.

  When the processing proceeds to step S10, the CPU unit 7 updates the display of the viewfinder screen and acquires each parameter representing the updated imaging range. In addition, as the process of step S11, the CPU unit 7 performs a composite reference image (in this case, the first and second composite images) after the update and an image (from the camera photographing unit 2 at that time) ( In this case, the relative positional relationship and size with the third image) are calculated. Further, as a process of step S12, the CPU unit 7 maintains both of the relative positions and sizes of the two images (in this case, the first and second synthesized images and the third image). Is displayed on the viewfinder screen.

  In step S13, the CPU 7 determines whether or not the shooting button has been pressed for image shooting. If the shooting button has been pressed, the process returns to step S4. Hereinafter, since it is the same, description is abbreviate | omitted.

  If an instruction to end shooting is input from the user in step S24, the CPU 7 advances the process to step S25.

  When the processing proceeds to step S25, the CPU unit 7 combines all the images that have been shot and stored in the memory unit 5 after entering the panoramic image shooting mode. Note that the image composition process at this time uses a composition process in which the respective images are connected by an existing image composition technique.

  When the image composition processing in step S25 is completed, the CPU unit 7 records the composite image as an image file in the memory unit 5 as processing in step S26.

  Note that the image composition processing in step S25 may be performed separately by a personal computer or the like without being performed in the digital still camera 1.

[Summary]
As described above, according to the embodiment of the present invention, when capturing an image in the panoramic image capturing mode, the relative positional relationship and size between the image of the capturing range to be captured and the image captured before that are determined. In the maintained state, both images are displayed on the viewfinder screen so as to fit. Therefore, when obtaining a plurality of images covering a wider range than the angle of view at the time of shooting, the photographer only needs to look at the viewfinder screen, which direction and range should be taken, It is easy to know which range is currently being photographed. That is, according to the present embodiment, support for easily and surely photographing a plurality of images covering a wider range than the angle of view at the time of photographing is realized. Furthermore, according to the present embodiment, there is no need to determine the shooting order of a plurality of images covering a wider range than the angle of view at the time of shooting, and the direction and range determined by the photographer as necessary on the viewfinder screen. These images may be taken in any order.

  The above description of the embodiment of the present invention is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made according to the design or the like as long as the technical idea according to the present invention is not deviated.

  In the above-described embodiment, a digital still camera including all the components for executing the composite image creation support process is cited. For example, images before and after shooting are displayed on another monitor screen or the like. The present invention can also be applied to a system that only performs imaging and detection of orientation, inclination, and the like. Further, the processing of a program for simultaneously displaying images before and after photographing on a monitor screen or synthesizing images can be executed by a personal computer or the like, for example. In this case, the personal computer acquires image data, azimuth and tilt data, and the like from the camera side, and performs image display processing similar to the above-described screen display example of the viewfinder unit 2 using these data.

1 is a block diagram illustrating a schematic internal configuration example of a digital still camera according to an embodiment of the present invention. It is a figure used for description of the rotation angle detected by the inclination sensor part. It is a figure used for description of the elevation angle detected by an inclination sensor part. It is a figure used for description of the azimuth angle detected by the azimuth | direction sensor part. It is a figure which shows the example of a screen display of a viewfinder part when the 1st image is image | photographed in a panoramic image imaging | photography mode. It is a figure which shows the example of a screen display of a viewfinder part when a 2nd image is image | photographed in a panoramic image imaging | photography mode. It is a figure which shows the example of a screen display of a viewfinder part when a 3rd image is image | photographed in a panoramic image imaging | photography mode. FIG. 10 is a diagram illustrating a screen display example of the viewfinder when the first and second shooting ranges are separated from the third shooting range when the third image is shot in the panoramic image shooting mode. is there. When the third image is shot in the panoramic image shooting mode, the viewfinder section moves when the camera lens is moved so that the shooting range of the third image approaches the shooting range of the first and second images. It is a figure which shows the example of a screen display. It is a flowchart of a process when the CPU part is executing the synthetic image creation assistance program of this invention which implement | achieves a panoramic image imaging | photography mode.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Digital still camera, 2 Camera imaging | photography part, 3 Direction sensor part, 4 Tilt sensor part, 5 Memory part, 6 Image processing part, 7 CPU part, 8 Viewfinder part 10, 20, 30, 40, 50 Viewfinder screen 11, 21 First shot image, 22 Second shot image, 31, 41, 51 First and second composite image, 32, 42, 52 Third shot image

Claims (12)

An image capturing unit for capturing an image;
An image display unit having at least a screen for displaying an image;
An operation input unit for obtaining an instruction input from the user;
An image holding unit that holds information of an image captured by the image capturing unit in response to an instruction input to start image capturing via the operation input unit;
A parameter detection unit for detecting a parameter representing a shooting range during imaging by the image imaging unit;
A parameter holding unit that holds parameters detected by the parameter detection unit when the image held in the image holding unit is captured;
The image being captured by the image capturing unit is displayed on the screen of the image display unit according to the parameter detected by the parameter detection unit, and at the same time, the image held in the image holding unit is displayed on the parameter holding unit A control calculation unit to display on the screen of the image display unit according to the parameters held in
A camera device.   The camera device according to claim 1, wherein the parameter detection unit detects, as the parameter, an angle of view, a rotation angle, an elevation angle, and an azimuth angle of an imaging range during imaging by the image imaging unit.   Based on the parameters of the image being picked up by the image pickup unit and the parameters of the image held in the image holding unit, the control calculation unit is configured to relatively position the images on the screen. The camera device according to claim 1, wherein the relationship and the size are calculated, and each image is displayed on the screen in a state where the positional relationship and the size are maintained.   The control calculation unit causes the image holding unit to hold information on a display image in which each image is displayed on the screen, and the display image held in the image holding unit and an image being captured by the image imaging unit. The camera apparatus according to claim 3, wherein the relative positional relationship and size on the screen are calculated, and the images are displayed on the screen while maintaining the positional relationship and size.   The control arithmetic unit synthesizes all images held in the image holding unit in response to a predetermined instruction input via the operation input unit, and causes the image holding unit to hold information on the synthesized image. Item 2. The camera device according to Item 1. An image acquisition unit for acquiring information of an image being captured by the image capturing unit;
An image holding unit for holding information of an image taken by the image pickup unit;
A parameter acquisition unit for acquiring a parameter representing a shooting range of an image being captured by the image capturing unit;
A parameter holding unit for holding parameters acquired by the parameter acquisition unit;
The image being captured by the image capturing unit is displayed on the screen of the image display unit according to the parameters acquired by the parameter acquiring unit, and at the same time, the image held in the image holding unit is held in the parameter holding unit A control calculation unit that displays the image on the screen of the image display unit according to the set parameters,
A composite image creation support apparatus.   The composite image creation support apparatus according to claim 6, wherein the parameter acquisition unit acquires, as the parameter, information on an angle of view, a rotation angle, an elevation angle, and an azimuth angle of an imaging range during imaging by the image imaging unit.   Based on the parameters of the image being picked up by the image pickup unit and the parameters of the image held in the image holding unit, the control calculation unit is configured to relatively position the images on the screen. The composite image creation support apparatus according to claim 6 or 7, wherein the relationship and the size are calculated, and each image is displayed on the screen in a state where the positional relationship and the size are maintained.   The control calculation unit causes the image holding unit to hold information on a display image in which each image is displayed on the screen, and the display image held in the image holding unit and an image being captured by the image imaging unit. 9. The composite image creation support apparatus according to claim 8, wherein a relative positional relationship and a size on the screen are calculated, and each image is displayed on the screen in a state where the positional relationship and the size are maintained.   The control calculation unit synthesizes all images held in the image holding unit in response to a predetermined instruction input from a user, and causes the image holding unit to hold information of the combined image. Composite image creation support device. An image acquisition unit acquiring information of an image being captured by the image capturing unit;
A parameter acquisition unit acquiring a parameter representing a shooting range of an image being captured by the image capturing unit;
An image holding unit holding information of an image taken by the image pickup unit; and
A parameter holding unit holding the parameter acquired by the parameter acquisition unit;
The control calculation unit displays the image being captured by the image capturing unit on the screen of the image display unit according to the parameter acquired by the parameter acquisition unit, and at the same time, displays the image held in the image holding unit. Displaying on the screen of the image display unit according to the parameters held in the parameter holding unit;
A synthetic image creation support method comprising: An image acquisition unit for acquiring information of an image being captured by the image capturing unit;
An image holding control unit that causes the image holding unit to hold information of an image captured by the image capturing unit;
A parameter acquisition unit for acquiring a parameter representing a shooting range of an image being captured by the image capturing unit;
A parameter holding control unit for holding the parameter acquired by the parameter acquiring unit in the parameter holding unit;
The image being captured by the image capturing unit is displayed on the screen of the image display unit according to the parameters acquired by the parameter acquiring unit, and at the same time, the image held in the image holding unit is held in the parameter holding unit As a control calculation unit to be displayed on the screen of the image display unit according to the parameter that has been
A composite image creation support program that allows a computer to function.

Images