JP5622180B2 - Imaging apparatus, imaging control method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging control method, and a program, and more specifically, an imaging apparatus having a function of directing selection of an imaging location when imaging a plurality of images while changing the location for an arbitrary subject, The present invention relates to an imaging control method and a program.

  So-called panoramic photography is a technique for photographing a subject such as a landscape over a wide range. One horizontally long image (panoramic photo) is generated, and the entire view of the subject can be seen from this image. In order to perform panoramic shooting with a normal camera such as a digital camera, a plurality of images are captured while changing the shooting direction with respect to the subject, and these images are combined (joined) into one image. Synthesizing is time-consuming and cumbersome.

  In this regard, Japanese Patent Application Laid-Open Publication No. 2004-228688 describes that “a panorama image that reproduces a wide field of view by combining a plurality of divided images obtained by dividing and capturing a wide field of view within a range of angle of view” is obtained. A panoramic imaging method, wherein a desired panoramic image is obtained by selecting a desired recorded image and performing new imaging for a divided image to be joined to the selected recorded image. The technology (hereinafter, “conventional technology”) is disclosed.

  According to this prior art, since image composition can be performed automatically, there is no need for troublesome and time-consuming work.

JP 2000-175185 A

  A technique similar to panoramic photography is “capturing a plurality of images while changing the location of an arbitrary subject”. For example, when photographing a subject such as Mt. Fuji from various directions. In this case, each photograph becomes an independent work. In other words, “Mt. Fuji photo seen from the Shizuoka side”, “Mt. Fuji photo seen from the Yamanashi side”, and so on, but this is not the only way to enjoy multiple photos taken of the same subject. For example, by applying CG technology, a stereoscopic image of a subject (in this case, a stereoscopic image of Mt. Fuji) can be created from a plurality of photographs. By rotating this three-dimensional image on the display screen, a virtual realistic fun of viewing the subject from various directions can be obtained.

  Hereinafter, such a photographing technique that leads to the generation of a stereoscopic image is referred to as “reverse panoramic photographing” in the present specification for convenience.

  The term “stereoscopic image” as used herein refers to an image that provides a sensation of looking around each side of the subject while looking around the subject. Therefore, the stereoscopic image in the present specification is different from a so-called stereo image (an image that gives a feeling of depth as if viewed by human eyes: also referred to as a 3D image).

  As described above, reverse panoramic shooting can generate an interesting image called a three-dimensional image (thus, it can be enjoyed in a way that is not possible in a conventional two-dimensional image). The problem of how to select the shooting location efficiently must be overcome. This is because, unlike panoramic shooting, reverse panoramic shooting requires shooting at a plurality of locations while traveling around the subject.

  FIG. 10 is a diagram showing a shooting location for reverse panoramic shooting (hereinafter also referred to as a shooting location). In order to simplify the explanation, it is assumed that a camera 1 of a fixed focus lens (that is, no zoom) is used. Now, assuming that the first shooting is performed at the first point P1 separated from the subject 2 by the distance L, the second and subsequent shooting points P2 to Pn have the same distance L, that is, a radius centered on the subject 2. It must be set somewhere on the circle 3 of L. The reason is that if the distance for each photographing point is different, the size of the photographed subject will be different, which will hinder the generation of a stereoscopic image.

  In order to match the distance of the first photographing point P1 (distance from the subject 2; the same applies hereinafter) to the distances of the second and subsequent points P2 to Pn, the distance from the subject 2 is measured at each point. There is a need. Although it is possible to measure artificially (measure with a tape measure or measure with a tape measure) at a short distance, it is not practical at a long distance. In particular, when shooting a large subject (mountain scenery such as Mt. Fuji), it is possible to take a distance (several kilometers or tens of kilometers), so it is practically impossible to measure the distance. For this reason, in practice, shooting must be performed at an appropriately selected point (and hence the point where the distance from the subject is inaccurate), and a difference in the size of the subject in each image occurs as the distance shifts. Therefore, the generation of a stereoscopic image is hindered.

  This is because the selection of an appropriate shooting point (therefore, a point where the distance from the subject is inaccurate) is not effective. Support technology for panoramic photography exists (for example, the above-described conventional technology), but support technology for reverse panoramic photography that has not been common has not yet appeared.

  Therefore, an object of the present invention is to provide a technique for supporting selection of a shooting point in reverse panoramic shooting.

The invention according to claim 1 is an imaging device that guides selection of a shooting location when a plurality of images are captured while changing the location of an arbitrary subject, and acquires the position (A) of the subject. First acquisition means, second acquisition means for acquiring a shooting position (B) when the subject is first shot, and second and subsequent shooting candidate positions based on the two positions (A, B) Calculating means for calculating, output means for outputting guidance information for guiding shooting at the shooting candidate position calculated by the calculating means, and a shooting position (B) and a current position when the subject is first shot And a first guiding means for presenting and guiding a relative positional relationship between the photographing position (B) and the current position or a route to the photographing position (B) when the two are different from each other. It is an imaging device.
According to a second aspect of the present invention, the second guiding means for presenting and guiding a relative positional relationship between the second and subsequent photographing candidate positions and the current position or a route to the second and subsequent photographing candidate positions. The imaging apparatus according to claim 1, further comprising:
The invention according to claim 3 is an imaging device that guides selection of a shooting location when shooting a plurality of images while changing the location of an arbitrary subject, and acquires the position (A) of the subject. First acquisition means, second acquisition means for acquiring a shooting position (B) when the subject is first shot, and second and subsequent shooting candidate positions based on the two positions (A, B) Calculating means for calculating the image, and output means for outputting guidance information for guiding shooting at the shooting candidate position calculated by the calculating means, wherein the calculating means is one of the second and subsequent shooting candidate positions. When one is included in an area where entry is difficult or an area where access is restricted , the imaging apparatus is modified so that the imaging candidate position is moved to a place avoiding the area .
The invention according to claim 4 is an imaging device that guides selection of a shooting location when shooting a plurality of images while changing the location of an arbitrary subject, and acquires the position (A) of the subject. First acquisition means, second acquisition means for acquiring a shooting position (B) when the subject is first shot, and second and subsequent shooting candidate positions based on the two positions (A, B) Calculating means for calculating the image, and output means for outputting guidance information for guiding shooting at the shooting candidate position calculated by the calculating means, wherein the calculating means is one of the second and subsequent shooting candidate positions. If one is in a location that does not foresee the subject being obstructed by the obstacle, imaging the imaging candidate position, characterized in that it modified to move to the location where line of sight of the subject to avoid the obstacle Device .
The invention according to claim 5 is an imaging device that guides selection of a shooting location when shooting a plurality of images while changing the location of an arbitrary subject, and acquires the position (A) of the subject. First acquisition means, second acquisition means for acquiring a shooting position (B) when the subject is first shot, and second and subsequent shooting candidate positions based on the two positions (A, B) And an output means for outputting guidance information for guiding photographing at the photographing candidate position calculated by the calculating means, wherein the calculating means is centered on the position (A) of the subject. , A circle having a radius with a length corresponding to the distance between the two positions (A, B) is drawn, the position on the circle is obtained as the second and subsequent shooting candidate positions, and the output means A predetermined mark indicating the circle and the second and subsequent shooting candidate positions An imaging apparatus and displaying the map on the screen the door as teaching information to the user.
According to a sixth aspect of the present invention, when the user actually shoots in the vicinity of any one of the second and subsequent shooting candidate positions , the actual shooting position is not on the circle. If, claims the subject decrease by changing the angle of view of the imaging unit for imaging the same extent as if real shooting in the circle is characterized by performing the correction of the photographic candidate position as if it were made 5. The imaging device according to 5 .
According to claim 7 invention of claim 5, further comprising an interface means for changing the spacing of the set the second and subsequent shot candidate position on the circle to the user An imaging device.
The invention according to claim 8 is an imaging control method that guides selection of a shooting location when shooting a plurality of images while changing the location of an arbitrary subject, and acquires the position (A) of the subject. A first acquisition step, a second acquisition step of acquiring a shooting position (B) when the subject is first shot, and a second and subsequent shooting candidates based on the two positions (A, B) A calculation step of calculating a position, an output step of outputting guidance information for guiding shooting at a shooting candidate position calculated in the calculation step, a shooting position (B) and a current position when the subject is first shot If the bets are different, the photographing position (B) and the relative positional relationship or the imaging position path imaging control, which comprises a guide step of presenting to guide the to (B) the current position Is the method .
The invention according to claim 9 is a program for giving a computer a function of instructing selection of a photographing place when photographing a plurality of images while changing a place with respect to an arbitrary subject, to a computer of an imaging device, First acquisition means for acquiring the position (A) of the subject, second acquisition means for acquiring a photographing position (B) when the subject is first photographed, and the two positions (A, B) Based on the calculation means for calculating the second and subsequent shooting candidate positions, the output means for outputting guidance information for guiding shooting at the shooting candidate positions calculated by the calculation means, and the first shooting of the subject When the shooting position (B) is different from the current position, the relative position relationship between the shooting position (B) and the current position or the route to the shooting position (B) is presented and guided. characterized in that it comprises a guide means Is a program.

  According to the present invention, the second and subsequent photographing candidate positions are calculated based on the subject position (A) and the photographing position (B) when the subject is first photographed, and the computed photographing candidate positions are calculated by the user. It can be displayed on the screen as instruction information for. Therefore, the user can select the shooting location when taking a plurality of images while changing the location for an arbitrary subject without difficulty, according to the instruction information. Can provide useful assistive technologies.

It is a block diagram of a digital camera. 3 is a data storage structure diagram of a storage unit 16. FIG. It is a figure (1/2) which shows the control program performed with the control part 19. FIG. It is a figure (2/2) which shows the control program performed with the control part 19. FIG. It is a figure (1/2) which shows the execution screen (designation screens 21-24) of a control program. It is a figure (2/2) which shows the execution screen (guide screens 21-24) of a control program. It is a figure which shows a 1st modification. It is a figure which shows the 2nd modification. It is a figure which shows the 3rd modification. It is a figure which shows the imaging | photography place of reverse panoramic imaging.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings, taking application to a digital camera as an example.

<Configuration>
First, the configuration of the embodiment will be described.
FIG. 1 is a configuration diagram of a digital camera. The digital camera 10 includes an imaging unit 11, an operation unit 12, a position detection unit 13, a display unit 14, a touch panel 15, a storage unit 16, an external I / F 17, a power supply unit 18, a control unit 19, and the like.

  The imaging unit 11 includes a photographing lens (not shown), a two-dimensional imaging device such as a CCD or CMOS, an image processing unit, and the like. Under the control of the control unit 19, an arbitrary subject captured via the photographing lens is captured. After the image is formed on the imaging surface of the two-dimensional imaging device, the image signal (still image or moving image) corresponding to the image is output from the two-dimensional imaging device, and after performing the required image processing in the image processing unit, etc. Output to the control unit 19.

  In general, the photographing lens of the imaging unit 11 has a zoom function that can arbitrarily change the angle of view within a predetermined range, that is, from the wide side (wide angle side) of a predetermined wide angle of view to the tele side (telephoto side) of a predetermined narrow angle of view. Although it has a function that can arbitrarily change the shooting angle of view within the range, for the convenience of explanation, unless otherwise noted below, it is a shooting lens (shooting lens with a fixed angle of view) that does not have the zoom function. Shall.

  The operation unit 12 includes a power switch, a shutter button, and other buttons, generates a signal corresponding to the operation of the switch and button, and outputs the signal to the control unit 19.

  The position detection unit 13 is a device for detecting the current position of the digital camera 10, and is typically a position detection device using a GPS satellite. GPS is an abbreviation for Global Positioning System. Of the approximately 30 GPS satellites that orbit at an altitude of about 20,000 km over a period of about 12 hours, several of them are located above the positioning point. By receiving a signal from a satellite, the system can know the position coordinates of the positioning point (the altitude depending on the latitude and longitude and the number of captured satellites) from the signal. The position detection accuracy for private use is said to be about 100 m, but if DGPS (Differential GPS) is used, extremely high accuracy of 10 m or less can be obtained. In DGPS, two receivers are used to obtain an accurate position based on the difference between the respective positioning positions. What is necessary is just to use GPS alone or together with DGPS according to the required precision.

  The display unit 14 is a high-definition two-dimensional display device, preferably a color liquid crystal display or an organic EL display, and data appropriately output from the control unit 19, for example, a composition confirmation image (through image at the time of shooting) ), A confirmation image immediately after the completion of photographing, a photographed image arbitrarily selected by the user, various setting screens of the digital camera 10, and the like, and “the photographing point in the reverse panoramic photographing, which is a point of the present embodiment” The screen for “Guide to Selection” is displayed. This point will be described in detail later.

  The touch panel 15 is a transparent thin film sheet having a plane size substantially the same as the screen size of the display unit 14, and is disposed on the screen of the display unit 14. The display unit 14 passes through the touch panel 15. Display information can be seen. The structure of the touch panel 15 is various such as a resistive film type and a capacitance type. In any of the systems, the position of the touch point (XY coordinate of the touch panel 15) is detected and the position data is output to the control unit 19. The same is true. The resistive film type detects the touch of a hard object (such as a pen), and the capacitive type detects the touch of a part of the human body (generally a finger). Any method may be selected in consideration of usage. In the figure, the display unit 14 and the touch panel 15 are drawn in a shifted manner, but this is for convenience of illustration. Actually, they overlap each other without deviation.

  The storage unit 16 is a nonvolatile and rewritable information storage element. For example, a flash memory such as an SD card, a hard disk, or the like can be used. The storage unit 16 stores and saves various user data (such as image data captured by the image capturing unit 12), and a map necessary for “guidance for selecting a shooting point in reverse panoramic shooting” which is a point of the present embodiment. Store and save data.

  The external I / F 17 is a data interface with an external device such as a personal computer. The external device can access the storage unit 16 via the external I / F 17 and the central control unit 19, and can read or rewrite various data stored in the storage unit 16. Or add new data.

  The power supply unit 18 includes a battery composed of a primary battery or a rechargeable secondary battery, and generates various power supply voltages necessary for the operation of the digital camera 10 from the power of the battery and supplies them to the respective units.

  The control unit 19 includes a computer or microcomputer (hereinafter referred to as CPU) 19a, a read-only semiconductor memory (hereinafter referred to as ROM) 19b, a high-speed semiconductor memory (hereinafter referred to as RAM) 19c, and a control element of a program control system including peripheral circuits not shown The control program stored in advance in the ROM 19b is loaded into the RAM 19c and executed by the CPU 19a, whereby various processes are executed sequentially to control the overall operation of the digital camera 10. The ROM 19b may be a rewritable nonvolatile semiconductor memory (flash memory, PROM, etc.).

  FIG. 2 is a data storage structure diagram of the storage unit 16. In this figure, the storage unit 16 stores an area for storing image data captured by the imaging unit 12 (hereinafter referred to as a captured image storage region 19), and a map necessary for instruction for selecting a shooting point in reverse panoramic shooting. An area for storing and saving data (hereinafter referred to as map information storage area 20) is secured. Here, it is desirable that the map data covers the entire range of expected behavior of the user of the digital camera 10 (all maps in Japan, etc.), but such a wide range of map data has a considerable size, and stores map information. For example, the map data in the necessary range may be written to the map information storage area 20 from an external device whenever necessary.

<Action>
Next, the operation of the embodiment will be described.
3 and 4 are diagrams illustrating a control program executed by the control unit 19, and FIGS. 5 and 6 are diagrams illustrating control program execution screens (guidance screens 21 to 24). However, the illustrated program is not the entire control program. The part related to the point of the present embodiment, that is, the part related to “Guide to Selection of Shooting Point in Reverse Panorama Shooting” (main part flow) is extracted, and the main part flow is simplified in order to simplify the explanation. Is.

  This control program (main part flow) is not executed in normal photographing. The mode is executed when the user selects the “reverse panorama shooting” mode and the user selects to start the shooting at the time of shooting (the shooting point selection instruction in the reverse panorama shooting).

  Therefore, as a matter of course, the operation unit 12 is provided with a button for selecting the “reverse panorama shooting” mode and a button for instructing the start of the instruction. Incidentally, an object (button control or the like) on the display unit 14 may be used instead of these physical buttons. By touching these objects using the touch panel 15, the same operation as when a physical button provided on the operation unit 12 is operated can be obtained.

  When the illustrated control program is started, the control unit 19 displays the instruction screen (see FIGS. 5 and 6) on the display unit 14. Thereafter, the user selects and shoots a reverse panoramic shooting point while interacting with the instruction screen. 5 and 6 omits the background map display in order to avoid the congestion of the drawings.

  First, the control unit 19 determines whether or not the position of the subject (subject 25 in FIG. 5) has been designated by the user (step S1). If the position of the subject 25 is designated, the position coordinates of the subject 25 (hereinafter referred to as coordinates A) are acquired (step S2).

  The subject 25 is an arbitrary target or landscape that is the subject of reverse panoramic photography, and is, for example, Mt. Fuji described at the beginning. Hereinafter, the subject 25 will be specifically described as “Mt. Fuji”.

  The coordinates of the position of Mt. Fuji (the position of the summit) are 35 degrees 21 minutes 39 seconds north latitude / 138 degrees 43 minutes 39 seconds east longitude (world geodetic coordinates). Thus, if the coordinates of the subject 25 are known, the known coordinates may be directly input as “coordinate A” using the touch panel 15 or the operation unit 12. In this case, the control unit 19 acquires the input coordinates as “coordinate A”. Alternatively, a map (read from the map information storage area 20 of the storage unit 16) may be displayed on the display unit 14, and the position of the subject 25 (Mt. Fuji in this case) on the map may be designated by the user. In this case, the control unit 19 acquires the coordinates of the designated position as “coordinate A”. Alternatively, if possible, the user may go to the subject 25 and detect the coordinates of the subject 25 using the position detection unit 13. In this case, the control unit 19 acquires the detected coordinates as “coordinate A”. However, this last method cannot be used when the subject 25 is far away. In particular, when the subject 25 is a large object such as Mt. Fuji, it is impossible. Therefore, in reality, the coordinate A of the subject 25 is acquired by one of the two methods. Of course, this is not the case when the subject 25 is nearby (for example, in front of the eyes). The coordinates A may be acquired by going to the subject 25.

  When the coordinate A of the subject 25 is set, the control unit 19 next determines whether or not the first shooting point (point P1 in FIG. 5) has been designated by the user (step S3). The first shooting point P1 is a place where the user desires the first shooting, and is an arbitrary one on the map displayed on the display unit 14 (read from the map information storage area 20 of the storage unit 16). It is a point.

  When the first shooting point P1 is designated, it is next determined whether or not the position of the shooting point P1 matches the current position of the user (the position detected by the position detection unit 13). (Step S4).

  If the determination result in step S4 is YES, that is, if the position of the first shooting point P1 and the current position of the user (the position detected by the position detection unit 13) match, the position coordinates Are acquired as position coordinates (hereinafter referred to as coordinates B) of the first photographing point P1 (step S5).

  On the other hand, if the determination result in step S4 is NO, that is, if another place different from the current position on the map is designated as the first shooting point P1, the route to the shooting point P1 is guided. Guidance information to be displayed is displayed on the display unit 14 (step S6), and the determination in step S4 is repeated. Note that “guidance” is not only a mode in which the route from the current position to the target position is mapped and displayed on a road on the map (so-called route map), but also the relative positional relationship between the current position and the target position. It also includes an aspect of simple display (for example, an arrow indicating the direction of the target position and a distance to the target position). Hereinafter, the term “guidance” has the same definition.

  When the user moves to the first shooting point P1 while viewing the guidance information and reaches the first shooting point P1, the determination result in step S4 becomes YES. That is, when it reaches the first shooting point P1, it matches the current position of the user (the position detected by the position detection unit 13), so that the position coordinate is the position coordinate B of the first shooting point P1. (Step S5).

  When the coordinate B of the first shooting point P1 is acquired, the control unit 19 displays a message indicating that the first shooting should be performed on the display unit 14 (flow is omitted). The user performs the first reverse panorama shooting according to this message, and the control unit 19 determines whether or not the first shooting is completed (step S7).

  Since the reverse panoramic shooting operation is the same as the normal shooting operation, detailed description thereof is omitted. The difference from the normal shooting operation is that when storing image data in the storage unit 16, it is clearly stored that it is a group of image data shot by reverse panorama shooting. There are various ways to specify this. For example, a part of the file name may be aligned, or an independent folder may be created and a group of image data may be collectively stored therein. Alternatively, data indicating a group of image data may be written in the additional information of the image data.

  When the first imaging is completed, the control unit 19 then displays on the display unit 14 the instruction screens 21 to 24 including the instruction information for performing “the instruction for selecting the imaging point in the reverse panoramic imaging”. That is, first, a circle having a radius from the coordinate A to the coordinate B with the subject 25 as the center is drawn (step S8), and then the second and subsequent shooting point candidate marks are displayed on the circle (step S8). Step S9).

  Specific examples of the instruction screens 21 to 24 are shown in FIGS. 6 (a) and 6 (b). 6A, the circle 26 drawn around the subject 25 has a radius L from the coordinate A to the coordinate B, and a plurality of circles 26 are formed on the circle 26 in FIG. 6B. Marks P2 to P8 are displayed. The plurality of marks P2 to P8 are marks that are candidates for shooting points in reverse panoramic shooting, that is, instruction information for giving the user a shooting position necessary for reverse panoramic shooting. Let's say P8.

  The setting conditions for the candidate marks P2 to P8 are as follows. First, the distance from each photographing candidate point (P2 to P8) to the subject 25 is substantially the same as the distance L from the first photographing point P1 to the subject 25. (That is, each photographing candidate point is substantially located on the circle 26), and second, each photographing candidate point (P2 to P8) makes the area of the circle 25 substantially the same angle. are substantially located on the dividing lines 27, 28,... when divided into a plurality by θ.

  The first condition is to align the size of the subject 25 photographed at the first photographing point P1 with the size of the subject 25 photographed at the second and subsequent photographing points P2 to P8. This is because if the size of the subject 25 of each image is different, it will hinder the creation of the stereoscopic image described at the beginning.

  The second condition is for determining the accuracy (also referred to as fineness) of the stereoscopic image. As the angle θ is decreased, a more accurate stereoscopic image can be generated. The angle θ will be described using, for example, a case where a stereoscopic image of Mt. Fuji is generated. Suppose now that Mt. Fuji was photographed from one point in the north of Mt. Fuji (in Shizuoka Prefecture) and one point in the south direction (in Yamanashi Prefecture). That is, it is assumed that the image is taken at an angle θ = 180 degrees. In this case, the number of captured images is two. Although it is possible to generate a stereoscopic image (a stereoscopic image of Mt. Fuji) from this small number of images, the accuracy is not sufficient. This is because there is a definite lack of information on hidden parts that cannot be seen from the two shooting points.

Therefore, in order to obtain an accurate stereoscopic image, it is necessary to shoot all the way from many directions (decrease the angle θ), but there is a limit to this. This is because if the angle θ is reduced, an accurate stereoscopic image can be obtained, but the number of shooting points increases and it takes time and effort. For this reason, in practice, the angle θ is set to an appropriate angle θ with no excess or deficiency considering the required accuracy of the stereoscopic image and the time and effort of photographing.
Here, “a circle 26 drawn with the distance L from coordinates A to B centered on the subject 25 as a radius” and “a plurality of candidate marks P2 to P8 set on the circle 26” These two are displayed on the screen (display unit 14) as instruction information, but the present invention is not limited to this. An aspect in which the circle 26 is omitted from the instruction information, that is, only the candidate marks P2 to P8 may be displayed on the screen. The instruction information only needs to satisfy at least the first condition.

  When all the candidate marks P2 to P8 are displayed, the control unit 19 sets an initial value “2” in the candidate mark selection counter i (step S10), and the i-th shooting point, that is, the current i is “2”. Therefore, it is determined whether or not the position of the second shooting point P2 matches the current position of the user (the position detected by the position detection unit 13) (step S11).

  If the determination result in step S11 is NO, that is, if the position of the second shooting point P2 does not match the current position of the user (the position detected by the position detection unit 13), the shooting is performed. Guidance information for guiding the route to the point P2 is displayed on the display unit 14 (step S12), and the determination in step S11 is repeated.

  When the user moves to the second shooting point P2 while viewing the guidance information and reaches the second shooting point P2, the determination result in step S11 becomes YES. That is, when it reaches the second shooting point P2, it coincides with the current position of the user (the position detected by the position detection unit 13), so the control unit 19 performs the second shooting on the display unit 14. Display a message to the effect (flow omitted). The user performs the second reverse panorama shooting in accordance with this message, and the control unit 19 determines whether or not the second shooting is completed (step S13).

  When the second shooting is completed, the control unit 19 sets the candidate mark P2 of the finger image 24 (FIG. 6B) to have been shot (for example, changing the color or changing the shape; the same applies hereinafter) After the candidate mark selection counter i is incremented by 1 (step S14), it is determined whether or not “i> imax” (step S15). imax is the total number of candidate marks P2 to P8. If “i> imax”, it is determined that reverse panorama shooting has been completed for all candidate marks P2 to P8, and the program ends. However, if “i> imax” is not set, shooting still remains. Return to step S11.

  Since the i-th shooting point, that is, the current i is “3”, the control unit 19 determines the position of the third shooting point P3 and the current position of the user (the position detected by the position detection unit 13). ) Is matched (step S11).

  If the determination result in step S11 is NO, that is, if the position of the third shooting point P3 and the current position of the user (the position detected by the position detection unit 13) do not match, the shooting is performed. Guidance information for guiding the route to the point P3 is displayed on the display unit 14 (step S12), and the determination in step S11 is repeated.

  When the user moves to the third shooting point P3 while viewing the guidance information and reaches the third shooting point P3, the determination result in step S11 becomes YES. That is, when it reaches the third shooting point P3, it coincides with the current position of the user (the position detected by the position detection unit 13), so the control unit 19 performs the third shooting on the display unit 14. Display a message to the effect (flow omitted). The user performs the third reverse panorama shooting according to this message, and the control unit 19 determines whether or not the third shooting is completed (step S13).

  When the third shooting is completed, the control unit 19 sets the candidate mark P3 of the finger image 24 (FIG. 6B) to be shot, sets the candidate mark selection counter i to +1 (step S14), and then sets “i> It is determined whether or not “imax” (step S15). Similarly, imax is the total number of candidate marks P2 to P8. If “i> imax”, it is determined that reverse panorama shooting has been completed for all candidate marks P2 to P8, and the program ends. However, if “i> imax” is not set, shooting still remains. Return to step S11.

  In the same manner as described above, guidance to the shooting points from the fourth time to the seventh time and shooting are performed (details are omitted), and the candidate mark selection counter i is incremented by 1 at the stage of completion of the seventh shooting. It becomes “8”.

  Since the i-th shooting point, that is, the current i is “8”, the control unit 19 detects the position of the last eighth shooting point P8 and the current position of the user (detected by the position detection unit 13). It is determined whether or not the (positioned position) matches (step S11).

  If the determination result in step S11 is NO, that is, if the position of the eighth shooting point P8 does not match the current position of the user (the position detected by the position detection unit 13), the shooting is performed. Guidance information for guiding the route to the point P8 is displayed on the display unit 14 (step S12), and the determination in step S11 is repeated.

  When the user moves to the eighth shooting point P8 while viewing the guidance information and reaches the eighth shooting point P8, the determination result in step S11 becomes YES. That is, since it coincides with the current position of the user (the position detected by the position detection unit 13) when the eighth shooting point P8 is reached, the control unit 19 performs the eighth shooting on the display unit 14. Display a message to the effect (flow omitted). The user performs the last (eighth) reverse panorama shooting according to this message, and the control unit 19 determines whether or not the last (eighth) shooting is completed (step S13).

  When the last (eighth) shooting is completed, the control unit 19 sets the candidate mark P8 of the finger image 24 (FIG. 6B) to have been shot and sets the candidate mark selection counter i to +1 (step S14). It is determined whether or not “i> imax” (step S15). Since i exceeds imax at this stage, the control unit 19 has completed reverse panorama shooting for all candidate marks P2 to P8. If necessary, a necessary end message (for example, “a series of reverse panorama shooting has been completed”) is displayed, and then the program ends.

<Effect>
As described above, according to the embodiment, the following effects can be obtained.
(1) Support for selecting a shooting location for reverse panoramic shooting:
By simply setting the coordinates A of an arbitrary subject and the coordinates B of the place where the subject was first photographed, a plurality of candidate shooting locations (candidate marks P2 to P8) suitable for reverse panoramic photographing of the subject. Can be displayed on the screen as instruction information. Therefore, the user can easily obtain materials (a plurality of images) for generating a stereoscopic image of the subject simply by sequentially moving to the positions of the candidate marks P2 to P8 and repeating photographing.
(2) Guidance to the shooting location:
In addition, since route guidance to the first shooting location and route guidance to the second and subsequent shooting locations are performed, it is possible to reach the target shooting location without hesitation even if the location is unfamiliar with the geography.
(3) Invitation to stereoscopic images:
Then, by (1) and (2) above, anyone can easily perform “reverse panorama shooting”, which is a special shooting method that is not well known in general. Many users can enjoy the virtual reality of creating images and viewing the subject from various directions.

<First Modification>
The above embodiment can be variously modified and developed. For example, you may deform | transform as follows.

  FIG. 7 is a diagram illustrating a first modification. As shown in (a), depending on the situation at the site, it may not be possible to take a picture at a designated candidate point (candidate mark Pi). In such a case, the position must be corrected along the circle 26, or the position must be corrected by moving away from the subject 25 (P ') or approaching (Pi ").

  When the position is corrected along the circle 26, no particular inconvenience occurs. This is because at least the first condition (the distance L matches) is satisfied. However, when moving away from the subject 25 (P ′) or approaching (Pi ″), the first condition (distance L matches) is not satisfied, and the image is taken at the correction point (P ′ or Pi ″). The size of the photographed subject 25 is different from the size of the subject 25 photographed at another photographing point, which causes inconvenience when creating the stereoscopic image described at the beginning.

  The first modification is for eliminating such inconvenience. However, in the first modified example, it is necessary to assume that the photographing lens of the imaging unit 12 has a zoom and that the zoom magnification can be controlled by a command from the control unit 19.

  Under such a premise, in the first modification, as shown in FIG. 7B, it is determined whether or not the shooting point is on the circle 26 in the second and subsequent shooting stages (step S21). If the determination result is NO, that is, if the correction position (P ′ or Pi ″) is as shown in FIG. 7A, whether or not those correction positions are close to the subject 25, that is, It is determined whether or not the correction position (Pi ″) is less than or equal to the distance L to the subject 25 (step S22). In the following case (correction position Pi ″), the appropriate amount is zoomed down (step S23), but not below. In this case (correction position P ′), an appropriate amount value zoom-up (step S24) is added.

  Here, the “appropriate amount value” for zooming up and down means a zoom magnification at which a subject that matches the size of the subject photographed in the first time can be obtained. Specifically, a feature point that is common to the first shot image and the current shot composition adjustment image is searched, and the zoom factor is actually controlled (moving), and the magnification at which these feature points coincide with each other Is to be found and set as the above “appropriate amount value”.

  In this way, inconveniences when shooting cannot be performed at the designated candidate point (candidate mark Pi) can be solved. More specifically, if the subject 25 is unavoidably moved away from the subject 25 (P ′) and photographed, the subject 25 is originally photographed in a small size. The size of the subject 25 can be appropriately returned (enlarged) by (Step S24), or if it is unavoidably moved to a place (P ″) that is close to the subject 25 and shot, In this first modification, the size of the subject 25 can be appropriately returned (reduced) by zooming down (step S23), and in either case, the stereoscopic image is captured. You can avoid trouble when creating.

<Second Modification>
FIG. 8 is a diagram illustrating a second modification. In the above-described embodiment, candidate marks for shooting points are set at positions where the distance L to the subject 25 is at least the same (a position that satisfies the first condition). However, since such a position does not consider actual topographic features at all, it is difficult to enter as shown in FIG. 8A, for example, a place (Pi) off the road 29, or There may be a place where the subject 25 cannot be seen as shown in FIG. 8B, for example, a place (Pi) hidden behind the obstacle 30. In the case of FIG. 8 (a), it is possible to forcibly enter the place (Pi), but in the case of FIG. 8 (b), the subject 25 cannot be seen and thus the photographing itself cannot be performed.

  Therefore, in the second modification, in the case of FIG. 8 (a), it is decided to move to a place on the map where the user can freely enter (for example, the place Pi on the road 29), and In the case of FIG. 8B, it is decided to move to a place (a place Pia on the circle 26) where the subject 25 can be seen by avoiding the obstacle 30 and correct.

  The location after the movement is indicated by Pia and Pib. In FIG. 8A, Pia is a location on the road 29 and above the circle 26, and Pib is a location on the road 29 and approaches the subject 25 or away from the subject 25. It is. In the case of Pib, the first modified example is used together.

  As described above, according to the second modified example, the candidate marks Pia and Pib of the shooting point can be set by moving to a place in consideration of the actual topographic feature, so it is not necessary to enter the road 29, Further, it is possible to take a picture while avoiding the obstacle 30.

  In the above description, the outside of the road 29 is shown as a place where it is difficult to enter, but the present invention is not limited to this. There are various such places such as private sites and restricted access areas such as airports, all of which can be specified from map information. Therefore, as in the second modification, it is sufficiently feasible to move and set the shooting point candidate mark to a place in consideration of the actual topographic feature.

  The same applies to the obstacle 30. Some maps contain altitude information. For example, “Numerical Map 5m Mesh (Elevation)” published by the Geospatial Information Authority of Japan is known. If a map including such altitude information is used, when the subject 25 is viewed from the altitude of the shooting point, it can be checked whether there is an obstacle 30 such as a mountain between them. The candidate mark of the shooting point can be moved and set to a place where the obstacle 30 is avoided.

  Furthermore, the obstacle 30 is not limited to a natural object such as a mountain. An artifact such as a building also becomes an obstacle 30. In order to move and set the shooting point candidate mark to a place where such an artificial obstacle 30 is avoided, for example, use of car navigation map data can be considered. This is because most of the recent map data for car navigation contains detailed information (appearance, height, size, etc.) of landmarks in various places. By using this, landmarks such as buildings can be regarded as artificial obstacles 30 and can be avoided. In particular, it is preferable to perform reverse panoramic shooting on a subject 25 in a city. it can.

<Third Modification>
In the above-described embodiment, the angle θ (see FIG. 6B) of the second condition is a fixed value. If this angle θ is reduced, an accurate stereoscopic image can be obtained, but the number of shooting points increases. It has the contradiction that it takes time to shoot. Therefore, in determining the angle θ, only one of the measures of sacrificing one or making a compromise between the two can be taken. Therefore, in the third modification, the angle θ can be arbitrarily set, so that it is possible to select at the user's will which priority should be given to the generation of an accurate stereoscopic image or the reduction of troublesome shooting. .

  FIG. 9 is a diagram illustrating a third modification. (A) shows a case where the angle θ is greatly changed, and (b) shows a case where the angle θ is changed small. In the third modification, when the user selects the dividing line 28 of the second candidate mark P2, the control unit 19 displays an icon 31 having a predetermined shape (hand shape in the drawing) on the screen. When the icon 1 is moved by the user in a predetermined direction (clockwise or counterclockwise around the subject 25), the control unit 19 adjusts the angle θ of the dividing line 28 according to the movement of the icon 31. In addition, the angle of other dividing lines is similarly increased and decreased, and the position and number of candidate marks Pi for each dividing line are corrected.

  Therefore, for example, as shown in (a), when the angle θ is greatly changed, the interval between the candidate marks widens and the number of candidate marks decreases accordingly. In the example shown in FIG. 6B, four can be reduced from 7 to 3 in the example shown in FIG. 6B, and the number of photographing points can be reduced to reduce the time and effort of photographing. Alternatively, as shown in (b), when the angle θ is changed to be small, the interval between candidate marks is narrowed, and the number of candidate marks is increased accordingly. In the example shown in the figure, 7 in 6 (b) can be increased from 4 to 7 in the example shown in the figure, and the material (multiple images) for generating an accurate stereoscopic image can be obtained, although the time and effort of shooting increase. be able to.

  As described above, according to the third modified example, a user who places importance on reducing the effort of shooting can increase the angle θ as much as necessary by his / her own intention, while a user who places importance on the generation of an accurate stereoscopic image similarly Since the angle θ can be reduced as much as necessary by its own will, it can be used in a flexible manner that is not biased in any way, so that it can be made practically preferable.

Pi candidate mark (shooting location)
10 Digital camera (imaging device)
13 position detector (first acquisition means, second acquisition means)
14 Display (screen)
19 Control unit (calculation means, first guide means, second guide means, first acquisition means, second acquisition means)
19a CPU (computer, display means)
25 subject 26 yen 30 obstacle 31 icon (interface means)

Claims (9)

An imaging device that guides selection of a shooting location when shooting a plurality of images while changing the location for an arbitrary subject ,
First acquisition means for acquiring the position (A) of the subject;
Second acquisition means for acquiring a shooting position (B) when the subject is first shot;
A computing means for computing the second and subsequent shooting candidate positions based on the two positions (A, B);
Output means for outputting guidance information for teaching photographing at a photographing candidate position calculated by the calculating means ;
When the photographing position (B) when the subject is first photographed is different from the current position, the relative positional relationship between the photographing position (B) and the current position or the route to the photographing position (B) is determined. An imaging apparatus comprising: first guiding means for presenting and guiding . The apparatus further comprises second guiding means for presenting and guiding a relative positional relationship between the second and subsequent photographing candidate positions and a current position or a route to the second and subsequent photographing candidate positions. The imaging device according to claim 1. An imaging device that guides selection of a shooting location when shooting a plurality of images while changing the location for an arbitrary subject,
First acquisition means for acquiring the position (A) of the subject;
Second acquisition means for acquiring a shooting position (B) when the subject is first shot;
A computing means for computing the second and subsequent shooting candidate positions based on the two positions (A, B);
Output means for outputting guidance information for guiding photographing at the photographing candidate position calculated by the calculating means;
With
The calculation means moves the photographing candidate position to a place avoiding the area when any one of the second and subsequent photographing candidate positions is included in an area where entry is difficult or an area where access is restricted. An image pickup apparatus which is corrected so as to perform. An imaging device that guides selection of a shooting location when shooting a plurality of images while changing the location for an arbitrary subject,
First acquisition means for acquiring the position (A) of the subject;
Second acquisition means for acquiring a shooting position (B) when the subject is first shot;
A computing means for computing the second and subsequent shooting candidate positions based on the two positions (A, B);
Output means for outputting guidance information for guiding photographing at the photographing candidate position calculated by the calculating means;
With
The computing means avoids the obstacle and avoids the obstacle when any one of the second and subsequent photographing candidate positions is obstructed by an obstacle and cannot be seen through the subject. An image pickup apparatus that is corrected so as to move to a place where it can be seen through . An imaging device that guides selection of a shooting location when shooting a plurality of images while changing the location for an arbitrary subject,
First acquisition means for acquiring the position (A) of the subject;
Second acquisition means for acquiring a shooting position (B) when the subject is first shot;
A computing means for computing the second and subsequent shooting candidate positions based on the two positions (A, B);
Output means for outputting guidance information for guiding photographing at the photographing candidate position calculated by the calculating means;
With
The calculation means draws a circle having a radius with a length corresponding to the distance between the two positions (A, B) around the position (A) of the subject, Obtained as the second and subsequent shooting candidate positions,
And the output means, the imaging apparatus and displaying the map on the screen with a predetermined mark indicating the shot candidate position of the circle and the second and subsequent as teaching information to the user. The calculation means is for capturing an image of the subject when the user actually shoots in the vicinity of any one of the second and subsequent shooting candidate positions and the actual shooting position is not on the circle. 6. The imaging apparatus according to claim 5 , wherein the imaging candidate position is corrected as if the actual imaging was performed on the circle by changing the angle of view of the imaging unit. 6. The imaging apparatus according to claim 5 , further comprising interface means for allowing a user to change an interval between the second and subsequent shooting candidate positions set on the circle . An imaging control method that guides selection of a shooting location when shooting a plurality of images while changing the location for an arbitrary subject,
A first acquisition step of acquiring the position (A) of the subject;
A second acquisition step of acquiring a shooting position (B) when the subject is first shot;
A calculation step of calculating the second and subsequent shooting candidate positions based on the two positions (A, B);
An output step of outputting guidance information for teaching shooting at the shooting candidate position calculated in the calculation step;
When the photographing position (B) when the subject is first photographed is different from the current position, the relative positional relationship between the photographing position (B) and the current position or the route to the photographing position (B) is determined. A guidance process to present and guide
Imaging control method, which comprises a. In the computer of the imaging device,
A program for giving a function to guide selection of a shooting place when shooting a plurality of images while changing the place for an arbitrary subject,
First acquisition means for acquiring the position (A) of the subject;
Second acquisition means for acquiring a shooting position (B) when the subject is first shot;
A computing means for computing the second and subsequent shooting candidate positions based on the two positions (A, B);
Output means for outputting guidance information for teaching photographing at a photographing candidate position calculated by the calculating means;
When the photographing position (B) when the subject is first photographed is different from the current position, the relative positional relationship between the photographing position (B) and the current position or the route to the photographing position (B) is determined. First guiding means for presenting and guiding;
The program characterized by including .

Images