JP6234506B2 - Computer apparatus, control method thereof, and program - Google Patents

Description

  The present invention relates to a computer apparatus, a control method thereof, and a program.

  2. Description of the Related Art Conventionally, an omnidirectional optical system using a mirror or a lens is known in order to photograph a 360-degree all-round subject with an imaging device (see Patent Document 1). In addition to a dedicated omnidirectional camera equipped with an omnidirectional optical system, there are some that are attached to existing cameras as an adapter.

  A mirror-type omnidirectional optical system using a spherical mirror or a hyperboloidal mirror is generally characterized by a wide photographing range (elevation angle range). Here, FIG. 10A shows an image of an image taken by a mirror type omnidirectional optical system. In the mirror type omnidirectional optical system, the imaging device itself is reflected in the center, so that the obtained image is a ring image. The example shown in FIG. 10A is an image taken with the imaging device facing directly upward in the room. In FIG. 10A, the ceiling 1001 positioned directly above the room is displayed on the outer peripheral side of the annular image, and the floor 1002 positioned directly below is displayed on the center side. By panoramicly developing this image data, an all-around panoramic image as shown in FIG. 10B is obtained and can be used by the user.

  Also, in recent imaging devices, the subject image is always displayed on the display unit (live view display) during the shooting mode, and horizontal and vertical grid-like auxiliary lines are superimposed on the subject image and displayed horizontally. And those that support composition determination (see Patent Document 2).

JP 2006-50185 A JP 2007-279767 A

When an omnidirectional optical system is mounted with a mirror type omnidirectional optical system attached to the imaging apparatus, as described above, what is displayed on the display unit is a ring image. Therefore, as shown in FIG. 10C, even if the conventional horizontal and vertical grid-like auxiliary lines 1003 are displayed superimposed on the annular image, they are not useful for leveling, and the horizontal view is displayed in the live view display. It is difficult to take out. On the other hand, when a special device such as a spirit level is attached to the imaging device, the cost increases.
The present invention has been made in view of the above-described problems, and an object of the present invention is to enable easy leveling.

The present invention is a radial direction around the live view display means for displaying on the display unit a live view of the Utsushitai image, the optical center of the omnidirectional optical system acquired by the imaging unit via the omnidirectional optical system radial first auxiliary line and the auxiliary line display means for displaying on the display unit superimposes at least either the live view of the optical center second auxiliary line centered circumferential arcuate of And.

  According to the present invention, leveling can be performed easily.

It is a figure which shows the structure of the imaging device of this embodiment. It is a figure which shows the structure of the omnidirectional mirror of this embodiment. It is a figure which shows the auxiliary line in the omnidirectional imaging | photography mode of this embodiment. It is a flowchart which shows the operation | movement at the time of the live view display of 1st Embodiment. It is a figure which shows the display which superimposed the auxiliary line of 1st Embodiment. It is a figure which shows the display which superimposed the auxiliary line of 1st Embodiment. It is a figure which shows the relationship between the elevation angle of this embodiment, and a cyclic | annular image. It is a flowchart which shows the operation | movement at the time of the live view display of 2nd Embodiment. It is a figure which shows the display which superimposed the auxiliary line of 2nd Embodiment. It is a figure which shows the image image | photographed with the omnidirectional optical system.

Embodiments according to the present invention will be described below with reference to the drawings.
(First embodiment)
FIG. 1 is a diagram illustrating a configuration of an imaging apparatus 100 to which the present embodiment is applied.
The imaging apparatus 100 can record captured still image data on the memory card 106. Further, the imaging apparatus 100 can shoot an annular image of the entire 360 ° circumference by mounting an omnidirectional mirror 200 described later.

The imaging apparatus 100 includes an imaging unit 101, a video signal processing unit 102, a data buffer 103, a JPEGCODEC 104, a memory card I / F 105, a memory card 106, an operation unit 107, a display unit 108, a file management unit 109, and a CPU 110.
The imaging unit 101 is an example of an imaging unit, and captures a subject image and converts it into an electrical signal. The video signal processing unit 102 generates image data by performing A / D conversion or appropriate image processing on the electrical signal converted by the imaging unit 101. The data buffer 103 stores image data generated by the video signal processing unit 102 during recording. The JPEGCODEC 104 performs compression coding on the image data stored in the data buffer 103 and outputs it as JPEG image data during recording. The memory card I / F 105 reads / writes data from / into the installed memory card 106. The memory card 106 records image data captured by the imaging device 100. The operation unit 107 is for receiving an operation from the user and operating the imaging apparatus 100. The operation unit 107 includes a shutter button (not shown). The display unit 108 has a liquid crystal screen, displays a live view image captured by the imaging unit 101 at the time of shooting, shooting information, and the like, and displays a playback image at the time of playback. The file management unit 109 controls file level writing during recording. A CPU (central processing unit) 110 controls the operation of each unit by software (program).

FIG. 2 is a diagram showing the configuration of the omnidirectional mirror 200. As shown in FIG. 2A, the omnidirectional mirror 200 includes a mirror 201, a mirror support 202, and a detachable adapter 203. The mirror 201 is an optical unit, and reflects a subject image from all directions of 360 degrees so as to enter the imaging unit 101 of the imaging apparatus 100. The mirror support part 202 is formed in a transparent cylindrical shape and supports the mirror 201. The detachable adapter 203 is an adapter unit for mounting the omnidirectional mirror 200 on the imaging apparatus 100.
As shown in FIG. 2B, omnidirectional imaging capable of capturing a subject image of 360 degrees all around can be performed by attaching the omnidirectional mirror 200 to the imaging apparatus 100.

(Auxiliary line type according to the shooting mode)
The image capturing apparatus 100 has a function of always capturing images repeatedly by the image capturing unit 101 and displaying the acquired image on the display unit 108 (hereinafter referred to as a live view) even when the user does not perform capturing according to the shutter button. With the live view function, the user can determine the composition while viewing the displayed image, and can record a desired subject image on the memory card 106 by pressing the shutter button of the operation unit 107.

The imaging apparatus 100 can set the following two shooting modes as shooting modes of the live view function displayed on the display unit 108 during shooting. When the user switches and selects two shooting modes via the operation unit 107, it is possible to use them according to the purpose of shooting.
1. Normal shooting mode Omnidirectional shooting mode

  The normal shooting mode is used during normal shooting, and the omnidirectional shooting mode is used when the omnidirectional mirror 200 is mounted. The display of the auxiliary line superimposed on the live view display is different between the normal shooting mode and the omnidirectional shooting mode.

  A grid-like auxiliary line (grid) along the vertical and horizontal directions of the shooting angle of view is displayed in the subject image on the display unit 108 when shooting a normal subject in the normal shooting mode without attaching the omnidirectional mirror 200. It is displayed superimposed. While viewing the auxiliary line, the user can perform leveling by adjusting the composition so that, for example, the horizontal auxiliary line and the horizontal line on the subject are parallel to each other. Similarly, the user can easily level the vertical auxiliary line by adjusting the composition so that it is parallel to the vertical edge existing on the subject, such as the outline of the wall of the building. be able to.

On the other hand, auxiliary lines 301 and 302 shown in FIG. 3A are superimposed on the subject image and displayed on the display unit 108 when the omnidirectional mirror 200 is attached and omnidirectional imaging is performed in the omnidirectional imaging mode. The As shown in FIG. 3A, the auxiliary line 301 is a straight line extending radially in the radial direction around the optical center O1 (hereinafter referred to as the radial auxiliary line 301). Here, the optical center O1 coincides with the position of the optical center O2 of the omnidirectional mirror 200 shown in FIG. 2 when the omnidirectional mirror 200 is accurately attached to the imaging apparatus 100.
The auxiliary line 302 is a concentric circle in the circumferential direction centered on the optical center O1 (hereinafter referred to as a circumferential auxiliary line 302). Here, the radial auxiliary lines 301 are displayed at equal angles around the optical center O1, and the circumferential auxiliary lines 302 are displayed at equal intervals in the radial direction. The radial auxiliary line 301 and the circumferential auxiliary line 302 are displayed in a polar coordinate grid.

  Next, processing for displaying an auxiliary line by the imaging apparatus 100 will be described with reference to a flowchart shown in FIG. The flowchart shown in FIG. 4 is repeatedly executed during live view display. Further, the flowchart shown in FIG. 4 is realized by the CPU 110 of the imaging apparatus 100 executing a program recorded in a storage unit such as a ROM (not shown).

In step S401, the CPU 110 acquires the set shooting mode.
In step S402, the CPU 110 determines whether or not the set shooting mode is the omnidirectional shooting mode. If it is not the omnidirectional shooting mode, that is, if it is the normal shooting mode, the process proceeds to step S403. On the other hand, in the omnidirectional shooting mode, the process proceeds to step S404.
In step S <b> 403, the CPU 110 displays a grid-like auxiliary line on the display unit 108.
In step S404, as shown in FIG. 3A, the CPU 110 displays the radial auxiliary line 301 and the circumferential auxiliary line 301 centered on the optical center O1 on the display unit. This processing corresponds to an example of processing by the display control unit.

Next, a leveling method using auxiliary lines will be described with reference to an example of the subject shown in FIGS.
FIG. 5A is a live view display in which the inside of a room is taken as a subject. In FIG. 5A, there are a plurality of vertical edges 501 such as corners and shelves of a room.
FIG. 5B is a display when the auxiliary line 301 in the radial direction and the auxiliary line 302 in the circumferential direction are superimposed on the display unit 108. When the optical axis for omnidirectional imaging is upward in the vertical direction, the edge 501 should be on a radial straight line at the center of the optical center O1 on the subject in the live view display. Therefore, the user can easily level the image by adjusting the composition so that all the edges 501 are radial straight lines while looking at the auxiliary line 301 in the radial direction.

FIG. 6A is a live view display obtained by photographing the sea or the like as a subject. In FIG. 6A, a horizontal edge 601 exists as a horizontal line.
FIG. 6B shows a display when the auxiliary line 301 in the radial direction and the auxiliary line 302 in the circumferential direction are superimposed on the display unit 108. When the optical axis for omnidirectional imaging is upward in the vertical direction, a sufficiently distant horizontal edge 601 should be on the circumference of the center of the optical center O1 on the subject in the live view display. Therefore, the user can easily level the image by adjusting the composition so that the edge 601 has an accurate circular shape while looking at the auxiliary line 302 in the circumferential direction.

  In the above description, the CPU 110 has described the case where the radial auxiliary line 301 and the circumferential auxiliary line 302 are displayed simultaneously, but the present invention is not limited to this case. For example, as shown in FIGS. 5C and 6C, the CPU 110 may display either one of the radial auxiliary line 301 or the circumferential auxiliary line 302. In this case, the imaging apparatus 100 is configured so that the user can select the display of the radial auxiliary line 301 or the circumferential auxiliary line 302, and the CPU 110 can select the radial auxiliary line 301 or the circle according to the selection by the user. One of the circumferential auxiliary lines 302 is displayed.

In the above description, the CPU 110 has described the case where the radial auxiliary lines 301 are displayed at equal angles and the circumferential auxiliary lines 302 are displayed at equal intervals in the radial direction. However, the present invention is not limited to this case. It does not necessarily have to be equiangular or equidistant.
Here, as an example, a case where the circumferential auxiliary line 302 is displayed so as to overlap in a specific elevation angle direction will be described.
FIG. 7 is a diagram for explaining the relationship between the elevation angle and the annular image. The mirror 201 of the omnidirectional mirror 200 has a rotationally symmetric shape about the optical center O2. Therefore, the specific elevation angle direction in the subject image is a concentric circle of the optical center O1 on the annular image. Therefore, as shown in FIG. 3B, the CPU 110 annularly arranges the auxiliary lines 301a to 301d in the circumferential direction corresponding to, for example, the elevation angles 30 °, 0 °, −30 °, and −60 ° in FIG. Display it superimposed on the image. Further, the CPU 110 displays the elevation angle value 304 for each of the auxiliary lines 301a to 301d in the circumferential direction. Therefore, the imaging apparatus 100 can support leveling while facilitating the grasp of the subject image displayed as a ring image by the user.

(Second Embodiment)
Next, a second embodiment will be described. Hereinafter, differences from the first embodiment will be described. In the present embodiment, the CPU 110 detects an edge that satisfies a predetermined condition from the photographed subject image. Specifically, the CPU 110 detects the following two types of edges from live view image data stored in the data buffer 103 during omnidirectional shooting.
(A) Straight edge (b) Arc edge When CPU 110 detects a straight edge, CPU 110 can calculate the position and orientation of the straight line. Further, the CPU 110 can calculate the center position and radius of the arc when detecting the arc-shaped edge. Here, the arc-shaped edge includes a circular edge.

The CPU 110 performs evaluation according to the type of edge from the detected two types of edge information. Specifically, it is as follows.
(A) In the case of a linear edge The CPU 110 determines how close this straight line is to a “radial straight line passing through the optical center O1” from the position and orientation of the detected linear edge. Edges are actually line segments, not straight lines. Therefore, the CPU 110 calculates the distance between the straight line obtained by extending the line segment and the optical center O1, and when the distance is equal to or smaller than the threshold value, the CPU 110 determines that the line is “close to a radial straight line passing through the optical center O1”. Output the result.

(B) In the case of an arcuate edge The CPU 110 determines how close the arc or circle is to the “circle centered on the optical center O1” from the center position of the detected arcuate edge. Specifically, the CPU 110 calculates the distance between the center position of the arcuate edge and the optical center O1, and when the distance is equal to or smaller than the threshold value, the CPU 110 determines “close to a circle centered on the optical center O1”. Outputs the “Pass” result.

  CPU110 superimposes and displays an auxiliary line so that it may overlap with the edge which output the determination pass among the detected edges. That is, in the case of a straight edge, the CPU 110 superimposes and displays a radial auxiliary line 301 that passes through the optical center O1 and on the straight edge. Further, in the case of an arc-shaped edge, the CPU 110 superimposes and displays a circumferential auxiliary line 302 passing through the arc-shaped edge with the optical center O1 as the center.

  Next, the above-described processing by the imaging apparatus 100 will be described with reference to the flowchart shown in FIG. The flowchart shown in FIG. 8 is repeatedly executed during live view display. The flowchart shown in FIG. 8 is realized by the CPU 110 of the imaging apparatus 100 executing a program recorded in a storage unit such as a ROM (not shown).

In step S801, the CPU 110 acquires the set shooting mode.
In step S802, the CPU 110 determines whether or not the set shooting mode is the omnidirectional shooting mode. If it is not the omnidirectional shooting mode, that is, if it is the normal shooting mode, the process proceeds to step S803. On the other hand, in the case of the omnidirectional shooting mode, the process proceeds to step S804.

In step S <b> 803, the CPU 110 displays a grid-like auxiliary line on the display unit 108.
In step S804, the CPU 110 detects an arcuate edge. Here, the CPU 110 detects an edge including an edge close to an arc or a circle. This processing corresponds to an example of processing by the edge detection unit.
In step S805, the CPU 110 evaluates each detected arc-shaped edge. Specifically, as described above, the CPU 110 calculates the distance between the center position of the arcuate edge and the optical center O1, and when this distance is less than or equal to the threshold value, outputs a determination pass. This processing corresponds to an example of processing by the evaluation unit.
In step S806, the CPU 110 superimposes and displays the auxiliary line 302 in the circumferential direction passing through the arc-shaped edge with the optical center O1 as the center, with respect to the arc-shaped edge that has passed the judgment pass among the evaluated arc-shaped edges.

In step S807, the CPU 110 detects a straight edge. Here, the CPU 110 performs detection including an edge close to a straight line. This processing corresponds to an example of processing by the edge detection unit.
In step S808, the CPU 110 evaluates each detected linear edge. Specifically, as described above, the CPU 110 calculates a distance between a straight line obtained by extending a line segment of the linear edge and the optical center O1, and outputs a determination pass if the distance is equal to or less than a threshold value. This processing corresponds to an example of processing by the evaluation unit.
In step S809, the CPU 110 superimposes and displays a radial auxiliary line 301 that passes through the optical center O1 and passes over the linear edge, with respect to the linear edge that has output the determination pass among the evaluated linear edges.

Next, auxiliary lines displayed with reference to an example of the subject shown in FIG. 9 will be described.
FIG. 9A is a live view display in which the inside of a room is taken as a subject. FIG. 9A is an example in which a radial auxiliary line 301 passing through the optical center O1 is superimposed and displayed on each of the plurality of linear edges 501 to which the determination pass is output.
FIG. 9B is a live view display obtained by photographing the sea including the horizontal line as a subject. FIG. 9B is an example in which an auxiliary line 302 in the circumferential direction with the optical center O1 as the center is superimposed and displayed on the arc-shaped edge 601 to which the determination pass is output.
Here, a display example in which the radial auxiliary line 301 and the circumferential auxiliary line 302 are displayed separately is shown, but when both the straight edge and the arcuate edge are judged pass, The CPU 110 displays a radial auxiliary line 301 and a circumferential auxiliary line 302.

  As described above, the radial auxiliary line 301 and the circumferential auxiliary line 302 are displayed so as to be superimposed on at least one of the linear edge and the arcuate edge, so that the user can watch the auxiliary line. The composition can be adjusted accurately and leveling can be performed easily.

As mentioned above, although this invention was demonstrated with various embodiment, this invention is not limited only to these embodiment, A change etc. are possible within the scope of the present invention.
For example, in the above-described embodiment, the case where the user selects the shooting mode has been described. However, the present invention is not limited to this case, and the type of the lens or adapter of the omnidirectional optical system to which the CPU 110 is attached is detected, and the detection result is determined. The shooting mode may be switched. In the above-described embodiment, the case where the omnidirectional mirror 200 is used as the omnidirectional optical system has been described. However, the present invention is not limited to this case, and the present invention can be applied to the case where omnidirectional imaging is performed using other optical systems and methods. is there.

  The present invention can also be realized by executing the following processing. In other words, this is a process in which a program that realizes the functions of the above-described embodiments is supplied to an imaging apparatus via a network or a storage medium, and a computer (such as a CPU) of the imaging apparatus reads and executes the program.

  DESCRIPTION OF SYMBOLS 100: Imaging device 101: Imaging part 102: Video signal processing part 103: Data buffer 104: JPEG CODEC 105: Memory card I / F 106: Memory card 107: Operation part 108: Display part 109: File management part 110: CPU 200 : Omnidirectional mirror (omnidirectional optical system)

Claims (6)

And live view display means for displaying on the display unit a live view of the Utsushitai image acquired by the imaging unit via the omnidirectional optical system,
The live view at least one of the omnidirectional optical system a second auxiliary line in the circumferential direction arcuate around the radial first auxiliary line and the optical center of the radial direction around the optical center of the And an auxiliary line display means for displaying on the display unit in a superimposed manner.   The computer apparatus according to claim 1, wherein the auxiliary line display unit displays at least one of the first auxiliary line and the second auxiliary line in response to a user's selection operation. Detection means for detecting the attached adapter;
2. The computer apparatus according to claim 1, wherein the auxiliary line display unit displays at least one of the first auxiliary line and the second auxiliary line according to a detection result by the detection unit. . The live view display unit displays a live view of a subject image having a narrower angle of view than the omnidirectional acquired by the imaging unit instead of the live view of the subject image acquired by the imaging unit via the omnidirectional optical system. Display on the display,
The auxiliary line display means is configured to display a third auxiliary line in a lattice shape having a vertical or horizontal angle of view instead of the first and second auxiliary lines, and a live view of a subject image having an angle of view narrower than the omnidirectional direction. 4. The computer apparatus according to claim 1, wherein the computer device is displayed on the display unit in a superimposed manner.   The program which controls a computer apparatus so that each means of any one of Claims 1 thru | or 4 may be implement | achieved. A step of displaying on the display unit a live view of the Utsushitai image acquired by the imaging unit via the omnidirectional optical system,
The live view at least one of the omnidirectional optical system a second auxiliary line in the circumferential direction arcuate around the radial first auxiliary line and the optical center of the radial direction around the optical center of the And a step of causing the display unit to display the image on the display unit.

Images