JP2022137105A - Imaging apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress reflection of a leg supporting a panoramic camera as much as possible or prevent reflection of the leg with image processing.

SOLUTION: An imaging apparatus has a self-standing leg that has an attachment part to which a panoramic camera is attached. The leg is translucent. The imaging apparatus specifies and extracts a position of the leg portion on the basis of pixel gradation data of the leg portion from a photographed image, and performs correction processing on the leg portion such that the 360-degree whole periphery is imaged.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2022,JPO&INPIT

Description

The present invention relates to a panoramic photographing apparatus and image processing using a self-supporting transparent monopod capable of photographing an object to be photographed all around 360 degrees surrounding a panoramic camera in one photographing.

Conventionally, a panorama camera is attached to a tripod to photograph an object around 360 degrees. For example, the photographing device described in Patent Document 1 has a panoramic camera attached to a tripod.

JP-A-6-235981

However, in the invention described in Patent Document 1, since the tripod part is reflected in the image, it is not possible to photograph the entire 360-degree surroundings without being obstructed by the tripod.
SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and is a panoramic photographing apparatus using a self-supporting transparent monopod that can photograph an object to be photographed all around 360 degrees surrounding the panorama camera in one shot. and image processing.

The photographing device is a self-supporting monopod having a mounting portion for mounting the panoramic camera, and the monopod is translucent.

Also, the photographing device includes a panoramic camera, a self-supporting translucent monopod attached to the panoramic camera, and an information terminal connected to the panoramic camera via a wireless LAN for operating the panoramic camera. characterized by

In addition, the photographing device is characterized in that the monopod portion is extracted from the photographed image and the monopod portion is subjected to correction processing so that the entire circumference of 360 degrees is captured.

According to the present invention, it is possible to minimize the appearance of the leg that supports the panoramic camera, and to prevent the appearance of the leg by image processing.

1 is a diagram showing the entire panoramic imaging device 1; FIG. It is the figure which showed the structure of the processing apparatus. It is the figure which showed the flow of 1st Embodiment of a correction process. FIG. 4 is a diagram for explaining correction processing 1; FIG. 10 is a diagram for explaining correction processing 2; FIG. 11 is a diagram for explaining correction processing 3; FIG. 11 is a diagram for explaining correction processing 4; FIG. 10 is a diagram illustrating acquired pixels in the first embodiment of correction processing; It is a figure explaining the correction order of 1st Embodiment of a correction process. FIG. 11 is a diagram showing a flow of correction processing according to the second embodiment; FIG. 11 is a diagram for explaining acquired pixels in the second embodiment of correction processing;

A panoramic photographing apparatus according to the present invention will be described below with reference to FIG.

The panorama photographing apparatus 1 has a panorama camera 3 detachably attached to the tip of a translucent rod-shaped or extendable rod-shaped self-supporting monopod support member 2 .

The panorama photographing apparatus 1 can be assembled by screwing the tip of the male screw portion of the support member 2 into a leg hole formed in the bottom of the panorama camera 3 .

Both sides of the main body of the panorama camera 3 are formed in a substantially flat plate shape, fisheye lenses 4 for photographing are attached to both surfaces thereof, and a hemispherical object to be photographed can be photographed with a photographing angle of view of a little over 180 degrees. Therefore, by simultaneously photographing with the fisheye lenses 4 on both sides, it is possible to photograph the object to be photographed in a 360-degree all-round surroundings of the panorama camera 3 in one photographing.

In order to remotely photograph the panorama camera 3 of the panorama photographing apparatus 1, the panorama camera 3 is connected to, for example, a smartphone 5 (or various wireless portable terminals such as a tablet terminal) via a wireless LAN such as Wi-Fi. (or personal computer) is connected to a wireless information terminal.

Next, how to use the panorama photographing apparatus 1 will be described.
First, observe with the smartphone 5, a personal computer, or the like to confirm whether the panorama camera 3 operates normally and captures the image properly.

Then, a photographing button for operating the shutter of the panoramic camera 3 on the screen of the smartphone 5 is pressed, and correspondingly, the shutter of the panoramic camera 3 is remotely operated to perform photographing.

The photographed image captures the entire 360-degree circumference, and since the support member 2 is a rod-shaped semi-transparent self-supporting monopod, the support member 2 is hardly captured and the 360-degree circumference can be photographed almost perfectly. can.

Next, processing of an image captured by the panoramic image capturing apparatus according to the second embodiment of the present invention will be described.

In the image captured in the first embodiment described above, although the supporting member 2 was slightly reflected, the entire 360-degree surroundings could not be captured perfectly. Therefore, image processing is performed to obtain an image in which the entire 360-degree surroundings are completely photographed. Details are provided below.

The panoramic camera 3 incorporates a control section 6 and a storage section 7 , and the control section 6 controls the storage section 7 . The configuration is shown in FIG.

The storage unit 7 stores pixel gradation data of the support member 2 (here, a color code representing RGB, which is a color expression method, in six hexadecimal digits). ), image data captured by the panorama camera 3, and corrected image data corrected by image processing are stored.

Note that the image data is composed of position coordinates of each pixel and pixel tone data. Here, positional coordinates of pixels will be described. Pixels arranged horizontally are called rows, and pixels arranged vertically are called columns. Rows are numbered in order from top to bottom, and columns are numbered in order from left to right. is shaken to The row number of a pixel is represented by a variable i, the column number by a variable j, and the position information of an arbitrary pixel is represented by row i, column j.

Next, a first embodiment of correction processing for the support member 2 executed by the panoramic camera 3 will be described with reference to flowcharts of FIGS. 3 to 7. FIG.

First, the control unit 6 reads out a program for executing correction processing from the storage unit 7 to start processing, reads out the pixel gradation data of the support member 2 stored in advance in the storage unit 7, and obtains the photographed image. A portion identical to the pixel gradation data is searched for, and the portion where the support member 2 is shown is specified (step S101).

After completing the processing of step S101, the control unit 6 collects the image data of the portion of the support member 2 and one pixel on the top, bottom, left, and right around the support member 2, and stores the image data in the storage unit 7 (step S102). Here, a specific example of pixel arrangement is shown in FIG. 8, and FIG. 8 depicts a case where the pixels in the portion of the support member 2 are rectangular with 7 rows×6 columns.

After completing the process of step S102, the control unit 6 obtains the minimum numerical value for each row and column of the position information (row i, column j) of the pixels that are part of the support member 2 stored in the storage unit 7 ( step S103). As a result, as shown in FIG. 9, the top left position of the support member 2 where the process is started is specified.

After completing the process of step S103, the control unit 6 puts the minimum numerical value of the row into the variable i and the minimum numerical value of the column into the variable j with respect to the pixel position information (row i, column j) (step S104).

After completing the process of step S104, the control unit 6 performs the correction process 1 (step S105).

Now, the correction process 1 will be described with reference to the flowchart shown in FIG.

Correction processing 1 describes a procedure for correcting a specific row of the support member 2 in the horizontal direction (from left to right).

First, the control unit 6 calculates the value of the pixel data at the i-th row and the j-th column. Pixel data of (i-1) row (j+1) column is read out from the storage unit 7 (step S201).

When the control unit 6 completes the processing of step S201, the position of the pixel read from the storage unit 7 is (i-1) row (j-1) column, (i-1) row j column, (i-1) An addition average is obtained for pixel data of three pixels in row (j+1) and column (step S202).

Here, calculation for averaging three pieces of pixel data will be described. The pixel data is a 6-digit hexadecimal number, with the 1st and 2nd digits representing R (red), the 3rd and 4th digits representing G (green), and the 5th and 6th digits representing B (blue). there is Divide the three pixel data into RGB, add and average them, round off the first decimal place to 8 (equivalent to rounding off in decimal numbers) for each, and convert to 2 hexadecimal digits, then the 1st and 2nd digits The R value found in 1, the G value found in the 3rd and 4th digits, and the B value found in the 5th and 6th digits are arranged in hexadecimal 6 digits to find the pixel value.

Specifically, for the first and second digits of each of the three pixel data, the arithmetic mean and the first decimal place are rounded down to 8 to obtain R, and the third digit of each of the three pixel data is calculated. and the fourth digit are averaged and the first decimal place is rounded down to 8 to find G, and the averaged and the first decimal place are rounded down to 8 for the fifth and sixth digits of each of the three pixel data. 6-digit hexadecimal number consisting of the 1st and 2nd digits of R, the 3rd and 4th digits of G, and the 5th and 6th digits of B The pixel data becomes the desired pixel value.

To give a more specific calculation example, if the three pixel data are 123456, 789ABC, and DEFEDC, the first and second digits of the three pixel data for R (red) are averaged and the first decimal place is calculated. is rounded down by 7 to 8, then (12 + 78 + DE)/3 = 168/3 = 78, so the value to be found is 78. Next, for G (green), averaging the 3rd and 4th digits of the three pixel data and rounding off the first decimal place to 8, we get: (34+9A+FE)/3=1CC/3=99.5 . . , so the desired value is 99. Next, for B (blue), averaging the 5th and 6th digits of the three pixel data and rounding off the first decimal place to 8, we get: (56+BC+DC)/3=1EE/3=A4 .A... so the desired value is A5. From the above, the pixel value (hexadecimal number) of the pixel data to be obtained is 7899A5.

After completing the process of step S202, the control unit 6 stores the calculated average value in the storage unit 7 as the value of the pixel data at the i-th row and the j-th column (step S203).
After completing the process of step S203, the control unit 6 adds 1 to the variable j (step S204).

After completing the processing of step S204, the control unit 6 determines whether or not the pixel data of the pixel position i row (j+1) column is the support member 2 (step S205), and if the pixel position is i row ( If the pixel data of the j+1) column is the support member 2, the process from step S201 is repeated to calculate the value of the pixel data of the i row (j+1) column (step S205: YES). is not the support member 2, the correction process 1 is terminated (step S205: NO).

Next, returning to the flow of FIG. 3, the control unit 6 starts the correction process 2 (step S106).

Now, the correction process 2 will be described with reference to the flowchart shown in FIG.
Correction processing 2 describes a procedure for correcting a specific row of the support member 2 in the vertical direction (from top to bottom).

First, the control unit 6 increases the value of the variable i by 1, and the position of the pixel is (i-1) row (j+1) column, i row (j+1) column, (i+1) row (j+1) ) column is read from the storage unit 7 (step S301).

When the control unit 6 completes the processing of step S301, the position of the pixel read from the storage unit 7 is (i-1) row (j+1) column, i row (j+1) column, (i+1) row. The pixel data of the three pixels in the (j+1) column are averaged (step S302).

After completing the process of step S302, the control unit 6 stores the calculated average value in the storage unit 7 as the value of the pixel data at the pixel position of i row and j column (step S303).
After completing the process of step S303, the control unit 6 adds 1 to the variable i (step S304).

After completing the processing of step S304, the control unit 6 determines whether or not the pixel data at the pixel position (i+1) row j column is the support member 2 (step S305), and if the pixel position is (i+ 1) If the pixel data at row j column is support member 2, the process from step S301 is repeated (step S305: YES). If not, the correction process 2 is terminated (step S305: NO).

Next, returning to the flow of FIG. 3, the control unit 6 starts the correction process 3 (step S107).

Now, the correction process 3 will be described with reference to the flowchart shown in FIG.
A correction process 3 describes a procedure for correcting a specific row of the support member 2 in the horizontal direction (from right to left).

First, the control unit 6 decrements the value of j by 1, and the position of the pixel is (i+1) row (j-1) column, (i+1) row j column, (i+1) row (j+1). Pixel data for a column is read out from the storage unit 7 (step S401).

When the control unit 6 completes the processing of step S401, the position of the pixel read from the storage unit 7 is (i+1) row (j-1) column, (i+1) row j column, (i+1) row. The pixel data of the three pixels in the (j+1) column are averaged (step S402).
After completing the process of step S402, the control unit 6 stores the calculated average value in the storage unit 7 as the value of the pixel data at the i-th row and the j-th column of the pixel (step S403).
After completing the process of step S403, the control unit 6 subtracts 1 from the variable j (step S404).

After completing the processing of step S404, the control unit 6 determines whether or not the pixel data in the i row (j-1) column is the support member 2 (step S405). If the pixel data of column j-1) is support member 2, the process from step S401 is repeated (step S405: YES). If not, the correction process 3 is terminated (step S405: NO).

Next, returning to the flow of FIG. 3, the control unit 6 starts the correction process 4 (step S108).

Now, the correction process 4 will be described with reference to the flowchart shown in FIG.
A correction process 4 describes a procedure for correcting a specific row of the support member 2 in the vertical direction (from bottom to top).

First, the control unit 6 decrements the value of i by 1, and the position of the pixel is (i-1) row (j-1) column, i row (j-1).
The pixel data of column, (i+1) row and (j-1) column are read out from the storage unit 7 (step S50
1).

When the control unit 6 completes the processing of step S501, the position of the pixel read from the storage unit 7 is (i-1) row (j-1) column, i row (j-1) column, (i+1) row. The pixel data of the three pixels in the (j-1) column are averaged (step S502).

After completing the process of step S502, the control unit 6 stores the calculated average value in the storage unit 7 as the value of the pixel data at the i row and j column of the pixel position (step S503).
After completing the process of step S503, the control unit 6 subtracts 1 from the variable j (step S504).

After completing the process of step S504, the control unit 6 determines whether or not the pixel data at the pixel position (i-1) row j column is the support member 2 (step S505), and if the pixel position is (i- 1) If the pixel data at row j column is support member 2, the process from step S501 is repeated (step S505: YES). If not, the correction process 4 is terminated (step S505: NO).

Next, returning to the flow of FIG. 3, the control unit 6 determines whether or not the pixel data of the pixel position i row (j+1) column is the support member 2 (step S109), and if the pixel position is i If the pixel data of the row (j+1) column is the support member 2 (step S109: YES), 1 is added to the variable j (step S110), and the processing from step S105 is repeated to perform the i row (j+1) Calculate the value of the pixel data in the column. If the pixel data at the i-th row (j+1) column is not at the support member 2, the correction process is terminated because the correction of all the pixel data of the support member 2 has been completed (step S109: NO).

According to the above flow, it is possible to obtain all the pixel data for the portion of the support member 2 by proceeding spirally clockwise from the upper left. FIG. 9 is a diagram explaining this order of progress.

Next, with reference to the flowchart of FIG. 10, different correction processing methods for the support member 2 executed by the panoramic camera 3 will be described.

First, the control unit 6 reads out a program for executing this processing from the storage unit 7 to start the processing, reads out the pixel gradation data of the support member 2 stored in the storage unit 7 in advance, and obtains the photographed image. Among them, the same portion as the pixel tone data is searched, and the portion where the support member 2 is shown is specified (step S601).

After completing the process of step S601, the control unit 6 collects the image data of the portion of the support member 2 and five pixels on the top, bottom, left, and right around the support member 2, and stores the image data in the storage unit 7 (step S602). Here, FIG. 11 shows a specific example of arrangement of pixels. One square represents one pixel.

After completing the process of step S602, the control unit 6 calculates the position of the center of gravity based on the position coordinates and pixel tone data of each pixel collected and stored in the storage unit 7 (step S603).

The position of the center of gravity (I row, J column) is obtained by, for example, the following arithmetic expression.

I = Σ {(i of each pixel) x (tone value of each pixel)}/(sum of tone values of each pixel)
J = Σ {(j of each pixel) x (tone value of each pixel)}/(sum of tone values of each pixel)

Here, an example of calculating the position of the center of gravity will be shown. The gradation data (6-digit hexadecimal number) of the pixel in the first row and first column is 000001, the gradation data of the pixel in the first row and second column is 000001, and the gradation data of the pixel in the second row and first column is 000002. , 2nd row, 2nd column, the gradation data is 000002. Considering the center of gravity of four pixels,
I = 00000A/000006 = 1.A (5/3 in decimal),
J = 000009/000006 = 1.8 (1.5 when expressed in decimal)
becomes.

After completing the process of step S603, the control unit 6 obtains the ideal pixel gradation by dithering for each pixel of the support member 2 so as to obtain the ideal pixel gradation by dithering at the position of the center of gravity. Image processing is performed so that the portion of member 2 blends into the surroundings and is difficult to distinguish (step S604).

After completing the process of step S603, the control unit 6 ends the correction process.

In each of the above-described embodiments, the panoramic camera 3 and the smartphone 5 are provided as the panoramic photographing device 1, but the smartphone 5 may not necessarily be provided in the present invention, and the panoramic camera 3 is replaced by remote shooting via wiring. Alternatively, the memory of the panoramic image captured by the panoramic camera 3 may be taken out from the panoramic camera 3 and reproduced by a personal computer, a printer, or the like.

Also, instead of the panorama camera 3 having fisheye lenses 4 on both sides of the main body, a panorama camera or the like having various lenses such as a fisheye lens on only one side may be used. Further, it may be a panorama camera or the like provided with various lenses such as a fish-eye lens on multiple sides.

1 panoramic photography device 2 self-supporting monopod support member 3 panoramic camera 4 fisheye lens 5 smartphone

Claims (2)

A self-supporting monopod having a mounting portion for mounting a panoramic camera, the monopod being translucent, and the position of the monopod portion being specified from the photographed image based on the pixel gradation data of the monopod portion. 1. A photographing device characterized by extracting a 360-degree image by extracting a portion of the monopod and subjecting the monopod portion to correction processing. A self-supporting monopod having a mounting portion for mounting a panoramic camera, the monopod being translucent A computer that controls an imaging device,
To specify and extract the position of the unipod portion from a photographed image based on the pixel gradation data of the unipod portion, perform correction processing on the unipod portion, and realize an image showing the entire circumference of 360 degrees. A program characterized by

Images