KR20120097213A - Apparatus for photographing with fish eye lens and method thereof - Google Patents

Abstract

PURPOSE: A photographing device using a fisheye lens and a photographing method thereof are provided to transfer an image sensor obtaining input images being input through a fisheye lens, thereby obtaining larger input images through the image sensor of a set size. CONSTITUTION: A photographing device using a fisheye lens comprises a fisheye lens(11), an image sensor(12), and a driving unit. The fisheye lens converts images being input into input images which is an actual original form. The image sensor has a valid area where the input images is photographed a rectangular shape. The driving unit reciprocates the image sensor to a short side direction where a short side of a rectangular shape. The driving unit receives a first image by transferring the image sensor toward a first direction of the short side direction and receives a second image by transferring the image sensor to a second direction opposite to the first direction and synthesizes the first and second images, thereby generating a third image.

Description

Apparatus for photographing with fish eye lens and method

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging apparatus using a fisheye lens and an imaging method thereof, and more particularly, to an imaging apparatus using a fisheye lens capable of receiving an image of a monitoring target such as a vehicle or a building using a fisheye lens, and an imaging thereof. It is about a method.

A fish eye lens is an ultra wide angle lens with an angle of view greater than 180 degrees. A camera using a fisheye lens may receive an input image through the fisheye lens and obtain a circular image of all boundary lines through 360 degrees. In this case, the camera may be a camera module mounted on a digital still camera (DSC), a digital video camera (DVC), or a mobile phone.

On the other hand, the camera may be equipped with an image sensor for obtaining an image input through the fisheye lens. The image sensor mounted to the camera may typically be rectangular in shape. For example, the image sensor may be formed in a rectangular shape at a ratio of 4: 3 or 3: 2.

In this case, the diameter of the circular image may be determined according to the size of the short side of the rectangular image sensor in order to obtain a 360 degree circular image input through the fisheye lens. In this case, some regions of the expensive image sensor may be wasted in order to receive a circular image.

Alternatively, the diameter of the circular image may be set larger than the length of the short side direction of the effective area of the image sensor. In this case, some areas of the circular image input through the fisheye lens may not be input and may be omitted.

The present invention provides an image pickup apparatus using a fisheye lens capable of obtaining an input image of a larger size through an image sensor having a predetermined size, by allowing an image sensor to obtain an input image input through a fisheye lens to be moved. It is an object to provide an imaging method.

The present invention provides a fisheye lens for converting an input image into a substantially circular input image; An image sensor having a rectangular shape in which an effective area where the input image is captured is captured; And a driving unit configured to reciprocate the image sensor in a short side direction in which the short side of the rectangle extends, and receive the first image by moving the image sensor in the first direction in the short side direction. The present invention provides an imaging device that receives a second image by moving the image sensor in a second direction opposite to a direction, and generates a substantially circular third image by combining the first image and the second image.

The diameter of the input image may be larger than the short side length of the effective area and smaller than the long side length of the effective area.

It may further include a position sensor for detecting the position of the image sensor.

The driving unit may include a stepping motor for driving the image sensor.

The driving unit may drive the image sensor to move at a variable speed.

The movement of the image sensor may be synchronized with the read timing of the image sensor.

The imaging device is operated in units of sampling time intervals, each sampling time is divided into a first section and a second section, the position of the image sensor is moved in the first section, and the image is in the second section. The input image may be received through a sensor.

A first time of a sampling time of moving the image sensor to a first position and receiving the first image, and a second time of a sampling time of moving the image sensor to a second position and receiving the second image; can do. The third image may be generated by alternately repeating the first time and the second time.

The imaging device may be operated in units of sampling time at regular intervals. A first time of sampling time for receiving the first image at a first position, a second time of sampling time for moving the image sensor to a second position, and a sampling time for receiving the second image at the second position A third time and a fourth time of sampling time to move the image sensor to the first position. The third image may be generated while repeating the first to fourth times.

The imaging device may be operated in units of sampling time at regular intervals. A first time of sampling time for receiving the first image at a first position, a second time of sampling time for moving the image sensor to a second position, and a sampling time for receiving the second image at the second position A third time, a fourth time of a sampling time for receiving the second image at the second position, a fifth time of the sampling time for moving the image sensor to the first position, and the first position at the first position And a sixth time of a sampling time for receiving an image. The third image may be generated while repeating the first to sixth times.

The third image is generated by combining the first image of the first time and the second image of the third time, and the first image of the first time and the second image of the fourth time are synthesized. The third image may be generated, and the third image may be generated by synthesizing the second image of the fourth time and the first image of the sixth time.

At the time of image acquisition, a newly acquired image can be used first, and previously acquired image can be used for the part which cannot be acquired newly.

By the set selection, the image may be input only at a position including the cut region set by the image sensor.

The cutting region may be a fan-shaped region cut at a set angle.

The cutting area may be moved in a set angle unit.

The entire area of the input image may be divided at a predetermined angle, and the cutting areas may be sequentially output while rotating in the set direction.

The drive unit may comprise an electric drive means.

The image sensor may be moved such that a designated area of the input image is captured by the image sensor.

According to another aspect of the present invention, a circular input image input through a fisheye lens is captured in an effective area of a rectangular shape of an image sensor, and determining whether the current imaging mode acquires a circular image; The first image is input by moving the image sensor in a first direction of the rectangular short side direction, and the second image is input by moving the image sensor in a second direction opposite to the first direction. Synthesizing a first image and the second image to generate a substantially circular third image; And receiving a cut region set from the input image by the image sensor.

The image sensor may be moved such that a designated area of the input image is captured by the image sensor.

According to the imaging device using the fisheye lens and the imaging method thereof according to the present invention, by allowing the image sensor to acquire the input image input through the fisheye lens, the input image of a larger size through the image sensor of a predetermined size Can be obtained.

1 is a diagram showing a schematic configuration of an imaging device as a preferred embodiment according to the present invention.
FIG. 2 is a diagram schematically illustrating an internal control structure and an external connection structure in the imaging device of FIG. 1.
FIG. 3 is a diagram illustrating a method of obtaining a third image by synthesizing a first image acquired at a first position and a second image acquired at a second position in the imaging apparatus of FIG. 1.
4 is a timing diagram illustrating an exemplary embodiment in which a third image is obtained by synthesizing images continuously input by the imaging apparatus of FIG. 1.
FIG. 5 is a timing diagram illustrating another exemplary embodiment in which a third image is obtained by synthesizing images continuously input by the imaging apparatus of FIG. 1.
FIG. 6 is a timing diagram illustrating another exemplary embodiment in which a third image is obtained by synthesizing images continuously input by the imaging apparatus of FIG. 1.
FIG. 7 is a diagram illustrating an example in which an image is taken by cutting a portion of an entire region input through an image sensor in the imaging apparatus of FIG. 1.
8 is a flowchart schematically illustrating an image capturing method using a fisheye lens according to an exemplary embodiment of the present invention.
9 is a diagram showing a schematic configuration of an imaging device as another preferred embodiment according to the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 shows a schematic configuration of an imaging device 1 according to a preferred embodiment of the present invention.

Referring to the drawing, the imaging device 1 may include a fisheye lens 11, an image sensor 12, and drivers 14 and 15.

The fisheye lens 11 may convert the input image into a substantially circular input image. The image sensor 12 has a rectangular shape in which the effective area where the input image is picked up. The drivers 14 and 15 may reciprocate the image sensor 12 in a short side direction in which a short side of the rectangle extends. The drives 14, 15 may comprise electrical drive means.

In this case, the image sensor 12 may be moved in the first direction of the short side direction to receive the first image. In addition, the second image may be input by moving the image sensor 12 in a second direction opposite to the first direction. In addition, the first image and the second image may be synthesized to generate a substantially circular third image.

In this case, the diameter of the circular input image input through the fisheye lens 11 may be larger than the short side length of the effective area of the image sensor 12 and smaller than the long side length.

The imaging device 1 according to an embodiment of the present invention may be a camera using the fisheye lens 11, for example, a camera used for monitoring in a vehicle or a building.

The imaging device 1 can be used as a surveillance camera. The imaging device 1 can obtain all 360 degree circumferential images using the fisheye lens 11. Meanwhile, the effective area where the image sensor 12 captures an image may have a rectangular shape.

At this time, the photograph can be taken by matching the diameter of the image circle made by the fisheye lens 11 to the short side of the effective area of the image sensor 12. In this case, a pixel waste portion may occur in the long side direction of the effective area of the image sensor 12.

For example, the imaging device 1 may receive an image using the rectangular image sensor 12 having a 4: 3 aspect ratio of an effective area. In this case, the circular diameter of the input image may be adjusted to an effective area of the short side direction of the image sensor 12 in order to take a circular picture of all boundary lines by using the fisheye lens 11. In this case, a part wasted in the long side direction of the image sensor 12 may occur.

In addition, the circular diameter of the input image may be matched to the long side direction of the image sensor 12 so that a waste portion of the image sensor 12 does not occur. In this case, a portion where a photograph is not obtained in the short side direction of the image sensor 12 may occur, and 360-degree photographing may not be possible.

Therefore, in the imaging device 1, when the image sensor 12 is moved, the diameter of the image circle may be adjusted to the long side direction, and the short side direction may be configured to move the image sensor to search all the pictures in the order of time. In this case, as a result, an image equivalent to the case of using an image sensor with a larger number of pixels can be obtained, and a high quality image can be obtained.

For example, when the image pickup device 1 receives the images by combining the images while moving the image sensor 12 in the short side direction, and obtains the images, the image is obtained while the image sensor 12 is fixed. In comparison with this, an image of 1.78 times as many pixels can be obtained.

In the case of using the 3M pixel image sensor 12, an image corresponding to the case of using the image sensor of 5.5M pixels can be obtained by applying the imaging device 1 according to an embodiment of the present invention.

As a result, the imaging device using the fisheye lens 11 can obtain an image similar to the case of using the expensive image sensor 12 of 5.5M pixels while using the image sensor 12 of 3M pixels. In addition, it is possible to realize a camera that can be monitored in all directions even with small equipment.

In the imaging device 1, the diameter of the circular input image input through the fisheye lens 11 may be captured in accordance with the long side direction of the image sensor 12. To this end, images of all boundary lines can be obtained by inputting and synthesizing the images in chronological order while rapidly reciprocating the image sensor 12 in the short side direction. Thus, it is possible to obtain an image of the entire circumference without wasting the image sensor 12.

For example, when using a charge coupled device (CCD) as the image sensor 12, the image sensor 12 may sample an image at 30 frames per second. In this case, the image can be synthesized at maximum 15 cycles while moving the image sensor 12 using the electronic shutter in combination. In this case, an area of 15 frames per second may occur in the upper and lower areas of the screen.

In this case, it is important for the imaging device 1 using the fisheye lens 11 to view the entire view field at a time, and the detailed monitoring can be performed by segmented video surveillance. No problem. In addition, when using a method of partially cutting and observing, power consumption can be reduced by moving the image sensor as necessary.

The fisheye lens 11 may have a round image, and may receive a circular image of every boundary line 360 degrees. The image sensor 12 may be a charge coupled device (CCD), a complementary metal oxide semiconductor (CMOS), or the like. In FIG. 1, the cross section of the short side direction of the image sensor 12 is shown.

The image sensor 12 may be mounted on the image sensor board 13 and electrically connected to a peripheral circuit such as a driver formed thereon. At this time, the image sensor 12 may move by moving the image sensor board 13. For this purpose, the image sensor board 13 may be guided only by the guide member, which is not shown in the drawing, in the vertical direction on the drawing.

The driving units 14 and 15 may include the driving coil 14 and the permanent magnet 15 to move the image sensor board 13 by magnetic force. The drive coil 14 is installed to be fixed to the image sensor board 13, and the permanent magnet 15 may be fixed to a housing or other fixing part of the imaging device 1.

In this case, when a current flows in the driving coil 14, a moving force for moving the image sensor board 13 may be generated by the interaction of the driving coil 14 and the permanent magnet 15. In this case, the position sensor 16 for detecting the position of the image sensor 12 or the image sensor board 13 may be installed. The driving units 14 and 15 may be controlled to detect the position of the image sensor 12 using the position sensor 16 so that the image sensor 12 is accurately positioned at the set position.

2 schematically shows an internal control structure and an external connection structure in the imaging device of FIG. 1. Here, the same reference numerals are used for the same components as in the imaging device 1 of FIG. 1, and the detailed description thereof will be omitted.

Referring to the figure, the timing generator 17 controls the driving of the image sensor 12. The image processor 18 processes the signal of the image sensor 12. The central processing unit 19 is responsible for the entire sequence of the imaging device 1. The driver 20 is a driver circuit for driving the drive coil 14 to move the image sensor 12.

The output of the position sensor 16 may vary depending on the position of the image sensor board 13 using a photo interrupt or the like. The network interface 21 may supply an image input through the image sensor 12 on a network according to a predetermined protocol, and receive an image acquisition and other operation instructions through the network.

Meanwhile, the imaging device 1 may be connected to external devices through the network interface 21. In this case, the external devices may include a PC 22, a display 23, and a storage device 24.

In the PC 22, camera control software and the like are installed, and controls such as control of camera exposure, image capture cycle, and movement cycle of the image sensor 12, and view all boundary images in a given image or partially cut out the distortion of the image, etc. Correction and display can be performed.

The display 23 is connected to the PC 22 and controlled by the PC 22, and can display an image on the screen. The storage device 24 may store an image obtained by the camera. The storage device 24 may store a network image using a semiconductor memory, a DVD, or the like.

FIG. 3 illustrates a third image obtained by synthesizing a first image 122a obtained at a first position A and a second image 122b obtained at a second position B by the imaging apparatus 1 of FIG. 1. The process of obtaining image 122c is schematically illustrated.

Referring to the drawing, the image sensor 12 may capture an image input through the effective area 121 of the entire area 120. The imaging device 1 may receive a circular input image 122 corresponding to all circumferences of 360 degrees using the fisheye lens 11. On the other hand, the image sensor 12 may have a rectangular shape of the effective region 121 in which an image is captured.

The circular diameter of the input image 122 may be aligned in the long side direction of the effective area 121 of the image sensor. In this case, a portion where a photograph cannot be obtained in the short side direction of the effective area 121 of the image sensor may occur, and thus 360-degree photographing may not be possible.

In this case, the image sensor 12 may be moved in the first direction of the short side direction to receive the first image 122a at the first position A. FIG. In addition, the image sensor 12 may be moved in a second direction opposite to the first direction to receive the second image 122b at the second position B. FIG. In addition, the first image 122a and the second image 122b may be synthesized to generate a substantially circular third image 122c.

If no current flows through the driving coil 14, the image sensor 12 may be located freely. When the power is turned on and the start signal of the image capture sequence is output from the control circuit, a current flows in the driving coil 14, and the image sensor board 13 is driven in the initial position of the image sensor 12, for example, in the position A direction. do. At this time, the position is sensed by the position sensor 16, and the position of the image sensor board 13 is determined such that the position of the image sensor 12 is the first position A. FIG.

In that state, image sampling by the image sensor 12 is performed. When the image sampling is finished, a current flows in the opposite direction to the drive coil 14, and the image sensor board 13 is driven in the second position of the image sensor 12, for example, the position B direction. At this time, the position is sensed by the position sensor 16, and the position of the image sensor board 13 is determined such that the position of the image sensor 12 is the second position B. FIG.

At this time, sampling of the image sensor 12 is again opened at the prescribed position at the output of the position sensor 16. This completes one cycle of sampling all the images. If the above process is repeated, all visual image moving images can be acquired continuously.

In this case, the driving units 14 and 15 may drive the image sensor 12 to move at a variable speed. Thus, the movement of the image sensor 12 can be made natural. According to the timing embodiment illustrated in FIGS. 5 to 7, the image sensor 12 may be moved at a variable speed.

The real image can collectively monitor the 360-degree field of view. However, all the time is roundly distorted. The entire circular image can be partially cut out and displayed sequentially on the monitor, and if there is a point of interest, it can be monitored centrally.

In some cases, sampling may also be considered while keeping the image sensor 12 in the A position or B position without moving. In addition, the driving algorithm of the image sensor may be various other than those described above.

In addition, the movement of the image sensor 12 may be synchronized with the read timing of the image sensor 12. Therefore, the movement of the image sensor 12 and the reading of the image sensor 12 may be naturally performed. The imaging device 1 can be operated in units of sampling time at regular time intervals.

4 to 6 are timing diagrams illustrating various embodiments in which a third image is obtained by synthesizing images continuously input by the imaging device 1 of FIG. 1, respectively.

As in the embodiment illustrated in FIG. 4, one cycle includes a first time T1 and a second time T2, and the third image 122c may be generated while repeatedly performing the cycles alternately. Can be. In this case, the circular third image 122c may be obtained at short time intervals.

At a first time T1, the image sensor 12 is moved to the first position A to receive the first image 122a. At a second time T2, the image sensor 12 is moved to the second position B to receive the second image 122b.

Here, each sampling time T1 and T2 may be operated by being divided into first sections T11 and T21 and second sections T12 and T22. In this case, the position of the image sensor 12 is moved in the first sections T11 and T21, and the input image is received through the image sensor 12 in the second sections T12 and T22.

On the other hand, the portion of the first image 122a or the second image 122b inputted in the new frame, which is not read from the input image of the second image 122b or the first image 122a inputted in the previous frame, respectively, In addition, the third image 122c may be synthesized.

However, the present invention is not limited thereto, and a common part of the first image 122a and the second image 122b may be newly synthesized in successive frames.

In the embodiment shown in FIG. 4, the image sensor 12 is moved in accordance with the read timing. For example, according to a sampling rate of 30 frames per second, the image sensor 12 is moved within one sampling time, and image capture is performed. At this time, it is necessary to invalidate the image during the movement times T11 and T21 of the image sensor 12.

In this embodiment, the image signal during the movement of the image sensor can be deleted using the electronic shutter. Therefore, the effective remaining time of the image signal can be shortened by the moving time of the image sensor.

At this time, at the beginning, the image sensor 12 is first moved to the first position A, and the integral signal of the image sensor is reset after moving the image sensor, and then the normal image editing signal is integrated to perform the prescribed timing. Integral completion image signal can be transmitted accordingly. In addition, after a predetermined time of moving the movement of the image sensor 12 to the second position B, the image signal of the image sensor can be reset and a new integration can be started. Similarly, the image signal can be transmitted at the sampling timing of the image sensor 12. At this time, the reset timing of the image sensor 12 may sufficiently cover the movement time of the sensor.

5 can be easily applied even when the moving speed of the sensor is not very fast. The embodiment of FIG. 4 may move the image sensor 12 using a portion of the sampling time of the image sensor. At this time, all of the sampling time of the image sensor 12 may be set as the movement time of the image sensor. In this case, sampling of the image may not be possible when the image sensor 12 moves. In the meantime, it is possible to compensate by holding and outputting the previous image in the CPU 19 processing the image signal.

In the embodiment shown in FIG. 5, one cycle includes a first time T1, a second time T2, a third time T3, and a fourth time T4, and the cycles alternately. The third image 122c may be generated while iteratively performing. In this case, the time required for the movement of the image sensor 12 can be secured with a margin.

The first image 122a is received at the first position A at the first time T1. The image sensor 12 is moved to the second position B at the second time T2. The second image 122b is received at the second position B at the third time T3. The image sensor 12 is moved to the first position A at the fourth time T4.

As in the embodiment shown in FIG. 6, one cycle includes a first time T1, a second time T2, a third time T3, a fourth time T4, a fifth time T5, And a sixth time T6, and may generate the third image 122c while repeatedly performing the cycle alternately. In this case, the time required for the movement of the image sensor 12 can be secured with a margin.

The first image 122a is received at the first position A at the first time T1. The image sensor 12 is moved to the second position B at the second time T2. The second image 122b is received at the second position B at the third time T3. The second image 122b is received at the second position B at the fourth time T4. The image sensor 12 is moved to the first position A at the fifth time T5. At the sixth time T6, the first image 122a is received at the first position A. FIG.

In this case, one third image 122c may be generated by synthesizing the first image 122a of the first time T1 and the second image 122b of the third time T3. Thereafter, when the second image 122b of the fourth time T4 is acquired, the second image 122b of the third time T3 is replaced with the first image 122a of the sixth time T6. ) Is obtained, the third image 122c may be generated by replacing the first image 122a of the first time T1.

In the embodiment shown in FIG. 6, the frequency of movement of the image sensor 12 can be lowered, and a reduction in current consumption and durability of the moving mechanism can be expected. 6 shows sampling twice at the same sensor position, but the present invention is not limited thereto and may be set to sample three or more times at the same sensor position.

FIG. 7 illustrates an embodiment in which an image is cut out of a part of the entire area input through the image sensor 12 in the imaging device 1 of FIG. 1.

Referring to the drawings, an image may be obtained by cutting the set cutting regions 123a, 123b, and 123c from an input image input through the image sensor 12 by a set selection. In this case, the cutting regions 123a, 123b, and 123c to be used may be sectors of a fan shape cut at a set angle. In addition, an image may be acquired while the cutting regions 123a, 123b, and 123c are moved in a set angle unit.

In this case, the image sensor 12 may be moved so that a designated area of the input image may be captured by the image sensor 12. That is, when the image of the cutting area set at the position of the current image sensor 12 cannot be obtained, the image sensor 12 is moved to the first position or the second position, so that the image of the cutting area is set to the image sensor ( 12) can be obtained through.

In this case, the cutting regions 123a, 123b, and 123c may be cut to have an angle equal to or less than the maximum occupying a region commonly included in the first position A and the second position B in the image sensor 12. In this case, it is possible to smoothly obtain a circular input image by minimizing the number of position movements of the image sensor 12.

For example, when the image sensor 12 has a rectangular shape with an aspect ratio of 4: 3 of the effective area, the angle of the cutting area can be 60 degrees or less.

Meanwhile, the entire region of the input image may be divided at a predetermined angle, and the cutting regions may be sequentially input while rotating in the set direction. In this case, the entire area of the input image may be equally divided at the set angle, and the images of the divided cut areas may be sequentially obtained.

The cutting area can be freely set. For example, the cutting position may be set to 60 degrees or less, and the cutting positions may be sequentially changed to move the position of the sensor between 360 degrees. The position sensor may be moved only once to receive an image.

Typically when using the fisheye lens 11, 360 degree monitoring can be realized without being aware of the movement of the image sensor 12. For example, in FIG. 7, the image of the position of the image sensor 12 may be cut at an image of the position of 128a at the first position A, and the image may be cropped around the field of view. In this case, it is possible to crop the image sensor up to the position at 123b without moving the image sensor. In addition, the image may be cropped by moving the position of the image sensor 12 to be cut in the clockwise direction and moving to a second position.

In addition, the image can be started as it is by rotating clockwise to the position of 123c. In addition, when the cutting position is moved around the clock at the position of 123c, the position of the image sensor 12 may be moved to the first position A, or may return to the 123a position. However, when the angle of view of 60 degrees or more is set, it may occur when the image sensor 12 needs to be continuously moved according to the cutting position.

8 shows a schematic configuration of an imaging device 2 which is another preferred embodiment according to the present invention. The same reference numerals are used for the same components as in FIG. 1 and detailed description thereof will be omitted.

Referring to the drawings, the driving unit of the imaging device 2 may include a stepping motor 25 for driving the image sensor 12 to move in a set step unit. To this end, a lead screw 25a is connected to the output terminal of the stepping motor 25. In addition, the image sensor board 13 is provided to fix the transfer block 13a.

At this time, the transfer block 13a is screwed with the lead screw 25a, so that the transfer block 13a moves forward or backward by a drive of the stepping motor 25. Accordingly, the image sensor 12 mounted on the image sensor board 13 may be moved in the first direction or the second direction.

In this case, since the stepping motor 25 may know the driving position without a separate external position sensor, the stepping motor 25 may move the image sensor 12 to a set position without a separate position sensor.

When the movement command of the image sensor 12 is output from the central processing unit 19 of FIG. 2, a drive signal is input to the driver 20 which drives the stepping motor 25, and the stepping motor 25 is driven. In this case, the stepping motor 15 is driven by a predetermined number of steps to move the image sensor 12 to a predetermined position, for example, the first position A. FIG.

When the moving command of the stepping motor 15 is issued again after the image progress integration of the image sensor 12, and the stepping motor 15 is driven in the opposite direction as before by the predetermined predetermined step, the image sensor 12 This time, it moves to the 2nd position B. FIG. Similarly, when the image editing of the image sensor is completed, the operation is repeated. The stepping motor 25 drives the predetermined number of steps to determine the position, thereby eliminating the need for the position sensor 6 required in the embodiment of FIG.

9 is a flowchart illustrating an image capturing method S10 using a fisheye lens according to an exemplary embodiment of the present invention. 9 shows obtaining a third image by synthesizing the images continuously input by the imaging device 1 of FIG. 1.

Referring to the drawings, the imaging method using a fisheye lens (S10) is a shooting preparation step (S110); Determining whether the circular image is acquired (S120); Circular image acquisition step (S130 to S190); And cut image acquisition steps S210 to S250.

The imaging method S10 using the fisheye lens allows the circular input image inputted through the fisheye lens 11 of FIG. 1 to be captured in the rectangular effective area of the image sensor 12. The image capturing method S10 using the fisheye lens is performed by the image capturing apparatus 1 of FIG. 1, and the same content as the description of the image capturing apparatus 1 will be referred to, and a detailed description thereof will be omitted.

In the shooting preparation step (S110), basic settings and preparation for shooting are performed. In the determination of whether the circular image is acquired (S120), it is determined whether the current imaging mode is to acquire the circular image.

In the circular image acquisition steps S130 to S190, the first image is input by moving the image sensor 12 in the first direction of the short side direction of the rectangle of the effective area of the image sensor 12, and receives the first image, which is opposite to the first direction. The image sensor 12 is moved in a second direction to receive a second image, and the first image and the second image are synthesized to generate a substantially circular third image.

In the cut image acquisition steps S210 to S250, the cut region set from the input image is received by the image sensor 12.

At this time, the image sensor is moved so that the designated area of the input image is captured by the image sensor 12.

In the imaging method S10 using the fisheye lens, the diameter of the circular input image input through the fisheye lens 11 may be captured according to the long side direction of the image sensor 12. To this end, images of all boundary lines can be obtained by inputting and synthesizing the images in chronological order while rapidly reciprocating the image sensor 12 in the short side direction. Thus, it is possible to obtain an image of the entire circumference without wasting the image sensor 12.

The photographing preparation step S110 is started by an operation such as a switch (not shown). At this time, the predetermined sequence is started by the central processing unit 19. At the same time, the camera control software installed in the PC 22 connected via the network interface 21 is executed and the tasks first set the image search mode.

It is set whether to obtain a picture of all of the boundary lines 360 degrees or a picture cut out of the set cutting area. If it is determined in step S120 of acquiring the circular image, that is, the image is set to the 360 degree image search, the circular image acquiring steps S130 to S190 are performed.

In this case, the central processing unit 19 controls the 360 degree image search mode to be performed through the network. At this time, the image sensor 12 is first moved to the acquisition position of the first image at the image capture timing according to the command of the central processing unit 19 (S130). At this time, the image sensor 12 is controlled to be exactly at the first position by the signal of the position sensor 16.

Thereafter, image sampling of the image sensor 12 is started at a predetermined timing, and a first image is acquired through the image sensor 12 at a preset time (S140). In this case, a third image is generated by synthesizing the second image and the image acquired from the first image in the previous frame (S150).

In addition, the image sensor 12 is moved to be positioned at the second position according to the instruction for moving the image sensor 12 to the second position (S160). At this time, when the position sensor 16 confirms that the image sensor 12 is located at the second position, sampling starts at a predetermined timing. Accordingly, the second image is acquired at the second position (S170).

In this case, when sampling of the image sensor 12 is completed at the second position, a third image is generated by synthesizing the second image with the first image of the previous frame (S180). As a result, one cycle is completed and the image capture of the entire circumference is completed. In this case, the new image data is updated in the search part, and when there is no new data, the existing image data is used.

Next, it is determined whether or not to continue shooting (S190). If it is to continue, the process returns to the beginning and performs step S120, and if not, the method ends. After that, if you continue to sample the image repeatedly, you will get all the visual images of the image.

If it is determined in the step S120 of acquiring the cut image that is, the image retrieval is set for the cut region cut out of all the boundary lines 360 degrees, the cut image acquisition steps S210 to S250 are performed.

At this time, the first cut position is selected (S210). Next, the CPU 19 determines whether the image sensor 12 needs to be moved (S220). At this time, if the cutting area corresponding to the cutting position is located on the effective area of the image sensor 12, it is determined that the movement of the image sensor 12 is not necessary. In addition, if the cutting area corresponding to the cutting position is not positioned on the effective area of the image sensor 12, it is determined that the movement of the image sensor 12 is necessary.

That is, when it is determined that the positional movement of the image sensor 12 is necessary, the image sensor 12 is moved so that the cutting region is positioned over the effective area of the image sensor 12 (S230). However, the image is acquired by searching the image as it is until the cut position change instructions are issued.

If it is not necessary to change the position of the image sensor 12 even when the cut position change instruction has been issued, the position of the image sensor 12 is first displayed when it is determined that the image sensor 12 needs to be moved continuously. The image acquisition can continue after the change instruction is set to a different position from that.

Hereinafter, the imaging device using a fisheye lens and the operation | movement at the time of actual photography by the imaging method are demonstrated concretely.

When the imaging device 1 is turned on and / or the PC 22 is switched on, and the surveillance camera control software is started, all of the borderline image import commands from the PC 22 are applied to the imaging device 1 via the network. The central processing unit 19 starts the control.

First, a current flows in the driving coil 14 in accordance with the image capture timing, and the image sensor 12 is moved so that the output of the position sensor 16 is controlled to be a predetermined amount, and the position of the image sensor 12 is controlled in FIG. It is set to one position A. The image sensor 12 then sends the image signal to the image processor 18 when the image import is completed at the predetermined timing to start the integration of the image signal.

Next, a current in the opposite direction flows to the drive coil 14, and the image sensor 12 is moved accordingly. At this time, the output of the position sensor 16 is similarly controlled to be a predetermined amount, and is set to the second position B of FIG. 3. In addition, when the image sensor 12 starts to integrate, once the image capture is completed, the image signal is transmitted to the image processor 18 again while at the same time current flows in the driving coil 14 again, and the image sensor 12 is again shown in FIG. 3. The above operation is repeated to be located at the first position A. FIG.

On the other hand, the image signal sent to the image processor 18 is subjected to a variety of processing, such as image processing such as a general digital camera, a sensor image (1st image 122a of FIG. For example, an image of 2048 pixels ㅧ 1536 pixels) can be obtained. The first image 122a is sent to the memory of the central processing unit 19.

Similarly, the obtained image (second image 122b in FIG. 3, for example, 2048 pixels ㅧ 1536 pixels) is obtained by processing the image processor 18 before the image processor 18. Transferred to the memory of the device 19. Then, by the processing of the central processing unit 19, the two images are synthesized to form an image including the entire circumferential image (the third image 122c of FIG. 3, for example, an image of 2048 pixels by 2048 pixels). In this case, the image synthesizing operation may be set to be processed by the PC 22 through a network without synthesizing an image by the central processing unit 19.

Next, the synthesized image is sent to the PC 22 via a network, and may perform necessary processing such as compression. The image signal captured by the PC 22 may be decompressed and displayed on the display 23. The image at that time may be displayed in a preset format (for example, all boundary images are displayed as it is).

The images of the first position A and the second position B which are continuously acquired by the image sensor 12 are alternately input so that the newly captured image and the missing portion may be synthesized with the last sampled image. In this state, all visual monitoring is possible. However, the image at this time is an image of scanning the entire area in a circumferential shape, and detailed information may be difficult to understand.

At this time, if you want to obtain a partial image further, it is possible to perform image conversion, for example, by cutting a partial image, and correcting the distortion of the columnar image to restore a normal image. In addition, images can be panned, tilted or enlarged as needed. In addition, the controller can set the image acquisition cycle, the repetition frequency of the movement of the image sensor, and the degree of image compression.

In this case, the dark image may be set to drop the sampling period and perform long term integration. In addition, when monitoring a small target of movement, the network load and power consumption can be suppressed by lowering the sampling rate. At this time, the moving speed of the image sensor may also be reduced, thereby reducing power consumption.

In addition, although the storage device 24 connected to the network accumulates the surveillance image, it may be set to store the image of the entire circumference or the image displayed on the monitor, how to do the image of the accumulation. In this case, when the displayed image is a partial display and the accumulated picture is also a corresponding partial image, the movement of the image sensor 12 may be set to be performed as necessary.

In general, the image sensor 12 can capture the image without moving in most cases. In this case, when the image position of panning approaches the edge of the image sensor, the image sensor 12 may be moved first to capture an image. According to this configuration, the frequency of moving the image sensor 12 can be reduced, and power consumption can be reduced.

According to the photographing apparatus and the photographing method according to an embodiment of the present invention, the waste of pixels of the image sensor can be reduced, and a high-resolution fisheye lens can be obtained by effectively utilizing an expensive high pixel sensor. In addition, a fisheye lens photograph equivalent to a large number of pixel image sensors can be obtained using a small number of pixel image sensors.

Therefore, a high quality image can be obtained with a limited image sensor. For example, by using a 3M image sensor that is commonly used, 5M equivalent image can be obtained. In addition, when a 5M image sensor is available, an image equivalent to 8.9M can be obtained using the 5M image sensor.

Because fisheye lenses contain a comprehensive image, the higher the quality, the greater the benefit of finer recognition in partial cropping. As the number of pixels increases, surveillance cameras that use pan, tilt and zoom can be turned into simple cameras using fisheye lenses and sensor movement mechanisms. In addition, when the main purpose is to shoot a video such as a surveillance camera, it is possible to reduce the discomfort caused by the movement of the sensor to drive the sensor in accordance with the timing of the image sensor.

According to the present invention, an image sensor for acquiring an input image input through a fisheye lens can be moved, so that an input image of a larger size can be obtained through an image sensor of a predetermined size.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, You will understand. Accordingly, the true scope of protection of the present invention should be determined only by the appended claims.

1: imaging device, 11: fisheye lens,
12: image sensor, 13: image sensor board,
14: drive coil, 15: permanent magnet,
16: position sensor, 17: timing generator,
18: image processor, 19: CPU,
20: driver, 21: network interface,
22: PC, 23: display,
24: storage device, 25: step motor.

Claims (20)

A fisheye lens for converting an input image into a substantially circular input image;
An image sensor having a rectangular shape in which an effective area where the input image is captured is captured; And
And a driving unit capable of reciprocating the image sensor in a short side direction in which the short side of the rectangle extends.
The first image is input by moving the image sensor in a first direction of the short side direction, the second image is input by moving the image sensor in a second direction opposite to the first direction, and the first image is received. And the second image by synthesizing the second image to generate a substantially circular third image. The method of claim 1,
And the diameter of the input image is larger than the short side length of the effective area and smaller than the long side length of the effective area. The method of claim 1,
And a position sensor for detecting a position of the image sensor. The method of claim 1,
And the driving unit includes a stepping motor for driving the image sensor. The method of claim 1,
And the driving unit drives the image sensor to move at a variable speed. The method of claim 1,
And the movement of the image sensor is synchronized with the read timing of the image sensor. The method of claim 1,
The imaging device is operated at regular intervals of sampling time,
Each said sampling time is divided into a first section and a second section,
The imaging device moves the position of the image sensor in the first section, and receives the input image through the image sensor in the second section. The method of claim 7, wherein
A first time of a sampling time of moving the image sensor to a first position and receiving the first image; and
A second time of sampling time at which the image sensor is moved to a second position to receive the second image;
And the third image is generated by alternately repeating the first time and the second time. The method of claim 1,
The imaging device is operated at regular intervals of sampling time,
A first time of sampling time for receiving the first image at a first position,
A second time of sampling time to move the image sensor to a second position,
A third time of sampling time for receiving the second image at the second position, and
A fourth time of sampling time to move the image sensor to a first position,
And the third image is generated while repeating the first to fourth times. The method of claim 1,
The imaging device is operated at regular intervals of sampling time,
A first time of sampling time for receiving the first image at a first position,
A second time of sampling time to move the image sensor to a second position,
A third time of sampling time for receiving the second image at the second position,
A fourth time of sampling time for receiving the second image at the second position,
A fifth time of sampling time to move the image sensor to the first position, and
A sixth time of a sampling time for receiving the first image at the first position,
And the third image is generated while repeating the first to sixth times. The method of claim 10,
Generating the third image by synthesizing the first image of the first time and the second image of the third time,
Generating the third image by synthesizing the first image of the first time and the second image of the fourth time,
And a third image by synthesizing the second image of the fourth time and the first image of the sixth time. The method of claim 1,
An image pickup apparatus that uses a newly acquired image at the time of image acquisition, and uses previously acquired image for the part which could not be acquired newly. The method of claim 1,
And an image is received only at a position including a cutting area set by the image sensor by the selected selection. The method of claim 13,
And the cut area is a fan-shaped area cut at a set angle. The method of claim 13,
And the cutting area is moved by a set angle unit. The method of claim 13,
And dividing the entire area of the input image at a set angle, and outputting the cut areas in order while rotating in the set direction. The method of claim 1,
And the drive portion includes an electric drive means. The method of claim 13,
And the image sensor is moved such that a designated region of the input image is captured by the image sensor. By allowing the circular input image input through the fisheye lens to be captured in the effective area of the rectangular shape of the image sensor,
Determining whether the current imaging mode acquires a circular image;
The first image is input by moving the image sensor in a first direction of the rectangular short side direction, and the second image is input by moving the image sensor in a second direction opposite to the first direction. Synthesizing a first image and the second image to generate a substantially circular third image; And
And receiving a cut region set from the input image by the image sensor. 20. The method of claim 19,
And a fisheye lens for moving the image sensor such that a designated region of the input image is picked up by the image sensor.

Images