KR20130111172A - Image pickup apparatus, method for image pickup and computer-readable recording medium - Google Patents

Abstract

PURPOSE: Auto focusing information is precisely and quickly obtained. CONSTITUTION: A photographing unit has a first pixel group and a second pixel group. A control unit uses the first pixel group to photograph an object and controls the photographing unit to obtain a live view for the object by using the second pixel group (S1410). A storage unit stores photograph data taken with the first pixel group (S1430). An AF process unit produces AF information by using the live view obtained by the second pixel group. [Reference numerals] (AA) Start; (BB) End; (S1410) Photographing object and obtain live view; (S1430) Store photographed object data; (S1450) Display live view

Description

IMAGE PICKUP APPARATUS, METHOD FOR IMAGE PICKUP AND COMPUTER-READABLE RECORDING MEDIUM

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging apparatus, an imaging method, and a computer readable recording medium, and more particularly, to an imaging apparatus, an imaging method, and a computer readable recording medium capable of quickly and precisely obtaining auto focusing information.

Recently, digital cameras have been attempted to increase the speed and precision of auto focusing while pursuing size reduction and light weight according to user demand.

Since the image sensor of the conventional camera cannot accurately obtain the AF information of the subject during continuous shooting, the imaging device must be stopped for accurate AF information collection every shooting. In addition, since the current subject information cannot be obtained and displayed during the single or continuous imaging operation, the display operation can only be stopped.

Also, in order to obtain AF information of a conventional subject, a method of acquiring phase difference autofocusing information by obtaining phase difference information has been proposed, including light blocking means for partially shielding some pixels of an image sensor. There was a problem that loss occurs.

Therefore, there is a need for a new image sensor capable of acquiring AF information without displaying pixels of the original image while displaying a live view image even during a continuous imaging operation.

SUMMARY OF THE INVENTION The present invention devised by the above-mentioned necessity aims to provide an image capturing apparatus, an image capturing method, and a computer readable recording medium capable of quickly and precisely obtaining auto focusing information.

In accordance with another aspect of the present invention, an imaging device includes: an imaging unit divided into a first pixel group and a second pixel group, and an image of a subject by using the first pixel group, and using the second pixel group. The control unit to control the imaging unit to obtain a live view of the subject, the storage unit storing the imaging data captured by the first pixel group, and the AF information by using the live view acquired by the second pixel group. It includes an AF processing unit for generating a.

In this case, the AF processing unit may generate AF information by performing contrast autofocusing on the live view obtained by the second pixel group.

On the other hand, in the image pickup apparatus of the present invention, the second pixel group further includes light blocking means for each pixel, and the AF processing unit performs phase difference auto focusing on the live view obtained by the second pixel group. AF information can be generated.

On the other hand, the imaging apparatus of the present invention further comprises a user interface unit for receiving a continuous imaging command, the control unit, if the continuous imaging command is input using the first pixel group at a predetermined time interval continuous The imaging unit may be configured to control the imaging unit to continuously acquire the live view using the second pixel group even during continuous imaging.

In this case, the controller may control the image capturing unit to adjust the focus at each image capturing time point by using the AF information generated by the AF processing unit with respect to the live view obtained at the time point at which each image capturing starts.

Meanwhile, the first pixel group includes a plurality of first pixels arranged in a matrix form of a plurality of columns and a plurality of rows, and the second pixel group includes a plurality of second pixels arranged to match each first pixel. It may include a pixel.

In this case, some of the plurality of second pixels may include light blocking means for partially blocking incident light.

The size of the first pixel may be larger than that of the second pixel, and the number of the first pixels may be equal to or greater than the number of the second pixels.

The display unit may further include a display unit for continuously displaying the live view.

In an imaging method of an imaging apparatus including an imaging unit according to another exemplary embodiment of the present disclosure, an image is captured by a first pixel group provided in the imaging unit, and a second pixel group provided in the imaging unit is used. Acquiring a live view of the subject, storing image data captured by the first pixel group, and displaying a live view acquired by the second pixel group.

In this case, the method further includes performing contrast auto focusing on the live view to generate AF information.

Meanwhile, the imaging method of the present invention further includes generating AF information by performing phase difference auto focusing on the live view.

On the other hand, when continuous imaging is performed, generating autofocus information by performing contrast autofocusing on the live view obtained at the start of each imaging, and adjusting the focus by using the generated AF information for each imaging time point. It further includes.

On the other hand, in the imaging method of the present invention, when continuous imaging is performed, a step of generating AF information by performing phase difference autofocusing on the live view acquired at the start of each imaging, and generating the AF information at each imaging time point. And adjusting the focus using.

Meanwhile, the first pixel group includes a plurality of first pixels arranged in a matrix form of a plurality of columns and a plurality of rows, and the second pixel group includes a plurality of second pixels arranged to match each first pixel. It includes a pixel.

In this case, the size of the first pixel may be larger than the size of the second pixel, and the number of the first pixels may be equal to or greater than the number of the second pixels.

In a computer-readable recording medium including a program for executing an image pickup method according to another embodiment of the present invention, the image pickup method includes: capturing a subject by using a first pixel group provided in the image pickup unit; Acquiring a live view of the subject by using a second pixel group provided in the image capturing unit, storing image data captured by the first pixel group, and live view obtained by the second pixel group Displaying the step.

1 is a block diagram of an image pickup apparatus according to an embodiment of the present invention;
2 is a block diagram showing a more specific configuration of an imaging device according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a detailed configuration of the imaging unit and the control unit of FIG. 2;
4 is a view for explaining in detail the imaging unit according to an embodiment of the present invention;
5 is a view for explaining an example of light blocking means included in a pixel constituting an image pickup unit according to an embodiment of the present disclosure;
6 is a view for explaining another example of light blocking means included in a pixel constituting an imaging unit according to an embodiment of the present disclosure;
7 is a view for explaining another example of light blocking means included in a pixel constituting an imaging unit according to an embodiment of the present disclosure;
8 is a view for explaining a more specific configuration of the image pickup device according to an embodiment of the present invention;
9 is a diagram for describing in detail a main pixel and a sub pixel constituting an image capturing unit according to another exemplary embodiment;
FIG. 10 is a conceptual diagram illustrating simultaneous display of a still image and a live view image according to another exemplary embodiment of the present disclosure; FIG.
FIG. 11 is a conceptual diagram illustrating simultaneous display of a still image and a live view image according to an embodiment of the present disclosure; FIG.
12 is a block diagram illustrating an image capturing apparatus according to another embodiment of the present invention;
FIG. 13 is a diagram for explaining a circuit configuration of an image capturing unit in FIG. 2; and
14 is a flowchart illustrating an image capturing method of an image capturing apparatus according to still another embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

1 is a block diagram of an image capturing apparatus according to an exemplary embodiment of the present invention.

Referring to FIG. 1, FIG. 1 is a block diagram of an image pickup apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the imaging apparatus 100 according to an exemplary embodiment of the present invention includes an imaging unit 110, a controller 130, a storage unit 150, and an AF processing unit 170.

The imaging unit 110 is divided into a first pixel group and a second pixel group.

The controller 130 controls the imaging unit 110 to photograph the subject using the first pixel group and to acquire a live view of the subject using the second pixel group.

The storage unit 150 stores the captured image data captured by the first pixel group.

The AF processor 170 generates AF information from pixel values of the live view obtained by the second pixel group.

In detail, the second pixel group may further include light blocking means for each pixel. The AF processor 170 may generate AF information by performing phase difference auto focusing on the live view obtained by the second pixel group.

The AF processor 170 may generate AF information by performing contrast autofocusing on the live view obtained by the second pixel group.

2 is a block diagram showing a configuration of an image capturing apparatus according to an exemplary embodiment of the present invention.

Referring to FIG. 2, the imaging apparatus 100 according to the present exemplary embodiment includes an imaging unit 110, a user interface unit 120, a controller 130, a communication interface unit 140, a storage unit 150, and a display unit. 160 and the AF processing unit 170.

The imaging apparatus 100 according to the present embodiment may be a digital camera, a camcorder, a mobile phone, a smartphone, a tablet PC, a PMP, a webcam, a black box, or the like capable of capturing an image.

The communication interface 140 is formed to connect to at least one terminal device (not shown), and is connected to the terminal device in a wireless or wired manner through a local area network (LAN) and an internet network. It is also possible to connect via a universal serial bus (USB) port or a Bluetooth module.

The communication interface 140 transmits the content stored by the image capturing apparatus 100 to an external terminal device (not shown). In detail, the communication interface 140 may transmit an image file stored in the storage 150 to be described later to an external terminal device (not shown) or a server. The content may be image content, video content, etc. that the imaging apparatus 100 can generate.

The user interface 120 may include a plurality of function keys for user setting or selecting various functions supported by the imaging apparatus 100, and may display various information provided by the imaging apparatus 100. The user interface unit 120 may be implemented as a device in which an input and an output are simultaneously implemented, such as a touch pad, and may be implemented by combining an input configuration such as a plurality of buttons and a display configuration such as an LCD and an OLED.

The user interface 120 receives various control commands such as an imaging command (or shutter command). The user interface 120 receives a setting related to imaging. In detail, the user interface 120 may receive a setting such as a file format in which the captured image is to be stored, a resolution of the captured image, whether digital zoom, AWB, AF, AE, and the like.

The user interface 120 may display the captured image. In detail, the user interface 120 may display an image captured by a user's imaging command.

The user interface 120 may display various contents stored in the storage 150 according to a user's playback command. The content may be image content, video content, or the like. For example, when the image capturing apparatus 100 is capable of capturing a video, the user interface 120 may play the video content previously stored in the storage 150.

The storage unit 150 sequentially stores pixel values read by the imaging unit 110 for each pixel group. In detail, the storage unit 150 may sequentially store data (pixel values of the first pixel group and the second pixel group) transmitted from the imaging unit 110, which will be described later. In this case, the transmitted data may be compressed data.

The storage unit 150 stores the generated image. In detail, the storage unit 150 may store an image generated by the image processor to be described later and a corrected image.

The storage unit 150 may include a storage medium and an external storage medium in the imaging apparatus 100, for example, a removable disk including a USB memory, a flash memory, a storage medium connected to the imaging apparatus, a web server through a network. ), And includes volatile memory (eg, DDR) for high speed storage. In detail, the pixel value transmitted from the imaging unit 110 may be temporarily stored in the volatile memory for high speed processing.

The imaging unit 110 includes an imaging device that is physically divided into a first pixel group and a second pixel group, and acquires an image of a subject using a plurality of first pixel groups and a second pixel group arranged in a matrix form. do. In detail, the imaging unit 110 collects the light of the subject to form an optical image in the imaging area, an imaging device for photoelectric conversion of light incident through the lens into an electrical signal, and an analog signal of the imaging device as a digital signal. It can be configured as an AD converter that converts and outputs. At this time, the image pickup element may be a CCD (Charge Coupled Device) image pickup element and a CMOS (Complementary Metal Oxide Semiconductor) image pickup element. A detailed configuration and operation of the imaging unit 110 will be described later with reference to FIG. 3.

The image processor (not shown) generates an image. In detail, the image processor may generate one image by merging pixel values stored for each pixel group in the storage 150. If the pixel value stored in the storage unit 150 is compressed data, the image processor may restore the compressed data to the pixel value and generate one image using the restored pixel value.

The image processor may perform signal processing such as digital zoom, auto white balance (AWB), auto focus (AF), auto exposure (AE), etc., to adjust format conversion and image scale of the generated image. Meanwhile, in the present embodiment, the contents of receiving a voice signal have not been described. However, the image processor generates a video file by combining a plurality of images captured with a voice signal received through a separate internal microphone or an external microphone. The generated video file may be stored in the storage 150.

The display unit 160 displays an image captured by the imaging unit 110. The display 160 may be integrally implemented with the user interface 120 described above. Alternatively, the display 160 may be implemented as a separate touch panel that performs the same technology as the user interface 120.

According to an exemplary embodiment, the display 160 displays an image acquired from the second pixel group of the image capturing unit 110 as a live view image. That is, the display 160 continuously displays the target image to be captured as a live view image. The live view image displayed on the display unit 160 is obtained as a still image or a moving image image according to a user's imaging command, and is stored in the storage unit 150.

The AF processor 170 performs an auto focusing process on the image by using the pixel value obtained by the imaging unit 110. For example, in the phase difference AF method, when the light beam passing through the lens 114 is divided into two at the rear of the focal plane and formed into a different line sensor, the focus of the two subjects (phase) changes depending on the focus position. It is a way to control. That is, the distance between the two subjects is narrow in the case of the front pin and the distance of the distance between the two subjects in the case of the rear pin is focused according to the focusing position. This phase difference AF method speeds up the AF speed since it is possible to instantly determine in which direction the focus ring is to be moved according to the distance between the phases (phases) on the subject.

According to the phase difference auto focusing method, the AF processing unit 170 focuses using the phase difference information included in the pixel value read by the second pixel group of the imaging unit 110. In detail, the phase difference AF processor 170 analyzes the live view image read by the second pixel group. The phase difference AF processor 170 analyzes phase difference information included in the live view image every frame of the displayed live view image, extracts the phase difference auto focusing information, and transmits the phase difference auto focusing information to the controller 130.

According to the contrast auto focusing method, the AF processing unit 170 performs a function of automatically focusing the focus of the subject using the pixel value obtained by the imaging unit 110. The AF processing unit 170 applies a contrast auto focusing method. That is, the contrast AF method moves the focus lens to the lens position where the focus is best according to the characteristics of the contrast value while moving the lens. By moving the focus lens, the contrast value of the pixel value read out from the second pixel group of the imaging unit 110 is converted into an electric signal, and the waveform is interpreted to adjust the focus lens to the lens position that best focuses and focus on the subject. To match.

The AF processor 170 extracts a contrast value from the pixel values constituting the live view image acquired from the image capturing unit 110, and compares the extracted contrast value to determine a point that best focuses as the focus of the subject. The AF processor 170 transfers the focus information to the controller 130.

The controller 130 may control each component in the image capturing apparatus 100. Specifically, when the imaging command is input, the controller 130 sequentially scans the first reset signal and the second reset signal for initiating exposure of the pixels to the first pixel group and the second pixel group of the imaging device, respectively. When the read command is input by the user, the controller 130 extracts phase difference auto focusing information included in the live view image information at the input time point, adjusts the focus of the subject at the input time point, and reads the first pixel group. You can let work be done.

In addition, the controller 130 may control the storage 150 to perform only a data storage operation transmitted from the imaging unit 110 during the imaging process.

The controller 130 may control to display the live view image through the user interface 120 or the display 160 while the imaging operation of the imaging unit 110 is continued. At the same time, the image processor may be controlled to compress and store the image captured by the storage unit 150 or to generate an image by using the stored pixel value of each pixel group.

As described above, the image capturing apparatus 100 according to the present exemplary embodiment continuously displays the live view image through the display unit 160, extracts phase difference information from the live view image, and performs automatic focusing as compared with the conventional image capturing apparatus. And reads a still image or a moving image in accordance with a user's imaging operation. The automatic auto focusing operation and the still image capturing are simultaneously processed together with the live view image display, thereby eliminating the need to stop capturing still images for AF processing, and perform phase difference auto focusing every frame based on the live view image. As a result, it is possible to quickly capture an autofocused still image.

In addition, the imaging apparatus 100 according to the present exemplary embodiment may focus the captured image by the phase difference auto focusing process while continuously displaying the live view image, and may store the captured image.

1, the image processor may be configured in a separate configuration from the controller 130, or may include a function of the image processor and the controller 130 in one configuration (for example, a system). It can be implemented as a System On a Chip (SOC), which will be described below with reference to FIG.

FIG. 3 is a diagram illustrating a detailed configuration of the imaging unit and the control unit of FIG. 2.

Referring to FIG. 3, the imaging unit 110 may include an imaging device 111, a timing generator 112, a high speed serial 113, and a lens 114. The controller 130 controls the preprocessor 131, the bus 132, the image processor 133, the memory controller 134, the codec 135, the rectifier processor 136, the display processor 137, and the CPU 138. Include.

First, the imaging unit 110 will be described in detail. The imaging device 111 of the imaging unit 110 is divided into a plurality of first pixel groups and a second pixel group, each pixel group is arranged in a matrix form, and a plurality of first pixel groups and second pixel groups are provided. Photoelectric conversion of light incident through the lens 114 into an electrical signal is performed by using a pixel of. In addition, the imaging device 111 may convert the photoelectrically converted analog signal into a digital signal. The imaging device 111 may be a charge coupled device (CCD) imaging device and a complementary metal oxide semiconductor (CMOS) imaging device. The specific shape and operation of the imaging device 111 will be described later with reference to FIG. 3.

The timing generator 112 controls the imaging operation of the imaging device 111. Specifically, the timing generator 112 generates a control signal for controlling the read point of the reset signal and the photoelectrically converted electric signal for starting the exposure of the pixel, and generates the generated reset signal and the control signal by the imaging device 111. Can be provided to The timings of the reset signal and the control signal generated by the timing generator 112 will be described later with reference to FIG. 4.

The high speed serial 113 may transmit 24-bit RGB (red / green / blue) color data according to a sub-low voltage differential signaling (LVDS) scheme. That is, the high speed serial 113 may transmit the captured pixel value to the controller 130.

On the other hand, the imaging device 111 according to an embodiment of the present invention can be implemented as an image device of 24Mpixel, it is possible to perform a high-speed imaging operation of several tens to hundreds per second by the imaging operation as described above. In order to process the captured image generated by the high speed imaging, the high speed serial 154 needs throughput of several gigabytes per second. In addition, one pixel may have a size of, for example, 12 bits, 14 bits, or 16 bits. Consequently, the high speed serial 154 requires tens of gigabytes per second of throughput.

The lens 114 collects the light of the subject to cause an optical image to form in the imaging area of the imaging device 152.

The controller 130 may receive a pixel value or a compressed pixel value (hereinafter, referred to as data) from the imaging unit 110 and store the received data in the volatile memory 145. In addition, the controller 130 may generate data as a single image by merging data stored in the unit of a pixel group. In addition, the controller 130 may perform a correction operation such as light quantity correction on the generated image.

The preprocessor 131 converts the data received from the imaging unit 110 into parallel data. In detail, the preprocessor 131 converts the serial data transmitted through the high speed serial 113 of the imaging unit 110 into parallel data, and the memory controller 134 to store the converted parallel data in the volatile memory. The changed parallel data can be transmitted.

The bus 132 transmits signals between the components of the controller 130.

The image processor 133 may generate a single image by processing the pixel value stored in the memory.

The image processor 133 may perform signal processing such as digital zoom, auto white balance (AWB), auto focus (AF), auto exposure (AE), and the like, for format conversion and image scale adjustment.

The decompression unit restores the compressed data temporarily stored in the volatile memory. In detail, the decompressor may restore the compressed data for each pixel group by using a decompression algorithm corresponding to the compression algorithm applied to the compressed data.

The memory controller 134 controls the operation of the volatile memory (eg, DDR). In detail, the memory controller 134 may control a read or write operation of the storage 150 in response to a request of another configuration in the controller 130. However, during the imaging process, that is, when the high speed and the high capacity are stored from the imaging unit 110, the memory controller 134 stores the storage unit 150 such that the resources of the storage unit 150 occupy 100% of the write operation. Can be controlled.

The codec 135 encodes a plurality of images to generate a plurality of images captured by the image capturing unit 110 as a moving image file when the image capturing apparatus 100 is in a moving image capturing operation. Meanwhile, in the present embodiment, the contents of receiving a voice signal have not been described, but the codec 135 combines a plurality of images captured by a voice signal received through a separate internal microphone or an external microphone to generate a video file. Can be generated.

The display processor 137 may generate a user interface window to be displayed on the user interface 120 or control the operation of the user interface 120. In addition, the display processor 137 may control to display an image on the user interface 120 or the display 160.

The CPU 178 controls each component in the controller 130. Specifically, when the imaging command is input from the user, the CPU 178 may control the timing generator 112 to scan the reset signal for starting the exposure of the pixel at different points in time for each pixel group of the imaging device. In addition, the timing generator 112 may be controlled such that a control signal for reading the pixel value of the pixel group in which the reset signal is scanned is provided to the imaging device 111.

4 is a diagram for describing in detail an image capturing unit according to an exemplary embodiment.

Referring to FIG. 4, an image pickup device 111 according to an exemplary embodiment is divided into a first pixel group 111-1 and a second pixel group 111-2. The first pixel group 111-1 includes a plurality of pixels, and the pixels of each of the first pixel group 111-1 image an object. The second pixel group 111-2 includes a plurality of pixels, and the pixels of the second pixel group 111-2 may capture a live view image of a subject.

4 exemplarily illustrates pixel groups having NXM matrix types. The first pixel group 111-1 and the second pixel group 111-2 are configured to have the same number.

As shown in FIG. 4, since the first pixel group 111-1 is a pixel group for photographing a subject, the first pixel group 111-1 is equal to or larger than the number of pixels of the second pixel group 111-2. That is, the second pixel group 111-2 may be regularly arranged between the pixels of the first pixel group 111-2 or randomly disposed. In addition, the number of pixels of the second pixel group 111-2 is less than or equal to the number of pixels of the first pixel group 111-2.

The pixels of the first pixel group 111-1 and the pixels of the second pixel group 111-2 may be embodied in the same size with each other, or the first pixel group 111- The pixel of 1) may be larger in size than the pixel of the second pixel group 111-2.

5 to 7 are various embodiments of light blocking means included in a pixel constituting an imaging unit according to an exemplary embodiment.

5 to 7, the imaging device 111 includes a first pixel group and a second pixel group configured in a matrix form. In more detail, one unit cell may include a first pixel 111a and a second pixel 111b. The first pixel 111a is a pixel that reads a still image or a moving image, and the second pixel 111b is a pixel that reads a live image view. The second pixel 111b further includes light blocking means 111c that partially shields incident light. The incident light incident on the second pixel 111b by the light blocking means 111c generates a phase difference.

FIG. 5 illustrates an embodiment in which light blocking means for shielding light incident on the second pixel 111b is formed on one right side when the second pixel 111b is symmetrically partitioned. Referring to FIG. 5, it can be seen that other light blocking means is formed on one surface of the other pixels as well. However, the embodiment shown in FIG. 5 is only one embodiment and may not be symmetrically partitioned, and light blocking means may be formed on one surface of the left side.

FIG. 6 illustrates an embodiment in which light blocking means for shielding light incident on the second pixel 111b is formed on one lower surface when the second pixel 111b is vertically symmetrically partitioned. Referring to FIG. 6, it can be seen that light blocking means is formed on the lower surface of the other second pixels. However, the embodiment shown in FIG. 6 is only one embodiment and may not be partitioned symmetrically, and a light shielding means may be formed on one upper surface.

In FIG. 7, the second pixel 111b-1 positioned on the left side of the first pixel 111a-1 is the same as the light blocking means pattern of the second pixel 111b-1 illustrated in FIG. 5, and the first pixel ( The second pixel 111b-3 positioned to the left of 111a-3 has the same light blocking means pattern as the second pixel 111b shown in FIG. That is, referring to FIG. 7, it can be seen that the pattern of the light blocking means for blocking the light incident surface of the second pixel may be implemented by using the light blocking means pattern illustrated in FIGS. 5 and 6.

8 is a view for explaining a more specific configuration of the image pickup device according to an embodiment of the present invention.

Referring to FIG. 8, the imaging device 111 according to an embodiment of the present invention may be configured of the first pixel groups 111a-1 to 111a-4 and the second pixel groups 111b-1 to 111b-4. Can be. In FIG. 8, the first pixel group and the second pixel group are illustrated in a 2 × 2 cell array, but this is merely exemplary.

First, the first pixel groups 111a-1 to 111a-4 and the second pixel groups 111b-1 to 111b-4 may be physically independently separated from each other. In this case, the first pixel groups 111a-1 to 111a-4 and the second pixel groups 111b-1 to 111b-4 are connected to the first vertical scan circuit 610 through separate first vertical scan lines, respectively. And a second vertical scan circuit 620 through a second vertical scan line. In addition, the first horizontal scanning circuit 650 and the second horizontal scanning circuit 640 may be connected to the second horizontal scanning circuit 640 through the first horizontal scanning line.

The first pixel groups 111a-1 to 111a-4 may be composed of four main pixels, and the second pixel groups 111b-1 to 111b-4 may be configured of four sub pixels. Here, the main pixel may read a still image or a moving image, and the sub pixel may read a live view image including phase difference information. However, as described above with reference to FIG. 4, the subpixel may be a pixel group capable of reading only a live view image that does not include phase difference information.

The pixel value of the image read through the main pixel may be configured to have a higher resolution than the pixel value of the image read through the sub pixel. To this end, the number of unit pixels of the first pixel groups 111a-1 to 111a-4 is greater than or equal to the number of unit pixels of the second pixel groups 111b-1 to 111b-4. It is preferable. However, FIG. 8 illustrates one embodiment implemented as the same number for convenience of description.

In addition, the unit pixel constituting the main pixel may be designed to have a larger size of the unit cell than the unit pixel constituting the sub pixel.

In addition, the second pixel groups 111b-1 to 111b-4 may further include light blocking means 111c-1 to 111c-4 in each unit pixel. In the case of further including the light blocking means, the second pixel groups 111b-1 to 111b-4 may read the live view image and simultaneously read the phase difference information.

According to another embodiment of the present invention, a horizontal scan line for reading a pixel value from the first pixel groups 111a-1 to 111a-4 and the second pixel groups 111b-1 to 111b-4, and controlling the pixel value And the vertical scan line can be configured independently. However, each of the vertical scan line and the horizontal scan line includes a first vertical scan circuit 610 or a second vertical scan circuit 620, respectively, and the first horizontal scan circuit 650 or the second horizontal scan circuit 640. It can be configured as.

In detail, when the first and second reset signals or the first and second control signals are received from the timing generator 112, the first pixel group 111a-1, 111a-2. 4) are sequentially read out. At the same time, the second pixel group 111b-1, 111b-2 ... 111b-4 is sequentially read out by the second reset signal.

The controller 130 controls to read out pixel values sequentially read out by the first reset signal and the second reset signal. The still image or moving image is captured based on the first pixel values read from the first pixel group. Also, a live view image is captured based on the second pixel values read from the second pixel group. The still image or video image captured in this way has a higher resolution than the Live View image. The pixel value read out from the second pixel group includes phase difference information.

The imaging apparatus 100 configured as an image sensor according to the present invention separates and captures a still image and a live view image from a subject through a first pixel group and a second pixel group, respectively, and extracts phase difference information from the live view image. The phase difference auto focusing information of the subject may be acquired every frame of the live view image.

By using the phase difference auto focusing information thus obtained continuously, the focus of the subject is autofocused at the time of imaging. The phase difference auto focusing method according to an exemplary embodiment of the present invention extracts phase difference auto focusing information from a live view image continuously captured, and adjusts the focus of a still image or a moving image based on the phase difference auto focusing information.

Therefore, compared to the conventional method of obtaining pixel values from some pixel values of the still image, the live view image display and the still image capturing operation are simultaneously performed, thereby simultaneously displaying and storing the still view image. Exert.

In addition, since the phase difference auto focusing information of the subject can be obtained every frame while displaying the live view image, unlike the conventional invention, AF information can be obtained more precisely, and thus, high-speed auto focusing can be performed based on more precise focusing information. There is an effect that can be performed.

FIG. 9 is a diagram for specifically describing a main pixel and a sub pixel constituting an imaging unit according to another exemplary embodiment.

Referring to FIG. 9, the imaging device 111 according to an embodiment of the present invention may be configured of the first pixel groups 111a-1 to 111a -N and the second pixel groups 111b-1 to 111b -M. Can be. The first pixel groups 111a-1 to 111a -N and the second pixel groups 111b-1 to 111b -M may be physically independently separated from each other.

In this case, the first pixel groups 111a-1 to 111a -N and the second pixel groups 111b-1 to 111b -M are separate first vertical scan lines 310-1 to 310-3 and second, respectively. The vertical scan line 330-1 to 330-3 and the first horizontal scan line 350 may be connected to a vertical scan circuit (not shown) and a horizontal scan circuit (not shown) through the second horizontal scan line 360. .

The first pixel groups 111a-1 to 111a -N may include N main pixels, and the second pixel group 111b-1 through 111b -M may include M sub pixels. Here, the main pixel may read a still image or a moving image, and the sub pixel may read a live view image including contrast auto focusing information.

The pixel value of the image read through the main pixel may be configured to have a higher resolution than the pixel value of the image read through the sub pixel. To this end, the number (N) of the unit pixels of the first pixel group 111a-1 to 111a -N is equal to the number (M) of the unit pixels of the second pixel group 111b-1 to 111b -M, or It can be composed a lot. That is, the second pixel groups 111b-1 to 111b -M may be regularly or randomly disposed between the first pixel groups 111a-1 to 111a -N.

In addition, the unit pixel constituting the main pixel may be manufactured to have a larger size of the unit cell than the unit pixel constituting the sub pixel.

According to another embodiment of the present invention, a horizontal scan line for reading a pixel value from the first pixel groups 111a-1 to 111a -N and the second pixel groups 111b-1 to 111b -M and controlling the same The and vertical scan lines may be configured independently, but the vertical scan lines and the horizontal scan lines may be configured as separate vertical scan circuits or horizontal scan circuits, respectively.

In detail, when the first reset signal is received from the timing generator 112, the first pixel group 111a-1, 111a-2,... 111a -N are sequentially read out by the first reset signal. At the same time, the second pixel group 111b-1, 111b-2 ... 111b-M is sequentially read out by the second reset signal.

The controller 130 controls to read out pixel values sequentially read out by the first reset signal and the second reset signal. The still image or moving image is captured based on the first pixel values read from the first pixel group. Also, a live view image is captured based on the second pixel values read from the second pixel group. The still image or video image captured in this way has a higher resolution than the Live View image.

The imaging apparatus 100 configured as an image sensor according to the present invention separates and captures a still image and a live view image from a subject through a first pixel group and a second pixel group, respectively, and extracts contrast autofocusing information from the live view image. Thus, the contrast auto focusing information of the subject can be obtained every frame of the live view image.

By using the contrast auto focusing information thus obtained continuously, the focus of the subject can be autofocused at the time of imaging. The contrast auto focusing method according to an exemplary embodiment of the present invention extracts contrast auto focusing information from a live view image continuously captured, and adjusts the focus of a still image or a moving image based on the extracted contrast auto focusing information. have.

Therefore, the live view image display and the still image capturing operation can be simultaneously performed as compared with the method of obtaining pixel values from some pixel values of the conventional still image, thereby simultaneously capturing and storing the still image while displaying the live view image. It is effective.

In addition, since contrast auto focusing information of a subject is obtained every frame while displaying a live view image, high-speed auto focusing can be performed because the imaging operation does not have to be stopped to obtain AF information, unlike conventional inventions. .

FIG. 10 is a conceptual diagram illustrating simultaneous display of a still image and a live view image according to another exemplary embodiment.

Referring to FIG. 10, the live view images 430-1 to 430 -M are continuously displayed, and the still images 410-1, 410-2, and 410-3 are displayed at a time point t1, t2, where an imaging operation is performed. It can be confirmed that each is imaged at t3).

The still images 410-1, 410-2, and 410-3 shown in FIG. 10 are images captured by the first pixel group of the imaging unit 110, and live view images 430-1 to 430 -M. Is an image picked up by the second pixel group.

More specifically, it is as follows. When the image capturing apparatus 100 starts capturing an object, the captured object is displayed on the display unit 160 as a live view image. In this case, the live view image is a real-time image of a subject (for example, a person or a landscape) to be captured by the imaging apparatus 100. However, the live view image is a continuous captured image in which an image of a low pixel of a subject is displayed at a predetermined frame rate, but is not stored in the storage 150.

The contrast AF processor 170 extracts contrast auto focusing information from some pixels of the frame constituting the live view image. The contrast autofocusing method is a method of focusing to a lens position having the highest contrast value by comparing contrast values of pixel values of an image.

The contrast AF processor 170 extracts a contrast value from pixel values of every frame constituting the live view image and compares the contrast value to focus on a point having the highest contrast value. If the focus is changed by moving the subject, the contrast AF processor 170 newly focuses by extracting and comparing contrast values from the live view image of the changed subject.

 If the user inputs an image capturing command of the still image to the imaging apparatus 100 at the first time point t1 while the live view image is displayed, the user extracts the image from the live view image L12 of the time point t1. The focus of the lens is focused based on the contrast auto focusing information, and the subject is imaged to obtain a still image 410-1. The still image 410-1 thus obtained is compressed by the compression unit and stored in the storage unit 150.

Live view images L13 to L24 are still displayed while the still image 410-1 thus obtained is captured, compressed and stored. In this way, the live view images L13 to L24 are obtained based on pixel values read from the second pixel group of the imaging unit 110, and the still image 410-1 is obtained from the first pixel group of the imaging unit 110. Since it is obtained based on the read pixel value, the live view image is displayed on the display unit 160 even during the imaging operation.

Similarly, when the user performs a still image capturing operation at the second time point t2 and the third time point t3, the second still image 410-2 and the third still image 410-3 may be displayed at each time point. It can be obtained, compressed and stored in the storage unit 150. In this case, the contrast auto focusing information of the second still image 410-2 is based on the contrast auto focusing information obtained from the live view image L24. In addition, the contrast auto focusing information of the third still image 410-3 is based on the contrast auto focusing information obtained from the live view image L _N.

FIG. 11 is a conceptual diagram illustrating simultaneous display of a still image and a live view image according to an exemplary embodiment.

Referring to FIG. 11, the live view images 1130-1 to 1130 -N are continuously displayed, and the still images 1110-1, 1110-2, and 1110-3 are displayed at a time point t1 at which three imaging operations are performed. It can be confirmed that the images are captured at t2 and t3).

The still images 1110-1, 1110-2, and 1110-3 shown in FIG. 11 are images captured by the first pixel group of the image capturing unit 110, and live view images 1130-1 to 1130 -N. Is an image picked up by the second pixel group.

More specifically, it is as follows. When the image capturing apparatus 100 starts capturing an object, the captured object is displayed on the display unit 160 as a live view image. In this case, the live view image is a real-time image of a subject (for example, a person or a landscape) to be captured by the imaging apparatus 100. However, the live view image is a continuous captured image that is continuously displayed at a predetermined frame rate composed of an image of a low pixel of a subject, and the live view image is not stored in the storage 150.

The AF processor 170 extracts phase difference autofocusing information by analyzing the phase difference of the pixel value read by the second pixel group. The phase difference autofocusing method is a method of adjusting the focus position of a lens by comparing the phase difference of a plurality of pixel values.

The AF processor 170 extracts a phase difference value from pixel values of every frame constituting the live view image and adjusts the focus based on the phase difference value. If the focus is changed due to the movement of the subject, the AF processor 170 extracts a phase difference value from the live view image of the changed subject and adjusts it to a new focus by using the same.

 If the user inputs an image capturing command to the image capturing apparatus 100 at the first time point t1 while the live view image is being displayed, it is extracted from the live view image 1030-1 of the corresponding time point t1. The lens is focused based on the phase difference information, and the subject is imaged to obtain a still image 1110-1. The still image 810-1 thus obtained is stored in the storage 150.

The live view images 1130-2 to 1130-11 are continuously displayed even while the still image 1110-1 thus obtained is captured and stored. In this way, the live view images 1130-2 to 1130-11 are obtained from pixel values read from the second pixel group of the imaging unit 110, and the still image 1110-1 is the first pixel of the imaging unit 110. Obtained based on pixel values read from the group. Since the first pixel group and the second pixel group are independently controlled and output an output signal, the display unit 160 stores the live view image captured by the second pixel group while storing the image captured by the first pixel group. Is displayed.

Similarly, when the user performs an imaging operation at the second time point t2 and the third time point t3, the controller 130 may control the second still image 1110-2 and the third still image (obtained at each time point). 1110-3) may be controlled to be compressed and stored in the storage 150.

In this case, the phase difference auto focusing information of the second still image 1110-2 is based on the phase difference auto focusing information obtained from the live view image 1130-12. In addition, the phase difference auto focusing information of the third still image 1110-3 is based on the phase difference auto focusing information obtained from the live view image 1130-25.

12 is a block diagram illustrating an image capturing apparatus according to another embodiment of the present invention.

Referring to FIG. 12, the imaging apparatus 100 includes an imaging unit 110, a controller 130, a storage 150, a display 160, and an AF processor 170.

The imaging unit 110 acquires an image of a subject by using a plurality of pixels divided into a plurality of first pixel groups and a second pixel group. The controller 130 processes the image captured by the imaging unit 110. The display 160 displays the captured image processed by the controller 130. The AF processor 170 extracts phase difference information from pixel values read from the second pixel group. The controller 130 sequentially scans the first reset signal and the second reset signal for simultaneously exposing exposure of the pixels of the plurality of first pixel groups and the second pixel group, and the plurality of first pixel groups to correspond to the scanning order. And the pixel values of the plurality of second pixel groups are sequentially read.

In this case, the imaging unit 110 includes a lens 114 for receiving light, an imaging device 111 for converting the received light into an electrical signal, and A / D converters 115-1 and 115-2.

The imaging device 111 converts the optical signal of the subject introduced through the lens 114 into an electrical signal. That is, the imaging element 111 picks up a still image and a live view image from a plurality of pixels divided into a first pixel group and a second pixel group, respectively.

In this case, the plurality of first pixel groups may be composed of a plurality of pixels having a matrix form, and the plurality of second pixel groups may be configured of a plurality of pixels having the same shape as the plurality of first pixel groups. Alternatively, the plurality of second pixel groups may be configured in a space between the plurality of pixels of the plurality of first pixel groups.

That is, the plurality of first pixel groups and the plurality of second pixel groups may operate independently of each other, perform the same functions as the existing image sensor through the plurality of first pixel groups, and perform the plurality of second pixel groups. Through this, a function of acquiring an image including phase difference information is performed.

The pixels of the plurality of first pixel groups may be designed to have a separate first control unit (not shown) and a first output unit (not shown) for a high speed algorithm, and the pixels of the plurality of second pixel groups may include image information. It may be designed to have a separate second control unit (not shown) and a second output unit (not shown) to obtain a. In this case, the first output unit and the second output unit may be physically divided output units, or they may be designed to share the first output unit and the second output unit as one output unit by physically sharing but separating time by time division.

 The image signals picked up from the plurality of first pixel groups are converted into first digital signals through the first A / D converter 115-1, and the image signals picked up from the plurality of second pixel groups are second A / D. The converter 115-2 converts the signal into a second digital signal.

The converted first digital signal and the second digital signal are stored in the storage 150 according to the control signal of the controller 130, displayed as a live view image on the display 160, or the phase difference AF processor 170. It can be input to and used as auto focus information of the subject.

The AF processor 170 extracts information on focus by performing phase difference autofocusing according to phase difference information included in pixel values obtained from the second pixel group among the pixel values acquired by the imaging device 111. Adjust the focus of the subject according to the focus.

The controller 130 controls the imaging unit 110 to adjust the focus of the lens 114 based on the phase difference information extracted by the AF processing unit 170.

In addition, the controller 130 displays the live view image captured by the display unit 160 based on the live view image display information.

As described above, in the imaging apparatus 100 according to the exemplary embodiment, the imaging device 111 may be configured to have a structure independent of each other by a plurality of first pixel groups and a plurality of second pixel groups.

Here, the plurality of first pixel groups serve as an image pickup device for picking up a still image or a moving image of a subject. The plurality of second pixel groups function as an image pickup device that picks up an image for extracting auto focusing information for adjusting a focus of a subject.

Since a plurality of second pixel groups according to an embodiment of the present invention capture an image for extracting auto focusing information, the plurality of second pixel groups may be designed as pixels capable of capturing a low resolution image. Accordingly, the plurality of second pixel groups may have fewer pixels and smaller unit pixel sizes than the plurality of first pixel groups.

Also, unlike the arrangement of the plurality of first pixel groups, the plurality of second pixel groups may not have a matrix structure, and the plurality of second pixel groups may be implemented with at least two pixels in a space between pixels constituting the plurality of first pixel groups. Can be.

The controller 130 may control the display 160 to continuously perform the live view operation even while the pixel value read in the storage 150 is stored. This means that a still image or a moving image is read through the first pixel group, and an image displayed as the live view image is read through the second pixel group. The high speed auto focusing imaging device according to the present invention has the effect of displaying a live view image while storing still images.

FIG. 13 is a diagram for describing a circuit configuration of the imaging device of FIG. 1.

Referring to FIG. 13, a CCD pixel cell and an AD converter are shown.

The CCD pixel cell is one element in the image pickup element as shown in FIG. Specifically, in the CCD pixel cell, a metal-oxide-silicon (MOS) and a capacitor are in close proximity to each other, and the charge carriers of the MOS are stored in the capacitor by exposure. Therefore, the size of the charge carriers stored in the capacitor changes with the exposure time.

The AD converter reads the magnitude of the charge carriers stored in the capacitor, that is, reads the voltage value of the capacitor and outputs the digital signal. These AD converters are connected to each column in the matrix.

14 is a flowchart illustrating an image capturing method of a high speed auto focusing image capturing apparatus according to another exemplary embodiment of the present invention.

Referring to FIG. 14, the image capturing apparatus 100 according to the present invention captures a subject and acquires a live view (S1410), stores the acquired image data (S1430), and performs a live view using the obtained live view image. Display (S1450).

Subject imaging and live view acquisition capture a subject by using a first pixel group provided in the imaging unit, and obtain a live view of the subject using the second pixel group provided in the imaging unit (S1310). .

In the sensing data storing step, the sensing data captured by the first pixel group is stored (S1330).

The live view display step displays the live view acquired by the second pixel group (S1350).

The imaging method of the imaging device according to another embodiment of the present invention sequentially scans the reset signal. The pixel values of the plurality of first pixel groups and the plurality of second pixel groups are read out. Phase difference autofocusing information is extracted from the pixel values read from the plurality of second pixel groups, and the focus of the subject is adjusted using the phase difference AF information and the live view display information. The Live View image is displayed while saving the captured image.

In the step of sequentially scanning the reset signals, a plurality of first pixels are provided with a reset signal for initiating exposure of the pixels to an imaging device 111 including a plurality of pixels divided into a plurality of first pixel groups and a plurality of second pixel groups. The first reset signal and the second reset signal are sequentially scanned to the group and the plurality of second pixel groups, respectively. In this case, the plurality of first pixel groups and the plurality of second pixel groups are connected to separate vertical scan lines and horizontal scan lines, respectively, and controlled by circuits connected to the respective vertical scan lines and the horizontal scan lines, thereby independently of each other. The first reset signal and the second reset signal may be scanned.

The pixel values of the plurality of first pixel groups and the plurality of second pixel groups are read out sequentially for each pixel group. In detail, the pixel value of each pixel in the first pixel group may be read at a predetermined time after the first reset signal is scanned with respect to the first pixel group scanned with the first reset signal. Similarly, a pixel value of each pixel in the second pixel group may be read at a predetermined time after the second reset signal is scanned for the second pixel group scanned with the second reset signal.

Phase difference AF information and live view display information are extracted based on pixel values read from each pixel in the second pixel group. Specifically, since the pixel values of each pixel of the second pixel group have different phase differences, phase difference information is extracted by comparing pixel values of each pixel.

The read pixel values are compressed in pixel group units for storage or display on the display unit. Specifically, the plurality of pixel values read in pixel group units may be compressed using a quasi-lossless algorithm.

The pixel value compressed in the unit of the first pixel group is stored and the pixel value compressed in the unit of the second pixel group is displayed as a live view image. The compressed pixel value may be restored, and one image may be generated by merging the plurality of restored pixel values. The image pickup method of the high speed auto focusing image capturing apparatus according to the present invention extracts phase difference information from an image picked up by the second pixel group, thereby adjusting the focus of the subject every frame of the live view image picked up by the second pixel group. Can be. At the same time, the image picked up by the first pixel group may be stored in the storage unit as a still image or a moving image.

The operation of displaying the live view image and the operation of storing the still image are simultaneously performed, and auto focusing can be performed at high speed by extracting phase difference information from the live view image.

In addition, the imaging method as described above may be implemented with at least one execution program for executing the imaging method of the imaging device as described above, such execution program may be stored in a computer read recording medium.

Therefore, photographing the subject using the first pixel group provided in the imaging unit according to the present invention, and acquiring a live view of the subject using the second pixel group provided in the imaging unit. The step of storing the imaged data picked up by the user and displaying the live view obtained by the second pixel group may be implemented with computer recordable code on a computer readable recording medium. The computer readable recording medium may be a device capable of storing data that can be read by a computer system.

Although the above has been illustrated and described with respect to preferred embodiments of the present invention, the present invention is not limited to the above-described specific embodiments, and the present invention belongs to the present invention without departing from the gist of the present invention as claimed in the claims. Anyone of ordinary skill in the art can make various modifications, and such changes are within the scope of the claims.

110: imaging unit: 111: imaging device
120: user interface unit 130: control unit
140: communication interface unit 150:
160; Display unit 170: AF processing unit

Claims (17)

In the imaging device,
An imaging unit divided into a first pixel group and a second pixel group;
A controller configured to photograph the subject by using the first pixel group and to control the imaging unit to obtain a live view of the subject by using the second pixel group;
A storage unit which stores the imaging data picked up by the first pixel group; And
And an AF processor configured to generate AF information by using the live view acquired by the second pixel group. The method of claim 1,
And the AF processing unit generates AF information by performing contrast auto focusing on the live view obtained by the second pixel group. The method of claim 1,
The second pixel group further includes light blocking means for each pixel.
And the AF processing unit generates AF information by performing phase difference auto focusing on the live view obtained by the second pixel group. The method of claim 1,
And a user interface unit configured to receive a continuous imaging command.
The control unit,
When the continuous imaging command is input, the imaging is continuously performed using the first pixel group at a predetermined time interval, and the live view is continuously acquired using the second pixel group even during continuous imaging. An imaging device, characterized in that for controlling the imaging section. 5. The method of claim 4,
The control unit,
And the image capturing unit controls the image capturing unit to adjust the focus at each image capturing time point using the AF information generated by the AF processing unit with respect to the live view obtained at the time point at which each image capturing starts. The method of claim 1,
The first pixel group includes a plurality of first pixels arranged in a matrix form of a plurality of columns and a plurality of rows.
And the second pixel group includes a plurality of second pixels arranged to match each first pixel. The method according to claim 6,
And some of said plurality of second pixels are provided with light shielding means for partially blocking incident light. The method according to claim 6,
The size of the first pixel is larger than the size of the second pixel, the number of the first pixel is at least the number of the second pixel. The method according to any one of claims 1 to 8,
And a display unit for continuously displaying the live view. An imaging method of an imaging device including an imaging unit,
Imaging a subject using a first pixel group provided in the imaging unit, and obtaining a live view of the subject using the second pixel group provided in the imaging unit;
Storing the imaging data picked up by the first pixel group; And
Displaying the live view obtained by the second group of pixels. The method of claim 10,
And performing contrast auto focusing on the live view to generate AF information. The method of claim 10,
And performing phase difference auto focusing on the live view to generate AF information. 12. The method of claim 11,
When continuous imaging is performed, generating AF information by performing contrast autofocusing on the live view obtained at the start of each imaging; And
And adjusting the focus by using the AF information generated at each imaging time point. The method of claim 12,
When continuous imaging is performed, generating AF information by performing phase difference autofocusing on the live view acquired at the time when each imaging is started; And
And adjusting the focus by using the AF information generated at each imaging time point. The method of claim 10,
The first pixel group includes a plurality of first pixels arranged in a matrix form of a plurality of columns and a plurality of rows.
And the second pixel group includes a plurality of second pixels arranged to match each first pixel. 15. The method of claim 14,
The size of the first pixel is larger than the size of the second pixel, the number of the first pixel is at least the number of the second pixel. A computer readable recording medium comprising a program for executing an imaging method, the method comprising:
The imaging method,
Imaging a subject using a first pixel group provided in the imaging unit, and obtaining a live view of the subject using the second pixel group provided in the imaging unit;
Storing the imaging data picked up by the first pixel group; And
Displaying the live view obtained by the second group of pixels.

Images