JP2007259155A - Camera, determination method thereof, and control method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a determination method of a camera and a control method of the camera for taking pictures with different angles of field for one scene. <P>SOLUTION: A pixel signal of a first photography range 3w with a wide angle θw of field through a lens 2 is read out by a first AFE 4w. An image signal of a second photography range 3t with a narrow angle θt of field through the same lens 2 is read out by a second AFE 4t. After one-time exposure of an imaging element, the pixel signal of the first photography range 3w and the image signal of second photography range 3t are continuously read out. The image signal with the same exposure is used in common for two image signals. In a signal processing unit 5, each read-out image signal is subjected to predetermined image processing, such as compression. The first processed image Dw is recorded in a memory 9. The second processed image Dt is recorded in a back-up memory 9a. In this way, two moving video images are recorded at the same time. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a camera, in particular, a camera having an image photographing function suitable for viewing.

  A normal camera only records one screen, but a camera that displays and records images with different angles and directions has been proposed as follows in order to record convenience and moving image still images simultaneously. ing.

  First, a camera that prevents a change in the angle of view of a moving image still image has been proposed (Patent Document 1). This camera is equipped with an image sensor having a larger number of pixels than that required for moving images, and when shooting a moving image, a lens is widened and a part of all pixels are cut out and recorded. This is because even if the number of pixels larger than that displayed on the monitor is recorded as a moving image, it is useless and multi-pixel recording at high speed is not easy. At the time of still image shooting, all the images on the image sensor are recorded with the lens set to tele. This is to withstand printing. This unifies the angle of view taken with moving image still images.

  In addition, a camera has been proposed that not only records one image but also includes two optical systems and records images obtained from the respective optical systems. This is because the photographer can take a picture while confirming the subject image in various situations (Patent Document 2).

  In addition, a camera that displays an image with a wide angle of view on a display unit and records a narrower image for recording is proposed in order to be able to predict and capture the movement of an object to be imaged (Patent Document). 3). Since an area larger than the recording area is displayed and the area to be recorded can be determined while looking at this, it is possible to deal with a subject to be photographed with a large amount of movement.

  In addition, a camera that can capture a still image during moving image shooting has also been proposed (Patent Document 4). A moving image and a still image are read alternately. A moving image is read in the thinning-out reading mode, and a still image is read in the all-pixel reading mode. A single camera can record video still images with the same angle of view at the same time.

In addition, an imaging apparatus that can easily capture a plurality of images with different fields of view has been proposed (Patent Document 5). Here, signals are read from alternately different areas of the CCD image sensor to create two moving images.
Japanese Patent Laid-Open No. 11-187299 JP 2003-29884 A JP 2004-343363 A JP 2005-057378 A JP 2006-042399 A

  When watching athletic events, concert events, or travel destinations, people watch while changing their gaze points and gaze directions unconsciously. In other words, do not keep looking at the same range all the time, looking at the whole or a specific part. When shooting with the camera, shooting is performed while appropriately switching between the entire shooting and the zoomed shooting by mechanical zoom and direction designation. However, since there is only one opportunity to shoot, it is not uncommon to miss the chance of taking a picture of each of the whole or partial shots. Also, when viewing after shooting, the points of interest for those who are not photographers are naturally different from those for photographers, so it may not be an image that is sufficiently satisfactory for those who are not photographers. Many.

  According to the imaging apparatus disclosed in Patent Document 5, a request for simultaneously capturing images with different angles of view can be achieved, and there is no need to prepare two cameras.

  However, if two images with different angles of view are taken in parallel from the beginning to the end, there is a problem that the memory consumption is nearly doubled. And since the amount is simply doubled, the amount of information will be too much to handle in later playback.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object of the present invention is to provide a camera that easily captures one scene at different angles of view, a method for determining such a camera, and a method for controlling the camera.

  In order to achieve the above object, a camera according to a first invention includes an imaging unit that forms an image based on a plurality of subject images that include the same subject and that covers different regions of an imaging device, and the imaging unit includes the plurality of imaging units. A determination unit that determines whether to form an image or only one image and a plurality of images formed by the imaging unit at the same time when the imaging unit is determined to form the plurality of images And a control unit that records a plurality of captured moving images or still images in a memory.

  A camera according to a second aspect of the present invention is an image sensor that outputs an image signal, a first image capturing unit that reads an image from a first image capturing range of the image sensor, and a first image sensor having a size different from that of the first image capturing range of the image sensor. A second imaging unit that reads an image from two imaging ranges, a determination unit that determines whether to read from only the first imaging unit or from both the first imaging unit and the second imaging unit, and the first When it is determined that both the image pickup unit and the second image pickup unit read out the image, the first image pickup unit and the second image pickup unit repeatedly read out the image twice for each exposure of the image pickup element. And a control unit that records a first image based on the image read by the imaging unit and a second image based on the image read by the second imaging unit in the memory as two moving images.

  According to a third aspect of the present invention, there is provided a method for determining a camera, wherein a single exposure to an image sensor is selectively performed with a plurality of readouts with different sizes of a readout range from the image sensor, and a plurality of exposures are performed in a single exposure. In a method for determining a camera having a control unit that records a plurality of moving images having different readout ranges by repeating this operation, the plurality of images are recorded based on a photographer's instruction. It is determined whether to record only the image.

  According to a fourth aspect of the present invention, there is provided a camera according to a fourth aspect of the present invention, an image sensor that outputs an image signal, a first image capturing unit that reads an image from a first image capturing range of the image sensor, and a first image sensor having a size different from the first image capturing range of the image sensor. (2) a second imaging unit that reads an image from the imaging range, and a control unit that controls the first imaging unit and the second imaging unit, and the control unit, when instructed to change the second imaging range, Control is performed so that the first imaging unit or the second imaging unit captures an image of a region including the region before and after the second imaging range change, and the second imaging range is then captured by the second imaging unit. To do.

  ADVANTAGE OF THE INVENTION According to this invention, the camera which image | photographs one scene by the image of a different angle of view, the determination method of such a camera, and the control method of a camera can be provided.

The best mode for carrying out the present invention will be described below with reference to the drawings.
(First embodiment)
The first embodiment will be described with reference to FIGS. FIG. 1 is an overall block diagram of a digital camera 1 to which the present invention is applied.
The camera 1 is provided with a photographic lens 2, an image sensor 3, a first AFE (analog front end) 4w, a second AFE (analog front end) 4t, a signal processing unit 5, a RAM 6, a ROM 7, and a memory 9. The taking lens 2 forms an image of the incident subject 20 on the image sensor 3. The image sensor 3 is composed of a CCD or a CMOS, and converts the formed subject image into an electrical signal. The first AFE 4w and the second AFE 4t read the image signal from the image sensor 3, and output the read image signal as digital image data by performing AGC processing, CDS processing, AD conversion, or the like. The first AFE 4w is also called a first imaging unit, and the second AFE 4t is also called a second imaging unit, details of which will be described later.

The signal processing unit 5 includes a compression unit, an expansion unit, and the like, and performs processing such as color correction, signal compression, and expansion on the image data. The compression unit performs, for example, JPEG compression or MPEG compression for recording image data in the memory 9, and also has a sound compression function. The decompressing unit performs a process of restoring the compressed image data.
The auxiliary block 5a in the signal processing unit 5 changes the way of correction. The RAM 6 is used as a work area for temporary storage of various calculation data and image data during compression / decompression. The memory 9 is a memory for storing image data, and includes, for example, a flash memory or a hard disk. The image data processed by the signal processing unit 5 is recorded in the memory 9. The memory 9 is also provided with an area for a transmission memory 9a.

  The camera 1 is provided with a display unit 8 for displaying images, a microphone 12 and a speaker 13. At the time of shooting, the image output from the image sensor 3 is sequentially reproduced and displayed on the display unit 8 for image confirmation. At the time of reproduction, an image read from the memory 9 and expanded by the expansion unit is displayed on the display unit 8.

  The camera 1 is provided with an MPU 10. The MPU 10 is a control unit that controls the entire camera 1 such as shooting and playback. The first AFE 4w, the second AFE 4t, the signal processing unit 5 and the like are controlled by the MPU 10.

  A ROM 7, an operation unit 16, a clock unit 14, and a position detection unit 15 are connected to the MPU 10. The ROM 7 is a non-volatile and recordable memory, for example, a flash ROM, and stores a control program for performing camera processing. Further, the operation unit 16 notifies the MPU 10 of the photographer's instruction. Switches 16a, 16b, and 16c are provided as representative examples of the operation unit 16, and their functions are, for example, a release, a mode switching instruction, and a power ON / OFF switch. The clock unit 14 is used for recording the shooting date and time, recording the exposure time and the shooting time of a moving image, and measuring a predetermined timing interval. The position detection unit 15 includes a GPS sensor, detects a captured position, and notifies the MPU 1 of position data. The detected shooting position is added to the image data and recorded in the memory 9.

  Further, the camera 1 is provided with a wireless transmission unit 11 and a print signal output unit 12. The wireless transmission unit 11 is an interface unit that wirelessly transmits image data to a printer or a PC (Personal Computer). The print signal output unit 12 is an interface unit that outputs captured image data to a connected printer. For example, it consists of USB (Universal Serial Bus).

  FIG. 2 is a diagram for explaining the main blocks for performing image shooting with different shooting ranges in the overall block diagram of FIG. A basic angle of view taken by the taking lens 2 and indicated by a broken line is the first angle of view θw. A subject image corresponding to the first angle of view θw is formed on the image sensor 3. A range captured by the imaging device 3 corresponding to the first angle of view θw is a first imaging range 3w. On the other hand, an angle of view narrower than the first angle of view θw and indicated by a solid line is the second angle of view θt. A range captured by the image sensor 3 corresponding to the second angle of view θt is a second imaging range 3t. The second imaging range 3t is a range narrower than the first imaging range 3w.

  Then, the first AFE 4w performs processing such as reading of pixels in the first imaging range 3w, AGC, A / D conversion, and the like. The second AFE 4t performs processing such as readout of pixels in the second imaging range 3t and AGCA / D conversion. Next, the signal processing unit 5 performs a predetermined image such as γ conversion or compression on the image data of the first imaging range 3w output from the first AFE 4w and the image data of the first imaging range 3t output from the second AFE 4t. Apply processing.

The image data of the first imaging range 3w subjected to the image processing is recorded in the memory 9 as the first image Dw. Further, the image data of the second imaging range 3t subjected to the image processing is recorded in the auxiliary memory 9b as the second image Dt. Thus, two moving images are recorded simultaneously. Note that whether or not to shoot the second image Dt in conjunction with the shooting of the first image Dw is a user's choice. And, of course, it is free to start or stop shooting the second image in the middle of shooting. The switching is executed by the MPU 10 based on the operation instruction.
In this sense, the MPU 10 is also a determination unit for determining whether to shoot a plurality of images. And according to the instruction | indication, the 1st image Dw and the 2nd image Dt are displayed on the display part 8 simultaneously. Of course, they may be displayed separately.

FIG. 3 is a diagram showing the timing of exposure (integration) to the image sensor 3 and reading of the image signal.
FIG. 3A sequentially shows the timing at which the charge is integrated in the image sensor 3. This is the period during which the high part is integrated. FIG. 3B shows a timing at which the first AFE 4w reads out signals (or charges) of pixels belonging to the first imaging range 3w for one frame from the imaging device 3. FIG. 3C similarly shows the timing at which the second AFE 4t reads out signals (or charges) of pixels belonging to the second imaging range 3t for one frame. Note that “integration” is referred to as the imaging element 3 accumulates incident light according to its brightness for a predetermined time and accumulates a photocurrent in a capacitor in the element. Also called “accumulation”.

  The image sensor 3 performs integration (exposure) for a predetermined time ((A) in the figure). The integration time is automatically set according to the brightness by an AE circuit not shown. After the integration is completed, the first AFE 4w reads out signals of pixels belonging to the first imaging range 3w for one frame ((B) in the figure). Then, after reading out the signals of the pixels in the first imaging range 3w, the second AFE 4t reads out the signals of the pixels belonging to the second imaging range 3t for one frame ((C) in the figure). The next integration (exposure) is performed after reading the signal of the second imaging range 3t ((A) in the figure). After this integration, reading of the first imaging range 3w (1 frame) and reading of the second imaging range 3t (1 frame) are executed. Then, a series of operations of reading once integration (exposure) twice is repeated.

  The signals read out in this way are recorded separately in the memory 9 after various processing as described in FIG. The signal in the first imaging range 3w is recorded in the memory 9 as the first image Dw, and the signal in the second imaging range 3t is recorded in the memory 9 as the second image Dt. Thereby, two moving images with different angles of view are recorded simultaneously. Note that the number of pixels read from the first imaging range 3a and the second imaging range 3b may be set to the same number of pixels. This is because display processing and the like when displaying two images on a monitor are simplified. The series of control processes is controlled by the MPU 10.

  FIG. 4 is a diagram for explaining an example of reproduction of two captured moving images. FIG. 4A shows a first image Dw that is an entire image on the left side, and a second image Dt that is a partial image of the entire image in a narrow range on the right side. During playback, the display size may be changed. FIG. 5A shows reproduction of the first image Dw and the second image Dt with the same size, while FIG. 5B shows the second image Dt on the right side with a size larger than the first image Dw. It is displayed. The display size changing process is performed by the signal processing unit 5 in accordance with an instruction.

  FIG. 5 is a diagram illustrating a change example of the position of the second imaging range 3t. In FIG. 2, the cutout position that is the second imaging range 3t is positioned at the center of the first imaging range 3w, but the present invention is not limited to this. In this example, the position of the second imaging range 3t is shifted upward as viewed in the figure. The change of the position of the second imaging range 3t is realized by the second AFE 4t changing the reading range of the imaging element 3.

  FIG. 6 is an example in which the position of the cutout portion (second imaging range 3t) is changed in this way during shooting. FIG. 6 is a monitor image at the time of photographing, and the left side of the screen is a first image Dw that is an entire image, and the right side is a second image Dt that is a cut-out image. In the first image Dw, a cursor frame 8c indicating the relative position and range of the second imaging range 3t with respect to the entire image is displayed in an overlapping manner. Here, the second imaging range 3t is set not to the center of the first imaging range 3w but to the left side of the first imaging range 3w.

  FIG. 7 shows the shooting when the second imaging range 3t (cutout portion) is changed during shooting. If the cutout part is suddenly changed during photographing, it becomes unnatural. Therefore, the whole picture is taken for a short time during switching, and then the cutout part is changed. FIG. 7A is a nita screen showing the captured images before and after changing the cutout portion. First, the cutout part 1 which is the cutout part before the change is recorded (photographed) as the second image Dt (A-1). When the photographer instructs to change the cutout, the image of the first imaging range 3w is recorded as the second image Dt for a short time, for example, 1 second without switching the screen immediately (A-2). That is, the same image as the first image Dw is recorded for a short time. After that, the cutout unit 2 corresponding to the change instruction is started to be recorded as the second image Dt (A-3). As described above, it is possible to prevent unnatural movement caused by switching the cutout portion during photographing.

  FIG. 7B is a flowchart showing a procedure for switching the captured image when changing the cutout portion (second image) described above. The second image Dt is taken within the designated range (step S51). It is determined whether or not the user has instructed to change the second image (cutout unit) (step S52). If there is no change operation (NO in step S52), the process proceeds to step S57, and the end operation is determined. If there is an end operation (YES in step S57), end processing is performed. If there is no end operation (step S57 NO), the process returns to step S51.

  On the other hand, when it is determined that there has been a change operation (YES in step S52), first, an image of an area including the two second images before and after the change is taken for a short time. For example, as shown in FIG. A-2, the first image Dw that is the entire image may be taken. Moreover, since the image before and after a change should just be included, an area smaller than the whole image may be sufficient. Further, when shooting this small area, the second imaging unit may shoot. Then, an image of this area is taken for a predetermined time (for example, 1 second). It is determined whether a predetermined time has elapsed (step S54), and when the predetermined time has elapsed (YES in step S54), the imaging area is switched to the newly changed area as the second image Dt. Then, shooting of a new area is started. At the same time, the setting of the second image area is changed to a new area (step S56). Then, the process returns to step S51.

  As described above, even if the position of the second image is greatly changed, the images before and after the change are once taken, so that even a first-time viewer does not lose sight of where the screen flew from. Less confused.

FIG. 8 is a flowchart 1 showing the photographing / reproducing process of the camera 1, and FIG. 9 is a flowchart 2 of the flowchart. This process is mainly executed by the MPU 10 according to a program.
First, the set current camera mode is determined (step S1). If it is determined that the playback mode has been set (YES in step S1), the process proceeds to step S31 in FIG. In step S31 and subsequent steps, a step of accepting the user's image selection is executed.

  On the other hand, if it is determined that the shooting mode is set instead of the playback mode (NO in step S1), the shooting process after step S2 is executed. First, the time is counted to measure the time (step S2). This is because the time data is recorded together with each image when shooting two moving images.

  First, the first image Dw is displayed on the display unit 8 as a monitor image (step S3). An image signal is read from the image sensor 3 in real time by the first AFE 4w, and signal processing is performed by the signal processing unit 5 to form a first image Dw. The formed first image Dw is displayed on the display unit 8.

  Next, the cut-out position of the second image Dt is set according to the photographer's instruction (step S4). FIG. 10 is a diagram illustrating a cutting position setting operation by the photographer. FIG. 10A is a view showing the rear appearance of the camera 1. A display unit 8 is provided on the rear left side of the camera 1. A zoom lens operation button 16-1, a shooting range setting button 16-2, and an XY operation button 16-3 are arranged on the right side of the rear surface. Further, a cursor 8c indicating the range of the second image Dt is displayed on the screen of the display unit 8. When the photographing range setting button 16-2 is pressed, the cursor 8c is displayed on the display unit 8. The position of the second image Dt is set by operating the XY operation button 16-3. For example, when the pressing of the left button 16-3L, which is one of the XY operation buttons 16-3, is detected, the cursor 8c is moved to the left by a predetermined amount (FIG. (B)). The zoom lens operation button 16-1 is used for the zoom control operation of the normal photographing lens. At this time, the zoom lens operation button 16-1 serves as an operation unit for setting the enlargement / reduction of the size of the second image 8T (FIG. (C)). Then, after the size and position of the second image Dt are set, when the pressing of the shooting range setting button 16-2 is detected again, the size and position of the second image Dt in that state are determined. The size and position of the second image Dt are determined by the operation as described above.

  Returning to FIG. After setting the cutout position, the camera waits for a release operation by the photographer (step S5), and goes to step S4. If it is determined that a release operation has been performed (step S5 YES), it is then determined whether or not the user has instructed the second image shooting (step S6). If the second image capturing instruction has not been given (step S6 NO), the process jumps to step S10. If the instruction to shoot the second image has been given (step S6 YES), the image signal of the second image range 3t is read from the image sensor 3 by the second AFE 4t. Whether to shoot only the first image or both the first and second images is determined according to the user's operation. The MPU 10 corresponds to the determination unit.

  Then, N pixels are read from the read image signal (step S7). The read image is input to the signal processing unit 5 (step S8). Image processing of the image read by the signal processing unit 5 is performed. The image processed image data is recorded in the auxiliary memory 9b as the second image Dt together with the photographing time (step S9). In addition, a signal indicating the presence of the second image is also recorded (step S10).

  Similarly, an image signal in the first image range 3w is read from the image sensor 3 by the first AFE 4w. N pixels are read out (step S11). The read image is input to the signal processing unit 5 (step S12). The signal processing unit 5 is caused to perform image processing on the read image. Image-processed image data is recorded in the memory 9 as the first image Dw together with the shooting time (step S13). Thereafter, it is determined whether or not there is an instruction to end photographing (step S14). When there is no instruction to end shooting (NO in step S14), the process proceeds to step S21 to continue shooting. If there is an instruction to end shooting (YES in step S14), an end process is executed (step S15), and the process ends.

  On the other hand, in step S21, it is determined whether or not there is an instruction to change the cutout part (second image Dt) during shooting by the photographer. When there is a change instruction (step S21 YES), the setting is changed accordingly. The change operation is the same as that described with reference to FIG. Then, the end of the change setting of the cut-out portion is determined (step S22), and the process proceeds to step S10 until the end (step S22 NO). Since the second image Dt in the middle of the changing operation is a disordered image, only the first image Dw is recorded without recording the second image Dt until the end. When this change is finished (YES in step S22), the process proceeds to step S6, and recording of the second image Dt is started. However, during the change, not only the first image Dw but also the second image Dt before the change may be continuously recorded. This is because it is sufficient not to record a disordered image.

  If the photographer wants to shoot not only a moving image but also a still image during shooting, still image shooting is also possible. When there is no change operation of the cutout part (second image Dt) (NO in step S21), it is determined whether or not there is an instruction for still image shooting (step S23). When there is an instruction to shoot a still image (YES at step S23), N1 pixels, which are larger than N at the time of moving image shooting, are taken out from the image sensor (step S24). Here, a still image is taken instead of the second image Dt. This image data is recorded in the memory 9 together with the photographing time (step S25). Further, since still image shooting is performed instead of shooting the second image Dt, the process proceeds to step S10 during still image shooting (YES in step S26), and the first image Dw shooting is performed. If the still image shooting process is completed (NO in step S26), the process proceeds to step S21. The original imaging for obtaining the first image Dw and the second image Dt is restored. Since the number of recorded pixels is increased during still image shooting, the image quality at the time of printing can be ensured.

  Next, the reproduction process after the end of shooting will be described with reference to FIGS. FIG. 11 is a part of the camera block diagram of FIG. 1 and is a block diagram relating to the playback function. The signal processing unit 5 includes a CPU 5b, a separation unit 5c, a video decoder 5d, an audio decoder 5e, and a superimpose unit 5f. The CPU 5b communicates with the MPU 10 and controls the signal processing unit. The separation unit 5c separates audio data and image data included in the same file. The video decoder 5d converts the separated image data into an analog signal in a form suitable for display on the display unit 8. The audio decoder 5 e converts the separated audio data into a signal that can be output to the speaker 13. The superimposing unit 5f superimposes information indicating that there is a sub-image described later on the image displayed on the display unit 8.

  One of the files in the memory 9 is a file 9b. The file 9b has a main area and a user area. The main area is composed of separated data, first image data, audio data, and incidental data. In the incidental data, the presence or absence of the second image data corresponding to the first image data is recorded. The user area contains second image data which is data copied from the auxiliary memory 9a to the file 9b.

  A process for reproducing a plurality of images will be described with reference to this block diagram. The image processing unit 5 reproduces the data of the image file 9b. The CPU 5b looks at the contents of the separated data and instructs the separating unit 5d which data in the file forms the first image. In accordance with the instruction, the separator uses the video decoder 5d and the audio decoder 5e to reproduce them. At this time, the CPU 5b reads the incidental data separately from the image by the separation unit 5c. The CPU 5b determines whether there is a second image taken at the same timing as the first image based on the accompanying data.

  FIG. 12 is an example of a screen on which the second image is displayed when the second image exists. First, the superimposing unit 5f displays, for example, as 8d that there is a second image (sub-image) superimposed on the sequentially displayed images (A-2). When the user wants to know the sub-image range, the frame 8c may be displayed to indicate which part is enlarged and displayed according to the user's operation. It is assumed that the user sees this and performs the second image display operation. The second image (sub-image) is read out from the user area, changed to the first image, and the second image is reproduced (A-3, 4).

  The reproduction process will be described with reference to FIG. Steps S31 to S37 in FIG. 9 are the procedure of the reproduction process. An image designated by the user is selected as a reproduced image (step S31). The reproduction of the first image Dw, which is the image selected by the user, is started (step S32). The selected first image Dw is read from the memory 9 and expanded and reproduced on the display unit 8.

  Here, it is determined whether another moving image taken at the same time as the feature of the present invention, that is, the second image Dt exists in the auxiliary memory 9b (step S33). If there is a second image Dt corresponding to the first image currently being reproduced (step S33 YES), the process proceeds to step S34. Here, instead of immediately displaying the second image, the fact that the second image exists is displayed (step S34). It is a display like 8d shown by A-2 of FIG. If there is no corresponding second image Dt (NO in step S33), the process proceeds to step S41.

  Then, it is determined whether or not the user has performed an operation for confirming the range of the second image (step S35). If a confirmation operation is performed (YES in step S35), the range of the second image is specified by being superimposed on the first image (step S36). It is a display like the frame 8c shown by A-2 in FIG.

  Subsequently, it is determined whether or not the user has performed an image switching operation (step S37). If there is a switching operation (YES in step S37), the second image Dt is also started to be reproduced simultaneously (step S38). The corresponding second image Dt is read from the memory 9b, decompressed, and reproduced on the display unit 8. The first image Dw and the second image Dt are displayed side by side on the display unit 8 as shown in FIG. Then, it is determined whether or not there is an instruction to change the image reproduction area (step S39). As shown in FIG. 4B, if there is a change instruction (YES in step S39), the size is changed and reproduction is performed (step S40). In a camera provided with a touch panel on the display unit 8, the display position and size may be changed by a touch operation. Thereafter, the reproduction end instruction is determined (step S41), and the process returns to step S33 until the end instruction is received (step S41 NO). If there is no switching operation (NO in step S37), the process jumps to step S41. If a reproduction end instruction is detected (YES in step S41), end processing is performed. In the above flowchart, the second image Dt is displayed together with the first image Dw when displayed. However, as shown in FIG. 12, the second image Dt may be displayed alone.

  Next, a method for calculating each pixel of the first image Dw and the first image Dt will be described. FIG. 13 is a diagram illustrating the relationship between the pixels of the first image Dw and the second image Dt. Hereinafter, one pixel of the first image Dw is denoted by Pw, and one pixel of the second image Dt is denoted by Pt. In this example, one pixel Pw of the first image Dw corresponds to four pixels of one pixel Pt of the second image Dt, and one pixel Pt of the second image Dt is composed of 16 pixels of the image sensor. And That is, one pixel Pw of the first image Dw is composed of 64 pixels of the image sensor. Of course, this is only an example, and the ratio is not limited to this.

  FIG. 6A is a diagram schematically showing the entire pixel area of the first imaging range 3w of the first image Dw. FIG. 5B is an enlarged view of the one pixel Pw1 region of the first image Dw. FIG. 4C is an enlarged view of the region Pw1 in FIG.

  m1 is the number of pixels in the horizontal direction of the first image Dw, and n1 is the number of pixels in the vertical direction of the first image Dw ((A) in the figure). Similarly, m2 is the number of pixels in the horizontal direction of the second image Dt, and n2 is the number of pixels in the vertical direction of the first image Dt. The first image Dw and the second image Dt are composed of N identical pixels. That is, m1 × n1 = m2 × n2 (= N).

  FIG. 5B shows the configuration of the pixel Pw1, which is one of the pixels Pw. As described above, the pixel Pw is composed of four pixels Pt (Pt1, Pt2, Pt3, Pt4). The pixel Pt1 is composed of four units, that is, a total of 16 pixels, with a total of four pixels of R pixel (red), B pixel (blue), and two G pixels (green) as one unit. Here, the R pixel, the G pixel, and the B pixel are pixels of the image sensor. The other pixels Pt2, Pt3, and Pt4 are configured similarly to Pt1. Further, FIG. 3C shows in detail the pixels of the image sensor that constitutes Pt1. The other Pt has the same configuration as Pt1. Pt1 in the upper left area is composed of a total of 16 pixels: 4 R pixels (red), 4 B pixels (blue), and 8 G pixels (green).

  The calculation formula of the pixel of the 1st image Dw and the 2nd image Dt which were comprised in this way is shown. In the following, in order to explain with red as a representative, only the R pixel is numbered. Here, the calculation formula differs depending on whether or not the type of the image sensor is a non-destructive readout type. When the imaging device 3 to be used is a type capable of nondestructive readout, the pixel signal can be read out a plurality of times, so that information on the same pixel can be read out in the first image Dw and the second image Dt, respectively. On the other hand, in the case of a type in which non-destructive reading is not possible, the pixel signal can be read only once, so that the same pixel information cannot be shared between the first image Dw and the second image Dt. A typical example of a non-destructive readout type image sensor is a CMOS. A representative example of a type of image sensor that cannot perform nondestructive readout is a CCD.

First, the calculation formula when the imaging device 3 to be used is a nondestructive readout type will be described.
Pt1 includes R11, R12, R13, and R14 as red components (FIG. (C)). Therefore, let Pt1r be the red component of Pt1,

[Equation 1]
Pt1r = (R11 + R12 + R13 + R14) / 4
And That is, the average of four pixels is set as the value of Pt1r.
In addition, there are a total of 16 red components (R11 to R14), (R21 to R24), (R31 to R34), and (R41 to R44) as red components (FIG. C). Let Pw1r be the red component of

[Equation 2]
Pw1r = (R11 + R12 + R13 + R14 + R21 + R22 + R23 + R24 + R31 + R32 + R33 + R34 + R41 + R42 + R43 + R44) / 16
And That is, the average of 16 pixels is set as the value of Pw1r.

Next, a calculation formula when the imaging device 3 to be used is of a type when non-destructive reading is not possible will be described.
The red component Pt1r of Pt1 is

[Equation 3]
Pr1r = R11
And Use only R11. This is because R12, R13, and R14 are used in the following Pw.
Similarly, the red component Pw1r of Pw1 is

[Equation 4]
Pw1r = (R12 + R13 + R14 + R22 + R23 + R24 + R32 + R33 + R34 + R42 + R43 + R44) / 12
And This is because R11 and R21 cannot be used.
For the G and B pixels other than R (red), signals of each pixel of the first image Dw and the second image Dt are calculated using the same calculation formula.

  Next, readout of the nondestructive readout image sensor will be briefly described. FIG. 14 shows a circuit of a CMOS type image sensor. A portion surrounded by a broken line corresponds to one pixel. The operation will be briefly described with this pixel as a representative. The other pixels have the same configuration.

  The transmission Tr 44 is turned off, and a charge corresponding to light is accumulated in a capacitor parallel to the photodiode 41. The period during which charges are accumulated is the integration time. After the integration, when the reset Tr 45 is turned off from on and the transmission Tr 44 is turned on, a voltage according to the integration time and the amount of light is input to the amplification Tr 42 and an amplified output is generated.

  This is input to the sample hold circuit (S / H) 46 to hold the output value. An image signal for one pixel is output from the S / H circuit 46 to the averaging processing unit 47. Then, the averaging processing unit 47 adds the image signals of this pixel and another pixel and performs an averaging process. The averaging process follows the above formulas 1 and 2. Thereby, the pixel signals of the first image Dw and the second image Dt are calculated. The averaging process is performed by the first AFE 4w and the second AFE 4t, respectively. Alternatively, the sum of the output levels of the photodiodes may be divided by the number of pixels and averaged. On the other hand, since a circuit without a sample hold circuit (S / H) cannot hold an output value, Expressions 3 and 4 may be used.

  As described above, with the camera according to the first embodiment, one scene can be photographed simultaneously with the whole and a part of two angles of view, so that a moving image can be photographed with changes. Furthermore, since the shooting range of the second image can be switched during shooting, it is possible to view images with changes. In other words, it is possible to shoot images with changes as if taken by two cameras, and to record images that never get tired. In addition, it is possible to shoot still images in the middle, and shoot in consideration of fine points so that image disturbance is less likely to occur when the shooting area of the second image is switched. In addition, since the first image Dw that is the entire image and the second image Dt that is a part of the image can be reproduced side by side at the same time, the viewer can appreciate the image of the favorite one.

(Second Embodiment)
The second embodiment will be described with reference to FIGS. 15 and 16. In the camera 1 of the first embodiment, two images having different angles of view were obtained by sharing the lens 2 of the optical system and switching the effective area of the image sensor 3. On the other hand, in the second embodiment, two images are obtained by different optical systems.

FIG. 15A is a diagram showing an outline of an imaging system block of the camera 1 to which the second embodiment is applied.
Since other than the imaging system is the same as the first embodiment, the description thereof is omitted.

  The camera 1 includes both a wide-angle lens 52w that captures a wide range and a narrow-angle lens 52t that captures a narrow range. Both lenses are lenses having different focal lengths, the wide-angle lens 52w is a short-focus lens, and the narrow-angle lens 52t is a long-focus optical system. The wide-angle lens 52w and the narrow-angle lens 52t are arranged so that the two images are formed in different areas of the image sensor 53. That is, the first imaging range 53w by the lens 52w and the second imaging range 53t by the lens 52t are at different positions on the imaging element.

  Further, the camera 1 is provided with an image sensor 53, an AFE (analog front end) 54, and a signal processing unit 55. Then, the AFE 54 performs predetermined processing on the two images formed by the imaging element 53 separately for the image signals in the first imaging range 53w and the second imaging range 53t. Further, the signal processing unit 5 performs image processing such as compression on the image data of the first image Dw and the second image Dt output from the AFE 54. Then, the first image Dw and the second image Dt that have been subjected to compression or the like are recorded in a memory 9 (not shown).

  FIG. 15B shows the sizes of two images recorded as the first image Dw and the second image Dt. A wide range image Dw and a narrow range image dt which is a part of the wide range are photographed and recorded. Moving images of these two images can also be achieved by using a separate optical system.

  FIG. 16 is an example in which another camera of the second embodiment adopts an optical system different from FIG. 15 as the optical system. The optical system of the camera 1 includes a wide-angle lens 62w, a narrow-angle lens 62t, a mirror 62m, and a prism mirror 62p. Both lenses are lenses having different focal lengths, the wide-angle lens 52w is a short-focus lens, and the narrow-angle lens 52t is a long-focus optical system. In addition, the camera 1 is provided with an AFE (analog front end) 64 and a signal processing unit 65.

  A set of the wide-angle lens 62w and the mirror 62m, and a set of the narrow-angle lens 62t and the mirror 62 are arranged substantially on the target with the prism mirror 62 interposed therebetween. One subject light beam that has passed through the wide-angle lens 62w and reflected by the mirror 62m is reflected by one side of the prism mirror 62 and enters the upper region of the image sensor 63 (see this figure). On the other hand, another subject light that has passed through the narrow-angle lens 62t and reflected by the mirror 62m is reflected by another side of the prism mirror 62 and enters the lower region (see this figure) of the image sensor 63. . As a result, images with different angles of view are formed in different areas of one image sensor 63. In the AFE 64, predetermined processing such as A / D conversion is performed on the two images formed by the imaging element 63 separately from the image signals in the first imaging range 63w and the second imaging range 63t. In the signal processing unit 65, image processing such as compression is performed, and the first image Dw and the second image Dt are recorded in the memory 9 (not shown), respectively.

  As described above, in the second embodiment, two moving image images can be obtained by simple image sensor control. Also in this example, it is possible to perform shooting and viewing with a change, not a monotonous screen like a conventional movie. Of course, with this configuration, the size and position of the second image described in FIG. 10 may be switched.

  As described above, according to the first and second embodiments, a plurality of high-quality images can be obtained by performing reading by thinning or reading only a specific portion of an image while effectively using the abundant image data of the image sensor. Since simultaneous recording is performed, it is not necessary to prepare a large number of cameras as in the past, and it is possible to provide a camera that can acquire a changed image with a single unit. Also, a moving image has restrictions on the reproduction side such as TV, and an excessive number of pixels tends to be wasted. However, according to the present invention, a huge pixel output can be read at high speed.

  Further, part or all of the processing of the MPU 10 described in the above embodiments may be configured by hardware. The specific configuration is a design matter. Each control process by the MPU 10 is realized by a software program stored in the ROM 7 being supplied to the MPU 10 and operating according to the supplied program. Therefore, the software program itself realizes the functions of the MPU 10, and the program itself constitutes the present invention. A recording medium for storing the program also constitutes the present invention. As a recording medium, besides a flash memory, an optical recording medium such as a CD-ROM or DVD, a magnetic recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used.

  Furthermore, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

1 is an overall block diagram of a digital camera to which the present invention is applied in a first embodiment. The figure explaining the whole block which image-shoots from which an imaging range differs in 1st Embodiment. The figure which shows the timing of integration to the image pick-up element 3, and the reading-out in 1st Embodiment. The figure explaining the example of reproduction | regeneration of two image | videos image | photographed in 1st Embodiment. The figure which shows the example of a change of the position of the 2nd imaging range 3t in 1st Embodiment. The figure which shows the example which changed the position of the cutout part in 1st Embodiment. The figure which shows the example of 2nd imaging range 3t (cutout part) change in the middle of imaging | photography in 1st Embodiment. The flowchart 1 which shows the imaging | photography reproduction | regeneration processing of the camera 1 in 1st Embodiment. FIG. 3 is a flowchart 2 illustrating a shooting / playback process of the camera 1 in the first embodiment. FIG. 6 is a diagram illustrating a cut-out position setting operation by a photographer in the first embodiment. The partial block diagram for demonstrating the function regarding reproduction | regeneration in 1st Embodiment. The figure which shows the example of a screen display at the time of reproduction | regeneration in 1st Embodiment. The figure explaining the relationship of the pixel of the 1st image Dw and the 2nd image Dt in 1st Embodiment. FIG. 3 is a circuit diagram of a CMOS type image sensor in the first embodiment. FIG. 10 is a main block diagram of a camera centering on an optical system in a second embodiment. FIG. 10 is a main block diagram of a camera that employs another optical system in the second embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Camera, 2 ... Lens, 3 ... Imaging device, 3w ... 1st imaging range, 3t ... 2nd imaging range, 4 ... Analog front end (AFE) part, 4w ... 1st AFE, 4t ... 2nd AFE, 5 ... Signal Processing section,
5a ... auxiliary block, 5b ... CPU, 5c ... separation unit, 5d ... video decoder, 5e ... audio decoder,
5f ... Superimpose, 6 ... RAM,
7 ... ROM, 8 ... display unit, 8c ... cursor frame, 9 ... memory, 9a ... auxiliary memory, 9b ... file 10 ... MPU, 11 ... wireless transmission, 12 ... print signal output unit, 13 ... speaker, 14 ... clock unit ,
15 ... Position part, 16, 16a, 16b, 16c ... Operation part, 16-1 ... Zoom operation button,
16-2 ... Shooting range setting button, 16-3 ... XY operation button, 16-3L ... Left button,
20 ... Subject,
41 ... photodiode, 42 ... amplifying transistor, 43 ... load transistor,
44 ... Transmission transistor, 45 ... Reset transistor, 46 ... Sample hold unit (S / H),
47 ... Averaging unit 52w ... Wide angle lens, 52t ... Narrow angle lens, 53 ... Image sensor, 54 ... Analog front end (AFE) unit, 55 ... Signal processing unit,
62w ... Wide-angle lens, 62t ... Narrow-angle lens, 62m ... Mirror, 62p ... Prism mirror, 63 ... Image sensor, 64 ... Analog front end (AFE) part, 65 ... Signal processing part,
e ... Arrow,
θw: first angle of view, θt: second angle of view, Dw: first image, Dt: second image, Pw: one pixel of the first image, Pt: one pixel of the second image, N: number of pixels

Claims (13)

An imaging unit that forms an image based on a plurality of subject images that include the same subject and that target different regions of the imaging element;
A determination unit that determines whether the imaging unit forms the plurality of images or only one image;
A controller that records in the memory as a plurality of moving images or still images obtained by simultaneously capturing the plurality of images formed by the imaging unit when the imaging unit is determined to form the plurality of images. A camera characterized by that. The camera according to claim 1, wherein the plurality of subject images are subject images captured at different angles of view. The camera according to claim 2, wherein the imaging unit obtains a subject image captured at the different angle of view by changing a size of a readout region from the imaging device. In order to form a subject image on the image sensor at different angles of view, equipped with multiple lenses with different focal lengths,
The camera according to claim 2. The imaging unit forms both a frame image related to the first moving image and a frame image related to the second moving image from a signal obtained by one exposure of the image sensor as a subject image captured at different angles of view. The camera according to claim 2, wherein: An image sensor that outputs an image signal;
A first imaging unit that reads an image from the first imaging range of the imaging element;
A second imaging unit that reads an image from a second imaging range having a different size from the first imaging range of the imaging element;
A determination unit that determines whether to read from only the first imaging unit or to read an image from both the first imaging unit and the second imaging unit;
When it is determined that both the first image pickup unit and the second image pickup unit read out images, the first image pickup unit and the second image pickup unit repeatedly read out images twice for each exposure of the image pickup device. A control unit that records a first image based on the image read by the first imaging unit and a second image based on the image read by the second imaging unit in the memory as two moving images, respectively. Camera characterized by. The camera according to claim 6, wherein the first imaging unit and the second imaging unit read signals from the same exposure of the same pixel of the imaging device. The camera according to claim 6, wherein the first image and the second image have substantially the same number of pixels. The camera according to claim 6, wherein the first imaging range is a range including a second imaging range. The camera according to claim 9, wherein the second imaging unit changes a position or a size of the second imaging range in accordance with an instruction. For a single exposure to the image sensor, a read operation that selectively changes the size of the read range from the image sensor is performed a plurality of times to obtain a plurality of images in a single exposure, and this operation is repeated. In a method for determining a camera including a control unit that records a plurality of moving images having different readout ranges,
A method for determining a camera, comprising: determining whether to record the plurality of images or only one image based on an instruction from a photographer. An image sensor that outputs an image signal;
A first imaging unit that reads an image from the first imaging range of the imaging element;
A second imaging unit that reads an image from a second imaging range having a different size from the first imaging range of the imaging element;
A control unit for controlling the first imaging unit and the second imaging unit;
When there is an instruction to change the second imaging range, the control unit causes the first imaging unit or the second imaging unit to capture an image of an area including the area before the second imaging range change and the area after the change. Then, the camera is controlled to cause the second imaging unit to take an image of the changed second imaging range. A first imaging unit that reads an image from the first imaging range of the imaging device, a second imaging unit that reads an image from a second imaging range having a size different from the first imaging range, the first imaging unit, and the second imaging In a camera control method comprising a control unit for controlling the unit,
When there is an instruction to change the second imaging range, the first imaging unit or the second imaging unit is caused to capture an image of an area including the area before the second imaging range change and the area after the change. A control method for a camera, wherein the second imaging range is controlled to be photographed by the second imaging unit.

Images