JP2014027631A - Electronic camera - Google Patents

Abstract

PROBLEM TO BE SOLVED: To diversify image data generated in parallel.SOLUTION: An image sensor 16 includes an imaging face on which an optical image is radiated. The imaging face is repetitively exposed with an exposure pulse generation circuit 18p1 arranged in a driver 18c. Raw image data in response to an electric charge generated by exposure is repetitively outputted from the image sensor 16 by an electric charge reading pulse generation circuit 18p2 disposed in the driver 18c. A CPU 26 repeats processing for setting an exposure value of the imaging face to a value of K-pieces (K:integer of 2 or more) in a predetermined order. Processing for classifying the image data in a YUV form in response to output of the image sensor 16 into K-pieces of groups in the predetermined order is repeated.

Description

  The present invention relates to an electronic camera, and more particularly to an electronic camera that performs repeated exposure.

  An example of this type of camera is disclosed in Patent Document 1. According to this background art, imaging with a short exposure time and imaging with a long exposure time are alternately performed, and the obtained plurality of image data are recorded as one image file. During movie playback, frame image data B captured with a long exposure time is sequentially played back and displayed. While movie playback is paused, frame image data A captured with a short exposure time is displayed as a still image. Displayed continuously.

JP 2011-55524 A

  However, in the background art, there is a possibility that the brightness of image data captured with a short exposure time and image data captured with a long exposure time may not be appropriate. In such a case, the use of these image data is limited. It is done. For this reason, there exists a possibility that the electronic image produced using these image data may become uniform.

  Therefore, a main object of the present invention is to provide an electronic camera capable of diversifying electronic images created in parallel.

  An electronic camera according to the present invention (10: reference numeral corresponding to the embodiment; the same applies hereinafter) includes an imaging means (16) having an imaging surface on which an optical image is irradiated, an exposure means (18p1) for repeatedly exposing the imaging surface, and an exposure An output unit (18p2) that repeatedly outputs an electronic image generated on the imaging surface by the processing of the unit, and an adjustment that repeatedly sets the exposure amount of the exposure unit to K values (K: an integer of 2 or more) in a predetermined order Means (S49, S71, S79, S87) and classification means (S173 to S183, S207 to S217) for repeating the process of classifying the electronic images output by the output means into K groups in a predetermined order.

  Preferably, a calculation means (S23) for calculating an appropriate exposure amount based on the electronic image output from the output means is further provided, and the adjustment means is an exposure amount of the exposure means based on the exposure amount calculated by the calculation means. Set.

  Preferably, a first creation means (S161 to S165, S187 to S191) for creating a moving image file using the electronic images classified by the classification means is further provided.

  Preferably, a second creation means (S201 to S205, S223 to S227) for creating a wide-angle image file using the electronic images classified by the classification means is further provided.

  Preferably, search means (S107) for searching for a specific object image from the electronic image output from the output means, and change means (S17, S169) for changing the imaging condition of the imaging means based on the search result of the search means are further provided. Provided.

  An imaging control program according to the present invention includes an imaging unit (16) having an imaging surface on which an optical image is irradiated, an exposure unit (18p1) that repeatedly exposes the imaging surface, and an electronic image generated on the imaging surface by processing of the exposure unit The process of setting the exposure amount of the exposure means to K values (K: an integer of 2 or more) in a predetermined order is repeated in the processor (26) of the electronic camera (10) having the output means (18p2) To execute an adjustment step (S49, S71, S79, S87) and a classification step (S173 to S183, S207 to S217) for repeating the process of classifying the electronic images output by the output means into K groups in a predetermined order This is an imaging control program.

  An imaging control method according to the present invention includes an imaging unit (16) having an imaging surface on which an optical image is irradiated, an exposure unit (18p1) that repeatedly exposes the imaging surface, and an electronic image generated on the imaging surface by processing of the exposure unit Is an imaging control method executed by an electronic camera (10) equipped with output means (18p2) that repeatedly outputs the exposure amount, and sets the exposure amount of the exposure means to K values (K: an integer of 2 or more) in a predetermined order. Adjustment steps (S49, S71, S79, S87) for repeating the processing to be performed, and classification steps (S173 to S183, S207 to S217) for repeating the processing for classifying the electronic images output by the output means into K groups in a predetermined order Is provided.

  The external control program according to the present invention includes an imaging means (16) having an imaging surface on which an optical image is irradiated, an exposure means (18p1) that repeatedly exposes the imaging surface, and an electronic image generated on the imaging surface by the processing of the exposure means. An external control program supplied to an electronic camera (10) comprising an output means (18p2) that repeatedly outputs and a processor (26) that executes processing according to an internal control program stored in a memory (44), the exposure means Adjustment step (S49, S71, S79, S87) that repeats the process of setting the exposure amount to K values in a predetermined order (K: an integer of 2 or more), and the electronic image output by the output means in the predetermined order An external control program for causing a processor to execute a classification step (S173 to S183, S207 to S217) that repeats the process of classifying into K groups in cooperation with the internal control program.

  An electronic camera (10) according to the present invention includes an imaging means (16) having an imaging surface on which an optical image is irradiated, an exposure means (18p1) that repeatedly exposes the imaging surface, and an electron generated on the imaging surface by the processing of the exposure means. Executes processing according to the output means (18p2) for repeatedly outputting images, the fetch means (60) for fetching an external control program, and the external control program fetched by the fetch means and the internal control program stored in the memory (44) An electronic camera provided with a processor (26), wherein the external control program repeats an adjustment step (S49, S71) for repeating the process of setting the exposure amount of the exposure means to K values (K: an integer of 2 or more) in a predetermined order. , S79, S87), and a classification step (S173 to S183, S207 to S217) for repeating the process of classifying the electronic images output by the output means into K groups in a predetermined order are defined as an internal control program Corresponding to the program to be executed by work.

  The exposure amount on the imaging surface is set to K values in a predetermined order, and the electronic images output from the imaging means are classified into K groups in the predetermined order. Such exposure setting and image classification are repeatedly executed. The classified electronic images of each group are images that represent a common scene with different brightness. This makes it possible to diversify electronic images created in parallel.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

It is a block diagram which shows the basic composition of one Example of this invention. It is a block diagram which shows the structure of one Example of this invention. FIG. 3 is an illustrative view showing one example of a mapping state of an SDRAM applied to the embodiment in FIG. 2; It is an illustration figure which shows an example of the allocation state of the evaluation area in an imaging surface. FIG. 3 is an illustrative view showing one example of a configuration of a register referred to in the embodiment in FIG. 2; It is an illustration figure which shows an example of the face detection frame used in a face detection process. It is an illustration figure which shows an example of a structure of the face dictionary referred in a face detection process. FIG. 10 is an illustrative view showing one example of a configuration of another register referred to in the embodiment in FIG. 2; FIG. 10 is an illustrative view showing one example of a configuration of another register referred to in the embodiment in FIG. 2; It is an illustration figure which shows a part of face detection process. It is an illustration figure which shows a part of person object AF process. FIG. 3 is a timing chart showing a part of the process in the embodiment in FIG. 2; FIG. 9 is a timing diagram showing another part of the process of the embodiment in FIG. 2; FIG. 3 is a timing diagram showing another part of the processing of the embodiment in FIG. 2; FIG. 10 is a timing diagram showing still another portion of the processing in the embodiment in FIG. 2; FIG. 3 is an illustrative view showing one example of a moving image file created in the embodiment in FIG. 2; FIG. 3 is an illustrative view showing one example of a panoramic image file created in the embodiment in FIG. 2; It is a flowchart which shows a part of operation | movement of CPU applied to the FIG. 2 Example. It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a block diagram which shows the structure of the other Example of this invention.

Embodiments of the present invention will be described below with reference to the drawings.
[Basic configuration]

  Referring to FIG. 1, the electronic camera of this embodiment is basically configured as follows. The imaging means 1 has an imaging surface on which an optical image is irradiated. The exposure unit 2 repeatedly exposes the imaging surface. The output unit 3 repeatedly outputs an electronic image generated on the imaging surface by the processing of the exposure unit 2. The adjustment unit 4 repeats the process of setting the exposure amount of the exposure unit 2 to K values (K: an integer equal to or greater than 2) in a predetermined order. The classification unit 5 repeats the process of classifying the electronic images output by the output unit 3 into K groups in a predetermined order.

The exposure amount on the imaging surface is set to K values in a predetermined order, and the electronic images output from the imaging means 1 are classified into K groups in the predetermined order. Such exposure setting and image classification are repeatedly executed. The classified electronic images of each group are images that represent a common scene with different brightness. This makes it possible to diversify electronic images created in parallel.
[Example]

  Referring to FIG. 2, the digital camera 10 of this embodiment includes a focus lens 12 and an aperture unit 14 driven by drivers 18a and 18b, respectively. The optical image of the scene that has passed through these members is irradiated onto the imaging surface of the image sensor 16 and subjected to photoelectric conversion. As a result, a charge representing the scene is generated.

  When the power is turned on, the CPU 26 activates the exposure control task and the face detection task under the bracket imaging task. Next, the CPU 26 instructs the driver 18c to repeat the exposure operation and the charge reading operation under the exposure control task in order to execute the moving image capturing process. In response to a vertical synchronization signal Vsync periodically generated from an SG (Signal Generator) (not shown), the driver 18c exposes the imaging surface and reads out the charges generated on the imaging surface in a raster scanning manner.

  Here, the exposure operation is particularly performed by the exposure pulse generation circuit 18p1, and the charge readout operation is performed by the charge readout pulse generation circuit 18p2. From the image sensor 16, raw image data based on the read charges is periodically output. The CPU 26 also arranges the focus lens 12 at the pan focus position, which is the initial setting position, under the bracket imaging task.

  The preprocessing circuit 20 performs processing such as digital clamping, pixel defect correction, and gain control on the raw image data output from the image sensor 16. The raw image data subjected to these processes is written into the raw image area 32a (see FIG. 3) of the SDRAM 32 through the memory control circuit 30.

  The post-processing circuit 34 reads the raw image data stored in the raw image area 32a through the memory control circuit 30, and performs color separation processing, white balance adjustment processing, and YUV conversion processing on the read raw image data. As a result, YUV image data is created, and the created YUV image data is written into the YUV image area 32b (see FIG. 3) of the SDRAM 32 through the memory control circuit 30.

  The post-processing circuit 34 further performs display zoom processing and search zoom processing in parallel on the image data in the YUV format. As a result, display image data and search image data conforming to the YUV format are individually created. The display image data is written into the display image area 32c (see FIG. 3) of the SDRAM 32 by the memory control circuit 30. The search image data is written into the search image area 32d (see FIG. 3) of the SDRAM 32 by the memory control circuit 30.

  The LCD driver 36 repeatedly reads the display image data stored in the display image area 32c through the memory control circuit 30, and drives the LCD monitor 38 based on the read image data. As a result, a real-time moving image (through image) representing the scene is displayed on the LCD monitor 38.

  Referring to FIG. 4, an evaluation area EVA is assigned to the center of the imaging surface. The evaluation area EVA is divided into 16 in each of the horizontal direction and the vertical direction, and 256 divided areas form the evaluation area EVA. In addition to the above-described processing, the preprocessing circuit 20 shown in FIG. 2 executes simple RGB conversion processing that simply converts raw image data into RGB data.

  The AE evaluation circuit 22 integrates RGB data belonging to the evaluation area EVA among the RGB data generated by the preprocessing circuit 20 every time the vertical synchronization signal Vsync is generated. As a result, 256 integral values, that is, 256 AE evaluation values, are output from the AE evaluation circuit 22 in response to the vertical synchronization signal Vsync.

  The AF evaluation circuit 24 integrates the high-frequency components of the RGB data belonging to the evaluation area EVA among the RGB data generated by the preprocessing circuit 20 every time the vertical synchronization signal Vsync is generated. As a result, 256 integral values, that is, 256 AF evaluation values, are output from the AF evaluation circuit 24 in response to the vertical synchronization signal Vsync.

  Referring to FIG. 12, when shutter button 28sh is in a non-operating state, CPU 26 executes a simple AE process based on the output from AE evaluation circuit 22 under the bracket imaging task, and calculates an appropriate EV value.

  The CPU 26 calculates the reference exposure time and the aperture amount that define the EV value calculated by the simple AE process under the exposure control task. The calculated aperture amount is set in the driver 18b, and the aperture unit 14 is adjusted. The calculated reference exposure time is registered in the exposure time register RGSTet shown in FIG. The registered exposure time is set in the driver 18c, and exposure for the set exposure time is executed every time the vertical synchronization signal Vsync is generated.

  When the reference exposure time has elapsed from the start of exposure, the CPU 26 instructs the driver 18c to read the raw image data, and issues an image reading completion notification NT0 in response to the completion of the reading. The read raw image data is written in the raw image area 32a of the SDRAM 32 through the processing of the preprocessing circuit 20 as described above. As a result, the brightness of the through image is appropriately adjusted.

  Next, the CPU 26 executes face detection processing under the face detection task every time an image read completion notification is issued in order to search for a human face image from the search image data stored in the search image area 32d. For such a face detection task, a plurality of face detection frames FD, FD, FD,... Shown in FIG. 6, a face dictionary DCf shown in FIG. 7, a face detection work register RGSTwk shown in FIG. An AF target register RGSTaf is prepared. The face dictionary DCf contains five dictionary images (= face images with different directions). The face dictionary DCf is stored in the flash memory 44.

  In the face detection process, first, the entire evaluation area EVA is set as a search area. In order to define a variable range of the size of the face detection frame FD, the maximum size SZmax is set to “200”, and the minimum size SZmin is set to “20”.

  The face detection frame FD is moved by a predetermined amount in a raster scanning manner from the start position (upper left position) to the end position (lower right position) of the search area (see FIG. 10). The size of the face detection frame FD is reduced by “5” from “SZmax” to “SZmin” every time the face detection frame FD reaches the end position.

  The CPU 26 reads the image data belonging to the face detection frame FD from the search image area 32d through the memory control circuit 30, and calculates the feature amount of the read image data. The calculated feature amount is collated with each feature amount of the standard face dictionary DCf. When the matching level exceeds the reference value TH, it is considered that a face image has been detected, and the current position and size of the face detection frame FD are stored in the face detection work register RGSTwk as face information.

  When face information is stored in the face detection work register RGSTwk after completion of the face detection process, the CPU 26 converts the face information to be subjected to AF processing from the face information stored in the face detection work register RGSTwk. Decide under the discovery task. When one piece of face information is stored in the face detection work register RGSTwk, the CPU 26 sets the stored face information as AF target face information. When a plurality of pieces of face information are stored in the face detection work register RGSTwk, the CPU 26 sets face information whose position is closest to the center of the imaging surface as AF target face information. The position and size of the face information set as AF target face information is stored in the AF target register RGSTaf.

  Further, the CPU 26 sets a flag FLG_f to “1” in order to announce that a person's face has been found.

  When face information is not registered in the face detection work register RGSTwk after completion of the face detection process, that is, when a person's face is not found, the CPU 26 indicates that a person's face has not been found. Accordingly, the flag FLG_f is set to “0”.

  Referring to FIG. 12, when the shutter button 28sh is half-pressed, when the flag FLG_f indicates “1”, under the bracket imaging task, the CPU 26 performs strict AF processing focusing on the area indicated by the AF target face information. Run. The CPU 26 extracts an AF evaluation value corresponding to the position and size stored in the AF target register RGSTaf from the 256 AF evaluation values output from the AF evaluation circuit 24. The CPU 26 executes AF processing based on a part of the extracted AF evaluation values. As a result, the focus lens 12 is disposed at a focal point focusing on the area indicated by the AF target face information, and the sharpness of the AF target face in the through image is improved.

  When the flag FLG_f indicates “1”, under the bracket imaging task, the CPU 26 refers to the contents of the AF target register RGSTaf and requests the graphic generator 46 to display the face frame FF. The graphic generator 46 outputs graphic information representing the face frame FF to the LCD driver 38. The face frame FF is displayed on the LCD monitor 38 in a manner that matches the position and size stored in the AF target register RGSTaf.

  Therefore, when the face of the person HM1 is captured on the imaging surface, the face frame FF is displayed on the LCD monitor 38 as shown in FIG. 11 so as to surround the face image of the person HM1.

  The CPU 26 also executes a strict AE process based on the 256 AE evaluation values output from the AE evaluation circuit 22 under the bracket imaging task, and calculates an appropriate EV value.

  The CPU 26 calculates the reference exposure time and the aperture amount that define the EV value calculated by the strict AE process under the exposure control task. The calculated aperture amount is set in the driver 18b, and the aperture unit 14 is adjusted. The calculated reference exposure time is registered in the exposure time register RGSTet. The registered exposure time is set in the driver 18c, and exposure for the set exposure time is executed every time the vertical synchronization signal Vsync is generated.

  When the reference exposure time has elapsed from the start of exposure, the CPU 26 instructs the driver 18c to read the raw image data, and issues an image reading completion notification NT0 in response to the completion of reading. The read raw image data is written in the raw image area 32a of the SDRAM 32 through the processing of the preprocessing circuit 20 as described above. As a result, the brightness of the through image is adjusted strictly.

  Referring to FIG. 13, when shutter button 28sh is fully pressed, CPU 26 controls the exposure time under the exposure control task, and executes exposure a plurality of times each time vertical synchronization signal Vsync is generated. Hereinafter, the exposure process will be described in detail by taking as an example a case where three exposures are executed every time the vertical synchronization signal Vsync is generated.

  When the vertical synchronization signal Vsync is generated, the CPU 26 sets the exposure time obtained by subtracting the predetermined value α from the reference exposure time registered in the exposure time register RGSTet to the driver 18c, and instructs the driver 18c to perform exposure for the set exposure time. To do. When the set exposure time has elapsed from the start of exposure, the CPU 26 instructs the driver 18c to read the raw image data under the exposure control task, and issues an image reading completion notification NT1 in response to the completion of the reading.

  When the image read completion notification NT1 is issued, the CPU 26 sets the reference exposure time registered in the exposure time register RGSTet in the driver 18c, and instructs the driver 18c to perform exposure for the set exposure time. When the set exposure time has elapsed from the start of exposure, the CPU 26 instructs the driver 18c to read the raw image data, and issues an image read completion notification NT2 in response to the completion of the read.

  When the image reading completion notification NT2 is issued, the CPU 26 sets an exposure time obtained by adding a predetermined value B to the reference exposure time registered in the exposure time register RGSTet in the driver 18c, and performs exposure for the set exposure time to the driver. Command 18c. When the set exposure time has elapsed from the start of exposure, the CPU 26 instructs the driver 18c to read the raw image data, and issues an image read completion notification NT3 in response to the completion of the read.

  As a result, every time the vertical synchronization signal Vsync is generated, three exposures based on the exposure time shorter than the reference exposure time, the reference exposure time, and the exposure time longer than the reference exposure time are executed.

  When the shutter button 28sh is fully pressed, the CPU 26 executes a moving image shooting process or a panoramic shooting process based on the state of the mode change button 28md provided on the key input device 28 under the bracket imaging task.

  In the moving image shooting process, open moving image files FM1, FM2, and FM3 are newly created on the recording medium.

  When the image read completion notification NT1 is issued, the CPU 26 records the YUV image data written in the YUV image area 32b as a frame image in the open moving image file FM1.

  When the image reading completion notification NT2 is issued, the CPU 26 records the YUV image data written in the YUV image area 32b as a frame image in the open moving image file FM2.

  When the image reading completion notification NT3 is issued, the CPU 26 records the YUV image data written in the YUV image area 32b as a frame image in the open moving image file FM3.

  Further, when the flag FLG_f indicates “1”, the CPU 26 executes the above-described strict AF processing focusing on the area indicated by the AF target face information. As a result, the focus lens 12 is disposed at a focal point focusing on the area indicated by the AF target face information, and the sharpness of the AF target face in the through image is improved. Further, even when the face image is detected by only one or two of the three face detection processes corresponding to the three exposure times, the arrangement of the focus lens 12 is maintained. Therefore, the sharpness of the AF target face does not decrease.

  Referring to FIG. 14, by repeating such processing until the shutter button 28sh is fully pressed, three moving image files having different brightness are created in parallel as shown in FIG. Is done.

  When the fully pressed state of the shutter button 28 sh is released, the CPU 26 accesses the recording medium 42 through the I / F 40, closes each of the open moving image files FM 1, FM 2, and FM 3 and ends the recording process.

  In the panorama shooting process, open panorama image files FP1, FP2, and FP3 are newly created on the recording medium 42.

  When the image read completion notification NT1 is issued, the CPU 26 performs composition processing on the panorama composite image data of the panorama image file FP1 using the YUV image data written in the YUV image area 32b, and creates a new panorama image. . The panorama image file FP1 is updated with panorama composite image data including a newly created panorama image.

  When the image read completion notification NT2 is issued, the CPU 26 performs composition processing on the panorama composite image data of the panorama image file FP2 using the YUV image data written in the YUV image area 32b, and creates a new panorama image. . The panorama image file FP2 is updated with panorama composite image data including a newly created panorama image.

  When the image read completion notification NT3 is issued, the CPU 26 performs composition processing on the panorama composite image data of the panorama image file FP3 using the YUV image data written in the YUV image area 32b, and creates a new panorama image. . The panorama image file FP3 is updated with panorama composite image data including a newly created panorama image.

  Referring to FIG. 15, such a process is repeated until the shutter button 28sh is fully pressed, so that three panoramic image files having different brightness are displayed in parallel as shown in FIG. Created.

  When it is determined that the shutter button 28sh is fully pressed or the panning rotation of the digital camera 10 reaches 360 degrees based on the panorama composite image data stored in the panorama image file FP1. The CPU 26 accesses the recording medium 42 through the I / F 40, closes each of the open panorama image files FP1, FP2, and FP3, and ends the recording process.

  When each of the panorama image files FP1 to FP3 is closed, the CPU 26 executes a process of calculating an average brightness for each of the three panorama image data stored in the panorama image files FP1 to FP3. Based on the calculation result, the CPU 26 selects a panoramic image file including panoramic image data photographed with the most appropriate exposure amount, and deletes other panoramic image files. As a result, the panorama image file having the most appropriate brightness is left on the recording medium 42.

  The CPU 26 executes in parallel a plurality of tasks including a bracket imaging task shown in FIGS. 18 to 19, an exposure control task shown in FIGS. 20 to 21, and a face detection task shown in FIG. Note that control programs corresponding to these tasks are stored in the flash memory 44.

  Referring to FIG. 18, an exposure control task is activated in step S1, and a face detection task is activated in step S3. In step S5, the moving image capturing process is started. As a result, a through image representing a scene is displayed on the LCD monitor 38.

  In step S7, the flag FLG_b is initially set to “0”, and in step S9, the focus lens 12 is disposed at the pan focus position which is the initial setting position. In step S11, it is determined whether or not the shutter button 28sh has been half-pressed. If the determination result is NO, the simple AE process is repeatedly executed in step S13.

  When the determination result is updated from NO to YES, it is determined in step S15 whether or not the flag FLG_f indicates “1”. If the determination result of step S15 is NO, the process proceeds to step S23 through the process of step S21, while if the determination result is YES, the process proceeds to step S23 through the processes of steps S17 and S19.

  In step S17, a strict AF process focusing on the area indicated by the AF target face information is executed. As a result, the focus lens 12 is disposed at a focal point focusing on the area indicated by the AF target face information, and the sharpness of the AF target face in the through image is improved. In step S19, the graphic generator 46 is requested to display the face frame FF. As a result, the face frame FF is displayed on the LCD monitor 38 in a manner that matches the position and size stored in the AF target register RGSTaf.

  In step S21, a strict AF process focusing on the center of the image is executed. The CPU 26 extracts an AF evaluation value corresponding to the center of the screen from the 256 AF evaluation values output from the AF evaluation circuit 24. The CPU 26 executes AF processing based on a part of the extracted AF evaluation values. As a result, the sharpness of the center of the image in the through image or the recorded image is improved.

  In step S23, a strict AE process is executed. As a result, the brightness of the through image is adjusted strictly.

  In step S25, it is determined whether or not the shutter button 28sh is fully pressed. If the determination result is NO, it is determined in step S27 whether or not the half-pressed state of the shutter button 28sh is released. If the determination result in step S27 is NO, the process returns to step S25, while if the determination result in step S27 is YES, the process proceeds to step S37.

  If the decision result in the step S25 is YES, a flag FLG_b is set to “1” in a step S29. In step S31, it is determined whether or not the state of the mode change button 28md provided on the key input device 28 indicates the moving image shooting mode. If the determination result is YES, a moving image shooting process is executed in step S33, and then the process proceeds to step S37. If the determination result is NO, a panorama shooting process is executed in step S35, and then the process proceeds to step S37.

  In step S37, the face frame FF is not displayed, and then the process returns to step S7.

  Referring to FIG. 20, in step S41, a default value is set as the EV reference value, and a reference exposure time is calculated in step S43 based on the set EV reference value. The calculated reference exposure time is registered in the exposure time register RGSTet. Further, the aperture amount is calculated in step S45 based on the set EV reference value, and the calculated aperture amount is set in the driver 18b in step S47. As a result, the aperture unit 14 is adjusted based on the calculated aperture amount.

  In step S49, it is determined whether or not the vertical synchronization signal Vsync is generated. If the determination result is YES, the process proceeds to step S61, and if the determination result is NO, the process proceeds to step S51. In step S51, it is determined whether or not the simple AE process or the strict AE process is executed. If the determination result is NO, the process returns to step S49, whereas if the determination result is YES, the process proceeds to step S53.

  In step S53, the EV reference value is set to a value calculated by the simple AE process or the strict AE process. A reference exposure time is calculated in step S55 based on the set EV reference value. The calculated reference exposure time is registered in the exposure time register RGSTet. Further, the aperture amount is calculated in step S57 based on the set EV reference value, and the calculated aperture amount is set in the driver 18b in step S59. As a result, the aperture unit 14 is adjusted based on the calculated aperture amount.

  In step S61, it is determined whether or not “1” is set in the flag FLG_b. If the determination result is YES, the process proceeds to step S71, and if the determination result is NO, the process proceeds to step S63.

  In step S63, the reference exposure time registered in the exposure time register RGSTet is set in the driver 18c as the exposure time, and an exposure based on the set exposure time is commanded to the driver 18c in step S65. In step S67, the driver 18c is instructed to read the raw image data, and in response to the completion of reading, an image reading completion notification NT0 is issued in step S69. After the process of step S69 is completed, the process returns to step S49.

  In step S71, an exposure time obtained by subtracting a predetermined value α from the reference exposure time registered in the exposure time register RGSTet is set in the driver 18c, and an exposure based on the set exposure time is commanded to the driver 18c in step S73. In step S75, the driver 18c is instructed to read the raw image data, and in response to the completion of reading, an image reading completion notification NT1 is issued in step S77.

  In step S79, the reference exposure time registered in the exposure time register RGSTet is set in the driver 18c as the exposure time, and an exposure based on the set exposure time is commanded to the driver 18c in step S81. In step S83, the driver 18c is instructed to read the raw image data, and in response to the completion of reading, an image reading completion notification NT2 is issued in step S85.

  In step S87, an exposure time obtained by adding a predetermined value β to the reference exposure time registered in the exposure time register RGSTet is set in the driver 18c, and an exposure based on the set exposure time is commanded to the driver 18c in step S89. In step S91, the driver 18c is instructed to read the raw image data, and in response to the completion of reading, an image reading completion notification NT3 is issued in step S93. After the process of step S93 is completed, the process returns to step S49.

  Referring to FIG. 22, in step S101, flag FLG_f is set to “0”, and in step S103, the contents stored in AF target register RGSTaf are cleared to be initialized. In step S105, it is repeatedly determined whether any of image reading completion notifications NT0 to NT3 has been issued. If the determination result is updated from NO to YES, the process proceeds to step S107.

  In step S107, face detection processing is executed to search for a human face image from the search image data. In step S109, it is determined whether or not face information is stored in the face detection work register RGSTwk by the process in step S107. If the determination result is YES, the process proceeds to step S113. If the determination result is NO, the process proceeds to step S111. move on. In step S111, “0” is set to the flag FLG_f, and then the process returns to step S105.

  In step S113, it is determined whether or not a plurality of pieces of face information are stored in the face detection work register RGSTwk. If the determination result is NO, the process proceeds to step S117. If the determination result is YES, the process of step S115 is performed. The process proceeds to step S117.

  In step S115, face information whose position stored in the face detection work register RGSTwk is closest to the center of the image is determined as AF target face information. In step S117, the position and size of the face information set as AF target face information are determined. Stored in the AF target register RGSTaf. In step S119, “1” is set in the flag FLG_f, and then the process returns to step S105.

  The face detection process in step S107 is executed according to a subroutine shown in FIGS.

  Referring to FIG. 23, in step S121, the stored contents are cleared to initialize face detection work register RGSTwk.

  In step S123, the variable Nmax is set to the registration number of the face dictionary DCf, and in step S125, the entire evaluation area EVA is set as a search area. In step S127, the maximum size SZmax is set to “200” and the minimum size SZmin is set to “20” in order to define a variable range of the size of the face detection frame FD.

  In step S129, the size of the face detection frame FD is set to “SZmax”, and in step S131, the face detection frame FD is arranged at the upper left position of the search area. In step S133, a part of the search image data belonging to the face detection frame FD is read from the search image area 32d, and the feature amount of the read search image data is calculated.

  In step S135, the variable N is set to “1”. In step S137, the feature amount calculated in step S133 is compared with the feature amount of the Nth dictionary image stored in the face dictionary DCf. As a result of the collation, it is determined in step S139 whether or not a collation degree exceeding the threshold TH is obtained. If the determination result is NO, the process proceeds to step S141. If the determination result is YES, the process proceeds to step S145.

  In step S141, the variable N is incremented, and in step S143, it is determined whether or not the variable N exceeds Nmax. If the determination result is NO, the process returns to step S137, while if the determination result is YES, the process proceeds to step S147.

  In step S145, the current position and size of the face detection frame FD are registered in the face detection work register RGSTwk as face information. In step S147, it is determined whether or not the face detection frame FD has reached the lower right position of the search area. If the determination result is YES, the process proceeds to step S151. If the determination result is NO, the face detection is performed in step S149. The frame FD is moved in the raster direction by a predetermined amount, and then the process returns to step S133.

  In step S151, it is determined whether or not the size of the face detection frame FD is equal to or smaller than “SZmin”. If the determination result is YES, the process returns to the upper hierarchy routine. If the determination result is NO, the process proceeds to step S153. .

  In step S153, the size of the face detection frame FD is reduced by “5”, and in step S155, the face detection frame FD is arranged at the upper left position of the search area. When the process of step S155 is completed, the process returns to step S133.

  The moving image shooting process in step S33 is executed according to a subroutine shown in FIGS.

  Referring to FIG. 25, the recording medium 42 is accessed through the I / F 40. In step S161, an open moving image file FM1 is newly created in the recording medium 42. In step S163, the open moving image file FM2 is created. In step S165, an open moving image file FM3 is newly created on the recording medium 42.

  In step S167, it is determined whether or not “1” is set in the flag FLG_f. If the determination result is NO, the process proceeds to step S173, and if the determination result is YES, the process proceeds to step S169.

  In step S169, a strict AF process focusing on the area indicated by the AF target face information is executed. As a result, the focus lens 12 is disposed at a focal point focusing on the area indicated by the AF target face information, and the sharpness of the AF target face in the through image and the recorded image is improved. In step S171, the graphic generator 46 is requested to display the face frame FF. As a result, the face frame FF is displayed on the LCD monitor 38 in a manner that matches the position and size stored in the AF target register RGSTaf.

  In step S173, it is determined whether any of image reading completion notifications NT1 to NT3 has been issued. If the determination result is NO, the process proceeds to step S185. If the determination result is YES, the process proceeds to step S175.

  In step S175, it is determined whether the issued notification is the image reading completion notification NT1, and if the determination result is NO, it is determined in step S177 whether the issued notification is the image reading completion notification NT2. .

  If the decision result in the step S175 is YES, the YUV image data written in the YUV image area 32b is recorded as a frame image in the open moving image file FM1 in a step S179.

  If the decision result in the step S177 is YES, the YUV image data written in the YUV image area 32b is recorded as a frame image in the open moving image file FM2 in a step S181.

  If the determination result in step S177 is NO, the YUV image data written in the YUV image area 32b is recorded as a frame image in the open moving image file FM3 in step S183.

  When the process of step S179, S181, or S183 is completed, the process proceeds to step S185.

  In step S185, it is determined whether or not the fully pressed state of the shutter button 28sh is released. If the determination result is NO, the process returns to step S167, and if the determination result is YES, the process proceeds to step S187.

  The recording medium 42 is accessed through the I / F 40. In step S187, the open moving image file FM1 is closed to end the recording process. In step S189, the open moving image file FM2 is closed to end the recording process. In S191, the open moving image file FM3 is closed and the recording process is terminated. When the process of step S191 is completed, the process returns to the upper layer routine.

  The panoramic photographing process in step S35 is executed according to a subroutine shown in FIGS.

  Referring to FIG. 28, the recording medium 42 is accessed through the I / F 40. In step S201, an open panorama composite file FP1 is newly created in the recording medium 42. In step S203, an open panorama composite file FP2 is recorded. A new panorama composite file FP3 is created on the recording medium 42 in step S205.

  In step S207, it is determined whether any of image reading completion notifications NT1 to NT3 has been issued. If the determination result is NO, the process proceeds to step S219. If the determination result is YES, the process proceeds to step S209.

  In step S209, it is determined whether the issued notification is the image reading completion notification NT1, and if the determination result is NO, it is determined in step S211 whether the issued notification is the image reading completion notification NT2. .

  If the determination result in step S209 is YES, in step S213, the panorama composite image data of the panorama image file FP1 is composited using the YUV image data written in the YUV image area 32b to create a new panorama image. To do. The panorama image file FP1 is updated with panorama composite image data including a newly created panorama image.

  If the determination result in step S211 is YES, in step S215, the panorama composite image data of the panorama image file FP2 is composited using the YUV image data written in the YUV image area 32b to create a new panorama image. To do. The panorama image file FP2 is updated with panorama composite image data including a newly created panorama image.

  If the determination result in step S211 is NO, in step S217, the panorama composite image data of the panorama image file FP3 is synthesized using the YUV image data written in the YUV image area 32b to create a new panorama image. To do. The panorama image file FP3 is updated with panorama composite image data including a newly created panorama image.

  When the process of step S213, S215, or S217 is completed, the process proceeds to step S219.

  In step S219, it is determined whether or not the fully pressed state of the shutter button 28sh has been released. If the determination result is NO, the process proceeds to step S221. If the determination result is YES, the process proceeds to step S223.

  In step S221, based on the panorama composite image data stored in the panorama image file FP1, it is determined whether or not the rotation of the digital camera 10 in the pan direction has reached 360 degrees. If the determination result is NO, the process returns to step S207, and if the determination result is YES, the process proceeds to step S223.

  The recording medium 42 is accessed through the I / F 40. In step S223, the open panorama composite file FP1 is closed and the recording process is ended. In step S225, the open panorama composite file FP2 is closed and the recording process is ended. In step S227, the open panorama composite file FP3 is closed and the recording process is terminated.

  In step S229, a process of calculating the average brightness is executed for each of the three panoramic image data stored in the panoramic image files FP1 to FP3. Based on the calculation result, a panorama image file including panorama image data photographed with the most appropriate exposure amount is selected. In step S231, panorama image files other than the panorama image file selected in step S229 are deleted. As a result, the panorama image file having the most appropriate brightness is left on the recording medium 42. When the process of step S231 is completed, the process returns to the upper-level routine.

  As can be seen from the above description, the image sensor 16 has an imaging surface on which an optical image is irradiated. The imaging surface is repeatedly exposed by an exposure pulse generation circuit 18p1 provided in the driver 18c. The raw image data based on the charge generated by the exposure is repeatedly output from the image sensor 16 by the charge readout pulse generation circuit 18p2 provided in the driver 18c. The CPU 26 repeats the process of setting the exposure amount on the imaging surface to K values (K: an integer of 2 or more) in a predetermined order (S49, S71, S79, S87), and the YUV format based on the output of the image sensor 16 The process of classifying image data into K groups in a predetermined order is repeated (S173 to S183, S207 to S217).

  The exposure amount on the imaging surface is set to K values in a predetermined order, and the image data based on the output of the image sensor 16 is classified into K groups in the predetermined order. Such exposure setting and image classification are repeatedly executed. The classified image data of each group is an image representing a common scene with different brightness. This makes it possible to diversify the image data created in parallel.

  In this embodiment, the reference exposure time is calculated based on the strict AE process, the exposure time obtained by subtracting the predetermined value α from the reference exposure time, the reference exposure time, and the exposure time obtained by adding the predetermined value β to the reference exposure time. The exposure time is periodically set to these three values. However, other exposure times may be set. For example, the exposure time is periodically set to three values: an exposure time obtained by subtracting a predetermined value α × 2 from the reference exposure time, an exposure time obtained by subtracting the predetermined value α from the reference exposure time, and a reference exposure time. Also good.

  In this embodiment, the multitask OS and control programs corresponding to a plurality of tasks executed thereby are stored in the flash memory 44 in advance. However, a communication I / F 60 for connecting to an external server is provided in the digital camera 10 in the manner shown in FIG. 31, and some control programs are prepared in the flash memory 44 from the beginning as internal control programs, while other parts are prepared. These control programs may be acquired from an external server as an external control program. In this case, the above-described operation is realized by cooperation of the internal control program and the external control program.

  In this embodiment, the process executed by the CPU 26 is divided into a plurality of tasks including a bracket imaging task, an exposure control task, and a face detection task. However, these tasks may be further divided into a plurality of small tasks, and a part of the divided plurality of small tasks may be integrated with other tasks. Further, when the transfer task is divided into a plurality of small tasks, all or part of the transfer task may be acquired from an external server.

  In this embodiment, the digital camera is used for the explanation. However, the present invention can also be applied to a mobile phone terminal or a smartphone.

DESCRIPTION OF SYMBOLS 10 ... Digital camera 14 ... Aperture unit 16 ... Image sensor 18b, 18c ... Driver 26 ... CPU
42 ... Recording medium

Claims (9)

An imaging means having an imaging surface on which an optical image is irradiated;
Exposure means for repeatedly exposing the imaging surface;
Output means for repeatedly outputting an electronic image generated on the imaging surface by the processing of the exposure means;
Adjusting means for repeating the process of setting the exposure amount of the exposure means to K values (K: an integer equal to or greater than 2) in a predetermined order; and K groups of electronic images output by the output means in the predetermined order An electronic camera comprising classification means for repeating the process of classifying into A calculation unit that calculates an appropriate exposure amount based on the electronic image output from the output unit;
The electronic camera according to claim 1, wherein the adjustment unit sets an exposure amount of the exposure unit based on the exposure amount calculated by the calculation unit.   The electronic camera according to claim 1, further comprising first creation means for creating a moving image file using the electronic images classified by the classification means.   The electronic camera according to claim 1, further comprising a second creation unit that creates a wide-angle image file using the electronic images classified by the classification unit. 5. The apparatus according to claim 1, further comprising: search means for searching for a specific object image from the electronic image output from the output means; and change means for changing an image pickup condition of the image pickup means based on a search result of the search means. An electronic camera according to any one of the above. An imaging means having an imaging surface on which an optical image is irradiated;
An exposure unit that repeatedly exposes the imaging surface; and an electronic camera processor that includes an output unit that repeatedly outputs an electronic image generated on the imaging surface by the processing of the exposure unit.
An adjustment step of repeating the process of setting the exposure amount of the exposure means to K values (K: an integer equal to or greater than 2) in a predetermined order; and K groups of electronic images output by the output means in the predetermined order The imaging control program for performing the classification step which repeats the process classified into (1). An imaging means having an imaging surface on which an optical image is irradiated;
An imaging control method executed by an electronic camera comprising: an exposure unit that repeatedly exposes the imaging surface; and an output unit that repeatedly outputs an electronic image generated on the imaging surface by the processing of the exposure unit,
An adjustment step of repeating the process of setting the exposure amount of the exposure means to K values (K: an integer equal to or greater than 2) in a predetermined order; and K groups of electronic images output by the output means in the predetermined order An imaging control method, comprising: a classification step that repeats the process of classifying into two. An imaging means having an imaging surface on which an optical image is irradiated;
Exposure means for repeatedly exposing the imaging surface;
An external control program supplied to an electronic camera comprising output means for repeatedly outputting an electronic image generated on the imaging surface by processing of the exposure means, and a processor for executing processing according to an internal control program stored in a memory. And
An adjustment step of repeating the process of setting the exposure amount of the exposure means to K values (K: an integer equal to or greater than 2) in a predetermined order; and K groups of electronic images output by the output means in the predetermined order An external control program for causing the processor to execute a classification step that repeats the process of classifying into the internal control program in cooperation with the internal control program. An imaging means having an imaging surface on which an optical image is irradiated;
Exposure means for repeatedly exposing the imaging surface;
Output means for repeatedly outputting an electronic image generated on the imaging surface by the processing of the exposure means;
An electronic camera comprising a capturing unit that captures an external control program, and a processor that executes processing according to the external control program captured by the capturing unit and the internal control program stored in a memory,
The external control program is
An adjustment step of repeating the process of setting the exposure amount of the exposure means to K values (K: an integer equal to or greater than 2) in a predetermined order; and K groups of electronic images output by the output means in the predetermined order An electronic camera corresponding to a program that executes a classification step of repeating the classification process in cooperation with the internal control program.

Images