JP2014158210A - Electronic camera - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a photographer to obtain an intended determination result easily, in an automatic determination function of a scene.SOLUTION: An image sensor 16 outputs an electronic image representing a scene captured by an imaging surface. A CPU 36 selects one scene as a scene candidate, based on an image outputted from the image sensor 16 upon acceptance of a condition selection instruction. The CPU 36 also selects any one scene anew, as a scene candidate, from the scenes excepting those that have been selected already as scene candidates, upon acceptance of a selection change instruction after a scene candidate is selected. Furthermore, the CPU 36 adjusts the photography conditions along the scene candidate thus selected.

Description

  The present invention relates to an electronic camera, and more particularly to an electronic camera that discriminates a scene.

  An example of a method for improving the accuracy of scene discrimination used in this type of camera is disclosed in Patent Document 1. According to this background art, the condition adjustment is performed by executing processing for extracting any one of two or more scene candidates selected based on an image as a confirmed scene in a different manner depending on the audio capturing time. Improvement in response characteristics to instructions and improvement in scene discrimination accuracy are both achieved.

JP2012-129958A

  However, in the background art, there is no description about processing when the result of scene discrimination is not intended by the photographer. For example, the determination process is executed by pressing the shutter button halfway, and then the shooting process is performed under the condition set based on the determination result by pressing the shutter button fully. Here, when the determined result is not what is desired, the photographer once cancels the half-pressed state of the shutter button, and again performs the determination process by making the half-pressed state again. However, if there is no change in the state of the shooting scene, such as the brightness of the shooting area and the positional relationship of the subject, it is highly possible that the same result as the previous time is obtained even if the discrimination process is performed again. In such a case, the photographer needs to obtain a desired result by changing the angle of view of the camera or using another function.

  Therefore, a main object of the present invention is to provide an electronic camera that can easily obtain a discrimination result intended by a photographer in an automatic scene discrimination function.

  An electronic camera according to the present invention (10: reference numeral corresponding to the embodiment; the same applies hereinafter) includes an imaging unit (16) that outputs an electronic image representing a scene captured by an imaging plane, and an imaging unit when a condition selection instruction is received Selection means (S3, S9, S41 to S49) for selecting one scene as a scene candidate based on the state of the image output from the screen, and when the selection change instruction is received after the scene candidate is selected, the selection means selects Selection changing means (S61 to S69) for selecting and changing another scene different from the selected scene as the scene candidate, and adjustment means (S11 to S13, S19 to S25) for adjusting the shooting conditions along the selected scene candidate ).

  Preferably, the selection change unit changes the selection of the scene candidate when the selection change instruction is received within a predetermined time after the condition selection instruction is canceled.

  Preferably, the selection changing unit determines a scene candidate from scenes having a likelihood greater than or equal to a predetermined value with respect to an image state among a plurality of predetermined scene groups.

  More preferably, each time the selection change instruction is received, the selection change means sequentially determines a scene candidate from a scene having a high likelihood for the image state among a plurality of predetermined scene groups.

  Preferably, the condition selection instruction and the selection change instruction are performed by the same operation.

  The imaging control program according to the present invention is output in the imaging step (16) for outputting an electronic image representing a scene captured by the imaging surface to the processor (36) of the electronic camera, and in the imaging step when a condition selection instruction is received. A selection step (S3, S9, S41 to S49) for selecting one scene as a scene candidate based on the state of the image. When a selection change instruction is received after a scene candidate is selected, the scene selected in the selection step A selection change step (S61 to S69) for selecting and changing another scene different from the scene candidate, and an adjustment step (S11 to S13, S19 to S25) for adjusting the shooting conditions along the selected scene candidate are executed. This is an imaging control program.

  An imaging control method according to the present invention is an imaging control method executed by an electronic camera (10), and an imaging step (16) for outputting an electronic image representing a scene captured by an imaging surface, accepting a condition selection instruction A selection step (S3, S9, S41 to S49) for selecting one scene as a scene candidate based on the state of the image output in the imaging step, when a selection change instruction is received after the scene candidate is selected, A selection change step (S61 to S69) for selecting and changing another scene different from the scene selected in the selection step as a scene candidate, and an adjustment step (S11 to S13, for adjusting shooting conditions along the selected scene candidate) S19 to S25).

  An external control program according to the present invention is an external control program supplied to an electronic camera (10) including a processor (36) that executes processing according to an internal control program stored in a memory (42), and is captured by an imaging surface. An imaging step (16) for outputting an electronic image representing a given scene, and a selection step for selecting one scene as a scene candidate based on the state of the image output in the imaging step when a condition selection instruction is received (S3, (S9, S41 to S49), when a selection change instruction is accepted after a scene candidate is selected, a selection change step (S61 to S69) for selecting and changing another scene different from the scene selected in the selection step as a scene candidate And an adjustment step (S11 to S13, S19 to S25) for adjusting the shooting conditions according to the selected scene candidate is executed by the processor in cooperation with the internal control program. Because of, which is an external control program.

  An electronic camera (10) according to the present invention executes a process according to a receiving means (52) for receiving an external control program, and an external control program received by the receiving means and an internal control program stored in a memory (42). An electronic camera (10) provided with a processor (36), wherein the external control program outputs an electronic image representing a scene captured by the imaging surface in an imaging step (16) and an imaging step when a condition selection instruction is received. A selection step (S3, S9, S41 to S49) for selecting one scene as a scene candidate based on the state of the output image. When a selection change instruction is received after a scene candidate is selected, the selection step selects A selection change step (S61 to S69) for selecting and changing another scene different from the selected scene as a scene candidate, and shooting conditions along the selected scene candidate Adjustment adjusting steps (S11 ~ S13, S19 ~ S25) corresponds to the internal control program in cooperation with a program to be executed.

  The selected scene candidate is excluded when a selection change instruction is accepted, so that the previously selected scene candidate is not selected as the scene candidate after the selection change. This makes it possible to easily obtain the determination result intended by the photographer in the automatic scene determination function.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

It is a block diagram which shows the basic composition of one Example of this invention. It is a block diagram which shows the structure of one Example of this invention. It is an illustration figure which shows an example of the state which allocated the evaluation area to the imaging surface. It is an illustration figure which shows an example of the state which allocated the motion detection area to the imaging surface. It is a flowchart which shows a part of operation | movement of CPU applied to the FIG. 2 Example. It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. FIG. 11 is a flowchart showing still another portion of behavior of the CPU applied to the embodiment in FIG. 2; FIG. 10 is a flowchart showing yet another portion of behavior of the CPU applied to the embodiment in FIG. 2; It is a block diagram which shows the structure of the other Example of this invention.

Embodiments of the present invention will be described below with reference to the drawings.
[Basic configuration]

Referring to FIG. 1, the electronic camera of this embodiment is basically configured as follows. The imaging unit 1 outputs an electronic image representing a scene captured by the imaging surface. The selection unit 2 selects one scene as a scene candidate based on the state of the image output from the imaging unit 1 when receiving a condition selection instruction. When a selection change instruction is received after a scene candidate is selected, the selection change means 3 selects and changes another scene different from the scene selected by the selection means 2 as a scene candidate. The adjusting unit 4 adjusts the shooting conditions along the selected scene candidate.
[Example]

  Referring to FIG. 2, the digital camera 10 of this embodiment includes a focus lens 12 and an aperture unit 14 driven by drivers 18a and 18b, respectively. The optical image of the scene that has passed through these members is irradiated onto the imaging surface of the image sensor 16 and subjected to photoelectric conversion. As a result, a charge representing an electronic image representing the scene is generated.

  When the power is turned on, the CPU 36 instructs the driver 18c to repeat the exposure operation and the charge reading operation under the imaging task in order to execute the moving image capturing process. In response to a vertical synchronization signal Vsync periodically generated from an SG (Signal Generator) (not shown), the driver 18c exposes the imaging surface and reads out the charges generated on the imaging surface in a raster scanning manner. From the image sensor 16, raw image data based on the read charges is periodically output.

  The preprocessing circuit 20 performs processing such as digital clamping, pixel defect correction, and gain control on the raw image data output from the image sensor 16. The raw image data subjected to these processes is written into the raw image area 24 a of the SDRAM 24 through the memory control circuit 22.

  The post-processing circuit 26 reads the raw image data stored in the raw image area 24a through the memory control circuit 22, and performs color separation processing, white balance adjustment processing, and YUV conversion processing on the read raw image data. The post-processing circuit 26 further executes a zoom process for display on the image data according to the YUV format. As a result, display image data according to the YUV format is individually created. The display image data is written into the display image area 24 b of the SDRAM 24 by the memory control circuit 22.

  The LCD driver 28 repeatedly reads the display image data stored in the display image area 24b through the memory control circuit 22, and drives the LCD monitor 30 based on the read image data. As a result, a real-time moving image (through image) of the scene is displayed on the monitor screen.

  Referring to FIG. 3, an evaluation area EVA is allocated at the center of the imaging surface. The evaluation area EVA is divided into 16 in each of the horizontal direction and the vertical direction, and 256 divided areas form the evaluation area EVA. In addition to the processing described above, the preprocessing circuit 20 simply converts raw image data into Y data and RGB data.

  Each time the vertical synchronization signal Vsync is generated, the AE / AF / AWB evaluation circuit 34 integrates Y data belonging to the evaluation area among the Y data generated by the preprocessing circuit 20 for each divided area. Accordingly, 256 integral values, that is, 256 AE evaluation values are output from the AE / AF / AWB evaluation circuit 34 in response to the vertical synchronization signal Vsync.

  The AE / AF / AWB evaluation circuit 34 extracts the high frequency component of the Y data belonging to the same evaluation area from the Y data output from the preprocessing circuit 20 every time the vertical synchronization signal Vsync is generated, The extracted high frequency components are integrated for each divided area. Accordingly, 256 integral values, that is, 256 AF evaluation values are output from the AE / AF / AWB evaluation circuit 34 in response to the vertical synchronization signal Vsync.

  Further, every time the vertical synchronization signal Vsync is generated, the AE / AF / AWB evaluation circuit 34 integrates the RGB data belonging to the same evaluation area among the RGB data output from the preprocessing circuit 20 for each divided area. As a result, 256 integrated values, that is, 256 AWB evaluation values, are output from the AE / AF / AWB evaluation circuit 34 in response to the vertical synchronization signal Vsync.

  The face detection circuit 44 moves the collation frame in a raster scanning manner from the start position to the end position of the display image stored in the display image area 24b, and a part of the images belonging to the collation frame is stored in the dictionary of the standard face dictionary 44d. Match the image.

  When the collation frame image matches the dictionary image, the face detection circuit 44 registers the current collation frame size and position in the register 44e. The collation frame is reduced every time it reaches the end position, and then set again at the start position. As a result, collation frames having different sizes are scanned in the raster direction on the electronic image representing the scene. When the collation frame of the minimum size reaches the end position, a search end notification is returned from the face detection circuit 44 to the CPU 36.

  In response to the search end notification returned from the face detection circuit 44, the CPU 36 determines whether or not the search for the person's face has succeeded. If at least one collation frame is registered in the register 44e, it is determined that the face image search has been successful. On the other hand, if the collation frame is not registered in the register 44e, it is determined that the face image search has failed.

  Referring to FIG. 4, nine motion detection blocks MD1 to MD9 are assigned to the imaging surface. Each time the vertical synchronization signal Vsync is generated, the motion detection circuit 46 detects a motion vector representing the motion of the scene in each motion detection block based on the Y data given from the preprocessing circuit 20. The detected motion vector is output to the CPU 36.

  Until the shutter button 32sh provided in the key input device 32 is depressed, the CPU 36 executes a simple AE process based on the output from the AE / AF / AWB evaluation circuit 34 under the imaging task, and sets an appropriate EV value. calculate. The simple AE process is executed in parallel with the moving image capturing process, and the aperture amount and the exposure time that define the calculated appropriate EV value are set in the drivers 18b and 18c, respectively. As a result, the brightness of the through image is appropriately adjusted.

  The CPU 36 also executes simple AWB processing based on the output from the AE / AF / AWB evaluation circuit 34 under the imaging task, and calculates an appropriate white balance adjustment gain. The calculated appropriate white balance adjustment gain is set in the post-processing circuit 26. The post-processing circuit 26 performs white balance adjustment of the raw image data based on the set appropriate white balance adjustment gain, and as a result, the through image displayed on the monitor screen is adjusted to the white balance in consideration of the light source. The

  When the shutter button 32sh is half-pressed, the CPU 36 issues a scene determination request in order to determine what kind of scene the shooting target is.

  When a scene determination request is issued, under the scene determination task, the CPU 36 extracts a scene based on the image information. The image information used for scene extraction includes the AE evaluation value, AF evaluation value, and AWB evaluation value output from the AE / AF / AWB evaluation circuit 34, and the registration state of the register 44e indicating the success or failure of the face image search and the motion detection circuit 24 is a motion vector output from 24. Scene extraction calculates the possibility (likelihood) Pimg of each scene by referring to these image information for each of a plurality of scenes prepared for setting adjustment criteria for shooting conditions. To do.

  For example, when a scene in which a person is playing soccer is captured by the image sensor 16, the possibility Pimg for the sports scene increases. In this manner, the possibility Pimg is calculated for each scene, and scenes that are scene candidates are extracted by excluding scenes with the calculated possibility Pimg being less than the reference value. The reference value is, for example, “50%”. When the scene having the calculated possibility Pimg of 50% or more is only “B”, the CPU 36 selects “B” as a scene candidate to be photographed.

  When there are a plurality of extracted scenes such as “A”, “B”, and “C”, for example, the CPU 36 selects a scene with the highest calculated Pimg as a candidate scene to be photographed. To do. For example, if the possibility Pimg of scene A is “70%”, the possibility Pimg of scene B is “85%”, and the possibility Pimg of scene C is “80%”, the possibility of scene B is possible Sex Pimg is the highest. Therefore, the CPU 36 selects “B” as a scene candidate to be photographed.

  When the half-pressed state of the shutter button 32 sh is released and the shutter button 32 sh is half-pressed again within a predetermined time t seconds, the CPU 36 issues a selection change request to change the selected scene to be photographed. When the release of the half-pressed state of the shutter button 32sh exceeds the predetermined time t seconds and is half-pressed again, the CPU 36 newly issues a scene determination request.

  When a selection change request is issued, under the selection change task, the CPU 36 extracts scenes by excluding scenes selected as scene candidates until the current selection change request. Scene extraction in the selection change request is performed in the same manner as the scene discrimination task.

  When the extracted scenes are “A”, “B”, and “C”, when the selection change request is issued for the selected scene B, the CPU 36 has a high likelihood. In order, first, scene A may be selected as a scene candidate, and when a selection change request is issued, scene C may be selected as a scene candidate. In this way, for example, when 10 scenes are extracted, scene candidates can be selected in descending order of likelihood by repeating half-pressing (release) the shutter button 32sh 10 times.

  When the selection of a scene candidate to be photographed is confirmed, the CPU 36 sets a photographing condition adjustment criterion for the selected scene candidate under the photographing task. The CPU 36 executes a strict AE process based on the output from the AE / AF / AWB evaluation circuit 34 in accordance with the set adjustment standard. The aperture amount and the exposure time that define the optimum EV value calculated by the strict AE process are set in the drivers 18b and 18c, respectively. As a result, the brightness of the through image is adjusted strictly.

  When the strict AE process is completed, the CPU 36 executes the strict AWB process based on the output from the AE / AF / AWB evaluation circuit 34 in accordance with the set adjustment criterion. Thereby, an appropriate white balance adjustment gain is calculated. The calculated appropriate white balance adjustment gain is set in the post-processing circuit 26, and as a result, the white balance of the through image is strictly adjusted.

  When the strict AWB process is completed, the CPU 36 executes the AF process based on the output from the AE / AF / AWB evaluation circuit 34 in accordance with the set adjustment criterion. As a result, the focus lens 12 is disposed at the focal point, and the sharpness of the through image is improved.

  The adjustment of the shooting conditions may be performed each time a scene candidate is selected or selected, or may be performed only after selection of a shooting target scene candidate is confirmed.

  When the shutter button 32sh is fully pressed, a still image capturing process and a recording process are executed. One frame of display image data at the time when the shutter button 32sh is fully pressed is captured into the still image area 24c by the still image capturing process. The captured one-frame image data is read from the still image area 24c by the I / F 38 activated in association with the recording process, and is recorded in the recording medium 40 in a file format.

  The CPU 36 executes in parallel a plurality of tasks including an imaging task shown in FIGS. 5 to 6, a scene determination task shown in FIG. 7, and a selection change task shown in FIG. 8. Control programs corresponding to these tasks are stored in the flash memory 42.

  With reference to FIG. 5, in step S <b> 1, the moving image capturing process is started. In step S3, it is determined whether or not the shutter button 32sh is half-pressed. If the determination result is NO, a simple AE process is executed in step S5, a simple AWB process is executed in step S7, and then the process returns to step S3. . When the determination result is updated from NO to YES, a scene determination request is issued in step S9.

  In step S11, it is repeatedly determined whether or not a scene candidate has been selected. If the determination result is updated from NO to YES, it is determined in step S13 whether or not the half-pressed state of the shutter button 32sh is released. If the determination result of step S13 is YES, it will progress to step S15. If the decision result in the step S13 is NO, a shooting condition adjustment criterion is set for the selected scene candidate in a step S19.

  In step S21, strict AE processing is executed, and in step S23, strict AWB processing is executed. In step S25, AF processing is executed. The strict AE process, the strict AWB process, and the AF process are executed according to the adjustment criterion set in step S19.

  In step S27, it is determined whether or not the shutter button 32sh is fully pressed. If the determination result is YES, the process proceeds to step S31. If the determination result is NO, it is determined whether or not the shutter button 32sh is released in step S29. Determine. If the determination result in step S29 is NO, the process returns to step S27, while if the determination result in step S29 is YES, the process returns to step S3.

  In step S31, a still image capturing process is executed, and in step S33, a recording process is executed. Thereafter, the process returns to step S3.

  Referring to FIG. 7, in step S41, it is repeatedly determined whether or not a scene determination request has been issued. When the determination result is updated from NO to YES, a scene is extracted based on the image information in step S43. In step S45, it is determined whether or not the number of scenes extracted in step S43 is two or more. If the determination result is YES, the process proceeds to step S47. If the determination result is NO, the process proceeds to step S49. The scene extracted in step 1 is selected as a scene candidate to be photographed.

  In step S47, a scene having the highest possibility Pimg calculated in step S43 is selected as a scene candidate to be photographed.

  When the process of step S47 or step S49 is completed, the process returns to step S41.

  Referring to FIG. 8, in step S61, it is repeatedly determined whether or not a selection change request (Nth time) has been issued. If the determination result is updated from NO to YES, it is selected by N-1th time in step S63. Extract scenes excluding selected scenes. In step S65, it is determined whether or not the number of scenes extracted in step S63 is two or more. If the determination result is YES, the process proceeds to step S67. If the determination result is NO, the process proceeds to step S69. The scene extracted in step 1 is selected as a scene candidate to be photographed.

  In step S67, a scene having the highest possibility Pimg calculated in step S63 is selected as a scene candidate to be photographed.

  When the process of step S67 or step S69 is completed, the process returns to step S61.

  As can be understood from the above description, the image sensor 16 outputs an electronic image representing a scene captured by the imaging surface. The CPU 36 selects one scene as a scene candidate based on the image output from the image sensor 16 when a condition selection instruction is received. Further, when receiving a selection change instruction after the scene candidate is selected, the CPU 36 newly selects any one scene as a scene candidate from the scenes excluding the scenes already selected as the scene candidates. The CPU 36 also adjusts the shooting conditions along the selected scene candidate.

  Since a scene once selected as a scene candidate is excluded when a selection change instruction is accepted, a scene that has been selected as a scene candidate so far is not selected as a scene candidate after the selection change. . This makes it possible to easily obtain the determination result intended by the photographer in the automatic scene determination function.

  In this embodiment, the multitask OS and control programs corresponding to a plurality of tasks executed thereby are stored in the flash memory 42 in advance. However, a communication I / F 52 for connecting to an external server is provided in the digital camera 10 in the manner shown in FIG. 9, and some control programs are prepared as internal control programs in the flash memory 42 from the beginning, while other parts are provided. These control programs may be acquired from an external server as an external control program. In this case, the above-described operation is realized by cooperation of the internal control program and the external control program.

  In this embodiment, the processing executed by the CPU 36 is divided into an imaging task shown in FIGS. 5 to 6, a scene determination task shown in FIG. 7, and a selection change task shown in FIG. However, these tasks may be further divided into a plurality of small tasks, and some of the divided small tasks may be integrated. Further, when the transfer task is divided into a plurality of small tasks, all or part of the transfer task may be acquired from an external server.

  In this embodiment, the entire scene to be photographed is described as a scene. However, the present invention may use a human face, a human body, an animal other than a person, or other objects as a scene. For example, when shooting a plurality of persons using the automatic face detection function, if the face position determined by half-pressing the shutter button is something other than the person that the photographer wants to shoot, a selection change instruction is issued. Thus, the face position of a person other than the person previously determined can be determined.

  In this embodiment, the digital still camera has been described. However, the present invention can also be applied to a digital video camera, a mobile phone terminal, a smartphone, or the like.

DESCRIPTION OF SYMBOLS 10 ... Digital camera 16 ... Image sensor 20 ... Pre-processing circuit 34 ... AE / AF / AWB evaluation circuit 44 ... Face detection circuit 46 ... Motion detection circuit

Claims (9)

Imaging means for outputting an electronic image representing a scene captured by the imaging surface;
Selection means for selecting one scene as a scene candidate based on the state of the image output from the imaging means when receiving a condition selection instruction;
When a selection change instruction is received after a scene candidate is selected, a selection change means for selecting and changing another scene different from the scene selected by the selection means as the scene candidate, and along the selected scene candidate An electronic camera comprising adjustment means for adjusting photographing conditions.   The electronic camera according to claim 1, wherein the selection change unit changes the selection of the scene candidate when the selection change instruction is received within a predetermined time after the condition selection instruction is canceled.   The said selection change means determines the said scene candidate from the scenes with the likelihood more than predetermined value with respect to the state of the said image among several predetermined scene groups. Electronic camera.   The selection change means determines the scene candidate sequentially from a scene having a high likelihood for the state of the image among a plurality of predetermined scene groups each time the selection change instruction is received. 4. The electronic camera according to any one of 3 to 3.   The electronic camera according to claim 1, wherein the condition selection instruction and the selection change instruction are performed by the same operation. In the electronic camera processor,
An imaging step of outputting an electronic image representing a scene captured by the imaging surface;
A selection step of selecting one scene as a scene candidate based on the state of the image output in the imaging step when a condition selection instruction is received;
When a selection change instruction is received after a scene candidate is selected, a selection change step of selecting and changing another scene different from the scene selected in the selection step as the scene candidate, and along the selected scene candidate An imaging control program for executing an adjustment step for adjusting imaging conditions. An imaging control method executed by an electronic camera,
An imaging step of outputting an electronic image representing a scene captured by the imaging surface;
A selection step of selecting one scene as a scene candidate based on the state of the image output in the imaging step when a condition selection instruction is received;
When a selection change instruction is received after a scene candidate is selected, a selection change step of selecting and changing another scene different from the scene selected in the selection step as the scene candidate, and along the selected scene candidate An imaging control method comprising an adjustment step of adjusting imaging conditions. An external control program supplied to an electronic camera including a processor that executes processing according to an internal control program stored in a memory,
An imaging step of outputting an electronic image representing a scene captured by the imaging surface;
A selection step of selecting one scene as a scene candidate based on the state of the image output in the imaging step when a condition selection instruction is received;
When a selection change instruction is received after a scene candidate is selected, a selection change step of selecting and changing another scene different from the scene selected in the selection step as the scene candidate, and along the selected scene candidate An external control program for causing the processor to execute an adjustment step for adjusting photographing conditions in cooperation with the internal control program. An electronic camera comprising: a receiving unit that receives an external control program; and a processor that executes processing according to the external control program received by the receiving unit and an internal control program stored in a memory,
The external control program is
An imaging step of outputting an electronic image representing a scene captured by the imaging surface;
A selection step of selecting one scene as a scene candidate based on the state of the image output in the imaging step when a condition selection instruction is received;
When a selection change instruction is received after a scene candidate is selected, a selection change step of selecting and changing another scene different from the scene selected in the selection step as the scene candidate, and along the selected scene candidate An electronic camera corresponding to a program that executes an adjustment step for adjusting photographing conditions in cooperation with the internal control program.

Images