CN108419000A - Photographing element and its control method and picture pick-up device - Google Patents
Photographing element and its control method and picture pick-up device Download PDFInfo
- Publication number
- CN108419000A CN108419000A CN201810136488.9A CN201810136488A CN108419000A CN 108419000 A CN108419000 A CN 108419000A CN 201810136488 A CN201810136488 A CN 201810136488A CN 108419000 A CN108419000 A CN 108419000A
- Authority
- CN
- China
- Prior art keywords
- unit
- control
- photographing element
- gain
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/72—Combination of two or more compensation controls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Structure And Mechanism Of Cameras (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Exposure Control For Cameras (AREA)
Abstract
A kind of photographing element of present invention offer and its control method and picture pick-up device.Picture signal accessed by the camera unit of the photographing element output with multiple pixel units, the photographing element include：Gain unit, the gain for the output signal for the camera unit to be arranged；Control unit, the accumulated time for controlling the pixel unit；And arithmetic operation unit, for receiving target brightness value and spectrum assignment information, the gain or the accumulated time are calculated by using the picture signal detection brightness value read from the pixel unit, and the gain unit or described control unit is made to be exposed control to the camera unit.
Description
Technical field
The present invention relates to have the function of exposing the photographing element of arithmetical operation and using the picture pick-up device of sensor.
Background technology
In the presence of the picture pick-up device with the so-called live view function for sequentially showing captured image, such as camera lens can be more
Change camera etc..And it can be more using this in main body of the lens changeable mounted on picture pick-up device for shooting moving image
In the case of changing camera lens, the light of the lens changeable can be smoothly driven using multistage during the shooting of moving image
Circle.In addition, in main body of the lens changeable mounted on picture pick-up device for shooting static image and replaceable using this
In the case of camera lens, using less series come the aperture of the drive control lens changeable.In this case, due to aperture
Drive control series it is less, so if spend the time carry out drive control, then may will be difficult to promptly to exposure
Change makes a response.The control of aperture is carried out in the timing different from the electronic shutter of setting photographing element and the timing of gain
's.This may lead to the flicker of the image for the exposure difference being attributed between frame.Japanese Unexamined Patent Publication 2016-184874 discloses following
Picture pick-up device, picture element signal that wherein picture pick-up device is generated by amplifying camera element and change aperture opening and
Magnifying power adjusts the light exposure of image data.
Additionally, there are the Digital photographics for having the moving image for shooting the high frame frequency with 1000 frames/second (fps)
Machine.With due to digital camera have high functionality and cause the arithmetic processing unit (CPU) of picture pick-up device rate of load condensate and
Memory bandwidth increases, and worries do not have to complete the exposure calculating processing that CPU is carried out in the time between frames.If spending the time
It is exposed calculation processing, then following for exposure variations is become more to postpone, thus there is the flicker that may result in image
Exposure status the increased possibility of frame number.Japanese Unexamined Patent Publication 2009-296353 discloses following processing, wherein in the processing
In, the image information of photographing element is added for each color of color filter, and will add up value and be transmitted to
CPU.Image data transmission process the time it takes can be carried out by shortening to handle to accelerate the spectrum assignment of CPU.
In Japanese Unexamined Patent Publication 2016-184874, the bright of subject is calculated according to the image information read from photographing element
Degree, and control the gain of photographing element by being followed to the variation of aperture based on result of calculation.However, in aperture phase
In the case of for static image capture lens change dramatically, reads the timing that time of image information changes with aperture and differ
It causes, it is difficult to catch up with the control of gain, it is therefore possible to flicker.
In Japanese Unexamined Patent Publication 2009-296353, the information of the image captured by photographing element is added and exports to outside,
The data volume transmitted between photographing element and CPU is reduced, therefore the control exposed is accelerated.However, receiving additive value in CPU
Later, it needs according to programme diagram to carry out arithmetical operation to electronic shutter and gain, and there is high frame frequency when needing to be directed to
When moving image etc. carries out high-speed driving, exposure calculating processing delay is worried.In addition, since the variation for aperture is not taken
Measure, therefore may be flickered in image.
Invention content
The present invention is provided to control the photographing element of exposure and can reduce arithmetic processing using the photographing element
The picture pick-up device of the spectrum assignment treating capacity of unit.
According to aspects of the present invention, a kind of photographing element is obtained for exporting the camera unit with multiple pixel units
The picture signal got, the photographing element include：Gain unit is used to be arranged the output signal for being directed to the camera unit
Gain；Control unit, the accumulated time for controlling the pixel unit；And arithmetic operation unit, it is bright for receiving target
Angle value and spectrum assignment information, it is described to calculate to detect brightness value by using the picture signal read from the pixel unit
Gain or the accumulated time, and the gain unit or described control unit is made to be exposed control to the camera unit
System.
According to aspects of the present invention, a kind of control method of photographing element, the photographing element is for exporting with multiple
Picture signal accessed by the camera unit of pixel unit, the control method include the following steps：Receive target brightness value
With spectrum assignment information, brightness value is detected by using the picture signal read from the pixel unit to calculate gain or tire out
Product time, setting are directed to the gain of the output signal of the camera unit, and the accumulated time of the control pixel unit.
According to aspects of the present invention, a kind of photographing element is obtained for exporting the camera unit with multiple pixel units
The picture signal got, the photographing element include：Receiving unit, for receiving target brightness value or spectrum assignment information, with
Brightness value is detected by using the picture signal read from the pixel unit to calculate exposure parameter；And transmission unit,
For sending by using based on the target brightness value or the spectrum assignment information calculated exposure parameter of institute
The picture signal got.
According to the present invention it is possible to reduce the exposure of arithmetic processing unit by using the photographing element for controlling exposure
Control process amount.
According to following (refer to the attached drawing) to the explanation of exemplary embodiments, other feature of the invention will become obvious.
Description of the drawings
Fig. 1 is the schematic configuration diagram for showing photographing element according to an embodiment of the invention.
Fig. 2A and 2B is the figure for the structure for schematically showing photographing element according to an embodiment of the invention.
Fig. 3 is the sectional view for showing photographing element according to an embodiment of the invention.
Fig. 4 is the block diagram for the summary for showing camera system according to an embodiment of the invention.
Fig. 5 is the sequence diagram for the processing for showing the first embodiment of the present invention.
Fig. 6 is the flow chart of first embodiment according to the present invention.
Fig. 7 is flow chart according to the second embodiment of the present invention.
Fig. 8 is the sequence diagram for the processing for showing comparative example.
Fig. 9 is flow chart according to the fourth embodiment of the invention.
Figure 10 is the sequence diagram for the processing for showing the fourth embodiment of the present invention.
Figure 11 is the flow chart for the processing for showing camera system.
Specific implementation mode
As the embodiment of the present invention, the arithmetic that can cope with the picture pick-up device with high functionality will be detailed below
The processing load of processing unit or the increased photographing element and picture pick-up device of memory bandwidth.Due to because of photographing element
The increase of processing load or memory bandwidth caused by increase of pixel number etc., so if the time is spent to be exposed calculating
Processing then becomes more to postpone for following for exposure variations, this can lead to the flicker of image.According to each embodiment, it is possible to reduce
The spectrum assignment treating capacity of arithmetic processing unit, and exposure caused by the control of aperture, that flicker may be caused can be made
Light variation minimizes.
First embodiment
Fig. 1 is the schematic block diagram for the topology example for showing the photographing element according to the present embodiment.It is in two that photographing element, which has,
Tie up the structure of many pixel units 101 of array configuration arrangement.For example, stacked photographing element 506 has the (camera shooting of the first chip
Layer) 10 and second chip (circuit layer) 11.Camera signal processing circuit 507 handles the output signal of photographing element 506.Whole control
Arithmetic operation unit 509 processed is the core for controlling photographing element 506 and other Component units included in picture pick-up device
Unit.Although in the present embodiment, camera signal processing circuit 507 and whole control arithmetic operation unit 509 are provided as
Individual Component units, but the invention is not restricted to this, and these units can be included in the same circuit including CPU.
Vertical output line 102, transmission signal line 103, reseting signal line 104 and row selection signal line 105 are respectively connected to
Each pixel unit in pixel unit 101.Gain amplifier 110 is connected to pixel unit 101, and can be according to from following
The gain control signal (will be indicated by Sg) of element internal arithmetic unit 118 gain is set.It arranges ADC blocks 111 and exports and lead to
Cross to from be connected to the vertical output line 102 of pixel unit 101 via the signal that gain amplifier 110 exports simulated (A)/
Digital (D) converts obtained signal.Line-scan circuit 112 is selected by transmission signal line 103, reseting signal line 104 and row
Signal wire 105 and be connected to pixel unit 101.Company by horizontal signal lines 115-a and 115-b of multiple column scan circuits 113
It is connected to multiple row ADC blocks 111.Timing control unit 114 exports timing controling signal to row ADC blocks 111 and column scan circuit
Each in 113 is to control it.Note that although in the present embodiment, gain amplifier 110 with for amplify come from
The gain unit of the picture signal of pixel unit 101 is corresponding, but without being limited thereto for the amplifying unit of picture signal.Example
Such as, used conversion gain can be converted come amplified signal, or in digital conversion for number using row ADC blocks 111
Afterwards, amplified signal can be carried out using digital gain circuits (not shown).
Switch unit 116 switches the signal from horizontal signal lines 115-a and 115-b, and signal is exported to frame and is stored
Device 117 and element internal arithmetic unit 118.Parallel/serial converting unit (will be indicated by P/S converting units) 119 obtains member
The output of part internal arithmetic unit 118, and parallel/serial conversion is carried out to the output.After P/S converting units 119 will be converted
Signal export to camera signal processing circuit 507.
There is photographing element 506 first chip 10 to be stacked on the structure on the second chip 11.It is in square that first chip 10, which has,
Multiple pixel units 101 of battle array shaped formation, and it is configured in light incident side.That is, the first chip 10, which is located to receive, comes from quilt
Take the photograph the light incident side of the light of body.Pixel unit 101 is connected to transmission signal line 103, reset signal on (line direction) in the horizontal direction
Line 104 and row selection signal line 105, and it is connected to vertical output line 102 in a vertical direction (columns).Note that vertical
Each vertical output line in output line 102 has different connection destination according to the unit for reading row.
Such as gain amplifier 110, row ADC blocks 111, line-scan circuit 112, column scan electricity are formed in second chip 11
The pixel-driving circuit of road 113 and timing control circuit 114 etc., frame memory 117, element internal arithmetic unit 118 and
P/S converting units 119.
As described above, photographing element 506 has the first chip 10 for foring pixel unit 101 and forms pixel
Second chip 11 of driving circuit, memory circuit and arithmetic circuity etc..Can be directed to photographing element 506 camera shooting layer and
Circuit layer come divide manufacture processing, it is thereby achieved that the fine wiring of circuit layer, due to high density generate higher speed,
Miniaturization and high functionality.Note that a part of of the circuit of the second chip 11 can be arranged on the first chip.
The image that switch unit 116 selectively exports the slave horizontal signal lines 115-a and 115-b respectively with channel
Signal is sequentially output to frame memory 117.The picture signal that 117 interim storage of frame memory is exported.Element internal arithmetic
Unit 118 carries out arithmetical operation to the spectrum assignment in photographing element 506, and will be described below its details.P/S converting units
119 believe the image handled by element internal arithmetic unit 118 according to the timing controling signal from timing control circuit 114
Breath is converted, and transformed information is exported to the camera signal processing circuit 507 outside photographing element 506.
Exposure control unit 120 controls the exposure of pixel unit 101 according to the control command of element internal arithmetic unit 118.
Fig. 2A and 2B is the figure for the external structure for schematically showing the photographing element 506 according to the present embodiment.Fig. 2A is
The stereogram of photographing element 506 when being watched obliquely from light incident side.Fig. 2 B are the schematic sections of photographing element 506.The
One chip 10 and the second chip 11 respectively have multiple micro- pads 302, and via multiple dimpling blocks 301 by electrical connection one
Change.
Fig. 3 is the figure for the detail section structure for showing photographing element 506.In figure 3, the first chip 10 is illustrated in down
Side, and the second chip 11 is illustrated in upside.That is, camera shooting layer 401 it is corresponding with the first chip 10, and circuit layer 402 and
Second chip 11 is corresponding.
Imaging layer 401 has the structure that wiring layer 404 is formed on silicon (Si) substrate 403.Work is formed in Si substrates 403
For the n diffusion zones 407 of photodiode (will be indicated below by PD), therefore there is back side illuminaton structure.In the table of PD 202
(that is, in boundary part of PD and wiring layer 404) forms p on the part of face+Diffusion zone 408.In the surface element of Si substrates 403
Divide the upper multiple n formed for floating diffusion (FD)+Diffusion zone 409 and multiple n for switching transistor+Diffusion zone
410。
Wiring layer 404 has by silica (SiO2) etc. compositions insulating layer in formed multiple transistor gates match
Line 411 and signal propagate wiring 412.The surface portion of wiring layer 404 is formed with micro- pad 413 made of Cu etc..Utilize n+Expand
Dissipate region 409, n+Diffusion zone 410 and transistor gate wiring 411 form transmission transistor, reset transistor, amplification crystal
Pipe and selection transistor.Wiring layer 404 has for by n+Diffusion zone 410 is connected to logical hole (VIA) 414 of micro- pad 413.
Circuit layer 402 has the structure that wiring layer 406 is formed on Si substrates 405.The surface portion of Si substrates 405 is formed
There are multiple transistor diffusion regions 416.Wiring layer 406 has by SiO2Etc. compositions insulating layer in formed multiple transistors
Gate wirings 417 and signal propagate wiring 418.Micro- pad 419 made of Cu etc. is formed in the surface portion of wiring layer 406.
Micro- pad 419 is connected to micro- pad 413 via dimpling block 415.It is formed in wiring layer 406 for connecting diffusion zone 416 Deng
To the through-hole 420 of micro- pad 419.Wiring 418 etc. is propagated using transistor diffusion region 416, transistor gate wiring 417 and signal
Form various types of circuits.Since the details of constituent element are not directly dependent upon with the present invention, the description thereof will be omitted.To the greatest extent
Pipe is shown in FIG. 3 using the connection for carrying out camera shooting layer 401 and circuit layer 402 as the dimpling block 415 for stacking connection terminal
Topology example, but image the embodiment that layer 401 and circuit layer 402 are directly connected to without using dimpling block be also can
Can.
Then, it will illustrate the camera system of the present embodiment with reference to figure 4.Although the camera system of the present embodiment is to obtain fortune
Motion video or static image are as exemplary digital camera, however, the present invention is not limited thereto.For example, it may also be possible to apply the invention for
The mobile object etc. of mobile device, the onboard camera of supervision camera, smart phone etc. etc..Fig. 4 is to show to make
With the block diagram of the summary of the picture pick-up device of photographing element 506.Lens unit 501 includes the multiple of composition imaging optical system
Mirror.Lens unit 501 be may be mounted at lens changeable in camera body or with the integrated camera lens of camera body
Unit.Lens driving unit 502 drives movable lens included in imaging optical system, and (such as zoom lens and focusing are saturating
Mirror etc.).Mechanical shutter (being indicated by mechanical shutter in figure) 503 is for controlling the time for exposure, and aperture 504 is exposed for controlling
Light quantity.505 driving 503 He of mechanical shutter of mechanical shutter/aperture driving unit (being indicated by shutter/aperture driving unit in figure)
Aperture 504.Note that the optical filter of ND filters etc. can be set to the unit for controlling light exposure.
Photographing element 506 receives the light from the subject for forming image via imaging optical system, then to being received
The light arrived carries out opto-electronic conversion, and exports electric signal.Camera signal processing circuit 507 handles the output letter of photographing element 506
Number, and export treated picture signal.The storage of first memory unit (being indicated by memory cell I in figure) 508 is taken the photograph
Picture signal etc. as handled by signal processing circuit 507.
Whole control arithmetic operation unit 509 is responsible for the whole core cell for controlling camera system, and includes center
Processing unit (CPU).CPU is read by executing from second memory unit (in figure indicated by memory cell II) 514
Program controls the operation of each unit.Second memory unit 514 stores the arithmetic operation results of CPU and passes through user
Operate the camera information etc. being arranged in picture pick-up device.Recording medium control interface (I/F) unit 510 is calculated according to whole control
Picture signal etc. is recorded in recording medium 512 by the control command of art arithmetic element 509, and is carried out from recording medium 512
Information reading process.Recording medium 512 can be dismantled from the main body of picture pick-up device.Display unit 511 includes such as liquid crystal display
The display device of panel etc., and picture number is shown on picture according to the control command of whole control arithmetic operation unit 509
According to etc..External interface (I/F) unit 513 is the communication process list for exchanging information with the external device (ED) of computer etc.
Member.Operating unit 515 includes the input unit of switch and touch panel etc., receives the operation instruction of user, and will behaviour
It is exported to whole as indication signal and controls arithmetic operation unit 509.In addition, whole control arithmetic operation unit 509 will be by that will use
It is exported to photographing element 506 in the control signal for each constituent element for controlling photographing element 506 shown in FIG. 1, to control camera shooting
Element 506.It includes camera shooting synchronizing signal, drive mode setting or exposure setting information etc. to control signal.
It is adjusted with light quantity appropriate by aperture 504 by the light from subject of lens unit 501, and
And form image in the imaging surface of photographing element 506.Constitute the photoelectric conversion unit of the pixel unit 101 of photographing element 506
Opto-electronic conversion is carried out to the optical imagery of subject, and exports electric signal.Then, which is controlled by gain, passes through
A/D conversions are converted from analog into digital signal, are then obtained as the signal of R, Gr, Gb and B, are then transmitted to and take the photograph
As signal processing circuit 507.Camera signal processing circuit 507 carries out such as reducing the low-pass filtering treatment of noise, shade
Correction process or white balance processing etc. various types of signal processings, then also carry out various types of corrections or picture signal
Compression etc..
Lens driving unit 502 controls lens unit 501 to carry out zoom drive and focusing driving etc. during camera shooting.Machine
Tool shutter 503 and each free mechanical shutter/aperture driving unit 505 of aperture 504 are according to whole control arithmetic operation unit 509
Control command is driven.The interim storage picture signal after camera shooting of first memory unit 508.Recording medium controls I/F
Unit 510 is into being about to processing of the picture signal record in recording medium 512.Captured by display unit 511 is shown on picture
Image.
Here, the comparative example with reference to figure 8 is illustrated by the generation of the flicker caused by aperture driving and spectrum assignment.Figure
8 be the sequence diagram for the exposure control mechanism for showing comparative example.It is arranged to control photographing element 506 using camera shooting synchronizing signal 901
Accumulation and the timing read etc. and camera signal processing circuit 507 obtain the image information come from the transmission of photographing element 506
Periodically.The timing 902,903 and 904 that photographing element 506 is accumulated and read is instantiated, and by sensor setting come table
Show the timing 905,906 and 907 for operation to be arranged.
Gain is indicated for the gain set by each frame in photographing element 506.The increasing of element internal arithmetic unit 118
Benefit control signal carries out gain setting to gain amplifier 110.Gain 908 is " x1 ", and gain 909 is " x2 ", and gain 910
It is " x4 ".X2 indicates gain more higher leveled than x1.Accumulated time 911 is by photographing element 506 for set by each frame, and
Here, accumulated time is " fixed ".The downside of this indicates frame number.In being handled in element, in photographing element 506
The processing of progress indicates to receive the timing 912,913 and 914 of information from whole control arithmetic operation unit 509.In engine
In reason, the timing 915 of exposure arithmetic processing, 916 and are indicated for the processing carried out in integrally control arithmetic operation unit 509
917.It is assumed here that whole control 509 every two frame of arithmetic operation unit carries out single exposure arithmetic processing, and photographing element
506 are represented as receiving arithmetic results in the next frame.It is controlled about aperture, the mirror installed in picture pick-up device is indicated with figure line
The aperture control variation 918 of head device.This illustrate aperture be driven to each frame with level-one and by two frames by
Its stop down two-stage.About exposure, the variation of exposure status is instantiated in such a way：" suitable " expression proper exposure shape
State, " -1 " indicate that the under-exposed state of level-one, and " -2 " indicate the under-exposed state of two-stage.Period 919 indicates to expose
Light state changes from " suitable " to " -1 " and then further changes, is then back to " -2 " period of " -1 ".
Then, it will illustrate the flow of control.Whole control arithmetic operation unit 509 is based on exposure setting, program schema, survey
State of optical mode or subject etc. determines target brightness value, and retains the value in second memory unit 514.Separately
Outside, the brightness value of subject is calculated based on the image information just read from photographing element 506.Whole control arithmetical operation list
Member 509 is exposed arithmetical operation at timing 915, determines the accumulated time 911 to be arranged and gain 908, then will setting
Data transmission is to photographing element 506.The timing 905 that photographing element 506 is arranged in sensor is arranged in the timing for delaying a frame
912 information received.Therefore, which is reflected in the accumulated time and reading (902) of next frame.By read image
Information is transmitted to camera signal processing circuit 507 as the image information of frame number 3.As described above, from exposure arithmetical operation to
Delay time corresponding at least multiple frames is generated in the period that image information is read.It is whole to control in aperture control
Arithmetic operation unit 509 is using the image information after changing exposure due to the control, to be exposed arithmetical operation.By
In in order to follow aperture control variation and photographing element 506 is set, it is therefore desirable to spend the time follow operation after make exposure
Light state is stablized.Such as the case where static image capture lens, in the situation that aperture 504 significantly moves in a short period of time
Under, for example, if exposure status change dramatically within the period 919 of Fig. 8, flicker is likely to occur on image.Particularly,
The load for the arithmetical operation processing that whole control arithmetic operation unit 509 is carried out is increased in the pixel number to be read
Increase, and time lag occurs before exposure arithmetic results are reflected in the control of photographing element.In addition, also increased in frame frequency
In the case of, even if carrying out arithmetic processing in section at the same time, when being handled as unit of frame, the frame number of delay also can
Increase.Therefore, when the moving image obtained with high frame frequency slowly reproduces, the time that exposure is followed is not realized fully
Section significantly increases.
Illustrate according to the present embodiment for making the variation of exposure most using aperture control below with reference to Fig. 5 and Fig. 6
The control of smallization.Fig. 5 is the sequence diagram for showing the exposure control mechanism according to the present embodiment.Fig. 6 is for illustrating basis
The flow chart of the processing of the camera system of the present embodiment.
Fig. 5 shows that the camera shooting synchronizing signal 201 for photographing element 506, accumulation and reading timing 202~204, setting are fixed
When 205~207 and gain control formulate when 208~210.In addition, although showing accumulated time setting 211, frame number and aperture control
System variation 217, but they are identical with Fig. 8, therefore by description is omitted.It is institute in photographing element with the difference of Fig. 8
Processing in the element of execution.In being handled in element, show that exposure arithmetical operation timing 212,213 and 214 and information receive
Periodically 215 and 216.In being handled in element, arithmetical operation is exposed for each frame.That is, processing such as whole control in element
Arithmetic operation unit 509 is not influenced like that by the rate of load condensate of the CPU caused by the execution of other processing or memory bandwidth etc..It takes the photograph
Element 506 receives the setting information and object brightness of camera system in timing 215 from whole control arithmetic operation unit 509
Value.Then, photographing element 506 is single from whole control arithmetic operation unit 509 reception mechanical shutter/aperture driving in timing 216
505 institute's aperture control information to be used of member.
When starting camera system in figure 6, in S601, the whole arithmetic operation unit 509 that controls is by the photograph of camera system
Camera setting information and target brightness value are sent to photographing element 506.Camera setting information for example including exposure setting information,
Pattern information and subject information of drive mode, program schema or metering mode etc. etc..Photographing element 506 connects
Timing is received to be indicated by the timing 215 of Fig. 5.Although camera setting information and target brightness value are assumed to grasp whenever by user
Make to be sent to photographing element 506 when changing the setting of camera system, but these information can be sent at regular intervals.
In S602, the whole arithmetic operation unit 509 that controls initializes frame number (being indicated by N).In showing for Fig. 5
In example, the value of frame number N is initialized as zero.Frame number N is for making whole control arithmetic operation unit 509 and photographing element 506
Synchronous information.Initialization timing can be not only arranged once when starting camera system, can also be arranged whenever camera
Setting is multiple when information or target brightness value have variation.
The transmission process of aperture control information is carried out in S603.Aperture control information is to indicate to answer for which frame section
The information of how many grades of apertures of the control.In the case where controlling aperture 504, the whole arithmetic operation unit 509 that controls drives camera lens
Aperture control information used in moving cell 502 is transmitted to photographing element 506.The reception timing of photographing element 506 is determined by Fig. 5
When 216 indicate.In the example of hgure 5, aperture is made to reduce the control of level-one from current f-number respectively in frame number N=4 and N=5
Information (217) processed is transferred to photographing element 506 as aperture control information.Note that instead of being specified in aperture control information
Frame number can use following method, wherein this method to use the light for specifying the relative time relative to predetermined benchmark timing
Circle control information.In this case, into the processing for being about to relative time information and being converted to frame number in photographing element.In addition,
It can not be included in aperture control information with the relevant information of timing.In this case, control can with time restriction and
Predetermined delay (after frame etc.) starts.
S604 is whether to be the judgement processing of final frame to judgment frame, and integrally control arithmetic operation unit 509 and sentence
It is disconnected whether to terminate camera shooting processing.In the case where user clearly disconnects the power supply of camera system using operating unit 515,
In the case of stopping shooting or in the case where carrying out interim stopping processing by menu operation, camera shooting processing terminates.In frame
In the case of being judged as final frame, processing terminates, and in the case where it is not final frame that frame, which is judged as, and processing enters
The processing of S605.The processing of following step S605~S610 is carried out under the control of photographing element 506.It is set in addition to camera
In the case that confidence ceases or target brightness value existed other than the case where variation, for each frame not by camera setting information from entirety
Control arithmetic operation unit 509 is transmitted to photographing element 506.Therefore, it is possible to reduce whole to control arithmetic operation unit 509 and take the photograph
The traffic between element 506.
In S605, photographing element 506 is based on the aperture control information received from whole control arithmetic operation unit 509
To determine whether being the timing that carry out aperture operation to present frame.In the case where being judged as YES the timing of aperture operation, place
Reason enters the processing of S606, and in the case where it is not the timing to be judged as, processing goes to S607.
In S606, the element internal arithmetic unit 118 of photographing element 506 based on aperture control information come obtain due to
The caused luminance delta of aperture operation.In S607, element internal arithmetic unit 118 is according to luminance delta come to exposing
Light carries out arithmetical operation, to determine accumulated time and gain (referring to the timing 212 of Fig. 5).The case where luminance delta is zero
Under, continue the setting of previous frame.In S608, for the section of frame number 1, the accumulated time obtained in S607 and gain are set
(referring to the timing 205 of Fig. 5).Element internal arithmetic unit 118 makes exposure control unit 120 by the way that pixel unit 101 is arranged
Accumulated time be exposed control, and the yield value of gain amplifier 110 is set using gain control signal Sg.Structure
Gain amplifier 110 at gain unit is the variable gain amplifier that yield value can be arranged.Camera shooting member is carried out in S609
The camera operation of part 506.For example, accumulated process and reading process are sequentially carried out for each row in the section of frame number 2~3,
And image information is transmitted to frame memory 117 at frame number 3 (referring to the timing 202 of Fig. 5).
In S610, the element internal arithmetic unit 118 of photographing element 506 uses the image information of frame memory 117
The brightness value of subject is calculated, so that result of calculation is stored in second memory unit 514, and image information is transmitted to
Image processing unit outside photographing element.In S611, the whole arithmetic operation unit 509 that controls executes incremental place to frame number N
Reason.Add 1 to the value of frame number N, processing returns to S604 to continue, and repeats the processing until camera operation terminates.Note that Fig. 5
In timing 213,206 and 203 relationship and timing 214,207 and 204 relationship with timing 212,205 and 202 relationship
It is identical.Although carrying out the aperture operation of two-stage, the exposure status with Fig. 8 as shown in the aperture of Fig. 5 control variation 217
Different, Fig. 5 exposure status maintains suitable state always.
In the drive mode using stringent time application to handle moving image with high frame frequency (HRF) etc., remove
Other than the increase of the load or memory bandwidth of CPU, also worry not to be exposed at arithmetic in set time between frames
Reason.In this case, whole control arithmetic operation unit 509 can be exposed control according to the present embodiment to each frame.Separately
Outside, by the way that aperture control information is transmitted to photographing element 506 from whole control arithmetic operation unit 509, photographing element 506 can
To grasp the timing of aperture control in advance.Therefore, control can be exposed according to aperture operation by photographing element 506, come
The flicker of image caused by keeping aperture operation possible minimizes.In addition, in the replaceable camera system of camera lens, it can be according to photograph
The characteristic of the aperture for the lens assembly installed in owner's body controls to be exposed.
In the present embodiment, following processing example is illustrated, wherein in the processing example, photographing element 506 is from whole
Body controls arithmetic operation unit 509 and receives aperture control information and by the message reflection in the setting of next frame.The present invention
It is without being limited thereto, and the aperture control information that be sent to photographing element 506 may include that speed is followed in exposure.Speed is followed in exposure
Degree is the information of the speed for determining to follow exposure arithmetical operation from receiving aperture control information.In this feelings
Under condition, can be followed by the exposure received by photographing element 506 speed such as Fig. 5 timing 213 or 214 without
Reflect aperture control information in the exposure arithmetical operation for being timing 212, speed is followed to adjust exposure.In addition, in the present embodiment
In, even if being arranged new target brightness value aperture control period, and element internal arithmetic unit 118 is based on institute
The new target brightness value that receives is exposed arithmetical operation.The invention is not limited thereto, and photographing element 506 is in aperture
Control period can not receive new target brightness value.That is, element internal arithmetic unit 118 is exposed calculation in camera unit
New target brightness value is not received during art operation and control.It is applied to picture pick-up device according to this embodiment, it can reduce
On arithmetic processing unit to be exposed the processing load of control, and the original since image flicker may be used as can be made
Exposure variations minimize caused by the aperture control of cause.Note that can be according to whole control arithmetic operation unit 509 to driving
The control of pattern suitably switches Fig. 5 and operation shown in Fig. 8.Note that in addition to camera setting information and target brightness value,
Photographing element 506 can also be directed to, predetermined information is set.For example, range can be followed by setting, (maximum gain is minimum fast
Door speed etc.) etc., to be suitably exposed control.
Second embodiment
Then, it will illustrate the second embodiment of the present invention.Although illustrating that photographing element 506 has in the first embodiment
The structure of the function of arithmetical operation is exposed, but will be described for the arithmetic processing unit of switching camera system in the present embodiment
Exposure arithmetical operation function and photographing element 506 exposure arithmetical operation function processing.Note that will not be described and the
The identical item of item of one embodiment, and will mainly illustrate difference.This mode omitted the description is equally applicable to following
Embodiment.
Then, the flow chart with reference to figure 7 is illustrated to the processing of the camera system according to the present embodiment.Starting camera shooting system
When system, in S701, the whole arithmetic operation unit 509 that controls obtains the camera setting information that camera system is kept.Photograph
Machine setting information includes the drive mode (4K/Full HD/HD/HFR) for static image/moving image, exposure setting, journey
Sequence pattern, metering mode and subject information etc..In addition, by being maintained at according to the information on load of the CPU of various setting combinations
In second memory unit 514, and obtain the information on load.
In S702, the whole arithmetic operation unit 509 that controls judges whether to need the higher exposure arithmetical operation of precision.Example
Such as, it is assumed that following situation, wherein in this case, according to the facial or specific of the setting information of metering mode or subject
The information of organ (eyes etc.) needs some survey light arithmetical operations in photographing element 506.In this case, exist as follows
Possibility：To be difficult to be exposed arithmetic processing merely with photographing element 506, or cannot be with necessary precision at
Reason.In the case where being judged as needing the higher exposure arithmetical operation of precision, the whole arithmetic operation unit 509 that controls carries out S705
Processing, and in the case where being judged as not needing the higher exposure arithmetical operation of precision, processing enters the processing of S703.
In S703, the whole arithmetic operation unit 509 that controls judges to expose whether the arithmetical operation time has ampleness.It is based on
Processing load per unit time carries out the processing for judging time ampleness, and specifically, included in judgment frame
Pixel number and the image processing operations carried out for each signal quantity.Whole control arithmetic operation unit 509 is for example
Judge the processing load of next frame based on arrange parameter (drive mode or the content of data processing).The content of data processing
Purpose including processing, such as data are output for display or for showing and recording.Based on acquired driving
Information on load of pattern or CPU etc. come judge state whether be can be directed to each frame execute exposure arithmetic processing state.As
Arithmetic processing does not have the example of ampleness, for example, following situation is instantiated, wherein in this case, it is whole to control arithmetic fortune
It calculates unit 509 and detects subject, and need that there is the load that can not possibly be completed processing within the unit interval using testing result
The arithmetic processing of amount.In S703 in the case where being judged as that can be directed to each frame executes exposure arithmetic processing, processing is gone to
S705.On the other hand, in the case where treatment situation is unfavorable and is judged as not executing exposure arithmetic processing for each frame, processing
Into the processing of S704.
In S704, it is whole control arithmetic operation unit 509 be arranged photographing element 506 exposure control mode and to
The photographing element 506 notifies camera setting information.On the other hand, in S705, the whole arithmetic operation unit 509 that controls is arranged
The exposure control mode of whole control arithmetic operation unit 509.In this mode, by time for exposure and gain setting information from whole
Body control arithmetic operation unit 509 is sent to photographing element 506.After the processing of S704 or S705, processing enters S706's
Processing.In S706, whole control starts under the exposure control mode set in S704 or S705 of arithmetic operation unit 509
Camera operation, and reprocessed for each frame.
In S707, the whole arithmetic operation unit 509 that controls judges camera system (lens unit and camera body)
Whether state changes.In the case where being judged as that change has occurred in the state of camera system, processing is back to S701 with again
Secondary acquisition camera setting information, and handle continuation.In addition, not changing in the state for being judged as camera system in S707
In the case of change, processing enters the processing of S708.In S708, the whole arithmetic operation unit 509 that controls judges that camera shooting processing is
It is no to terminate.In the case where being judged as that camera shooting processing should terminate, a series of processing terminate.In the feelings that camera shooting processing continues
Under condition, processing is back to the processing of S706 to repeat camera shooting processing.
In the present embodiment, camera setting information is obtained, and according to the load condition of drive mode and CPU come appropriate
Ground switches two kinds of spectrum assignment.For example, the processing load in integrally control arithmetic operation unit 509 is greater than or equal to
In the case of threshold value, pattern is switched to the first spectrum assignment that photographing element is carried out, and is less than threshold in processing load
In the case of value, pattern is switched to whole the second spectrum assignment for controlling arithmetic operation unit 509 and being carried out.By in necessity
When be switched to the second spectrum assignment, the higher spectrum assignment of precision can be carried out.In addition, passing through the feelings larger in processing load
The first spectrum assignment is switched under condition, it is possible to reduce the processing load of whole control arithmetic operation unit 509.Note that two exposures
Light control mode is only example, and the present invention is not limited to switch the knot of the first exposure control mode and the second exposure control mode
Structure.In order to realize the processing of more complicated function, the structure of two exposure control modes can also be applied in combination.For example, Fig. 7's
Following processing is executed in S705, wherein in this process, the of the arithmetical operation carried out based on photographing element is applied in combination
One exposure control mode and the second exposure control mode carried out by integrally controlling arithmetic operation unit 509.Optionally, make
With the judging result under the conditions of further decision, execute it is as third exposure control mode, the first spectrum assignment mould is applied in combination
The control of formula and the second exposure control mode.Note that whole control arithmetic operation unit 509 can have the unit can be from taking the photograph
Element 506 obtains the structure of predetermined information.For example, it is also possible to obtain the arithmetic that element internal arithmetic unit 118 is obtained
The setting value of operation result or gain or electronic shutter speed.Indicate that photographing element 506 has reached further, it is also possible to obtain
The information of the state of the exposure limit that the photographing element can follow etc..
3rd embodiment
Then, it will illustrate the third embodiment of the present invention.In the first embodiment, following example is illustrated, wherein
In the example, gain phase is equably carried out in the picture in the structure with exposure arithmetical operation function of photographing element 506
Multiply processing.In the present embodiment, in the region in shooting picture multiplication processing is carried out using different yield values.Specifically
Ground, the example that will be described below, wherein in this example, element internal arithmetic unit 118 controls gain amplifier 110, and
And different yield values is applied in the vertical direction of picture.
Then, it will illustrate the spectrum assignment according to the present embodiment with reference to figure 5.It is narrow due to being carried out in moving image capture
Seam, which rolls, reads (slit rolling reading), therefore the accumulation timing in the upper and lower part of shooting picture is different
's.In Figure 5, the gain that the progress aperture of corresponding timing 209 starts the frame number 4 of variation is being set with the sensor of frame number 2
Setting.Show that on picture yield value is equably set as the example of " x2 ".In the present embodiment, in order to change the upper of picture
The yield value in portion and lower part, photographing element 506 change the gain setting of each horizontal line.Due in the example of hgure 5, yield value exists
Change between " x1 " and " x2 ", therefore for the most uplink of picture setting " x1 ", and for the most downlink of picture setting " x2 ".
For the yield value between the row setting " x1 " and " x2 " between most uplink and most downlink (for example, more than 1 times of default value
And less than 2 times of yield value of default value) so that yield value is equally distributed on these rows.Equally, in the gain of next frame
In setting, (give tacit consent to for example, being greater than or equal to for from the yield value being most up between the row setting " x2 " and " x3 " of most downlink
Value 2 times and less than or equal to default value 3 times of yield value) so that yield value is equally distributed on these rows.In addition,
In the gain setting of next frame, for the yield value being arranged from the row for being most up to most downlink between " x3 " and " x4 " so that
Yield value is equally distributed on these rows.
In the present embodiment, the frame image accumulated during being operated for aperture, can be to avoid in the vertical direction of picture
Unequal exposure status.Although the exemplary embodiments of the present invention are explained above, however, the present invention is not limited thereto and can be
It deforms or changes in various ways in the range of the gist of the invention.
Fourth embodiment
Then, it will illustrate the fourth embodiment of the present invention.The arithmetic of switching camera system is illustrated in a second embodiment
The processing of the function of the exposure arithmetical operation of processing unit and the function of the exposure arithmetical operation of photographing element 506.On the other hand,
In the present embodiment, explanation is applied in combination to the function and camera shooting member of the exposure arithmetical operation of the arithmetic processing unit of camera system
The processing of the function of the exposure arithmetical operation of part 506.
Then, the flow chart with reference to figure 9 is illustrated to the processing of the camera system according to the present embodiment.Starting camera shooting system
When system, in S1101, the whole arithmetic operation unit 509 that controls obtains the camera setting information that camera system is kept.Note
Meaning, camera setting information include for static image/moving image drive mode (4K/Full HD/HD/HFR), exposure
Setting, program schema, metering mode and subject information etc..
In S1102, the whole arithmetic operation unit 509 that controls judges whether to need the higher exposure arithmetical operation of precision.
For example it is assumed that following situation, wherein in this case, according to the face or spy of the setting information of metering mode or subject
The information for determining organ (eyes etc.) needs some survey light arithmetical operations in photographing element 506.In this case, exist as
Under possibility：Be difficult to be exposed arithmetic processing merely with photographing element 506, or cannot be with necessary precision at
Reason.In the case where being judged as needing the higher exposure arithmetical operation of precision, the whole arithmetic operation unit 509 that controls carries out
The processing of S1104 so that processing goes to the exposure control that whole control arithmetic operation unit 509 and photographing element 506 is applied in combination
Molding formula.In addition, in the case where being judged as not needing the higher exposure arithmetical operation of precision, processing enters the processing of S1103,
So that processing goes to the exposure control mode of photographing element 506.It is whole to control arithmetic operation unit in S1103 and S1104
509 notify camera setting information to photographing element 506.The example of the higher exposure arithmetic processing of precision is for example including whole control
Arithmetic operation unit 509 processed detects subject and using testing result come the case where carrying out arithmetic processing.
It is whole to control the exposure control mode set in S1103 or S1104 of arithmetic operation unit 509 in S1105
Lower beginning camera operation, and reprocessed for each frame.In S1106, the whole arithmetic operation unit 509 that controls judges camera shooting
Whether the state of system (lens unit and camera body) changes.Changed in the state for being judged as camera system
In the case of, processing is back to S1101 to obtain camera setting information again, and handles continuation.In addition, in S1106
In the case of being judged as that the state of camera system does not change, processing enters the processing of S1107.It is whole to control in S1107
Arithmetic operation unit 509 judges whether camera shooting processing should terminate.In the case where being judged as that camera shooting processing should terminate, a system
Column processing terminates.In the case where camera shooting processing continues, processing is back to the processing of S1105 to repeat camera shooting processing.
In the present embodiment, it will illustrate the exposure for the arithmetic processing unit that camera system is applied in combination with reference to figure 10 and Figure 11
The camera shooting processing of the function of light arithmetical operation and the function of the exposure arithmetical operation of photographing element 506.Figure 10 is shown according to this
The sequence diagram of the exposure control mechanism of embodiment.Figure 11 is the flow of the processing for illustrating the camera system according to the present embodiment
Figure.
Figure 10 shows the camera shooting synchronizing signal 1001 for photographing element 506, accumulation and reads timing 1002~1004, sets
1008~1010 when setting timing 1005~1007 and gain control formulation.In addition, show accumulated time setting 1011, frame number, with
And the variation 1026 of aperture control.Although showing exposure arithmetic timing 1012,1013 and 1014, Yi Jixin in being handled in element
Breath receives timing 1015 and 1016, but these are periodically identical as the timing in Fig. 5, therefore by description is omitted.With Fig. 5's
Difference is to be handled by integrally controlling in the engine that arithmetic operation unit 509 executes.In being handled in engine, exposure arithmetic is shown
1020~1022 when operation timing 1017, setting timing 1018 and 1019 and gain control are formulated.In addition, showing by making biography
The overall gain 1023~1025 that sensor gain and engine multiplied by gains are determined.The engine gain of shooting since frame number 0
Setting value is determined using the exposure arithmetical operation timing 1017 of engine.It takes a picture in addition, being sent simultaneously to photographing element 506
Machine setting information, target brightness value and spectrum assignment information.The case where arithmetic processing being carried out in being handled in element for each frame
Under, in being handled in engine, arithmetic processing is carried out at the first timing or intermittent timing, therefore the load of CPU can be reduced
The influence of rate or memory bandwidth etc..
In fig. 11, when starting camera system, in S1201, the whole arithmetic operation unit 509 that controls identifies Fig. 9's
The camera setting information of acquired camera system and the exposure arithmetical operation in engine is carried out in S1101.For example, one
Camera setting information is programme diagram.Control range is divided into photographing element 509 by whole control arithmetic operation unit 509
Control range in control range and engine.The integral multiple of the control range processing 1008~1010 of photographing element 509 etc.
Yield value to simplify amount of arichmetic operations, and the circuit scale in photographing element 509 can be reduced.On the other hand, due to drawing
The circuit including more complicated arithmetical operation can be carried out is held up, therefore the control range processing in engine is directed to photographing element 509
For be difficult to carry out the yield value of the mixed decimal point of arithmetical operation.As an example, photographing element 509 and engine can share them
Role.
In S1202, whole control arithmetic operation unit 509 will be with the relevant camera setting information of camera system and mesh
Mark brightness value is sent to photographing element 506.In the present embodiment, camera setting information is assumed to include programme diagram.Photograph
It includes the pattern letter for exposing setting information, drive mode, program schema and metering mode etc. that machine setting information, which can have,
The structure of breath and subject information etc..The reception timing of photographing element 506 is indicated by the timing 1015 of Figure 10.Although photograph
Machine setting information and target brightness value are assumed to be sent to whenever changing the setting of camera system by user's operation
Photographing element 506, but these information can be sent at regular intervals.
In S1203, the whole arithmetic operation unit 509 that controls carries out just frame number (being indicated in the present embodiment by N)
Beginningization.In the present embodiment, the value of frame number N is initialized as zero.Note that frame number N is for making whole control arithmetical operation list
First 509 information synchronous with photographing element 506.Initialization timing can be not only arranged once when starting camera system, may be used also
To be arranged repeatedly in the presence of when changing whenever camera setting information or target brightness value.
In S1204, the transmission process of aperture control information is carried out.Aperture control information is to indicate which frame section be directed to
The information of how many grades of apertures should be controlled.In the case where controlling aperture 504, the whole arithmetic operation unit 509 that controls is by camera lens
Aperture control information used in driving unit 502 is transmitted to photographing element 506.The reception timing of photographing element 506 is by Figure 10
Timing 1016 indicate.The control information that aperture reduces level-one from current f-number is set (to become respectively in frame number N=4 and N=5
1026) change is transferred to photographing element 506 as the aperture control information in the present embodiment.Note that believing instead of being controlled in aperture
Designated frame number in breath can use following method, wherein this method to use and specify relative to the opposite of predetermined benchmark timing
The aperture control information of time.In this case, into the place for being about to relative time information and being converted to frame number in photographing element
Reason.In addition, can not be included in aperture control information with the relevant information of timing.In this case, control can with when
Between limitation and predetermined delay (after frame etc.) start.
S1205 is whether to be the judgement processing of final frame to judgment frame, and integrally control arithmetic operation unit 509 and sentence
It is disconnected whether to terminate camera shooting processing.In the case where user clearly disconnects the power supply of camera system using operating unit 515,
In the case of stopping shooting or in the case where carrying out interim stopping processing by menu operation, camera shooting processing terminates.In frame
In the case of being judged as final frame, processing terminates, and in the case where it is not final frame that frame, which is judged as, and processing enters
The processing of S1206.The place of following step S1206~S1209, S1211 and S1212 are carried out under the control of photographing element 506
Reason.In the case of other than there is the case where variation in addition to camera setting information or target brightness value, it will not be shone for each frame
Camera setting information is transmitted to photographing element 506 from whole control arithmetic operation unit 509.Therefore, it is possible to reduce whole control
The traffic between arithmetic operation unit 509 and photographing element 506.
In S1206, photographing element 506 controls letter based on the aperture received from whole control arithmetic operation unit 509
Breath is to determine whether be the timing that carry out aperture operation to present frame.Taking the photograph to camera body is installed in lens unit 501
As in system, f-number changes according to the variation of focal length.Therefore, light is received from whole control arithmetic operation unit 509 in advance
Circle control information, and equally judge whether it is the timing that aperture operation is carried out to each frame.It is being judged as YES aperture operation
In the case of timing, processing enters the processing of S1207, and in the case where it is not the timing of aperture operation to be judged as, processing
Go to S1208.
In S1207, the element internal arithmetic unit 118 of photographing element 506 based on aperture control information come obtain by
In the luminance delta that aperture operation is caused.In S1208, element internal arithmetic unit 118 according to luminance delta come
Arithmetical operation is carried out to exposure, to determine accumulated time and gain (referring to the timing 1012 of Figure 10).It is zero in luminance delta
In the case of, continue the setting of previous frame.In S1209, for the section of frame number 1, when the accumulation obtained in S1207 is set
Between and gain (referring to the timing 1005 of Figure 10).Element internal arithmetic unit 118 makes exposure control unit 120 by the way that picture is arranged
The accumulated time of plain unit 101 controls to be exposed, and gain amplifier 110 is arranged using gain control signal Sg
Yield value.The gain amplifier 110 for constituting gain unit is the variable gain amplifier that yield value can be arranged.
It is whole to control arithmetical operation list in the case where accumulated time and gain is arranged in photographing element 506 in S1210
The gain of engine is arranged in member 509.By the way that the gain of mixed decimal point is arranged in engine, exposure can be finely controlled.In this reality
It applies in example, as shown in Figure 10, sets gain " x3/4 " to engine gain 1021, and set gain " x3/4 " to engine and increase
Benefit 1022.The overall gain used in camera system is determined by making photographing element 506 be multiplied with engine, and by gain
" x1 " is set as overall gain 1023, sets gain " x3/2 " to overall gain 1024, and set gain " x3 " to overall gain
1025。
In S1211, the camera operation of photographing element 506 is carried out.For example, suitable for each row in the section of frame number 2 and 3
Secondary progress accumulated process and reading process, and image information is transmitted to the (timing of Figure 10 of frame memory 117 at frame number 3
1002).In S1212, the element internal arithmetic unit 118 of photographing element 506 according to the image information of frame memory 117 come
The brightness value for calculating subject, makes result of calculation be stored in second memory unit 514, and image information is transmitted to and is taken the photograph
Image processing unit outside element.In S1213, the whole arithmetic operation unit 509 that controls executes incremental place to frame number N
Reason.Add 1 to the value of frame number N, processing is back to S1205 to continue, and repeats the processing until camera operation terminates.Note that
The relationship of timing 1013,1006 and 1003 in Figure 10 and the relationship of timing 1014,1007 and 1004 and timing 1012,1005
It is identical with 1002 relationship.Although carrying out 1/3 grade of aperture operation as shown in the aperture of Figure 10 control variation 1026,
Always suitable exposure status is maintained.
There is a situation where as follows：Such as in the case where expectation is exposed according to the testing result of subject to control, in the phase
In the case of the exposure for hoping control unequal caused by flickering or it is expected according to metering mode come the case where controlling exposure
Under, it is expected that the gain of camera system is more finely controlled.In this case, according to the present embodiment, by the way that camera is arranged
Information is sent to photographing element 506 and the exposure arithmetical operation and camera shooting of whole control arithmetic operation unit 509 is applied in combination
The exposure arithmetical operation of element 506 come be exposed control, can the processing rate of load condensate and memory bandwidth that make CPU increase most
Control is more accurately exposed while smallization.
Although illustrating the present invention by reference to exemplary embodiments, it is to be understood that, the present invention is not limited to disclosed allusion quotations
Type embodiment.The range of following claims should be given widest understanding, so as to comprising it is all it is such modification and
Equivalent structure and function.
This application claims on 2 10th, the 2017 Japanese patent application 2017-022782 submitted and November 27 in 2017
The equity for the Japanese patent application 2017-227175 that day submits, above-mentioned document is whole by reference to be incorporated herein.
Claims (14)
1. a kind of photographing element, special for exporting the picture signal accessed by the camera unit with multiple pixel units
Sign is that the photographing element includes：
Gain unit, the gain for the output signal for the camera unit to be arranged；
Control unit, the accumulated time for controlling the pixel unit；And
Arithmetic operation unit is read for receiving target brightness value and spectrum assignment information by using from the pixel unit
Picture signal and detect brightness value to calculate the gain or the accumulated time, and make the gain unit or the control
Unit processed is exposed control to the camera unit.
2. photographing element according to claim 1, wherein the arithmetic operation unit using the spectrum assignment information into
The arithmetical operation of the variable quantity of row brightness value calculates accumulated time corresponding with the variable quantity, and makes described control unit
Control is exposed to the camera unit.
3. photographing element according to claim 2, wherein
The spectrum assignment information includes the information for the timing for indicating that the aperture for the photographing element operates, and
The arithmetic operation unit carries out the brightness value in the case where being judged as YES the timing for carrying out the aperture operation
The arithmetical operation of variable quantity.
4. photographing element according to claim 2, wherein the arithmetic operation unit is come using the spectrum assignment information
It obtains exposure and follows the information of speed, and determine that executing to follow the exposure operated for the aperture of the photographing element calculates
The timing of art operation.
5. photographing element according to claim 3, wherein new receiving even if carrying out the aperture operation
In the case of target brightness value, the arithmetic operation unit also carries out arithmetical operation using the new target brightness value.
6. photographing element according to claim 2, wherein the arithmetic operation unit is in the gain unit and the control
In the case that unit processed is exposed control to the camera unit, new target brightness value is not received.
7. photographing element according to claim 1, wherein the arithmetic operation unit is calculated for each row of shooting picture
Different gains value, to control the setting of the gain unit.
8. a kind of picture pick-up device, including：
Photographing element according to claim 1；And
Arithmetic processing unit, for the target brightness value and the spectrum assignment information to be sent to the photographing element.
9. picture pick-up device according to claim 8, wherein the arithmetic processing unit obtains set in imaging optical system
The control information for the aperture set detects the brightness value of subject from the picture signal accessed by the photographing element, and
It is exposed arithmetical operation.
10. picture pick-up device according to claim 9, wherein the arithmetic processing unit is carried out for described
The first control of arithmetical operation and the arithmetic fortune to use the arithmetic processing unit to be carried out are exposed in photographing element
The result of calculation is exposed the photographing element hand-off process that switches between the second control of control.
11. picture pick-up device according to claim 10, wherein the arithmetic processing unit be more than in processing load
Or switch and in the case where the processing load is less than the threshold value equal to being controlled to described first in the case of threshold value
To the processing of the second control switching.
12. picture pick-up device according to claim 9, wherein the arithmetic processing unit is applied in combination to take the photograph described
The first control and the arithmetical operation to use the arithmetic processing unit to be carried out that arithmetical operation is exposed in element
Result be exposed the second control of control to the photographing element and control.
13. a kind of control method of photographing element, the photographing element is used to export the camera unit with multiple pixel units
Accessed picture signal, which is characterized in that the control method includes the following steps：
Target brightness value and spectrum assignment information are received,
Brightness value is detected by using the picture signal read from the pixel unit to calculate gain or accumulated time,
The gain of output signal for the camera unit is set, and
Control the accumulated time of the pixel unit.
14. a kind of photographing element, special for exporting the picture signal accessed by the camera unit with multiple pixel units
Sign is that the photographing element includes：
Receiving unit, for receiving target brightness value or spectrum assignment information, with by using reading from the pixel unit
Picture signal and detect brightness value to calculate exposure parameter；And
Transmission unit, for sending by using based on the calculated institute of the target brightness value or spectrum assignment information institute
The picture signal stated exposure parameter and got.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110740960.1A CN113596289B (en) | 2017-02-10 | 2018-02-09 | Image sensor and image pickup apparatus |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2017022782 | 2017-02-10 | ||
| JP2017-022782 | 2017-02-10 | ||
| JP2017227175A JP6580111B2 (en) | 2017-02-10 | 2017-11-27 | Imaging device and imaging apparatus |
| JP2017-227175 | 2017-11-27 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110740960.1A Division CN113596289B (en) | 2017-02-10 | 2018-02-09 | Image sensor and image pickup apparatus |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| CN108419000A true CN108419000A (en) | 2018-08-17 |
| CN108419000B CN108419000B (en) | 2021-06-29 |
| CN108419000B9 CN108419000B9 (en) | 2022-01-14 |
Family
ID=63174321
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810136488.9A Active CN108419000B9 (en) | 2017-02-10 | 2018-02-09 | Image pickup element and image pickup apparatus |
Country Status (3)
| Country | Link |
|---|---|
| JP (2) | JP6580111B2 (en) |
| KR (2) | KR102333346B1 (en) |
| CN (1) | CN108419000B9 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109474790A (en) * | 2018-11-05 | 2019-03-15 | 浙江大华技术股份有限公司 | Exposure adjustment method, device and video camera and computer storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPWO2022250000A1 (en) * | 2021-05-24 | 2022-12-01 |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080151086A1 (en) * | 2006-12-20 | 2008-06-26 | Canon Kabushiki Kaisha | Image capturing apparatus, control method therefor, program, and storage medium |
| JP4124882B2 (en) * | 1998-10-08 | 2008-07-23 | キヤノン株式会社 | Imaging apparatus and control method |
| US20100097492A1 (en) * | 2008-10-22 | 2010-04-22 | Samsung Electro-Mechanics Co., Ltd. | Apparatus and method for controlling auto exposure |
| CN101840925A (en) * | 2009-03-19 | 2010-09-22 | 索尼公司 | Semiconductor device and manufacture method thereof and electronic equipment |
| US20140078358A1 (en) * | 2012-09-14 | 2014-03-20 | Canon Kabushiki Kaisha | Solid-state imaging apparatus and driving method of solid-state imaging apparatus |
| US20150181095A1 (en) * | 2013-12-25 | 2015-06-25 | Sony Corporation | Control device, control method, and exposure control system |
| CN105338235A (en) * | 2014-07-28 | 2016-02-17 | 华为技术有限公司 | Automatic aperture adjustment method and device |
| CN105611189A (en) * | 2015-12-23 | 2016-05-25 | 北京奇虎科技有限公司 | Automatic exposure parameter adjustment method and device and user equipment |
| CN106027914A (en) * | 2015-03-26 | 2016-10-12 | 奥林巴斯株式会社 | Imaging device and imaging method |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH01287632A (en) * | 1988-05-16 | 1989-11-20 | Olympus Optical Co Ltd | Camera system |
| JP4277216B2 (en) * | 2005-01-13 | 2009-06-10 | ソニー株式会社 | Imaging apparatus and imaging result processing method |
| JP5495841B2 (en) * | 2010-02-22 | 2014-05-21 | オリンパスイメージング株式会社 | Camera and camera control method |
| JP5696513B2 (en) * | 2011-02-08 | 2015-04-08 | ソニー株式会社 | SOLID-STATE IMAGING DEVICE, ITS MANUFACTURING METHOD, AND ELECTRONIC DEVICE |
| JP6618235B2 (en) * | 2012-12-28 | 2019-12-11 | キヤノン株式会社 | Imaging device and imaging apparatus |
| JP6272387B2 (en) * | 2015-05-29 | 2018-01-31 | キヤノン株式会社 | Imaging device and imaging apparatus |
| JP6466786B2 (en) * | 2015-06-12 | 2019-02-06 | オリンパス株式会社 | Imaging apparatus, imaging method, and program |
-
2017
- 2017-11-27 JP JP2017227175A patent/JP6580111B2/en active Active
-
2018
- 2018-01-29 KR KR1020180010380A patent/KR102333346B1/en active IP Right Grant
- 2018-02-09 CN CN201810136488.9A patent/CN108419000B9/en active Active
-
2019
- 2019-08-23 JP JP2019153008A patent/JP2019213216A/en active Pending
-
2021
- 2021-11-26 KR KR1020210165053A patent/KR102413830B1/en active IP Right Grant
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4124882B2 (en) * | 1998-10-08 | 2008-07-23 | キヤノン株式会社 | Imaging apparatus and control method |
| US20080151086A1 (en) * | 2006-12-20 | 2008-06-26 | Canon Kabushiki Kaisha | Image capturing apparatus, control method therefor, program, and storage medium |
| US20100097492A1 (en) * | 2008-10-22 | 2010-04-22 | Samsung Electro-Mechanics Co., Ltd. | Apparatus and method for controlling auto exposure |
| CN101840925A (en) * | 2009-03-19 | 2010-09-22 | 索尼公司 | Semiconductor device and manufacture method thereof and electronic equipment |
| US20140078358A1 (en) * | 2012-09-14 | 2014-03-20 | Canon Kabushiki Kaisha | Solid-state imaging apparatus and driving method of solid-state imaging apparatus |
| US20150181095A1 (en) * | 2013-12-25 | 2015-06-25 | Sony Corporation | Control device, control method, and exposure control system |
| CN105338235A (en) * | 2014-07-28 | 2016-02-17 | 华为技术有限公司 | Automatic aperture adjustment method and device |
| CN106027914A (en) * | 2015-03-26 | 2016-10-12 | 奥林巴斯株式会社 | Imaging device and imaging method |
| CN105611189A (en) * | 2015-12-23 | 2016-05-25 | 北京奇虎科技有限公司 | Automatic exposure parameter adjustment method and device and user equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109474790A (en) * | 2018-11-05 | 2019-03-15 | 浙江大华技术股份有限公司 | Exposure adjustment method, device and video camera and computer storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108419000B9 (en) | 2022-01-14 |
| JP6580111B2 (en) | 2019-09-25 |
| KR20200067253A (en) | 2020-06-12 |
| CN108419000B (en) | 2021-06-29 |
| JP2019213216A (en) | 2019-12-12 |
| KR102333346B1 (en) | 2021-12-03 |
| KR102413830B1 (en) | 2022-06-28 |
| KR20210148054A (en) | 2021-12-07 |
| JP2018129789A (en) | 2018-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101262565B (en) | Imaging method, imaging apparatus, and driving device | |
| US7978240B2 (en) | Enhancing image quality imaging unit and image sensor | |
| CN101052101B (en) | Apparatus and method for image pickup | |
| CN100568928C (en) | Filming apparatus and method | |
| CN101247467B (en) | Amplification-type solid-state image capturing apparatus and electronic information device | |
| CN105324985A (en) | Electronic apparatus, electronic apparatus control method, and control program | |
| CN103139494B (en) | Camera head | |
| CN106210463B (en) | Photographic device and picture pick-up device | |
| CN102104727A (en) | Image pickup apparatus and method | |
| JP2015094925A (en) | Focus adjustment device, focus adjustment method and program, and imaging device having focus adjustment device | |
| JP6947590B2 (en) | Imaging device, control method of imaging device | |
| CN104025565A (en) | Image pickup apparatus, method for image compensation and computer-readable recording medium | |
| CN107710744A (en) | Picture pick-up device and picture pick-up device | |
| RU2394388C1 (en) | Image forming device and method of controlling said device | |
| KR102413830B1 (en) | Imaging element and imaging apparatus | |
| JPWO2011043045A1 (en) | Imaging device, solid-state imaging device, image generation method, and program | |
| CN105934944A (en) | Electronic device, imaging device, and imaging element | |
| CN101296329A (en) | Image picking-up apparatus and control method thereof | |
| CN113596289B (en) | Image sensor and image pickup apparatus | |
| CN1435721A (en) | Picture pick-up device | |
| CN1981515A (en) | Imaging equipment, imaging component, control method thereof | |
| US11089217B2 (en) | Image-pickup apparatus and control method thereof | |
| CN110495165A (en) | Photographing element and photographic device | |
| CN104469142A (en) | Image capturing apparatus and control method thereof | |
| CN101931750B (en) | Enlarging section control device and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CI03 | Correction of invention patent | ||
| CI03 | Correction of invention patent |
Correction item: Claims Correct: Claims submitted on December 6, 2021 False: Claims submitted on March 25, 2021 Number: 27-01 Page: ?? Volume: 37 |