CN101557469A - Image processing device and image processing method - Google Patents
Image processing device and image processing method Download PDFInfo
- Publication number
- CN101557469A CN101557469A CNA2009100077801A CN200910007780A CN101557469A CN 101557469 A CN101557469 A CN 101557469A CN A2009100077801 A CNA2009100077801 A CN A2009100077801A CN 200910007780 A CN200910007780 A CN 200910007780A CN 101557469 A CN101557469 A CN 101557469A
- Authority
- CN
- China
- Prior art keywords
- virtualization
- background image
- photograph mode
- judged
- intensity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Studio Devices (AREA)
Abstract
The invention provides an image processing device and image processing method capable of acquiring high quality blur image without complex setting and operation by users. The device includes a blur processing equipment for blurring inputted background image data, a photograph mode judging equipment for judging photograph mode of displayed photograph scene of the background image being photographed, and a blur strength decision device for deciding blur strength of the blur processing according to the judged photograph mode.
Description
Technical field
The present invention relates to image processing equipment and image processing method, relate in particular to the image processing system of the virtualization image that can obtain high image quality.
In addition, the present invention can be applied to digital camera, and in the control method of digital camera.
Background technology
The employed imaging apparatus of small-sized digital camera is littler than employed imaging apparatus of single lens reflex camera or silver salt photograph, and therefore, for the image of the same view angle of photographing, the focal length of needed photographic optical system is also short.
Focal length in short-term, even the F number of photographic optical system is identical, the depth of field also can deepen.
When focal length shortens, if the F number is dwindled in proportion, the depth of field is shoaled, but like this just need make photographic optical system become heavy caliberization, can increase size and cost thus.
Therefore, when photographing with small-sized digital camera, for big relatively distance range, focus is aimed at.
This point is when the image of the identical lightness of photography, and its strong point is to obtain the less image of virtualization, but when background virtualizations such as photography portrait painting became important images, background is photographed brightly can become problem points on the contrary.
In order to address this problem, for example in patent documentation 1-4 motion come the camera of virtualization background by image processing.
In the camera that patent documentation 1-4 is put down in writing, change virtualization intensity according to distance, thereby reproduce virtualization with far and near sense to subject.
Also have, in patent documentation 2, the user can adjust virtualization intensity.But, the camera that patent documentation 2 is put down in writing can carry out on the multiple performance this point, owing to can adjust arbitrarily and outstanding virtualization intensity, but it is because be not easy to confirm virtualization intensity, so and impracticable by the compact display apparatus such as LCD of camera.
And, in patent documentation 3, be the virtualization intensity conversion to be become to be equal to 135 specifications photograph.
Further, in patent documentation 4, carry out virtualization and handle though disclose to handle by gaussian filtering or smoothing, do not mention use any.
As mentioned above, carry out in the image processing equipment or image processing method that virtualization handles,, exist the problem of the visual cognition of the shape of not considering virtualization or virtualization shape though be to change virtualization intensity existing
[patent documentation 1] spy opens flat 9-318870 communique
[patent documentation 2] spy opens flat 11-266388 communique
[patent documentation 3] spy opens the 2003-37767 communique
[patent documentation 4] spy opens the 2006-140594 communique
Summary of the invention
The present invention In view of the foregoing, purpose is to provide a kind of image processing equipment and image processing method, it need not user complicated especially setting or operation, just can obtain high-quality virtualization image.
To achieve these goals, technical scheme 1 of the present invention provides a kind of image processing equipment, it comprises the virtualization processing unit that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising: the photograph mode decision maker, the photograph mode of its photography sight when showing that described background image is photographed is judged; Virtualization intensity determination device, it decides the virtualization intensity of described virtualization processing according to the photograph mode of being judged.
According to the formation of technical scheme 1, because be to decide virtualization intensity, so just can obtain suitable virtualization degree corresponding to the photography sight according to the photograph mode that shows the photography sight.
Technical scheme 2 of the present invention provides a kind of image processing equipment, it comprises the virtualization processing unit that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising: virtualization intensity adjusting device, its virtualization intensity that described virtualization is handled is adjusted; The photograph mode decision maker, the photograph mode of its photography sight when showing that described background image is photographed is judged; Virtualization intensity initial value determination device, it decides the initial value of described virtualization intensity adjusting device according to the photograph mode of being judged.
According to the formation of technical scheme 2, because be to set the initial value of virtualization intensity according to the photograph mode that shows the photography sight, so just can obtain in the initial condition suitable virtualization degree corresponding to the sight of photographing.
Technical scheme 3 of the present invention provides a kind of image processing equipment, it comprises the virtualization processing unit that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising: virtualization intensity adjusting device, its virtualization intensity that described virtualization is handled is adjusted; The photograph mode decision maker, the photograph mode of its photography sight when showing that described background image is photographed is judged; Virtualization intensity adjusting range determination device, it decides the adjusting range of described virtualization intensity adjusting device according to the photograph mode of being judged.
According to the formation of technical scheme 3, because be the adjusting range of setting virtualization intensity according to the photograph mode that shows the photography sight, so just can obtain to prevent from photographs, to carry out the effect of factitious virtualization processing.
Technical scheme 4 of the present invention provides a kind of image processing equipment, it comprises the virtualization processing unit that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising: the photograph mode decision maker, the photograph mode of its photography sight when showing that described background image is photographed is judged; Virtualization shape determination device, it decides the virtualization shape of described virtualization processing according to the photograph mode of being judged.
According to the formation of technical scheme 4, because be to decide virtualization shape (shape of virtualization or the vividness of shape), so just can obtain suitable virtualization image corresponding to the photography sight according to the photograph mode that shows the photography sight.
Technical scheme 5 of the present invention provides a kind of image processing equipment, it comprises the virtualization processing unit that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising: the picture characteristics decision maker, its characteristic to described background image data is judged; Virtualization shape determination device, it decides the virtualization shape of described virtualization processing according to the picture characteristics of being judged.
According to the formation of technical scheme 5, because be that characteristic according to background image decides virtualization shape (shape of virtualization or the vividness of shape), so just have the effect that can obtain corresponding to the suitable image of background image content.
Technical scheme 6 of the present invention is characterized in that according to technical scheme 5 described image processing equipments: described picture characteristics decision maker is to judge picture characteristics according to the maximum of view data.
According to the formation of technical scheme 6, because be that maximum according to background image data decides virtualization shape (shape of virtualization or the vividness of shape), so just have the effect that can obtain corresponding to the suitable image of background image content.
Technical scheme 7 of the present invention is characterized in that according to technical scheme 5 described image processing equipments: described picture characteristics decision maker is to judge picture characteristics according to the mean value of view data.
According to the formation of technical scheme 7, because be that mean value according to background image data decides virtualization shape (shape of virtualization or the vividness of shape), so just have the effect that can obtain corresponding to the suitable image of background image content.
Technical scheme 8 of the present invention provides a kind of image processing method, it comprises the virtualization treatment step that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising: the photograph mode determination step, the photograph mode of its photography sight when showing that described background image is photographed is judged; Virtualization intensity deciding step, it decides the virtualization intensity of described virtualization processing according to the photograph mode of being judged.
According to the formation of technical scheme 8, because be to decide virtualization intensity, so just can obtain suitable virtualization degree corresponding to the photography sight according to the photograph mode that shows the photography sight.
Technical scheme 9 of the present invention provides a kind of image processing method, it comprises the virtualization treatment step that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising: virtualization intensity set-up procedure, its virtualization intensity that described virtualization is handled is adjusted; The photograph mode determination step, the photograph mode of its photography sight when showing that described background image is photographed is judged; Virtualization intensity initial value deciding step, it decides the initial value of described virtualization intensity set-up procedure according to the photograph mode of being judged.
According to the formation of technical scheme 9, because be to set the initial value of virtualization intensity according to the photograph mode that shows the photography sight, so just can obtain in the initial condition suitable virtualization degree corresponding to the sight of photographing.
According to the formation of technical scheme 10, because be the adjusting range of setting virtualization intensity according to the photograph mode that shows the photography sight, so just can obtain to prevent from photographs, to carry out the effect of factitious virtualization processing.
According to the formation of technical scheme 11, because be to decide virtualization shape (shape of virtualization or the vividness of shape), so just can obtain suitable virtualization image corresponding to the photography sight according to the photograph mode that shows the photography sight.
Technical scheme 12 of the present invention provides a kind of image processing method, it comprises the virtualization treatment step that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising: the picture characteristics determination step, its characteristic to described background image data is judged; Virtualization shape deciding step, it decides the virtualization shape of described virtualization processing according to the picture characteristics of being judged.
According to the formation of technical scheme 12, because be that characteristic according to background image decides virtualization shape (shape of virtualization or the vividness of shape), so just have the effect that can obtain corresponding to the suitable image of background image content.
Technical scheme 13 of the present invention is characterized in that according to technical scheme 12 described image processing methods: described picture characteristics determination step is to judge picture characteristics according to the maximum of view data.
According to the formation of technical scheme 13, because be that maximum according to background image data decides virtualization shape (shape of virtualization or the vividness of shape), so just have the effect that can obtain corresponding to the suitable image of background image content.
Technical scheme 14 of the present invention is characterized in that according to technical scheme 12 described image processing methods: described picture characteristics determination step is to judge picture characteristics according to the mean value of view data.
According to the formation of technical scheme 14, because be that mean value according to background image data decides virtualization shape (shape of virtualization or the vividness of shape), so just have the effect that can obtain corresponding to the suitable image of background image content.
Technical scheme 15 of the present invention is characterized in that: be digital camera according to any one described image processing equipment in the technical scheme 1 to 7.
According to the formation of technical scheme 15, because any one described formation in the technique scheme 1 to 7 is adapted in the digital camera, so just can obtain the identical effect of formation with technique scheme 1 to 7.
According to technical scheme of the present invention, just can provide to need not user complicated especially setting or operation, just can obtain the image processing equipment and the image processing method of more high-quality virtualization image.
Description of drawings
With reference to following to accompanying drawing detailed explanation can understand complete description to public technology and feature thereof faster and betterly.Wherein,
The formation summary module figure of the digital camera of one of image processing equipment that [Fig. 1] is involved in the present invention execution mode and connection machine thereof.
[Fig. 2] is the 1st execution mode that the background image virtualization is handled (A).(B) be the 2nd execution mode that the background image virtualization is handled.
[Fig. 3] (A)-(D) is the shooting process mode figure of image processing equipment involved in the present invention.
[Fig. 4] is the 3rd execution mode that the background image virtualization is handled (A).(B) be the 4th execution mode that the background image virtualization is handled.
The illustration figure of filtration coefficient A～C during the virtualization of [Fig. 5] background is handled.
Embodiment
Below, use image that the basic comprising of image processing equipment of the present invention is elaborated.
Also have, the following stated execution mode is a preferred forms of the present invention, thereby has added required various qualifications technically, and still, scope of the present invention if do not limit record especially, just is not limited to these modes in following explanation.
Shown in Figure 1 be image processing equipment involved in the present invention an execution mode digital still camera (digital camera) and connect the summary module figure of the formation of machine.
In Fig. 1,01 represents digital camera devices; 02 representative is in order to control all and systems control division that is provided with, be made of CPU, nand flash memory memory, SDRAM, clock etc. of digital camera devices 01; 03 representative is provided with, drives the image pickup part that loop, A/D converter etc. constitute by optical system components (lens and lens motor), CCD, CCD for shooting; 04 representative image handling part, when it is included in the obtained picture signal of image pickup part is carried out various image processing, CCD to image pickup part 03 drives opportunity, the lens CD-ROM drive motor is carried out zoom, focusing, exposure adjustment after controlling, and the image processing DSP (digital signal processor), the RAM etc. that are provided with for the compression elongation of carrying out image.05 represents display control unit, comprise carrying out and be used for the handled picture signal of image processing part is shown to signal processing in the LCD, generation is used for the various images portrait of user interface, and it is shown in the LCD and D/A converter that is provided with and screen display (On Screen Display) controller etc.; 06 representative shows portrait, and shows the LCD that is used for the image of user interface and is provided with; 07 representative is used for the recording medium interface portion that interface with recording medium is provided with, is made of memory card controller etc.; 08 represents recording medium, it comprises and is used to remember the flash memories that is provided with about the various information of the picture signal of compression or image etc., can be loaded and unloaded on digital camera devices 01:09 and represent the hardkey interface portion, it comprises that the state that is used for user interfaces such as not shown key, dials detects, and be used to control the main power source of host CPU, constitute by secondary CPU etc.; 10 represent communication interface part, are used to connect the laggard row data communication of USB, comprise communication controler; 11 represent PC (personal computer), and it is connected to 01 li of digital camera devices by USB, and the image of digital camera devices 01 is transmitted afterwards or plays, or logarithmic code camera apparatus 01 carries out various settings.
At first, describe for starting action.
When the user pressed not shown power knob, hardkey interface portion 09 was just connected the power supply of host CPU is supplied with.
Host CPU in the systems control division 02 at first begins visit (executive program) from guiding (boot) portion of nand flash memory, and by boot with programmed data transfer in SDRAM.
Go after the transmission of SDRAM finishes, program implementation pointer (programmed counting) is moved on in the program on the SDRAM after the transmission, just begin to start processing later on by the program on the SDRAM.
Start in the processing and comprise the initialization of OS (operating system), the initialization process that produces processing, recording medium of lens barrel etc.
Producing of lens barrel handled by being situated between by image processing part 04, every the interval (2ms) of regulation, pulse signal paid in the lens CD-ROM drive motor to image pickup part 03 carry out.
Also have, the initialization process of recording medium is to be situated between by recording medium interface portion 07, power supply and clock supplied to 08 li of recording medium after, initialization directive is sent to 08 li of recording medium.Actual initialization process is performed in recording medium 08, and whether systems control division 02 finishes in order to detect it, comes the state of poll (polling) recording medium 08 with the interval of 10ms.
Action when next explanation is photographed.
The user operates not shown various keys, dial earlier before photography, with decision photograph mode (macro mode: Macro Mode, Portrait: Portrait Mode etc.).
User's content of operation is differentiated by systems control division 02 by hardkey interface portion 09, and systems control division 02 is according to operation, the guide image is generated to 05 li of display control unit after, allow the user carry out ensuing operation.
Systems control division 02 is set to 04 li of image processing part with the processing parameter that is dependent on pattern after photograph mode is determined.
Perhaps operate not shown zoom lever and decide image angle (composition) by the user.
After user's content of operation was differentiated by systems control division 02 by hardkey interface portion 09, systems control division 02 was controlled image pickup part 03 according to operation, and drives lens.
Camera data is delivered to 04 li of image processing part continuously, after image processing part 04 place carries out colour space transformation, gamma revisal, white balance adjustment etc. and handles, view data is delivered to 05 li of display control unit.
At display control unit 05 place, view data is carried out being shown in the LCD06 after the signal processing, to point out the shooting state to the user.
When pressing not shown release-push (release button), this operation and mode initialization are similarly differentiated by systems control division 02 by hardkey interface portion 09.
Systems control division 02 is read the image of compression, and again behind the additional header information, is written to 08 li of recording medium by recording medium interface 07.
More than, just finished a series of photography action.
[the 1st execution mode (background virtualization)]
Below, the 1st execution mode of the manner of execution that the background virtualization of the feature in the image processing equipment involved in the present invention is handled describes.
Be in the digital camera involved in the present invention shown in Fig. 2 (A), show the action flow chart of the background virtualization of the 1st execution mode.
Shown in the motion flow in the present embodiment is when the virtualization processing capacity is set to opening, the action when described release-push is pressed.
The unlatching of virtualization processing capacity, close with the setting of described photograph mode similarly, set in advance by user's operation.
When release-push was pressed, systems control division 02 was controlled image processing part 04 and image pickup part 03, and carried out the scanning motion (step 01-001) of CCDAF.
Here, the summary to CCDAF describes.
Usually, have in the electronic image pickup apparatus of two-dimentional imaging apparatus at digital camera or video camera etc., carry out the acutance that image signal after the light-to-current inversion detects picture according to the imaging apparatus place, and control is carried out making that acutance is maximum after the focal adjustments to the position of focus lens.Generally, this acutance diminishes when focus is in the virtualization state, can become big when in focus, and just reach maximum when focus is in complete alignment.CCDAF be will to focus lens from unlimited far-end when near-end slowly moves, make a video recording to the body of being photographed in position at plural number, and from by the view data of the plural number of being made a video recording, the focusing position of image that can obtain high sharpness is as focal position.
Focusing, image that image pickup part 03 and image processing part 04 are carried out above-mentioned steps are taken into (step 01-002).
Then, the calculating (step 01-003) of distance is carried out in each position of 02 pair of each image of systems control division.
Below, explain with reference to Fig. 3.
In Fig. 3 (A), the photography of the image that 100 representatives are taken into, 101 represent 1 AF evaluation of estimate zone.
As shown in the figure, AF evaluation of estimate zone obtains the AF evaluation of estimate (aggregate value of the contrast of image in the field) in each field for cutting apart the little field that photography obtains equably by the scanning of CCDAF.
Systems control division 02 will scan the AF evaluation of estimate of each lens position that obtains by CCDAF, and algorithm is according to the rules resolved each field, and judge the activation point that is equivalent to the lens in the AF evaluation of estimate peak.
Further, systems control division 02 all is transformed to apart from information from the activation point of present zoom position (focal lengths of lens) with lens for each field.
Here, the AF evaluation of estimate is for each pixel in the AF evaluation of estimate zone, calculates the HPF (high-pass filtering) of its horizontal direction, the high-frequency composition that is obtained is added up to obtain after adding.
The HPF coefficient can use for example ki={-1, and-2,6 ,-2 ,-1} equivalence.
K0 is by the coefficient behind the product in the pixel of coordinate of horizontal direction-2 of concerned pixel, k1 is by the coefficient behind the product in the pixel of coordinate of horizontal direction-1 of concerned pixel, k2 is by the coefficient behind the product in the concerned pixel, k3 be in the pixel of coordinate of horizontal direction+1 of concerned pixel by the coefficient behind the product, k4 is by the coefficient behind the product in the pixel of coordinate of horizontal direction+2 of concerned pixel.
When obtaining apart from information,, calculate by following formula according to Gauss's imaging side formula from the AF evaluation of estimate.
1/a+1/b＝1/f
a＝b×f/(b-f)
Here, a represents the distance from lens to the body of being photographed, the distance between b represents from lens to the imaging apparatus, and f represents the focal length of lens.
Wherein, from lens to by the photography body apart from a be need try to achieve apart from information.Also have, the zoom position of the focal length f of lens during by photography as one man tried to achieve, and resulting activation point to focus lens was as one man tried to achieve when the distance b between from lens to the imaging apparatus was peak value by the AF evaluation of estimate.As mentioned above, just can access the full field in the image angle 100 each AF evaluation of estimate zone 101 apart from information.
In Fig. 3 (A), 102 representatives are by the zone after the AF focusing.
Systems control division 02 is judged the regional A in the minimum distance among the AF evaluation of estimate zone of picture middle body, and will be judged as main subject zoning with the AF equidistant zoning in zone (block) as the AF zone.
In Fig. 3 (B), the main subject zoning of 103 representatives (main subject zoning 103 comprises AF zone 102).
Systems control division 02 is judged main subject field (step 01-004) according to the information of the main subject zoning 103 that is obtained and the image of being made a video recording.This handles the image processing (profile extractions) by before, and the field of the arbitrary shape that comprises main subject zoning 103 is judged.
Here, systems control division 02 decides filter sizes fs (step 01-005 described later from current photograph mode; The photograph mode decision maker, virtualization intensity determination device).
It shown in the table 1 example of setting the fs value according to photograph mode.
Table 1
| Photograph mode | The fs value |
| Portrait | 5 |
| The night |
11 |
| The macroshot pattern | 13 |
In table 1, photograph mode is the photograph mode of expression photography sight, and the fs value is the value of the fs of this photograph mode when selected.
In Fig. 3 (C), the main subject of 104 representatives field.
In Fig. 3 (D), the 105th, photographs, the 106th, main subject, the 107th, the main subject image of extracting out, the 108th, background image, the 109th, the background image of virtualization, 110 represent composograph.
In the extraction of main subject is handled,, just can carry out the extraction of main subject and handle by coming separate picture along main subject field 104.Consequently, photographs 105 is separated into main subject image 107 and background image 108.
In the virtualization of background image is handled, spatial filtering is applicable to 108 li of background images after, can generate virtualization background image 109.
Spatial filtering is as shown in the formula shown in 1, by (level and smooth filtration is calculated in In (x, y)) lining, and (k (ix, iy)) just can obtain output image (Out (x, y)) at input picture.
Input picture (the coordinate figure that x among the In (x, y)) and y represent concerned pixel (horizontal coordinate x, vertical coordinate y).Also have, in following formula 1, Coordinate Calculation result (x+ix-fs/2, and y+iy-fs/2) is become integer behind the fractions omitted, and goes after cut to indicate in the input picture.
Filtration coefficient (position that ix among the k (ix, iy)) and iy represent filtration coefficient (horizontal direction ix, vertical direction iy).
Through type 1, the value of concerned pixel are replaced as the mean value of its neighboring pixel (length of side on one side is the square of size fs).
When fs increased, the size in equalization field also increased, and just can obtain stronger virtualization effect.
During fs=1,,, do not have the effect of virtualization so its value does not change because only be the mean value of concerned pixel yet.
In synthetic the processing, with main subject image 107 overlap onto virtualization 109 li of background images after synthesize, to generate composograph 110.
The composograph that is generated is situated between and is shown to (step 01-007) in the LCD06 by display control unit 05.
02 pair of image processing part 04 of systems control division is controlled, and the image after synthetic is compressed, and read compressed view data, has added after the header information again, is written to 08 li of recording medium (step 01-008) by recording medium interface 07.
[the 2nd execution mode (background virtualization)]
Below, the 2nd execution mode that the background virtualization of carrying out the characteristics in the image processing equipment involved in the present invention is handled explains.
Be in the digital camera involved in the present invention shown in Fig. 2 (B), the flow chart of the 2nd execution mode of background virtualization motion flow.
Motion flow in the present embodiment is identical with the 1st execution mode, is that the virtualization processing capacity is set to when starting the action when described release-push is pressed.
Step 02-001～004 is identical with step 01-001～004.
In step 02-005, systems control division 02 decides initial value and restriction (limit) value (the step 02-005 of filter sizes fs from current photograph mode; The photograph mode decision maker, virtualization intensity adjusting device, virtualization intensity initial value determination device, virtualization intensity adjusting range determination device).
It shown in the table 2 example of setting fs initial value (initial value of virtualization intensity adjusting device) and limits value (adjusting range of virtualization intensity adjusting device) according to photograph mode.
Table 2
| Photograph mode | The initial value of Fs | The Fs limits value |
| Portrait | 5 | 9 |
| The night |
11 | 15 |
| The macroshot pattern | 13 | 15 |
In table 2, photograph mode is the photograph mode of expression photography sight, and the initial value of fs and limits value are initial value and the limits values of the fs of this photograph mode when selected.
Step 02-006～007 is identical with step 01-006～007.
When the change of virtualization intensity is performed (step 02-008), systems control division 02 deducts 2 according to this operation with the value of fs, or carry out image processing after add (step 02-010) once more, but before this change, judge that earlier after changing fs value is whether below the limits value of above-mentioned table 2 (step 02-009), if greater than limits value, just do not change.When the change of fs is performed, just turn back in the step 02-006.
In addition, when the value of fs is discontented with 1, do not carry out change yet.
When carrying out definite operation (step 02-011), image compression after systems control division 02 control image processing part 04 will synthesize, and read compressed view data, behind the additional header information, just write recording medium 08 (step 02-012) again by recording medium interface portion 07.At this moment, also with paying in the header information of being obtained apart from information.
According to the above-mentioned the 1st and the 2nd execution mode,, just can obtain suitable virtualization degree corresponding to the photography sight because be to decide virtualization intensity according to the photograph mode that shows the photography sight.Especially, being adapted to pass through visual cognition is not that enough good display device carries out the formation that virtualization is handled.
[the 3rd execution mode (background virtualization)]
Below, the 3rd execution mode that the background virtualization of carrying out the feature in the image processing equipment involved in the present invention is handled explains.Especially, in the present embodiment, shown example is after deciding virtualization shape (vividness) according to photograph mode, carries out virtualization and handles.
Be in the digital camera involved in the present invention shown in Fig. 4 (A), carry out the action flow chart of the 3rd execution mode that the background virtualization handles.
Shown in the motion flow in the present embodiment is that the virtualization processing capacity is in starting state, the action when described release-push is pressed.
The startup of virtualization processing capacity, close with the setting of described photograph mode in the same manner, set in advance by user's operation.
Step 03-001～004 is identical with step 01-001～004.
Systems control division 02 decides described later according to current photograph mode, be used for background image is carried out filtration coefficient (the step 03-005 of virtualization; The photograph mode decision maker, virtualization shape determination device).
This decision can be carried out with reference to the correspondence table shown in the following table 3, with decision filtration coefficient (coefficient A～C).
Table 2
| Photograph mode | Filtration coefficient |
| Common photograph mode | Conversion A |
| Portrait | Conversion B |
| The night scene photograph mode | Conversion C |
In table 32, photograph mode is current photograph mode, and the filtration coefficient representative is corresponding to the filtration coefficient of photograph mode.
Filtration coefficient A～the C that uses during about step 03-006 institute comes illustration with Fig. 5.Here, in the present embodiment, fs=9.
Virtualization shape when the part among Fig. 5 shown in the wave-like line is represented to put as virtualization, the focus form that presents when being equivalent to the optics virtualization.
A compares with coefficient, and near the coefficient value the part shown in the wave-like line will arrive in the coefficient B, and therefore, the virtualization profile in its output image is visual cognition more brightly.And coefficient C compares with coefficient B, and its value is bigger, and the virtualization profile that is obtained also more brightly can visual cognition.
Therefore, night scene mode is compared with common photograph mode, can emphasize the profile of more virtualization, thus the virtualization can realize that the distinctive highlighted part of night scene manifests the time.
Portrait is positioned in the centre position of common photograph mode and night scene mode, can emphasize the sunlight that sees through tree branches and leaves that often occurs in the background of portrait photo etc. preferably.
Step 03-006～0084 is identical with step 01-006～008.
[the 4th execution mode (background virtualization)]
Below, in image processing equipment involved in the present invention, the 4th execution mode that carries out the background virtualization processing of feature explains.Especially, in the present embodiment, shown example is after deciding virtualization shape (vividness) according to photograph mode, carries out virtualization and handles.
Be in the digital camera involved in the present invention shown in Fig. 4 (B), carry out the action flow chart of the 4th execution mode that the background virtualization handles.
Motion flow in the present embodiment is identical with the 1st execution mode, and shown is that the virtualization processing capacity is in starting state, the action when described release-push is pressed.
Step 04-001～004 is identical with step 03-001～004.
In step 04-005, systems control division 02 calculates the briliancy mean value and the maximum (step 04-005) of background image 108.
Here, though the picture characteristics in the present embodiment refers to the briliancy of background image data, the present invention is not limited thereto.That is, the picture characteristics among the present invention both can be the briliancy of background image data, and the characteristic beyond the briliancy, can also be the briliancy of background image data and the characteristic beyond the briliancy are merged use.
Then, according to mean value that calculates and maximum, decide the filtration coefficient that is used for the virtualization background image.
This determining method can carry out with reference to the correspondence table shown in the following table 4, to determine filtration coefficient ((the step 04-006 of coefficient A～C); The picture characteristics decision maker, virtualization shape determination device).
Table 4
| Mean value | Maximum | Filtration coefficient |
| Discontented 96 | Discontented 224 | Conversion A |
| More than 96 | Discontented 224 | Conversion A |
| More than 96 | More than 224 | Conversion B |
| Discontented 96 | More than 224 | Conversion C |
In table 4, mean value is the mean value (mean value of view data) of the briliancy that calculates, and maximum is the maximum (maximum of view data) of the briliancy that calculates, and filtration coefficient is corresponding to mean value and peaked filtration coefficient.
In addition, the Fig. 5 that illustrates in filtration coefficient and the 3rd execution mode is identical.
When the maximum of briliancy is bigger, when promptly in image, having comprised high briliancy part, just can realize that the virtualization profile is by the virtualization after clearly emphasizing.Further, as night scene the sort of briliancy mean value less in, profile just more can have been emphasized in the chosen back of coefficient C, thereby can realize the virtualization after the distinctive highlighted part of night scene manifests.
Step 04-007～009 is identical with step 03-006～008.
In the above-mentioned the 3rd and the 4th execution mode, though be shape invariance to virtualization, and the explanation that the situation after the vividness of virtualization profile changed is done also can be that the shape to virtualization changes, or with shape and vividness combination and variation.During this situation,, just can be achieved by filtration coefficient shown in Figure 5 being changed to content corresponding to desirable variation.
According to the above-mentioned the 3rd and the 4th execution mode, because be according to the photograph mode that shows the photography sight or the characteristic of background image data, decide virtualization shape (shape of virtualization or the vividness of shape), so just can obtain effect corresponding to the suitable virtualization image of photography sight or background image content.Also have,, need not just can to carry out virtualization and handle through complicated especially setting according to above-mentioned formation.
From the above many improvement and variation can also be arranged, within the scope of the claims, the disclosure of this patent specification is not limited to above-mentioned explanation.
The basis of present patent application and priority request be on March 7th, 2008, at the Japanese patent application JP2008-058152 of Japan Patent office application, its full content draws the do combination at this.
Claims (15)
1. image processing equipment, it comprises the background image data that is transfused to is carried out the virtualization processing unit that virtualization is handled, and the background image after the output virtualization, it is characterized in that comprising:
The photograph mode decision maker, the photograph mode of its photography sight when showing that described background image is photographed is judged;
Virtualization intensity determination device, it decides the virtualization intensity of described virtualization processing according to the photograph mode of being judged.
2. image processing equipment, it comprises the background image data that is transfused to is carried out the virtualization processing unit that virtualization is handled, and the background image after the output virtualization, it is characterized in that comprising:
Virtualization intensity adjusting device, its virtualization intensity that described virtualization is handled is adjusted;
The photograph mode decision maker, the photograph mode of its photography sight when showing that described background image is photographed is judged;
Virtualization intensity initial value determination device, it decides the initial value of described virtualization intensity adjusting device according to the photograph mode of being judged.
3. image processing equipment, it comprises the background image data that is transfused to is carried out the virtualization processing unit that virtualization is handled, and the background image after the output virtualization, it is characterized in that comprising:
Virtualization intensity adjusting device, its virtualization intensity that described virtualization is handled is adjusted;
The photograph mode decision maker, the photograph mode of its photography sight when showing that described background image is photographed is judged;
Virtualization intensity adjusting range determination device, it decides the adjusting range of described virtualization intensity adjusting device according to the photograph mode of being judged.
4. image processing equipment, it comprises the background image data that is transfused to is carried out the virtualization processing unit that virtualization is handled, and the background image after the output virtualization, it is characterized in that comprising:
The photograph mode decision maker, the photograph mode of its photography sight when showing that described background image is photographed is judged;
Virtualization shape determination device, it decides the virtualization shape of described virtualization processing according to the photograph mode of being judged.
5. image processing equipment, it comprises the background image data that is transfused to is carried out the virtualization processing unit that virtualization is handled, and the background image after the output virtualization, it is characterized in that comprising:
The picture characteristics decision maker, its characteristic to described background image data is judged;
Virtualization shape determination device, it decides the virtualization shape of described virtualization processing according to the picture characteristics of being judged.
6. image processing equipment according to claim 5 is characterized in that:
Described picture characteristics decision maker is to judge picture characteristics according to the maximum of view data.
7. image processing equipment according to claim 5 is characterized in that:
Described picture characteristics decision maker is to judge picture characteristics according to the mean value of view data.
8. image processing method, it comprises the background image data that is transfused to is carried out the virtualization treatment step that virtualization is handled, and the background image after the output virtualization, it is characterized in that comprising:
The photograph mode determination step, the photograph mode of its photography sight when showing that described background image is photographed is judged;
Virtualization intensity deciding step, it decides the virtualization intensity of described virtualization processing according to the photograph mode of being judged.
9. image processing method, it comprises the background image data that is transfused to is carried out the virtualization treatment step that virtualization is handled, and the background image after the output virtualization, it is characterized in that comprising:
Virtualization intensity set-up procedure, its virtualization intensity that described virtualization is handled is adjusted;
The photograph mode determination step, the photograph mode of its photography sight when showing that described background image is photographed is judged;
Virtualization intensity initial value deciding step, it decides the initial value of described virtualization intensity set-up procedure according to the photograph mode of being judged.
10. image processing method, it comprises the background image data that is transfused to is carried out the virtualization treatment step that virtualization is handled, and the background image after the output virtualization, it is characterized in that comprising:
Virtualization intensity set-up procedure, its virtualization intensity that described virtualization is handled is adjusted;
The photograph mode determination step, the photograph mode of its photography sight when showing that described background image is photographed is judged;
Virtualization intensity adjusting range deciding step, it decides the adjusting range of described virtualization intensity set-up procedure according to the photograph mode of being judged.
11. an image processing method, it comprises the virtualization treatment step that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising:
The photograph mode determination step, the photograph mode of its photography sight when showing that described background image is photographed is judged;
Virtualization shape deciding step, it decides the virtualization shape of described virtualization processing according to the photograph mode of being judged.
12. an image processing method, it comprises the virtualization treatment step that the background image data that is transfused to is carried out the virtualization processing, and the background image after the output virtualization, it is characterized in that comprising:
The picture characteristics determination step, its characteristic to described background image data is judged;
Virtualization shape deciding step, it decides the virtualization shape of described virtualization processing according to the picture characteristics of being judged.
13. image processing method according to claim 12 is characterized in that:
Described picture characteristics determination step is to judge picture characteristics according to the maximum of view data.
14. image processing method according to claim 12 is characterized in that:
Described picture characteristics determination step is to judge picture characteristics according to the mean value of view data.
15., it is characterized in that: be digital camera according to any one described image processing equipment in the claim 1 to 7.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2008058152A JP5117889B2 (en) | 2008-03-07 | 2008-03-07 | Image processing apparatus and image processing method |
| JP058152/08 | 2008-03-07 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110059243.9A Division CN102176736B (en) | 2008-03-07 | 2009-02-24 | Image processing device and image processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101557469A true CN101557469A (en) | 2009-10-14 |
| CN101557469B CN101557469B (en) | 2011-05-11 |
Family
ID=41175396
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110059243.9A Expired - Fee Related CN102176736B (en) | 2008-03-07 | 2009-02-24 | Image processing device and image processing method |
| CN2009100077801A Active CN101557469B (en) | 2008-03-07 | 2009-02-24 | Image processing device and image processing method |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110059243.9A Expired - Fee Related CN102176736B (en) | 2008-03-07 | 2009-02-24 | Image processing device and image processing method |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP5117889B2 (en) |
| CN (2) | CN102176736B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102932541A (en) * | 2012-10-25 | 2013-02-13 | 广东欧珀移动通信有限公司 | Mobile phone photographing method and system |
| CN104243804A (en) * | 2013-06-11 | 2014-12-24 | 佳能株式会社 | Imaging apparatus, image processing apparatus, and control method therefor |
| CN105409198A (en) * | 2013-07-29 | 2016-03-16 | 富士胶片株式会社 | Image capture device and image processing method |
| WO2019105298A1 (en) * | 2017-11-30 | 2019-06-06 | Oppo广东移动通信有限公司 | Image blurring processing method, device, mobile device and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5831033B2 (en) * | 2011-08-16 | 2015-12-09 | リコーイメージング株式会社 | Imaging apparatus and distance information acquisition method |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09200508A (en) * | 1996-01-16 | 1997-07-31 | Olympus Optical Co Ltd | Image processor |
| JP4081219B2 (en) * | 2000-04-17 | 2008-04-23 | 富士フイルム株式会社 | Image processing method and image processing apparatus |
| JP2003141506A (en) * | 2001-11-01 | 2003-05-16 | Seiko Epson Corp | Image processing apparatus and image processing program |
| WO2007046205A1 (en) * | 2005-10-18 | 2007-04-26 | Kyocera Corporation | Image pickup apparatus and image processing method |
| JP4760302B2 (en) * | 2005-10-28 | 2011-08-31 | 株式会社ニコン | Imaging device |
| KR100657522B1 (en) * | 2006-03-31 | 2006-12-15 | 삼성전자주식회사 | Apparatus and method for out-focusing photographing of portable terminal |
-
2008
- 2008-03-07 JP JP2008058152A patent/JP5117889B2/en not_active Expired - Fee Related
-
2009
- 2009-02-24 CN CN201110059243.9A patent/CN102176736B/en not_active Expired - Fee Related
- 2009-02-24 CN CN2009100077801A patent/CN101557469B/en active Active
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102932541A (en) * | 2012-10-25 | 2013-02-13 | 广东欧珀移动通信有限公司 | Mobile phone photographing method and system |
| CN104243804A (en) * | 2013-06-11 | 2014-12-24 | 佳能株式会社 | Imaging apparatus, image processing apparatus, and control method therefor |
| CN104243804B (en) * | 2013-06-11 | 2018-01-26 | 佳能株式会社 | Picture pick-up device, image processing equipment and its control method |
| US10368008B2 (en) | 2013-06-11 | 2019-07-30 | Canon Kabushiki Kaisha | Imaging apparatus and control method wherein auto bracket parameters and image processes applied are determined from image analysis |
| CN105409198A (en) * | 2013-07-29 | 2016-03-16 | 富士胶片株式会社 | Image capture device and image processing method |
| CN105409198B (en) * | 2013-07-29 | 2018-11-09 | 富士胶片株式会社 | Photographic device and image processing method |
| WO2019105298A1 (en) * | 2017-11-30 | 2019-06-06 | Oppo广东移动通信有限公司 | Image blurring processing method, device, mobile device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2009218708A (en) | 2009-09-24 |
| CN102176736A (en) | 2011-09-07 |
| JP5117889B2 (en) | 2013-01-16 |
| CN101557469B (en) | 2011-05-11 |
| CN102176736B (en) | 2014-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101350889A (en) | Image pickup device and control method thereof | |
| CN106134178B (en) | Image processing apparatus, camera device and image processing method | |
| US8023000B2 (en) | Image pickup apparatus, image processing apparatus, image pickup method, and image processing method | |
| US8830357B2 (en) | Image processing device and image processing method including a blurring process | |
| CN103384998B (en) | Imaging device and imaging method | |
| US8885091B2 (en) | Imaging device and distance information detecting method | |
| CN104782110B (en) | Image processing apparatus, photographic device and image processing method | |
| CN103426147B (en) | Image processing apparatus, image pick-up device and image processing method | |
| CN101297545A (en) | Imaging device, image processing device, and program | |
| CN105409198B (en) | Photographic device and image processing method | |
| CN104885440B (en) | Image processing apparatus, camera device and image processing method | |
| JP2006067521A (en) | Image processor, image processing method, image pickup device, and image pickup method | |
| CN104641624B (en) | Image processing apparatus, camera device and image processing method | |
| CN105657238B (en) | Track focusing method and device | |
| CN104735350B (en) | A kind of information processing method and electronic equipment | |
| CN102801910A (en) | Image sensing device | |
| CN105493493A (en) | Imaging device, imaging method, and image processing device | |
| CN101557469B (en) | Image processing device and image processing method | |
| CN105516611A (en) | An imaging device and a shooting method | |
| CN105847666B (en) | Picture pick-up device and its control method | |
| JP2013042371A (en) | Image pickup device and distance information acquisition method | |
| WO2013146066A1 (en) | Image processing device and method, and imaging device | |
| CN101656817A (en) | Image processing apparatus, image processing process and image processing procedures | |
| CN103888655B (en) | A kind of photographic method and electronic equipment | |
| CN106412423A (en) | Focusing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |