CN106201238A - Show the method and device of focusing state - Google Patents
Show the method and device of focusing state Download PDFInfo
- Publication number
- CN106201238A CN106201238A CN201510226260.5A CN201510226260A CN106201238A CN 106201238 A CN106201238 A CN 106201238A CN 201510226260 A CN201510226260 A CN 201510226260A CN 106201238 A CN106201238 A CN 106201238A
- Authority
- CN
- China
- Prior art keywords
- preview image
- target pixel
- coloured
- pixel location
- contrast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Studio Devices (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure is directed to a kind of method and device showing focusing state, belong to image processing field.Described method includes: show the preview image of object in shooting view-finder；The contrast target pixel location more than predetermined threshold value is obtained from preview image；The coloured highlight mark of Overlapping display above target pixel location, this coloured highlight mark is for showing the focusing state of preview image.The disclosure utilizes this coloured highlight mark to show the focusing state of preview image；Solve the analysis judgement depending on human eye when correlation technique uses manual focus mode to the focusing state of image, cause operating efficiency relatively low and user is required higher problem；Just should be clear the focusing state of image when making user use manual focus mode according to coloured highlight mark, reached improve operating efficiency and reduce the effect of the requirement to user.
Description
Technical field
It relates to image processing field, particularly to a kind of method and device showing focusing state.
Background technology
The such as electronic equipment of mobile phone, panel computer and digital camera etc the most progressively becomes people's life
In necessary, using these electronic equipments shooting photo is the most frequently used function of user.
So that the image of shooting is relatively sharp, need to focus in shooting process.Focusing mode bag
Include auto-focusing mode and manual focus mode.Compared to auto-focusing mode, the focusing of manual focus mode
Precision is higher, and error rate is relatively low.
But, manual focus mode is largely dependent upon human eye and judges the analysis of the focusing state of image,
When therefore using manual focus mode, operating efficiency is relatively low and requires higher to user.
Summary of the invention
Disclosure embodiment provides a kind of method and device showing focusing state.Described technical scheme is as follows:
First aspect according to disclosure embodiment, it is provided that a kind of method showing focusing state, the method
Including:
The preview image of object is shown in shooting view-finder；
The contrast target pixel location more than predetermined threshold value is obtained from preview image；
The coloured highlight mark of Overlapping display above target pixel location, this coloured highlight mark is used for showing pre-
Look at the focusing state of image.
Alternatively, from preview image, obtain the contrast target pixel location more than predetermined threshold value, including:
Calculate the contrast between each two neighbor in preview image；
Each contrast calculated is compared with predetermined threshold value；
From preview image, the contrast target pixel location more than predetermined threshold value is obtained according to comparison result.
Alternatively, from preview image, the contrast object pixel more than predetermined threshold value is obtained according to comparison result
Position, including:
From preview image, the contrast object pixel position more than predetermined threshold value is directly obtained according to comparison result
Put；
Or,
From preview image, contrast other location of pixels less than predetermined threshold value is obtained according to comparison result；Will
In preview image, the residual pixel position in addition to other location of pixels is defined as target pixel location.
Alternatively, the coloured highlight mark of Overlapping display above target pixel location, including:
The color of the pixel at acquisition target pixel location；
Color according to the pixel at target pixel location determines the color of coloured highlight mark, and this is coloured highlighted
The color of labelling is different from the color of the pixel at target pixel location；
According to the color of the coloured highlight mark determined, above target pixel location, Overlapping display is coloured highlighted
Labelling.
Alternatively, the method also includes:
Display slidable adjustment control, this slidable adjustment control is for adjusting the focusing area in preview image
Joint；
Receive the slip touch signal acting on slidable adjustment control；
Focal distance is regulated according to slip touch signal；
According to the focusing area in focal distance regulation preview image.
Alternatively, the method also includes:
Obtain the focal distance corresponding with current focal distance to classify, this focal distance be categorized as microspur,
Any one in standard and infinity；
Display focal distance classification.
Second aspect according to disclosure embodiment, it is provided that a kind of device showing focusing state, this device
Including:
Image display, is configured to show the preview image of object in shooting view-finder；
Position acquisition module, is configured to from preview image the target picture obtaining contrast more than predetermined threshold value
Element position；
Labelling display module, is configured to the coloured highlight mark of Overlapping display above target pixel location, should
Coloured highlight mark is for showing the focusing state of preview image.
Alternatively, position acquisition module, including:
Calculating sub module, is configured to the contrast between each two neighbor in calculating preview image；
Comparer module, is configured to compare each contrast calculated with predetermined threshold value；
Position acquisition submodule, is configured to obtain contrast from preview image more than pre-according to comparison result
If the target pixel location of threshold value.
Alternatively, position acquisition submodule, including:
Primary importance obtains submodule, is configured to directly obtain from preview image contrast according to comparison result
Degree is more than the target pixel location of predetermined threshold value；
Or,
The second position obtains submodule, is configured to obtain contrast from preview image according to comparison result little
In other location of pixels of predetermined threshold value, and by residual pixel in addition to other location of pixels in preview image
Position is defined as target pixel location.
Alternatively, labelling display module, including:
Obtain submodule, be configured to obtain the color of the pixel at target pixel location；
Determining submodule, the color being configured to the pixel at according to target pixel location determines coloured highlighted mark
The color of note, the color of this coloured highlight mark is different from the color of the pixel at target pixel location；
Display sub-module, is configured to the color according to the coloured highlight mark determined, in target pixel location
The top coloured highlight mark of Overlapping display.
Alternatively, this device also includes:
Control display module, is display configured to slidable adjustment control, and this slidable adjustment control is for preview
Focusing area in image is adjusted；
Signal receiving module, is configured to receive the slip touch signal acting on slidable adjustment control；
Distance adjustment module, is configured to regulate focal distance according to slip touch signal；
Region adjustment module, is configured to according to the focusing area in focal distance regulation preview image.
Alternatively, this device also includes:
Classification acquisition module, is configured to obtain the focal distance classification corresponding with current focal distance,
This focal distance is categorized as any one in microspur, standard and infinity；
Classification display module, is display configured to focal distance classification.
The third aspect according to disclosure embodiment, it is provided that a kind of device showing focusing state, this device
Including:
Processor；
For storing the memorizer of the executable instruction of processor；
Wherein, processor is configured to:
The preview image of object is shown in shooting view-finder；
The contrast target pixel location more than predetermined threshold value is obtained from preview image；
The coloured highlight mark of Overlapping display above target pixel location, this coloured highlight mark is used for showing pre-
Look at the focusing state of image.
The technical scheme that disclosure embodiment provides can include following beneficial effect:
By the preview image of display from shooting view-finder obtains the contrast target picture more than predetermined threshold value
Element position, and the coloured highlight mark of Overlapping display above this target pixel location, utilize this coloured highlighted mark
Note shows the focusing state of preview image；Solve when correlation technique uses manual focus mode and depend on human eye
Analysis to the focusing state of image judges, causes operating efficiency relatively low and user is required higher problem；
Just should be clear the focusing of image according to coloured highlight mark when making user use manual focus mode
State, has reached improve operating efficiency and reduce the effect of the requirement to user.
It should be appreciated that it is only exemplary and explanatory that above general description and details hereinafter describe,
The disclosure can not be limited.
Accompanying drawing explanation
Accompanying drawing herein is merged in description and constitutes the part of this specification, it is shown that meet the disclosure
Embodiment, and for explaining the principle of the disclosure together with description.
Fig. 1 is the flow chart according to a kind of method showing focusing state shown in an exemplary embodiment；
Fig. 2 A is the flow chart according to a kind of method showing focusing state shown in another exemplary embodiment；
Fig. 2 B is the flow chart of the step 202 involved by another exemplary embodiment；
Fig. 2 C and Fig. 2 D is the interface schematic diagram involved by another exemplary embodiment；
Fig. 3 is the flow chart according to a kind of method showing focusing state shown in another exemplary embodiment；
Fig. 4 is the block diagram according to a kind of device showing focusing state shown in an exemplary embodiment；
Fig. 5 is the block diagram according to a kind of device showing focusing state shown in another exemplary embodiment；
Fig. 6 is the block diagram according to a kind of device shown in an exemplary embodiment.
Detailed description of the invention
Here will illustrate exemplary embodiment in detail, its example represents in the accompanying drawings.Following retouches
Stating when relating to accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represents same or analogous key element.
Embodiment described in following exemplary embodiment does not represent all embodiment party consistent with the disclosure
Formula.On the contrary, they only with describe in detail in appended claims, the disclosure some in terms of mutually one
The example of the apparatus and method caused.
Fig. 1 is the flow chart according to a kind of method showing focusing state shown in an exemplary embodiment.Should
Method can be applicable to have in the electronic equipment of shoot function, this electronic equipment can be mobile phone, panel computer,
Camera etc..The method can include following several step:
In a step 102, in shooting view-finder, show the preview image of object.
At step 104, from preview image, the contrast target pixel location more than predetermined threshold value is obtained.
In step 106, the coloured highlight mark of Overlapping display above target pixel location, this is coloured highlighted
Labelling is for showing the focusing state of preview image.
In sum, the method that the present embodiment provides, by the preview image of display from shooting view-finder
Obtain the contrast target pixel location more than predetermined threshold value, and Overlapping display above this target pixel location
Coloured highlight mark, utilizes this coloured highlight mark to show the focusing state of preview image；Solve relevant skill
Art depends on human eye and judges the analysis of the focusing state of image when using manual focus mode, cause operation effect
Rate is relatively low and user is required higher problem；According to coloured highlighted when making user use manual focus mode
Labelling just should be clear the focusing state of image, has reached improve operating efficiency and reduce user's
The effect required.
Fig. 2 A is the flow chart according to a kind of method showing focusing state shown in another exemplary embodiment.
The method can be applicable to have in the electronic equipment of shoot function, and this electronic equipment can be mobile phone, flat board electricity
Brain, camera etc..The method can include following several step:
In step 201, in shooting view-finder, show the preview image of object.
Electronic equipment has shoot function, when user uses the shoot function shooting photo of electronic equipment, and electricity
Subset can show shooting view-finder in screen, and this shooting view-finder is used for preview content being shot, and electronics sets
The standby preview image showing object in this shooting view-finder.
In step 202., from preview image, the contrast target pixel location more than predetermined threshold value is obtained.
Electronic equipment, according to the contrast between pixel each in preview image, obtains contrast big from preview image
Target pixel location in predetermined threshold value.Contrast reflects the definition of image, details performance and gray scale
The characteristics such as level performance.In general, contrast is the biggest, and image is the most clear eye-catching, and color is the distinctest gorgeous
Beautiful；And contrast is little, then whole image can be allowed to seem dusky.In the present embodiment, from preview image
Middle acquisition contrast more than the target pixel location of predetermined threshold value, namely choose from preview image display clear,
Clearly demarcated and the painted position of details.
In a kind of possible embodiment, as shown in Figure 2 B, this step can include following a few sub-steps:
In step 202a, calculate the contrast between each two neighbor in preview image.
Electronic equipment calculates the contrast in preview image between each two neighbor.Wherein, contrast is calculated
When spending, the parameter of required employing and the mode of calculating contrast can be set according to the actual requirements, and this
Partial content be the easy full of beard of those skilled in the art and content, this is not construed as limiting by the present embodiment.In one
In possible embodiment, electronic equipment can calculate the aberration in preview image between each two neighbor,
And this aberration is spent as a comparison.
In step 202b, each contrast calculated is compared with predetermined threshold value.
For any two neighbor, electronic equipment is in the contrast calculated between these two neighbors
Afterwards, the contrast calculated is compared with predetermined threshold value, namely judge that the contrast calculated is with pre-
If the magnitude relationship between threshold value.
In step 202c, from preview image, obtain the contrast mesh more than predetermined threshold value according to comparison result
Mark location of pixels.
In the embodiment that the first is possible, electronic equipment directly obtains according to comparison result from preview image
Take the contrast target pixel location more than predetermined threshold value.For any two neighbor, when these two phases
When contrast between adjacent pixel is more than predetermined threshold value, electronic equipment determines that these two neighbors are in preview graph
Position corresponding in Xiang belongs to target pixel location.
It should be noted is that: when using this first possible embodiment to obtain target pixel location,
Contrast all can be defined as object pixel position more than the position at two neighbor places of predetermined threshold value
Put, it is also possible to contrast is more than in two neighbors of predetermined threshold value and calculates the pixel place that parameter is bigger
Position be defined as target pixel location, or contrast is fallen into a trap more than two neighbors of predetermined threshold value
The position calculating the less pixel place of parameter is defined as target pixel location.Wherein, calculate parameter to refer to calculate
The parameter used during contrast, such as the aberration of the example above.
In the embodiment that the second is possible, it is right that electronic equipment obtains from preview image according to comparison result
Than degree less than other location of pixels of predetermined threshold value, and by preview image in addition to other location of pixels above-mentioned
Residual pixel position be defined as target pixel location.That is, electronic equipment uses the mode reversely chosen to obtain
Take the target pixel location in preview image.
Similarly, when the embodiment using this second possible obtains other location of pixels, can be by right
Other location of pixels all it is defined as less than the position at two neighbor places of predetermined threshold value than degree, it is also possible to
The position calculating the bigger pixel place of parameter in the contrast two neighbors less than predetermined threshold value is determined
For other location of pixels or less by the contrast two neighbors less than predetermined threshold value calculate parameter
The position at pixel place be defined as other location of pixels.Wherein, calculate parameter to refer to adopt when calculating contrast
Parameter, such as the aberration of the example above.
In step 203, the coloured highlight mark of Overlapping display above target pixel location, this is coloured highlighted
Labelling is for showing the focusing state of preview image.
After electronic equipment obtains target pixel location from preview image, superposition above target pixel location
Show coloured highlight mark.Wherein, coloured highlight mark is for showing the focusing state of preview image, coloured
Target pixel location at highlight mark is to show clear, the clearly demarcated and painted position of details in preview image
Put.In the present embodiment, by using coloured highlight mark to be highlighted position clearly of focusing in preview image
Display so that user just should be clear pre-when using manual focus mode according to coloured highlight mark
Look at the focusing state of image, improve operating efficiency during user's manual focus, and operation is the most fool,
Requirement to user is low, improves Consumer's Experience.
It addition, the color of coloured highlight mark can be a kind of specific color.Such as, coloured highlight mark
Color can be system a certain color set in advance, such as redness；Or, the face of coloured highlight mark
Color can also be a certain color of the most self-defined setting of user, such as yellow.
Or, the color of coloured highlight mark can also be one or more chosen in real time from multiple color
Color.Such as, the color of coloured highlight mark can be chosen from system multiple color set in advance
A kind of color, such as the redness chosen from system red, yellow and white three kinds of colors set in advance.Wherein, choosing
The mode of taking can be to be randomly selected by electronic equipment, it is also possible to is to be chosen by user, or by electronic equipment
Actual content according to preview image is chosen selectively.
Such as Fig. 2 C, it illustrates a kind of interface schematic diagram involved by the present embodiment.The shooting of electronic equipment takes
Scape frame 21 shows the preview image 22 of object, between electronic equipment is according to pixel each in preview image 22
Contrast, after choosing target pixel location from preview image 22, folded above this target pixel location
Add the coloured highlight mark 23 (as shown in black dot in Fig. 2 C) of display.
Alternatively, the method that the present embodiment provides also includes following several step:
In step 204, display slidable adjustment control.
Electronic equipment also can show slidable adjustment control in screen, and this slidable adjustment control is for entering user
During row manual focus, the focusing area in preview image is adjusted.In conjunction with reference to Fig. 2 C and figure
2D, electronic equipment can shoot Overlapping display slidable adjustment control 24 above view-finder 21.
In step 205, reception acts on the slip touch signal of slidable adjustment control.
This control can be controlled in the slip touch signal of slidable adjustment control by user by trigger action,
To realize the focusing area in preview image is adjusted.In conjunction with reference to Fig. 2 C and Fig. 2 D, user Ke Tong
Cross the operating point 25 horizontally slipped in this slidable adjustment control 24, the focusing area in preview image 22 is entered
Row regulation.
In step 206, focal distance is regulated according to slip touch signal.
The size of focal distance is adjusted according to slip touch signal and controls by electronic equipment.Wherein, right
Defocus distance refers to the distance between image, is the distance of the camera lens distance to object and camera lens to photo-sensitive cell
Sum.Focusing area in preview image is adjusted by regulating focal distance and controls by electronic equipment.
Focusing area refers to the region of clear display in preview image.In conjunction with reference to Fig. 2 C and Fig. 2 D, user is to the left
Slide point 25, triggers electronic equipment and turns focal distance down；User's point of slide to the right 25, triggers electricity
Subset tunes up focal distance.
In step 207, according to the focusing area in focal distance regulation preview image.
Electronic equipment is according to the focusing area in focal distance regulation preview image.In conjunction with reference to Fig. 2 C and figure
2D, when focal distance is turned down, focusing area at the lower zone (as shown in Figure 2 C) of preview image 22,
In focusing area, image clearly shows, coloured highlight mark is on the high side in focusing area；When focal distance is adjusted
Time big, focusing area is at the upper area (as shown in Figure 2 D) of preview image 22, image in focusing area
Clear display, coloured highlight mark is on the high side in focusing area.
It should be noted is that: during user regulates focusing area, electronic equipment can be every predetermined
Time interval (such as 0.05 second) calculates a target pixel location, and superposition above this target pixel location
Show coloured highlight mark, thus realize during user regulates focusing area to user's Real-time and Dynamic exhibition
Show the change of the focusing state of preview image.
Alternatively, during user regulates focusing area, electronic equipment also can obtain and current focusing
Apart from corresponding focal distance classification, and show that this focal distance is classified.Alternatively, focal distance classification
Include but not limited to it is any one in microspur, standard and infinity.Wherein, focal distance is classified with right
Corresponding relation between defocus distance is pre-set, and the focal distance that such as microspur is corresponding is 0 to 40cm,
Focal distance corresponding to standard is 41 to 80cm, and focal distance corresponding to infinity is more than 80cm.Such as figure
Shown in 2C and Fig. 2 D, the focal distance that the most current focal distance is corresponding is categorized as microspur, at figure
The focal distance that focal distance current in 2D is corresponding is categorized as standard.Certainly, the above-mentioned focal distance enumerated
Corresponding relation between classification and focal distance classification and focal distance is only exemplary and explanatory, this
Focal distance can be classified on the basis of the content that the present embodiment provides by skilled person according to the actual requirements
Quantity and type, and focal distance classification and focal distance between corresponding relation be set, this reality
Execute example this is not construed as limiting.
Alternatively, electronic equipment may also display the numerical value that current focal distance is corresponding, enables a user to
More it is expressly understood that current focal distance by this numerical value, and then carries out the regulation of more precise and high efficiency.
As shown in Figure 2 C and 2 D shown in FIG., numerical value corresponding to the most current focal distance is 33, at Fig. 2 D
In numerical value corresponding to current focal distance be 50.
Alternatively, as shown in Figure 2 C and 2 D shown in FIG., electronic equipment also can show that in screen focal modes switches
Button 26, focal modes switching push button 26 is corresponding to two kinds of different focal modes, including manual focus pattern
And autofocus mode, user can be by clicking on this focal modes switching push button 26 different right of above two
Switch between burnt pattern.Under manual focus pattern, the method that electronic equipment can be provided by the present embodiment
Focusing state is shown to user.
In sum, the method that the present embodiment provides, by the preview image of display from shooting view-finder
Obtain the contrast target pixel location more than predetermined threshold value, and Overlapping display above this target pixel location
Coloured highlight mark, utilizes this coloured highlight mark to show the focusing state of preview image；Solve relevant skill
Art depends on human eye and judges the analysis of the focusing state of image when using manual focus mode, cause operation effect
Rate is relatively low and user is required higher problem；According to coloured highlighted when making user use manual focus mode
Labelling just should be clear the focusing state of image, has reached improve operating efficiency and reduce user's
The effect required.
It addition, the method that the present embodiment provides, also by display slidable adjustment control so that user is by being somebody's turn to do
Focusing area in preview image is adjusted by slidable adjustment control, regulates the process of focusing area user
The change of the middle focusing state showing preview image to user's Real-time and Dynamic.
Fig. 3 is the flow chart according to a kind of method showing focusing state shown in another exemplary embodiment.
The method can be applicable to have in the electronic equipment of shoot function, and this electronic equipment can be mobile phone, flat board electricity
Brain, camera etc..The method can include following several step:
In step 301, in shooting view-finder, show the preview image of object.
Step 301 is identical with the step 201 in Fig. 2 A illustrated embodiment, sees in Fig. 2 A illustrated embodiment
For introduction and the explanation of step 201, this is repeated no more by the present embodiment.
In step 302, from preview image, the contrast target pixel location more than predetermined threshold value is obtained.
Step 302 is identical with the step 202 in Fig. 2 A illustrated embodiment, sees in Fig. 2 A illustrated embodiment
For introduction and the explanation of step 202, this is repeated no more by the present embodiment.
In step 303, the color of the pixel at acquisition target pixel location.
After electronic equipment obtains target pixel location from preview image, obtain the picture at target pixel location
The color of element.In a kind of possible embodiment, for each pixel at target pixel location, electricity
Subset obtains the position coordinates of this pixel, then searches from the view data of preview image and sits with this position
The color value that mark is corresponding.Wherein, what the view data of preview image included between position coordinates and color value is right
Should be related to.
In step 304, the face of coloured highlight mark is determined according to the color of the pixel at target pixel location
Color, the color of this coloured highlight mark is different from the color of the pixel at target pixel location.
When the color of the pixel at target pixel location is same color, another kind of face selected by electronic equipment
Color is as the color of coloured highlight mark, and this another kind color is different from above-mentioned same color.Such as, when
When the color of the pixel at target pixel location is red, electronic equipment selects yellow as coloured highlight mark
Color.
When the color of the pixel at target pixel location is multiple different color, another is selected by electronic equipment
Planting the color color as coloured highlight mark, this another kind color is different from above-mentioned multiple different color
Any one color.Such as, the color of the pixel at target pixel location is red, yellow and white
Time, the green color as coloured highlight mark selected by electronic equipment.
It addition, electronic equipment can choose the color of coloured highlight mark from system color libraries set in advance,
The color of coloured highlight mark can also be chosen from the color libraries of the most self-defined setting of user.Wherein, face
Color storehouse comprises multiple different color.
In the present embodiment, by by coloured highlight mark from the pixel at target pixel location with different face
Color is differently shown so that user more can recognize the focusing state of preview image ocular and clear,
It is favorably improved operating efficiency and Consumer's Experience.
In step 305, according to the color of the coloured highlight mark determined, folded above target pixel location
Add the coloured highlight mark of display.
After the color of coloured highlight mark determined by electronic equipment, Overlapping display above target pixel location
Coloured highlight mark.
In sum, the method that the present embodiment provides, by the preview image of display from shooting view-finder
Obtain the contrast target pixel location more than predetermined threshold value, and Overlapping display above this target pixel location
Coloured highlight mark, utilizes this coloured highlight mark to show the focusing state of preview image；Solve relevant skill
Art depends on human eye and judges the analysis of the focusing state of image when using manual focus mode, cause operation effect
Rate is relatively low and user is required higher problem；According to coloured highlighted when making user use manual focus mode
Labelling just should be clear the focusing state of image, has reached improve operating efficiency and reduce user's
The effect required.
It addition, the method that the present embodiment provides, also by by coloured highlight mark and target pixel location
Pixel is differently shown with different colors so that user more can recognize preview graph ocular and clear
The focusing state of picture, is favorably improved operating efficiency and Consumer's Experience.
Following for disclosure device embodiment, may be used for performing method of disclosure embodiment.For the disclosure
The details not disclosed in device embodiment, refer to method of disclosure embodiment.
Fig. 4 is the block diagram according to a kind of device showing focusing state shown in an exemplary embodiment.This dress
Put and can be applicable to have in the electronic equipment of shoot function, this electronic equipment can be mobile phone, panel computer,
Camera etc..This device may include that image display 410, position acquisition module 420 and labelling display mould
Block 430.
Image display 410, is configured to show the preview image of object in shooting view-finder.
Position acquisition module 420, is configured to from described preview image obtain contrast more than predetermined threshold value
Target pixel location.
Labelling display module 430, is configured to the coloured highlighted mark of Overlapping display above described target pixel location
Note, described coloured highlight mark is for showing the focusing state of described preview image.
In sum, the device that the present embodiment provides, by the preview image of display from shooting view-finder
Obtain the contrast target pixel location more than predetermined threshold value, and Overlapping display above this target pixel location
Coloured highlight mark, utilizes this coloured highlight mark to show the focusing state of preview image；Solve relevant skill
Art depends on human eye and judges the analysis of the focusing state of image when using manual focus mode, cause operation effect
Rate is relatively low and user is required higher problem；According to coloured highlighted when making user use manual focus mode
Labelling just should be clear the focusing state of image, has reached improve operating efficiency and reduce user's
The effect required.
Fig. 5 is the block diagram according to a kind of device showing focusing state shown in another exemplary embodiment.Should
Device can be applicable to have in the electronic equipment of shoot function, this electronic equipment can be mobile phone, panel computer,
Camera etc..This device may include that image display 410, position acquisition module 420 and labelling display mould
Block 430.
Image display 410, is configured to show the preview image of object in shooting view-finder.
Position acquisition module 420, is configured to from described preview image obtain contrast more than predetermined threshold value
Target pixel location.
Labelling display module 430, is configured to the coloured highlighted mark of Overlapping display above described target pixel location
Note, described coloured highlight mark is for showing the focusing state of described preview image.
Alternatively, described position acquisition module 420, including: calculating sub module 420a, comparer module 420b
With position acquisition submodule 420c.
Calculating sub module 420a, be configured to calculate in described preview image between each two neighbor is right
Degree of ratio.
Comparer module 420b, is configured to carry out each contrast calculated with described predetermined threshold value
Comparison.
Position acquisition submodule 420c, is configured to obtain contrast from described preview image according to comparison result
Degree is more than the described target pixel location of described predetermined threshold value.
Alternatively, described position acquisition submodule 420c, including:
Primary importance obtains submodule 420c1, is configured to according to described comparison result directly from described preview graph
The contrast described target pixel location more than described predetermined threshold value is obtained in Xiang；
Or,
The second position obtains submodule 420c2, is configured to according to described comparison result from described preview image
Obtain contrast less than other location of pixels of described predetermined threshold value, and by described preview image except described its
Residual pixel position outside its location of pixels is defined as described target pixel location.
Alternatively, described labelling display module 430, including: obtain submodule 430a, determine submodule 430b
With display sub-module 430c.
Obtain submodule 430a, be configured to obtain the color of the pixel at described target pixel location.
Determining submodule 430b, the color being configured to the pixel at according to described target pixel location determines institute
Stating the color of coloured highlight mark, the color of described coloured highlight mark is different from described target pixel location
The color of pixel.
Display sub-module 430c, is configured to the color according to the described coloured highlight mark determined, described
Coloured highlight mark described in Overlapping display above target pixel location.
Alternatively, described device also includes: control display module 440, signal receiving module 450, distance are adjusted
Joint module 460 and region adjustment module 470.
Control display module 440, is display configured to slidable adjustment control, and described slidable adjustment control is for right
Focusing area in described preview image is adjusted.
Signal receiving module 450, is configured to receive the slip touch letter acting on described slidable adjustment control
Number.
Distance adjustment module 460, is configured to regulate focal distance according to described slip touch signal.
Region adjustment module 470, is configured to regulate the focusing in described preview image according to described focal distance
Region.
Alternatively, described device also includes: classification acquisition module 480 and classification display module 490.
Classification acquisition module 480, is configured to obtain the focal distance corresponding with current focal distance and divides
Class, described focal distance is categorized as any one in microspur, standard and infinity；
Classification display module 490, is display configured to the classification of described focal distance.
In sum, the device that the present embodiment provides, by the preview image of display from shooting view-finder
Obtain the contrast target pixel location more than predetermined threshold value, and Overlapping display above this target pixel location
Coloured highlight mark, utilizes this coloured highlight mark to show the focusing state of preview image；Solve relevant skill
Art depends on human eye and judges the analysis of the focusing state of image when using manual focus mode, cause operation effect
Rate is relatively low and user is required higher problem；According to coloured highlighted when making user use manual focus mode
Labelling just should be clear the focusing state of image, has reached improve operating efficiency and reduce user's
The effect required.
It addition, the device that the present embodiment provides, also by display slidable adjustment control so that user is by being somebody's turn to do
Focusing area in preview image is adjusted by slidable adjustment control, regulates the process of focusing area user
The change of the middle focusing state showing preview image to user's Real-time and Dynamic.
It addition, the device that the present embodiment provides, also by by coloured highlight mark and target pixel location
Pixel is differently shown with different colors so that user more can recognize preview graph ocular and clear
The focusing state of picture, is favorably improved operating efficiency and Consumer's Experience.
About the device in above-described embodiment, wherein modules performs the concrete mode of operation relevant
The embodiment of the method is described in detail, explanation will be not set forth in detail herein.
The disclosure one exemplary embodiment provides a kind of device showing focusing state, it is possible to realize the disclosure
The method of displayings focusing state provided, this device includes: processor and be used for storing holding of processor
The memorizer of row instruction；
Wherein, processor is configured to:
The preview image of object is shown in shooting view-finder；
The contrast target pixel location more than predetermined threshold value is obtained from preview image；
The coloured highlight mark of Overlapping display above target pixel location, this coloured highlight mark is used for showing pre-
Look at the focusing state of image.
Alternatively, processor is configured to:
Calculate the contrast between each two neighbor in preview image；
Each contrast calculated is compared with predetermined threshold value；
From preview image, the contrast target pixel location more than predetermined threshold value is obtained according to comparison result.
Alternatively, processor is configured to:
From preview image, the contrast object pixel position more than predetermined threshold value is directly obtained according to comparison result
Put；
Or,
From preview image, contrast other location of pixels less than predetermined threshold value is obtained according to comparison result, and
Residual pixel position in addition to other location of pixels in preview image is defined as target pixel location.
Alternatively, processor is configured to:
The color of the pixel at acquisition target pixel location；
Color according to the pixel at target pixel location determines the color of coloured highlight mark, and this is coloured highlighted
The color of labelling is different from the color of the pixel at target pixel location；
According to the color of the coloured highlight mark determined, above target pixel location, Overlapping display is coloured highlighted
Labelling.
Alternatively, processor is also configured to
Display slidable adjustment control, this slidable adjustment control is for adjusting the focusing area in preview image
Joint；
Receive the slip touch signal acting on slidable adjustment control；
Focal distance is regulated according to slip touch signal；
According to the focusing area in focal distance regulation preview image.
Alternatively, processor is also configured to
Obtain the focal distance corresponding with current focal distance to classify, this focal distance be categorized as microspur,
Any one in standard and infinity；
Display focal distance classification.
Fig. 6 is the block diagram according to a kind of device 600 shown in an exemplary embodiment.Device 600 has bat
Taking the photograph ability, such as, device 600 can be mobile phone, computer, digital broadcast terminal, information receiving and transmitting
Equipment, game console, tablet device, armarium, body-building equipment, personal digital assistant etc..
With reference to Fig. 6, device 600 can include following one or more assembly: processes assembly 602, memorizer
604, power supply module 606, multimedia groupware 608, audio-frequency assembly 610, the interface of input/output (I/O)
612, sensor cluster 614, and communications component 616.
Process assembly 602 and generally control the integrated operation of device 600, such as with display, call, number
The operation being associated according to communication, camera operation and record operation.Process assembly 602 and can include one or many
Individual processor 620 performs instruction, to complete all or part of step of above-mentioned method.Additionally, process
Assembly 602 can include one or more module, it is simple to process between assembly 602 and other assemblies is mutual.
Such as, process assembly 602 and can include multi-media module, to facilitate multimedia groupware 608 and to process assembly
Mutual between 602.
Memorizer 604 is configured to store various types of data to support the operation at device 600.These
The example of data includes any application program for operation on device 600 or the instruction of method, contact person
Data, telephone book data, message, picture, video etc..Memorizer 604 can be by any kind of volatile
Property or non-volatile memory device or combinations thereof realize, such as static RAM (SRAM),
Electrically Erasable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory EPROM (EPROM),
Programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory,
Disk or CD.
The various assemblies that power supply module 606 is device 600 provide electric power.Power supply module 606 can include electricity
Management system, one or more power supplys, and other generate, manage and distribute electric power phase with for device 600
The assembly of association.
The screen of one output interface of offer that multimedia groupware 608 is included between described device 600 and user
Curtain.In certain embodiments, screen can include liquid crystal display (LCD) and touch panel (TP).As
Really screen includes that touch panel, screen may be implemented as touch screen, to receive the input signal from user.
Touch panel includes that one or more touch sensor is with the gesture on sensing touch, slip and touch panel.
Described touch sensor can not only sense touch or the border of sliding action, but also detects and described touch
Or slide relevant persistent period and pressure.In certain embodiments, multimedia groupware 608 includes one
Individual front-facing camera and/or post-positioned pick-up head.When device 600 is in operator scheme, such as screening-mode or video
During pattern, front-facing camera and/or post-positioned pick-up head can receive the multi-medium data of outside.Each preposition take the photograph
As head and post-positioned pick-up head can be fixing optical lens systems or have focal length and optical zoom energy
Power.
Audio-frequency assembly 610 is configured to output and/or input audio signal.Such as, audio-frequency assembly 610 includes
One mike (MIC), when device 600 is in operator scheme, such as call model, logging mode and voice
During recognition mode, mike is configured to receive external audio signal.The audio signal received can be entered
One step is stored in memorizer 604 or sends via communications component 616.In certain embodiments, audio-frequency assembly
610 also include a speaker, are used for exporting audio signal.
I/O interface 612 provides interface, above-mentioned peripheral interface for processing between assembly 602 and peripheral interface module
Module can be keyboard, puts striking wheel, button etc..These buttons may include but be not limited to: home button, sound
Amount button, start button and locking press button.
Sensor cluster 614 includes one or more sensor, for providing various aspects for device 600
State estimation.Such as, what sensor cluster 614 can detect device 600 opens/closed mode, assembly
Relative localization, the most described assembly is display and the keypad of device 600, and sensor cluster 614 is also
Device 600 or the position change of 600 1 assemblies of device, user and depositing that device 600 contacts can be detected
Or do not exist, device 600 orientation or acceleration/deceleration and the variations in temperature of device 600.Sensor cluster 614
Proximity transducer can be included, be configured to when there is no any physical contact depositing of object near detection
?.Sensor cluster 614 can also include optical sensor, such as CMOS or ccd image sensor, is used for
Imaging applications uses.In certain embodiments, this sensor cluster 614 can also include that acceleration passes
Sensor, gyro sensor, Magnetic Sensor, pressure transducer or temperature sensor.
Communications component 616 is configured to facilitate the logical of wired or wireless mode between device 600 and other equipment
Letter.Device 600 can access wireless network based on communication standard, such as WiFi, 2G or 3G, or they
Combination.In one exemplary embodiment, communications component 616 receives wide from outside via broadcast channel
The broadcast singal of broadcast management system or broadcast related information.In one exemplary embodiment, described communication set
Part 616 also includes near-field communication (NFC) module, to promote junction service.Such as, can in NFC module
Based on RF identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra broadband (UWB) skill
Art, bluetooth (BT) technology and other technologies realize.
In the exemplary embodiment, device 600 can by one or more application specific integrated circuits (ASIC),
Digital signal processor (DSP), digital signal processing appts (DSPD), PLD (PLD),
Field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are real
Existing, it is used for performing said method.
In the exemplary embodiment, a kind of non-transitory computer-readable storage medium including instruction is additionally provided
Matter, such as, include the memorizer 604 of instruction, and above-mentioned instruction can be performed by the processor 620 of device 600 with complete
Become said method.Such as, described non-transitory computer-readable recording medium can be ROM, random access memory
Memorizer (RAM), CD-ROM, tape, floppy disk and optical data storage devices etc..
A kind of non-transitory computer-readable recording medium, when the instruction in described storage medium is by device 600
Processor perform time so that device 600 is able to carry out the method for above-mentioned displaying focusing state.
Those skilled in the art, after considering description and putting into practice invention disclosed herein, will readily occur to these public affairs
Other embodiment opened.The application is intended to any modification, purposes or the adaptations of the disclosure,
These modification, purposes or adaptations are followed the general principle of the disclosure and include that the disclosure is not disclosed
Common knowledge in the art or conventional techniques means.Description and embodiments is considered only as exemplary
, the true scope of the disclosure and spirit are pointed out by claim below.
It should be appreciated that the disclosure is not limited to accurate knot described above and illustrated in the accompanying drawings
Structure, and various modifications and changes can carried out without departing from the scope.The scope of the present disclosure is only by appended
Claim limits.
Claims (13)
1. the method showing focusing state, it is characterised in that described method includes:
The preview image of object is shown in shooting view-finder；
The contrast target pixel location more than predetermined threshold value is obtained from described preview image；
The coloured highlight mark of Overlapping display above described target pixel location, described coloured highlight mark is used for
Show the focusing state of described preview image.
Method the most according to claim 1, it is characterised in that described acquisition from described preview image
Contrast is more than the target pixel location of predetermined threshold value, including:
Calculate the contrast between each two neighbor in described preview image；
Each contrast calculated is compared with described predetermined threshold value；
From described preview image, the contrast described target more than described predetermined threshold value is obtained according to comparison result
Location of pixels.
Method the most according to claim 2, it is characterised in that described according to comparison result from described pre-
Look at and image obtains the contrast described target pixel location more than described predetermined threshold value, including:
From described preview image, contrast is directly obtained more than described predetermined threshold value according to described comparison result
Described target pixel location；
Or,
From described preview image, contrast is obtained less than other of described predetermined threshold value according to described comparison result
Location of pixels；Residual pixel position in addition to other location of pixels described in described preview image is defined as
Described target pixel location.
Method the most according to claim 1, it is characterised in that described in described target pixel location
Side's coloured highlight mark of Overlapping display, including:
Obtain the color of pixel at described target pixel location；
Color according to the pixel at described target pixel location determines the color of described coloured highlight mark, institute
The color stating coloured highlight mark is different from the color of the pixel at described target pixel location；
According to the color of the described coloured highlight mark determined, Overlapping display above described target pixel location
Described coloured highlight mark.
5. according to the arbitrary described method of Claims 1-4, it is characterised in that described method also includes:
Display slidable adjustment control, described slidable adjustment control is for the focusing area in described preview image
It is adjusted；
Receive the slip touch signal acting on described slidable adjustment control；
Focal distance is regulated according to described slip touch signal；
The focusing area in described preview image is regulated according to described focal distance.
Method the most according to claim 5, it is characterised in that described method also includes:
Obtain the focal distance corresponding with current focal distance to classify, described focal distance be categorized as microspur,
Any one in standard and infinity；
Show that described focal distance is classified.
7. the device showing focusing state, it is characterised in that described device includes:
Image display, is configured to show the preview image of object in shooting view-finder；
Position acquisition module, is configured to from described preview image the mesh obtaining contrast more than predetermined threshold value
Mark location of pixels；
Labelling display module, is configured to the coloured highlight mark of Overlapping display above described target pixel location,
Described coloured highlight mark is for showing the focusing state of described preview image.
Device the most according to claim 7, it is characterised in that described position acquisition module, including:
Calculating sub module, is configured to calculate the contrast between each two neighbor in described preview image；
Comparer module, is configured to compare each contrast calculated with described predetermined threshold value；
Position acquisition submodule, is configured to obtain contrast from described preview image according to comparison result big
Described target pixel location in described predetermined threshold value.
Device the most according to claim 8, it is characterised in that described position acquisition submodule, including:
Primary importance obtains submodule, is configured to according to described comparison result directly from described preview image
Obtain the contrast described target pixel location more than described predetermined threshold value；
Or,
The second position obtains submodule, is configured to obtain from described preview image according to described comparison result
Contrast is less than other location of pixels of described predetermined threshold value, and will remove other picture described in described preview image
Residual pixel position outside element position is defined as described target pixel location.
Device the most according to claim 7, it is characterised in that described labelling display module, including:
Obtain submodule, be configured to obtain the color of the pixel at described target pixel location；
Determine submodule, be configured to the color of the pixel at according to described target pixel location determine described in have
The color of color highlight mark, the color of described coloured highlight mark is different from the picture at described target pixel location
The color of element；
Display sub-module, is configured to the color according to the described coloured highlight mark determined, in described target
Coloured highlight mark described in Overlapping display above location of pixels.
11. according to the arbitrary described device of claim 7 to 10, it is characterised in that described device also includes:
Control display module, is display configured to slidable adjustment control, and described slidable adjustment control is for institute
The focusing area stated in preview image is adjusted；
Signal receiving module, is configured to receive the slip touch signal acting on described slidable adjustment control；
Distance adjustment module, is configured to regulate focal distance according to described slip touch signal；
Region adjustment module, is configured to regulate the focusing district in described preview image according to described focal distance
Territory.
12. devices according to claim 11, it is characterised in that described device also includes:
Classification acquisition module, is configured to obtain the focal distance classification corresponding with current focal distance,
Described focal distance is categorized as any one in microspur, standard and infinity；
Classification display module, is display configured to the classification of described focal distance.
13. 1 kinds of devices showing focusing state, it is characterised in that described device includes:
Processor；
For storing the memorizer of the executable instruction of described processor；
Wherein, described processor is configured to:
The preview image of object is shown in shooting view-finder；
The contrast target pixel location more than predetermined threshold value is obtained from described preview image；
The coloured highlight mark of Overlapping display above described target pixel location, described coloured highlight mark is used for
Show the focusing state of described preview image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510226260.5A CN106201238B (en) | 2015-05-06 | 2015-05-06 | Show the method and device of focusing state |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510226260.5A CN106201238B (en) | 2015-05-06 | 2015-05-06 | Show the method and device of focusing state |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106201238A true CN106201238A (en) | 2016-12-07 |
| CN106201238B CN106201238B (en) | 2019-11-29 |
Family
ID=57459027
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510226260.5A Active CN106201238B (en) | 2015-05-06 | 2015-05-06 | Show the method and device of focusing state |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106201238B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114189628A (en) * | 2021-11-30 | 2022-03-15 | 歌尔光学科技有限公司 | Control method and device of shooting function, AR device and storage medium |
| CN114584700A (en) * | 2020-11-30 | 2022-06-03 | 京东方科技集团股份有限公司 | Focusing marking method, marking device and electronic equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070052836A1 (en) * | 2005-08-25 | 2007-03-08 | Sony Corporation | Image pickup apparatus and display control method |
| US20100259652A1 (en) * | 2009-04-08 | 2010-10-14 | Canon Kabushiki Kaisha | Image capturing apparatus and control method therefor |
| CN101877137A (en) * | 2009-04-30 | 2010-11-03 | 国际商业机器公司 | Method for highlighting thematic element and system thereof |
| CN102281399A (en) * | 2011-08-12 | 2011-12-14 | 广东步步高电子工业有限公司 | Digital photographic equipment with touch screen and zooming method of digital photographic equipment |
| US20120013763A1 (en) * | 2010-07-16 | 2012-01-19 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, and computer-readable medium |
| CN103763498A (en) * | 2014-01-24 | 2014-04-30 | 深圳市影歌科技有限公司 | HDMI signal processing system and method |
| CN103795916A (en) * | 2012-10-26 | 2014-05-14 | 佳能株式会社 | Imaging apparatus and focusing method for imaging apparatus |
| CN103988489A (en) * | 2011-09-30 | 2014-08-13 | 富士胶片株式会社 | Imaging device, imaging method, recording medium and program |
| CN104270562A (en) * | 2014-08-15 | 2015-01-07 | 广东欧珀移动通信有限公司 | Method and device for focusing when photographing |
-
2015
- 2015-05-06 CN CN201510226260.5A patent/CN106201238B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070052836A1 (en) * | 2005-08-25 | 2007-03-08 | Sony Corporation | Image pickup apparatus and display control method |
| US20100259652A1 (en) * | 2009-04-08 | 2010-10-14 | Canon Kabushiki Kaisha | Image capturing apparatus and control method therefor |
| CN101877137A (en) * | 2009-04-30 | 2010-11-03 | 国际商业机器公司 | Method for highlighting thematic element and system thereof |
| US20120013763A1 (en) * | 2010-07-16 | 2012-01-19 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, and computer-readable medium |
| US20150009513A1 (en) * | 2010-07-16 | 2015-01-08 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, and computer-readable medium |
| CN102281399A (en) * | 2011-08-12 | 2011-12-14 | 广东步步高电子工业有限公司 | Digital photographic equipment with touch screen and zooming method of digital photographic equipment |
| CN103988489A (en) * | 2011-09-30 | 2014-08-13 | 富士胶片株式会社 | Imaging device, imaging method, recording medium and program |
| CN103795916A (en) * | 2012-10-26 | 2014-05-14 | 佳能株式会社 | Imaging apparatus and focusing method for imaging apparatus |
| CN103763498A (en) * | 2014-01-24 | 2014-04-30 | 深圳市影歌科技有限公司 | HDMI signal processing system and method |
| CN104270562A (en) * | 2014-08-15 | 2015-01-07 | 广东欧珀移动通信有限公司 | Method and device for focusing when photographing |
Non-Patent Citations (1)
| Title |
|---|
| （美）霍恩: "《机器视觉》", 31 August 2014 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114584700A (en) * | 2020-11-30 | 2022-06-03 | 京东方科技集团股份有限公司 | Focusing marking method, marking device and electronic equipment |
| CN114584700B (en) * | 2020-11-30 | 2024-04-05 | 京东方科技集团股份有限公司 | Focusing marking method, marking device and electronic equipment |
| CN114189628A (en) * | 2021-11-30 | 2022-03-15 | 歌尔光学科技有限公司 | Control method and device of shooting function, AR device and storage medium |
| WO2023097724A1 (en) * | 2021-11-30 | 2023-06-08 | 歌尔股份有限公司 | Photographing function control method and apparatus, ar device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106201238B (en) | 2019-11-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430262B (en) | Filming control method and device | |
| CN105491284B (en) | The display methods and device of preview image | |
| CN106210550A (en) | Mode regulating method and device | |
| CN107426502B (en) | Shooting method and device, electronic equipment and storage medium | |
| CN106020592A (en) | Split screen display method and device | |
| CN106028143A (en) | Video live broadcasting method and device | |
| CN105635567A (en) | Shooting method and device | |
| CN106572389A (en) | Method and apparatus for adjusting display image | |
| CN106231419A (en) | Operation performs method and device | |
| CN105512615B (en) | Image processing method and device | |
| CN105631804B (en) | Image processing method and device | |
| CN105278841B (en) | Control method and device for terminal device | |
| CN106210496A (en) | Method, photo taking and device | |
| CN104700353A (en) | Image filter generating method and device | |
| CN105528078B (en) | The method and device of controlling electronic devices | |
| KR102575196B1 (en) | Photography method, photography apparatus, electronic device, and storage medium | |
| CN104216525B (en) | Method and device for mode control of camera application | |
| CN106407365A (en) | Picture sharing method and apparatus | |
| CN106210495A (en) | Image capturing method and device | |
| CN104460185A (en) | Automatic focusing method and device | |
| CN109600555A (en) | A kind of focusing control method, system and photographing device | |
| CN105959594A (en) | Metering method and device for photographic equipment | |
| CN113364965A (en) | Shooting method and device based on multiple cameras and electronic equipment | |
| CN105100622B (en) | Zoom implementation method and device, electronic equipment | |
| CN105204712B (en) | The display methods and device of folder icon |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |