CN105973466B - Method and terminal for spectral detection - Google Patents
Method and terminal for spectral detection Download PDFInfo
- Publication number
- CN105973466B CN105973466B CN201610270423.4A CN201610270423A CN105973466B CN 105973466 B CN105973466 B CN 105973466B CN 201610270423 A CN201610270423 A CN 201610270423A CN 105973466 B CN105973466 B CN 105973466B
- Authority
- CN
- China
- Prior art keywords
- spectral response
- response curve
- terminal
- under test
- object under
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003595 spectral effect Effects 0.000 title claims abstract description 201
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000001514 detection method Methods 0.000 title claims abstract description 43
- 230000004044 response Effects 0.000 claims abstract description 174
- 238000012360 testing method Methods 0.000 claims abstract description 71
- 230000003287 optical effect Effects 0.000 claims abstract description 31
- 238000001914 filtration Methods 0.000 claims abstract description 8
- 238000005286 illumination Methods 0.000 claims description 83
- 238000001228 spectrum Methods 0.000 claims description 39
- 238000013507 mapping Methods 0.000 claims description 29
- 238000005315 distribution function Methods 0.000 claims description 19
- 238000009826 distribution Methods 0.000 claims description 6
- 230000006870 function Effects 0.000 description 17
- 238000013461 design Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000003860 storage Methods 0.000 description 6
- 238000012937 correction Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000003796 beauty Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- WFKWXMTUELFFGS-UHFFFAOYSA-N tungsten Chemical compound [W] WFKWXMTUELFFGS-UHFFFAOYSA-N 0.000 description 3
- 229910052721 tungsten Inorganic materials 0.000 description 3
- 239000010937 tungsten Substances 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 235000013305 food Nutrition 0.000 description 2
- 230000004298 light response Effects 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 238000007789 sealing Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 239000000839 emulsion Substances 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 210000002374 sebum Anatomy 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Spectrometry And Color Measurement (AREA)
Abstract
A kind of method and terminal for spectral detection, can be improved the efficiency of the spectral detection of terminal.It include: first spectral response curve of the terminal by optical sensor acquisition object under test under light source and current environment light;Terminal determines the second spectral response curve of current environment light;Terminal determines that third spectral response curve, third spectral response curve are the spectral response curve after the interference for filtering out current environment light of object under test according to the first spectral response curve and the second spectral response curve;Terminal determines the 4th spectral response curve of the objective attribute target attribute of object under test according to third spectral response curve.
Description
Technical field
The present invention relates to methods and terminal that spectral detection is used in field of terminal more particularly to field of terminal.
Background technique
Current light spectrum detection technique has been used in the skin detection of beauty circle, and the skin detection instrument in beauty circle is in detection skin
When skin region, in order to obtain spectral response of the skin area under radiation source as a result, ambient light should be prevented to quilt as far as possible
Spectral interference of the skin area under radiation source is surveyed, so the prior art usually increases before the spectrum sensor of skin detection instrument
The shading sealing ring design of a circle tubular is added, to obtain the spectral response knot for the tested skin area not interfered by ambient light
Fruit.
With the development of intelligent terminal and the development of sensor technology, the miniaturization of device so that beauty circle professional application
The possibility of oriented consumer field development.For example, the function of skin detection is integrated among intelligent terminal.But existing skin
Detection device or instrument must be closed skin tested region using hood, with the influence of isolated environment light, then to skin
Parameter (such as colour of skin) measures and hind computation.And hood is applied on intelligent terminal and not meet terminal small
Type and convenient and fast developing direction, i.e., traditional scheme are unfavorable for the application of intelligent terminal from composition and principle.And it is simple
Simply remove hood to go to carry out spectral detection, then can reduce user because of the interference effect testing result of ambient light
Experience Degree.
Summary of the invention
The present invention provides a kind of methods and terminal for spectral detection, to improve the efficiency of the spectral detection of terminal.
In a first aspect, providing a kind of method for spectral detection, comprising: terminal obtains determinand by optical sensor
First spectral response curve of the body under light source and current environment light;The terminal determines the second spectrum of the current environment light
Response curve;The terminal determines third light according to first spectral response curve and second spectral response curve
Response curve is composed, after the third spectral response curve is the interference for filtering out the current environment light of the object under test
Spectral response curve;The terminal determines the of the objective attribute target attribute of the object under test according to the third spectral response curve
Four spectral response curves.
After the first spectral response curve for obtaining object under test, the second spectral response by determining environment light is bent
Line, and according to second spectral response curve, the interference of the first spectral response curve ambient light is eliminated, spectral characteristic is obtained
More accurate spectral response is as a result, improve the efficiency of the spectral detection of terminal.
In one possible implementation, the terminal determines the second spectral response curve of the current environment light,
It include: that the terminal by the optical sensor obtains second spectrum of the object under test under the current environment light
Response curve.
In one possible implementation, the terminal determines described to be measured according to the third spectral response curve
4th spectral response curve of the objective attribute target attribute of object, comprising: the terminal is according to the third spectral response curve, the light
The filter function model of sensor, the reflection model of the objective attribute target attribute of the object under test, the light source energy distribution function,
Determine the 4th spectral response curve.
In one possible implementation, the terminal is according to the third spectral response curve, the optical sensor
Filter function model, the reflection model of objective attribute target attribute of the object under test, the light source energy distribution function, determine institute
State the 4th spectral response curve, comprising: the terminal determines the 4th light according to formula Y (λ)=∫ F (λ) R (λ) I (λ) d λ
Response curve is composed, wherein Y (λ) indicates that the third spectral response curve, F (λ) indicate the filter function mould of the optical sensor
Type, the R (λ) indicate the reflection model of the objective attribute target attribute of the object under test, and the I (λ) indicates the energy point of the light source
Cloth function.
In one possible implementation, this method further include: the terminal determines target illumination field scape;The terminal
According to the target illumination field scape, the illumination mapping model between the 4th curve of spectrum and the domain CIE XYZ is determined;The end
End determines that the 4th curve of spectrum maps to the value in the domain CIE XYZ according to the illumination mapping model.
Illumination mapping model is determined according to target illumination field scape, and then determines that the 4th curve of spectrum maps to the domain CIE XYZ
Value improve the efficiency of the spectral detection of terminal to obtain the value in the domain CIE XYZ corresponding with target illumination field scape.
In one possible implementation, the terminal determines target illumination field scape, comprising: the terminal obtains user
Input information, the input information is used to indicate the target illumination field scape;The terminal is according to the input information, from more
Determine the target illumination field scape in a candidate's illumination scene, the multiple candidate's illumination scene and multiple illumination mapping models it
Between have corresponding relationship;The terminal according to the target illumination field scape, determine the 4th curve of spectrum and the domain CIE XYZ it
Between illumination mapping model, comprising: the terminal determines that the target illumination field scape is corresponding described according to the corresponding relationship
Illumination mapping model.
In one possible implementation, the optical sensor is multispectral sensor.
Second aspect, provides a kind of terminal, and the terminal includes the module for executing the method for first aspect.It is based on
Same inventive concept should since the principle that the terminal solves the problems, such as is corresponding with the scheme in the design of the method for first aspect
The implementation of terminal may refer to the implementation of method, and overlaps will not be repeated.
The third aspect, provides a kind of terminal, and the terminal includes memory, processor.The memory is for storing
Program, the processor is for executing program.When described program is performed, the processor is used to execute the side of first aspect
Method.Based on the same inventive concept, the principle solved the problems, such as due to the terminal is corresponding with the scheme in the design of the method for first aspect,
Therefore the implementation of the terminal may refer to the implementation of method, and overlaps will not be repeated.
Fourth aspect provides a kind of System on Chip/SoC, including input interface, output interface, at least one processor, storage
Device, the input interface, output interface, the processor and memory are directly connected by bus, and the processor is used for
The code in the memory is executed, when the code is performed, the processor realizes the method in first aspect.It is based on
Same inventive concept, since the principle that the System on Chip/SoC solves the problems, such as is corresponding with the scheme in the design of the method for first aspect, because
The implementation of this System on Chip/SoC may refer to the implementation of method, and overlaps will not be repeated.
5th aspect, provides a kind of computer-readable medium, and the computer-readable medium storage is executed for terminal
Program code, said program code be used for execute first aspect method instruction, based on the same inventive concept, since this is
The principle that solves the problems, such as of system chip designed with the method for first aspect in scheme it is corresponding, therefore the implementation of the System on Chip/SoC can be with
Referring to the implementation of method, overlaps will not be repeated.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be in embodiment or description of the prior art
Required attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some realities of the invention
Example is applied, it for those of ordinary skill in the art, without creative efforts, can also be according to these attached drawings
Obtain other attached drawings.
Fig. 1 is the schematic diagram of skin detection instrument in the prior art.
Fig. 2 is the block schematic illustration of the terminal of the embodiment of the present invention.
Fig. 3 is the flow chart of the method for spectral detection of the embodiment of the present invention.
Fig. 4 is the flow chart of the method for spectral detection of another embodiment of the present invention.
Fig. 5 is the block schematic illustration of the terminal of further embodiment of this invention.
Fig. 6 is the block schematic illustration of the terminal of further embodiment of this invention.
Fig. 7 is the block schematic illustration of the terminal of further embodiment of this invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiment is a part of the embodiments of the present invention, rather than whole embodiments.Based on this hair
Embodiment in bright, those of ordinary skill in the art's every other reality obtained without making creative work
Example is applied, all should belong to the scope of protection of the invention.
It should be understood that the technical solution of the embodiment of the present invention can be applied to various communication systems, and such as: global system for mobile telecommunications
(Global System of Mobile communication, referred to as " GSM ") system, CDMA (Code
Division Multiple Access, referred to as " CDMA ") system, wideband code division multiple access (Wideband Code
Division Multiple Access, referred to as " WCDMA ") system, General Packet Radio Service (General Packet
Radio Service, referred to as " GPRS "), long term evolution (Long Term Evolution, referred to as " LTE ") system, LTE
Frequency division duplex (Frequency Division Duplex, referred to as " FDD ") system, LTE time division duplex (Time Division
Duplex, referred to as " TDD "), Universal Mobile Communication System (Universal Mobile Telecommunication
System, referred to as " UMTS ") or global interconnection inserting of microwave (Worldwide Interoperability for
Microwave Access, referred to as " WiMAX ") communication system etc..
It should also be understood that in embodiments of the present invention, terminal may include mobile phone, tablet computer, PDA (Personal
Digital Assistant, personal digital assistant), POS (Point of Sales, point-of-sale terminal), vehicle-mounted computer etc..
As described above, in the prior art for being usually provided with hood in the instrument of spectral detection, with shielding environment
The interference of the spectral detection result of light measuring targets.For example, Fig. 1 is in the prior art for detecting the spectral detection of skin
The example of instrument.As shown in Figure 1, either skin detection instrument used in medicine/scientific research either make up sales counter use it is portable
Formula skin detection instrument increases the design for having shading sealing ring, all before sensor to avoid the interference of environment light.It is incited somebody to action in possibility
The method of spectral detection is applied under the prospect of terminal, since terminal itself simplifies the requirement with portability, traditional shading
The design of cover is not suitable for being applied in terminal, and simply removes hood merely and go to carry out spectral detection, then can be because of environment
The interference effect testing result of light, reduces user experience.
The present invention is in view of the above-mentioned problems, propose a kind of method for spectral detection.This method can be executed by terminal.
Its main thought is: in the case where no hood, obtaining object under test in light source and current environment light by optical sensor
Under the first spectral response curve, and determine current environment light the second spectral response curve, and according to the first spectral response song
Line and the second spectral response curve obtain the third spectral response curve after the interference of filtering environmental light.To obtain object under test
The third spectral response curve not interfered by ambient light.And the target of object under test is obtained according to the third curve of spectrum
4th curve of spectrum of attribute.
In embodiments of the present invention, after the first spectral response curve for obtaining object under test, by determining environment light
The second spectral response curve eliminate the first spectral response curve ambient light and according to second spectral response curve
Interference, obtains the more accurate spectral response of spectral characteristic as a result, improving the efficiency of terminal spectral detection.
Method provided in an embodiment of the present invention for spectral detection, it is possible to reduce the spectrum of environment light measuring targets is rung
The interference of curve is answered, obtains the more accurate spectral response of spectral characteristic as a result, improving user experience.
It should be noted that in the prior art, spectral detection equipment generallys use XYZ sensor or RGB (Red
Green Blue, RGB) the three coloured lights spectrum device such as sensor obtains the spectral response information of object under test, the frequency spectrum letter of acquisition
The spectral range of breath is limited.It in embodiments of the present invention, can be more by being arranged in the terminal as a preferred embodiment
Spectrum sensor (in other words, bloom spectrum sensor) is passed using multispectral sensor acquisition than conventional XYZ sensor or RGB
The richer spectrum information of sensor, thus obtain than using more first spectral response curves of XYZ sensor spectrum information, into
And the processing of algorithm is carried out according to the first spectral response curve and the second spectral response curve, it obtains object under test and is filtering out ring
Third spectral response curve after the interference of border light.The more accurate spectral response of object under test can be obtained by multispectral sensor
Information.It should be understood that the acceptable wave-length coverage of multispectral sensor may include the wave of traditional XYZ or tradition RGB sensor
Long range.
Fig. 2 shows the schematic block diagrams of the terminal of the embodiment of the present invention.As shown in Figure 1, the terminal 100 includes light sensing
Device 101 and light source 102.The optical sensor can be XYZ sensor, RGB sensor or multispectral sensor, excellent as one
The scheme of choosing will hereafter be described by taking multispectral sensor as an example.The working range of multispectral sensor includes multiple wave bands.Its
In, it can be different according to reflection characteristic of the object under test to the light of different-waveband, select the multispectral sensor of different-waveband, example
Such as, in the case where object under test is people's face skin or color of object surface, can choose receiver wavelength range be covered as 400~
800nm (perhaps 470nm-630nm) can choose reception wavelength in the case where object under test is food or object materials
Range is the multispectral sensor of 700nm~1050nm.Wherein, it according to the resolution ratio of multispectral sensor, can choose multiple
Wavelength into detection object under test spectrum, for example, 480nm can be selected in wave-length coverage, 520nm, 560nm, 600ms,
The light of 660nm, 710nm, 750nm, 780nm, 820nm, 880nm, 900nm, 950nm, 1000nm equiwavelength detection object under test
Spectrum.The multispectral sensor of the embodiment of the present invention also includes the multispectral sensor of other wave-length coverages.The present invention is to multispectral
Sensor is not especially limited.In addition, integrated for the ease of intelligent terminal, light source can be usually used luminous two of terminal
Pole pipe (Light Emitting Diode, LED) lamp.
In addition, the terminal 100 further includes radio frequency (Radio Frequency, RF) circuit 110, memory 120, display screen
140, the components such as voicefrequency circuit 160, I/O subsystem 170, processor 180 and power supply 190.Those skilled in the art can manage
Solution, the restriction of terminal structure shown in Figure 2 not structure paired terminal, may include than illustrating more or fewer components, or
Person combines certain components, perhaps splits certain components or different component layouts.
Wherein, the optical sensor in intelligent terminal in the prior art for shooting is usually RGB sensor, as one
Example, multispectral sensor 101 in Fig. 2 can be with RGB sensor integrations on one chip, i.e. the device of multispectral sensor
Part range includes RGB sensor.Alternatively, multispectral sensor 101 can also be used as an independent sensor and RGB sensor
It is located on different chips.
Fig. 3 is the schematic flow chart of the method for spectral detection of the embodiment of the present invention, as shown in figure 3, this method
It can be executed by terminal, this method 300 includes:
301, terminal obtains first spectral response song of the object under test under light source and current environment light by optical sensor
Line.
It will be understood to those skilled in the art that the spectral response curve in the embodiment of the present invention, may also be referred to as spectrum,
Spectral information or spectral response curve etc..It should be understood that the first spectral response curve in the embodiment of the present invention, can refer in light
The spectrum of the reflected light of source and the object under test under the irradiation of current environment light.
Optionally, which can be set in the terminal, for example, the light source can be the LED light in terminal.Optionally,
The optical sensor can be multispectral sensor.
Optionally, above-mentioned object under test can be people's face skin, or the object of food or other materials.
For example, terminal can open light source, in terminal close to the region of skin to be measured when object under test is people's face skin
In the case where, it is bent that first spectral response of the tested skin under light source and current environment light is obtained by multispectral sensor
Line.
302, the terminal determines the second spectral response curve of the current environment light.
It will be understood by those skilled in the art that current environment light refers to that the object under test is currently located the environment light of environment.
Optionally it is determined that second spectral response curve, can be the terminal by the optical sensor and obtains institute
State second spectral response curve of the object under test under current environment light.
For example, terminal can obtain the object under test the second of current environment in the case where closing the light source
Spectral response curve.
Optionally it is determined that the second spectral response curve of environment light, can be terminal according to the input of user and determines second
Spectral response curve.For example, corresponding second spectral response curve of multiple common environment can be stored in advance in terminal, such as handle official business
Room, market, bedroom etc..Or scene, such as daylight, incandescent lamp, tungsten lamp can also be distinguished according to illumination condition, measurement in advance is simultaneously
Store typical second spectral response curve of different scenes.After the input information for being used to indicate current environment for obtaining user,
Current environment is determined from multiple common environment of storage, and then corresponding second spectral response curve of current environment is determined as
Second spectral response curve of current environment light.
303, the terminal determines third according to first spectral response curve and second spectral response curve
Spectral response curve, the third spectral response curve are light of the object under test after the interference for filtering out the environment light
Compose response curve.
Optionally, the terminal is determined according to first spectral response curve and second spectral response curve
Third spectral response curve, comprising: the terminal by first spectral response curve and second spectral response curve into
The processing of row noise cancellation, obtains not by the 4th spectral response curve of ambient light interference.The embodiment of the present invention to noise cancellation at
The specific method of reason is not construed as limiting, such as the processing of above-mentioned noise cancellation can use vector operation approach.
304, the terminal determines the 4th of the objective attribute target attribute of the object under test according to the third spectral response curve
Spectral response curve.
Wherein, the objective attribute target attribute of the object under test can be the attribute of the object under test.For example, the object under test
It can be face skin, the objective attribute target attribute can be the colour of skin of face skin or the oiliness of face skin.
Optionally it is determined that the 4th spectral response curve, it is bent according to the third spectral response to can be the terminal
Line, the filter function model of the optical sensor, the reflection model of the objective attribute target attribute of the object under test, the light source energy
Distribution function determines the 4th spectral response curve.
Wherein, the reflection model of the objective attribute target attribute of the object under test can refer to the objective attribute target attribute of the object under test
Optical reflection model.The reflection model of the objective attribute target attribute of the object under test can be to be measured by third party's device or the detection of mould group
The property parameters of object, the reflection model of building.For example, in the case where object under test is people's face skin, available third
The parameters such as square device or skin heart, sebum, the texture of mould group detection measurand, construct the skin parameters of measurand
Model.This class model has individuation characteristic.Alternatively, the also skin model of available classics, such as Ku Baika-Man Ke reflection
(Kubelka-Munk) reflection model of the model as face skin.
Wherein, the energy distribution function of above-mentioned light source can be predetermined the energy distribution function of light source.For example,
If light source is the LED light of certain specification, energy distribution function can first pass through unified testing inspection in advance and obtain.Some
In the case of, since LED light cannot be guaranteed that all devices are completely the same, allow actual light distribution and are obtained ahead of time in manufacture
Energy distribution function there are certain errors, and can be by algorithm compensation error, to avoid the inaccuracy of subsequent calculating.Make
For a preferred scheme, light source and multispectral sensor can be packaged together, according to light source and multispectral sensor
The adjustment of response sets the light distribution of light source.
Optionally, the terminal is according to the third spectral response curve, the filter function model of the optical sensor, institute
The reflection model of the objective attribute target attribute of object under test, the energy distribution function of the light source are stated, determines that the 4th spectral response is bent
Line, comprising: the terminal is according to formula
Y (λ)=∫ F (λ) R (λ) I (λ) d λ, (1)
Determine the 4th spectral response curve, wherein Y (λ) indicates that the third spectral response curve, F (λ) indicate institute
The filter function model of optical sensor is stated, the R (λ) indicates the reflection model of the objective attribute target attribute of the object under test, the I
(λ) indicates the energy distribution function of the light source.
Wherein, above-mentioned that 4th spectral response curve is determined according to formula (1), it can be according to third spectral response curve
With formula (1), the 4th spectral response curve is obtained by study.
Optionally, I (λ) is the energy distribution function of light source, and the energy of more accurate light source can be obtained by backoff algorithm
Distribution function is measured, for example, can be trained in advance to device to professional the corresponding of frequency spectrograph using backstage in the concrete realization
Or correction.For example, the I (λ) after correction can be obtained according to such as formula (2)
I (λ)=Iapprox(λ)*SI(λ) (2)
Wherein Iapprox(λ) indicates the energy distribution function of the light source before correction.I (λ) indicates the energy of the light source after correction
Distribution function.SI (λ) indicates to can be in the correction coefficient function under corresponding wavelength in conjunction with the spectrum in the embodiment of the present invention
Sensor module mutually maps with professional frequency spectrograph to the response characteristic of each wave spectrum, learns out.
Optionally, the method 300 of the embodiment of the present invention further include:
305, the terminal determines target illumination field scape;The terminal determines described according to the target illumination field scape
The illumination mapping model of four curves of spectrum and the domain CIE XYZ;The terminal determines the described 4th according to the illumination mapping model
The curve of spectrum maps to the value in the domain CIE XYZ.
The embodiment of the present invention determines illumination mapping model according to target illumination field scape, and then determines the mapping of the 4th curve of spectrum
The spectral detection of terminal is improved to the value in the domain CIE XYZ to obtain the value in the domain CIE XYZ corresponding with target illumination field scape
Efficiency and user Experience Degree.
It should be understood that above-mentioned illumination mapping model can refer to the mapping relations of the 4th curve of spectrum Yu the domain CIE XYZ.According to mesh
It is different to mark illumination scene, the 4th curve of spectrum is different from the illumination mapping model in the domain CIE XYZ.
Optionally, above-mentioned terminal determines target illumination field scape, comprising: the terminal obtains the input information of user, described
Input information is used to indicate the target illumination field scape;The terminal is according to the input information, from multiple candidate illumination scenes
The middle determination target illumination field scape has corresponding close between the multiple candidate's illumination scene and multiple illumination mapping models
System;The terminal determines the corresponding illumination mapping model of the target illumination field scape according to the corresponding relationship.
Wherein, the different illumination conditions such as daylight, incandescent lamp, the tungsten lamp that multiple candidate illumination scene can be as stated earlier
Under scene.The input information of user can serve to indicate that the target illumination field scape of object under test.For example, obtaining user in terminal
Input information before, the option of multiple candidate illumination scenes can be shown to user by man-machine interface, and pass through user's
Input information determines the target illumination field scape that user selects from multiple candidate illumination scenes.And then determine target illumination field scape pair
The illumination mapping model answered.
Below in conjunction with specific example shown in Fig. 4, the embodiment of the present invention is introduced in further detail.It should be noted that the implementation of Fig. 4
Example is used for the purpose of helping skilled in the art to understand the embodiment of the present invention.And the embodiment of the present invention have to be limited to illustrated
Specific value or concrete scene.Those skilled in the art are according to the example of given Fig. 4, it is clear that can carry out various equivalences
Modification or variation, such modifications and variations also fall into the range of the embodiment of the present invention.
As an example, Fig. 4 is showing for the method that the method for the embodiment of the present invention is used to detect the colour of skin of face skin
Meaning property flow chart.Where it is assumed that light source is the LED light in terminal.Optical sensor is that multispectral sensor such as Fig. 4 shows, should
Method includes:
Step 1, terminal receive the instruction information of user, open LED light, and the case where terminal is close to skin area to be measured
Under, obtain tested first spectral response curve of the skin under LED light and current environment light;
Wherein, the product Energy distribution response of general LED light source is it is known that but by cannot be guaranteed institute in the manufacture of LED
Have that device is completely the same, allowing actual energy to be distributed, there is a certain error with known features.It needs to compensate by algorithm, come
Avoid the inaccuracy of subsequent calculating;Wherein, the realization of above-mentioned backoff algorithm, can be by from the background in advance to device and profession frequency
The response of spectrometer is trained or corrects.
The terminal referred in this step is closely or the mode close to capturing skin region is detected, can be in terminal
In integrate multispectral sensor or be integrated with other sensors of multispectral acquisition function, to acquire than routinely being integrated in terminal
The richer spectrum information of RGB sensor is used for skin color model.
Step 2, terminal close LED light, obtain second spectral response curve of the skin to be measured under current environment light.
It should be understood that the first spectral response curve and the second spectral response curve are equivalent to skin to be measured under two kinds of illumination
Spectral response curve.A kind of illumination is in light source and environment light, and another illumination is only under ambient light.
First spectral response curve and the second spectral response curve are carried out noise cancellation processing by step 3, terminal, obtain filter
Third spectral response curve after removing ambient light interference.E.g., including but be not limited to carry out noise cancellation using vector calculus
Processing.
Light distribution information (in other words, energy distribution function), the known multispectral biography of step 4, terminal according to LED light
The illumination reflection model of the filter function model of sensor, face skin, corrects and calculates the spectral response curve of face.
For example, can be obtained by third spectral response curve and formula Y (λ)=∫ F (λ) R (λ) I (λ) d λ by study
4th spectral response curve of the colour of skin of tested skin.
Wherein, F (λ) is the filter function of multispectral sensor, in other words response letter of the optical sensor under wavelength X itself
Number, can be corrected by filter response model;R (λ) can be the illumination reflection model function of face skin in this step, existing
Have and may exist multi-modeling in technology;I (λ) is the energy distribution function (i.e. light distribution information) of light source.Y (λ) is third
The frequency-domain expression of spectral response curve.
Step 5, terminal obtain user and input information, which is used to indicate target light environment.
For example, the target light environment may include the light environment under the different illumination such as daylight, incandescent lamp, tungsten lamp.
For example, can show multiple candidates to user by man-machine interface before the input information that terminal obtains user
The option of illumination scene, and shone by the target light that the input information of user determines that user selects from multiple candidate illumination scenes
Scene.
Step 6, terminal determine illumination mapping model corresponding with the target light environment according to the target light environment.
The illumination mapping model is used to indicate the mapping relations of the 4th spectral response curve Yu the domain CIE XYZ.Terminal is reflected according to the illumination
Model is penetrated, the value that the 4th spectral response curve maps to the domain CIE XYZ is obtained.
For example, the illumination mapping model under the available multiple candidate light environments learnt in advance of terminal.And according to
The target light environment of family selection selects the target light environment from multiple candidate light environments, and is shone according to target light
The corresponding illumination mapping model of environment obtains the value that the 4th curve of spectrum maps to the domain CIE XYZ.
It should be noted that carrying out in frequency domain in step 1 to step 4 to the processing of spectral information, and obtain frequency domain
Spectral response curve.For compatible or support application of the spectral detection in three traditional colour gamuts in the prior art.It can finally incite somebody to action
It converts in the spectral response result of frequency domain to the value in the domain L*a*b.For example, in this step, it can also be by the spectral response of frequency domain
Curve is converted directly into the value in the domain L*a*b.
As a preferred scheme, since the domain CIE XYZ and frequency domain have better linear relationship, it is possible to according to
Illumination mapping model first obtains the 4th spectral response curve and converts to the value in the domain CIE XYZ, then the value in the domain CIE XYZ is converted
To the value in the domain L*a*b.It is possible thereby to obtain, accuracy is higher, closer to the value in the domain L*a*b of object under test color itself.
Optionally, in the scheme of Fig. 4, further includes:
Step 7, terminal are after obtaining the value in the domain L*a*b of the 4th spectral response curve of the colour of skin of tested skin, eventually
End can be by the L*a*b of the value in the corresponding domain L*a*b of the 4th spectral response curve and a variety of skin makeup products (for example, foundation emulsion)
Value is matched, and according to scheduled matching rule, selects the target skin makeup product for most matching the color number of the colour of skin of tested skin,
And user is recommended.
It is alternatively possible in locally database of the building skin makeup product under different light environments, to skin makeup product
The step 1-6 in Fig. 4 can also be used in database sharing.For example, can be obtained using the method for Fig. 4 beautiful under different light environments
The spectral response curve of skin product, and determine its value for being mapped to the domain CIE XYZ, it is then converted into L*a*b value.And it can will be more
The testing result (CIE XYZ value or L*a*b value) of kind skin makeup product is stored in the database in local or cloud.
Wherein, above-mentioned scheduled matching rule, can be matching algorithm.For example, can be most short using such as minimum error method
The matching algorithms such as euclidean distance method, the embodiment of the present invention are not construed as limiting this.
The method for spectral detection of the embodiment of the present invention is described in detail above in association with Fig. 1 to Fig. 4, below in conjunction with
Fig. 5 to Fig. 7 the present invention is described in detail embodiment terminal.
Fig. 5 is the schematic block diagram of the terminal of the embodiment of the present invention.It should be understood that the terminal 500 of Fig. 5 is able to carry out Fig. 2 extremely
Each step of method in Fig. 4, in order to avoid repeating, and will not be described here in detail, and terminal 500 includes:
Module 510 is obtained, for obtaining first light of the object under test under light source and current environment light by optical sensor
Compose response curve;
Determining module 520, for determining the second spectral response curve of the current environment light;
The determining module 520 is also used to bent according to first spectral response curve and second spectral response
Line determines that third spectral response curve, the third spectral response curve filter out the current environment for the object under test
Spectral response curve after the interference of light;
The determining module 520 is also used to determine the target of the object under test according to the third spectral response curve
4th spectral response curve of attribute.
After the first spectral response curve for obtaining object under test, the second spectral response by determining environment light is bent
Line, and according to second spectral response curve, the interference of the first spectral response curve ambient light is eliminated, spectral characteristic is obtained
More accurate spectral response is as a result, improve the efficiency of terminal spectral detection.
Based on the same inventive concept, the side in principle and embodiment of the present invention method solved the problems, such as due to the mobile terminal
Method is similar, therefore the implementation of the terminal may refer to the implementation of method, and overlaps will not be repeated.
Fig. 6 is the schematic block diagram of the terminal of the embodiment of the present invention.It should be understood that the terminal in Fig. 6 is able to carry out Fig. 2 to figure
Each step of method in 4, in order to avoid repeating, and will not be described here in detail, and terminal 600 includes:
Memory 610, for storing program;
Processor 620, for executing the program stored in the memory 610, when described program is performed, the place
Device 620 is managed to be used to obtain first spectral response curve of the object under test under light source and current environment light by optical sensor;Really
Second spectral response curve of the fixed current environment light;It is rung according to first spectral response curve and second spectrum
Curve is answered, determines that third spectral response curve, the third spectral response curve are that filtering out for the object under test is described current
Spectral response curve after the interference of environment light;According to the third spectral response curve, the mesh of the object under test is determined
Mark the 4th spectral response curve of attribute.
After the first spectral response curve for obtaining object under test, the second spectral response by determining environment light is bent
Line, and according to second spectral response curve, the interference of the first spectral response curve ambient light is eliminated, spectral characteristic is obtained
More accurate spectral response is as a result, improve the efficiency of terminal spectral detection.
Based on the same inventive concept, the side in principle and embodiment of the present invention method solved the problems, such as due to the mobile terminal
Method is similar, therefore the implementation of the terminal may refer to the implementation of method, and overlaps will not be repeated.
Fig. 7 is the schematic diagram of the System on Chip/SoC of the embodiment of the present invention.The System on Chip/SoC 700 of Fig. 7 includes that input connects
Mouth 710, output interface 720, at least one processor 730, memory 740, the input interface 710, output interface 720, institute
It states and is connected between processor 730 and memory 740 by bus, the processor 730 is for executing in the memory 740
Code, when the code is performed, the processor 730 realizes method of the Fig. 2 into Fig. 4.Based on the same inventive concept,
Since the principle that the mobile terminal solves the problems, such as is similar to the method in embodiment of the present invention method, the implementation of the terminal can
With referring to the implementation of method, overlaps will not be repeated.
In addition, the terms " system " and " network " are often used interchangeably herein.The terms " and/
Or ", only a kind of incidence relation for describing affiliated partner, indicates may exist three kinds of relationships, for example, A and/or B, it can be with table
Show: individualism A exists simultaneously A and B, these three situations of individualism B.In addition, character "/" herein, typicallys represent front and back
Affiliated partner is a kind of relationship of "or".
It should be understood that in embodiments of the present invention, " B corresponding with A " indicates that B is associated with A, B can be determined according to A.But
It should also be understood that determining that B is not meant to determine B only according to A according to A, B can also be determined according to A and/or other information.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware
With the interchangeability of software, each exemplary composition and step are generally described according to function in the above description.This
A little functions are implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Specially
Industry technical staff can use different methods to achieve the described function each specific application, but this realization is not
It is considered as beyond the scope of this invention.
It is apparent to those skilled in the art that for convenience of description and succinctly, foregoing description is
The specific work process of system, device and unit, can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.In addition, shown or beg for
Opinion mutual coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING of device or unit
Or communication connection, it is also possible to electricity, mechanical or other form connections.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.Some or all of unit therein can be selected to realize the embodiment of the present invention according to the actual needs
Purpose.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, is also possible to two or more units and is integrated in one unit.It is above-mentioned integrated
Unit both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the present invention
Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
Technical characteristic and description in the above a certain embodiment, in order to keep application documents succinctly clear, it is possible to understand that be applicable in
In other embodiments, no longer repeated one by one in other embodiments.
Claims (10)
1. a kind of method for spectral detection characterized by comprising
Terminal obtains first spectral response curve of the object under test under light source and current environment light, the light by optical sensor
Source is arranged in the terminal;
The terminal determines second spectral response curve of the object under test under the current environment light;
The terminal determines third spectral response according to first spectral response curve and second spectral response curve
Curve, the third spectral response curve are that the spectrum after the interference for filtering out the current environment light of the object under test is rung
Answer curve;
The terminal determines the 4th spectral response of the objective attribute target attribute of the object under test according to the third spectral response curve
Curve;
Wherein, the terminal determines second spectral response curve of the object under test under the current environment light, comprising:
The terminal obtains second spectrum of the object under test under the current environment light by the optical sensor
Response curve;
The optical sensor is multispectral sensor.
2. the method as described in claim 1, which is characterized in that the terminal is determined according to the third spectral response curve
4th spectral response curve of the objective attribute target attribute of the object under test, comprising:
The terminal is according to the third spectral response curve, the filter function model of the optical sensor, the object under test
Objective attribute target attribute reflection model and the light source energy distribution function, determine the 4th spectral response curve.
3. method according to claim 2, which is characterized in that the terminal is according to the third spectral response curve, described
Filter function model, the reflection model of the objective attribute target attribute of the object under test and the Energy distribution letter of the light source of optical sensor
Number, determines the 4th spectral response curve, comprising:
The terminal determines the 4th spectral response curve, wherein Y (λ) table according to formula Y (λ)=∫ F (λ) R (λ) I (λ) d λ
Show the third spectral response curve, F (λ) indicates the filter function model of the optical sensor, the R (λ) indicate it is described to
The reflection model of the objective attribute target attribute of object is surveyed, the I (λ) indicates the energy distribution function of the light source.
4. method according to any one of claims 1 to 3, which is characterized in that the method also includes:
The terminal determines target illumination field scape;
The terminal determines that the illumination between the 4th curve of spectrum and the domain CIE XYZ is reflected according to the target illumination field scape
Penetrate model;
The terminal determines that the 4th curve of spectrum maps to the value in the domain CIEXYZ according to the illumination mapping model.
5. method as claimed in claim 4, which is characterized in that the terminal determines target illumination field scape, comprising:
The terminal obtains the input information of user, and the input information is used to indicate the target illumination field scape;
The terminal determines the target illumination field scape from multiple candidate illumination scenes according to the input information, described more
There is corresponding relationship between a candidate's illumination scene and multiple illumination mapping models;
The terminal determines that the illumination between the 4th curve of spectrum and the domain CIE XYZ is reflected according to the target illumination field scape
Penetrate model, comprising:
The terminal determines the corresponding illumination mapping model of the target illumination field scape according to the corresponding relationship.
6. a kind of terminal characterized by comprising
Module is obtained, it is bent for obtaining first spectral response of the object under test under light source and current environment light by optical sensor
Line;
Determining module, for determining second spectral response curve of the object under test under the current environment light;
The determining module is also used to determine according to first spectral response curve and second spectral response curve
Three spectral response curves, the third spectral response curve be the object under test the interference for filtering out the current environment light it
Spectral response curve afterwards;
The determining module is also used to determine the of the objective attribute target attribute of the object under test according to the third spectral response curve
Four spectral response curves;
Wherein, the determining module is specifically used for obtaining the object under test in the current environment light by the optical sensor
Under second spectral response curve;
The optical sensor is multispectral sensor.
7. terminal as claimed in claim 6, which is characterized in that the determining module is specifically used for being rung according to the third spectrum
Answer curve, the filter function model of the optical sensor, the object under test objective attribute target attribute reflection model and the light source
Energy distribution function, determine the 4th spectral response curve.
8. terminal as claimed in claim 7, which is characterized in that the determining module is specifically used for according to formula Y (λ)=∫ F
(λ) R (λ) I (λ) d λ, determines the 4th spectral response curve, and wherein Y (λ) indicates the third spectral response curve, F (λ)
Indicating the filter function model of the optical sensor, the R (λ) indicates the reflection model of the objective attribute target attribute of the object under test,
The I (λ) indicates the energy distribution function of the light source.
9. the terminal as described in any one of claim 6 to 8, which is characterized in that the determining module is also used to determine target
Illumination scene;According to the target illumination field scape, the illumination mapping mould between the 4th curve of spectrum and the domain CIE XYZ is determined
Type;According to the illumination mapping model, determine that the 4th curve of spectrum maps to the value in the domain CIE XYZ.
10. terminal as claimed in claim 9, which is characterized in that the determining module is specifically used for obtaining the input letter of user
Breath, the input information are used to indicate the target illumination field scape;According to the input information, from multiple candidate illumination scenes
It determines the target illumination field scape, there is corresponding relationship between the multiple candidate's illumination scene and multiple illumination mapping models;
According to the corresponding relationship, the corresponding illumination mapping model of the target illumination field scape is determined.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610270423.4A CN105973466B (en) | 2016-04-27 | 2016-04-27 | Method and terminal for spectral detection |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610270423.4A CN105973466B (en) | 2016-04-27 | 2016-04-27 | Method and terminal for spectral detection |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105973466A CN105973466A (en) | 2016-09-28 |
CN105973466B true CN105973466B (en) | 2019-07-23 |
Family
ID=56993325
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610270423.4A Active CN105973466B (en) | 2016-04-27 | 2016-04-27 | Method and terminal for spectral detection |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105973466B (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2682593C1 (en) * | 2018-03-30 | 2019-03-19 | Самсунг Электроникс Ко., Лтд. | Ultra-compact high-resolution spectrometer and its application method |
US11330983B2 (en) | 2018-03-30 | 2022-05-17 | Samsung Electronics Co., Ltd. | Electronic device for acquiring state information on object, and control method therefor |
CN110580879B (en) * | 2018-06-07 | 2021-07-20 | 华为技术有限公司 | Terminal device and display screen control method |
CN108924437A (en) * | 2018-08-02 | 2018-11-30 | 清华大学 | Overcome the video multispectral imaging method, apparatus and storage medium of ambient light interference |
CN109269643B (en) * | 2018-11-02 | 2021-05-11 | 天津津航技术物理研究所 | Spectrum demodulation system and method based on mobile device screen light source |
CN110132323A (en) * | 2019-04-23 | 2019-08-16 | 深圳市志奋领科技有限公司 | A kind of removing method and device of ambient light interference |
CN110287809B (en) * | 2019-06-03 | 2021-08-24 | Oppo广东移动通信有限公司 | Image processing method and related product |
CN112816441B (en) * | 2020-12-23 | 2022-09-02 | 华南农业大学 | Method and device for detecting growth condition of facility horticultural crop |
CN113358224B (en) * | 2021-06-15 | 2023-09-26 | 杭州海康威视数字技术股份有限公司 | Spectral reflectivity detection method and system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1519167A3 (en) * | 2003-09-26 | 2005-06-01 | X-Rite, Inc. | Color measurement instrument |
CN102192783A (en) * | 2010-03-05 | 2011-09-21 | 日本电气株式会社 | Light measuring apparatus and light measuring method |
CN102331301A (en) * | 2010-07-13 | 2012-01-25 | 卡尔斯特里姆保健公司 | Dental shade mapping |
CN104749155A (en) * | 2013-12-27 | 2015-07-01 | 同方威视技术股份有限公司 | Raman spectrum detection method for detecting sample in container |
CN104749156A (en) * | 2013-12-27 | 2015-07-01 | 同方威视技术股份有限公司 | Raman spectrum detection method |
-
2016
- 2016-04-27 CN CN201610270423.4A patent/CN105973466B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1519167A3 (en) * | 2003-09-26 | 2005-06-01 | X-Rite, Inc. | Color measurement instrument |
CN102192783A (en) * | 2010-03-05 | 2011-09-21 | 日本电气株式会社 | Light measuring apparatus and light measuring method |
CN102331301A (en) * | 2010-07-13 | 2012-01-25 | 卡尔斯特里姆保健公司 | Dental shade mapping |
CN104749155A (en) * | 2013-12-27 | 2015-07-01 | 同方威视技术股份有限公司 | Raman spectrum detection method for detecting sample in container |
CN104749156A (en) * | 2013-12-27 | 2015-07-01 | 同方威视技术股份有限公司 | Raman spectrum detection method |
Also Published As
Publication number | Publication date |
---|---|
CN105973466A (en) | 2016-09-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105973466B (en) | Method and terminal for spectral detection | |
KR102007309B1 (en) | Method and device for measuring the colour of an object | |
CN106211804B (en) | Automatic white balance is carried out using to the colour measurement of raw image data | |
JP5883949B2 (en) | Spectral synthesis for image capture device processing. | |
US9049407B2 (en) | Color correction of images | |
EP3775810B1 (en) | Calibrated brightness estimation using ambient color sensors | |
CN113196288B (en) | Method and apparatus for estimating scene illuminant based on skin reflectivity database | |
JP2003533831A (en) | Method and apparatus for measuring, encoding and displaying object color for digital imaging processing | |
KR20180084035A (en) | Method and related device for determining the reflectance of an object | |
KR102002622B1 (en) | System for determining a personal color and method thereof | |
CN103077541A (en) | Measuring and expressing method and system for skin color of human face | |
CN109982059A (en) | The estimation of illumination coloration in automatic white balance | |
Ahn et al. | Improving color constancy by saturation weighting | |
CN109269643A (en) | Spectrum demodulating system and method based on mobile device screen light source | |
Crichton et al. | Skin chromaticity gamuts for illumination recovery | |
Molada-Teba et al. | Towards colour-accurate documentation of anonymous expressions | |
CN106165543A (en) | For calibrating the system and method launching light to meet the criterion for reflection light | |
CN102906762A (en) | System and method for measuring a color value of a target | |
Huynh et al. | Recovery of spectral sensitivity functions from a colour chart image under unknown spectrally smooth illumination | |
Oleari et al. | Digital image‐color conversion between different illuminants by color‐constancy actuation in a color‐vision model based on the OSA‐UCS system | |
JP2011095110A (en) | Apparatus and method for estimation of light source | |
CN105286841A (en) | Heart rate detection method and system | |
US20220070425A1 (en) | Multi-sensor system | |
JP2019501509A (en) | Configuration of the intensity of the light source constituting the illumination device | |
Zhang et al. | Metamer mismatching and its consequences for predicting how colours are affected by the illuminant |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |