CN105898261A - Photographing system and method - Google Patents
Photographing system and method Download PDFInfo
- Publication number
- CN105898261A CN105898261A CN201610284751.XA CN201610284751A CN105898261A CN 105898261 A CN105898261 A CN 105898261A CN 201610284751 A CN201610284751 A CN 201610284751A CN 105898261 A CN105898261 A CN 105898261A
- Authority
- CN
- China
- Prior art keywords
- information
- color temperature
- module
- temperature information
- white balance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
- H04N23/88—Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention relates to the technical field of photographing, and especially relates to a photographing system. The system carries out the locating of a position where a mobile terminal is located through a positioning module, and obtains the position information of the mobile terminal, and obtains the color temperature information which is the most matched with the standard position information. The matching degree of the color temperature information with the sunlight color temperature of a region where the mobile terminal is located is the highest. A camera of the mobile terminal can determine the white balance parameter during photographing according to the color temperature information. A flash lamp of the mobile terminal can determine the color temperature value of the flash lamp according to the color temperature information, thereby achieving the optimal photographing effect. The system is simple in operation, achieves the positioning of the mobile terminal through the positioning terminal, solves a problem that the manual setting of the color temperature of the flash lamp and the white balance parameter is not accurate, and also solve a problem that the photographing effect is not good when the unified color temperature of the flash lamp and white balance parameter are employed for all photographing scenes.
Description
Technical field
The present invention relates to filming image technical field, particularly relate to a kind of camera system and method.
Background technology
User can be by all shootings using mobile terminal to carry out impact shooting when at present
The flash lamp colour temperature of scene and white balance parameter are unified, i.e. shoot any scene and all use one specific
Flash lamp colour temperature and white balance parameter, along with the technological progress of mobile terminal, gradually can lead to
Light emitting module and the white balance of crossing the flash lamp of manual use when arranging shooting of user are joined
Number.
The colour temperature at sunshine of different regions is different, so while the difference of colour temperature at sunshine, different
The effect of area shooting i.e. difference, so being not suitable for using same flash lamp colour temperature and white balance
Parameter tackles all of photographed scene, so poor to the effect shot out, additionally, such as
Really user manually arranges light emitting module and the white balance parameter that flash lamp uses, and so operates
Complex, and the setting of user the most not necessarily can well adapt to the day of its location
According to colour temperature, shooting effect is the most satisfied.
Summary of the invention
The problem existed for prior art, now provides a kind of camera system and method.
Concrete technical scheme is as follows:
A kind of camera system, is applied to have in the mobile terminal of flash lamp and photographic head, described
Camera system includes:
Locating module 1, in order to position described mobile terminal, exports a positional information；
Processing module 2, is connected with described locating module 1, in order to obtain according to described positional information
Take the color temperature information of a correspondence；
Flash modules 3, at least includes the light emitting module of two different-colours, and with described place
Reason module 2 connects, and uses during in order to determine described flash lamp operation according to described color temperature information
Described light emitting module；
Photographing module 4, is connected with described processing module 2, in order to true according to described color temperature information
White balance parameter during fixed described photographic head shooting.
Preferably, also include
Memory module 5, is connected with described processing module 2, in order to store standard location information,
The described color temperature information adaptive with described standard location information, and corresponding with described color temperature information
White balance parameter；
Described processing module mates the institute of correspondence according to described positional information in described memory module
State standard location information, and obtain the described colour temperature letter that corresponding described standard location information is corresponding
Breath and described white balance parameter.
Preferably, also include
Display module 6, is connected with described photographing module 4, in order to show that described photographic head shoots
Information.
Preferably, also include
Operation module 7, is connected with described processing module 2, inputs in order to the operation according to user
Described positional information and the color temperature information adaptive with described positional information；And described flash lamp
The described luminous mould that module 3 uses when determining described flash lamp operation according to described color temperature information
Block, photographing module 4 determines described photographic head according to the color temperature information of the operation input of described user
White balance parameter during shooting；Further,
Described operation module 7 is also connected with described memory module 5, and described operation module 7 is also used
So that described positional information and adaptive with described positional information will be inputted according to the operation of user
Color temperature information stores to described memory module 5.
Preferably, described locating module 1 includes gyroscope and GPS locator.
A kind of image pickup method, including:
Step S1, to a mobile terminal location, exports a positional information；
Step S2, obtains the color temperature information of a correspondence according to described positional information；
Step S3, it is provided that one at least includes the flash lamp of the light emitting module of two different-colours, root
Which the light emitting module work used in described flash lamp is determined according to described color temperature information；
Step S4, white balance parameter when determining that described photographic head shoots according to described color temperature information.
Preferably, also included before described step S1:
Step S0, standard location information described in pre-stored and adaptive with described standard location information
Described color temperature information and the white balance parameter corresponding with described color temperature information.
Preferably, specifically include in described step S2:
Step S21, it is right to mate in the standard location information of pre-stored according to described positional information
The described standard location information answered, and obtain corresponding described of described standard location information of correspondence
Color temperature information and described white balance parameter.
Preferably, also included before described step S3
Step S31, inputs described positional information according to the operation of user and believes with described position
The color temperature information that breath is adaptive.
Preferably, also include after described step S31
Step S32, by according to user operation input described positional information and with described position
The color temperature information storage that information is adaptive.
Technique scheme provides the benefit that:
In technique scheme, it is fixed to be carried out mobile terminal location by locating module
Position, obtains the positional information of mobile terminal, determines colour temperature adaptive therewith according to this positional information
Information, this color temperature information and mobile terminal location sunshine colour temperature matching degree the highest, institute
White balance parameter during shooting can be determined according to this color temperature information with the photographic head of mobile terminal,
The flash lamp of mobile terminal can determine which light emitting module of flash lamp according to color temperature information
Work, thus realize optimal shooting effect, technique scheme is simple to operate, by location
Module the position of mobile terminal is carried out location solve manually arrange light emitting module work and set
The inaccurate problem of white balance parameter put, the most also solves and uses unified flash lamp colour temperature
The problem that shooting effect that all of photographed scene brings is bad is tackled with white balance parameter.
Accompanying drawing explanation
Fig. 1-Fig. 2 is the structural representation of the embodiment of a kind of camera system of the present invention；
Fig. 3 is the flow chart of the embodiment of a kind of image pickup method of the present invention.
Detailed description of the invention
It should be noted that in the case of not conflicting, following technical proposals, technical characteristic it
Between can be mutually combined.
Below in conjunction with the accompanying drawings the detailed description of the invention of the present invention is further described:
Present embodiments provide a kind of camera system, be applied to the shifting with flash lamp and photographic head
In dynamic terminal, as it is shown in figure 1, camera system includes:
Locating module 1, in order to position mobile terminal, exports a positional information；
Processing module 2, is connected with locating module 1, corresponding in order to obtain one according to positional information
Color temperature information；
Flash modules 3, at least includes the light emitting module of two different-colours, and with process mould
Block 2 connects, the light emitting module used during in order to determine flash lamp operation according to color temperature information；
Photographing module 4, is connected with processing module 2, in order to determine photographic head according to color temperature information
White balance parameter during shooting.
In the present embodiment, mobile terminal location can be positioned, such as by locating module 1
Mobile terminal can be mobile phone, panel computer etc., by location positioning thus obtain positional information,
Processing module can carry out Treatment Analysis and go out position corresponding to this positional information positional information
Being suitable for using what kind of color temperature information to shoot, flash modules and photographing module are when shooting
This color temperature information is utilized to be capable of preferable shooting effect.
In one preferred embodiment of the present invention, as in figure 2 it is shown, also include
Memory module 5, is connected with processing module 2, in order to store standard location information, with mark
The color temperature information that quasi-positional information is adaptive, and the white balance parameter corresponding with color temperature information；
Processing module mates the standard location information of correspondence according to positional information in memory module,
And obtain color temperature information corresponding to corresponding standard location information and white balance parameter.
In the present embodiment, the positional information obtained after positioning mobile terminal location is permissible
It is longitude information and the latitude information of mobile terminal location, the standard of same pre-stored
Positional information can also be longitude information and latitude information, due to the finiteness of database volume,
The longitude information of the longitude information of mobile terminal location and latitude information and pre-stored and
Latitude information differs when coupling and is set to identical being just defined as and mates the most with positional information
Standard location information, the standard location information that the error amount of its coupling is minimum both can be the most
The standard location information of coupling.
Further, the color temperature information in the present embodiment can be corresponding with standard location information
The colour temperature that the longitude information of colour temperature, i.e. pre-stored is corresponding with latitude information, the color temperature value of flash lamp
White balance parameter when shooting with photographic head all can be corresponding with latitude information according to longitude information
Colour temperature determine.
In one preferred embodiment of the present invention, as in figure 2 it is shown, also include
Display module 6, is connected with photographing module 4, in order to show the information that photographic head shoots.
The information of display photographic head shooting is easy to the information that user sees that photographic head shoots intuitively, this letter
Breath can be image etc..
In one preferred embodiment of the present invention, as in figure 2 it is shown, also include
Operation module 7, is connected with processing module 2, in order to the operation input position according to user
Information and the color temperature information adaptive with positional information；And flash modules 3 is according to colour temperature letter
The light emitting module that breath uses when determining flash lamp operation, photographing module 4 is defeated according to the operation of user
The color temperature information entered determines white balance parameter when photographic head shoots；Further,
Operation module 7 is also connected with memory module 5, and operation module 7 is also in order to will be according to user
Operation input position information and the color temperature information adaptive with positional information store to storage mould
In block 5.
In the present embodiment, the input position information that user can be manual, such as positional information is permissible
For longitude information and latitude information, user can also input by this longitude information and latitude information true
The color temperature information of fixed position, this color temperature information can be this longitude information and latitude information determines
The colour temperature at sunshine of position, the camera system of the present embodiment also have be manually entered positional information and
The function of color temperature information, the experience sense of user is higher.
Further, in the present embodiment, user is manually entered positional information and color temperature information can
It is saved in memory module 5, it is simple to the position that locating module 1 is obtained by subsequent treatment module 2
Information is mated with the positional information being manually entered.
In one preferred embodiment of the present invention, locating module 1 includes that gyroscope and GPS are fixed
Position device.
Present embodiments provide a kind of image pickup method, as it is shown on figure 3, include:
Step S1, to a mobile terminal location, exports a positional information；
Step S2, obtains the color temperature information of a correspondence according to positional information；
Step S3, it is provided that one at least includes the flash lamp of the light emitting module of two different-colours,
Which the light emitting module work used in flash lamp is determined according to color temperature information；
Step S4, white balance parameter when determining that photographic head shoots according to color temperature information.
In above-described embodiment, the colour temperature at sunshine of different regions is different, the most equatorial
Sunshine, colour temperature was about 11000K Kelvin, and neighbouring shooting is relatively suitable for high color temperature under the line,
Contrary, take pictures in the area that latitude is higher and be the most relatively suitable for low colour temperature, such as 5600K or
6500K etc..User, using mobile terminal shooting when, needs to regulate mobile terminal shooting
Time white balance parameter so that shoot information the truest.
After determining color temperature information, the regulation of the white balance parameter of photographic head, this enforcement will be carried out
In example, the information of shooting can be image, and an image color includes red R, blue G, green B
Three primary colors, three parametric component of white balance parameter the reddest, blue, green, the method for the present embodiment
Mainly regulate white balance parameter by the red bluish-green parametric component ratio of regulation.Colour temperature is more
Height, color more biases toward cool colour, i.e. has higher green parametric component；Colour temperature is the lowest, color
More bias toward warm colour, i.e. have higher red parametric component.
In one preferred embodiment of the present invention, step S2 specifically includes:
Step S21, mates correspondence according to positional information in the standard location information of pre-stored
Standard location information, and obtain color temperature information corresponding to corresponding standard location information and white balance
Parameter.
In one preferred embodiment of the present invention, also include after step S4:
Step S5, the information of display photographic head shooting.
In one preferred embodiment of the present invention, also included before step S3
Step S31, according to the operation input position information of user and adaptive with positional information
Color temperature information.
In the present embodiment, user can be manually entered positional information and color temperature information, adds use
The experience sense at family.It should be noted that positional information and color that the user of the present embodiment is manually entered
Temperature information can be associated with the positional information of this area.
In one preferred embodiment of the present invention, also include after step S31
Step S32, by the operation input position information according to user and adaptive with positional information
Color temperature information storage.
Positional information and color temperature information that user is inputted by the present embodiment preserve, in order to follow-up general
This positional information mates as standard location information, and the user of the present embodiment is manually entered
Positional information and color temperature information can be associated with the positional information of this area, if so follow-up
User is again when this position shoots, it is possible to quickly obtain the position inputted before user
Information and color temperature information, increase the experience sense of user.
To sum up, in technique scheme, by locating module, mobile terminal location is entered
Row location, obtains the positional information of mobile terminal, determines adaptive therewith according to this positional information
Color temperature information, this color temperature information and mobile terminal location sunshine colour temperature matching degree
Height, so the photographic head of mobile terminal can determine white balance during shooting according to this color temperature information
Parameter, the flash lamp of mobile terminal can determine which luminescence of flash lamp according to color temperature information
Module works, thus realizes optimal shooting effect, and technique scheme is simple to operate, passes through
Locating module the position of mobile terminal is carried out location solve manually arrange light emitting module work
With the inaccurate problem of white balance parameter arranged, the most also solve and use unified flash lamp
Colour temperature and white balance parameter tackle bad the asking of shooting effect that all of photographed scene brings
Topic.
By explanation and accompanying drawing, give typical case's enforcement of the ad hoc structure of detailed description of the invention
Example, based on present invention spirit, also can make other conversion.Although foregoing invention proposes existing
Preferred embodiment, but, these contents be not intended as limitation.
For a person skilled in the art, after reading described above, various changes and modifications
Will be apparent to undoubtedly.Therefore, appending claims should be regarded as and contains the true of the present invention
Sincere figure and whole variations and modifications of scope.In Claims scope any and all etc.
The scope of valency and content, be all considered as still belonging to the intent and scope of the invention.
Claims (10)
1. a camera system, it is characterised in that be applied to the shifting with flash lamp and photographic head
In dynamic terminal, described camera system includes:
Locating module (1), in order to position described mobile terminal, exports a positional information；
Processing module (2), is connected with described locating module (1), in order to believe according to described position
Breath obtains the color temperature information of a correspondence；
Flash modules (3), at least includes the light emitting module of two different-colours, and with described
Processing module (2) connects, during in order to determine described flash lamp operation according to described color temperature information
The described light emitting module used；
Photographing module (4), is connected with described processing module (2), in order to believe according to described colour temperature
Breath determines white balance parameter when described photographic head shoots.
Camera system the most according to claim 1, it is characterised in that also include
Memory module (5), is connected with described processing module (2), in order to store normal bit confidence
Breath, the described color temperature information adaptive with described standard location information, and with described color temperature information
Corresponding white balance parameter；
Described processing module mates correspondence according to described positional information in described memory module
Described standard location information, and obtain the described colour temperature that corresponding described standard location information is corresponding
Information and described white balance parameter.
Camera system the most according to claim 1, it is characterised in that also include
Display module (6), is connected with described photographing module (4), in order to show described photographic head
The information of shooting.
Camera system the most according to claim 2, it is characterised in that also include
Operation module (7), is connected with described processing module (2), in order to the operation according to user
Input described positional information and the color temperature information adaptive with described positional information；And described sudden strain of a muscle
Described in light lamp module (3) uses when determining described flash lamp operation according to described color temperature information
Light emitting module, photographing module (4) determines according to the color temperature information of the operation input of described user
The white balance parameter during shooting of described photographic head；Further,
Described operation module (7) is also connected with described memory module (5), described operation module
(7) also in order to the operation according to user is inputted described positional information and believes with described position
The color temperature information of breath adaptation stores to described memory module (5).
Camera system the most according to claim 1, it is characterised in that described locating module
(1) gyroscope and GPS locator are included.
6. an image pickup method, it is characterised in that including:
Step S1, to a mobile terminal location, exports a positional information；
Step S2, obtains the color temperature information of a correspondence according to described positional information；
Step S3, it is provided that one at least includes the flash lamp of the light emitting module of two different-colours, root
Which the light emitting module work used in described flash lamp is determined according to described color temperature information；
Step S4, white balance parameter when determining that described photographic head shoots according to described color temperature information.
Image pickup method the most according to claim 6, it is characterised in that in described step
Also include before S1:
Step S0, standard location information described in pre-stored and adaptive with described standard location information
Described color temperature information and the white balance parameter corresponding with described color temperature information.
Image pickup method the most according to claim 7, it is characterised in that described step S2
Specifically include:
Step S21, it is right to mate in the standard location information of pre-stored according to described positional information
The described standard location information answered, and obtain corresponding described of described standard location information of correspondence
Color temperature information and described white balance parameter.
Image pickup method the most according to claim 6, it is characterised in that in described step
Also include before S3
Step S31, inputs described positional information according to the operation of user and believes with described position
The color temperature information that breath is adaptive.
Image pickup method the most according to claim 9, it is characterised in that in described step
Also include after S31
Step S32, by according to user operation input described positional information and with described position
The color temperature information storage that information is adaptive.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610284751.XA CN105898261A (en) | 2016-04-29 | 2016-04-29 | Photographing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610284751.XA CN105898261A (en) | 2016-04-29 | 2016-04-29 | Photographing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105898261A true CN105898261A (en) | 2016-08-24 |
Family
ID=56702311
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610284751.XA Pending CN105898261A (en) | 2016-04-29 | 2016-04-29 | Photographing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105898261A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106506949A (en) * | 2016-10-27 | 2017-03-15 | 上海传英信息技术有限公司 | A kind of photography and vedio recording control system and the control method of mobile terminal |
| CN107087117A (en) * | 2017-05-25 | 2017-08-22 | 上海传英信息技术有限公司 | Mobile terminal and the method using taking photos by using flashlights photo |
| CN108174172A (en) * | 2017-12-25 | 2018-06-15 | 广东欧珀移动通信有限公司 | Image pickup method and device, computer readable storage medium and computer equipment |
| CN108776771A (en) * | 2018-04-25 | 2018-11-09 | 青岛海信移动通信技术股份有限公司 | A kind of method and apparatus of display picture |
| CN109286808A (en) * | 2017-07-21 | 2019-01-29 | 北京小米移动软件有限公司 | White balance calibration method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201163831Y (en) * | 2008-02-01 | 2008-12-10 | 华晶科技股份有限公司 | Flashing module of electronic device |
| CN101399998A (en) * | 2007-09-24 | 2009-04-01 | 鸿富锦精密工业（深圳）有限公司 | White balance adjustment system and method |
| CN103686100A (en) * | 2012-09-24 | 2014-03-26 | 宏达国际电子股份有限公司 | Mobile communication apparatus and flashlight controlling method |
| CN104320642A (en) * | 2014-10-11 | 2015-01-28 | 广东欧珀移动通信有限公司 | Picture processing method and device |
| CN105338333A (en) * | 2014-08-15 | 2016-02-17 | 联想(北京)有限公司 | Image white balance control method and electronic equipment |
-
2016
- 2016-04-29 CN CN201610284751.XA patent/CN105898261A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101399998A (en) * | 2007-09-24 | 2009-04-01 | 鸿富锦精密工业（深圳）有限公司 | White balance adjustment system and method |
| CN201163831Y (en) * | 2008-02-01 | 2008-12-10 | 华晶科技股份有限公司 | Flashing module of electronic device |
| CN103686100A (en) * | 2012-09-24 | 2014-03-26 | 宏达国际电子股份有限公司 | Mobile communication apparatus and flashlight controlling method |
| CN105338333A (en) * | 2014-08-15 | 2016-02-17 | 联想(北京)有限公司 | Image white balance control method and electronic equipment |
| CN104320642A (en) * | 2014-10-11 | 2015-01-28 | 广东欧珀移动通信有限公司 | Picture processing method and device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106506949A (en) * | 2016-10-27 | 2017-03-15 | 上海传英信息技术有限公司 | A kind of photography and vedio recording control system and the control method of mobile terminal |
| CN107087117A (en) * | 2017-05-25 | 2017-08-22 | 上海传英信息技术有限公司 | Mobile terminal and the method using taking photos by using flashlights photo |
| CN109286808A (en) * | 2017-07-21 | 2019-01-29 | 北京小米移动软件有限公司 | White balance calibration method and device |
| CN108174172A (en) * | 2017-12-25 | 2018-06-15 | 广东欧珀移动通信有限公司 | Image pickup method and device, computer readable storage medium and computer equipment |
| CN108776771A (en) * | 2018-04-25 | 2018-11-09 | 青岛海信移动通信技术股份有限公司 | A kind of method and apparatus of display picture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105898261A (en) | Photographing system and method | |
| CN105245863B (en) | The image processing apparatus and its control method and picture pick-up device of progress white balance control | |
| CN101399998B (en) | White balance adjustment system and method | |
| JP6258555B2 (en) | Multi LED camera flash for color temperature adjustment | |
| CN103402102B (en) | The method and apparatus of dual camera camera system and white balance adjusting thereof | |
| US6788813B2 (en) | System and method for effectively performing a white balance operation | |
| CN105940673B (en) | Image processing apparatus and image processing method | |
| CN105306916A (en) | Image pickup apparatus that performs white balance control and method of controlling the same | |
| CN105409211A (en) | Automatic white balancing with skin tone correction for image processing | |
| WO2018058640A1 (en) | Method, apparatus and device for determining photographing policy of photographing device | |
| CN103227928A (en) | White balance adjusting method and device | |
| CN108234971A (en) | White balance parameter determines method, white balance adjustment method and device, storage medium, terminal | |
| US20190199990A1 (en) | Image processing method and device, computer-readable storage medium and computer device | |
| JP4703498B2 (en) | Digital camera | |
| KR102285756B1 (en) | Electronic system and image processing method | |
| CN106535120A (en) | Display screen color temperature adjusting method and apparatus for terminal | |
| CN105578062A (en) | Light metering mode selection method and image acquisition device utilizing same | |
| CN106165409A (en) | Image processing apparatus, camera head, image processing method and program | |
| WO2016184167A1 (en) | Method and device for realizing auto white balance function | |
| US20120075482A1 (en) | Image blending based on image reference information | |
| US9532024B2 (en) | Color calibration and use of multi-LED flash modules | |
| CN106782367B (en) | Liquid crystal-spliced screen shows method and system | |
| JP2002300363A (en) | Method and device for setting background image and recording medium | |
| US9030575B2 (en) | Transformations and white point constraint solutions for a novel chromaticity space | |
| CN114266694A (en) | Image processing method, apparatus and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160824 |
|
| RJ01 | Rejection of invention patent application after publication |