CN110830721A - Image processing method, electronic device and medium - Google Patents
Image processing method, electronic device and medium Download PDFInfo
- Publication number
- CN110830721A CN110830721A CN201911194901.8A CN201911194901A CN110830721A CN 110830721 A CN110830721 A CN 110830721A CN 201911194901 A CN201911194901 A CN 201911194901A CN 110830721 A CN110830721 A CN 110830721A
- Authority
- CN
- China
- Prior art keywords
- target
- image
- exposure
- target image
- source data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses an image processing method, an electronic device and a medium. The method comprises the following steps: receiving a first input of a target image by a user; in response to the first input, selecting target image source data matched with target exposure parameters corresponding to the first input from data associated with the target image; and performing image processing on the target image source data through an image signal processor, and outputting a processed target image. According to the image processing method, the electronic equipment and the medium provided by the embodiment of the invention, the exposure effect can be adjusted again for the shot target image according to the self requirement after the user finishes shooting, and the flexibility of exposure setting is improved.
Description
Technical Field
Embodiments of the present invention relate to the field of image processing, and in particular, to an image processing method, an electronic device, and a medium.
Background
At present, a camera has an automatic exposure control function to ensure that an ideal exposure picture can be obtained in various scenes. Although the auto exposure function can satisfy most scenes, some users may wish to control the effect of exposure according to their preferences or judgments.
In order to meet the setting requirement of a user on an exposure effect in some current cameras, a function of setting exposure parameters before photographing is added. However, once the user finishes taking a picture, the exposure effect of the taken image cannot be changed, and the flexibility of adjusting the exposure effect of the image is low.
Disclosure of Invention
Embodiments of the present invention provide an image processing method, an electronic device, and a medium, so as to solve a problem of low flexibility in setting an exposure effect of an image.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides an image processing method, including:
receiving a first input of a target image by a user;
in response to the first input, selecting target image source data matched with target exposure parameters corresponding to the first input from data associated with the target image;
and performing image processing on the target image source data through an image signal processor, and outputting a processed target image.
In a second aspect, an embodiment of the present invention provides an electronic device, including:
the first input receiving module is used for receiving first input of a user to the target image;
a target image source data selection module, configured to select, in response to the first input, target image source data matching a target exposure parameter corresponding to the first input from data associated with the target image;
and the processing module is used for carrying out image processing on the target image source data through an image signal processor and outputting the processed target image.
In a third aspect, an embodiment of the present invention provides an electronic device, where the device includes: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, implements the image processing method as provided by embodiments of the present invention.
In a fourth aspect, an embodiment of the present invention provides a computer storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the computer program instructions implement the image processing method provided by the embodiment of the present invention.
In an embodiment of the invention, the target image source data matched with the target exposure parameter corresponding to the first input is selected from the pre-stored data associated with the target image by responding to the first input of the user to the target image. Then, image processing is carried out on the data of the target image source through the image signal processor, and the processed target image is output, namely the target image which is exposed according to the target exposure parameter set by the user is obtained, so that the exposure effect of the target image shot firstly can be changed. The exposure effect can be adjusted again for the shot target image according to the requirement of the user after the shooting is finished, and the flexibility of exposure setting is improved.
Drawings
Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device according to another embodiment of the present invention.
Detailed Description
Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present invention by illustrating examples of the present invention.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
At present, the setting for the exposure effect of an image is generally before photographing, and once a user finishes photographing, the exposure effect of the photographed image cannot be changed any more. However, in some scenarios, the user wants to change the exposure effect of the photographed image according to his or her own needs.
Accordingly, embodiments of the present invention provide an image processing method, an electronic device, and a medium, which implement readjustment of an exposure effect of a captured image, and improve flexibility of adjustment of the exposure effect. The following detailed description is to be read with reference to the specific drawings and examples.
Fig. 1 is a flowchart illustrating an image processing method 100 according to an embodiment of the present invention. As shown in fig. 1, an image processing method provided in an embodiment of the present invention is applied to an electronic device, and includes:
In response to the first input, selecting target image source data matching the target exposure parameter corresponding to the first input from the data associated with the target image, step 120.
And step 130, performing image processing on the target image source data through the image signal processor, and outputting a processed target image.
In an embodiment of the invention, the target image source data matched with the target exposure parameter corresponding to the first input is selected from the pre-stored data associated with the target image by responding to the first input of the user to the target image. Then, image processing is carried out on the data of the target image source through the image signal processor, and the processed target image is output, namely the target image which is exposed according to the target exposure parameter set by the user is obtained, so that the exposure effect of the target image shot firstly can be changed. The exposure effect can be adjusted again for the shot target image according to the requirement of the user after the shooting is finished, and the flexibility of exposure setting is improved.
The implementation of each of steps 110 to 130 is described in detail below.
First, a specific implementation of step 110 will be described. In some embodiments, the first input includes an exposure adjustment input to the target image and a second input within the exposure parameter setting interface. The exposure adjustment input is used for displaying an exposure parameter setting interface of a target image, and the second input is used for determining target exposure parameters of the target image.
First, the electronic device receives a user's exposure adjustment input for a target image. The electronic device then displays an exposure parameter setting interface for the target image in response to an exposure adjustment input for the target image. Next, the electronic device receives a second input from the user within the exposure parameter setting interface. Finally, the electronic device determines a target exposure parameter in response to the second input.
As one example, the exposure adjustment input may be a single click input, a double click input, a slide input in a preset direction, a long press input, or the like.
Wherein the first input comprises a selection input of a target exposure parameter. As an example, the selection input may be a single click input, a double click input, or a slide input in a preset direction, or the like.
The exposure parameter setting interface may include a plurality of exposure parameters for user adjustment. As one example, the parameters provided to the user in the Exposure parameter setting interface that are adjustable include Exposure Compensation (EV), Exposure time, and sensitivity (ISO).
As an example, the adjustment range of EV may be several intermediate gears from-2 to + 2. As one example, the adjustment range of the exposure time may include an exposure time corresponding to each image source data included in the data associated with the target image, respectively, to improve the accuracy of the adjustment of the exposure effect on the target image.
As an example, the minimum value of the adjustment range of the ISO may be determined according to the ISO determined by an image sensor gain (sensor gain) corresponding to the target image. For example, the image sensor gain may be a gain of a Complementary Metal Oxide Semiconductor (CMOS) image sensor or a gain of a Charge Coupled Device (CCD) image sensor.
Then, a maximum ISO in the adjustment range of the ISO is determined according to a maximum Image Signal Processing (ISP) gain and a minimum ISO in the adjustment range of the ISO. Specifically, multiplying the ISO determined by the maximum ISP gain by the above-mentioned minimum ISO results in the maximum ISO in the ISO's adjustment range. Specifically, an adjustable range can be generated for the user to adjust, and some gears can be set for the user to adjust.
In an embodiment of the present invention, when setting the target exposure parameter, the user may set at least one of a plurality of exposure parameters for adjustment by the user.
The following describes a specific implementation of step 220. In step 220, the data associated with the target image includes image source data corresponding to each of the N frames of images. The N frame images are obtained by exposure for N different exposure times, respectively. Wherein, the shooting object of each frame image in the N frame images is the same as the shooting object of the target image, and N is an integer greater than or equal to 2.
It should be noted that the N frames of images are all raw images output by the image sensor without being processed by the image signal processor. It is worth mentioning that the target image is an image in jpeg (joint Photographic Experts group) format that is displayed to the user after being processed by the image signal processor.
In the embodiment of the invention, the image source data corresponding to the image obtained by exposing the shooting object in the target image with different exposure time is used as the selection source of the target image source data, so that the authenticity of the target image source data can be ensured, and the reliability of the exposure effect of the target image is improved.
As one example, image source data for a frame of an image includes raw data and metadata for the image. The raw data and metadata are used to change the exposure effect of the image. The raw data is raw data obtained by converting a light source signal captured by a CCD image sensor or a CMOS image sensor into a digital signal. That is, the raw data is raw data of a digital signal output after an image sensor in an image capturing device of an electronic apparatus captures an object. The metadata refers to some attribute information generated when the image acquisition device acquires an image of an object, such as information of ISP gain, shutter speed, aperture value, white balance, and the like.
A specific implementation of acquiring data associated with a target image is described below.
In some embodiments, the N frame images may include an original image corresponding to the target image (i.e., a first image corresponding to the target image). That is, the data associated with the target image includes image source data corresponding to the original image corresponding to the target image.
The first image corresponding to the target image is as follows: the first image acquisition device of the electronic equipment responds to a photographing request of a user and is obtained after exposure is carried out for a first exposure time. Wherein the first exposure time is determined by the first image capturing device based on the shooting environment.
And when the electronic equipment receives an opening instruction of a user for the first image acquisition device, the first image acquisition device is opened, and an image preview interface of the first image acquisition device is displayed.
As an example, the opening instruction of the first image capturing device by the user may be input such as a single-click input, a double-click input, or a sliding input along a preset direction of the icon corresponding to the first image capturing device by the user.
If the electronic equipment receives a photographing request of a user, the first image acquisition device automatically determines first exposure time based on the current photographing environment and photographs a first image with the first exposure time. And then sending the first image into an image signal processor for processing, generating a target image in a JPEG format, and displaying the target image to a user. Meanwhile, the electronic equipment stores image source data corresponding to the first image.
The first image acquisition device determines other N-1 exposure times according to the first exposure time while shooting the first image, and performs exposure respectively according to the other N-1 exposure times to obtain image source data respectively corresponding to other N-1 frame images except the first image in the N frame images. That is, the N-1 frame images of the N frame images other than the first image are: the first image acquisition device is obtained by respectively carrying out exposure in N-1 exposure times except the first exposure time in the N exposure times.
As an example, if the first exposure time is t0And N is 5, the other 4 exposure times may be
2t0And 4t0. Or, taking the first exposure time as a reference, and increasing or decreasing the first exposure time at preset time intervals to obtain other N-1 exposure times.
By utilizing the first image acquisition device to automatically acquire image source data corresponding to each frame of image in the N frames of images, the operation of a user is simplified, and the image processing efficiency is improved.
Because the first exposure time is the optimal exposure time determined based on the shooting environment, other N-1 exposure times are determined according to the first exposure time, image source data corresponding to an image with relatively good exposure time effect can be provided for a user, and the accuracy of exposure of a target image can be improved.
Then, the electronic device saves the target image, the image source data of the first image and the image source data corresponding to the other N-1 frames of images into a file. The image source data of the first image and the image source data corresponding to other N-1 frames of images are stored in association with the target image, so that the electronic equipment can directly find the image source data related to the target image, convenience and rapidness are realized, and the image processing efficiency is improved.
In some embodiments, if the electronic device further includes a second image capturing device, in order to avoid the image preview interface of the first image capturing device from being jammed and improve the efficiency of image processing, the second image capturing device may be used to capture N-1 frames of images of the N frames of images, except for the first image.
That is, the N-1 frame image is: and the second image acquisition devices of the electronic equipment are respectively exposed for N-1 exposure times to obtain the image. Wherein each of the N-1 exposure times is determined based on the first exposure time.
After the electronic equipment receives an opening instruction of a user to the first image acquisition device, the first image acquisition device is started, and meanwhile the second image acquisition device is powered on, so that the second image acquisition device is in a preparation state.
If the electronic equipment receives a photographing request of a user, the first image acquisition device automatically determines first exposure time based on the current photographing environment and photographs a first image with the first exposure time. The electronic device then transmits the first exposure time to the second image capture device. And the second image acquisition device determines other N-1 exposure times according to the first exposure time and respectively exposes according to the other N-1 exposure times to obtain image source data respectively corresponding to other N-1 frame images except the first image in the N frame images. And after the second image acquisition device finishes acquiring the N-1 frame image, entering a dormant state.
The second image acquisition device is used for acquiring other N-1 frame images except the first image in the N frame images, so that the preview of a user on a preview interface of the first image acquisition device can not be influenced, the second image acquisition device can also shoot a plurality of images after the exposure time is changed, and the flexibility of exposure adjustment of the user on the images can be improved.
In some embodiments, if the target exposure parameter includes a target exposure time set by a user, step 120 includes: and taking image source data corresponding to the image with the exposure time matched with the target exposure time in the N frames of images as target image source data.
It should be noted that, in general, the adjustable range of the exposure time in the exposure parameter setting interface is set according to the exposure time corresponding to each image source data in the data associated with the target image.
That is, image source data corresponding to an image having the same exposure time as the target exposure time among the N exposure times is taken as target image source data.
The target image source data comprises original data and metadata corresponding to the image matched with the target exposure time.
In some embodiments, if the target exposure parameter includes a target exposure time, the target image source data is preferentially selected according to the target exposure time. As an example, if the user adjusts only the exposure time or the user adjusts both the exposure time and the ISO, the target image source data is preferentially selected according to the target exposure time set by the user.
In the embodiment of the invention, because each image source data in the data associated with the target image is distinguished by the exposure time, if the target exposure time is set by a user, the target exposure time is used for selecting the target image source data, and the efficiency and the accuracy of selecting the target image source data are improved.
In other embodiments of the present invention, the target exposure parameter is a target sensitivity set by a user, and step 120 includes: and taking image source data corresponding to the image with the exposure time matched with that of the target image in the N frames of images as target image source data.
In the embodiment of the invention, because each image source data in the data associated with the target image is distinguished by the exposure time, if the user only sets the light sensitivity and does not set the exposure time, the reliability of changing the exposure effect of the target image can be improved by selecting the image source data corresponding to the optimal exposure time of the target image as the source data of the target image.
In still other embodiments of the present invention, the target exposure parameter is a target exposure compensation value set by a user, and step 120 includes: and under the condition that the target exposure compensation value is less than zero, taking the image source data corresponding to the second exposure time as the target image source data.
The second exposure time is the maximum exposure time of the M exposure times, which can achieve the exposure effect achieved by the target exposure compensation value under the preset signal gain. The M exposure times include an exposure time that is less than or equal to a first exposure time of the target image among the N exposure times, and M is an integer less than or equal to N.
That is, if the user adjusts the EV and adjusts in a direction of decreasing the EV, i.e. the target EV is less than zero, since the larger the ISO, the larger the noise, the lower the ISO can be first, and then the exposure time can be reduced to find the exposure effect achieved by the target exposure compensation value satisfying the user adjustment.
It should be noted that the preset signal gain is the minimum value of the ISP gain.
Therefore, if the target exposure compensation value is smaller than zero, image source data corresponding to an image with exposure time matched with that of the target image in the N frames of images is preferentially selected as the target image source data. If the ISP gain is reduced to the minimum value, that is, under the preset signal gain, the image source data corresponding to the image matched with the exposure time of the target image still cannot meet the exposure effect corresponding to the target exposure compensation value adjusted by the user, the image source data corresponding to the maximum exposure time (that is, the second exposure time) except the first exposure time among the M exposure times is selected as the target image source data.
And if the ISP gain is reduced to the minimum value, using the image source data corresponding to the image matched with the second exposure time to still not meet the exposure effect corresponding to the target exposure compensation value adjusted by the user, and selecting the image source data corresponding to the maximum exposure time except the first exposure time and the second exposure time from the M exposure times as the target image source data. And analogizing in sequence until image source data corresponding to the maximum exposure time which can realize the exposure effect achieved by the target exposure compensation value under the preset signal gain in the M exposure times is found and used as the target image source data.
In the embodiment of the invention, if the user adjusts in the direction of decreasing the EV, since the larger the ISO is, the larger the noise is, the higher the ISO is, the priority can be given to decreasing the ISO, and then the exposure time is decreased, and the target image source data corresponding to the target exposure compensation value which meets the requirements set by the user is gradually found, so that the noise of the exposed target image can be decreased, and the exposure effect of the exposed target image can be improved.
In some embodiments of the present invention, where the target exposure compensation value is greater than zero, step 120 comprises: and taking the image source data corresponding to the third exposure time as target image source data.
And the third exposure time is the maximum exposure time which can realize the exposure effect achieved by the target exposure compensation value under the preset signal gain in the L exposure times. The L exposure times include exposure times which are greater than or equal to the first exposure time and less than or equal to a preset exposure time threshold value in the N exposure times, and L is an integer less than or equal to N.
In the embodiment of the present invention, if the user adjusts the EV and adjusts the EV in a direction of increasing the EV, that is, the target EV is greater than zero, the image source data corresponding to the image with a longer exposure time in the N frames of images may be preferentially used as the target image source data. However, in order to prevent the image sharpness from being affected by the jitter phenomenon caused by the excessively long exposure time, the selected exposure time is less than or equal to the preset exposure time threshold.
Therefore, if the target exposure compensation value is greater than zero, the image source data corresponding to the maximum exposure time (third exposure time) of the L exposure times is preferentially selected as the target image source data. If the ISP gain is reduced to the minimum value, that is, under the preset signal gain, the image source data corresponding to the image matched with the third exposure time still cannot meet the exposure effect corresponding to the target exposure compensation value adjusted by the user, the image source data corresponding to the maximum exposure time (that is, the fourth exposure time) of the L exposure times except for the third exposure time is selected as the target image source data. And analogizing in sequence until image source data corresponding to the maximum exposure time which can realize the exposure effect achieved by the target exposure compensation value under the preset signal gain in the L exposure times is found and used as the target image source data.
In the embodiment of the invention, if the user adjusts in the direction of increasing the EV, the image source data corresponding to the maximum exposure time which can realize the exposure effect achieved by the target exposure compensation value under the preset signal gain in the L exposure times is used as the target image source data, so that not only can the definition of the exposed target image be improved, but also the exposure effect set by the user can be satisfied.
The specific implementation of step 130 is described below. In step 130, in response to the first input, a preset virtual camera is turned on to start the image signal processor.
The virtual camera does not have corresponding actual camera equipment, and is only used for starting a processing path for processing image source data in the image signal processor.
In some embodiments, image data in YUV format may be obtained by processing the target image source data with the image signal processor enabled.
It should be noted that outputting the processed target image includes obtaining the processed target image, and may also include displaying the processed target image.
In order to save the waiting time of the user, the YUV format image does not need to be processed into a JPEG format image and then returned to the user. The image data in YUV format may be returned first to allow the user to confirm whether the exposure effect for the target image is satisfactory.
If receiving the command of completing exposure adjustment from the user, the bottom layer path of the image signal processor processes the YUV format image into a JPEG format image and returns the JPEG format image to the user.
The processed target image may be an image in YUV format or an image in JPEG format. And when receiving an exposure adjustment finishing instruction of the user, displaying the exposed image in the JPEG format to the user, and replacing the target image with the image for storage.
In the embodiment of the invention, the processed target image is displayed to the user, so that the user can judge whether the exposure requirement of the user is met, and the flexibility is higher.
In some embodiments, prior to step 110, the image processing method further comprises: in response to a third input, a target image is displayed.
As an example, the third input may be a third input in a pre-stored picture library. The third input may be a single-click input, a double-click input, a long-press input, a sliding input along a preset direction, or a preset gesture operation.
As is apparent from the above description, the user can display the exposure parameter setting interface by clicking the target image, and thus the target image needs to be displayed first. For example, after the electronic device receives the third input, the electronic device reads the target image from the saved file, and decodes and displays the target image, so that the user can quickly call the exposure parameter setting interface, thereby improving the image processing efficiency of the target image.
In some embodiments of the present invention, the target image source data comprises target raw data and target metadata, and prior to step 130, the image processing method further comprises step 121. Step 121, determining first metadata according to the target exposure parameters and the target metadata.
In some embodiments, step 121 comprises: taking the target metadata as first metadata under the condition that the target exposure parameter is the target exposure time set by a user; in the case where the target exposure parameter includes a target sensitivity or a target exposure compensation value set by a user, the target metadata is updated based on the target sensitivity or the target exposure compensation value, and the updated target metadata is taken as the first metadata.
In an embodiment of the present invention, on the basis of step 121, step 130 includes: and starting the image signal processor, carrying out image processing on the target original data and the first metadata through the image signal processor, and outputting a processed target image.
Since the metadata does not involve updating the exposure time, if the target exposure parameter is the target exposure time set by the user, the target metadata is used as the first metadata. And then sending the target metadata and the target original data into an image signal processor for processing to obtain an exposed target image.
However, if the user sets not only the target exposure time but also the target sensitivity. Although the target image source data is selected at the target exposure time, the target metadata needs to be updated.
As an example, a first total gain corresponding to a target sensitivity set by a user may be calculated based on the target sensitivity. The first total gain is equal to a product of the first target ISP gain and a sensor gain corresponding to the target image. Wherein, the sensor gain corresponding to the target image is a fixed value. Thus, the first target ISP gain may be calculated.
It should be noted that only the exposure time is changed when the data associated with the target image is acquired, and therefore the sensor gains corresponding to each of the N frames of images included in the data associated with the target image are the same, that is, the sensor gains corresponding to the target image are the same.
And then, updating the original ISP gain in the target metadata selected based on the target exposure time by using the calculated first target ISP gain to obtain first metadata corresponding to the target sensitivity.
If the target exposure parameter is only the target sensitivity set by the user, the target metadata selected based on the target sensitivity still needs to be updated in a similar manner as described above to obtain the first metadata corresponding to the target sensitivity.
In some embodiments, if the target exposure parameter set by the user includes a target exposure compensation value. According to the above, the target image source data matched with the target exposure compensation value can be selected according to the target exposure compensation value. A second total gain may be calculated based on the exposure time corresponding to the selected target image source data and the target exposure compensation value. The second total gain is equal to a product of the second target ISP gain and the sensor gain corresponding to the target image. Wherein, the sensor gain corresponding to the target image is a fixed value. Thus, a second target ISP gain may be calculated.
And then, updating the original ISP gain in the target metadata selected based on the target exposure compensation value by using the calculated second target ISP gain to obtain first metadata corresponding to the target exposure compensation value.
In the embodiment of the present invention, by updating the target metadata based on the target exposure parameter set by the user, the reliability of the exposure effect on the target image can be improved.
Fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. As shown in fig. 2, the electronic apparatus 200 includes:
the first input receiving module 210 is configured to receive a first input of the target image from a user.
And a target image source data selecting module 220, configured to select, in response to the first input, target image source data matching the target exposure parameter corresponding to the first input from the data associated with the target image.
And the processing module 230 is configured to perform image processing on the target image source data through the image signal processor, and output a processed target image.
In an embodiment of the invention, the target image source data matched with the target exposure parameter corresponding to the first input is selected from the pre-stored data associated with the target image by responding to the first input of the user to the target image. Then, image processing is carried out on the data of the target image source through the image signal processor, and the processed target image is output, namely, the target image which is exposed according to the target exposure parameter set by the user is obtained, so that the exposure effect of the target image shot firstly can be changed, namely, the exposure effect of the shot target image can be adjusted again according to the requirement of the user after the shooting is finished, and the flexibility of exposure setting is improved.
In an embodiment of the present invention, the target image source data includes target raw data and target metadata, and in order to improve reliability of an exposure effect on the target image, the electronic device 200 further includes:
and the metadata updating module is used for determining first metadata according to the target exposure parameters and the target metadata.
In an embodiment of the present invention, the processing module 230 is specifically configured to:
and starting the image signal processor, carrying out image processing on the target original data and the first metadata through the image signal processor, and outputting a processed target image.
In an embodiment of the present invention, the metadata update module is configured to:
taking the target metadata as first metadata under the condition that the target exposure parameter is the target exposure time set by a user;
in the case where the target exposure parameter includes a target sensitivity or a target exposure compensation value set by a user, the target metadata is updated based on the target sensitivity or the target exposure compensation value, and the updated target metadata is taken as the first metadata.
In the embodiment of the invention, in order to ensure the authenticity of the source data of the target image and improve the reliability of the exposure effect on the target image, the data associated with the target image comprises the image source data corresponding to each frame of image in the N frames of images. The N frames of images are obtained by respectively exposing N different exposure time; wherein, the shooting object of each frame image in the N frame images is the same as the shooting object of the target image, and N is an integer greater than or equal to 2.
In the embodiment of the present invention, the target exposure parameter includes a target exposure time set by a user, and in order to improve the efficiency and accuracy of selecting the target image source data, the target image source data selecting module 220 is specifically configured to:
and taking image source data corresponding to the image with the exposure time matched with the target exposure time in the N frames of images as target image source data.
In an embodiment of the present invention, the target exposure parameter is a target sensitivity set by a user, and in order to improve reliability of changing an exposure effect of the target image, the target image source data selecting module 220 is specifically configured to:
and taking image source data corresponding to the image with the exposure time matched with that of the target image in the N frames of images as target image source data.
In the embodiment of the present invention, the target exposure parameter is a target exposure compensation value set by a user, and in order to reduce noise of the exposed target image and improve an exposure effect of the exposed target image, the target image source data selecting module 220 is specifically configured to:
and under the condition that the target exposure compensation value is less than zero, taking the image source data corresponding to the second exposure time as the target image source data.
The second exposure time is the maximum exposure time which can realize the exposure effect achieved by the target exposure compensation value under the preset signal gain in the M exposure times; the M exposure times include an exposure time that is less than or equal to a first exposure time of the target image among the N exposure times, and M is an integer less than or equal to N.
In the embodiment of the present invention, the target exposure parameter is a target exposure compensation value set by a user, and in order to improve the definition of the exposed target image and improve the accuracy of the exposure effect on the target image, the target image source data selecting module 220 is specifically configured to:
and taking the image source data corresponding to the third exposure time as the target image source data under the condition that the target exposure compensation value is larger than zero.
The third exposure time is the maximum exposure time which can realize the exposure effect achieved by the target exposure compensation value under the preset signal gain in the L exposure times; the L exposure times include exposure times which are greater than or equal to the first exposure time and less than or equal to a preset exposure time threshold value in the N exposure times, and L is an integer less than or equal to N.
In the embodiment of the invention, the first image corresponding to the target image in the N frames of images is obtained after the first image acquisition device of the electronic equipment is exposed for the first exposure time in response to the photographing request of the user. The first exposure time is determined by the first image capturing device based on the shooting environment.
In order to simplify the operation of a user and improve the efficiency of image processing, the N-1 frames of images except the first image in the N frames of images are: the first image acquisition device is obtained by respectively carrying out exposure in N-1 exposure times except the first exposure time in the N exposure times.
In order to improve the flexibility of exposure adjustment of the image, the N-1 frame image is: and the second image acquisition devices of the electronic equipment are respectively exposed for N-1 exposure times to obtain the image.
In order to improve the accuracy of the exposure of the target image, N-1 exposure times are determined based on the first exposure time.
The image processing apparatus provided in the embodiment of the present invention can implement each process in the method embodiment of fig. 1, and is not described here again to avoid repetition.
Figure 3 is a schematic diagram of a hardware configuration of an electronic device implementing various embodiments of the invention,
the electronic device 300 includes, but is not limited to: a radio frequency unit 301, a network module 302, an audio output unit 303, an input unit 304, a sensor 305, a display unit 306, a user input unit 307, an interface unit 308, a memory 309, a processor 310, a power supply 311, an image capturing apparatus 312, and the like. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 3 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or combine certain components, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The user input unit 307 is configured to receive a first input of the target image from the user.
Wherein, the processor 310 is configured to select, in response to a first input received by the user input unit 307, target image source data matching a target exposure parameter corresponding to the first input from data associated with the target image; and performing image processing on the target image source data through an image signal processor, and outputting a processed target image.
Embodiments of the present invention select target image source data that matches target exposure parameters corresponding to a first input from pre-stored data associated with a target image by, in response to receiving the first input to the target image by a user. Then, image processing is carried out on the data of the target image source through the image signal processor, and the processed target image is output, namely, the target image which is exposed according to the target exposure parameter set by the user is obtained, so that the exposure effect of the target image shot firstly can be changed, namely, the exposure effect of the shot target image can be adjusted again according to the requirement of the user after the shooting is finished, and the flexibility of exposure setting is improved.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 301 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 310; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 301 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 301 can also communicate with a network and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user via the network module 302, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 303 may convert audio data received by the radio frequency unit 301 or the network module 302 or stored in the memory 309 into an audio signal and output as sound. Also, the audio output unit 303 may also provide audio output related to a specific function performed by the electronic apparatus 300 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 303 includes a speaker, a buzzer, a receiver, and the like.
The input unit 304 is used to receive audio or video signals. The input Unit 304 may include a Graphics Processing Unit (GPU) 3041 and a microphone 3042, and the Graphics processor 3041 processes image data of a still picture or video obtained by an image capturing apparatus (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 306. The image frames processed by the graphic processor 3041 may be stored in the memory 309 (or other storage medium) or transmitted via the radio frequency unit 301 or the network module 302. The microphone 3042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 301 in case of the phone call mode.
The electronic device 300 also includes at least one sensor 305, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 3061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 3061 and/or the backlight when the electronic device 300 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 305 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 306 is used to display information input by the user or information provided to the user. The Display unit 306 may include a Display panel 3061, and the Display panel 3061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 307 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 307 includes a touch panel 3071 and other input devices 3072. The touch panel 3071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 3071 (e.g., operations by a user on or near the touch panel 3071 using a finger, a stylus, or any suitable object or attachment). The touch panel 3071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 310, and receives and executes commands sent by the processor 310. In addition, the touch panel 3071 may be implemented using various types, such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 307 may include other input devices 3072 in addition to the touch panel 3071. Specifically, the other input devices 3072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein.
Further, the touch panel 3071 may be overlaid on the display panel 3061, and when the touch panel 3071 detects a touch operation on or near the touch panel, the touch operation is transmitted to the processor 310 to determine the type of the touch event, and then the processor 310 provides a corresponding visual output on the display panel 3061 according to the type of the touch event. Although the touch panel 3071 and the display panel 3061 are shown in fig. 3 as two separate components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 3071 and the display panel 3061 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.
The interface unit 308 is an interface for connecting an external device to the electronic apparatus 300. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 308 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 300 or may be used to transmit data between the electronic apparatus 300 and the external device.
The memory 309 may be used to store software programs as well as various data. The memory 309 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 309 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 310 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by operating or executing software programs and/or modules stored in the memory 309 and calling data stored in the memory 309, thereby performing overall monitoring of the electronic device. Processor 310 may include one or more processing units; preferably, the processor 310 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 310.
The electronic device 300 may further include a power supply 311 (such as a battery) for supplying power to various components, and preferably, the power supply 311 may be logically connected to the processor 310 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
The image capturing device 312 is connected to the processor 310 and the graphic processor 3041 (the connection relationship is not shown in fig. 3) for capturing the above-mentioned N frames of images.
In addition, the electronic device 300 includes some functional modules that are not shown, and are not described in detail herein.
Preferably, an embodiment of the present invention further provides an electronic device, further including a processor 310, a memory 309, and a computer program stored in the memory 309 and capable of running on the processor 310, where the computer program, when executed by the processor 310, implements each process of the above-mentioned embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention. While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (11)
1. An image processing method applied to an electronic device, the method comprising:
receiving a first input of a target image by a user;
in response to the first input, selecting target image source data matched with target exposure parameters corresponding to the first input from data associated with the target image;
and performing image processing on the target image source data through an image signal processor, and outputting the processed target image.
2. The method of claim 1, wherein the target image source data comprises target raw data and target metadata;
before the image signal processor performs image processing on the target image source data and outputs the processed target image, the method further includes:
determining first metadata according to the target exposure parameters and the target metadata;
the image signal processor performs image processing on the target image source data and outputs the processed target image, and the image processing method includes:
and starting the image signal processor, carrying out image processing on the target original data and the first metadata through the image signal processor, and outputting the processed target image.
3. The method of claim 2, wherein determining first metadata based on the target exposure parameters and the target metadata comprises:
taking the target metadata as the first metadata under the condition that the target exposure parameter is a target exposure time set by a user;
and under the condition that the target exposure parameter comprises target sensitivity or a target exposure compensation value set by a user, updating the target metadata based on the target sensitivity or the target exposure compensation value, and taking the updated target metadata as the first metadata.
4. The method of claim 1, wherein the data associated with the target image comprises image source data corresponding to each of N frames of images; the N frames of images are obtained by respectively exposing N different exposure time;
wherein a photographic subject of each frame image in the N frame images is the same as a photographic subject of the target image, and N is an integer greater than or equal to 2.
5. The method of claim 4, wherein the target exposure parameter comprises a target exposure time set by a user;
selecting target image source data matched with the target exposure parameter corresponding to the first input from the data associated with the target image, including:
and taking image source data corresponding to the image with the exposure time matched with the target exposure time in the N frames of images as the target image source data.
6. The method according to claim 4, wherein the target exposure parameter is a target sensitivity set by a user;
selecting target image source data matched with the target exposure parameter corresponding to the first input from the data associated with the target image, including:
and taking image source data corresponding to the image with the exposure time matched with the first exposure time of the target image in the N frames of images as the source data of the target image.
7. The method of claim 4, wherein the target exposure parameter is a target exposure compensation value set by a user;
selecting target image source data matched with the target exposure parameter corresponding to the first input from the data associated with the target image, including:
taking image source data corresponding to second exposure time as the target image source data under the condition that the target exposure compensation value is less than zero; the second exposure time is the maximum exposure time which can realize the exposure effect achieved by the target exposure compensation value under the preset signal gain in the M exposure times; the M exposure times include an exposure time which is less than or equal to a first exposure time of the target image among N exposure times, and M is an integer less than or equal to N;
taking image source data corresponding to a third exposure time as the target image source data under the condition that the target exposure compensation value is larger than zero; the third exposure time is the maximum exposure time which can realize the exposure effect achieved by the target exposure compensation value under the preset signal gain in the L exposure times; the L exposure times include exposure times which are greater than or equal to the first exposure time and less than or equal to a preset exposure time threshold value in the N exposure times, and L is an integer less than or equal to N.
8. The method of claim 4, wherein a first image of the N images corresponding to the target image is: the first image acquisition device of the electronic equipment responds to a photographing request of a user and is obtained after exposure is carried out for first exposure time; the first exposure time is determined by the first image acquisition device based on a shooting environment;
the N-1 frame images except the first image in the N frame images are: the first image acquisition device is obtained by respectively carrying out exposure in N-1 exposure times except the first exposure time in N exposure times;
or the like, or, alternatively,
the N-1 frame image is as follows: the second image acquisition device of the electronic equipment is obtained by respectively carrying out exposure for the N-1 exposure time;
wherein the N-1 exposure times are each determined based on the first exposure time.
9. An electronic device, characterized in that the electronic device comprises:
the first input receiving module is used for receiving first input of a user to the target image;
a target image source data selection module, configured to select, in response to the first input, target image source data matching a target exposure parameter corresponding to the first input from data associated with the target image;
and the processing module is used for carrying out image processing on the target image source data through an image signal processor and outputting the processed target image.
10. An electronic device, characterized in that the device comprises: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, implements the image processing method of any of claims 1-8.
11. A computer storage medium having computer program instructions stored thereon which, when executed by a processor, implement the image processing method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911194901.8A CN110830721B (en) | 2019-11-28 | 2019-11-28 | Image processing method, electronic device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911194901.8A CN110830721B (en) | 2019-11-28 | 2019-11-28 | Image processing method, electronic device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110830721A true CN110830721A (en) | 2020-02-21 |
| CN110830721B CN110830721B (en) | 2021-09-07 |
Family
ID=69543021
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911194901.8A Active CN110830721B (en) | 2019-11-28 | 2019-11-28 | Image processing method, electronic device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110830721B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI828302B (en) * | 2022-09-02 | 2024-01-01 | 英屬維爾京群島商威爾德嘉德有限公司 | Shooting methods and shooting equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140071311A1 (en) * | 2012-09-07 | 2014-03-13 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
| CN103905732A (en) * | 2014-04-02 | 2014-07-02 | 深圳市中兴移动通信有限公司 | Shooting method and shooting device |
| CN104869308A (en) * | 2015-04-29 | 2015-08-26 | 小米科技有限责任公司 | Picture taking method and device |
| CN105827936A (en) * | 2015-08-28 | 2016-08-03 | 维沃移动通信有限公司 | Image processing method and mobile terminal |
| CN107483809A (en) * | 2017-07-20 | 2017-12-15 | 努比亚技术有限公司 | A kind of image capturing method, terminal and computer-readable recording medium |
| US20180191934A1 (en) * | 2016-12-30 | 2018-07-05 | Samsung Electronics Co., Ltd. | Image capturing device and method of driving the same |
| WO2018124051A1 (en) * | 2016-12-27 | 2018-07-05 | パナソニックＩｐマネジメント株式会社 | Image selection device, camera and image selection method |
| CN108364267A (en) * | 2018-02-13 | 2018-08-03 | 北京旷视科技有限公司 | Image processing method, device and equipment |
| CN109922322A (en) * | 2019-04-10 | 2019-06-21 | Oppo广东移动通信有限公司 | Photographic method, image processor, camera arrangement and electronic equipment |
-
2019
- 2019-11-28 CN CN201911194901.8A patent/CN110830721B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140071311A1 (en) * | 2012-09-07 | 2014-03-13 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
| CN103905732A (en) * | 2014-04-02 | 2014-07-02 | 深圳市中兴移动通信有限公司 | Shooting method and shooting device |
| CN104869308A (en) * | 2015-04-29 | 2015-08-26 | 小米科技有限责任公司 | Picture taking method and device |
| CN105827936A (en) * | 2015-08-28 | 2016-08-03 | 维沃移动通信有限公司 | Image processing method and mobile terminal |
| WO2018124051A1 (en) * | 2016-12-27 | 2018-07-05 | パナソニックＩｐマネジメント株式会社 | Image selection device, camera and image selection method |
| US20180191934A1 (en) * | 2016-12-30 | 2018-07-05 | Samsung Electronics Co., Ltd. | Image capturing device and method of driving the same |
| CN107483809A (en) * | 2017-07-20 | 2017-12-15 | 努比亚技术有限公司 | A kind of image capturing method, terminal and computer-readable recording medium |
| CN108364267A (en) * | 2018-02-13 | 2018-08-03 | 北京旷视科技有限公司 | Image processing method, device and equipment |
| CN109922322A (en) * | 2019-04-10 | 2019-06-21 | Oppo广东移动通信有限公司 | Photographic method, image processor, camera arrangement and electronic equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI828302B (en) * | 2022-09-02 | 2024-01-01 | 英屬維爾京群島商威爾德嘉德有限公司 | Shooting methods and shooting equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110830721B (en) | 2021-09-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108513070B (en) | Image processing method, mobile terminal and computer readable storage medium | |
| CN109361865B (en) | Shooting method and terminal | |
| CN110505400B (en) | Preview image display adjustment method and terminal | |
| CN108307109B (en) | High dynamic range image preview method and terminal equipment | |
| CN109361867B (en) | Filter processing method and mobile terminal | |
| CN108924414B (en) | Shooting method and terminal equipment | |
| CN110913139B (en) | Photographing method and electronic equipment | |
| CN109474786B (en) | Preview image generation method and terminal | |
| CN110933306A (en) | Method for sharing shooting parameters and electronic equipment | |
| CN110213484B (en) | Photographing method, terminal equipment and computer readable storage medium | |
| CN109819168B (en) | Camera starting method and mobile terminal | |
| CN111147752B (en) | Zoom factor adjusting method, electronic device, and medium | |
| CN109104566B (en) | Image display method and terminal equipment | |
| JP2023518895A (en) | Imaging methods and electronics | |
| CN108174110B (en) | Photographing method and flexible screen terminal | |
| CN110798621A (en) | Image processing method and electronic equipment | |
| CN110708475B (en) | Exposure parameter determination method, electronic equipment and storage medium | |
| CN111447365B (en) | Shooting method and electronic equipment | |
| KR20220093246A (en) | Filming method and electronic device | |
| CN110881105B (en) | Shooting method and electronic equipment | |
| CN110636225B (en) | Photographing method and electronic equipment | |
| CN110086998B (en) | Shooting method and terminal | |
| CN111131722A (en) | Image processing method, electronic device, and medium | |
| CN110955793A (en) | Display control method and electronic equipment | |
| CN108243489B (en) | Photographing control method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |