CN113014803A - Filter adding method and device and electronic equipment - Google Patents
Filter adding method and device and electronic equipment Download PDFInfo
- Publication number
- CN113014803A CN113014803A CN202110157569.9A CN202110157569A CN113014803A CN 113014803 A CN113014803 A CN 113014803A CN 202110157569 A CN202110157569 A CN 202110157569A CN 113014803 A CN113014803 A CN 113014803A
- Authority
- CN
- China
- Prior art keywords
- target
- image data
- pixel point
- filter
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The application discloses a filter adding method and device and electronic equipment, and belongs to the technical field of communication. The problem that the efficiency of adding the filter effect to the image is low when the electronic equipment shoots can be solved. The method comprises the following steps: receiving a first input under the condition of shooting by adopting a camera; responding to the first input, and adjusting respective corresponding sampling rates of target pixel points of a sensor of the camera based on a target filter effect corresponding to the first input; and processing the original image data acquired by the sensor according to the adjusted sampling rate to obtain target image data, wherein the image corresponding to the target image data has a target filter effect. The embodiment of the application is applied to the process that the filter is added when the electronic equipment shoots.
Description
Technical Field
The application belongs to the technical field of communication, and particularly relates to a filter adding method and device and electronic equipment.
Background
Generally, when an electronic device is used for shooting, a user can trigger the electronic device to add a filter to a shot image according to a use requirement, so as to obtain the image with a certain filter effect.
In the related art, in the process of shooting, the electronic device may adjust image data obtained when the image is shot in a preset manner, so as to adjust color effect (for example, adding a black and white filter effect), saturation, contrast, and the like of the image, so as to obtain images with different style effects.
However, in the above method, after the sensor acquires the initial image data and the RGB data is obtained by processing the image data, the post-adjustment is performed on each pixel point of the image by the software algorithm to obtain the image with the corresponding filter effect. Because the step of software algorithm is added after the image is collected, the photographing time is relatively long, and the efficiency of adding the filter effect to the image by the electronic equipment is low when the image is photographed.
Disclosure of Invention
The embodiment of the application aims to provide a filter adding method and device and electronic equipment, and the problem that the efficiency of adding a filter effect to an image is low when the electronic equipment shoots can be solved.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a filter adding method, including: receiving a first input under the condition of shooting by adopting a camera; responding to the first input, and adjusting respective corresponding sampling rates of target pixel points of a sensor of the camera based on a target filter effect corresponding to the first input; and processing the original image data acquired by the sensor according to the adjusted sampling rate to obtain target image data, wherein the image corresponding to the target image data has a target filter effect.
In a second aspect, an embodiment of the present application provides a filter adding apparatus, including: the device comprises a receiving module, an adjusting module and a processing module. The receiving module is used for receiving a first input under the condition of shooting by adopting the camera. And the adjusting module is used for responding to the first input received by the receiving module and adjusting the sampling rate corresponding to each target pixel point of the sensor of the camera based on the target filter effect corresponding to the first input. And the processing module is used for processing the original image data acquired by the sensor according to the adjusted sampling rate to obtain target image data, and the image corresponding to the target image data has a target filter effect.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.
In the embodiment of the application, when a user triggers the electronic device to shoot by using the camera, the user can perform the first input to trigger the electronic device to adjust the sampling rates corresponding to the target pixel points of the sensor of the camera based on the target filter effect corresponding to the first input of the user, so that the original image data collected by the sensor can be processed according to the adjusted sampling rates, and the image corresponding to the obtained target image data has the target filter effect. When the electronic equipment adopts the camera to shoot, a user can carry out first input to determine a target filter effect required to be added to an image to be shot through the first input, so that the electronic equipment can adjust respective corresponding sampling rates of target pixel points of a sensor of the camera according to the target filter effect corresponding to the first input, and the electronic equipment can directly obtain target image data according to the adjusted sampling rates when processing original image data collected by the sensor, and the image corresponding to the target image data is an image with the target filter effect. The image with the target filter effect can be obtained without processing the original image data acquired by the sensor through the default sampling rate to obtain the RGB data by the electronic equipment and then performing later-stage adjustment on each pixel point of the image corresponding to the RGB data through a software algorithm, so that the process of processing the image data by the electronic equipment can be reduced, and the efficiency of adding the filter effect to the image when the electronic equipment shoots can be improved.
Drawings
Fig. 1 is a schematic diagram of an imaging principle of a camera provided in an embodiment of the present application;
fig. 2 is a schematic diagram of a demosaicing process performed on pixel points according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of a filter adding method according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of an example of an interface of a mobile phone according to an embodiment of the present application;
fig. 5 is a second schematic diagram of a filter adding method according to an embodiment of the present application;
fig. 6 is a third schematic diagram of a filter adding method according to an embodiment of the present disclosure;
FIG. 7 is a fourth schematic diagram of a filter adding method according to an embodiment of the present disclosure;
FIG. 8 is a fifth schematic diagram of a filter adding method according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of a filter adding apparatus according to an embodiment of the present disclosure;
fig. 10 is a second schematic structural diagram of a filter adding apparatus according to an embodiment of the present application;
fig. 11 is a third schematic structural diagram of a filter adding apparatus according to an embodiment of the present disclosure;
fig. 12 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
A filter lens: also called filter, is a special image effect processing technique, and in general, filters perform calculation and conversion processing on attributes such as color, brightness, saturation, contrast, hue, distribution, arrangement, and the like of pixels in an image according to a certain program algorithm, and as a result, the obtained image is caused to produce a special effect.
Camera formation of image principle: the working principle of the camera is roughly that an optical image generated by a scene through a lens is projected on the surface of a sensor, then the optical image is converted into an electric signal, the electric signal is converted into a digital image signal after analog-to-digital conversion, the digital image signal is sent to a digital signal processing chip to be processed to obtain RGB data, and finally images in various file formats (such as JPG format) are obtained through compression and stored.
Specifically, as shown in fig. 1, light enters the camera, the electronic device focuses an image on an imaging element (CCD/CMOS sensor) through an optical system, the sensor performs color filtering and light sensing (photoelectric conversion), and "decomposes" a photographed object into individual pixel points according to a certain arrangement, and the pixel points are transferred to an "analog-to-Digital converter" in the form of an analog image Signal, converted into a Digital image Signal, and transmitted to an image processor (i.e., a Digital Signal Processing (DSP)) for Processing, the Digital image Signal is processed at a fixed sampling rate to be processed into a real image, and then compressed and stored in a storage medium.
The filter adding method provided by the embodiment of the application can be applied to a scene that a filter effect is added to a shot picture when the electronic equipment shoots. The specific application scenario may be determined according to the use requirement, and the application is not limited.
Taking the example of adding a black and white filter effect to a shot picture when the electronic device shoots, in the related art, the implementation principle of the filter is that RGB data obtained by image data processing is substantially adjusted according to a specific rule and a specific mode in the process of shooting by the electronic device, so as to adjust RGB pixel values of image pixels, thereby obtaining different color effects (such as a black and white filter), or adjusting the saturation and contrast of an image, so as to obtain different style effects. Each pixel point of a common sensor can only detect the intensity of received light, and cannot detect the color of the light. In order to obtain a Color image, a Color Filter Array (CFA) is added in front of the sensor, so that each pixel point can independently detect a Color, and the remaining two colors missing from the pixel point are calculated through an algorithm. This process is called a Demosaic (Demosaic) process. In a common demosaicing process, a method for calculating missing residual colors is an interpolation algorithm, that is, a color value of a current pixel point is calculated by referring to color values of adjacent pixel points with specific colors. In connection with FIG. 2, the G component, such as pixel point R1, may be calculated as: gR1＝0.25*(G10+G11) Where 0.25 is referred to as the sampling rate. Different results can be obtained by the color components of the pixel points with different sampling rates, namely, different results can be obtained by the color finally expressed by the pixel points.
In the embodiment of the application, when a user triggers the electronic device to shoot through the camera, the user can input the control corresponding to the black-and-white filter effect displayed in the shooting preview picture, so that the electronic device can adjust the sampling rate corresponding to the target pixel point of the sensor of the camera, and the sampling rate corresponds to the black-and-white filter effect, and thus, the original image data collected by the sensor can be processed according to the adjusted sampling rate, and the target image data with the black-and-white filter effect is obtained. Specifically, after light enters a camera of the electronic device and focuses an image on an imaging element (sensor) through an optical system, the sensor performs color filtering and light sensing (photoelectric conversion), a shot object is decomposed into pixel points according to a certain arrangement mode, the pixel points are transferred to an analog-to-digital converter in the form of analog image signals and converted into digital image signals, and when the digital image signals are transmitted to an image processor for processing, the digital image signals can be processed by adopting a sampling rate corresponding to a black-and-white filter effect, so that an image with the black-and-white filter effect is directly obtained. The original image data is not required to be converted into an electric signal, the electric signal is converted into a digital image signal after analog-to-digital conversion, the digital image signal is sent to a digital signal processing chip to be processed to obtain RGB data, and then later-stage adjustment is carried out on each pixel point of the RGB data image through a software algorithm to obtain an image with a black-and-white filter effect, so that the process of processing the image data can be reduced, and the efficiency of adding the filter effect to the image when the electronic equipment shoots the image can be improved.
The filter adding method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
An embodiment of the present application provides a filter adding method, and fig. 3 shows a flowchart of the filter adding method provided in the embodiment of the present application, where the method can be applied to an electronic device. As shown in fig. 3, the filter adding method provided in the embodiment of the present application may include steps 201 to 203 described below.
In the embodiment of the application, when the electronic equipment adopts the camera to shoot, the user can perform the first input, so that the electronic equipment can adjust the sampling rate corresponding to the target pixel point of the sensor of the camera based on the target filter effect corresponding to the first input of the user, and process the original image data collected by the sensor according to the adjusted sampling rate to obtain the target image data with the target filter effect.
Optionally, in this embodiment of the application, when the user triggers the electronic device to run the camera application program for shooting, a shooting preview screen is displayed in the screen, and a plurality of filter controls are displayed in the shooting preview screen, so that the user can perform a first input on a certain control of the plurality of filter controls, so that the electronic device adds a corresponding filter effect to a picture to be shot.
Optionally, in this embodiment of the application, each filter control of the multiple filter controls corresponds to one filter effect, different filter controls are associated with (correspond to) different filter effects, and the multiple filter effects corresponding to the multiple filter controls may include: black and white filter effect, medium grey filter effect, cowboy filter effect, blue adjusting filter effect, nostalgic filter effect, etc.
Optionally, in this embodiment of the application, the first input is a selection input of a user to any filter control of a plurality of filter controls displayed in a shooting preview picture, so as to trigger the electronic device to add a filter effect corresponding to the filter control selected by the user to a picture to be shot.
Optionally, in this embodiment of the application, the electronic device may obtain a target filter effect associated with a filter control corresponding to the first input of the user, and determine respective sampling rates corresponding to target pixels of the sensor when a picture of the target filter effect is obtained in the current scene, so that the respective sampling rates corresponding to the target pixels of the sensor of the camera may be adjusted.
It should be noted that, when the electronic device is in the same shooting scene, for the same filter effect, the sampling rates corresponding to each pixel of the sensor of the camera are not necessarily the same. Moreover, for a pixel point of the sensor of the camera, when the electronic device is in different shooting scenes, for the same filter effect, due to the influence of the surrounding environment, the corresponding sampling rate of the pixel point of the sensor of the camera is not necessarily the same when the pixel point is in different shooting scenes.
And step 203, the electronic equipment processes the original image data acquired by the sensor according to the adjusted sampling rate to obtain target image data.
Wherein, the image corresponding to the target image data has a target filter effect.
Optionally, in this embodiment of the application, after the original image data corresponding to the captured image acquired by the sensor of the camera is acquired, the electronic device may perform analog-to-digital conversion on the original image data to obtain a corresponding digital image signal, so that when the image processor processes the digital image signal, the digital image signal may be processed by using the adjusted sampling rate, and thus the target image data is directly obtained.
The electronic device is taken as a mobile phone for illustration. As shown in fig. 4, when the mobile phone displays a shooting preview screen 10, a plurality of filter controls (i.e., a filter 1, a filter 2, and a filter 3) are displayed in the shooting preview screen 10, and a user can select and input a filter control 11 (e.g., a black and white filter control) in the plurality of filter controls, so that the mobile phone can determine that a filter effect added to an image to be shot is a black and white filter effect, and determine that a sampling rate corresponding to the black and white filter effect is m in a current environment according to the current environment of the mobile phone, so that when processing original image data acquired by a sensor, a digital image signal can be processed according to the sampling rate m, so that an image corresponding to the obtained final RGB data is an image with a filter effect.
The embodiment of the application provides a filter adding method, wherein a user can perform first input under the condition that the user triggers electronic equipment to shoot by adopting a camera, so that the triggering electronic equipment can adjust respective sampling rates corresponding to target pixel points of a sensor of the camera based on a target filter effect corresponding to the first input of the user, and therefore original image data collected by the sensor can be processed according to the adjusted sampling rates, and an image corresponding to the obtained target image data has the target filter effect. When the electronic equipment adopts the camera to shoot, a user can carry out first input to determine a target filter effect required to be added to an image to be shot through the first input, so that the electronic equipment can adjust respective corresponding sampling rates of target pixel points of a sensor of the camera according to the target filter effect corresponding to the first input, and the electronic equipment can directly obtain target image data according to the adjusted sampling rates when processing original image data collected by the sensor, and the image corresponding to the target image data is an image with the target filter effect. The image with the target filter effect can be obtained without processing the original image data acquired by the sensor through the default sampling rate to obtain the RGB data by the electronic equipment and then performing later-stage adjustment on each pixel point of the image corresponding to the RGB data through a software algorithm, so that the process of processing the image data by the electronic equipment can be reduced, and the efficiency of adding the filter effect to the image when the electronic equipment shoots can be improved.
Optionally, in this embodiment, with reference to fig. 3, as shown in fig. 5, before the step 203, the filter adding method provided in this embodiment may further include the following step 301 and step 302, and the step 203 may be specifically realized by the following step 203 a.
Optionally, in this embodiment of the application, before the electronic device processes the original image data acquired by the sensor according to the adjusted sampling rate to obtain the target image data, the user may perform a second input on the shooting preview picture displayed in the screen to determine a target area in the shooting preview picture, where the target area is a part of the display area in the shooting preview picture.
Optionally, in this embodiment of the application, the user may trigger the electronic device to determine the target area in the shooting preview picture in a frame selection manner, or the user performs a sliding input in the screen to circle out the target area.
Optionally, in this embodiment of the application, each region in the captured preview image has a corresponding relationship with a pixel point in the sensor, that is, each region in the captured preview image is a display image obtained by the corresponding pixel point in the sensor.
Optionally, in this embodiment of the application, the electronic device may determine, according to the position of the target area in the shooting preview picture, all pixel points in the sensor, where the pixel point corresponding to the target area is the target pixel point.
It should be noted that, the specific execution sequence of the above steps 301 and 302 may be located after the above step 202 and before the step 203, or the specific execution sequence of the above steps 301 and 302 may be located before the "receiving the first input" in the above step 201. The specific execution sequence of step 301 is not limited in this application.
It can be understood that the user may perform a second input to determine a target area in the shooting preview screen in a case where the electronic device shoots with the camera and displays the shooting preview screen; or, after the electronic device adjusts the respective sampling rates corresponding to the target pixel points of the sensor of the camera according to the first input, the user may perform a second input to determine the target area in the shooting preview picture.
And 203a, the electronic equipment processes image data corresponding to the target area in the original image data according to the adjusted sampling rate to obtain target image data.
Optionally, in this embodiment of the application, the electronic device may process, according to the adjusted sampling rate, only the original image data corresponding to the target area in the captured preview image without processing all the original data, so that a partial area (that is, an image area corresponding to the target area) in the image corresponding to the obtained target image data may have a target filter effect.
In the embodiment of the application, before the electronic device processes original image data collected by the sensor according to the adjusted sampling rate to obtain target image data, a user can input a shooting preview picture, so that pixel points corresponding to a target area in the sensor are determined as target pixel points, and the target area in the shooting preview picture is determined, so that the electronic device can process the original image data corresponding to the target area only according to the adjusted sampling rate, and part of areas in an image corresponding to the obtained target image data have a target filter effect, thereby improving the flexibility of adding the filter effect to the image when the electronic device shoots.
Optionally, in this embodiment of the present application, before the step 203a, the filter adding method provided in this embodiment of the present application may further include the following step 303.
Step 303, the electronic equipment marks a display target area in the shooting preview picture.
Optionally, in this embodiment of the application, the electronic device may mark the display target area in the shooting preview screen in a mark display form, for example, the electronic device may highlight the display target area in the shooting preview screen in a frame selection form.
The target area is used to prompt the user, and the image area corresponding to the target area in the captured image has the target filter effect.
For example, as shown in fig. 4, when the mobile phone displays the shooting preview screen 10, the user may perform a second input to trigger the mobile phone to display a frame selection mark in the shooting preview screen 10, so as to determine the target area 12 in the shooting preview screen 10 through the frame selection mark, thereby prompting the user that the image area corresponding to the target area 12 in the captured image has the target filter effect.
When step 302 is executed, the specific step of step 203a may be "the electronic device processes the original image data corresponding to the target area according to the adjusted sampling rate to obtain the target image data".
In the embodiment of the application, the electronic device can mark and display the target area in the shooting preview picture according to the input of the user so as to prompt the user that the image area corresponding to the target area has the target filter effect in the shot image, so that the accuracy of adding the filter effect to the partial image area by the electronic device during shooting can be improved.
Optionally, in this embodiment of the present application, with reference to fig. 3, as shown in fig. 6, before step 203, the filter adding method provided in this embodiment of the present application may further include step 304 described below.
And step 304, the electronic equipment identifies a target object in a shooting preview picture of the camera, determines a region corresponding to the target object as a target region, and determines pixel points corresponding to the target region in the sensor as target pixel points.
Alternatively, in the embodiment of the present application, a user may set a plurality of types of objects in advance, so that when the electronic device displays a shooting preview screen of a camera, the objects included in the shooting preview screen may be automatically recognized and compared with the plurality of types of objects set in advance, so that in a case where the objects included in the shooting preview screen match any of the plurality of types of objects set in advance, the electronic device may determine the objects included in the shooting preview screen as target objects.
Further, the electronic device may determine a rectangular region including the target object as a target region; alternatively, the electronic device may determine a region corresponding to the contour of the target object as the target region.
In the embodiment of the application, the electronic equipment can identify the target object in the shooting preview picture of the camera, so that the area corresponding to the target object can be determined as the target area, and the pixel point corresponding to the target area in the sensor is determined as the target pixel point. Therefore, the electronic equipment can process the original image data corresponding to the target area only according to the adjusted sampling rate, so that part of the area in the image corresponding to the obtained target image data has the target filter effect, and the flexibility of adding the filter effect to the image when the electronic equipment shoots can be improved.
Optionally, in this embodiment of the application, the original image data includes a color value acquired by each pixel point of the camera. Referring to fig. 3, as shown in fig. 7, the step 203 can be specifically realized by the step 203b described below.
And 203b, the electronic device adjusts the color value corresponding to the first pixel point based on the adjusted sampling rate corresponding to the first pixel point.
The first pixel point is any one pixel point of the sensor; the target image data includes: and adjusting the color value corresponding to the target pixel point.
Optionally, in this embodiment of the application, for any one of the plurality of pixel points of the sensor, the electronic device may adjust the color value of the pixel point according to the adjusted sampling rate corresponding to the pixel point.
For example, the electronic device may calculate the remaining color missing from each pixel point through an interpolation algorithm during the demosaicing process, so as to calculate the color value of the current pixel point by referring to the color value of the adjacent pixel point with the specific color. For example, referring to fig. 2, when the sampling rate corresponding to the black-and-white filter effect is determined to be m, the G component of the pixel point R1 may be calculated as: gR1＝m*(G10+G11). Therefore, the color value of the pixel point under the effect of the black and white filter can be obtained, and the same is true for each pixel point.
In the embodiment of the application, the electronic device may adjust the color value corresponding to the target pixel point based on the adjusted sampling rate corresponding to the target pixel point of the sensor, so that the adjusted color value corresponding to the target pixel point may be included in the obtained target image data, and an image with a target filter effect may be obtained according to the target image data.
Optionally, in this embodiment of the application, with reference to fig. 3, as shown in fig. 8, the step 201 may be specifically implemented by a step 201a described below.
In step 201a, in the case of displaying a shooting preview screen of a camera, the electronic device receives a first input to a target control displayed in the shooting preview screen.
And the target filter effect is the filter effect corresponding to the target control.
Optionally, in this embodiment of the application, when the electronic device displays a shooting preview screen of the camera, a plurality of filter controls may be displayed, so that a user may perform a first input on a target control of the plurality of filter controls, and the electronic device may determine a sampling rate corresponding to a target filter effect according to the target control.
It should be noted that the electronic device may determine and record the sampling rate corresponding to each filter control of the multiple filter controls displayed in the shooting preview picture in advance, so that when a user inputs a certain filter control, the sampling rate of the filter effect corresponding to the certain filter control may be directly determined.
In the embodiment of the application, the user can select the filter effect required to be added to the image to be shot when the electronic equipment displays the shooting preview picture of the camera, so that the electronic equipment can adjust the sampling rate corresponding to the target pixel point of the sensor of the camera according to the filter effect selected by the user, and the efficiency of adding the filter effect to the image when the electronic equipment shoots can be improved.
It should be noted that, in the filter adding method provided in the embodiment of the present application, the execution main body may be a filter adding device, or a control module in the filter adding device for executing the filter adding method. The filter adding device provided by the embodiment of the present application is described by taking an example of a method for executing loading filter adding by a filter adding device.
Fig. 9 shows a schematic diagram of a possible structure of the filter adding device involved in the embodiment of the present application. As shown in fig. 9, the filter adding device 70 may include: a receiving module 71, a conditioning module 72 and a processing module 73.
The receiving module 71 is configured to receive a first input when a camera is used for shooting. And the adjusting module 72 is configured to adjust, in response to the first input received by the receiving module 71, sampling rates corresponding to target pixel points of the sensor of the camera based on a target filter effect corresponding to the first input. And the processing module 73 is configured to process the original image data acquired by the sensor according to the adjusted sampling rate to obtain target image data, where an image corresponding to the target image data has a target filter effect.
In a possible implementation manner, the receiving module 71 is further configured to receive a second input to the target area in the shooting preview picture of the camera before the processing module 73 processes the original image data collected by the sensor according to the adjusted sampling rate to obtain the target image data. Referring to fig. 9, as shown in fig. 10, the filter adding apparatus 70 according to the embodiment of the present application may further include: a determination module 74. Wherein, the determining module 74 is configured to determine, in response to the second input received by the receiving module 71, a pixel point of the target area corresponding to the sensor as a target pixel point.
In a possible implementation manner, with reference to fig. 9 and as shown in fig. 11, the filter adding apparatus 70 provided in the embodiment of the present application may further include: an identification module 75 and a determination module 74. The identifying module 75 is configured to identify the target object in the shooting preview picture of the camera before the processing module 73 processes the original image data corresponding to the target area according to the adjusted sampling rate to obtain the target image data. And the determining module 74 is configured to determine a region corresponding to the target object as a target region, and determine pixel points corresponding to the target region in the sensor as target pixel points.
In one possible implementation, the raw image data includes color values collected by target pixel points of the camera. The processing module 73 is specifically configured to adjust a color value corresponding to the first pixel point based on the adjusted sampling rate corresponding to the first pixel point, where the first pixel point is any one pixel point of the sensor. Wherein the target image data includes: and adjusting the color value corresponding to the target pixel point.
In a possible implementation manner, the receiving module 71 is specifically configured to receive a first input to a target control displayed in a shooting preview screen when the shooting preview screen of the camera is displayed. And the target filter effect is the filter effect corresponding to the target control.
The filter adding device provided by the embodiment of the application can realize each process realized by the filter adding device in the method embodiment, and the detailed description is not repeated here for avoiding repetition.
The embodiment of the application provides a filter adding device, because when electronic equipment adopts the camera to shoot, the user can carry out first input, with the target filter effect that the image that waits to shoot needs to add is confirmed through first input, thereby electronic equipment can be according to the target filter effect that first input corresponds, adjust the respective sampling rate that corresponds of the target pixel of the sensor of camera, and electronic equipment can be according to the sampling rate after the regulation, when handling the original image data of sensor collection, directly obtain target image data, and the image that this target image data corresponds is the image that possesses the target filter effect. The image with the target filter effect can be obtained without processing the original image data acquired by the sensor through the default sampling rate to obtain the RGB data by the electronic equipment and then performing later-stage adjustment on each pixel point of the image corresponding to the RGB data through a software algorithm, so that the process of processing the image data by the electronic equipment can be reduced, and the efficiency of adding the filter effect to the image when the electronic equipment shoots can be improved.
The filter adding device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The filter adding device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
Optionally, an electronic device is further provided in this embodiment of the present application, and includes a processor 110, a memory 109, and a program or an instruction stored in the memory 109 and executable on the processor 110, where the program or the instruction is executed by the processor 110 to implement each process of the filter addition method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 12 is a schematic hardware structure diagram of an electronic device implementing an embodiment of the present application.
The electronic device 100 includes, but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.
Those skilled in the art will appreciate that the electronic device 100 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 12 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.
Wherein, the user input unit 107 is used for receiving a first input in the case of shooting by using a camera.
The processor 110 is configured to respond to the first input, and adjust respective sampling rates of target pixel points of a sensor of the camera based on a target filter effect corresponding to the first input; and processing the original image data acquired by the sensor according to the adjusted sampling rate to obtain target image data, wherein the image corresponding to the target image data has a target filter effect.
The embodiment of the application provides an electronic device, because when electronic device adopts the camera to shoot, the user can carry out first input, with the target filter effect that the image that waits to shoot needs to add is confirmed through first input, thereby electronic device can be according to the target filter effect that first input corresponds, adjust the respective sampling rate that corresponds of the target pixel of the sensor of camera, and electronic device can be according to the sampling rate after adjusting, when handling the original image data that the sensor gathered, directly obtain target image data, and the image that this target image data corresponds is the image that possesses the target filter effect. The image with the target filter effect can be obtained without processing the original image data acquired by the sensor through the default sampling rate to obtain the RGB data by the electronic equipment and then performing later-stage adjustment on each pixel point of the image corresponding to the RGB data through a software algorithm, so that the process of processing the image data by the electronic equipment can be reduced, and the efficiency of adding the filter effect to the image when the electronic equipment shoots can be improved.
Optionally, the user input unit 107 is further configured to receive a second input to the target area in the shooting preview screen of the camera before the processor 110 processes the original image data collected by the sensor according to the adjusted sampling rate to obtain the target image data.
The processor 110 is specifically configured to determine, in response to the second input, a pixel point corresponding to the target area in the sensor as a target pixel point.
In the embodiment of the application, before the electronic device processes original image data collected by the sensor according to the adjusted sampling rate to obtain target image data, a user can input a shooting preview picture, so that pixel points corresponding to a target area in the sensor are determined as target pixel points, and the target area in the shooting preview picture is determined, so that the electronic device can process the original image data corresponding to the target area only according to the adjusted sampling rate, and part of areas in an image corresponding to the obtained target image data have a target filter effect, thereby improving the flexibility of adding the filter effect to the image when the electronic device shoots.
The processor 110 is further configured to identify a target object in a shooting preview picture of the camera before processing the original image data collected by the sensor according to the adjusted sampling rate to obtain target image data, determine an area corresponding to the target object as a target area, and determine pixel points corresponding to the target area in the sensor as target pixel points.
In the embodiment of the application, the electronic equipment can identify the target object in the shooting preview picture of the camera, so that the area corresponding to the target object can be determined as the target area, and the pixel point corresponding to the target area in the sensor is determined as the target pixel point. Therefore, the electronic equipment can process the original image data corresponding to the target area only according to the adjusted sampling rate, so that part of the area in the image corresponding to the obtained target image data has the target filter effect, and the flexibility of adding the filter effect to the image when the electronic equipment shoots can be improved.
The processor 110 is specifically configured to adjust a color value corresponding to a first pixel point based on the adjusted sampling rate corresponding to the first pixel point, where the first pixel point is any one pixel point of the sensor; wherein the target image data includes: and adjusting the color value corresponding to the target pixel point.
In the embodiment of the application, the electronic device may adjust the color value corresponding to the target pixel point based on the adjusted sampling rate corresponding to the target pixel point of the sensor, so that the adjusted color value corresponding to the target pixel point may be included in the obtained target image data, and an image with a target filter effect may be obtained according to the target image data.
A user input unit 107, specifically configured to receive a first input to a target control displayed in a shooting preview screen when the shooting preview screen of the camera is displayed; and the target filter effect is the filter effect corresponding to the target control.
In the embodiment of the application, the user can select the filter effect required to be added to the image to be shot when the electronic equipment displays the shooting preview picture of the camera, so that the electronic equipment can adjust the sampling rate corresponding to the target pixel point of the sensor of the camera according to the filter effect selected by the user, and the efficiency of adding the filter effect to the image when the electronic equipment shoots can be improved.
It should be understood that, in the embodiment of the present application, the input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics Processing Unit 1041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 109 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 110 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the filter adding method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the filter adding method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (12)
1. A filter addition method, comprising:
receiving a first input under the condition of shooting by adopting a camera;
responding to the first input, and adjusting respective corresponding sampling rates of target pixel points of a sensor of the camera based on a target filter effect corresponding to the first input;
and processing the original image data acquired by the sensor according to the adjusted sampling rate to obtain target image data, wherein the image corresponding to the target image data has the target filter effect.
2. The method of claim 1, wherein before processing the raw image data collected by the sensor according to the adjusted sampling rate to obtain target image data, the method further comprises:
receiving a second input of a target area in a shooting preview picture of the camera;
and responding to the second input, and determining pixel points of the target area corresponding to the sensor as the target pixel points.
3. The method of claim 1, wherein before processing the raw image data collected by the sensor according to the adjusted sampling rate to obtain target image data, the method further comprises:
identifying a target object in a shooting preview picture of the camera, determining a region corresponding to the target object as a target region, and determining a pixel point of the target region corresponding to the sensor as a target pixel point.
4. The method of any of claims 1 to 3, wherein the raw image data comprises color values collected by target pixel points of the camera;
the processing the original image data collected by the sensor according to the adjusted sampling rate to obtain target image data comprises the following steps:
adjusting a color value corresponding to a first pixel point based on the adjusted sampling rate corresponding to the first pixel point, wherein the first pixel point is any one pixel point of the sensor;
wherein the target image data includes: and the adjusted color value corresponding to the target pixel point.
5. The method according to any one of claims 1 to 3, wherein the receiving a first input in case of taking a picture with a camera comprises:
under the condition that a shooting preview picture of the camera is displayed, receiving a first input of a target control displayed in the shooting preview picture;
and the target filter effect is the filter effect corresponding to the target control.
6. A filter adding device, characterized by comprising: the device comprises a receiving module, an adjusting module and a processing module;
the receiving module is used for receiving a first input under the condition of shooting by adopting a camera;
the adjusting module is used for responding to the first input received by the receiving module and adjusting the sampling rate corresponding to each target pixel point of a sensor of the camera based on the target filter effect corresponding to the first input;
and the processing module is used for processing the original image data acquired by the sensor according to the adjusted sampling rate to obtain target image data, and the image corresponding to the target image data has the target filter effect.
7. The filter adding device according to claim 6, wherein the receiving module is further configured to receive a second input to a target area in a shooting preview screen of the camera before the processing module processes raw image data collected by the sensor according to the adjusted sampling rate to obtain target image data;
the filter adding device further comprises: a determination module;
the determining module is configured to determine, in response to the second input received by the receiving module, a pixel point of the target area corresponding to the sensor as the target pixel point.
8. The filter adding apparatus according to claim 6, further comprising: the device comprises an identification module and a determination module;
the identification module is used for identifying a target object in a shooting preview picture of the camera before the processing module processes the original image data collected by the sensor according to the adjusted sampling rate to obtain target image data;
the determining module is configured to determine a region corresponding to the target object as a target region, and determine a pixel point corresponding to the target region in the sensor as the target pixel point.
9. The filter adding apparatus according to any one of claims 6 to 8, wherein the raw image data includes color values acquired by target pixel points of the camera;
the processing module is specifically configured to adjust a color value corresponding to a first pixel point based on an adjusted sampling rate corresponding to the first pixel point, where the first pixel point is any one pixel point of the sensor;
wherein the target image data includes: and the adjusted color value corresponding to the target pixel point.
10. The filter adding device according to any one of claims 6 to 8, wherein the receiving module is specifically configured to receive a first input to a target control displayed in a shooting preview screen of the camera in a case where the shooting preview screen is displayed;
and the target filter effect is the filter effect corresponding to the target control.
11. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the filter addition method of any of claims 1-5.
12. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the filter addition method according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110157569.9A CN113014803A (en) | 2021-02-04 | 2021-02-04 | Filter adding method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110157569.9A CN113014803A (en) | 2021-02-04 | 2021-02-04 | Filter adding method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113014803A true CN113014803A (en) | 2021-06-22 |
Family
ID=76385094
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110157569.9A Pending CN113014803A (en) | 2021-02-04 | 2021-02-04 | Filter adding method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113014803A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113810642A (en) * | 2021-08-12 | 2021-12-17 | 荣耀终端有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN113810641A (en) * | 2021-08-12 | 2021-12-17 | 荣耀终端有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN114339077A (en) * | 2022-01-28 | 2022-04-12 | 维沃移动通信有限公司 | Imaging method, imaging device, electronic apparatus, and storage medium |
| CN115589539A (en) * | 2022-11-29 | 2023-01-10 | 荣耀终端有限公司 | Image adjusting method, device and storage medium |
| WO2023016365A1 (en) * | 2021-08-09 | 2023-02-16 | 维沃移动通信有限公司 | Image processing method and apparatus, and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080088858A1 (en) * | 2006-10-13 | 2008-04-17 | Apple Inc. | System and Method for Processing Images Using Predetermined Tone Reproduction Curves |
| US7474337B1 (en) * | 2000-10-24 | 2009-01-06 | Sony Corporation | Method and apparatus to provide edge enhancements as part of a demosaicing process |
| CN105376640A (en) * | 2014-08-06 | 2016-03-02 | 腾讯科技（北京）有限公司 | Filter processing method, filter processing device and electronic equipment |
| CN106254764A (en) * | 2015-06-12 | 2016-12-21 | 三星电子株式会社 | Electronic installation and the method being used for showing image in an electronic |
| CN107835402A (en) * | 2017-11-08 | 2018-03-23 | 维沃移动通信有限公司 | A kind of image processing method, device and mobile terminal |
| CN109361867A (en) * | 2018-11-23 | 2019-02-19 | 维沃移动通信有限公司 | A kind of filter processing method and mobile terminal |
| CN109523465A (en) * | 2018-11-21 | 2019-03-26 | 维沃移动通信有限公司 | A kind of filter processing method and terminal |
-
2021
- 2021-02-04 CN CN202110157569.9A patent/CN113014803A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7474337B1 (en) * | 2000-10-24 | 2009-01-06 | Sony Corporation | Method and apparatus to provide edge enhancements as part of a demosaicing process |
| US20080088858A1 (en) * | 2006-10-13 | 2008-04-17 | Apple Inc. | System and Method for Processing Images Using Predetermined Tone Reproduction Curves |
| CN105376640A (en) * | 2014-08-06 | 2016-03-02 | 腾讯科技（北京）有限公司 | Filter processing method, filter processing device and electronic equipment |
| CN106254764A (en) * | 2015-06-12 | 2016-12-21 | 三星电子株式会社 | Electronic installation and the method being used for showing image in an electronic |
| CN107835402A (en) * | 2017-11-08 | 2018-03-23 | 维沃移动通信有限公司 | A kind of image processing method, device and mobile terminal |
| CN109523465A (en) * | 2018-11-21 | 2019-03-26 | 维沃移动通信有限公司 | A kind of filter processing method and terminal |
| CN109361867A (en) * | 2018-11-23 | 2019-02-19 | 维沃移动通信有限公司 | A kind of filter processing method and mobile terminal |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023016365A1 (en) * | 2021-08-09 | 2023-02-16 | 维沃移动通信有限公司 | Image processing method and apparatus, and electronic device |
| CN113810642A (en) * | 2021-08-12 | 2021-12-17 | 荣耀终端有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN113810641A (en) * | 2021-08-12 | 2021-12-17 | 荣耀终端有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN113810642B (en) * | 2021-08-12 | 2023-02-28 | 荣耀终端有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN113810641B (en) * | 2021-08-12 | 2023-02-28 | 荣耀终端有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN114339077A (en) * | 2022-01-28 | 2022-04-12 | 维沃移动通信有限公司 | Imaging method, imaging device, electronic apparatus, and storage medium |
| CN115589539A (en) * | 2022-11-29 | 2023-01-10 | 荣耀终端有限公司 | Image adjusting method, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113014803A (en) | Filter adding method and device and electronic equipment | |
| CN107395898B (en) | Shooting method and mobile terminal | |
| CN112135046B (en) | Video shooting method, video shooting device and electronic equipment | |
| CN112492227B (en) | Exposure method, camera module and electronic equipment | |
| CN110784660B (en) | Method, system, equipment and medium for controlling camera brightness | |
| CN110958401B (en) | Super night scene image color correction method and device and electronic equipment | |
| US10516860B2 (en) | Image processing method, storage medium, and terminal | |
| CN113329172B (en) | Shooting method and device and electronic equipment | |
| WO2023056950A1 (en) | Image processing method and electronic device | |
| CN112422798A (en) | Photographing method and device, electronic equipment and storage medium | |
| CN105791790A (en) | Image processing method and apparatus | |
| CN112037160A (en) | Image processing method, device and equipment | |
| CN110944163A (en) | Image processing method and electronic equipment | |
| CN112437237B (en) | Shooting method and device | |
| CN112508820A (en) | Image processing method and device and electronic equipment | |
| EP4175275A1 (en) | White balance processing method and electronic device | |
| US11348365B2 (en) | Skin color identification method, skin color identification apparatus and storage medium | |
| CN110089103B (en) | Demosaicing method and device | |
| CN114298889A (en) | Image processing circuit and image processing method | |
| CN114125319A (en) | Image sensor, camera module, image processing method and device and electronic equipment | |
| CN112532904A (en) | Video processing method and device and electronic equipment | |
| CN111614901A (en) | Image shooting method and device, storage medium and terminal | |
| US7965889B2 (en) | Imaging apparatus, imaging method, program and recording medium | |
| EP4106321A1 (en) | Image processing method and apparatus, model training method and apparatus, and storage medium | |
| CN114143447B (en) | Image processing method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210622 |
|
| RJ01 | Rejection of invention patent application after publication |