CN112954222B - Continuous shooting method and electronic equipment - Google Patents

Continuous shooting method and electronic equipment Download PDF

Info

Publication number
CN112954222B
CN112954222B CN202110303864.0A CN202110303864A CN112954222B CN 112954222 B CN112954222 B CN 112954222B CN 202110303864 A CN202110303864 A CN 202110303864A CN 112954222 B CN112954222 B CN 112954222B
Authority
CN
China
Prior art keywords
request
photographing
processing module
preview
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110303864.0A
Other languages
Chinese (zh)
Other versions
CN112954222A (en
Inventor
肖旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202110303864.0A priority Critical patent/CN112954222B/en
Publication of CN112954222A publication Critical patent/CN112954222A/en
Application granted granted Critical
Publication of CN112954222B publication Critical patent/CN112954222B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The embodiment of the invention provides a continuous shooting method and electronic equipment, belonging to the technical field of shooting, wherein the method comprises the following steps: receiving a second request, the second request comprising a preview request; processing the preview request; processing the photographing request in a case where the second request includes a photographing request; wherein, when the third photographing request is processed, the second request comprises the photographing request; the third photographing request is a photographing request with the receiving time earlier than that of the second request. The embodiment of the invention can ensure that the image preview is normal and has no jam when the hardware performance of the electronic equipment is insufficient.

Description

Continuous shooting method and electronic equipment
The invention relates to a divisional application of an invention application with the application date of 2019, 11/07/11 and the application number of 201911082436.9, namely a continuous shooting method and electronic equipment.
Technical Field
The embodiment of the invention relates to the technical field of photographing, in particular to a continuous shooting method and electronic equipment.
Background
The continuous shooting function of the camera application (i.e. the image capturing application) needs to take a large number of photos quickly, and the main flow is as follows: step 1: the user presses the shooting button for a long time to trigger the continuous shooting function; step 2: the camera application program continuously issues a photographing + previewing request to the system; and step 3: the system receives a request of photographing and previewing issued by a camera application program; and 4, step 4: the system processes the photographing request: the system receives an original Image (namely, a RAW Image) output by a Sensor (Sensor), obtains YUV (Y represents brightness, namely, a gray-scale value, and U and V represent chroma) format Image data after Image Signal Processing (ISP), and finally converts the YUV format Image data into JPEG (Joint Photographic Experts Group) format Image data; and 5: the system processes the preview request: the system receives an original image output by the sensor, and image data in a YUV format is obtained after image signal processing. Wherein, the steps 4 and 5 are generally executed in parallel, that is, the system processes the photographing request and the preview request simultaneously.
Different electronic devices have hardware differences and, correspondingly, performance differences. For some electronic devices with poor hardware performance, the continuous shooting function may cause the preview frame rate to decrease, i.e. cause the preview to have a pause phenomenon. The reason is that due to hardware performance limitations, it is not possible to handle a large number of shots at the same time and maintain a normal preview. For example, the system needs to occupy ISP hardware when processing a photographing request, and needs to use this hardware for processing a preview request, and for an electronic device with relatively poor ISP hardware performance, if a large number of photographing requests need to be processed in a short time, the preview request cannot be processed, and a pause phenomenon occurs in the preview during a continuous photographing process.
Disclosure of Invention
The embodiment of the invention provides a continuous shooting method and electronic equipment, and aims to solve the problem that the preview possibly has a pause phenomenon when the conventional electronic equipment continuously shoots by using a continuous shooting function.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a continuous shooting method applied to an electronic device, including:
acquiring a first request, wherein the first request comprises a first preview request and a first photographing request;
processing the first preview request;
processing the first photographing request under the condition that the time interval between the first photographing request and the second photographing request is greater than a first duration;
under the condition that the time interval between the first photographing request and the second photographing request is less than the first duration, discarding the first photographing request;
the first duration is the minimum time interval between the photo requests which can be processed under the condition that each preview request can be processed, and the second photo request is a processed photo request which is earlier in processing time than the first photo request and has the shortest time interval with the processing time of the first photo request.
In a second aspect, an embodiment of the present invention further provides a continuous shooting method applied to an electronic device, including:
receiving a second request, the second request comprising a preview request;
processing the preview request;
processing the photographing request if the second request comprises a photographing request;
wherein, under the condition that the third photographing request is processed, the second request comprises the photographing request; the third photographing request is a photographing request with the receiving time earlier than that of the second request.
In a third aspect, an embodiment of the present invention further provides an electronic device, including:
the system comprises a first image processing module, a second image processing module and a third image processing module, wherein the first image processing module is used for acquiring a first request, and the first request comprises a first preview request and a first photographing request; processing the first preview request; processing the first photographing request under the condition that the time interval between the first photographing request and the second photographing request is greater than a first duration; when the time interval between the first photographing request and the second photographing request is less than the first duration, discarding the first photographing request;
the first duration is the minimum time interval between the photo requests which can be processed under the condition that each preview request can be processed, and the second photo request is a processed photo request which is earlier in processing time than the first photo request and has the shortest time interval with the processing time of the first photo request.
In a fourth aspect, an embodiment of the present invention further provides an electronic device, including:
a second image processing module for receiving a second request, the second request comprising a preview request; processing the preview request; processing the photographing request in a case where the second request includes a photographing request;
wherein, when the third photographing request is processed, the second request comprises the photographing request; the third photographing request is a photographing request with the receiving time earlier than that of the second request.
In a fifth aspect, an embodiment of the present invention further provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and executable on the processor, and when the computer program is executed by the processor, the steps of any one of the continuous shooting methods are implemented.
In a sixth aspect, the embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the steps of any one of the continuous shooting methods described above.
In the embodiment of the invention, the image processing module (the first image processing module) of the bottom layer system dynamically controls the continuous shooting speed according to the hardware performance of the electronic equipment to ensure that the preview is normal and not blocked, the continuous shooting speed cannot be influenced for the electronic equipment with good performance, and the preview can be ensured for the electronic equipment with poor performance by reducing the continuous shooting speed. In addition, for the upper image capturing application program (the first image capturing application program), the hardware implementation of the bottom layer does not need to be considered in the continuous shooting process, and only the preview request and the shooting request need to be continuously issued to the image processing module (the first image processing module) of the system, then the image processing module (the first image processing module) of the system calculates the minimum time interval of the shooting request which can be processed while the processing of the preview request is ensured according to the hardware performance, and finally in the process of processing the shooting request, the image processing module (the first image processing module) of the system dynamically skips the shooting request of which the time interval with the last shooting request which is determined to be processed is smaller than the minimum time interval. That is, if the hardware performance is not sufficient to process the current photo request while maintaining the preview normal, the current photo request is skipped.
In the embodiment of the invention, in the continuous shooting process, the image acquisition application program (second image acquisition application program) defaults to carry the preview request in the second request, and determines whether to carry the shooting request in the second request according to whether the image processing module (second image processing module) of the bottom layer system finishes processing the last shooting request, so that the influence of excessive shooting requests on the response of the preview request when the hardware performance of the electronic equipment is insufficient is avoided, and the preview is ensured to be normal without pause.
Drawings
FIG. 1 is a flowchart illustrating a continuous shooting method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a request issuing and processing sequence in an embodiment of the present invention;
FIG. 3 is a second flowchart illustrating a continuous shooting method according to an embodiment of the present invention;
FIG. 4 is a third schematic flowchart illustrating a continuous shooting method according to an embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating another request issuing and processing timing sequence according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the invention;
fig. 7 is a second schematic structural diagram of an electronic apparatus according to an embodiment of the invention;
fig. 8 is a third schematic structural diagram of an electronic apparatus according to an embodiment of the invention;
FIG. 9 is a fourth schematic structural diagram of an electronic apparatus according to an embodiment of the present invention;
fig. 10 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a schematic flow chart of a continuous shooting method according to an embodiment of the present invention, where the method is applied to an electronic device, and includes:
step 101: acquiring a first request, wherein the first request comprises a first preview request and a first photographing request;
specifically, the first image processing module of the underlying system may obtain the preview request + the photographing request from the first image capturing application (i.e., the camera application) on the upper layer.
Step 102: processing the first preview request;
that is, the image data in YUV format is captured by the first image processing module of the underlying system and then returned to the first image capturing application (i.e., the camera application).
Step 103: processing the first photographing request under the condition that the time interval between the first photographing request and the second photographing request is greater than a first duration;
step 104: when the time interval between the first photographing request and the second photographing request is less than the first duration, discarding the first photographing request;
the first duration is the minimum time interval between the photo requests which can be processed under the condition that each preview request can be processed, and the second photo request is a processed photo request which is earlier in processing time than the first photo request and has the shortest time interval with the processing time of the first photo request.
That is, in the embodiment of the present invention, it is determined to process or not process the first photographing request in the first request, according to the minimum time interval T. Specifically, the minimum time interval T is a minimum time interval between photographing requests that can be processed by the electronic device under the condition that it is ensured that each preview request can be processed normally. That is, if processing of one photographing request is currently started, it takes at least the interval T for the start of processing of another photographing request, otherwise the processing of the preview request is affected. Therefore, if the time interval between the current photographing request and the last photographing request which is determined to be processed is less than T, the photographing request is not processed, so that the preview is ensured not to be jammed normally.
In the embodiment of the invention, the minimum time interval is calculated according to the actual hardware performance of the electronic equipment. For example, suppose the electronic device has only one ISP hardware, and the time for processing one frame of preview image is 20ms (milliseconds), and the time for processing one frame of photographed image is 30ms. For the preview screen to appear continuous, the frame rate of the preview is typically 30 frames per second, so the time interval between two adjacent frames of preview images is 33.3ms, here for convenience of illustration, it can be considered that the time interval between two adjacent frames of preview images is 30ms, that is, the time interval between two adjacent preview requests can be 30ms. Therefore, every time a frame of preview image is processed, that is, every time a preview request is processed, the ISP hardware still has 10ms of idle time, so that every time 3 preview requests are processed, one photographing request can be processed at the same time, that is, if it is ensured that all preview requests can be processed normally so that the preview is not stuck normally, at least 90ms is provided between the photographing requests that the ISP hardware can process, and the 90ms is the minimum time interval. Therefore, if the time interval between the first photographing request and the second photographing request is less than the minimum time interval, determining not to process the first photographing request; if the time interval between the first photographing request and the second photographing request is greater than or equal to the minimum time interval, determining to process the first photographing request; wherein, the second photographing request is the photographing request of the last determined processing.
The execution sequence between step 102 and step 103 or step 104 is not limited, and step 102 may be executed simultaneously with step 103 or step 104.
In the embodiment of the present invention, the preview request refers to a request for an image processing module (in the embodiment of the present invention, the first image processing module) of the system to output YUV format image data for a user to preview, and a picture viewed by the user when the user opens the camera is a preview picture. The photographing request is to request an image processing module (in the embodiment of the present invention, the first image processing module) of the system to output JPEG format image data to be saved in the album.
The first request is issued to a first image processing module of the underlying system by a first image acquisition application program.
In the embodiment of the invention, the image processing module (the first image processing module) of the bottom layer system dynamically controls the continuous shooting speed according to the hardware performance of the electronic equipment to ensure that the preview is normal and not blocked, the continuous shooting speed cannot be influenced for the electronic equipment with good performance, and the preview can be ensured for the electronic equipment with poor performance by reducing the continuous shooting speed.
In addition, for the upper image capturing application program (first image capturing application program), the hardware implementation of the bottom layer does not need to be considered in the continuous shooting process, and only the preview request and the photographing request need to be continuously issued to the image processing module (first image processing module) of the system, then the image processing module (first image processing module) of the system calculates the minimum time interval of the photographing request which can be processed while the processing of the preview request is guaranteed according to the hardware performance, and finally in the process of processing the photographing request, the image processing module (first image processing module) of the system dynamically skips the photographing request of which the time interval with the last photographing request which is determined to be processed is smaller than the minimum time interval. That is, if the hardware performance is not sufficient to process the current request for taking a picture while maintaining the preview normal, the current request for taking a picture is skipped.
The continuous shooting method will be described below by way of example.
For example, if the time interval between the first image capturing application issuing the request including the photographing request and the preview request is 30ms, the minimum time interval T is equal to 90ms. Request issuing and processing sequence diagram referring to fig. 2, of the nine requests, only the photographing request among the requests numbered 1, 4, and 7 is processed, and the photographing request among the other requests is not processed.
Optionally, the electronic device includes a first image capturing application program and a first image processing module; the step of acquiring the first request, the step of processing the first preview request, the step of processing the first photographing request and the step of discarding the first photographing request are all executed by the first image processing module;
in a case that a time interval between the first photographing request and the second photographing request is less than the first duration, discarding the first photographing request includes:
the first image processing module controls to discard the first photographing request;
the first image processing module sends a first notification message to the first image acquisition application program, wherein the first notification message is used for indicating that the first photographing request is discarded.
For example, an ERROR is set to be returned to the first image capturing application to notify the first image capturing application that the photographing request is not processed.
In the embodiment of the present invention, after determining that the hardware performance of the electronic device cannot process all the photographing requests while ensuring that each preview request can be processed normally, the image processing module (the first image processing module) of the bottom system discards part of the photographing requests, and after discarding the part of the photographing requests, notifies the upper image acquisition application program (the first image acquisition application program) of which photographing requests are discarded, so that the upper image acquisition application program (the first image acquisition application program) can know which photographing requests do not obtain corresponding photos.
Optionally, the first request is a request acquired in a continuous shooting state.
In the embodiment of the invention, only when the continuous shooting state is detected, the first shooting request is determined to be processed or not processed according to the minimum time interval. This is because, if the continuous shooting state is not established, the time interval between adjacent shooting requests is long, and the preview is not generally affected by the processing of the shooting request, and therefore, if the continuous shooting state is not established currently, the shooting request is processed by default. Thus, the computational burden on the system can be reduced. In addition, if the user manually inputs a plurality of photographing requests in succession instead of the continuous shooting state, it may be considered that the user wishes to preferentially secure the processing of the photographing request rather than the processing of the preview request.
For example, if the mode of triggering the continuous shooting mode is to press (continuously press) the shooting button for a long time, it may be detected whether the shooting button is pressed for a long time, and if so, it indicates that the shooting button is currently in the continuous shooting state, otherwise, it indicates that the shooting button is not currently in the continuous shooting state.
In addition, the first image processing module of the underlying system may calculate the minimum time interval only when detecting that the image is currently in the continuous shooting state, otherwise, the minimum time interval may not be calculated, so as to reduce the calculation load of the system.
Optionally, the first request is generated according to a first input of a user, where the first input is used to trigger the electronic device to continuously capture at least two images.
For example, the first input may be an input of a long press of a photograph button. During the period that the user presses the photographing button for a long time, the first image acquisition application program continuously issues photographing requests, and meanwhile, in order to maintain that the previewing is not stopped, the previewing requests also need to be carried in the photographing requests, namely, the same request comprises the previewing request and the photographing request.
In the embodiment of the present invention, the preview request and the photo request may be issued simultaneously or separately, that is, the first image processing module of the system may receive the preview request and the photo request simultaneously or may receive the preview request and the photo request respectively.
Referring to fig. 3, fig. 3 is a schematic flow chart of a continuous shooting method according to a second embodiment of the present invention, applied to an electronic device, including:
step 201: receiving a second request, the second request comprising a preview request;
the second request is generated by a second image acquisition application program and is issued to a second image processing module, whether the second request comprises the photographing request is determined according to whether the second image processing module of the system finishes processing the photographing request issued last time, if the second image processing module of the system finishes processing the photographing request issued last time, the photographing request is carried in the second request, otherwise, the photographing request is not carried in the second request.
Step 202: processing the preview request;
that is, the second image processing module captures the image data in the YUV format and returns the image data to the second image capturing application (i.e., the camera application).
Step 203: processing the photographing request if the second request comprises a photographing request;
wherein, when the third photographing request is processed, the second request comprises the photographing request; the third photographing request is a photographing request with the receiving time earlier than that of the second request.
If the photographing request is not included in the second request, only the preview request in the second request needs to be processed.
The execution sequence between step 202 and step 203 is not limited, and step 202 and step 203 may be executed simultaneously.
In the embodiment of the present invention, the preview request refers to a request for an image processing module (in the embodiment of the present invention, the second image processing module) of the system to output YUV format image data for a user to preview, and a picture viewed by the user when the user opens the camera is a preview picture. The photographing request is to request an image processing module (in the embodiment of the present invention, the second image processing module) of the system to output JPEG format image data to be saved in the album.
In the embodiment of the invention, by increasing the coupling mode of the image acquisition application program (second image acquisition application program) and the image processing module (second image processing module) of the system, in the continuous shooting process, the image acquisition application program (second image acquisition application program) does not issue the request including the preview request and the shooting request by default, but determines whether to issue a new shooting request according to the fact that the image processing module (second image processing module) of the system has the shooting request issued last time or not. The image processing module (second image processing module) of the system does not need to calculate the minimum time interval between the photographing requests which can be processed by the ISP hardware when all the preview requests can be processed normally according to the hardware performance so that the preview can not be normally performed.
In the embodiment of the invention, in the continuous shooting process, the image acquisition application program (the second image acquisition application program) defaults to carry the preview request in the second request, and determines whether to carry the shooting request in the second request according to whether the image processing module (the second image processing module) of the system finishes processing the last shooting request, so that the influence of excessive shooting requests on the response of the preview request when the hardware performance of the electronic equipment is insufficient is avoided, and the preview is ensured to be normal without pause. In addition, compared with the first embodiment, the processing flow of the image processing module (the second image processing module) of the system may be simplified, that is, the image processing module (the second image processing module) of the system does not need to calculate the minimum time interval, and does not need to drop frames (that is, the photographing request is set as ERROR and returned to the second image capturing application program), and only needs to judge whether a photographing request is processed, and if not, the image capturing application program (the second image capturing application program) is notified to issue the photographing request.
The continuous shooting method described above is exemplified below.
Referring to fig. 4, a flow of one embodiment of the present invention includes:
step 301: if the current continuous shooting mode is detected, the second image acquisition application program (which may be referred to as application, the same below) determines whether the sent second request carries the shooting request according to the notification of the second image processing module (which may be referred to as system, the same below) of the underlying system. And if the second image processing module of the bottom layer system informs the second image acquisition application that the photographing request is not processed currently and a new photographing request can be issued, turning to the step 302, otherwise, turning to the step 303.
Step 302: the second image capture application issues a second request comprising a photograph request and a preview request.
Step 303: the second image capture application issues a second request that includes only the preview request.
Step 304: and a second image processing module of the bottom layer system acquires a second request issued by a second image acquisition application program.
Step 305: and a second image processing module of the bottom layer system processes a preview request of the second request, namely, the image data in the YUV format is grabbed and then returned to the second image acquisition application program.
Step 306: and the second image processing module of the bottom layer system processes the photographing request in the second request, and if the photographing request does not exist in the second request, the step is not executed.
Step 307: the second image processing module of the underlying system determines whether the photographing request is processed, and if so, goes to step 308.
Step 308: the second image processing module of the underlying system notifies the second image capturing application that no photographing request is currently being processed, and may issue a new photographing request, for example, may notify the second image capturing application by sending a callback.
For example, if the electronic device has only one ISP hardware, the time for processing one frame of preview image by the ISP hardware is 20ms (millisecond), and the time for processing one frame of photographed image by the ISP hardware is 30ms, the time interval for issuing the request by the second image capturing application program is 30ms. The issue sequence and the processing sequence of the requests are shown in fig. 5, and only the requests numbered 1, 4 and 7 carry the photographing request, and the other requests do not carry the photographing request.
Optionally, the first request is generated according to a first input of a user, where the first input is used to trigger the electronic device to continuously capture at least two images. For example, the first input may be an input of a long press of a photographing button.
In the embodiment of the invention, in order to maintain the preview continuously, the second image acquisition application program continuously issues the preview request during the period that the finger of the user presses the photographing button for a long time. However, in order to ensure that the preview is not normally jammed, the photographing request is not necessarily carried in each second request carrying the preview request, but is carried only after the previous photographing request has been processed.
Optionally, the electronic device includes a second image capturing application and a second image processing module; wherein the step of receiving a second request, the step of processing the preview request, and the step of processing the photograph request are all performed by the second image processing module;
before the receiving the second request, the method further includes:
and the second image acquisition application program generates a second request comprising a photographing request and sends the second request to the second image processing module under the condition that the second image processing module has processed the third photographing request.
In the embodiment of the present invention, the second request is generated by the second image acquisition application and is issued to the second image processing module of the underlying system, and in order to prevent the excessive photographing requests from affecting the processing of the preview request, the second image acquisition application issues a new photographing request only after the second image processing module has processed the previous photographing request.
Optionally, the method further includes: and sending second notification information to a second image acquisition application program every time a photographing request is processed, wherein the second notification information is used for indicating that no photographing request is currently processed.
That is, each time the second image processing module of the system processes one photographing request, the second image acquisition application program is notified that a new photographing request can be issued. Therefore, during continuous shooting, the second image acquisition application program can generate a second request comprising a shooting request according to the notification of the second image processing module and send the second request to the second image processing module of the system. If the notification of the second image processing module is not received, the photographing request is not issued, so that the preview is not influenced by photographing.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention, where the electronic device 600 includes:
the first image processing module 601 is configured to obtain a first request, where the first request includes a first preview request and a first photographing request; processing the first preview request; processing the first photographing request under the condition that the time interval between the first photographing request and the second photographing request is greater than a first duration; under the condition that the time interval between the first photographing request and the second photographing request is less than the first duration, discarding the first photographing request;
the first duration is the minimum time interval between the photo requests which can be processed under the condition that each preview request can be processed, and the second photo request is a processed photo request which is earlier in processing time than the first photo request and has the shortest time interval with the processing time of the first photo request.
In the electronic device provided by the embodiment of the present invention, the image processing module (the first image processing module) of the underlying system dynamically controls the continuous shooting speed according to the hardware performance of the electronic device to ensure that the preview is normal and not stuck, the continuous shooting speed is not affected for the electronic device with good performance, and the preview can be ensured for the electronic device with poor performance by reducing the continuous shooting speed.
Optionally, the electronic device further includes: a first image capture application;
the first image processing module 601 is configured to discard the first photographing request and send a first notification message to the first image capturing application program when a time interval between the first photographing request and the second photographing request is smaller than the first duration, where the first notification message is used to indicate that the first photographing request is discarded.
Optionally, the first request is a request acquired in a continuous shooting state.
The electronic device provided by the embodiment of the present invention can implement each process in the first method embodiment and achieve the same technical effect, and for avoiding repetition, details are not described here.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention, where the electronic device 700 includes:
a second image processing module 701, configured to receive a second request, where the second request includes a preview request; processing the preview request; processing the photographing request in a case where the second request includes a photographing request;
wherein, when the third photographing request is processed, the second request comprises the photographing request; the third photographing request is a photographing request with the receiving time earlier than that of the second request.
In the electronic device provided by the embodiment of the invention, in the continuous shooting process, the image acquisition application program (second image acquisition application program) defaults to carry the preview request in the second request, and determines whether to carry the photographing request in the second request according to whether the image processing module (second image processing module) of the bottom layer system finishes processing the last photographing request, so that the influence of too many photographing requests on the response of the preview request when the hardware performance of the electronic device is insufficient is avoided, and the preview is ensured to be normal without jamming.
Optionally, the electronic device further includes:
a second image capturing application program, configured to generate the second request including the photographing request and send the second request to the second image processing module 701 when the second image processing module 701 has processed the third photographing request.
Optionally, the second image processing module 701 is further configured to send a second notification message to the second image capturing application program every time a photographing request is processed, where the second notification message is used to indicate that no photographing request is currently to be processed.
The electronic device provided by the embodiment of the present invention can implement each process in the second method embodiment and achieve the same technical effect, and is not described herein again to avoid repetition.
Referring to fig. 8, fig. 8 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention, where the electronic device 800 includes a processor 801, a memory 802, and a computer program stored in the memory 802 and operable on the processor 801, where the computer program includes a first image processing module, and the first image processing module, when executed by the processor 801, implements the following steps:
acquiring a first request, wherein the first request comprises a first preview request and a first photographing request;
processing the first preview request;
processing the first photographing request under the condition that the time interval between the first photographing request and the second photographing request is greater than a first duration;
under the condition that the time interval between the first photographing request and the second photographing request is less than the first duration, discarding the first photographing request;
the first duration is the minimum time interval between the photographing requests which can be processed under the condition that each preview request can be processed, and the second photographing request is a processed photographing request which is earlier in processing time than the first photographing request and has the shortest time interval with the processing time of the first photographing request.
According to the electronic device provided by the embodiment of the invention, the image processing module (the first image processing module) of the bottom layer system dynamically controls the continuous shooting speed according to the hardware performance of the electronic device so as to ensure that the preview is normal and not blocked, the continuous shooting speed cannot be influenced for the electronic device with good performance, and the preview can be ensured for the electronic device with poor performance by reducing the continuous shooting speed.
Optionally, the computer program further includes a first image capturing application program, and when executed by the processor 801, the first image processing module further implements the following steps:
in a case that a time interval between the first photographing request and the second photographing request is less than the first duration, discarding the first photographing request includes:
the first image processing module discards the first photographing request;
the first image processing module sends a first notification message to the first image acquisition application program, wherein the first notification message is used for indicating that the first photographing request is discarded.
Optionally, the first request is a request acquired in a continuous shooting state.
The electronic device can implement each process of the first method embodiment, and can achieve the same technical effect, and for avoiding repetition, the details are not repeated here.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an electronic device according to a sixth embodiment of the present invention, where the electronic device 900 includes a processor 901, a memory 902, and a computer program stored in the memory 902 and operable on the processor 901, where the computer program includes a second image processing module, and the second image processing module, when executed by the processor 901, implements the following steps:
receiving a second request, the second request comprising a preview request;
processing the preview request;
processing the photographing request if the second request comprises a photographing request;
wherein, when the third photographing request is processed, the second request comprises the photographing request; the third photographing request is a photographing request with the receiving time earlier than that of the second request.
In the electronic device provided by the embodiment of the invention, in the continuous shooting process, the image acquisition application program (second image acquisition application program) defaults to carry the preview request in the second request, and determines whether to carry the photographing request in the second request according to whether the image processing module (second image processing module) of the bottom layer system finishes processing the last photographing request, so that the influence of too many photographing requests on the response of the preview request when the hardware performance of the electronic device is insufficient is avoided, and the preview is ensured to be normal without jamming.
Optionally, the computer program further comprises a second image acquisition application; the second image acquisition application computer program, when executed by the processor 1001, may further implement the steps of:
and the second image acquisition application program generates a second request comprising a photographing request and sends the second request to the second image processing module under the condition that the second image processing module has processed the third photographing request.
Optionally, when executed by the processor 901, the second image processing module further implements the following steps:
and sending a second notification message to the second image acquisition application program every time a photographing request is processed, wherein the second notification message is used for indicating that no photographing request is currently processed.
The electronic device can implement each process in the second embodiment of the method, and can achieve the same technical effect, and for avoiding repetition, the details are not repeated here.
Fig. 10 is a schematic diagram of a hardware structure of an electronic device for implementing various embodiments of the present invention, where the electronic device 1000 includes, but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, a processor 1010, and a power supply 1011. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 10 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The processor 1010 includes a first image processing module, where the first image processing module is configured to obtain a first request, where the first request includes a first preview request and a first photo request; processing the first preview request; processing the first photographing request under the condition that the time interval between the first photographing request and the second photographing request is greater than a first duration; when the time interval between the first photographing request and the second photographing request is less than the first duration, discarding the first photographing request; the first duration is the minimum time interval between the photo requests which can be processed under the condition that each preview request can be processed, and the second photo request is a processed photo request which is earlier in processing time than the first photo request and has the shortest time interval with the processing time of the first photo request.
Alternatively, the first and second electrodes may be,
a processor 1010 comprising a second image processing module to receive a second request, the second request comprising a preview request; processing the preview request; processing the photographing request in a case where the second request includes a photographing request; wherein, when the third photographing request is processed, the second request comprises the photographing request; the third photographing request is a photographing request with the receiving time earlier than that of the second request.
In the embodiment of the invention, the image processing module (the first image processing module) of the bottom layer system dynamically controls the continuous shooting speed according to the hardware performance of the electronic equipment to ensure that the preview is normal and not blocked, the continuous shooting speed cannot be influenced for the electronic equipment with good performance, and the preview can be ensured for the electronic equipment with poor performance by reducing the continuous shooting speed. In addition, for the upper image capturing application program (first image capturing application program), the hardware implementation of the bottom layer does not need to be considered in the continuous shooting process, and only the preview request and the photographing request need to be continuously issued to the image processing module (first image processing module) of the system, then the image processing module (first image processing module) of the system calculates the minimum time interval of the photographing request which can be processed while the processing of the preview request is guaranteed according to the hardware performance, and finally in the process of processing the photographing request, the image processing module (first image processing module) of the system dynamically skips the photographing request of which the time interval with the last photographing request which is determined to be processed is smaller than the minimum time interval. That is, if the hardware performance is not sufficient to process the current photo request while maintaining the preview normal, the current photo request is skipped.
In the embodiment of the invention, in the continuous shooting process, the image acquisition application program (second image acquisition application program) defaults to carry the preview request in the second request, and determines whether the shooting request is carried in the second request according to whether the image processing module (second image processing module) of the bottom layer system processes the last shooting request, so that the influence of excessive shooting requests on the response of the preview request when the hardware performance of the electronic equipment is insufficient is avoided, and the preview is ensured to be normal without blockage.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 1001 may be used for receiving and sending signals during a message transmission or a call, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 1010; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 1001 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio frequency unit 1001 may also communicate with a network and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user through the network module 1002, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 1003 may convert audio data received by the radio frequency unit 1001 or the network module 1002 or stored in the memory 1009 into an audio signal and output as sound. Also, the audio output unit 1003 may also provide audio output related to a specific function performed by the electronic apparatus 1000 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 1003 includes a speaker, a buzzer, a receiver, and the like.
The input unit 1004 is used to receive an audio or video signal. The input Unit 1004 may include a Graphics Processing Unit (GPU) 10041 and a microphone 10042, the Graphics processor 10041 Processing image data of still pictures or video obtained by an image capturing device (such as a camera) in a video capture mode or an image capture mode. The processed image frames may be displayed on the display unit 1006. The image frames processed by the graphic processor 10041 may be stored in the memory 1009 (or other storage medium) or transmitted via the radio frequency unit 1001 or the network module 1002. The microphone 10042 can receive sound and can process such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 1001 in case of a phone call mode.
The electronic device 1000 also includes at least one sensor 1005, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 10061 according to the brightness of ambient light and a proximity sensor that can turn off the display panel 10061 and/or the backlight when the electronic device 1000 moves to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensor 1005 may further include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be described herein.
The display unit 1006 is used to display information input by the user or information provided to the user. The Display unit 1006 may include a Display panel 10061, and the Display panel 10061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 1007 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 10071 (e.g., operations by a user on or near the touch panel 10071 using a finger, a stylus, or any other suitable object or attachment). The touch panel 10071 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1010, and receives and executes commands sent by the processor 1010. In addition, the touch panel 10071 may be implemented by various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 10071, the user input unit 1007 can include other input devices 10072. Specifically, the other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a track ball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 10071 can be overlaid on the display panel 10061, and when the touch panel 10071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 1010 to determine the type of the touch event, and then the processor 1010 provides a corresponding visual output on the display panel 10061 according to the type of the touch event. Although in fig. 10, the touch panel 10071 and the display panel 10061 are two independent components for implementing the input and output functions of the electronic device, in some embodiments, the touch panel 10071 and the display panel 10061 may be integrated to implement the input and output functions of the electronic device, and the implementation is not limited herein.
Interface unit 1008 is an interface for connecting an external device to terminal 1000. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 1008 may be used to receive input from external devices (e.g., data information, power, etc.) and transmit the received input to one or more elements within the electronic device 1000 or may be used to transmit data between the electronic device 1000 and the external devices.
The memory 1009 may be used to store software programs as well as various data. The memory 1009 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, and the like), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, etc. Further, the memory 1009 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 1010 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by operating or executing software programs and/or modules stored in the memory 1009 and calling data stored in the memory 1009, thereby integrally monitoring the electronic device. Processor 1010 may include one or more processing units; preferably, the processor 1010 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1010.
The electronic device 1000 may further include a power source 1011 (e.g., a battery) for supplying power to various components, and preferably, the power source 1011 may be logically connected to the processor 1010 through a power management system, so as to manage charging, discharging, and power consumption management functions through the power management system.
In addition, the electronic device 1000 includes some functional modules that are not shown, and are not described in detail herein.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process in the first and second continuous shooting method embodiments, and can achieve the same technical effect, and in order to avoid repetition, the computer program is not described herein again. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling an electronic device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (8)

1. A continuous shooting method is applied to electronic equipment and is characterized by comprising the following steps:
receiving a second request, the second request comprising a preview request;
processing the preview request;
processing the photographing request if the second request comprises a photographing request;
wherein, when the third photographing request is processed, the second request comprises the photographing request; the third photographing request is a photographing request with the receiving time earlier than that of the second request;
the electronic equipment comprises a second image processing module, and a second image acquisition application program runs on the electronic equipment; wherein the step of receiving a second request, the step of processing the preview request, and the step of processing the photograph request are all performed by the second image processing module;
wherein whether the photographing request is included in the second request is determined according to whether the second image processing module finishes processing the third photographing request.
2. The method of claim 1,
before the receiving the second request, the method further includes:
and the second image acquisition application program generates a second request comprising a photographing request and sends the second request to the second image processing module under the condition that the second image processing module has processed the third photographing request.
3. The method of claim 1, further comprising:
and sending a second notification message to the second image acquisition application program every time a photographing request is processed, wherein the second notification message is used for indicating that no photographing request is currently processed.
4. An electronic device, comprising:
a second image processing module for receiving a second request, the second request comprising a preview request; processing the preview request; processing the photographing request in a case where the second request includes a photographing request;
wherein, when the third photographing request is processed, the second request comprises the photographing request; the third photographing request is a photographing request with the receiving time earlier than that of the second request;
the electronic equipment runs a second image acquisition application program;
wherein whether the photographing request is included in the second request is determined according to whether the second image processing module finishes processing the third photographing request.
5. The electronic device of claim 4,
and the second image acquisition application program is used for generating a second request comprising a photographing request and sending the second request to the second image processing module under the condition that the second image processing module has processed the third photographing request.
6. The electronic device of claim 4, wherein the second image processing module is further configured to send a second notification message to the second image capturing application every time a photo request is processed, where the second notification message is used to indicate that no photo request is currently pending.
7. An electronic device, comprising a processor, a memory, on which a computer program is stored which is executable on the processor, the computer program, when executed by the processor, implementing the steps of the burst method as claimed in any one of claims 1 to 3.
8. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the continuous shooting method as claimed in any one of claims 1 to 3.
CN202110303864.0A 2019-11-07 2019-11-07 Continuous shooting method and electronic equipment Active CN112954222B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110303864.0A CN112954222B (en) 2019-11-07 2019-11-07 Continuous shooting method and electronic equipment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911082436.9A CN110719409B (en) 2019-11-07 2019-11-07 Continuous shooting method and electronic equipment
CN202110303864.0A CN112954222B (en) 2019-11-07 2019-11-07 Continuous shooting method and electronic equipment

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201911082436.9A Division CN110719409B (en) 2019-11-07 2019-11-07 Continuous shooting method and electronic equipment

Publications (2)

Publication Number Publication Date
CN112954222A CN112954222A (en) 2021-06-11
CN112954222B true CN112954222B (en) 2022-12-20

Family

ID=69213814

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202110303864.0A Active CN112954222B (en) 2019-11-07 2019-11-07 Continuous shooting method and electronic equipment
CN201911082436.9A Active CN110719409B (en) 2019-11-07 2019-11-07 Continuous shooting method and electronic equipment

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201911082436.9A Active CN110719409B (en) 2019-11-07 2019-11-07 Continuous shooting method and electronic equipment

Country Status (1)

Country Link
CN (2) CN112954222B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770059B (en) * 2021-01-22 2022-11-25 维沃移动通信(杭州)有限公司 Photographing method and device and electronic equipment
CN116055857B (en) * 2022-08-24 2023-11-24 荣耀终端有限公司 Photographing method and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103002152A (en) * 2012-12-06 2013-03-27 广东欧珀移动通信有限公司 Method and device for continuous shooting of mobile terminal
CN107770449A (en) * 2017-11-02 2018-03-06 广东欧珀移动通信有限公司 continuous shooting method, electronic equipment and storage medium

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2926671B2 (en) * 1993-02-03 1999-07-28 エヌ・ティ・ティ移動通信網株式会社 Meteor communication system
KR20030009610A (en) * 2001-07-23 2003-02-05 엠텍비젼 주식회사 Camera providing image data related to object to portable communication terminal and method providing the image data using the same
CN104618572B (en) * 2014-12-19 2018-02-16 广东欧珀移动通信有限公司 The photographic method and device of a kind of terminal
CN104699338B (en) * 2015-02-12 2017-10-31 广东欧珀移动通信有限公司 A kind of camera control method and terminal
CN105323484B (en) * 2015-10-29 2020-11-13 惠州Tcl移动通信有限公司 Rapid photographing method and electronic equipment
KR20170085358A (en) * 2016-01-14 2017-07-24 엘지전자 주식회사 Mobile terminal and control method for the mobile terminal
CN107317973A (en) * 2017-08-17 2017-11-03 珠海市魅族科技有限公司 A kind of information processing method and device, computer installation and readable storage medium storing program for executing
CN108513070B (en) * 2018-04-04 2020-09-04 维沃移动通信有限公司 Image processing method, mobile terminal and computer readable storage medium
CN109922322B (en) * 2019-04-10 2021-06-11 Oppo广东移动通信有限公司 Photographing method, image processor, photographing device and electronic equipment
CN110177215A (en) * 2019-06-28 2019-08-27 Oppo广东移动通信有限公司 Image processing method, image processor, filming apparatus and electronic equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103002152A (en) * 2012-12-06 2013-03-27 广东欧珀移动通信有限公司 Method and device for continuous shooting of mobile terminal
CN107770449A (en) * 2017-11-02 2018-03-06 广东欧珀移动通信有限公司 continuous shooting method, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN112954222A (en) 2021-06-11
CN110719409A (en) 2020-01-21
CN110719409B (en) 2021-06-08

Similar Documents

Publication Publication Date Title
CN108513070B (en) Image processing method, mobile terminal and computer readable storage medium
CN109597556B (en) Screen capturing method and terminal
CN109078319B (en) Game interface display method and terminal
CN110557566A (en) Video shooting method and electronic equipment
CN110913139B (en) Photographing method and electronic equipment
CN110213440B (en) Image sharing method and terminal
CN111263071B (en) Shooting method and electronic equipment
CN108307106B (en) Image processing method and device and mobile terminal
CN108924414B (en) Shooting method and terminal equipment
CN110933302B (en) Shooting method and electronic equipment
CN109889757B (en) Video call method and terminal equipment
CN108881721B (en) Display method and terminal
CN112954222B (en) Continuous shooting method and electronic equipment
CN110944114B (en) Photographing method and electronic equipment
CN110955793A (en) Display control method and electronic equipment
CN109005337B (en) Photographing method and terminal
CN108924413B (en) Shooting method and mobile terminal
CN108536513B (en) Picture display direction adjusting method and mobile terminal
CN108345657B (en) Picture screening method and mobile terminal
CN108243489B (en) Photographing control method and mobile terminal
CN108965701B (en) Jitter correction method and terminal equipment
CN108076287B (en) Image processing method, mobile terminal and computer readable storage medium
CN111314621B (en) Photographing method and electronic equipment
CN110868537B (en) Shooting method and electronic equipment
CN111327820B (en) Shooting method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant