CN114071047A - Frame rate control method and related device - Google Patents

Frame rate control method and related device Download PDF

Info

Publication number
CN114071047A
CN114071047A CN202111278490.8A CN202111278490A CN114071047A CN 114071047 A CN114071047 A CN 114071047A CN 202111278490 A CN202111278490 A CN 202111278490A CN 114071047 A CN114071047 A CN 114071047A
Authority
CN
China
Prior art keywords
frame
screen
image data
image
refresh rate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111278490.8A
Other languages
Chinese (zh)
Other versions
CN114071047B (en
Inventor
白颂荣
张海越
赖志业
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Xihua Technology Co Ltd
Original Assignee
Shenzhen Xihua Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Xihua Technology Co Ltd filed Critical Shenzhen Xihua Technology Co Ltd
Priority to CN202111278490.8A priority Critical patent/CN114071047B/en
Publication of CN114071047A publication Critical patent/CN114071047A/en
Application granted granted Critical
Publication of CN114071047B publication Critical patent/CN114071047B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0127Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0266Details of the structure or mounting of specific components for a display module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0277Details of the structure or mounting of specific components for a printed circuit board assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/7246User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions by connection of exchangeable housing parts
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The embodiment of the application discloses a frame rate control method and a related device, which are applied to a bridging chip of a screen replacing module of electronic equipment, wherein the electronic equipment comprises a processor and the screen replacing module, the screen replacing module comprises the bridging chip and a screen replacing screen, the processor is connected with the bridging chip, and the bridging chip is connected with the screen; the method comprises the following steps: receiving first image data from a processor; acquiring a second refresh rate range of the reloading screen; detecting that the first frame rate is greater than the maximum refresh rate of the second refresh rate range; processing the first video data to obtain second image data adaptive to the reloading screen, wherein the frame rate of the second image data is less than or equal to the maximum refresh rate of a second refresh rate range; and controlling the reloading screen to display the image information of the second image data. The method and the device are favorable for improving the success rate and the stability of image display after the screen of the electronic equipment is replaced.

Description

Frame rate control method and related device
Technical Field
The present application relates to the field of image data processing technologies, and in particular, to a frame rate control method and a related apparatus.
Background
When a user uses an electronic device such as a mobile phone with a screen, screen breaking events occur occasionally, many users can re-prepare the mobile phone with a screen different from the original screen-loading specification in consideration of cost performance, and if the refresh rate of the screen to be reloaded is different from that of the original screen, if a processor of the electronic device directly sends an image higher than the refresh rate of the screen to be reloaded to the screen, the problem that stable display cannot be achieved can occur.
Disclosure of Invention
The application provides a frame rate control method and a related device, aiming to improve the success rate and stability of image display after screen replacement of an electronic device.
In a first aspect, the present application provides a frame rate control method, which is applied to a bridge chip of a screen changing module of an electronic device, where the electronic device includes a processor and the screen changing module, the screen changing module includes a bridge chip and a screen changing screen, the processor is connected to the bridge chip, and the bridge chip is connected to the screen; the method comprises the following steps:
receiving first image data from the processor, wherein the frame rate of the first image data is a first frame rate, and the first frame rate is within a first refresh rate range of an original screen of the electronic device;
acquiring a second refresh rate range of the reloading screen, wherein the maximum refresh rate of the first refresh rate range is larger than that of the second refresh rate range;
detecting that the first frame rate is greater than a maximum refresh rate of the second refresh rate range;
processing the first video data to obtain second image data which is adapted to the reloading screen, wherein the frame rate of the second image data is smaller than or equal to the maximum refresh rate of the second refresh rate range;
and controlling the reloading screen to display the image information of the second image data.
It can be seen that, in the embodiment of the present application, a bridge chip of a screen changing module of an electronic device first receives first image data from a processor, where a frame rate of the first image data is a first frame rate, and the first frame rate is within a first refresh rate range of an original screen of the electronic device; secondly, acquiring a second refresh rate range of the reloading screen, wherein the maximum refresh rate of the first refresh rate range is larger than that of the second refresh rate range; thirdly, detecting that the first frame rate is larger than the maximum refresh rate of the second refresh rate range; thirdly, processing the first video data to obtain second image data adaptive to the reloading screen, wherein the frame rate of the second image data is less than or equal to the maximum refresh rate of a second refresh rate range; and finally, controlling the reloading screen to display the image information of the second image data. Therefore, the bridge chip adjusts the original image data based on the refresh rate of the reloading screen to adapt to the specification of the reloading screen, the situation that the image cannot be stably displayed due to the fact that the refresh rate cannot be met is avoided, and the success rate and the stability of image display after the electronic equipment reloads the screen are improved.
In a second aspect, the application provides a bridge chip applied to a screen reloading module of an electronic device, where the electronic device includes a processor and the screen reloading module, the screen reloading module includes a bridge chip and a screen reloading screen, the processor is connected to the bridge chip, and the bridge chip is connected to the screen; the device comprises:
the receiving unit is used for receiving first image data from the processor, wherein the frame rate of the first image data is a first frame rate, and the first frame rate is within a first refresh rate range of an original screen of the electronic equipment;
the obtaining unit is used for obtaining a second refresh rate range of the reloading screen, and the maximum refresh rate of the first refresh rate range is larger than that of the second refresh rate range;
a detecting unit, configured to detect that the first frame rate is greater than a maximum refresh rate of the second refresh rate range;
the processing unit is used for processing the first video data to obtain second image data which is adapted to the reloading screen, and the frame rate of the second image data is smaller than or equal to the maximum refresh rate of the second refresh rate range;
and the control unit is used for controlling the reloading screen to display the image information of the second image data.
In a third aspect, the present application provides a computer readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes an apparatus to perform the steps of the method according to any one of the first aspect.
In a fourth aspect, the application provides a bridge chip, which is applied to a screen replacing module of an electronic device, wherein the electronic device includes a processor and the screen replacing module, the screen replacing module includes the bridge chip and a screen replacing screen, the processor is connected to the bridge chip, and the bridge chip is connected to the screen replacing screen;
the bridge chip is used for running a program, wherein the program is used for executing the steps in the method according to the first aspect.
In a fifth aspect, the present application provides an electronic device comprising the bridge chip according to the fourth aspect.
Drawings
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 2 is a schematic flowchart of a frame rate control method according to an embodiment of the present disclosure;
fig. 3 is a block diagram illustrating functional units of a frame rate control apparatus according to an embodiment of the present disclosure;
fig. 4 is a block diagram illustrating functional units of another frame rate control apparatus according to an embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
In the present application, "at least one" means one or more, and a plurality means two or more. In this application and/or, an association relationship of an associated object is described, which means that there may be three relationships, for example, a and/or B, which may mean: a alone, both A and B, and B alone, where A, B may be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" or similar expressions refer to any combination of these items, including any combination of the singular or plural items. For example, at least one (one) of a, b, or c, may represent: a, b, c, a and b, a and c, b and c, or a, b and c, wherein each of a, b, c may itself be an element or a set comprising one or more elements.
It should be noted that, in the embodiments of the present application, the term "equal to" may be used in conjunction with more than, and is applicable to the technical solution adopted when more than, and may also be used in conjunction with less than, and is applicable to the technical solution adopted when less than, and it should be noted that when equal to or more than, it is not used in conjunction with less than; when the ratio is equal to or less than the combined ratio, the ratio is not greater than the combined ratio. In the embodiments of the present application, "of", "corresponding" and "corresponding" may be sometimes used in combination, and it should be noted that the intended meaning is consistent when the difference is not emphasized.
First, partial terms referred to in the embodiments of the present application are explained so as to be easily understood by those skilled in the art.
1. TDDI display chip: TDDI is Touch and Display Driver Integration (TDDI). The touch and display functions of the smart phone are independently controlled by the two chips, and the TDDI integrates the touch chip and the display chip into a single chip.
2. A Cortex-M0 microprocessor is a 32-bit processor from ARM. The kernel of the microprocessor adopts an architecture that the instruction and the data share the same bus.
3. The Low Temperature Polycrystalline Oxide (LTPO) screen is mainly used for a TFT channel material for OLED screen drive control, and the application of the LTPO screen can enable the refresh rate of the OLED screen to be the lowest so as to realize the self-adaptive adjustment of the screen refresh rate and realize the energy-saving aim.
At present, in a screen changing scene of electronic equipment such as a mobile phone, the electronic equipment with an originally installed screen being an LTPO screen supports dynamic refresh rate control, and after other screens are changed, the problem that images cannot be normally displayed can occur.
In view of the above problems, the present application provides a frame rate control method and related apparatus, which will be described in detail below.
Referring to fig. 1, fig. 1 is a schematic view of an electronic device 100 according to an embodiment of the present disclosure. The electronic device 100 includes a processor 120 and a screen replacing module 140, the screen replacing module 140 includes a bridge chip 141 and a screen replacing screen 142, the processor 120 is connected to the bridge chip 141, and the bridge chip 141 is connected to the screen replacing screen 142. The processor 120 may be a system-on-chip of an electronic device, and specifically includes a central processing unit CPU, a graphics processing unit GPU, and the like. The bridge chip 141 may be a Cortex-M0 microprocessor. The reloading screen 142 may be, for example, an Active Matrix/Organic Light Emitting Diode (AMOLED) screen.
In addition, the electronic device 100 may be a game machine, a mobile terminal (e.g., a smart phone), an IoT device in the internet of things, a vehicle-mounted terminal device, and other various electronic devices.
Referring to fig. 2, fig. 2 is a schematic flowchart of a frame rate control method according to an embodiment of the present disclosure, applied to a bridge chip 141 of a screen replacing module 140 of the electronic device 100 shown in fig. 1; as shown, the frame rate control method includes the following steps.
Step 201, receiving first image data from the processor, where a frame rate of the first image data is a first frame rate, and the first frame rate is within a first refresh rate range of an original screen of the electronic device.
Wherein the original screen of the electronic device may be an LTPO screen, for example, and the first refresh rate range may be 1Hz-120Hz, for example.
Step 202, obtaining a second refresh rate range of the reloading screen, wherein the maximum refresh rate of the first refresh rate range is greater than the maximum refresh rate of the second refresh rate range.
Wherein the second refresh rate range may be, for example, 15Hz-60 Hz.
Step 203, detecting that the first frame rate is greater than the maximum refresh rate of the second refresh rate range.
In one possible example, the method further comprises: and if the first frame rate is detected to be smaller than or equal to the maximum refresh rate of the second refresh rate range, maintaining the first frame rate to control the reloading screen to display the image information of the first image data.
Step 204, processing the first video data to obtain second image data adapted to the reloading screen, wherein the frame rate of the second image data is less than or equal to the maximum refresh rate of the second refresh rate range;
step 205, controlling the reloading screen to display the image information of the second image data.
In a specific implementation, if other specifications of the scanning mode, the resolution, and the like of each frame of image data in the second image data are not consistent with the specifications of the scanning mode, the resolution, and the like supported by the reloading screen, the second image data can be further processed according to the differences of the scanning mode and the resolution, so that third image data adapted to the reloading screen is obtained and displayed.
In one possible example, the first image data is a multi-frame image within one second of the target video; the processing the first image data to obtain second image data adapted to the reloading screen includes: determining a second frame rate to which the first image data needs to be adjusted; determining the number X of frame images needing to be deleted in the first image data according to the first frame rate and the second frame rate; and performing frame rate reduction processing on the first image data according to the number X to obtain second image data adaptive to the reloading screen.
The storage unit of the bridge chip can store a plurality of frames of images within one second of the target video.
As can be seen, in this example, the bridge chip can determine the number of frames of the dropped frame based on the frame rate difference, and delete the frame image corresponding to the number of frames to adapt to the reloaded screen, thereby ensuring display stability.
In one possible example, the determining the second frame rate to which the first image data needs to be adjusted includes: and determining that the maximum refresh rate of the second refresh rate range is a second frame rate to which the first image data needs to be adjusted.
As can be seen, in this example, the bridge chip may directly set the maximum refresh rate in the second refresh rate range to the second frame rate to which the first image data needs to be adjusted, so that the display effect of the original screen is as close as possible under the constraint of the performance range of the reloading screen, and the calculation is simple, efficient, and convenient.
In one possible example, the determining the second frame rate to which the first image data needs to be adjusted includes: determining a picture display type of the first image data, wherein the picture display type comprises any one of the following: a video picture display type, a game picture display type, a dynamic page display type, and a static page display type; inquiring a preset frame rate mapping relation table, and determining the lowest refresh rate which meets the display requirement and corresponds to the picture display type of the first image data, wherein the frame rate mapping relation table comprises the corresponding relation between the picture display type and the lowest refresh rate; determining a third refresh rate range according to the determined lowest refresh rate and a maximum refresh rate of the second refresh rate range; and determining a second frame rate to which the first image data needs to be adjusted according to the load condition of the processor of the electronic equipment within the third refresh rate range.
The application program associated with the video frame display type may be a video player, or another application program embedded in the video player, such as a browser. The application program associated with the game screen display type may be various game application programs, and may include a full-screen game and a partial-screen game. The application program associated with the dynamic page display type may be a news application program, and specifically may be an automatic playing picture or an automatic scrolling common in a web page. The application program associated with the static page display type can be a reader, a text editing tool and the like.
In specific implementation, when a user starts an application with a high load rate of a processor, a display screen operates at a high refresh rate; when the user turns on an application with a lower processor load rate, the display screen operates at a lower refresh rate.
As can be seen, in this example, since the refresh rate supports dynamic adjustment, and the picture display type characteristic of the first image data and the load condition of the processor are taken into consideration, performance and system power consumption can be balanced, and the use experience can be improved.
In one possible example, the frame-rate-reducing processing the first video data according to the number X to obtain second image data adapted to the reloading screen includes: dividing the first frame rate of the first image data by the number X and rounding down to obtain a frame removal period value Y; dividing the first image data according to the value Y of the frame removing period from a second frame image of the first image data to obtain X frame image subsets and residual frame images, wherein each frame image subset comprises Y frame images with continuous values; deleting any one frame image in the Y frame images of the numerical value in each frame image subset to obtain an updated frame image subset; and generating the second image data according to the first frame image of the first image data, the updated X frame image subsets and the residual frame images.
For example, assuming that the first video data is 95 frames, that is, the first frame rate is 95Hz, the second frame rate is 60Hz, and the number X is 35, the frame removal period value Y is 2, 35 frame image subsets are divided from frame 2 to frame 71 of the 95 frames, the remaining frame images are from frame 72 to frame 95, and any one frame image in each frame image subset is deleted, then frame 1, 35 updated frame image subsets, and frame 72 to frame 95 constitute 60 frame images of the second video data.
As can be seen, in this example, the bridge chip employs a redundancy algorithm to quickly delete X number of frame images, and meanwhile, to ensure timeliness and accuracy of display.
In one possible example, the first image data is a plurality of frames of images cached by a frame image caching unit of the bridge chip in a current refreshing cycle of the reloading screen; the processing the first image data to obtain second image data adapted to the reloading screen includes: determining a single-frame image for displaying in a next refresh period of the current refresh period according to the multi-frame image; and determining the refresh period of the reloading screen according to the maximum refresh rate of the second refresh rate range.
The duration of the refresh cycle of the reloading screen is greater than the duration of the refresh cycle of the original screen, and the processor sends the frame image data to the bridge chip according to the refresh cycle of the original screen, so that the frame image data received in an actual single refresh cycle is multi-frame image data, for example, the duration of the refresh cycle of the reloading screen is 16.7 milliseconds (60Hz), and the refresh cycle of the original screen is 8.3 milliseconds (120Hz), so that the frame image data received in the actual single refresh cycle is 2-frame image.
Therefore, in this example, the bridge chip can merge multiple frames of image data received in an actual single refresh period into single frame of image data, thereby avoiding errors caused by the fact that multiple frames of image data need to be displayed in a single refresh period, and improving stability.
In one possible example, the determining, according to the multiple frames of images, a single frame of image for displaying in a refresh period next to the current refresh period includes: predicting a dynamic image area of each frame of image in the multi-frame images, wherein the dynamic image area is an image area containing a target object, and the target object comprises a person or an object with motion characteristics; and carrying out weighting processing on the data of the dynamic image area according to the multi-frame image, and merging a processing result and the data of the non-dynamic image area of any one frame of image to obtain the single-frame image.
The non-moving image area refers to an area except for the moving image area in the frame image.
As can be seen, in this example, the bridge chip can merge multiple frames of images in a single refresh period into a single frame of image displayed in the next refresh period, and the dynamic image area is focused in the merging algorithm for processing, thereby balancing efficiency and accuracy.
In one possible example, the determining, according to the multiple frames of images, a single frame of image for displaying in a refresh period next to the current refresh period includes: and determining the last frame image in the multi-frame images as the single frame image.
In some application scenarios with very high real-time requirements, such as a multi-player battle game in a mobile phone, it is necessary to reduce the time consumption of the multi-frame image merging process as much as possible to ensure the smoothness of the game image display of the screen change.
As can be seen, in this example, the bridge chip can perform fast pruning on image data in an application scene with a high real-time requirement to ensure display smoothness, and ensure that image display stability is not jammed.
It can be seen that, in the embodiment of the present application, a bridge chip of a screen changing module of an electronic device first receives first image data from a processor, where a frame rate of the first image data is a first frame rate, and the first frame rate is within a first refresh rate range of an original screen of the electronic device; secondly, acquiring a second refresh rate range of the reloading screen, wherein the maximum refresh rate of the first refresh rate range is larger than that of the second refresh rate range; thirdly, detecting that the first frame rate is larger than the maximum refresh rate of the second refresh rate range; thirdly, processing the first video data to obtain second image data adaptive to the reloading screen, wherein the frame rate of the second image data is less than or equal to the maximum refresh rate of a second refresh rate range; and finally, controlling the reloading screen to display the image information of the second image data. Therefore, the bridge chip adjusts the original image data based on the refresh rate of the reloading screen to adapt to the specification of the reloading screen, the situation that the image cannot be stably displayed due to the fact that the refresh rate cannot be met is avoided, and the success rate and the stability of image display after the electronic equipment reloads the screen are improved.
The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the bridge chip contains corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the bridge chip may be divided into the functional units according to the above method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
The embodiment of the present application provides a frame rate control device, which may be a bridge chip. Specifically, the frame rate control device is configured to perform the steps performed by the bridge chip in the frame rate control method. The frame rate control device provided by the embodiment of the present application may include modules corresponding to the corresponding steps.
In the embodiment of the present application, the frame rate control device may be divided into functional modules according to the above method, for example, each functional module may be divided for each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The division of the modules in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
Fig. 3 shows a schematic diagram of a possible structure of the frame rate control device according to the above embodiment, in a case where each functional module is divided according to each function. As shown in fig. 3, the frame rate control device 3 is applied to a bridge chip of a screen replacing module of an electronic device, where the electronic device includes a processor and the screen replacing module, the screen replacing module includes a bridge chip and a screen replacing screen, the processor is connected to the bridge chip, and the bridge chip is connected to the screen replacing screen; the device comprises:
a receiving unit 30, configured to receive first image data from the processor, where a frame rate of the first image data is a first frame rate, and the first frame rate is within a first refresh rate range of an original screen of the electronic device;
an obtaining unit 31, configured to obtain a second refresh rate range of the reloading screen, where a maximum refresh rate of the first refresh rate range is greater than a maximum refresh rate of the second refresh rate range;
a detecting unit 32, configured to detect that the first frame rate is greater than a maximum refresh rate of the second refresh rate range;
a processing unit 33, configured to process the first video data to obtain second image data adapted to the reloading screen, where a frame rate of the second image data is less than or equal to a maximum refresh rate of the second refresh rate range;
and a control unit 34, configured to control the reloading screen to display image information of the second image data.
In one possible example, the first image data is a multi-frame image within one second of the target video; in respect of the processing the first image data to obtain the second image data adapted to the reloading screen, the processing unit 33 is specifically configured to: determining a second frame rate to which the first image data needs to be adjusted; determining the number X of frame images needing to be deleted in the first image data according to the first frame rate and the second frame rate; and performing frame rate reduction processing on the first image data according to the number X to obtain second image data adaptive to the reloading screen.
In one possible example, in terms of the determining the second frame rate to which the first image data needs to be adjusted, the processing unit 33 is specifically configured to: and determining that the maximum refresh rate of the second refresh rate range is a second frame rate to which the first image data needs to be adjusted.
In one possible example, in terms of the determining the second frame rate to which the first image data needs to be adjusted, the processing unit 33 is specifically configured to: determining a picture display type of the first image data, wherein the picture display type comprises any one of the following: a video picture display type, a game picture display type, a dynamic page display type, and a static page display type; inquiring a preset frame rate mapping relation table, and determining the lowest refresh rate which meets the display requirement and corresponds to the picture display type of the first image data, wherein the frame rate mapping relation table comprises the corresponding relation between the picture display type and the lowest refresh rate; determining a third refresh rate range according to the determined lowest refresh rate and a maximum refresh rate of the second refresh rate range; and determining a second frame rate to which the first image data needs to be adjusted according to the load condition of the processor of the electronic equipment within the third refresh rate range.
In a possible example, in terms of performing frame rate reduction processing on the first video data according to the number X to obtain second image data adapted to the reloading screen, the processing unit 33 is specifically configured to: dividing the first frame rate of the first image data by the number X and rounding down to obtain a frame removal period value Y; dividing the first image data according to the value Y of the frame removing period from a second frame image of the first image data to obtain X frame image subsets and residual frame images, wherein each frame image subset comprises Y frame images with continuous values; deleting any one frame image in the Y frame images of the numerical value in each frame image subset to obtain an updated frame image subset; and generating the second image data according to the first frame image of the first image data, the updated X frame image subsets and the residual frame images.
In one possible example, the first image data is a plurality of frames of images cached by a frame image caching unit of the bridge chip in a current refreshing cycle of the reloading screen; in respect of the processing the first image data to obtain the second image data adapted to the reloading screen, the processing unit 33 is specifically configured to: determining a single-frame image for displaying in a next refresh period of the current refresh period according to the multi-frame image; and determining the refresh period of the reloading screen according to the maximum refresh rate of the second refresh rate range.
In one possible example, in terms of determining, from the multiple frame images, a single frame image for displaying in a refresh period next to the current refresh period, the processing unit 33 is specifically configured to: predicting a dynamic image area of each frame of image in the multi-frame images, wherein the dynamic image area is an image area containing a target object, and the target object comprises a person or an object with motion characteristics; and carrying out weighting processing on the data of the dynamic image area according to the multi-frame image, and merging a processing result and the data of the non-dynamic image area of any one frame of image to obtain the single-frame image.
In one possible example, in terms of determining, from the multiple frame images, a single frame image for displaying in a refresh period next to the current refresh period, the processing unit 33 is specifically configured to: and determining the last frame image in the multi-frame images as the single frame image.
In the case of using an integrated unit, a schematic structural diagram of another frame rate control apparatus 4 provided in the embodiment of the present application is shown in fig. 4. In fig. 4, the frame rate control device 4 includes: a processing module 40 and a communication module 41. The processing module 40 is used for controlling and managing the actions of the rate control device, such as the steps performed by the receiving unit 30, the obtaining unit 31, the detecting unit 32, the processing unit 33, the control unit 34, and/or other processes for performing the techniques described herein. The communication module 41 is used to support the interaction between the frame rate control apparatus and other devices. As shown in fig. 4, the frame rate control device may further include a storage module 42, and the storage module 42 is used for storing program codes and data of the frame rate control device.
The Processing module 40 may be a Processor or a controller, and may be, for example, a Central Processing Unit (CPU), a general-purpose Processor, a Digital Signal Processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs, and microprocessors, among others. The communication module 41 may be a transceiver, an RF circuit or a communication interface, etc. The storage module 42 may be a memory.
All relevant contents of each scene related to the method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again. Both the frame rate control device 3 and the frame rate control device 4 can execute the steps executed by the microprocessor in the frame rate control method shown in fig. 2.
The above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, the above-described embodiments may be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions or computer programs. The procedures or functions according to the embodiments of the present application are wholly or partially generated when the computer instructions or the computer program are loaded or executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire or wirelessly. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more collections of available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. The semiconductor medium may be a solid state disk.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enabling a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes an electronic device.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device.
It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
In the several embodiments provided in the present application, it should be understood that the disclosed method, apparatus and system may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative; for example, the division of the unit is only a logic function division, and there may be another division manner in actual implementation; for example, various elements or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be physically included alone, or two or more units may be integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute some steps of the methods according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications can be easily made by those skilled in the art without departing from the spirit and scope of the present invention, and it is within the scope of the present invention to include different functions, combination of implementation steps, software and hardware implementations.

Claims (12)

1. The frame rate control method is characterized in that the method is applied to a bridge chip of a screen replacing module of electronic equipment, the electronic equipment comprises a processor and the screen replacing module, the screen replacing module comprises the bridge chip and a screen replacing screen, the processor is connected with the bridge chip, and the bridge chip is connected with the screen; the method comprises the following steps:
receiving first image data from the processor, wherein the frame rate of the first image data is a first frame rate, and the first frame rate is within a first refresh rate range of an original screen of the electronic device;
acquiring a second refresh rate range of the reloading screen, wherein the maximum refresh rate of the first refresh rate range is larger than that of the second refresh rate range;
detecting that the first frame rate is greater than a maximum refresh rate of the second refresh rate range;
processing the first video data to obtain second image data which is adapted to the reloading screen, wherein the frame rate of the second image data is smaller than or equal to the maximum refresh rate of the second refresh rate range;
and controlling the reloading screen to display the image information of the second image data.
2. The method according to claim 1, wherein the first image data is a plurality of frame images within one second of a target video;
the processing the first image data to obtain second image data adapted to the reloading screen includes:
determining a second frame rate to which the first image data needs to be adjusted;
determining the number X of frame images needing to be deleted in the first image data according to the first frame rate and the second frame rate;
and performing frame rate reduction processing on the first image data according to the number X to obtain second image data adaptive to the reloading screen.
3. The method of claim 2, wherein determining the second frame rate to which the first image data needs to be adjusted comprises:
and determining that the maximum refresh rate of the second refresh rate range is a second frame rate to which the first image data needs to be adjusted.
4. The method of claim 2, wherein determining the second frame rate to which the first image data needs to be adjusted comprises:
determining a picture display type of the first image data, wherein the picture display type comprises any one of the following: a video picture display type, a game picture display type, a dynamic page display type, and a static page display type;
inquiring a preset frame rate mapping relation table, and determining the lowest refresh rate which meets the display requirement and corresponds to the picture display type of the first image data, wherein the frame rate mapping relation table comprises the corresponding relation between the picture display type and the lowest refresh rate;
determining a third refresh rate range according to the determined lowest refresh rate and a maximum refresh rate of the second refresh rate range;
and determining a second frame rate to which the first image data needs to be adjusted according to the load condition of the processor of the electronic equipment within the third refresh rate range.
5. The method of claim 2, wherein the frame-rate-reducing the first video data according to the number X to obtain second image data adapted to the reloading screen comprises:
dividing the first frame rate of the first image data by the number X and rounding down to obtain a frame removal period value Y;
dividing the first image data according to the value Y of the frame removing period from a second frame image of the first image data to obtain X frame image subsets and residual frame images, wherein each frame image subset comprises Y frame images with continuous values;
deleting any one frame image in the Y frame images of the numerical value in each frame image subset to obtain an updated frame image subset;
and generating the second image data according to the first frame image of the first image data, the updated X frame image subsets and the residual frame images.
6. The method according to claim 1, wherein the first image data is a plurality of frames of images buffered by a frame image buffer unit of the bridge chip in a current refresh period of the reloading screen;
the processing the first image data to obtain second image data adapted to the reloading screen includes:
determining a single-frame image for displaying in a next refresh period of the current refresh period according to the multi-frame image;
and determining the refresh period of the reloading screen according to the maximum refresh rate of the second refresh rate range.
7. The method according to claim 6, wherein said determining a single frame image for display in a refresh cycle next to the current refresh cycle from the plurality of frame images comprises:
predicting a dynamic image area of each frame of image in the multi-frame images, wherein the dynamic image area is an image area containing a target object, and the target object comprises a person or an object with motion characteristics;
and carrying out weighting processing on the data of the dynamic image area according to the multi-frame image, and merging a processing result and the data of the non-dynamic image area of any one frame of image to obtain the single-frame image.
8. The method according to claim 6, wherein said determining a single frame image for display in a refresh cycle next to the current refresh cycle from the plurality of frame images comprises:
and determining the last frame image in the multi-frame images as the single frame image.
9. The frame rate control device is characterized in that the device is applied to a bridge chip of a screen replacing module of electronic equipment, the electronic equipment comprises a processor and the screen replacing module, the screen replacing module comprises the bridge chip and a screen replacing screen, the processor is connected with the bridge chip, and the bridge chip is connected with the screen; the device comprises:
the receiving unit is used for receiving first image data from the processor, wherein the frame rate of the first image data is a first frame rate, and the first frame rate is within a first refresh rate range of an original screen of the electronic equipment;
the obtaining unit is used for obtaining a second refresh rate range of the reloading screen, and the maximum refresh rate of the first refresh rate range is larger than that of the second refresh rate range;
a detecting unit, configured to detect that the first frame rate is greater than a maximum refresh rate of the second refresh rate range;
the processing unit is used for processing the first video data to obtain second image data which is adapted to the reloading screen, and the frame rate of the second image data is smaller than or equal to the maximum refresh rate of the second refresh rate range;
and the control unit is used for controlling the reloading screen to display the image information of the second image data.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program causes an apparatus to perform the steps of the method according to any one of claims 1-8.
11. A bridge chip is characterized in that the bridge chip is applied to a screen replacing module of electronic equipment, the electronic equipment comprises a processor and the screen replacing module, the screen replacing module comprises the bridge chip and a screen replacing screen, the processor is connected with the bridge chip, and the bridge chip is connected with the screen;
the bridge chip is configured to run a program, wherein the program is configured to perform the steps of the method according to any one of claims 1 to 8 when running.
12. An electronic device comprising the bridge chip of claim 11.
CN202111278490.8A 2021-10-30 2021-10-30 Frame rate control method and related device Active CN114071047B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111278490.8A CN114071047B (en) 2021-10-30 2021-10-30 Frame rate control method and related device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111278490.8A CN114071047B (en) 2021-10-30 2021-10-30 Frame rate control method and related device

Publications (2)

Publication Number Publication Date
CN114071047A true CN114071047A (en) 2022-02-18
CN114071047B CN114071047B (en) 2023-08-29

Family

ID=80236113

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111278490.8A Active CN114071047B (en) 2021-10-30 2021-10-30 Frame rate control method and related device

Country Status (1)

Country Link
CN (1) CN114071047B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114724528A (en) * 2022-04-02 2022-07-08 深圳创维-Rgb电子有限公司 Display control method and device of display equipment, electronic equipment and storage medium
CN115019749A (en) * 2022-06-07 2022-09-06 福建华佳彩有限公司 Panel display system capable of automatically and dynamically adjusting refresh rate
CN115831074A (en) * 2023-02-20 2023-03-21 深圳曦华科技有限公司 Frame rate conversion method and device based on single cache mode
CN116055623A (en) * 2022-06-23 2023-05-02 荣耀终端有限公司 Power consumption control method and electronic equipment
CN116915933A (en) * 2023-09-11 2023-10-20 苏州视达讯远电子科技有限公司 Synchronous imaging driving display system based on subway LCD display screen

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106933327A (en) * 2017-03-10 2017-07-07 广东欧珀移动通信有限公司 A kind of control method of mobile terminal frame per second, device and mobile terminal
CN109640168A (en) * 2018-11-27 2019-04-16 Oppo广东移动通信有限公司 Method for processing video frequency, device, electronic equipment and computer-readable medium
CN110377251A (en) * 2019-06-06 2019-10-25 努比亚技术有限公司 A kind of screen refresh rate method of adjustment, terminal and computer readable storage medium
CN110892405A (en) * 2018-03-31 2020-03-17 华为技术有限公司 Image display method and terminal
CN110928396A (en) * 2019-11-18 2020-03-27 Oppo(重庆)智能科技有限公司 Screen refreshing method and related equipment
CN111583886A (en) * 2020-04-29 2020-08-25 珠海市魅族科技有限公司 Screen refresh rate adjusting method, device, equipment and medium
CN111899680A (en) * 2020-07-14 2020-11-06 青岛海信医疗设备股份有限公司 Display device and setting method thereof
CN112256223A (en) * 2020-10-20 2021-01-22 北京字节跳动网络技术有限公司 Display fluency adjusting method and device and electronic equipment
CN112331145A (en) * 2020-11-17 2021-02-05 Oppo广东移动通信有限公司 Display screen frequency conversion method, DDIC chip, display screen module and terminal
CN112394896A (en) * 2020-11-18 2021-02-23 努比亚技术有限公司 Method and device for controlling reverse screen projection frame rate and computer readable storage medium
CN113064573A (en) * 2021-03-31 2021-07-02 联想(北京)有限公司 Information processing method
CN113144594A (en) * 2021-04-20 2021-07-23 努比亚技术有限公司 Screen display control method and device, mobile terminal and readable storage medium
CN113362783A (en) * 2020-03-06 2021-09-07 华为技术有限公司 Refresh rate switching method and electronic equipment

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106933327A (en) * 2017-03-10 2017-07-07 广东欧珀移动通信有限公司 A kind of control method of mobile terminal frame per second, device and mobile terminal
CN110892405A (en) * 2018-03-31 2020-03-17 华为技术有限公司 Image display method and terminal
CN109640168A (en) * 2018-11-27 2019-04-16 Oppo广东移动通信有限公司 Method for processing video frequency, device, electronic equipment and computer-readable medium
CN110377251A (en) * 2019-06-06 2019-10-25 努比亚技术有限公司 A kind of screen refresh rate method of adjustment, terminal and computer readable storage medium
CN110928396A (en) * 2019-11-18 2020-03-27 Oppo(重庆)智能科技有限公司 Screen refreshing method and related equipment
CN113362783A (en) * 2020-03-06 2021-09-07 华为技术有限公司 Refresh rate switching method and electronic equipment
WO2021175213A1 (en) * 2020-03-06 2021-09-10 华为技术有限公司 Refresh rate switching method and electronic device
CN111583886A (en) * 2020-04-29 2020-08-25 珠海市魅族科技有限公司 Screen refresh rate adjusting method, device, equipment and medium
CN111899680A (en) * 2020-07-14 2020-11-06 青岛海信医疗设备股份有限公司 Display device and setting method thereof
CN112256223A (en) * 2020-10-20 2021-01-22 北京字节跳动网络技术有限公司 Display fluency adjusting method and device and electronic equipment
CN112331145A (en) * 2020-11-17 2021-02-05 Oppo广东移动通信有限公司 Display screen frequency conversion method, DDIC chip, display screen module and terminal
CN112394896A (en) * 2020-11-18 2021-02-23 努比亚技术有限公司 Method and device for controlling reverse screen projection frame rate and computer readable storage medium
CN113064573A (en) * 2021-03-31 2021-07-02 联想(北京)有限公司 Information processing method
CN113144594A (en) * 2021-04-20 2021-07-23 努比亚技术有限公司 Screen display control method and device, mobile terminal and readable storage medium

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114724528A (en) * 2022-04-02 2022-07-08 深圳创维-Rgb电子有限公司 Display control method and device of display equipment, electronic equipment and storage medium
CN114724528B (en) * 2022-04-02 2024-03-22 深圳创维-Rgb电子有限公司 Display control method and device of display device, electronic device and storage medium
CN115019749A (en) * 2022-06-07 2022-09-06 福建华佳彩有限公司 Panel display system capable of automatically and dynamically adjusting refresh rate
CN116055623A (en) * 2022-06-23 2023-05-02 荣耀终端有限公司 Power consumption control method and electronic equipment
CN116055623B (en) * 2022-06-23 2023-11-03 荣耀终端有限公司 Power consumption control method, electronic equipment and storage medium
CN115831074A (en) * 2023-02-20 2023-03-21 深圳曦华科技有限公司 Frame rate conversion method and device based on single cache mode
CN116915933A (en) * 2023-09-11 2023-10-20 苏州视达讯远电子科技有限公司 Synchronous imaging driving display system based on subway LCD display screen
CN116915933B (en) * 2023-09-11 2023-11-28 苏州视达讯远电子科技有限公司 Synchronous imaging driving display system based on subway LCD display screen

Also Published As

Publication number Publication date
CN114071047B (en) 2023-08-29

Similar Documents

Publication Publication Date Title
CN114071047A (en) Frame rate control method and related device
JP5324411B2 (en) Advertisement distribution apparatus, method and program
CN108646906B (en) Frame rate adjusting method and device, storage medium and intelligent terminal
CN108762652B (en) Display control method and device of intelligent terminal, storage medium and intelligent terminal
CN113377485B (en) Refreshing display method of ink screen device, electronic device and storage medium
CN105205014A (en) Data storage method and device
CN110020300B (en) Browser page synthesis method and terminal
CN108710478B (en) Display screen control method and device, storage medium and intelligent terminal
KR101997776B1 (en) Method for reducing for consumption power of display unit and an electronic device thereof
CN108696767B (en) Barrage playing method and device, computer readable storage medium and terminal
KR20140039068A (en) Displaying static images
CN101202033A (en) System, method and computer program product for adjusting a refresh rate of a display
CN108648259B (en) Image drawing method and device, storage medium and intelligent terminal
CN106982388B (en) Picture display method and device
US11907164B2 (en) File loading method and apparatus, electronic device, and storage medium
CN108733193B (en) Method and device for intelligently adjusting frame rate, storage medium and intelligent terminal
WO2017202175A1 (en) Method and device for video compression and electronic device
CN113781949A (en) Image display method, DDIC, display screen module and terminal
JP5563703B2 (en) Content distribution apparatus, content distribution method, content distribution program, and terminal program
CN112416231B (en) Scroll bar display method and device, electronic equipment and readable storage medium
JP6339550B2 (en) Terminal program, terminal device, and terminal control method
CN105808629B (en) Webpage processing method and device
CN110688037A (en) Control display method, storage medium and mobile terminal
US8788965B2 (en) Method and device for displaying data by adjusting the size of controls
CN114090168A (en) Self-adaptive adjusting method for image output window of QEMU (QEMU virtual machine)

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant