CN107622234B - Method and device for displaying budding face gift - Google Patents
Method and device for displaying budding face gift Download PDFInfo
- Publication number
- CN107622234B CN107622234B CN201710815273.5A CN201710815273A CN107622234B CN 107622234 B CN107622234 B CN 107622234B CN 201710815273 A CN201710815273 A CN 201710815273A CN 107622234 B CN107622234 B CN 107622234B
- Authority
- CN
- China
- Prior art keywords
- frame rate
- budding
- face
- gift
- live broadcast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the invention discloses a method and a device for displaying a budding face gift, and belongs to the technical field of internet. The method comprises the following steps: when the fact that a target live broadcast room enters a non-budding gift display stage is detected, carrying out face recognition on image frames in a live broadcast video corresponding to the target live broadcast room according to a preset first frame rate; when detecting that a target live broadcast room enters an budding face gift display stage of a target budding face gift, determining a second frame rate suitable for the budding face gift display stage; sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate; when an image frame is obtained, carrying out face recognition on the obtained image frame to obtain a face recognition result corresponding to the image frame after face recognition, and displaying the target budding gift according to the obtained face recognition result, wherein the first frame rate is lower than the second frame rate. By adopting the invention, the terminal can be prevented from generating the jamming phenomenon.
Description
Technical Field
The invention relates to the technical field of internet, in particular to a method and a device for displaying a budding face gift.
Background
With the development of electronic technology and internet technology, terminals such as mobile phones and computers are widely used, and the types of application programs on the corresponding terminals are more and more, and the functions are more and more abundant. A live application is a very common application. Spectator watches the in-process of the performance of certain anchor through live type application, can send the budding face gift to the anchor, for example, can send the gift of cat ear.
At present, when the terminal of anchor received and sprouts face gift and send the present notice, can download this and sprout face gift to can combine the people's face to show it, for example, sprout face gift and be cat ear, the terminal of anchor received and sprouts face gift and send the present notice back, can show cat ear in the eyebrow top of anchor. In order to display a budding gift in combination with a face, the terminal often performs face recognition. Specifically, when the terminal detected live broadcast video, can obtain the image frame in the live broadcast video with higher frame rate of predetermineeing promptly to carry out face identification to image frame, receive to sprout face gift and send the present notice and want the show to sprout face gift (present live broadcast room entering show that sprouts face gift stage promptly), the terminal can combine the face identification result, shows and sprouts face gift.
In the process of implementing the invention, the inventor finds that the prior art has at least the following problems:
based on the above processing manner, as long as the terminal detects the live video, the image frame is always subjected to face recognition at a higher preset frame rate, and the face recognition often occupies more CPU (Central processing unit) resources, thereby causing a stuck phenomenon at the terminal.
Disclosure of Invention
In order to solve the problem that a terminal in the related art generates a stuck phenomenon, the embodiment of the invention provides a method and a device for displaying a budding face gift. The technical scheme is as follows:
in a first aspect, there is provided a method of displaying a budding face gift, the method comprising:
when the fact that a target live broadcast room enters a non-budding gift display stage is detected, carrying out face recognition on image frames in a live broadcast video corresponding to the target live broadcast room according to a preset first frame rate;
when detecting that a target live broadcast room enters an budding face gift display stage of a target budding face gift, determining a second frame rate suitable for the budding face gift display stage;
sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate;
when an image frame is obtained, carrying out face recognition on the obtained image frame to obtain a face recognition result corresponding to the image frame after face recognition, and displaying the target budding gift according to the obtained face recognition result, wherein the first frame rate is lower than the second frame rate.
Optionally, when detecting that the target live broadcast room gets into the face gift show stage of sprouting to the target face gift, confirm to be applicable to sprout the second frame rate in face gift show stage, include:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the current terminal state information does not meet a preset historical optimal frame rate selection condition, a preset second frame rate suitable for the budding face gift display stage is obtained;
and if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
Optionally, when detecting that the target live broadcast room gets into the budding face gift display stage of budding the face gift to the target, if current terminal state information does not satisfy the condition of selecting of the best frame rate of predetermined history, then acquire predetermined being applicable to the second frame rate of the budding face gift display stage includes:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the CPU occupancy rate of a current terminal is smaller than a preset threshold value, a preset second frame rate suitable for the budding face gift display stage is obtained;
if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage, and including:
and if the CPU occupancy rate of the current terminal is greater than or equal to a preset threshold value, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
Optionally, the method further includes:
and in the process of acquiring the image frames according to the second frame rate, when a pause phenomenon is detected, sequentially acquiring the image frames in the live video corresponding to the target live broadcast room according to a preset third frame rate, wherein the third frame rate is less than the second frame rate.
Optionally, when detecting that the target live broadcast room enters the non-budding face gift display stage, according to a preset first frame rate, the image frames in the live broadcast video corresponding to the target live broadcast room are subjected to face recognition, including:
when the fact that the target live broadcast room enters the face gift preparation stage is detected, face recognition is conducted on image frames in live broadcast videos corresponding to the target live broadcast room according to a preset first frame rate.
Optionally, the method further includes:
when the target live broadcast room is detected to enter the budding gift idle stage, carrying out face recognition on image frames in the live broadcast video corresponding to the target live broadcast room according to a preset fourth frame rate, wherein the fourth frame rate is smaller than the first frame rate.
In a second aspect, there is provided a device for displaying an emergent face gift, the device comprising:
the identification module is used for carrying out face identification on image frames in a live broadcast video corresponding to the target live broadcast room according to a preset first frame rate when the target live broadcast room is detected to enter a non-budding gift display stage;
the determining module is used for determining a second frame rate suitable for the budding face gift display stage when the fact that the target live broadcast room enters the budding face gift display stage of the target budding face gift is detected;
the acquisition module is used for sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate;
and the display module is used for carrying out face recognition on the acquired image frames when the image frames are acquired, obtaining face recognition results corresponding to the image frames after the face recognition, and displaying the target budding gift according to the obtained face recognition results, wherein the first frame rate is less than the second frame rate.
Optionally, the determining module is configured to:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the current terminal state information does not meet a preset historical optimal frame rate selection condition, a preset second frame rate suitable for the budding face gift display stage is obtained;
and if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
Optionally, the determining module is configured to:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the CPU occupancy rate of a current terminal is smaller than a preset threshold value, a preset second frame rate suitable for the budding face gift display stage is obtained;
and if the CPU occupancy rate of the current terminal is greater than or equal to a preset threshold value, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
Optionally, the apparatus further comprises:
and the adjusting module is used for sequentially acquiring the image frames in the live video corresponding to the target live broadcast room according to a preset third frame rate when a pause phenomenon is detected in the process of acquiring the image frames according to the second frame rate, wherein the third frame rate is less than the second frame rate.
Optionally, the identification module is configured to:
when the fact that the target live broadcast room enters the face gift preparation stage is detected, face recognition is conducted on image frames in live broadcast videos corresponding to the target live broadcast room according to a preset first frame rate.
Optionally, the identification module is further configured to:
when the target live broadcast room is detected to enter the budding gift idle stage, carrying out face recognition on image frames in the live broadcast video corresponding to the target live broadcast room according to a preset fourth frame rate, wherein the fourth frame rate is smaller than the first frame rate.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, when the target live broadcast room is detected to enter a non-budding gift display stage, the image frames in the live broadcast video corresponding to the target live broadcast room are subjected to face recognition according to a preset first frame rate; when the fact that the target live broadcast room enters an emergent face gift display stage of the target emergent face gift is detected, determining a second frame rate suitable for the emergent face gift display stage; sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate; and when an image frame is obtained, carrying out face recognition on the obtained image frame to obtain a face recognition result corresponding to the image frame after face recognition, and displaying a target budding gift according to the obtained face recognition result, wherein the first frame rate is less than the second frame rate. Like this, the terminal can carry out face identification to image frame with lower frame rate when the non-shows of face gift stage of sprouting, and then, can reduce the CPU resource that whole live in-process face identification occupy to, can prevent that the terminal from appearing the card phenomenon of pause.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of a method for displaying a budding gift according to an embodiment of the present invention;
FIG. 2 is a diagram of a frame rate according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a device for displaying a budding gift according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a device for displaying a budding gift according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
The embodiment of the invention provides a method for displaying a budding face gift. The terminal may be a terminal with a live broadcast function, such as a mobile phone or a personal computer with a live broadcast application installed therein, and the terminal may be a main broadcast terminal.
The terminal may include components such as a processor, memory, screen, etc. The processor can be a CPU and the like, and can be used for carrying out face recognition related processing on image frames in the live video according to a certain frame rate. The Memory may be a RAM (random access Memory), a Flash (Flash Memory), or the like, and may be configured to store received data, data required by a processing procedure, data generated in the processing procedure, or the like, such as a preset frame rate. The screen can be the touch-control screen, can be used for showing live broadcast video and sprouting face gift etc. can also be used for detecting touch signal etc.. The terminal may further include a transceiver, an image detection part, an audio output part, an audio input part, and the like. The transceiver may be used for data transmission with other devices, for example, to receive a gift-taking notice of the face gift sent by the server, which may include an antenna, matching circuit, modem, etc. The image detection means may be a camera or the like. The audio output component may be a speaker, headphones, or the like. The audio input means may be a microphone or the like.
The process flow shown in fig. 1 will be described in detail below with reference to specific embodiments, and the contents may be as follows:
The non-budding gift display stage may be a stage in which a budding gift is not displayed, and the frame rate may be a preset number of image frames for face recognition per second.
In implementation, a live application program can be installed in the terminal, and when the anchor program wants to perform live broadcasting through the live application program, the anchor program can trigger the terminal to display a live interface corresponding to a live broadcasting room (which can be called a target live broadcasting room) through operation, and can trigger the terminal to start a camera and a microphone and record live video. Audience of the target live broadcast room can watch live broadcast video of the main broadcast, and the audience can send a lovely face gift to the main broadcast in the process of watching the live broadcast video. In order to combine with the face to display the budding face gift sent by the audience, the terminal can track the face in the live broadcasting process of the anchor, namely, the face recognition can be carried out on the image frames in the live broadcasting video in real time. Correspondingly, the terminal can detect the current stage of locating of the live broadcast room of target in real time, when detecting that the live broadcast room of target gets into the non-face gift display stage of sprouting, the terminal can acquire the frame rate (can be called first frame rate) that is used for carrying out face identification to the image frame in the live broadcast video that predetermines, and then, be in the non-in-process that sprouts face gift display stage at the live broadcast room of target, the terminal can be according to predetermined first frame rate, acquire the image frame in the live broadcast video that the camera was gathered, and carry out face identification to every frame image frame that acquires, so that can follow the face. For example, the first frame rate is 5 frames/second, when the target live broadcast room is in the non-face-budding gift display stage, the terminal may acquire image frames at the frame rate of 5 frames per second, and after acquiring each image frame, the terminal may perform face recognition on the acquired image frame.
Optionally, the non-budding gift display stage may be a budding gift preparation stage, and accordingly, the processing procedure of step 101 may be as follows: when the fact that the target live broadcast room enters the face gift preparation stage is detected, face recognition is conducted on image frames in the live broadcast video corresponding to the target live broadcast room according to a preset first frame rate.
The preparation phase of the budding face gift can be a time period from the beginning of receiving the notification of the budding face gift to the display of the budding face gift.
In the implementation, spectator sends the back of sprouting face gift (can be called the target and sprouts face gift) to the anchor, the server can send the sprouting face gift that corresponds the target and sprout face gift and send the gift notice to the terminal of anchor, it is corresponding, the terminal can receive the sprouting face gift that the server sent and send the gift notice, at this moment, the terminal can detect the target and directly broadcast the room and get into and sprout face gift and prepare the stage, and then, sprouting face gift prepares the stage, the terminal can be according to predetermined first frame rate, the image frame in the live broadcast video that the target directly broadcast room that the camera was gathered corresponds carries out face identification. In addition, the terminal receives and sprouts face gift and send the present notice after, can sprout face gift to the target that the server download corresponds (for example, viewer's cat ear when sprouting face gift, then the terminal can download picture or the animation of cat ear to the server), wherein, all belong to and sprout face gift and prepare the stage until showing the time quantum before the target sprouts face gift.
Optionally, in the idle stage of the face gift, the terminal may also perform face recognition on the image frame in the live video, and correspondingly, the terminal may further perform the following processing: when the target live broadcast room is detected to enter the budding gift idle stage, carrying out face recognition on image frames in the live broadcast video corresponding to the target live broadcast room according to a preset fourth frame rate, wherein the fourth frame rate is smaller than the first frame rate.
The budding face gift idle stage can be a time period from the end of the current display of the budding face gift to the next reception of a notification of the budding face gift delivery.
In an implementation, when the terminal detects that the target live broadcast room enters the budding gift idle stage, a preset frame rate (which may be referred to as a fourth frame rate) for performing face recognition on image frames in the live broadcast video in the budding gift idle stage may be obtained, where the fourth frame rate is less than the first frame rate, as shown in fig. 2. After the fourth frame rate is obtained, in the idle stage of the face gift in the bud, the terminal can obtain the image frames in the live broadcast video according to the fourth frame rate, and further can perform face recognition on the obtained image frames to obtain the face recognition result of each image frame. That is to say, in the embodiment of the present invention, when the target live broadcast room enters the budding gift idle stage, the terminal may perform face recognition on the image frames in the live broadcast video at a lower fourth frame rate to track the face, and when the target live broadcast room enters the budding gift preparation stage, the terminal may perform face recognition on the image frames in the live broadcast video at a slightly higher first frame rate to better track the face. At non-budding face gift show stage, keep carrying out face identification to the image frame in the direct broadcast video, can trail the people's face in real time, can determine the region at people's face place to when will show the budding face gift, when preventing that the phenomenon of face identification failure from appearing, can improve face identification's rate.
In the implementation, after spectator sent the target to the anchor and sprouts face gift, the terminal can receive and sprout face gift of face gift and send the present notice to the target, and then, can sprout face gift and download to the target, after the download, the terminal can sprout face gift to the target and show, and at this moment, the terminal will detect the target live room and get into and sprout the face gift show stage of sprouting of face gift to the target, and then, the terminal can confirm the second frame rate that is applicable to the face gift show stage of sprouting.
Optionally, the second frame rate may be preset, or may be a historical optimal frame rate, and accordingly, the processing procedure in step 102 may be as follows: when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the current terminal state information does not meet a preset historical optimal frame rate selection condition, a preset second frame rate suitable for the budding face gift display stage is obtained; and if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as a second frame rate suitable for the emergent gift display stage.
The historical optimal frame rate selection condition may be a condition for judging whether to select the historical optimal frame rate currently according to the current terminal state information, and the historical optimal frame rate may be obtained by the terminal through statistics according to the use condition of the historical frame rate. The current terminal state information may be information for reflecting the current state of the terminal, such as CPU occupancy, or the number of times of displaying the budding gift this time (for example, the 100 th display of the budding gift this time).
In implementation, the terminal may be preset with a historical optimal frame rate selection condition. When the fact that the target live broadcast room enters an budding face gift display stage of the target budding face gift is detected, the terminal can obtain current terminal state information, further, whether the current terminal state information meets a historical optimal frame rate selection condition or not can be judged, and if the current terminal state information does not meet the preset historical optimal frame rate selection condition, a preset second frame rate suitable for the budding face gift display stage is obtained; and if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as a second frame rate suitable for the emergent gift display stage. For example, the preset historical optimal frame rate selection condition is that the historical optimal frame rate is selected when the budding gift is displayed 101 to 150 times and 201 to 250 times … times, and if the current terminal state information is that the budding gift is displayed 120 times, the terminal may determine that the current terminal state information satisfies the historical optimal frame rate selection condition, and at this time, the terminal may determine the predetermined historical optimal frame rate as the second frame rate suitable for the budding gift display stage. If the current terminal state information is that the 170 th display of the budding face gift is performed, the terminal can judge that the current terminal state information does not meet the historical optimal frame rate selection condition, and at the moment, the terminal can acquire a preset second frame rate suitable for the budding face gift display stage.
Optionally, the historical optimal frame rate selection condition may be a CPU occupancy rate, and accordingly, the specific processing procedure may be as follows: when the fact that the target live broadcast room enters an emergent face gift display stage of the target emergent face gift is detected, if the CPU occupancy rate of the current terminal is smaller than a preset threshold value, a preset second frame rate suitable for the emergent face gift display stage is obtained; and if the CPU occupancy rate of the current terminal is greater than or equal to the preset threshold value, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
In implementation, when the fact that the target live broadcast room enters the stage of displaying the budding face gift of the target budding face gift is detected, the terminal can obtain the CPU occupancy rate of the current terminal, and then the CPU occupancy rate of the current terminal can be compared with a preset threshold value, and if the CPU occupancy rate of the current terminal is smaller than the preset threshold value, a preset second frame rate suitable for the stage of displaying the budding face gift is obtained; if the CPU occupancy rate of the current terminal is greater than or equal to the preset threshold value, the predetermined historical optimal frame rate can be determined as a second frame rate suitable for the emerging face gift display stage, wherein the historical optimal frame rate is less than the preset frame rate suitable for the emerging face gift display stage.
And 103, sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate.
In implementation, after the terminal acquires the second frame rate, in the process that the target live broadcast room is in the budding gift display stage, the terminal can sequentially acquire the image frames in the live broadcast video acquired by the camera according to the preset second frame rate. For example, if the second frame rate is 8 frames/second, the terminal may acquire the image frames at the frame rate of 8 frames per second during the face gift display stage of the target live broadcast.
Optionally, in the process of acquiring the image frames at the second frame rate, in some cases, the terminal may further perform speed reduction processing, and correspondingly, the terminal may further perform the following processing: and in the process of acquiring the image frames according to the second frame rate, when the phenomenon of pause is detected, sequentially acquiring the image frames in the live video corresponding to the target live broadcast room according to a preset third frame rate, wherein the third frame rate is less than the second frame rate.
In implementation, in the process of acquiring the image frames in the live video according to the second frame rate, the terminal may further detect whether a pause phenomenon occurs in the terminal in real time, and when the pause phenomenon is detected, the terminal may reduce the preset frame rate on the basis of the second frame rate to obtain a third frame rate, and further may sequentially acquire the image frames in the live video corresponding to the target live broadcast room according to the obtained third frame rate. In addition, when the image frame is still detected to be jammed in the process of acquiring the image frame according to the third frame rate, the terminal may further reduce the preset frame rate on the basis of the third frame rate, and further, may acquire the image frame according to the reduced third frame rate, and so on until the minimum frame rate is reduced.
In addition, when it is detected that the display of the target budding face gift is finished, the terminal may acquire and record the frame rate that is adopted at the end of the budding face gift display period, and when the number of the recorded historically used frame rates reaches a preset number threshold, the terminal may determine a historically optimal frame rate among the previously recorded historically used frame rates, for example, the frame rate that occurs the most frequently may be determined as the historically optimal frame rate.
And 104, when an image frame is obtained, carrying out face recognition on the obtained image frame to obtain a face recognition result corresponding to the image frame after face recognition, and displaying a target budding gift according to the obtained face recognition result, wherein the first frame rate is less than the second frame rate.
In implementation, when the terminal acquires the image frame according to the second frame rate, the terminal can perform face recognition on the acquired image frame to obtain a face recognition result corresponding to the image frame, namely the face recognition result corresponding to the image frame after face recognition, and further can display the target budding gift according to the obtained face recognition result. For example, the face recognition result is the position of five sense organs in the image frame, and the target budding face gift is the cat ear, wherein, the relative position that the cat ear corresponds is 3 centimetres above the eyebrow, then the terminal can determine the display position of target budding face gift in the image frame.
In the embodiment of the invention, when the target live broadcast room is detected to enter a non-budding gift display stage, the image frames in the live broadcast video corresponding to the target live broadcast room are subjected to face recognition according to a preset first frame rate; when the fact that the target live broadcast room enters an emergent face gift display stage of the target emergent face gift is detected, determining a second frame rate suitable for the emergent face gift display stage; sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate; and when an image frame is obtained, carrying out face recognition on the obtained image frame to obtain a face recognition result corresponding to the image frame after face recognition, and displaying a target budding gift according to the obtained face recognition result, wherein the first frame rate is less than the second frame rate. Like this, the terminal can carry out face identification to image frame with lower frame rate when the non-shows of face gift stage of sprouting, and then, can reduce the CPU resource that whole live in-process face identification occupy to, can prevent that the terminal from appearing the card phenomenon of pause.
Based on the same technical concept, an embodiment of the present invention further provides a device for displaying a budding face gift, as shown in fig. 3, the device includes:
the identification module 310 is configured to, when it is detected that a target live broadcast room enters a non-budding gift display stage, perform face identification on an image frame in a live broadcast video corresponding to the target live broadcast room according to a preset first frame rate;
a determining module 320, configured to determine a second frame rate applicable to a stage of displaying a target budding gift when it is detected that the target live broadcast room enters the stage of displaying the target budding gift;
an obtaining module 330, configured to sequentially obtain, according to the second frame rate, image frames in a live video corresponding to the target live broadcast room;
the display module 340 is configured to perform face recognition on the acquired image frames each time the image frames are acquired, obtain face recognition results corresponding to the image frames after face recognition, and display the target budding gift according to the obtained face recognition results, where the first frame rate is less than the second frame rate.
Optionally, the determining module 320 is configured to:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the current terminal state information does not meet a preset historical optimal frame rate selection condition, a preset second frame rate suitable for the budding face gift display stage is obtained;
and if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
Optionally, the determining module 320 is configured to:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the CPU occupancy rate of a current terminal is smaller than a preset threshold value, a preset second frame rate suitable for the budding face gift display stage is obtained;
and if the CPU occupancy rate of the current terminal is greater than or equal to a preset threshold value, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
Optionally, as shown in fig. 4, the apparatus further includes:
and an adjusting module 350, configured to, in the process of obtaining image frames according to the second frame rate, when a pause phenomenon is detected, sequentially obtain image frames in a live video corresponding to the target live broadcast room according to a preset third frame rate, where the third frame rate is less than the second frame rate.
Optionally, the identifying module 310 is configured to:
when the fact that the target live broadcast room enters the face gift preparation stage is detected, face recognition is conducted on image frames in live broadcast videos corresponding to the target live broadcast room according to a preset first frame rate.
Optionally, the identifying module 310 is further configured to:
when the target live broadcast room is detected to enter the budding gift idle stage, carrying out face recognition on image frames in the live broadcast video corresponding to the target live broadcast room according to a preset fourth frame rate, wherein the fourth frame rate is smaller than the first frame rate.
In the embodiment of the invention, when the target live broadcast room is detected to enter a non-budding gift display stage, the image frames in the live broadcast video corresponding to the target live broadcast room are subjected to face recognition according to a preset first frame rate; when the fact that the target live broadcast room enters an emergent face gift display stage of the target emergent face gift is detected, determining a second frame rate suitable for the emergent face gift display stage; sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate; and when an image frame is obtained, carrying out face recognition on the obtained image frame to obtain a face recognition result corresponding to the image frame after face recognition, and displaying a target budding gift according to the obtained face recognition result, wherein the first frame rate is less than the second frame rate. Like this, the terminal can carry out face identification to image frame with lower frame rate when the non-shows of face gift stage of sprouting, and then, can reduce the CPU resource that whole live in-process face identification occupy to, can prevent that the terminal from appearing the card phenomenon of pause.
It should be noted that: the device of the face gift is sprouted in demonstration that above-mentioned embodiment provided only exemplifies with the division of above-mentioned each functional module when the face gift is sprouted in the demonstration, and in practical application, can accomplish by different functional modules with above-mentioned function distribution as required, be about to divide into different functional modules the inner structure at terminal to accomplish above-mentioned description all or partial function. In addition, the device for displaying the budding face gift provided by the embodiment and the method for displaying the budding face gift provided by the embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment and is not described again.
Referring to fig. 5, a schematic structural diagram of a terminal according to an embodiment of the present invention is shown, where the terminal may be used to implement the method for displaying a lovely face gift provided in the foregoing embodiment. Specifically, the method comprises the following steps:
the terminal 500 may include RF (Radio Frequency) circuitry 110, memory 120 including one or more computer-readable storage media, an input unit 130, a display unit 140, a sensor 150, audio circuitry 160, a WiFi (wireless fidelity) module 170, a processor 180 including one or more processing cores, and a power supply 190. Those skilled in the art will appreciate that the terminal structure shown in fig. 5 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the RF circuit 110 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, receives downlink information from a base station and then sends the received downlink information to the one or more processors 180 for processing; in addition, data relating to uplink is transmitted to the base station. In general, the RF circuitry 110 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, the RF circuitry 110 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (short messaging Service), etc.
The memory 120 may be used to store software programs and modules, and the processor 180 executes various functional applications and data processing by operating the software programs and modules stored in the memory 120. The memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the terminal 500, and the like. Further, the memory 120 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 120 may further include a memory controller to provide the processor 180 and the input unit 130 with access to the memory 120.
The input unit 130 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input unit 130 may include a touch-sensitive surface 131 as well as other input devices 132. The touch-sensitive surface 131, also referred to as a touch display screen or a touch pad, may collect touch operations by a user on or near the touch-sensitive surface 131 (e.g., operations by a user on or near the touch-sensitive surface 131 using a finger, a stylus, or any other suitable object or attachment), and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface 131 may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 180, and can receive and execute commands sent by the processor 180. Additionally, the touch-sensitive surface 131 may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface 131, the input unit 130 may also include other input devices 132. In particular, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 140 may be used to display information input by or provided to a user and various graphical user interfaces of the terminal 500, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 140 may include a Display panel 141, and optionally, the Display panel 141 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface 131 may cover the display panel 141, and when a touch operation is detected on or near the touch-sensitive surface 131, the touch operation is transmitted to the processor 180 to determine the type of the touch event, and then the processor 180 provides a corresponding visual output on the display panel 141 according to the type of the touch event. Although in FIG. 5, touch-sensitive surface 131 and display panel 141 are shown as two separate components to implement input and output functions, in some embodiments, touch-sensitive surface 131 may be integrated with display panel 141 to implement input and output functions.
The terminal 500 can also include at least one sensor 150, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 141 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 141 and/or a backlight when the terminal 500 is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal 500, detailed descriptions thereof are omitted.
WiFi belongs to a short-distance wireless transmission technology, and the terminal 500 can help a user send and receive e-mails, browse web pages, access streaming media, and the like through the WiFi module 170, and it provides wireless broadband internet access for the user. Although fig. 5 shows the WiFi module 170, it is understood that it does not belong to the essential constitution of the terminal 500 and can be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 180 is a control center of the terminal 500, connects various parts of the entire handset using various interfaces and lines, and performs various functions of the terminal 500 and processes data by operating or executing software programs and/or modules stored in the memory 120 and calling data stored in the memory 120, thereby performing overall monitoring of the handset. Optionally, processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 180.
The terminal 500 further includes a power supply 190 (e.g., a battery) for supplying power to the various components, which may preferably be logically connected to the processor 180 via a power management system, such that functions of managing charging, discharging, and power consumption are performed via the power management system. The power supply 190 may also include any component including one or more of a dc or ac power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
Although not shown, the terminal 500 may further include a camera, a bluetooth module, etc., which will not be described herein. Specifically, in this embodiment, the display unit of the terminal 500 is a touch screen display, and the terminal 500 further includes a memory and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for:
when the fact that a target live broadcast room enters a non-budding gift display stage is detected, carrying out face recognition on image frames in a live broadcast video corresponding to the target live broadcast room according to a preset first frame rate;
when detecting that a target live broadcast room enters an budding face gift display stage of a target budding face gift, determining a second frame rate suitable for the budding face gift display stage;
sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate;
when an image frame is obtained, carrying out face recognition on the obtained image frame to obtain a face recognition result corresponding to the image frame after face recognition, and displaying the target budding gift according to the obtained face recognition result, wherein the first frame rate is lower than the second frame rate.
Optionally, when detecting that the target live broadcast room gets into the face gift show stage of sprouting to the target face gift, confirm to be applicable to sprout the second frame rate in face gift show stage, include:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the current terminal state information does not meet a preset historical optimal frame rate selection condition, a preset second frame rate suitable for the budding face gift display stage is obtained;
and if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
Optionally, when detecting that the target live broadcast room gets into the budding face gift display stage of budding the face gift to the target, if current terminal state information does not satisfy the condition of selecting of the best frame rate of predetermined history, then acquire predetermined being applicable to the second frame rate of the budding face gift display stage includes:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the CPU occupancy rate of a current terminal is smaller than a preset threshold value, a preset second frame rate suitable for the budding face gift display stage is obtained;
if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage, and including:
and if the CPU occupancy rate of the current terminal is greater than or equal to a preset threshold value, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
Optionally, the method further includes:
and in the process of acquiring the image frames according to the second frame rate, when a pause phenomenon is detected, sequentially acquiring the image frames in the live video corresponding to the target live broadcast room according to a preset third frame rate, wherein the third frame rate is less than the second frame rate.
Optionally, when detecting that the target live broadcast room enters the non-budding face gift display stage, according to a preset first frame rate, the image frames in the live broadcast video corresponding to the target live broadcast room are subjected to face recognition, including:
when the fact that the target live broadcast room enters the face gift preparation stage is detected, face recognition is conducted on image frames in live broadcast videos corresponding to the target live broadcast room according to a preset first frame rate.
Optionally, the method further includes:
when the target live broadcast room is detected to enter the budding gift idle stage, carrying out face recognition on image frames in the live broadcast video corresponding to the target live broadcast room according to a preset fourth frame rate, wherein the fourth frame rate is smaller than the first frame rate.
In the embodiment of the invention, when the target live broadcast room is detected to enter a non-budding gift display stage, the image frames in the live broadcast video corresponding to the target live broadcast room are subjected to face recognition according to a preset first frame rate; when the fact that the target live broadcast room enters an emergent face gift display stage of the target emergent face gift is detected, determining a second frame rate suitable for the emergent face gift display stage; sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate; and when an image frame is obtained, carrying out face recognition on the obtained image frame to obtain a face recognition result corresponding to the image frame after face recognition, and displaying a target budding gift according to the obtained face recognition result, wherein the first frame rate is less than the second frame rate. Like this, the terminal can carry out face identification to image frame with lower frame rate when the non-shows of face gift stage of sprouting, and then, can reduce the CPU resource that whole live in-process face identification occupy to, can prevent that the terminal from appearing the card phenomenon of pause.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (8)
1. A method of displaying a budding face gift, the method comprising:
when detecting that the target live broadcast room gets into the non-face gift show stage of sprouting, according to predetermined first frame rate, right image frame in the live broadcast video that the target live broadcast room corresponds carries out face identification, the non-face gift show stage of sprouting prepares the stage for the face gift of sprouting, the face gift of sprouting prepares the stage and includes: receiving a time period from the beginning of the budding face gift sending notice to the display of the budding face gift;
when detecting that a target live broadcast room enters an budding face gift display stage of a target budding face gift, determining a second frame rate suitable for the budding face gift display stage;
sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate;
when an image frame is obtained, carrying out face recognition on the obtained image frame to obtain a face recognition result corresponding to the image frame after face recognition, and displaying the target budding gift according to the obtained face recognition result, wherein the first frame rate is less than the second frame rate;
when detecting that the target live broadcast room gets into the face gift show stage of sprouting to the target, confirm to be applicable to sprout the second frame rate in face gift show stage, include:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the current terminal state information does not meet a preset historical optimal frame rate selection condition, a preset second frame rate suitable for the budding face gift display stage is obtained;
and if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as the second frame rate applicable to the budding face gift display stage, wherein the historical optimal frame rate is less than the preset second frame rate applicable to the budding face gift display stage.
2. The method of claim 1, wherein when it is detected that the target live broadcast room enters an budding face gift display stage for the target budding face gift, if the current terminal state information does not meet a preset historical optimal frame rate selection condition, acquiring a preset second frame rate applicable to the budding face gift display stage, including:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the CPU occupancy rate of a current terminal is smaller than a preset threshold value, a preset second frame rate suitable for the budding face gift display stage is obtained;
if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage, and including:
and if the CPU occupancy rate of the current terminal is greater than or equal to a preset threshold value, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
3. The method according to any one of claims 1-2, further comprising:
and in the process of acquiring the image frames according to the second frame rate, when a pause phenomenon is detected, sequentially acquiring the image frames in the live video corresponding to the target live broadcast room according to a preset third frame rate, wherein the third frame rate is less than the second frame rate.
4. The method of claim 1, further comprising:
when the target live broadcast room is detected to enter the budding gift idle stage, carrying out face recognition on image frames in the live broadcast video corresponding to the target live broadcast room according to a preset fourth frame rate, wherein the fourth frame rate is smaller than the first frame rate.
5. A device for displaying a budding face gift, the device comprising:
the recognition module is used for when detecting that the target live broadcast room gets into the non-face gift display stage of sprouting, according to predetermined first frame rate, right the image frame in the live broadcast video that the target live broadcast room corresponds carries out face identification, the non-face gift display stage of sprouting prepares the stage for the face gift of sprouting, the face gift of sprouting prepares the stage and includes: receiving a time period from the beginning of the budding face gift sending notice to the display of the budding face gift;
the determining module is used for determining a second frame rate suitable for the budding face gift display stage when the fact that the target live broadcast room enters the budding face gift display stage of the target budding face gift is detected;
the acquisition module is used for sequentially acquiring image frames in the live video corresponding to the target live broadcast room according to the second frame rate;
the display module is used for carrying out face recognition on the obtained image frames when the image frames are obtained every time, obtaining face recognition results corresponding to the image frames after face recognition, and displaying the target budding gift according to the obtained face recognition results, wherein the first frame rate is smaller than the second frame rate;
the determining module is configured to:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the current terminal state information does not meet a preset historical optimal frame rate selection condition, a preset second frame rate suitable for the budding face gift display stage is obtained;
and if the current terminal state information meets the historical optimal frame rate selection condition, determining the predetermined historical optimal frame rate as the second frame rate applicable to the budding face gift display stage, wherein the historical optimal frame rate is less than the preset second frame rate applicable to the budding face gift display stage.
6. The apparatus of claim 5, wherein the determining module is configured to:
when the fact that a target live broadcast room enters an budding face gift display stage of a target budding face gift is detected, if the CPU occupancy rate of a current terminal is smaller than a preset threshold value, a preset second frame rate suitable for the budding face gift display stage is obtained;
and if the CPU occupancy rate of the current terminal is greater than or equal to a preset threshold value, determining the predetermined historical optimal frame rate as a second frame rate suitable for the budding gift display stage.
7. The apparatus of any one of claims 5-6, further comprising:
and the adjusting module is used for sequentially acquiring the image frames in the live video corresponding to the target live broadcast room according to a preset third frame rate when a pause phenomenon is detected in the process of acquiring the image frames according to the second frame rate, wherein the third frame rate is less than the second frame rate.
8. The apparatus of claim 5, wherein the identification module is further configured to:
when the target live broadcast room is detected to enter the budding gift idle stage, carrying out face recognition on image frames in the live broadcast video corresponding to the target live broadcast room according to a preset fourth frame rate, wherein the fourth frame rate is smaller than the first frame rate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710815273.5A CN107622234B (en) | 2017-09-12 | 2017-09-12 | Method and device for displaying budding face gift |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710815273.5A CN107622234B (en) | 2017-09-12 | 2017-09-12 | Method and device for displaying budding face gift |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107622234A CN107622234A (en) | 2018-01-23 |
| CN107622234B true CN107622234B (en) | 2020-04-24 |
Family
ID=61089532
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710815273.5A Active CN107622234B (en) | 2017-09-12 | 2017-09-12 | Method and device for displaying budding face gift |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107622234B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769825B (en) * | 2018-06-21 | 2020-11-06 | 北京密境和风科技有限公司 | Method and device for realizing live broadcast |
| CN109191544A (en) * | 2018-08-21 | 2019-01-11 | 北京潘达互娱科技有限公司 | A kind of paster present methods of exhibiting, device, electronic equipment and storage medium |
| CN110933454B (en) * | 2019-12-06 | 2021-11-02 | 广州酷狗计算机科技有限公司 | Method, device, equipment and storage medium for processing live broadcast budding gift |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008135923A (en) * | 2006-11-28 | 2008-06-12 | Taiwan Mukojo Kagi Kofun Yugenkoshi | Production method of videos interacting in real time, video production device, and video production system |
| CN105898348A (en) * | 2015-12-15 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Method and device for reducing CPU temperature of video play terminal |
| CN106375841A (en) * | 2015-07-23 | 2017-02-01 | 阿里巴巴集团控股有限公司 | Wireless screen projection data processing method and device, video data display method and device, and electronic device |
| CN106412626A (en) * | 2016-10-31 | 2017-02-15 | 武汉斗鱼网络科技有限公司 | Live video processing method and device |
| CN107071580A (en) * | 2017-03-20 | 2017-08-18 | 北京潘达互娱科技有限公司 | Data processing method and device |
-
2017
- 2017-09-12 CN CN201710815273.5A patent/CN107622234B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008135923A (en) * | 2006-11-28 | 2008-06-12 | Taiwan Mukojo Kagi Kofun Yugenkoshi | Production method of videos interacting in real time, video production device, and video production system |
| CN106375841A (en) * | 2015-07-23 | 2017-02-01 | 阿里巴巴集团控股有限公司 | Wireless screen projection data processing method and device, video data display method and device, and electronic device |
| CN105898348A (en) * | 2015-12-15 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Method and device for reducing CPU temperature of video play terminal |
| CN106412626A (en) * | 2016-10-31 | 2017-02-15 | 武汉斗鱼网络科技有限公司 | Live video processing method and device |
| CN107071580A (en) * | 2017-03-20 | 2017-08-18 | 北京潘达互娱科技有限公司 | Data processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107622234A (en) | 2018-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106993227B (en) | Method and device for information display | |
| CN106686396B (en) | Method and system for switching live broadcast room | |
| CN106792120B (en) | Video picture display method and device and terminal | |
| CN107231159B (en) | Radio frequency interference processing method, device, storage medium and terminal | |
| CN106254910B (en) | Method and device for recording image | |
| CN106973330B (en) | Screen live broadcasting method, device and system | |
| US9431983B2 (en) | Volume adjusting method, volume adjusting apparatus and electronic device using the same | |
| CN106303733B (en) | Method and device for playing live special effect information | |
| CN107333162B (en) | Method and device for playing live video | |
| WO2014086218A1 (en) | Interface adjustment method, device and terminal | |
| WO2014201863A1 (en) | Volume adjusting method, volume adjusting apparatus and electronic device using the same | |
| CN106371964B (en) | Method and device for prompting message | |
| CN108933964B (en) | Bullet screen display method, playing device and control terminal | |
| CN105094501B (en) | Method, device and system for displaying messages in mobile terminal | |
| CN111371705B (en) | Download task execution method and electronic device | |
| CN106791916B (en) | Method, device and system for recommending audio data | |
| CN106101764A (en) | A kind of methods, devices and systems showing video data | |
| CN107622234B (en) | Method and device for displaying budding face gift | |
| WO2019076250A1 (en) | Push message management method and related products | |
| CN109495769B (en) | Video communication method, terminal, smart television, server and storage medium | |
| CN110930964B (en) | Display screen brightness adjusting method and device, storage medium and terminal | |
| CN112040324A (en) | Playing progress adjusting method and device, storage medium and terminal | |
| CN109660445B (en) | Message processing method, device and storage medium | |
| CN106302101B (en) | Message reminding method, terminal and server | |
| CN105513098B (en) | Image processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |