CN110149552A - A kind of processing method and terminal of video flowing frame data - Google Patents

A kind of processing method and terminal of video flowing frame data Download PDF

Info

Publication number
CN110149552A
CN110149552A CN201910381687.0A CN201910381687A CN110149552A CN 110149552 A CN110149552 A CN 110149552A CN 201910381687 A CN201910381687 A CN 201910381687A CN 110149552 A CN110149552 A CN 110149552A
Authority
CN
China
Prior art keywords
frame data
queue
terminal
stored
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910381687.0A
Other languages
Chinese (zh)
Inventor
包宇津
赵洪飞
骆何飞
梁泽华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Baidu Online Network Technology Beijing Co Ltd
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201910381687.0A priority Critical patent/CN110149552A/en
Publication of CN110149552A publication Critical patent/CN110149552A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Memory System Of A Hierarchy Structure (AREA)

Abstract

The present invention provides the processing method and terminal of a kind of video flowing frame data, this method comprises: in the case that the quantity of the frame data stored in the target cache of terminal is more than or equal to the first preset threshold, the first frame data obtained in first queue from terminal are stored to the second queue of terminal, wherein, first queue is used to receive the frame data of the video flowing of current shooting;In the case where being cached with frame data in detecting target instruction target word and second queue, the second frame data are obtained from second queue, wherein target instruction target word is the instruction that target cache requests frame data;Second frame data are stored into target cache and as frame data to be rendered.In this manner it is achieved that being kept in by the frame data that second queue will be unable to handle in time into second queue, the discarding to video flowing frame data is reduced, and then reduce the generation of video flowing frame losing phenomenon, promote video quality.

Description

A kind of processing method and terminal of video flowing frame data
Technical field
The present invention relates to technical field of video processing more particularly to a kind of processing methods and terminal of video flowing frame data.
Background technique
With the rapid development of Internet technology and video technique, people increasingly like through smart phone and plate Computer etc. shoots video, and the video of shooting is shared by the modes such as being broadcast live or forwarding, video sharing to people with Carry out better social experience.And during video capture, to promote video display effect, user may be in video capture mistake Some rendering processing are carried out to video flowing in journey, such as increase filter and paster effect.
At present during carrying out rendering processing to video flowing, usually first the frame data of the video flowing of acquisition will be deposited Storage is used as frame data to be rendered into video card caching, then treats render frame data and carry out rendering processing.But since video flowing obtains The asynchronous operation characteristic with Video Rendering operation is taken, the band render frame data in video card caching may not be able to carry out at rendering in time Reason will lead to the frame data stored in video card caching and excessively the phenomenon that video flowing frame losing occurs, i.e., fractional frame data is dropped, In this way, the video fluency eventually resulted in after the completion of processing reduces, and then reduce the video quality of shooting.
As it can be seen that existing and being led because video flowing frame losing occurs during carrying out rendering processing to the video flowing of shooting at present The problem of causing treated video quality to reduce.
Summary of the invention
The embodiment of the present invention provides the processing method and terminal of a kind of video flowing frame data, to solve at present to the view of shooting During frequency stream carries out rendering processing, have that the video quality that leads to that treated because video flowing frame losing occurs reduces is asked Topic.
To solve the above problems, the embodiments of the present invention are implemented as follows:
In a first aspect, it is applied to terminal the embodiment of the invention provides a kind of processing method of video flowing frame data, it is described First queue is used to receive the frame data of the video flowing of current shooting;Include:
The quantity of the frame data stored in the target cache of the terminal is more than or equal to the feelings of the first preset threshold Under condition, the first frame data obtained from the first queue of the terminal are stored to the second queue of the terminal, wherein institute State the frame data of video flowing of the first queue for receiving current shooting;
In the case where being cached with frame data in detecting target instruction target word and the second queue, from the second queue Obtain the second frame data, wherein the target instruction target word is the instruction that the target cache requests frame data;
Second frame data are stored into the target cache and as frame data to be rendered.
Second aspect, the embodiment of the invention also provides a kind of terminals, comprising:
The quantity of first memory module, the frame data for storing in the target cache of the terminal is more than or equal to In the case where first preset threshold, the first frame data obtained from the first queue of the terminal are stored to the terminal Second queue, wherein the first queue is used to receive the frame data of the video flowing of current shooting;
Frame data obtain module, the case where for being cached with frame data in detecting target instruction target word and the second queue Under, the second frame data are obtained from the second queue, wherein the target instruction target word is that the target cache requests frame data Instruction;
Second memory module, for storing second frame data into the target cache and as frame number to be rendered According to.
The third aspect, the embodiment of the invention also provides a kind of terminals, which is characterized in that including processor, memory and It is stored in the computer program that can be run on the memory and on the processor, the computer program is by the processing The step of device realizes the processing method of above-mentioned video flowing frame data when executing.
Fourth aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer Program, which is characterized in that the computer program realizes the processing method of above-mentioned video flowing frame data when being executed by processor Step.
The embodiment of the present invention is more than or equal to first by the quantity of the frame data stored in the target cache of terminal In the case where preset threshold, the first frame data obtained in the first queue from terminal are stored to the second queue of terminal;? It detects in the case where being cached with frame data in target instruction target word and second queue, the second frame data is obtained from second queue, In, target instruction target word is the instruction that target cache requests frame data;Second frame data are stored into target cache and as to wash with watercolours Contaminate frame data.In this manner it is achieved that being kept in by the frame data that second queue will be unable to handle in time into second queue, reduce Discarding to video flowing frame data, and then the generation of video flowing frame losing phenomenon is reduced, promote video quality.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, needed in being described below to the embodiment of the present invention Attached drawing to be used is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, For those of ordinary skill in the art, without any creative labor, it can also obtain according to these attached drawings Obtain other attached drawings.
Fig. 1 is the flow diagram of the processing method of video flowing frame data provided in an embodiment of the present invention;
Fig. 2 a is schematic illustration of the processing method in practical application of video flowing frame data provided in an embodiment of the present invention One of;
Fig. 2 b is schematic illustration of the processing method in practical application of video flowing frame data provided in an embodiment of the present invention Two;
Fig. 3 is one of the structural schematic diagram of terminal provided in an embodiment of the present invention;
Fig. 4 is one of the structural schematic diagram of the first memory module provided in an embodiment of the present invention;
Fig. 5 is the second structural representation of the first memory module provided in an embodiment of the present invention;
Fig. 6 is the second structural representation of terminal provided in an embodiment of the present invention;
Fig. 7 is the hardware structural diagram of terminal provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall within the protection scope of the present invention.
It is a kind of flow chart of the processing method of video flowing frame data provided in an embodiment of the present invention referring to Fig. 1, Fig. 1, answers For terminal, as shown in Figure 1, the processing method of video flowing frame data the following steps are included:
Step 101, the quantity of the frame data stored in the target cache of terminal are more than or equal to the first preset threshold In the case where, it by the first frame data obtained in the first queue from terminal and stores to the second queue of terminal, wherein first Queue is used to receive the frame data of the video flowing of current shooting;
Step 102, in the case where be cached with frame data in detecting target instruction target word and second queue, from second queue Obtain the second frame data, wherein target instruction target word is the instruction that target cache requests frame data;
Step 103 stores the second frame data into target cache and as frame data to be rendered.
Here, terminal can be more than or equal to certain threshold value (i.e. first in the quantity for the frame data that target cache stores Preset threshold) in the case where, the frame data obtained from first queue (i.e. the first frame data) are stored to second queue, and In the render process of video flowing, target cache preferentially takes out to be rendered number of the frame data as target cache from second queue According to can will be unable to handle in time by second queue thus under the premise of guaranteeing to handle the normal rendering of video flowing Frame data are kept in into second queue, reduce the discarding to video flowing frame data, and then reduce the generation of video flowing frame losing phenomenon, Promote video quality.
It should be noted that above-mentioned terminal can be any shooting video and carry out rendering processing to the video flowing of shooting Terminal, such as: mobile phone, tablet computer (Tablet Personal Computer), laptop computer (Laptop Computer), personal digital assistant (personal digital assistant, abbreviation PDA), mobile Internet access device (Mobile Internet Device, MID) or wearable device (Wearable Device) etc., can also be other ends End, such as digital camera, e-book, navigator.
In the embodiment of the present invention, it is provided with first queue in above-mentioned terminal, which shoots in the camera of terminal During video, when camera collects the frame data of video flowing, what first queue can be acquired with real-time reception camera Frame data are simultaneously stored.Wherein, which can be tandem queue, i.e. first queue can press received frame data It is cached according to time sequencing.
In above-mentioned steps 101, when terminal needs obtain the first frame data from first queue, terminal may determine that its mesh Whether the quantity that mark caches currently stored frame data is more than or equal to the first preset threshold, and is determining target cache storage Frame data quantity be more than or equal to the first preset threshold in the case where, the first frame data for will being obtained from first queue It stores to second queue, so as to which the frame data for failing to handle in time are temporarily stored in second queue, reduce frame data and lost A possibility that abandoning.
Wherein, above-mentioned terminal obtains the first frame data from first queue, can be the frame number stored in first queue According to quantity be more than or equal to certain predetermined threshold value or first queue and receive the instruction for taking out frame data when, eventually The first frame data are taken out from first queue in end.
Such as: in the case where first queue is tandem queue, the quantity of the frame data stored in first queue exceeds Its capacity 90% when, which can take out the frame data of oldest stored in tandem queue, i.e. the frame data of the taking-up be Above-mentioned first frame data.
In addition, above-mentioned target cache is the storage region in terminal for display, and picture is carried out at rendering in terminal When reason, frame data can be taken to carry out rendering processing from the target cache by render instruction, such as: it is provided in the terminal In the case where independent video card, above-mentioned target cache can be the storage region of video card, i.e. video card caches;Alternatively, making in terminal In the case where with integrated graphics card, above-mentioned target cache can be the partial memory area domain in the memory of occupied terminal.
It should be noted that above-mentioned first preset threshold can be, terminal is preset to be greater than zero and is less than or equal to target The value of the maximum capacity of caching, such as: in the case where above-mentioned first preset threshold is the maximum capacity of target cache, then when Target cache cannot again memory buffers data when, terminal can store the first frame data obtained from first queue to second Queue.
In the embodiment of the present invention, above-mentioned second queue is the difference and above-mentioned first queue and target cache being arranged in terminal Queue, specifically, which can be a round-robin queue, thereby may be ensured that frame data first are first handled, real The first in first out of existing frame data, avoids the wrong order of video frame.
In some embodiments, step 101, may include:
In the case that the quantity of the frame data stored in target cache is more than or equal to the first preset threshold, the is determined Whether the number of frames stored in two queues is less than the second preset threshold;
In the case that the quantity of the frame data stored in second queue is less than the second preset threshold, obtained from first queue The first frame data taken are stored to second queue.
Here, the quantity for the frame data that terminal can store in target cache is more than or equal to the first preset threshold , and in the case that the quantity of the frame data stored in second queue is less than the second preset threshold, it will be obtained from first queue The first frame data store to second queue, so as to the current amount of storage in second queue be more than certain threshold value when, keep away Exempt from terminal to continue to store frame data to second queue.
Certainly, the quantity of the frame data stored in above-mentioned target cache is more than or equal to the case where the first preset threshold Under, if terminal determines that the quantity of the frame data stored in second queue is more than or equal to the second preset threshold, terminal can be with The first frame data obtained from first queue are abandoned.
Alternatively, in some embodiments, the quantity of the above-mentioned frame data stored in target cache reaches the first default threshold In the case where value, after determining the number of frames stored in second queue less than the second preset threshold, further includes:
In the case that the number of frames stored in second queue is more than or equal to the second preset threshold, second queue is extended Memory capacity;
It will be in the second queue after the first frame data to expanding storage depth.
Here, the quantity for the frame data that terminal can store in target cache is more than or equal to the first preset threshold , and the quantity of the frame data stored in second queue be more than or equal to the second preset threshold in the case where, automatically to second Queue carries out dilatation, that is, increases the memory capacity of second queue, and second queue is allow to continue to receive the frame data of first queue And it is stored, and then the frame data that can be taken out to avoid first queue are dropped, and further promote video quality.
Illustratively, it is assumed that above-mentioned first preset threshold is the maximum capacity of target cache and second threshold is second The maximum capacity of queue, then when terminal needs to take out frame data from first queue, terminal judges currently depositing for target cache Whether reserves reach maximum capacity, i.e. whether the quantity of the frame data of target cache storage, which is equal to the maximum of the target cache, is held Amount;If the currently stored amount of target cache reaches maximum capacity, terminal continues to judge whether second queue has vacant capacity, i.e., Whether the quantity of the frame data of second queue storage is less than the maximum capacity of second queue, if so, terminal will be from first queue The frame data of taking-up are stored to second and are stood facing each other;If it is not, the maximum capacity that then termination extension second queue carries out, and will be from first team The frame data that column take out store the second queue to dilatation.
It should be noted that the small feelings for being equal to the first preset threshold of the quantity of the above-mentioned frame data stored in target cache Under condition, terminal can will directly be stored into target cache from the first frame data obtained in first queue.
In above-mentioned steps 102, in the case where terminal receives the instruction of target cache request frame data, terminal can be sentenced In the case where whether being stored with frame data in disconnected second queue, and be stored in determining second queue frame data, terminal can be with From second queue.
Wherein, the quantity that above-mentioned target instruction target word can be the frame data that terminal stores in target cache is less than or equal to The instruction generated when certain predetermined threshold value, such as: the quantity that can be the frame data stored in target cache is less than or waits When the 80% of its maximum capacity, terminal generates above-mentioned target instruction target word;Alternatively, being also possible in target cache be sky, i.e. target Not stored when having frame data in caching, terminal generates above-mentioned target instruction target word.
In addition, in the case where above-mentioned second queue is round-robin queue, it is above-mentioned that the second frame data are obtained from second queue, It can be and take out the frame data for being in tail of the queue in second queue.
It should be noted that confirmly detecting target instruction target word in terminal and second queue is uncached the case where frame data Under, terminal can directly obtain frame data from first queue, not be illustrated herein.
In above-mentioned steps 103, in terminal after taking out the second frame data in second queue, terminal can be by the second frame Data buffer storage is into target cache and as frame data to be rendered, so as to successive by the acquisition time of frame data in video flowing Rendering processing is carried out to frame data, frame data in video flowing is avoided to malfunction.
Certainly, target instruction target word is confirmly detected in terminal and second queue is uncached there are frame data, and terminal is directly from In the case where obtaining frame data in one queue, terminal will cache into target cache and make from the frame data obtained in first queue For frame data to be rendered.
In the embodiment of the present invention, during terminal carries out rendering processing to video flowing, terminal can be successively to target The frame data stored in caching carry out rendering processing, then, it caches in the second frame data to target cache, terminal can also be with Rendering processing is carried out to above-mentioned second frame data being stored in target cache.
It should be noted that above-mentioned carry out rendering processing to the second frame data, it can be and paster is carried out to the second frame data At least one of in processing, filter processing, scribble processing and word processing etc..
Wherein, it needs to carry out a variety of rendering processing to video flowing in terminal, i.e., the second frame data in video flowing is carried out more In the case where kind rendering processing, terminal, which can be, carries out a variety of rendering processing to the second frame data in the way of GPUImage, by It is that this field is ripe in carrying out the process of a variety of rendering processing to frame data in such a way that the image based on GPU accelerates GPUImage Know, herein and without repeating.
In some embodiments, it is above-mentioned by the second frame data store into target cache and as frame data to be rendered it Afterwards, further includes:
It treats render frame data and carries out the first rendering processing, obtain the first processing frame data;
It treats render frame data and carries out the second rendering processing, obtain second processing frame data;
First processing frame data are merged with the second frame data, obtain target frame data.
Here, terminal can treat render frame data and carry out the first rendering processing and the second rendering processing respectively, to obtain Treated the first processing frame data and second processing frame data, and by by the first processing frame data and second processing frame data Fusion obtains rendering treated target frame data, so as to carry out a variety of rendering processing simultaneously to band render frame data, mentions It rises and treats the efficiency that render frame data carries out a variety of rendering processing.
Wherein, above-mentioned first rendering processing and the second rendering processing, can be and carry out paster processing, filter to the second frame data Any two kinds in mirror processing, scribble processing and word processing etc., specifically, the first rendering processing can be handled for paster; Second rendering processing can be handled for filter, carry out paster processing and filter to the frame data of video flowing so as to realize simultaneously Processing.
In addition, above-mentioned render frame data for the treatment of carries out the first rendering processing, and treats render frame data and carry out the second wash with watercolours Dye processing, can be terminal, Shader Language is (i.e. using open graphic library (Open Graphics Library, OpenGL) OpenGL Shading Language, GLSL), the first frame data are carried out with the first rendering processing and the second rendering processing respectively, To obtain above-mentioned first processing frame data and second processing frame data, to further promote the efficiency of rendering processing.
It certainly, can will rendering treated frame number after the completion of the frame data of video flowing are carried out rendering processing by terminal According to being encoded and being encapsulated, to generate the video file of specified format.
For the understanding of the realization process convenient for the processing method to above-mentioned video flowing frame data, herein with example of practical application It is illustrated, specific as follows:
As shown in Figure 2 a, when the camera of terminal gets frame data, i.e., for obtaining the frame data of camera acquisition When tandem queue (i.e. first queue) receives frame data, terminal first checks for whether target cache capacity reaches max-thresholds, If it is not, then sending the medium processing to be rendered of target cache for current frame data;Otherwise, then following of safeguarding in frame buffer is reexamined Whether ring queue (i.e. second queue) is vacant, if so, current frame data to be put into the tail of the queue of frame round-robin queue;Otherwise, it recycles Queue size can be according to the automatic dilatation of current number of frames, and current frame data is put into after dilatation the tail of the queue of frame round-robin queue, Wherein, which can guarantee that data first are first handled, and guarantee that the sequence of video frame will not entanglement;
As shown in Figure 2 b, when target cache receives render instruction, terminal judges in target cache whether have data, If so, the frame data in target cache is directly taken to be rendered;If it is not, data are sky i.e. in target cache, then can initiate to ask Data command is sought, at this moment, terminal can first check for whether there are data in the round-robin queue of frame buffer, if so, then from round-robin queue As soon as team head take frame data to be put into target cache, otherwise directly from tandem queue obtain current video frame data;
Wherein, during rendering to frame data, under simple scenario, a kind of rendering processing (paster is such as only carried out Or filter etc.), it can directly use graphics processor (Graphics Processing Unit, GPU) image procossing frame (i.e. GPUImage) is handled, and carries out rendering calculating by the chain type combination of different filters;And it is needing to be combined processing Task, such as paster and filter mixed processing can be used GLSL rendering language, video frame image data carried out respectively Paster generates an image data, and carries out filter rendering and generate an image data, finally mixes two image datas It closes.
In the embodiment of the present invention, it is more than or equal to the by the quantity of the frame data stored in the target cache of terminal In the case where one preset threshold, the first frame data obtained in the first queue from terminal are stored to the second queue of terminal; In the case where being cached with frame data in detecting target instruction target word and second queue, the second frame data are obtained from second queue, Wherein, target instruction target word is the instruction that target cache requests frame data;By the second frame data store into target cache and as to Render frame data subtracts in this manner it is achieved that being kept in by the frame data that second queue will be unable to handle in time into second queue Few discarding to video flowing frame data, and then the generation of video flowing frame losing phenomenon is reduced, promote video quality.
It is the structural schematic diagram of terminal provided in an embodiment of the present invention referring to Fig. 3, Fig. 3, as shown in figure 3, terminal 300 is wrapped It includes:
First memory module 301, the quantity of the frame data for being stored in the target cache of the terminal be greater than or In the case where equal to the first preset threshold, the first frame data obtained from the first queue of the terminal were stored to the end The second queue at end, wherein the first queue is used to receive the frame data of the video flowing of current shooting;
Frame data obtain module 302, for being cached with frame data in detecting target instruction target word and the second queue In the case of, the second frame data are obtained from the second queue, wherein the target instruction target word is that the target cache requests frame number According to instruction;
Second memory module 303, for storing second frame data into the target cache and as to be rendered Frame data.
Optionally, as shown in figure 4, first memory module 301, comprising:
Determination unit 3011, the quantity of the frame data for storing in the target cache are more than or equal to described the In the case where one preset threshold, determine the number of frames stored in the second queue less than the second preset threshold;
First storage unit 3012, the quantity of the frame data for storing in the second queue is less than the second default threshold In the case where value, the first frame data obtained from the first queue are stored to the second queue.
Optionally, as shown in figure 5, first memory module 301, further includes:
Capacity extension unit 3013, it is default that the number of frames for storing in the second queue is more than or equal to second In the case where threshold value, the memory capacity of the second queue is extended;
Second storage unit 3014, for will be in the second queue after first frame data to expanding storage depth.
Optionally, as shown in fig. 6, the terminal 300, further includes:
First rendering module 304 obtains the first processing frame for carrying out the first rendering processing to the frame data to be rendered Data;
First rendering module 305 obtains second processing frame for carrying out the second rendering processing to the frame data to be rendered Data;
Data fusion module 306 is obtained for merging the first processing frame data with second frame data The target frame data.
Optionally, the first rendering processing is that paster is handled;The second rendering processing is that filter is handled.
Terminal 300 provided in an embodiment of the present invention can be realized each process that terminal is realized in embodiment of the method in Fig. 1, To avoid repeating, which is not described herein again.
A kind of hardware structural diagram of Fig. 7 terminal of each embodiment to realize the present invention.
The terminal 700 includes but is not limited to: radio frequency unit 701, network module 702, audio output unit 703, input are single Member 704, sensor 705, display unit 706, user input unit 707, interface unit 708, memory 709, processor 710, And the equal components of power supply 711.It will be understood by those skilled in the art that the not structure paired terminal of terminal structure shown in Fig. 7 It limits, terminal may include perhaps combining certain components or different component layouts than illustrating more or fewer components.
Wherein, processor 710 are used for:
The quantity of the frame data stored in the target cache of the terminal is more than or equal to the feelings of the first preset threshold Under condition, the first frame data obtained from the first queue of the terminal are stored to the second queue of the terminal, wherein institute State the frame data of video flowing of the first queue for receiving current shooting;
In the case where being cached with frame data in detecting target instruction target word and the second queue, from the second queue Obtain the second frame data, wherein the target instruction target word is the instruction that the target cache requests frame data;
Second frame data are stored into the target cache and as frame data to be rendered.
Optionally, processor 710 are specifically used for:
The quantity of the frame data stored in the target cache is more than or equal to the case where first preset threshold Under, determine the number of frames stored in the second queue less than the second preset threshold;
In the case that the quantity of the frame data stored in the second queue is less than the second preset threshold, from described first The first frame data obtained in queue are stored to the second queue.
Optionally, processor 710 are specifically used for:
In the case that the number of frames stored in the second queue is more than or equal to the second preset threshold, described in extension The memory capacity of second queue;
It will be in the second queue after first frame data to expanding storage depth.
Optionally, processor 710 are also used to:
First rendering processing is carried out to the frame data to be rendered, obtains the first processing frame data;
Second rendering processing is carried out to the frame data to be rendered, obtains second processing frame data;
The first processing frame data are merged with second frame data, obtain the target frame data.
Optionally, the first rendering processing is that paster is handled;The second rendering processing is that filter is handled.
Terminal 700 provided in an embodiment of the present invention can be realized each process that terminal is realized in embodiment of the method in Fig. 1, To avoid repeating, which is not described herein again.
It should be understood that the embodiment of the present invention in, radio frequency unit 701 can be used for receiving and sending messages or communication process in, signal Send and receive, specifically, by from base station downlink data receive after, to processor 710 handle;In addition, by uplink Data are sent to base station.In general, radio frequency unit 701 includes but is not limited to antenna, at least one amplifier, transceiver, coupling Device, low-noise amplifier, duplexer etc..In addition, radio frequency unit 701 can also by wireless communication system and network and other set Standby communication.
Terminal provides wireless broadband internet by network module 702 for user and accesses, and such as user is helped to receive and dispatch electricity Sub- mail, browsing webpage and access streaming video etc..
Audio output unit 703 can be received by radio frequency unit 701 or network module 702 or in memory 709 The audio data of storage is converted into audio signal and exports to be sound.Moreover, audio output unit 703 can also provide and end The relevant audio output of specific function (for example, call signal receives sound, message sink sound etc.) that end 700 executes.Sound Frequency output unit 703 includes loudspeaker, buzzer and receiver etc..
Input unit 704 is for receiving audio or video signal.Input unit 704 may include graphics processor (Graphics Processing Unit, GPU) 7041 and microphone 7042, graphics processor 7041 is in video acquisition mode Or the image data of the static images or video obtained in picture acquisition mode by picture acquisition equipment (such as camera) carries out Reason.Treated, and picture frame may be displayed on display unit 706.Through graphics processor 7041, treated that picture frame can be deposited Storage is sent in memory 709 (or other storage mediums) or via radio frequency unit 701 or network module 702.Mike Wind 7042 can receive sound, and can be audio data by such acoustic processing.Treated audio data can be The format output that mobile communication base station can be sent to via radio frequency unit 701 is converted in the case where telephone calling model.
Terminal 700 further includes at least one sensor 705, such as optical sensor, motion sensor and other sensors. Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ambient light Light and shade adjusts the brightness of display panel 7061, and proximity sensor can close display panel when terminal 700 is moved in one's ear 7061 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (generally three axis) and add The size of speed can detect that size and the direction of gravity when static, can be used to identify terminal posture (such as horizontal/vertical screen switching, Dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.;Sensor 705 can be with Including fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, hygrometer, thermometer, Infrared sensor etc., details are not described herein.
Display unit 706 is for showing information input by user or being supplied to the information of user.Display unit 706 can wrap Display panel 7061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used Forms such as (Organic Light-Emitting Diode, OLED) configure display panel 7061.
User input unit 707 can be used for receiving the number or character information of input, and generates and set with the user of terminal It sets and the related key signals of function control inputs.Specifically, user input unit 707 include touch panel 7071 and other Input equipment 7072.Touch panel 7071, also referred to as touch screen, collect user on it or nearby touch operation (such as User is using any suitable objects or attachment such as finger, stylus on touch panel 7071 or near touch panel 7071 Operation).Touch panel 7071 may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus is examined The touch orientation of user is surveyed, and detects touch operation bring signal, transmits a signal to touch controller;Touch controller from Touch information is received on touch detecting apparatus, and is converted into contact coordinate, then gives processor 710, receives processor 710 The order sent simultaneously is executed.Furthermore, it is possible to using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves Realize touch panel 7071.In addition to touch panel 7071, user input unit 707 can also include other input equipments 7072. Specifically, other input equipments 7072 can include but is not limited to physical keyboard, function key (such as volume control button, switch Key etc.), trace ball, mouse, operating stick, details are not described herein.
Further, touch panel 7071 can be covered on display panel 7061, when touch panel 7071 is detected at it On or near touch operation after, send processor 710 to determine the type of touch event, be followed by subsequent processing device 710 according to touching The type for touching event provides corresponding visual output on display panel 7061.Although in Fig. 7, touch panel 7071 and display Panel 7061 is the function that outputs and inputs of realizing terminal as two independent components, but in certain embodiments, it can The function that outputs and inputs of terminal is realized so that touch panel 7071 and display panel 7061 is integrated, is not limited herein specifically It is fixed.
Interface unit 708 is the interface that external device (ED) is connect with terminal 700.For example, external device (ED) may include it is wired or Wireless head-band earphone port, external power supply (or battery charger) port, wired or wireless data port, memory card port, For connecting port, the port audio input/output (I/O), video i/o port, ear port of the device with identification module Etc..Interface unit 708 can be used for receiving the input (for example, data information, electric power etc.) from external device (ED) and will One or more elements that the input received is transferred in terminal 700 or can be used for terminal 700 and external device (ED) it Between transmit data.
Memory 709 can be used for storing software program and various data.Memory 709 can mainly include storing program area The storage data area and, wherein storing program area can (such as the sound of application program needed for storage program area, at least one function Sound playing function, picture playing function etc.) etc.;Storage data area can store according to mobile phone use created data (such as Audio data, phone directory etc.) etc..In addition, memory 709 may include high-speed random access memory, it can also include non-easy The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 710 is the control centre of terminal, using the various pieces of various interfaces and the entire terminal of connection, is led to It crosses operation or executes the software program and/or module being stored in memory 709, and call and be stored in memory 709 Data execute the various functions and processing data of terminal, to carry out integral monitoring to terminal.Processor 710 may include one Or multiple processing units;Preferably, processor 710 can integrate application processor and modem processor, wherein application processing The main processing operation system of device, user interface and application program etc., modem processor mainly handles wireless communication.It can manage Solution, above-mentioned modem processor can not also be integrated into processor 710.
Terminal 700 can also include the power supply 711 (such as battery) powered to all parts, it is preferred that power supply 711 can be with It is logically contiguous by power-supply management system and processor 710, thus by power-supply management system realize management charging, electric discharge, with And the functions such as power managed.
In addition, terminal 700 includes some unshowned functional modules, details are not described herein.
Preferably, the embodiment of the present invention also provides a kind of terminal, including processor 710, and memory 709 is stored in storage It is real when which is executed by processor 710 on device 709 and the computer program that can be run on the processor 710 Each process of the processing method embodiment of existing above-mentioned video flowing frame data, and identical technical effect can be reached, to avoid weight Multiple, which is not described herein again.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium Calculation machine program, the computer program realize each of the processing method embodiment of above-mentioned video flowing frame data when being executed by processor Process, and identical technical effect can be reached, to avoid repeating, which is not described herein again.Wherein, the computer-readable storage Medium, such as read-only memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation RAM), magnetic or disk etc..
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed The scope of the present invention.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In embodiment provided herein, it should be understood that disclosed device and method can pass through others Mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the unit, only A kind of logical function partition, there may be another division manner in actual implementation, for example, multiple units or components can combine or Person is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual Between coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or communication link of device or unit It connects, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.Some or all of unit therein can be selected to realize the embodiment of the present invention according to the actual needs Purpose.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention. And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, ROM, RAM, magnetic or disk etc. are various can store program code Medium.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be subject to the protection scope in claims.

Claims (12)

1. a kind of processing method of video flowing frame data, which is characterized in that be applied to terminal, comprising:
In the case that the quantity of the frame data stored in the target cache of the terminal is more than or equal to the first preset threshold, The first frame data obtained from the first queue of the terminal are stored to the second queue of the terminal, wherein described One queue is used to receive the frame data of the video flowing of current shooting;
In the case where being cached with frame data in detecting target instruction target word and the second queue, obtained from the second queue Second frame data, wherein the target instruction target word is the instruction that the target cache requests frame data;
Second frame data are stored into the target cache and as frame data to be rendered.
2. the method according to claim 1, wherein the number of the frame data stored in the target cache In the case that amount is more than or equal to the first preset threshold, the first frame data obtained from the first queue are stored to institute Second queue is stated, including
In the case that the quantity of the frame data stored in the target cache is more than or equal to first preset threshold, really Whether the number of frames stored in the fixed second queue is less than the second preset threshold;
In the case that the quantity of the frame data stored in the second queue is less than the second preset threshold, from the first queue First frame data of middle acquisition are stored to the second queue.
3. according to the method described in claim 2, it is characterized in that, the number of the frame data stored in the target cache In the case that amount reaches first preset threshold, determine whether the number of frames stored in the second queue is default less than second After threshold value, further includes:
In the case that the number of frames stored in the second queue is more than or equal to the second preset threshold, extension described second The memory capacity of queue;
It will be in the second queue after first frame data to expanding storage depth.
4. according to the method in any one of claims 1 to 3, which is characterized in that described to store second frame data To after in the target cache and as frame data to be rendered, further includes:
First rendering processing is carried out to the frame data to be rendered, obtains the first processing frame data;
Second rendering processing is carried out to the frame data to be rendered, obtains second processing frame data;
The first processing frame data are merged with second frame data, obtain the target frame data.
5. according to the method described in claim 4, it is characterized in that, the first rendering processing is that paster is handled;Described second Rendering processing is that filter is handled.
6. a kind of terminal characterized by comprising
The quantity of first memory module, the frame data for storing in the target cache of the terminal is more than or equal to first In the case where preset threshold, the first frame data obtained from the first queue of the terminal are stored to the second of the terminal Queue, wherein the first queue is used to receive the frame data of the video flowing of current shooting;
Frame data obtain module, in the case where for being cached with frame data in detecting target instruction target word and the second queue, The second frame data are obtained from the second queue, wherein the target instruction target word is the finger that the target cache requests frame data It enables;
Second memory module, for storing second frame data into the target cache and as frame data to be rendered.
7. terminal according to claim 6, which is characterized in that first memory module, including determination unit are used for In the case that the quantity of the frame data stored in the target cache is more than or equal to first preset threshold, described in determination Whether the number of frames stored in second queue is less than the second preset threshold;
The case where first storage unit, the quantity of the frame data for storing in the second queue is less than the second preset threshold Under, the first frame data obtained from the first queue are stored to the second queue.
8. terminal according to claim 7, which is characterized in that first memory module, further includes:
Capacity extension unit, the number of frames for storing in the second queue are more than or equal to the feelings of the second preset threshold Under condition, the memory capacity of the second queue is extended;
Second storage unit, for will be in the second queue after first frame data to expanding storage depth.
9. the terminal according to any one of claim 6 to 8, which is characterized in that the terminal, further includes:
First rendering module obtains the first processing frame data for carrying out the first rendering processing to the frame data to be rendered;
First rendering module obtains second processing frame data for carrying out the second rendering processing to the frame data to be rendered;
Data fusion module obtains the mesh for merging the first processing frame data with second frame data Mark frame data.
10. terminal according to claim 9, which is characterized in that the first rendering processing is that paster is handled;Described second Rendering processing is that filter is handled.
11. a kind of terminal, which is characterized in that including processor, memory and be stored on the memory and can be at the place The computer program run on reason device is realized when the computer program is executed by the processor as appointed in claim 1 to 5 The step of processing method of video flowing frame data described in one.
12. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program The step of processing method of video flowing frame data described in any one of claims 1 to 5 is realized when being executed by processor.
CN201910381687.0A 2019-05-08 2019-05-08 A kind of processing method and terminal of video flowing frame data Pending CN110149552A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910381687.0A CN110149552A (en) 2019-05-08 2019-05-08 A kind of processing method and terminal of video flowing frame data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910381687.0A CN110149552A (en) 2019-05-08 2019-05-08 A kind of processing method and terminal of video flowing frame data

Publications (1)

Publication Number Publication Date
CN110149552A true CN110149552A (en) 2019-08-20

Family

ID=67594883

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910381687.0A Pending CN110149552A (en) 2019-05-08 2019-05-08 A kind of processing method and terminal of video flowing frame data

Country Status (1)

Country Link
CN (1) CN110149552A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111081198A (en) * 2019-11-29 2020-04-28 Tcl移动通信科技(宁波)有限公司 Data control method, data control device, storage medium and terminal device
CN111367741A (en) * 2020-02-28 2020-07-03 Oppo广东移动通信有限公司 User interface card pause detection method and device and electronic equipment
CN111711779A (en) * 2020-06-29 2020-09-25 重庆紫光华山智安科技有限公司 Real-time video node multi-dimensional caching method and device
CN111711718A (en) * 2020-05-07 2020-09-25 华为技术有限公司 Electronic device
CN111917998A (en) * 2020-08-12 2020-11-10 惠州市康冠科技有限公司 GPUImgae-based smart television special-effect camera generation method and device and smart television
CN112078486A (en) * 2020-08-27 2020-12-15 江苏泽景汽车电子股份有限公司 Steering auxiliary device and method based on HUD display
CN113014997A (en) * 2021-03-12 2021-06-22 上海哔哩哔哩科技有限公司 Cache updating method and device
CN113347432A (en) * 2021-05-27 2021-09-03 深圳市斯博科技有限公司 Video encoding and decoding method and device, computer equipment and storage medium
CN113556495A (en) * 2021-07-21 2021-10-26 北京达佳互联信息技术有限公司 Video recording method, video processing method and corresponding equipment
CN114071224A (en) * 2020-07-31 2022-02-18 腾讯科技(深圳)有限公司 Video data processing method and device, computer equipment and storage medium
CN116703689A (en) * 2022-09-06 2023-09-05 荣耀终端有限公司 Method and device for generating shader program and electronic equipment
CN117114964A (en) * 2023-02-13 2023-11-24 荣耀终端有限公司 Method for caching image frames, electronic equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103390049A (en) * 2013-07-23 2013-11-13 南京联创科技集团股份有限公司 Method for processing high-speed message queue overflow based on memory database cache
CN103927305A (en) * 2013-01-11 2014-07-16 中国移动通信集团山东有限公司 Method and device for controlling memory overflow
CN104732593A (en) * 2015-03-27 2015-06-24 厦门幻世网络科技有限公司 Three-dimensional animation editing method based on mobile terminal
CN105681714A (en) * 2016-02-26 2016-06-15 北京金山安全软件有限公司 Video shooting method and device and electronic equipment
CN106534667A (en) * 2016-10-31 2017-03-22 努比亚技术有限公司 Distributed cooperative rendering method and terminal
CN106941567A (en) * 2017-03-27 2017-07-11 广州优视网络科技有限公司 Show method, device and the user terminal of network picture
CN106941460A (en) * 2016-01-05 2017-07-11 中兴通讯股份有限公司 File transmitting method and device
US20190089966A1 (en) * 2017-09-21 2019-03-21 Intel Corporation Efficient frame loss recovery and reconstruction in dyadic hierarchy based coding

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103927305A (en) * 2013-01-11 2014-07-16 中国移动通信集团山东有限公司 Method and device for controlling memory overflow
CN103390049A (en) * 2013-07-23 2013-11-13 南京联创科技集团股份有限公司 Method for processing high-speed message queue overflow based on memory database cache
CN104732593A (en) * 2015-03-27 2015-06-24 厦门幻世网络科技有限公司 Three-dimensional animation editing method based on mobile terminal
CN106941460A (en) * 2016-01-05 2017-07-11 中兴通讯股份有限公司 File transmitting method and device
CN105681714A (en) * 2016-02-26 2016-06-15 北京金山安全软件有限公司 Video shooting method and device and electronic equipment
CN106534667A (en) * 2016-10-31 2017-03-22 努比亚技术有限公司 Distributed cooperative rendering method and terminal
CN106941567A (en) * 2017-03-27 2017-07-11 广州优视网络科技有限公司 Show method, device and the user terminal of network picture
US20190089966A1 (en) * 2017-09-21 2019-03-21 Intel Corporation Efficient frame loss recovery and reconstruction in dyadic hierarchy based coding

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111081198A (en) * 2019-11-29 2020-04-28 Tcl移动通信科技(宁波)有限公司 Data control method, data control device, storage medium and terminal device
CN111081198B (en) * 2019-11-29 2022-12-06 Tcl移动通信科技(宁波)有限公司 Data control method, data control device, storage medium and terminal equipment
CN111367741A (en) * 2020-02-28 2020-07-03 Oppo广东移动通信有限公司 User interface card pause detection method and device and electronic equipment
CN111711718A (en) * 2020-05-07 2020-09-25 华为技术有限公司 Electronic device
CN111711779A (en) * 2020-06-29 2020-09-25 重庆紫光华山智安科技有限公司 Real-time video node multi-dimensional caching method and device
CN114071224A (en) * 2020-07-31 2022-02-18 腾讯科技(深圳)有限公司 Video data processing method and device, computer equipment and storage medium
CN114071224B (en) * 2020-07-31 2023-08-25 腾讯科技(深圳)有限公司 Video data processing method, device, computer equipment and storage medium
CN111917998A (en) * 2020-08-12 2020-11-10 惠州市康冠科技有限公司 GPUImgae-based smart television special-effect camera generation method and device and smart television
CN112078486A (en) * 2020-08-27 2020-12-15 江苏泽景汽车电子股份有限公司 Steering auxiliary device and method based on HUD display
CN113014997A (en) * 2021-03-12 2021-06-22 上海哔哩哔哩科技有限公司 Cache updating method and device
CN113347432A (en) * 2021-05-27 2021-09-03 深圳市斯博科技有限公司 Video encoding and decoding method and device, computer equipment and storage medium
CN113556495A (en) * 2021-07-21 2021-10-26 北京达佳互联信息技术有限公司 Video recording method, video processing method and corresponding equipment
CN113556495B (en) * 2021-07-21 2022-10-28 北京达佳互联信息技术有限公司 Video recording method, video processing method and corresponding equipment
CN116703689A (en) * 2022-09-06 2023-09-05 荣耀终端有限公司 Method and device for generating shader program and electronic equipment
CN116703689B (en) * 2022-09-06 2024-03-29 荣耀终端有限公司 Method and device for generating shader program and electronic equipment
CN117114964A (en) * 2023-02-13 2023-11-24 荣耀终端有限公司 Method for caching image frames, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN110149552A (en) A kind of processing method and terminal of video flowing frame data
CN107509038B (en) A kind of image pickup method and mobile terminal
CN108924817A (en) A kind of SIM card state switching method and mobile terminal
CN108108007B (en) A kind of processing method and mobile terminal reducing power consumption
CN109271121A (en) A kind of application display method and mobile terminal
CN110198545A (en) A kind of secondary cell group adding method, terminal device and host node
CN109067418A (en) A kind of method of controlling antenna and mobile terminal
CN109445894A (en) A kind of screenshot method and electronic equipment
CN108803963A (en) A kind of screenshotss method and mobile terminal
CN110213440A (en) A kind of images share method and terminal
CN109819450A (en) A kind of received method, apparatus of signal and terminal
CN109218626A (en) A kind of photographic method and terminal
CN108320263A (en) A kind of method, device and mobile terminal of image procossing
CN109803087A (en) A kind of image generating method and terminal device
CN109560591A (en) Charging method, device and terminal
CN109407948A (en) A kind of interface display method and mobile terminal
CN109831359A (en) A kind of detection method and its terminal device of data network connection state
CN108881719A (en) A kind of method and terminal device switching style of shooting
CN109803429A (en) RRM measurement control method, mobile communication terminal and the network side equipment of adjacent cell
CN109362103A (en) A kind of data cache method and terminal device
CN109739300A (en) A kind of method of controlling antenna and terminal
CN109117054A (en) A kind of display control method and terminal
CN109117037A (en) A kind of method and terminal device of image procossing
CN109257152A (en) A kind of resource indicating method, network side equipment and terminal
CN109005297A (en) A kind of display methods and mobile terminal of navigation application

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190820

RJ01 Rejection of invention patent application after publication