CN110572723A - Thumbnail generation method and related device - Google Patents

Thumbnail generation method and related device Download PDF

Info

Publication number
CN110572723A
CN110572723A CN201910818546.0A CN201910818546A CN110572723A CN 110572723 A CN110572723 A CN 110572723A CN 201910818546 A CN201910818546 A CN 201910818546A CN 110572723 A CN110572723 A CN 110572723A
Authority
CN
China
Prior art keywords
image frame
target image
frame
thumbnail
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910818546.0A
Other languages
Chinese (zh)
Inventor
余艳辉
钱申
程成
朱哮锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Device Co Ltd
Original Assignee
Huawei Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Device Co Ltd filed Critical Huawei Device Co Ltd
Priority to CN201910818546.0A priority Critical patent/CN110572723A/en
Publication of CN110572723A publication Critical patent/CN110572723A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4756End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8549Creating video summaries, e.g. movie trailer

Abstract

The embodiment of the application discloses a thumbnail generation method and a related device, comprising the following steps: acquiring a time stamp list of a target video according to the first sampling step length; determining at least one first target image frame from the list of timestamps; and decoding the first target image frame to generate a thumbnail corresponding to the target video. The thumbnail generation device can decode the at least one first target image frame to obtain the thumbnail of the target video, and user experience can be effectively improved.

Description

thumbnail generation method and related device
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method for generating a thumbnail and a related apparatus.
Background
With the rapid development of science and technology, electronic user terminal devices such as mobile phones, tablets and computers are increasingly popularized in daily life of people. As the network coverage is more and more extensive, users can watch videos through various terminal devices while connecting to the network, and in order to enrich the lives of people, a wide variety of videos begin to appear, such as television dramas, movies, sporting events, art programs, music programs, network courses, learning materials, and the like.
In order to facilitate a user to quickly find a video which the user wants to see, the user is usually made to quickly know the content of the video through a video thumbnail.
in the prior art, the process of generating the video thumbnail is complex, and a user needs to wait for a long time to obtain the thumbnail, so that the user experience is influenced.
content of application
the embodiment of the application provides a thumbnail generation method and a related device, wherein the thumbnail of a target video can be obtained through decoding according to at least one first target image frame, and user experience can be effectively improved.
The first aspect of the embodiments of the present application provides a method for generating a thumbnail, where:
acquiring a time stamp list of a target video according to the first sampling step length;
Determining at least one first target image frame according to the time stamp list;
And decoding the first target image frame to generate a thumbnail corresponding to the target video.
according to the embodiment of the application, the thumbnail of the target video can be obtained by decoding according to the at least one first target image frame, and the user experience can be effectively improved.
With reference to the first aspect, in an embodiment of the first aspect, the determining at least one first target image frame according to a list of timestamps includes:
When the first target image frame is a key frame,
determining at least one first target image frame according to the time stamp list, wherein the first target image frame is a key frame;
When the first target image frame is a non-key frame,
At least one first target image frame and at least one second target image frame are determined from the list of timestamps, wherein the second target image frame is a short-term reference frame associated with the first target image frame.
decoding a first target image frame, comprising:
and decoding the first target image frame and the second target image frame.
in the embodiment of the application, when the first target image frame is a key frame, the thumbnail generation device can directly generate a thumbnail according to the key frame; when the first target image frame is a short-term reference frame, the thumbnail generation device can generate the thumbnail according to at least two short-term reference frames, and the decoding time can be effectively saved.
With reference to the first aspect, in an embodiment of the first aspect, decoding the first target image frame and the second target image frame includes:
Rearranging the first target image frame and the second target image frame according to the reference relation according to the time stamp list;
and decoding the first target image frame and the second target image frame according to the arrangement sequence of the first target image frame and the second target image frame.
with reference to the first aspect, in an embodiment of the first aspect, after generating a thumbnail corresponding to the target video, the method further includes:
Grading the generated thumbnail according to an image quality grading standard to obtain a grading result of the thumbnail;
and determining a target thumbnail of the target video according to the grading result.
An image quality scoring criterion comprising:
The method comprises the steps of determining the size of an image frame, the time of the image frame to the starting frame of a target video and whether a thumbnail contains a target object, wherein the thumbnails correspond to the image frame one to one.
in the embodiment of the application, after the thumbnail is generated, the generated thumbnail can be scored according to an image quality scoring standard, and the target thumbnail of the target video is determined according to a scoring result so as to ensure the quality of the determined target thumbnail and enable the target thumbnail to be representative.
A second aspect provides a thumbnail generation apparatus, and the terminal device has a function of implementing the method for generating a thumbnail in the first aspect. The function can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.
A third aspect provides an electronic device comprising: the processor executes the method of each implementation mode provided by the first aspect of the embodiment of the present application by executing the software program stored in the memory and calling the data stored in the memory.
a fourth aspect provides a computer program product comprising computer program instructions which are loadable by a processor to carry out the method of the first aspect and implementations thereof.
a fifth aspect provides a computer storage medium for storing computer program instructions comprising a program for performing the steps of the various embodiments provided in the first aspect of the embodiments of the present application.
in a seventh aspect, an embodiment of the present application provides a communication apparatus, where the communication apparatus may include an entity such as a terminal device or a chip, and the communication apparatus includes: a processor, a memory; the memory is used for storing instructions; the processor is configured to execute the instructions in the memory to cause the communication device to perform the method according to any of the preceding first aspects.
In an eighth aspect, the present application provides a chip system, which includes a processor for enabling a network device to implement the functions referred to in the above aspects, for example, to transmit or process data and/or information referred to in the above methods. In one possible design, the system-on-chip further includes a memory, which stores program instructions and data necessary for the network device. The chip system may be formed by a chip, or may include a chip and other discrete devices.
According to the technical scheme, the embodiment of the application has the following advantages: according to the at least one first target image frame, the thumbnail of the target video can be obtained through decoding, and the user experience can be effectively improved.
Drawings
Fig. 1 is a schematic system architecture diagram of a method for generating a thumbnail according to an embodiment of the present application;
FIG. 2 is a schematic structural diagram of a computer system of an electronic device according to an embodiment of the present application;
Fig. 3 is a schematic diagram of an embodiment of a method for generating a thumbnail according to an embodiment of the present application;
Fig. 4a is a schematic view of an application interface provided in an embodiment of the present application;
FIG. 4b is a schematic diagram of another application interface provided in the embodiments of the present application;
Fig. 5 is a schematic diagram of an embodiment of a thumbnail generation apparatus in an embodiment of the present application.
Detailed Description
The embodiment of the application provides a thumbnail generation method and a related device, wherein the thumbnail of a target video can be obtained through decoding according to at least one first target image frame, and user experience can be effectively improved.
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the application. One skilled in the relevant art will recognize, however, that the subject matter of the present application can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known methods, devices, implementations, or operations have not been shown or described in detail to avoid obscuring aspects of the application.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
fig. 1 is a schematic system architecture diagram of a method for generating a thumbnail according to an embodiment of the present application.
As shown in fig. 1, the system architecture 100 may include one or more of terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired communication links, wireless communication links, and so forth.
it should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation. For example, server 105 may be a server cluster comprised of multiple servers, or the like.
The user may use the terminal devices 101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The terminal devices 101, 102, 103 may be various electronic devices having a display screen, including but not limited to smart phones, tablet computers, portable computers, desktop computers, and the like.
the server 105 may be a server that provides various services. For example, a user requests a to-be-processed video, such as a real-time live video, a user original content (UGC) video, a game video, etc., from the server 105 by using the terminal device 103 (which may also be the terminal device 101 or 102), and after receiving an object video file or an address returned by the server 105, the terminal device 103 may extract a preset number of image frames from the object video and generate a thumbnail to be displayed to the user. For example, the terminal device 103 obtains a time stamp list of the target video according to the first sampling step; the terminal device 103 determines at least one first target image frame according to the time stamp list; the terminal device 103 decodes the first target image frame to generate a thumbnail corresponding to the target video.
in another embodiment, the user may perform the above-described processing on a locally stored video file using the terminal device 103; or the server 105 returns the result to the terminal device 103 after performing the above-described processing.
it should be noted that, the method for generating a thumbnail provided in the embodiment of the present application is generally executed by a terminal device, and accordingly, the image frame extraction device is generally disposed in the terminal device. However, in other embodiments of the present application, the server may perform similar processing, so as to execute a method for generating a thumbnail image provided by an embodiment of the present application.
Fig. 2 is a schematic structural diagram of a computer system of an electronic device according to an embodiment of the present application.
it should be noted that the computer system 200 of the electronic device shown in fig. 2 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
as shown in fig. 2, the computer system 200 includes a Central Processing Unit (CPU)201 that can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)202 or a program loaded from a storage section 208 into a Random Access Memory (RAM) 203. In the RAM 203, various programs and data necessary for system operation are also stored. The CPU201, ROM202, and RAM 203 are connected to each other via a bus 204. An input/output (I/O) interface 205 is also connected to bus 204.
the following components are connected to the I/O interface 205: an input portion 206 including a keyboard, a mouse, and the like; an output section 207 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 208 including a hard disk and the like; and a communication section 209 including a network interface card such as a LAN card, a modem, or the like. The communication section 209 performs communication processing via a network such as the internet. A drive 210 is also connected to the I/O interface 205 as needed. A removable medium 211 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 210 as necessary, so that a computer program read out therefrom is mounted into the storage section 208 as necessary.
In particular, according to embodiments of the present application, the processes described below with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 209, and/or installed from a removable medium. The computer program executes various functions defined in the system of the present application when executed by a Central Processing Unit (CPU) 201.
It should be noted that the computer readable medium shown in the present application may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present application may be implemented by software, or may be implemented by hardware, and the described units may also be disposed in a processor. Wherein the names of the elements do not in some way constitute a limitation on the elements themselves.
As another aspect, the present application also provides a computer-readable medium, which may be contained in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by an electronic device, cause the electronic device to implement the method as described in the embodiments below. For example, the electronic device may implement the various steps shown in FIG. 3.
Before describing embodiments of the present application, some concepts related to the present application will be described first.
key and non-key frames:
In video compression, each frame represents a still image. In actual compression, various algorithms are adopted to reduce the data size, and intra-coded picture frames (I), predictive-coded picture frames (P), and bidirectional predictive-coded picture frames (B) are the most common.
Intra-coded picture frames (I) are key frames, referred to as intra pictures (I-frames), which are usually the first frames of each group of pictures (GOP) and can be regarded as pictures after being moderately compressed (as randomly accessed reference points). In the process of Moving Picture Experts Group (MPEG) coding, a part of image frame sequence is compressed into an I frame, a part is compressed into a P frame, and a part is compressed into a B frame. The I-frame method is an intra-frame compression method (P, B is inter-frame), also known as "key-frame" compression method. The I-frame method is a Discrete Cosine Transform (DCT) -based compression technique, and this algorithm is similar to a JPEG (joint photographic experts group) compression algorithm. With I-frame compression a compression ratio of 1/6 can be achieved without noticeable compression traces.
i frame characteristics:
1. It is a full frame compression encoded frame. JPEG compression coding and transmission are carried out on full-frame image information;
2. when decoding, only the data of the I frame can be used for reconstructing a complete image;
I frame describes details of image background and moving subject;
i frames are generated without reference to other pictures;
i frames are reference frames for P and B frames (the quality of which directly affects the quality of later frames in the same group);
I-frames are the base frames (first frames) of a group of frames, GOP, with only one I-frame in a group;
I frame does not need to consider motion vector;
The information amount of the data occupied by the I frame is relatively large.
the predictive-coded picture (P) and the bidirectional predictive-coded picture (B) are non-key frames, specifically:
p-frames are coded pictures, also called predicted frames, that compress the amount of transmitted data by substantially reducing the temporal redundancy information of previously coded frames in the picture sequence.
when encoding continuous moving pictures, several continuous pictures are divided into three types of P, B and I, a P frame is predicted from a P frame or an I frame before the P frame, and the P frame or the I frame is compared with the same information or data between the P frame or the I frame before the P frame or the I frame, namely, the inter-frame compression is carried out by considering the characteristics of motion. The P-frame method compresses data of a frame according to a difference between the frame and an adjacent previous frame (I-frame or P-frame). The method of P frame and I frame joint compression can achieve higher compression without obvious compression trace.
prediction and reconstruction of P frames:
The P frame uses I frame as reference frame, finds out the predicted value and motion vector of P frame 'some point' in I frame, and takes the predicted difference value and motion vector to transmit together. At the receiving end, the predicted value of the 'certain point' of the P frame is found out from the I frame according to the motion vector and is added with the difference value to obtain the sample value of the 'certain point' of the P frame, so that the complete P frame can be obtained.
the P frame is characterized in that:
The P frame is a coded frame which is 1-2 frames away from the I frame;
The P frame adopts the motion compensation method to transmit the difference value and the motion vector (prediction error) of the P frame and the previous I or P frame;
Thirdly, when decoding, the complete P frame image can be reconstructed only after the predicted value in the I frame is summed with the prediction error;
the P frame belongs to the interframe coding of forward prediction; it only refers to the I or P frame closest to it previously;
p frame can be the reference frame of its back P frame, also can be the reference frame of its preceding B frame;
Sixthly, since the P frame is a reference frame, it may cause diffusion of decoding errors;
And compression ratio of P frame is higher due to difference value transmission.
the B frame is a coded picture, also called a bidirectional predictive frame, which compresses a transmission data amount in consideration of both a coded frame preceding a source picture sequence and time redundancy information between coded frames following the source picture sequence.
The B-frame method is an inter-frame compression algorithm for bi-directional prediction. When compressing a frame into a B frame, it compresses the frame according to the difference of the adjacent previous frame, the current frame and the next frame data, that is, only the difference between the current frame and the previous and next frames is recorded. Only with B-frame compression can 200 be achieved: 1, high compression. Generally, I-frames are the least efficient in compression, P-frames are higher, and B-frames are the highest.
prediction and reconstruction of B frame:
The B frame takes the former I or P frame and the latter P frame as reference frames, finds out the predicted value and two motion vectors of a certain point of the B frame, and takes the predicted difference value and the motion vectors to transmit. The receiving end finds out (calculates) the predicted value in the two reference frames according to the motion vector and sums the predicted value with the difference value to obtain a sample value of a certain point of the B frame, thereby obtaining the complete B frame.
Reference frame:
In the prior art, the reference frames include a long term reference frame (long term picnum) and a short term reference frame. Long-term reference frames may be referenced by more distant inter-coded frames in the video sequence to be coded than short-term reference frames (short term picnum). For example, the valid range of a short-term reference frame is 16 frames (i.e., 16 inter-coded frames following the short-term reference frame may refer to the short-term reference frame), and the valid range of a long-term reference frame may exceed 16 frames (i.e., more than 16 inter-coded frames following the long-term reference frame may refer to the long-term reference frame).
The implementation details of the technical solution of the embodiment of the present application are described in detail below, please refer to fig. 3, and fig. 3 is a schematic diagram of an embodiment of a method for generating a thumbnail provided in the embodiment of the present application. For convenience of explanation, the thumbnail generation apparatus will be described by taking as an example that it is disposed in a terminal device.
301. And viewing the target video.
In this embodiment, when the user clicks a gallery application such as "album" in the terminal device, as shown in fig. 4 a. Or when the user needs to upload the target video in the application programs such as the WeChat and the microblog, as shown in fig. 4 b. And the user triggers a target video viewing instruction. At this time, the thumbnail generation apparatus obtains the thumbnail of the target video through the interface provided by the terminal device according to the target video viewing instruction, and triggers the subsequent embodiment steps, where taking the system of the terminal device as an android system as an example, the interface may be "getframeatttime". It should be noted that the target video may be one or more videos, and taking 50 videos included in the "album" as an example, at this time, the number of thumbnails of the target video acquired by the thumbnail generation apparatus is 50, and the thumbnails correspond to the videos one to one. For convenience of description, in the embodiment of the present application, one target video is taken as an example for description, and methods for generating thumbnails of multiple target videos are similar and are not repeated.
in addition, the method for generating the thumbnail provided by the embodiment of the present application includes, but is not limited to, the above-mentioned scenes, and is applicable to all scenes that need to generate the thumbnail of the video, for example: the thumbnail needs to be generated in slow motion playing of the video or video editing and previewing, and the thumbnail generation method provided by the embodiment of the application can be applied.
302. and acquiring a time stamp list of the target video according to the first sampling step length.
In this embodiment, after the thumbnail generation apparatus obtains the instruction to view the target video, a timestamp list of the target video is obtained according to a first sampling step length, where the first sampling step length may be determined according to a duration of the video, and in an optional implementation manner:
The first sampling step ts1 is adjusted according to the duration T of the target video, and when T is greater than 0 and less than 10 seconds(s), ts1 can be set to 200 milliseconds (ms), that is, a video segment of the first 200ms is selected from 0 second of the beginning of the video, and a timestamp list of the video segment is obtained, where the timestamp list is a list of timestamps of each image frame in the video segment;
when T is more than or equal to 10s and less than 60s, ts1 can be set to be 1s, namely, the video clip of the first 1s is selected from the beginning 0s of the video, and the time stamp list of the video clip is obtained;
when T is more than or equal to 60s and less than 5 x 60s, ts1 can be set to be 5s, namely, the video clip of the first 5s is selected from the beginning 0s of the video, and the time stamp list of the video clip is obtained;
when T is more than or equal to 5 × 60 and less than 60 × 60s, ts1 can be set to 10s, that is, the video segment of the first 10s is selected from the beginning 0 second of the video, and a time stamp list of the video segment is obtained;
When T is 60 × 60s ≦ T < 2 × 60s, ts1 may be set to 20s, i.e., the first 20s video segments are selected from the first 0 seconds of the video, and the timestamp list of the video segments is obtained.
in another alternative implementation, the first sample step ts1 is adjusted according to the duration T of the object video,
when T is more than 0 and less than 10s, ts1 can be set to be 200ms, namely, the image frame time stamps are extracted every 200ms, the extracted time stamps are summarized into a time stamp list, and finally, the time stamp list is acquired by the thumbnail generation device;
when T is more than or equal to 10s and less than 60s, ts1 can be set to be 1s, namely, the image frame time stamps are extracted every 1s, and the extracted time stamps are gathered into a time stamp list;
when T is more than or equal to 60s and less than 5 x 60s, ts1 can be set to be 5s, namely, the image frame time stamps are extracted every 5s, and the extracted time stamps are gathered into a time stamp list;
When T is more than or equal to 5 × 60 and less than 60 × 60s, ts1 can be set to 10s, that is, the image frame time stamps are extracted every 10s, and the extracted time stamps are collected into a time stamp list;
when T is 60 × 60s ≦ T < 2 × 60s, ts1 may be set to 20s, i.e., the image frame timestamps are extracted every 20s, and the extracted timestamps are aggregated into a list of timestamps.
303. At least one first target image frame is determined from the list of time stamps.
in the present embodiment, the thumbnail generation means determines at least one first target image frame from the time stamp list. Determining that the first target image frame is divided into two situations, wherein 1, the first target image frame is a key frame; 2. the first target image frame is a non-key frame, and the following description is provided:
1. The first target image frame is a key frame:
for ease of understanding: taking an example that the target video is 10 seconds, the first sampling step is 1 second, a video segment of the first 1s is selected from the beginning 0 seconds of the video, and a time stamp list of the video segment is obtained, please refer to table 1:
TABLE 1
In table 1, the image frame of the image frame serial number 2 and the image frame of the image frame serial number 5 are key frames, so that the two image frames may be determined as the first target image frame, or one of the image frames may be selected and determined as the first target image frame.
Wherein, the image frame sequence number is obtained according to a Presentation Time Stamp (PTS) ordering of the playing of the image frame. The reference relation sequence number is obtained in order of Decoded Time Stamps (DTS) of the image frame.
2. the first target image frame is a non-key frame:
for ease of understanding: taking a target video as 10 seconds, a first sampling step length as 1 second, selecting a video segment of the first 1s from the beginning 0 seconds of the video, and acquiring a time stamp list of the video segment, where the acquired time stamp list includes 5 image frames: the image frame of the image frame serial number 1, the image frame of the image frame serial number 2, the image frame of the image frame serial number 3, the image frame of the image frame serial number 4, and the image frame of the image frame serial number 5, wherein the 5 image frames are all non-key frames. As shown in table 2. And, the image frame of the image frame serial number 3 is a short-term reference frame associated with the image frame of the image frame serial number 4. At this time, the thumbnail image generation means determines the image frame with the image frame serial number 4 as the first target image frame, and determines the image frame with the image frame serial number 3 as the second target image frame.
TABLE 2
It should be noted that, when the first target image frame determined by the thumbnail generation apparatus includes a plurality of image frames, and the first target image frame includes a key frame and a non-key frame, the specific determination method is similar to the foregoing two methods, and details are not repeated here.
304. and decoding the first target image frame to generate a thumbnail corresponding to the target video.
in this embodiment, after the thumbnail generation apparatus determines the first target image frame, the first target image frame is first cached in a Decoded Picture Buffer (DPB). The decoding of the first target image frame by the thumbnail generation apparatus can be divided into two cases: 1. the first target image frame comprises a non-key frame; 2. the first target image frame includes a key frame. The following are described separately:
1. The first target image frame includes a non-key frame:
A decoder in the thumbnail generation apparatus decodes the first target image frame buffered in the DPB. The first target image frame may be one image frame or a plurality of image frames, and the following description will take the first target image frame as a non-key frame as an example:
The thumbnail generation device finds a second target image frame in the time stamp list according to the reference relation of the first target image frame, wherein the second target image frame is a short-term reference frame of the first target image frame. The number of the second target image frames may be one or more, and the second target image frame is exemplified as one image frame. Firstly, the thumbnail generation device buffers a first target image frame and a second target image frame into the DPB, and then the thumbnail generation device processes the first target image frame and the second target image frame by an end of packet (EOP) technique, so as to facilitate the decoding work of the thumbnail generation device.
specifically, the method comprises the following steps: the thumbnail generation device adds a decoding identifier at the end of each of the first target image frame and the second target image frame, wherein the decoding identifier is used for marking that the image frame is finished, and the thumbnail generation device can decode the image frame according to the decoding identifier, which can know that the image frame is a complete image frame. In an alternative implementation, the decoding identifier may be a set of predefined arrays.
the thumbnail generation device processes the first target image frame and the second target image frame through an EOP technology, and then rearranges the first target image frame and the second target image frame according to a reference relation. Then, the decoder of the thumbnail generation apparatus decodes the first target image frame and the second target image frame in the rearranged order. And taking the image generated after decoding as a thumbnail corresponding to the target video.
in an optional implementation manner, the thumbnail generation apparatus may also rearrange the first target image frame and the second target image frame, and then process the first target image frame and the second target image frame by using an EOP technique. After the processing is finished, the decoder decodes according to the rearrangement sequence.
it should be noted that the decoding manner of the first target image frame and the second target image frame being a plurality of image frames is similar to the foregoing method, and is not repeated here.
2. The first target image frame includes a key frame:
Since the key frame includes complete image information, the thumbnail generation apparatus can directly decode the key frame without rearranging and other image frames.
it should be noted that, when the first target image frame determined by the thumbnail generation apparatus includes a plurality of image frames, and the first target image frame includes a key frame and a non-key frame, the specific decoding method is similar to the foregoing two methods, and is not described herein again.
305. And scoring the generated thumbnail.
In this embodiment, the thumbnail generation device scores the thumbnail generated from the first target image frame according to the image quality scoring standard. In an alternative implementation, the image quality scoring criteria is: and according to the size of the first target image frame, the time of the first target image frame from the starting frame of the target video and whether the first frame contains a target object, carrying out image quality scoring on the thumbnail, wherein the thumbnail is associated with the first target image frame.
for a specific image quality score criteria, see table 3.
TABLE 3
The scoring process is described below, taking as an example that the first target image frame includes three image frames, the first target image frame includes: a first frame, a second frame, and a third frame.
First, a first target image frame is scored according to the size of the image frame, for example: the first frame is 500 kilobytes (kbytes) in size, the second frame is 450 kilobytes in size, and the third frame is 400 kilobytes in size. And respectively scoring the thumbnail 5 score corresponding to the first frame, the thumbnail 4 score corresponding to the second frame and the thumbnail 3 score corresponding to the third frame.
Second, the scoring is performed according to the time of the image frame from the starting frame of the target video, and is usually performed according to the time stamp of each image frame, for example: the timestamp of the first frame is 200 milliseconds, the timestamp of the second frame is 400 milliseconds, and the timestamp of the third frame is 800 milliseconds. And respectively scoring the thumbnail 5 score corresponding to the first frame, the thumbnail 4 score corresponding to the second frame and the thumbnail 3 score corresponding to the third frame.
And thirdly, whether the thumbnail contains the person is scored, whether the thumbnail contains the face image is generally detected, if yes, scoring is carried out, and if not, scoring is not carried out. For example: the thumbnail corresponding to the first frame comprises a face image, the thumbnail corresponding to the second frame comprises the face image, and the thumbnail corresponding to the third frame does not comprise the face image. And respectively scoring the thumbnail 5 point corresponding to the first frame, the thumbnail 5 point corresponding to the second frame and the thumbnail 0 point corresponding to the third frame.
thirdly, whether the thumbnail contains the key scenic spots is scored, whether the overall proportion of the range of the building image in the thumbnail exceeds 50 percent is generally detected, and if the detection result is that the overall proportion of the building image in the thumbnail exceeds 50 percent, the thumbnail is determined to contain the key scenic spots; and if the detection result is that the overall proportion of the building image in the thumbnail is not more than 50 percent, determining that the thumbnail does not contain the key scenic spots. For example: the thumbnail corresponding to the first frame comprises key scenery spots, the thumbnail corresponding to the second frame comprises key scenery spots, and the thumbnail corresponding to the third frame does not comprise key scenery spots. And respectively scoring the thumbnail 5 point corresponding to the first frame, the thumbnail 5 point corresponding to the second frame and the thumbnail 0 point corresponding to the third frame.
and finally, carrying out weighted summation on the scores of all the subentries according to the weights of all the subentries to obtain a score result.
it should be noted that this is only an optional image quality scoring criterion. In an optional implementation manner, the weight of each subentry in the image quality scoring standard may be adjusted according to actual requirements, and specific content of each subentry may also be added or deleted according to actual requirements, which is not limited herein.
306. a target thumbnail of the target video is determined.
in this embodiment, a target thumbnail of the target video is determined according to the scoring result obtained in step 305.
And the grading results of the thumbnails corresponding to the image frames are sequentially sorted according to the size sequence. The sequence is as follows: a first frame, a second frame, and a third frame. Therefore, the thumbnail generation device determines the thumbnail corresponding to the first frame with the highest score as the target thumbnail of the target video.
in the embodiment of the application, the thumbnail generation device deployed in the terminal equipment acquires the timestamp list of the target video according to the target video viewing instruction sent by the user. Specifically, a time stamp list of the target video is obtained according to the first sampling step length. Then, the thumbnail generation means determines at least one first target image frame according to the time stamp list, and the first target image frame determined by the thumbnail generation means is a key frame or a short-term reference frame, because when the first target image frame is a key frame, the thumbnail generation means can directly generate a thumbnail according to the key frame; when the first target image frame is a short-term reference frame, the thumbnail generation device can generate the thumbnail according to at least two short-term reference frames, and the decoding time can be effectively saved. After the thumbnail generation device generates the thumbnail, the generated thumbnail can be scored according to an image quality scoring standard, and a target thumbnail of the target video is determined according to a scoring result so as to ensure the quality of the determined target thumbnail and enable the target thumbnail to be representative.
Referring to fig. 5, fig. 5 is a schematic diagram of an embodiment of a thumbnail generation apparatus in an embodiment of the present application. The thumbnail generation apparatus 50 includes:
An obtaining module 501, configured to obtain a timestamp list of a target video according to a first sampling step;
A determining module 502 for determining at least one first target image frame according to the time stamp list;
The decoding module 503 is configured to decode the first target image frame to generate a thumbnail corresponding to the target video.
in some embodiments of the present application, the thumbnail generation apparatus 50 includes:
the determining module 502 is specifically configured to determine, when the first target image frame is a non-key frame,
At least one first target image frame and at least one second target image frame are determined from the list of timestamps, wherein the second target image frame is a short-term reference frame associated with the first target image frame.
In some embodiments of the present application, the thumbnail generation apparatus 50 includes:
The decoding module 503 is specifically configured to decode the first target image frame and the second target image frame.
In some embodiments of the present application, the thumbnail generation apparatus 50 includes:
A decoding module 503, specifically configured to rearrange the first target image frame and the second target image frame according to the reference relationship according to the time stamp list;
The decoding module 503 is specifically configured to decode the first target image frame and the second target image frame according to the arrangement order of the first target image frame and the second target image frame.
In some embodiments of the present application, the thumbnail generation apparatus 50 includes:
The determining module 502 is specifically configured to determine, when the first target image frame is a key frame,
determining at least one first target image frame according to the time stamp list, wherein the first target image frame is a key frame.
In some embodiments of the present application, the thumbnail generation apparatus 50 includes:
The determining module 502 is further configured to score the generated thumbnail according to the image quality scoring standard, and obtain a scoring result of the thumbnail;
the determining module 502 is further configured to determine a target thumbnail of the target video according to the scoring result.
The terms "first," "second," and the like in the description and in the claims of the present application and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Moreover, the terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or modules is not necessarily limited to those steps or modules explicitly listed, but may include other steps or modules not expressly listed or inherent to such process, method, article, or apparatus. The naming or numbering of the steps appearing in the present application does not mean that the steps in the method flow have to be executed in the chronological/logical order indicated by the naming or numbering, and the named or numbered process steps may be executed in a modified order depending on the technical purpose to be achieved, as long as the same or similar technical effects are achieved.
it is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (15)

1. a method of thumbnail generation, comprising:
acquiring a time stamp list of a target video according to the first sampling step length;
determining at least one first target image frame from the list of timestamps;
and decoding the first target image frame to generate a thumbnail corresponding to the target video.
2. the method of claim 1, wherein said determining at least one of said first target image frames from said list of time stamps comprises:
when the first target image frame is a non-key frame,
Determining at least one first target image frame and at least one second target image frame according to the time stamp list, wherein the second target image frame is a short-term reference frame associated with the first target image frame.
3. The method of claim 2, wherein said decoding the first target image frame comprises:
Decoding the first target image frame and the second target image frame.
4. The method of claim 3, wherein the decoding the first target image frame and the second target image frame comprises:
Rearranging the first target image frame and the second target image frame according to a reference relation according to the time stamp list;
And decoding the first target image frame and the second target image frame according to the arrangement sequence of the first target image frame and the second target image frame.
5. the method of claim 4, wherein said determining at least one of said first target image frames from said list of time stamps comprises:
when the first target image frame is a key frame,
determining at least one first target image frame according to the time stamp list, wherein the first target image frame is a key frame.
6. The method according to any one of claims 1-5, wherein after the generating the thumbnail image corresponding to the target video, the method further comprises:
Grading the generated thumbnail according to an image quality grading standard to obtain a grading result of the thumbnail;
And determining a target thumbnail of the target video according to the grading result.
7. The method of claim 6, wherein the image quality scoring criteria comprises:
the size of the image frame, the time of the image frame from the starting frame of the target video and whether the thumbnail contains the target object or not are determined, wherein the thumbnails correspond to the image frames one to one.
8. A thumbnail generation apparatus characterized by comprising:
the acquisition module is used for acquiring a time stamp list of the target video according to the first sampling step length;
a determining module for determining at least one first target image frame according to the time stamp list;
and the decoding module is used for decoding the first target image frame to generate a thumbnail corresponding to the target video.
9. The apparatus of claim 8,
The determining module is specifically configured to, when the first target image frame is a non-key frame,
Determining at least one first target image frame and at least one second target image frame according to the time stamp list, wherein the second target image frame is a short-term reference frame associated with the first target image frame.
10. The apparatus of claim 9,
The decoding module is specifically configured to decode the first target image frame and the second target image frame.
11. The apparatus of claim 10,
the decoding module is specifically configured to rearrange the first target image frame and the second target image frame according to a reference relationship according to the timestamp list;
the decoding module is specifically configured to decode the first target image frame and the second target image frame according to an arrangement order of the first target image frame and the second target image frame.
12. The apparatus of claim 11,
The determining module is specifically configured to, when the first target image frame is a key frame,
Determining at least one first target image frame according to the time stamp list, wherein the first target image frame is a key frame.
13. the apparatus according to any one of claims 8-12,
The determining module is further configured to score the generated thumbnail according to an image quality scoring standard to obtain a scoring result of the thumbnail;
The determining module is further configured to determine a target thumbnail of the target video according to the scoring result.
14. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of thumbnail generation according to any one of claims 1 to 7.
15. an electronic device, comprising: one or more processors and one or more memory devices;
the storage device to store one or more programs that, when executed by the one or more processors, cause the one or more processors to implement the method of thumbnail generation of any of claims 1-7.
CN201910818546.0A 2019-08-30 2019-08-30 Thumbnail generation method and related device Pending CN110572723A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910818546.0A CN110572723A (en) 2019-08-30 2019-08-30 Thumbnail generation method and related device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910818546.0A CN110572723A (en) 2019-08-30 2019-08-30 Thumbnail generation method and related device

Publications (1)

Publication Number Publication Date
CN110572723A true CN110572723A (en) 2019-12-13

Family

ID=68777247

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910818546.0A Pending CN110572723A (en) 2019-08-30 2019-08-30 Thumbnail generation method and related device

Country Status (1)

Country Link
CN (1) CN110572723A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112866799A (en) * 2020-12-31 2021-05-28 百果园技术(新加坡)有限公司 Video frame extraction processing method, device, equipment and medium
CN113453055A (en) * 2020-03-25 2021-09-28 华为技术有限公司 Method and device for generating video thumbnail and electronic equipment
CN114546558A (en) * 2022-02-21 2022-05-27 金蝶云科技有限公司 Drawing processing method and device, computer equipment and storage medium
CN114710640A (en) * 2020-12-29 2022-07-05 华为技术有限公司 Video call method, device and terminal based on virtual image

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040095396A1 (en) * 2002-11-19 2004-05-20 Stavely Donald J. Video thumbnail
US20080260346A1 (en) * 2006-10-17 2008-10-23 Hiroko Sukeda Video recording apparatus
US20090007202A1 (en) * 2007-06-29 2009-01-01 Microsoft Corporation Forming a Representation of a Video Item and Use Thereof
US20100107126A1 (en) * 2008-10-28 2010-04-29 Hulu Llc Method and apparatus for thumbnail selection and editing
CN101853286A (en) * 2010-05-20 2010-10-06 上海全土豆网络科技有限公司 Intelligent selection method of video thumbnails
JPWO2009139302A1 (en) * 2008-05-16 2011-09-22 シャープ株式会社 Recording / playback device
CN102629280A (en) * 2012-03-29 2012-08-08 深圳创维数字技术股份有限公司 Method and device for extracting thumbnail during video processing
CN105376658A (en) * 2014-08-26 2016-03-02 无锡天脉聚源传媒科技有限公司 Device and method for generating video file overview
CN105704570A (en) * 2016-03-08 2016-06-22 上海小蚁科技有限公司 Method and apparatus for generating one or more preview frames of video
CN107948646A (en) * 2017-09-26 2018-04-20 北京字节跳动网络技术有限公司 A kind of video abstraction generating method and video re-encoding method

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040095396A1 (en) * 2002-11-19 2004-05-20 Stavely Donald J. Video thumbnail
US20080260346A1 (en) * 2006-10-17 2008-10-23 Hiroko Sukeda Video recording apparatus
US20090007202A1 (en) * 2007-06-29 2009-01-01 Microsoft Corporation Forming a Representation of a Video Item and Use Thereof
JPWO2009139302A1 (en) * 2008-05-16 2011-09-22 シャープ株式会社 Recording / playback device
US20100107126A1 (en) * 2008-10-28 2010-04-29 Hulu Llc Method and apparatus for thumbnail selection and editing
CN101853286A (en) * 2010-05-20 2010-10-06 上海全土豆网络科技有限公司 Intelligent selection method of video thumbnails
CN102629280A (en) * 2012-03-29 2012-08-08 深圳创维数字技术股份有限公司 Method and device for extracting thumbnail during video processing
CN105376658A (en) * 2014-08-26 2016-03-02 无锡天脉聚源传媒科技有限公司 Device and method for generating video file overview
CN105704570A (en) * 2016-03-08 2016-06-22 上海小蚁科技有限公司 Method and apparatus for generating one or more preview frames of video
CN107948646A (en) * 2017-09-26 2018-04-20 北京字节跳动网络技术有限公司 A kind of video abstraction generating method and video re-encoding method

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113453055A (en) * 2020-03-25 2021-09-28 华为技术有限公司 Method and device for generating video thumbnail and electronic equipment
WO2021190412A1 (en) * 2020-03-25 2021-09-30 华为技术有限公司 Video thumbnail generation method, device, and electronic apparatus
CN114710640A (en) * 2020-12-29 2022-07-05 华为技术有限公司 Video call method, device and terminal based on virtual image
CN114710640B (en) * 2020-12-29 2023-06-27 华为技术有限公司 Video call method, device and terminal based on virtual image
CN112866799A (en) * 2020-12-31 2021-05-28 百果园技术(新加坡)有限公司 Video frame extraction processing method, device, equipment and medium
CN112866799B (en) * 2020-12-31 2023-08-11 百果园技术(新加坡)有限公司 Video frame extraction processing method, device, equipment and medium
CN114546558A (en) * 2022-02-21 2022-05-27 金蝶云科技有限公司 Drawing processing method and device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
CN110572723A (en) Thumbnail generation method and related device
CN106803992B (en) Video editing method and device
CN105187850B (en) The method and apparatus that the information of encoded video data is provided and receives encoded video data
CN102986218B (en) Video for stream video data switches
TWI692245B (en) Video decoding apparatus, video encoding method and apparatus, and computer-readable storage medium
KR100424762B1 (en) Image data providing system and method thereof
CN103069799B (en) Signaling is used for the data of multiplex video component
WO2018076998A1 (en) Method and device for generating playback video file
US20220232222A1 (en) Video data processing method and apparatus, and storage medium
CN103026721A (en) Arranging sub-track fragments for streaming video data
JP2001526859A (en) Instruction and editing method of compressed image on world wide web and architecture
US9667982B2 (en) Techniques for transform based transcoding
CN103081488A (en) Signaling video samples for trick mode video representations
CN111836076A (en) Video resolution switching method and device and electronic equipment
KR100940499B1 (en) Image processing method, image processing device, computer readable recording medium for storing image processing program and image browsing system
CN112423140A (en) Video playing method and device, electronic equipment and storage medium
CN113225585A (en) Video definition switching method and device, electronic equipment and storage medium
CN115250356A (en) Multi-camera switchable virtual camera of mobile phone
CN111436009A (en) Real-time video stream transmission and display method and transmission and play system
WO2023130896A1 (en) Media data processing method and apparatus, computer device and storage medium
CN111212288B (en) Video data encoding and decoding method and device, computer equipment and storage medium
CN113709574A (en) Video screenshot method and device, electronic equipment and computer-readable storage medium
CN111800649A (en) Method and device for storing video and method and device for generating video
TWI794076B (en) Method for processing track data in multimedia resources, device, medium and apparatus
CN117579843B (en) Video coding processing method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20191213

RJ01 Rejection of invention patent application after publication