CN111131868B - Video recording method and device based on player - Google Patents
Video recording method and device based on player Download PDFInfo
- Publication number
- CN111131868B CN111131868B CN201911382067.5A CN201911382067A CN111131868B CN 111131868 B CN111131868 B CN 111131868B CN 201911382067 A CN201911382067 A CN 201911382067A CN 111131868 B CN111131868 B CN 111131868B
- Authority
- CN
- China
- Prior art keywords
- data
- frame
- recording
- time stamp
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/4147—PVR [Personal Video Recorder]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses a video recording method and device based on a player. The video recording method based on the player comprises the following steps: copying data before decoding by a player, caching, recording a first time stamp of first frame playing data, and recording a second time stamp of the first frame playing data; when a user starts recording, acquiring recording start time, calculating according to the recording start time, a first time stamp corresponding to the first frame playing data and a second time stamp to obtain a first time stamp of a recorded first frame, and finding a corresponding data frame in cached data according to the first time stamp corresponding to the recorded first frame to start recording; and when the user stops recording, acquiring the recording ending time, calculating to obtain a first time stamp of the recorded last frame, and ending recording according to the first time stamp corresponding to the recorded last frame. The invention can realize the accurate recording of the video.
Description
Technical Field
The present invention relates to video recording technologies, and in particular, to a video recording method and apparatus based on a player.
Background
In recent years, with the rapid development of DVB CA (Digital Video Broadcasting Conditional Access) technology and the continuous progress of mobile consumer product intelligence, users are increasingly diversified in the presentation form and media playing function of programs while enjoying traditional media programs, for example, users want to add a Personal Video Recorder (PVR) on a player, so that users can enjoy different experiences brought by traditional DVB live programs at various mobile terminals, and users can record and retain the highlights of programs while enjoying the pleasure brought by direct programs, thereby realizing humanized experiences of classical storage and highlight sharing.
However, the existing audio/Video player adopts a flow design of demultiplexing, decoding and rendering, taking a USB Dongle player as an example, it needs to perform a series of processes of demultiplexing, decoding and rendering for processing a real-time MPEG2-TS audio/Video stream from a USB Dongle, and the series of processes are all implemented in a black box state based on directshow (a development package for stream media processing based on com (component Object model) and promoted by microsoft corporation on the basis of ActiveMovie and Video for Windows), and a general personal Video recording function starts recording at a time point clicked by a user or adopts a method of recording in advance, while the demultiplexing and decoding operations of the player have a great problem of time consumption due to buffer accumulation, and cannot realize the recording of the personal Video recording function from an accurate time point.
Therefore, how to provide a method capable of implementing an accurate personal video recording function is an urgent technical problem to be solved in the industry.
Disclosure of Invention
The invention provides a video recording method and device based on a player, aiming at solving the technical problem that the audio and the spectrogram thereof cannot be synchronously displayed in real time in the prior art.
The video recording method based on the player comprises the following steps:
copying data before decoding of the player for caching, recording a first time stamp of a data frame output by a demultiplexing module of the player corresponding to the first frame of playing data, and recording a second time stamp corresponding to the data frame output by an audio decoding module and/or a video decoding module of the player corresponding to the first frame of playing data;
when a user starts to record, acquiring recording start time, calculating according to the recording start time, a first time stamp corresponding to the first frame playing data and a second time stamp to obtain a first time stamp of a data frame output by the demultiplexing module corresponding to the recorded first frame, and finding out a corresponding data frame in the cached data according to the first time stamp corresponding to the recorded first frame to start to record;
and when the user stops recording, acquiring the recording ending time, calculating to obtain a first time stamp of the data frame output by the demultiplexing module corresponding to the recorded last frame, and ending recording according to the first time stamp corresponding to the recorded last frame.
Further, the data before decoding by the player is data output by a data source filtering module of the player, or audio data and/or video data output by a demultiplexing module of the player, or data input to the data source filtering module. When the cached data is the data before the demultiplexing module, demultiplexing the data, and then finding the data with the same first time stamp corresponding to the recorded first frame for recording.
Further, the first time stamp corresponding to the recorded first frame or the recorded last frame is according to formula PTSn=PTS0+Tn–T0Calculated to obtain the PTSnA first time stamp corresponding to a first or last recorded frame, the PTS0Playing a first time stamp corresponding to the data for the first frame, TnThe recording start time or the recording end time, the T0And playing a second time stamp corresponding to the data for the first frame.
Preferably, the buffered data is playback data within 10 seconds.
The video recording device based on the player adopts the video recording method of the technical scheme to record.
Wherein the player comprises: the system comprises a data source filtering module, a demultiplexing module, a video decoding module and an audio decoding module;
the video recording apparatus includes: the audio and video data pre-buffering module is used for copying and buffering data before the player decodes the data; the audio or video data filtering module is used for recording a first time stamp of a data frame output by the demultiplexing module corresponding to the first frame playing data; the audio or video decoding data filtering module is used for recording a second time stamp corresponding to the data frame output by the audio decoding module and/or the video decoding module and corresponding to the first frame playing data; and the recording module is used for acquiring the recording start time and the recording end time as well as the first time stamp and the second time stamp corresponding to the first frame playing data from the audio or video data filtering module and the audio or video decoding data filtering module, calculating to obtain the first time stamp corresponding to the recorded first frame and the recorded last frame, and finding out corresponding data from the cached data according to the first time stamp corresponding to the recorded first frame and the recorded last frame for recording.
The device further comprises a storage module for storing the recorded data.
The method effectively realizes the accurate measurement and calculation function of the recording starting time point of the streaming data based on the window DirectShow black box state, and perfectly solves the problem that wonderful segments or video data redundancy cannot be accurately recorded when the PVr function is realized through the measurement and calculation of the recording starting time point and a streaming data pre-buffering mechanism.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a block diagram of the present invention.
Fig. 2 is a data processing flow diagram of video recording according to the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects to be solved by the present invention more clearly apparent, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The principles and construction of the present invention will be described in detail below with reference to the drawings and examples.
Fig. 1 is a block diagram of a video recording apparatus based on a player according to an embodiment of the present invention. The player comprises a data source filtering module, a demultiplexing module, a video decoding module, an audio decoding module, a video renderer, an audio renderer, a display, a loudspeaker, a storage module, an audio and video data pre-buffering module, an audio or video data filtering module, an audio or video decoding data filtering module and a recording module. The storage module, the audio and video data pre-buffering module, the audio or video data filtering module, the audio or video decoding data filtering module and the recording module are main modules of the video recording device. The player of the present embodiment is a player based on the Direct Show framework.
The data source filtering module is mainly responsible for reading MPEG-2 program stream data from USB dongle equipment (USB adapter equipment) through a USB interface, decrypting the received program stream, and pushing the program stream data to the next demultiplexing module.
The demultiplexing module is used for separating the program stream, and since the transmitted program stream is a multi-program multiplexing stream, the demultiplexing module is required to separate the transport stream to obtain the audio and video ES stream of the currently played program.
And the audio decoding module receives the audio ES stream output by the demultiplexing module, is responsible for decoding the audio ES stream, and outputs PCM data to the audio renderer.
The audio renderer is mainly responsible for PCM data analysis and rendering, and finally outputs audio to a loudspeaker.
The video decoding module mainly decodes the compressed video image data (data of the video ES stream) to obtain original image data, and outputs YUV format data or RGB data, or other data that can be used for rendering.
The video renderer is mainly responsible for analyzing image raw data, rendering an image and outputting the image to a display.
The audio and video data pre-buffering module is used for copying data before decoding of the player for buffering, and the data copied by the audio and video data pre-buffering module can be data output by a data source filtering module of the player, or audio data and/or video data output by a demultiplexing module of the player, or data input into the data source filtering module by a USB dongle. In the embodiment of fig. 1, the audio/video data pre-buffering module copies data output by the data source filtering module, and generally after the MPEG2-TS audio/video stream is sent to the demultiplexing module, the original MPEG2-TS audio/video stream data will be cleared.
In this embodiment, the audio or video data filtering module is described by taking the audio data filtering module as a specific example, and the video data filtering module is based on the same principle. In this embodiment, the first time stamp of each frame of playing data may be obtained by an imediata sample object (media sample COM object), and then the first time stamp of the audio frame data is analyzed through a GetMediaTime interface of the imediata sample, and is recorded as PTSnN is greater than or equal to 0, and the first time stamp corresponding to the first frame play data is PTS0。
The audio or video decoding data filtering module is configured to record a second timestamp corresponding to a data frame output by the audio decoding module and/or the video decoding module and corresponding to the first frame of playing data, which is exemplified by the audio data filtering module in this embodiment, after the audio data filtering module obtains audio PCM data, the audio data filtering module obtains and records audio data sent by the first frame of playing data to the audio renderer, and records Reference Time (T) when the frame of data is sent to the renderer0) And as a starting point of timing, as a time reference point for calculating the time drift of video playing.
The recording module obtains the recording start time and the recording end time and the first time stamp and the second time stamp corresponding to the first frame playing data from the audio or video data filtering module and the audio or video decoding data filtering module, calculates to obtain the first time stamp corresponding to the recorded first frame and the recorded last frame, and finds out the corresponding data from the cached data according to the first time stamp corresponding to the recorded first frame and the recorded last frame for recording. Namely the moduleIs mainly responsible for the complete implementation of PVR functions, and related time data (PTS) is fetched0、T0、Tn) And calculating a first time stamp PTS corresponding to the recorded first frame through a time offset algorithmnBy a first time stamp PTS corresponding to a recorded first framenAnd searching the audio and video quantity recording starting point from the audio and video pre-storage module, and then writing the audio and/or video data into the storage module.
Fig. 2 shows a flow chart of a method of the invention based on recording of audio data. The same principle holds if the audio and/or video is recorded based on video data.
When the MPEG2-TS data stream is input to the data source filtering module, the data is divided into two paths to be transmitted to the demultiplexing module and the audio and video data pre-buffering module after being decoded by the data source filtering module, and the two paths of data are completely the same. And then, the audio and video data pre-buffering module takes a small memory space for continuous buffering, and the new data covers the old data, specifically, TS data is pre-stored in fifo buffer for enough time.
And the demultiplexing module demultiplexes the data into video data and audio data after receiving the data, the video data is transmitted to the next video decoding module, and the audio data is transmitted to the next audio decoding module. In this embodiment, a ctransinplace filter of DirectShow is used to obtain a first frame audio raw data structure object imediatsample after playing from data after demultiplexing, and a PTS of the frame data is obtained through a GetMediaTime interface of the imediatime object and recorded as a PTS0。
And continuously acquiring the data output to the audio renderer by the audio decoding module, and acquiring and recording a second time stamp corresponding to the data frame output by the audio decoding module and corresponding to the first frame playing data. In this embodiment, the ctransinfiPlaceFilter of DirectShow is used to confirm the output of the PCM data of the first frame after audio decoding, and simultaneously, the QueryInter of Directshow is usedThe face interface takes out an IreferenceClock object, acquires accurate Reference Time (Time 0) by using a member function GetTime of the IreferenceClock, and records a second Time stamp T of the first frame0= Time0。
When a user starts recording, recording start time T is acquirednAccording to the recording start time TnFirst time stamp PTS corresponding to first frame playing data0And a second time stamp T0Calculating to obtain a first time stamp PTS of a data frame output by a demultiplexing module corresponding to the recorded first framenAccording to the first time stamp PTS corresponding to the recorded first framenFinding out the corresponding data frame in the cached data to start recording, in a specific embodiment, obtaining Reference Time (T) at the start of recording by using a member function GetTime of irefferceclockn) Using algorithm PTSn=PTS0+Tn–T0Calculating a first time stamp PTS of a recording start pointn. By deducing the first time stamp PTS of the recorded first framenFinding out that the first time stamp PTS is equal to the PTS from the audio/video pre-cache datanThe small segment of data needs to be demultiplexed first in this embodiment, and then the PTS is larger than the PTSnAnd writing the data into the local disk until the user stops recording.
When the user stops recording, acquiring the recording end time TmAnd calculating to obtain the first time stamp PTS of the data frame output by the demultiplexing module corresponding to the recorded last framemAccording to the first time stamp PTS corresponding to the recorded last framemEnding the recording, specifically, in this embodiment, the Reference Time (T) at the end of the recording is obtained by using the member function GetTime of the irefferceclockm) And obtaining the recording end time, namely a second time stamp corresponding to the last frame. Using the formula of PTSm= PTSn+Tm–TnWhen the audio PTS of the recorded Ts data is larger than the first time stamp PTS corresponding to the last framemAnd then the recording is finished.
The invention pre-buffers the data stream before decoding in advance based on the technical scheme, thereby being beneficial to the subsequent recording of the playing data, and designs a set of PTS acquisition components between the data demultiplexing and the audio decoder and a set of playing time acquisition computing mechanism between the audio decoder and the renderer. And then, performing corresponding first time stamp PTS measurement on a first frame and a last frame of video recording based on the starting time of the video recording, thereby realizing a set of technical scheme capable of eliminating the problem of time error of a Pvr function caused by demultiplexing and decoding time consumption in a directshow black box mode, and realizing what you see is what you record.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (6)
1. A player-based video recording method, comprising:
copying data before decoding of the player for caching, recording a first time stamp of a data frame output by a demultiplexing module of the player corresponding to the first frame of playing data, and recording a second time stamp corresponding to the data frame output by an audio decoding module and/or a video decoding module of the player corresponding to the first frame of playing data;
when a user starts to record, acquiring recording start time, calculating according to the recording start time, a first time stamp corresponding to the first frame playing data and a second time stamp to obtain a first time stamp of a data frame output by the demultiplexing module corresponding to the recorded first frame, and finding out a corresponding data frame in the cached data according to the first time stamp corresponding to the recorded first frame to start to record;
when the user stops recording, acquiring recording ending time, calculating to obtain a first time stamp of the data frame output by the demultiplexing module corresponding to the recorded last frame, and ending recording according to the first time stamp corresponding to the recorded last frame;
the first time stamp corresponding to the recorded first frame or the last frame is according to formula PTSn=PTS0+Tn–T0Calculated to obtain the PTSnA first time stamp corresponding to a first or last recorded frame, the PTS0Playing a first time stamp corresponding to the data for the first frame, TnThe recording start time or the recording end time, the T0And playing a second time stamp corresponding to the data for the first frame.
2. The player-based video recording method according to claim 1, wherein the data before decoding by the player is data output by a data source filtering module of the player, or audio data and/or video data output by a demultiplexing module of the player, or data input to the data source filtering module.
3. The player-based video recording method according to claim 2, wherein when the buffered data is data before the demultiplexing module, the data is demultiplexed and then the data with the same first timestamp as the first recorded frame is found for recording.
4. The player-based video recording method of claim 1, wherein the buffered data is playback data within 10 seconds.
5. A player-based video recording apparatus, characterized in that the video recording method according to any one of claims 1 to 4 is used for recording;
the player includes: the system comprises a data source filtering module, a demultiplexing module, a video decoding module and an audio decoding module; the video recording apparatus includes:
the audio and video data pre-buffering module is used for copying and buffering data before the player decodes the data;
the audio or video data filtering module is used for recording a first time stamp of a data frame output by the demultiplexing module corresponding to the first frame playing data;
the audio or video decoding data filtering module is used for recording a second time stamp corresponding to the data frame output by the audio decoding module and/or the video decoding module and corresponding to the first frame playing data;
and the recording module is used for acquiring the recording start time and the recording end time as well as the first time stamp and the second time stamp corresponding to the first frame playing data from the audio or video data filtering module and the audio or video decoding data filtering module, calculating to obtain the first time stamp corresponding to the recorded first frame and the recorded last frame, and finding out corresponding data from the cached data according to the first time stamp corresponding to the recorded first frame and the recorded last frame for recording.
6. The video recording device of claim 5, further comprising a storage module for storing the recorded data.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911382067.5A CN111131868B (en) | 2019-12-27 | 2019-12-27 | Video recording method and device based on player |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911382067.5A CN111131868B (en) | 2019-12-27 | 2019-12-27 | Video recording method and device based on player |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111131868A CN111131868A (en) | 2020-05-08 |
CN111131868B true CN111131868B (en) | 2022-01-14 |
Family
ID=70505219
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911382067.5A Active CN111131868B (en) | 2019-12-27 | 2019-12-27 | Video recording method and device based on player |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111131868B (en) |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8676025B2 (en) * | 2002-03-01 | 2014-03-18 | Broadcom Corporation | Method of timebase management for MPEG decoding with personal video recording functionality |
US9521437B2 (en) * | 2009-06-17 | 2016-12-13 | Google Technology Holdings LLC | Insertion of recorded secondary digital video content during playback of primary digital video content |
US20120079054A1 (en) * | 2010-03-24 | 2012-03-29 | General Instrument Corporation | Automatic Memory Management for a Home Transcoding Device |
CN102821308B (en) * | 2012-06-04 | 2014-11-05 | 西安交通大学 | Multi-scene streaming media courseware recording and direct-broadcasting method |
CA3010043C (en) * | 2015-12-29 | 2020-10-20 | DISH Technologies L.L.C. | Dynamic content delivery routing and related methods and systems |
CN105657498B (en) * | 2016-02-17 | 2018-11-06 | 腾讯科技(深圳)有限公司 | The video recording method and device of mobile terminal |
CN107547908B (en) * | 2016-06-28 | 2020-11-06 | 真相网络科技(北京)有限公司 | Intelligent internet audio and video automatic recording and evidence obtaining method and system |
EP3343928A1 (en) * | 2016-12-29 | 2018-07-04 | Thomson Licensing | Method for storing audio/video data and corresponding device |
CN109068156A (en) * | 2018-08-16 | 2018-12-21 | 青岛海信传媒网络技术有限公司 | A kind of performance recording, playback method and device |
CN109819315A (en) * | 2019-03-21 | 2019-05-28 | 广州华多网络科技有限公司 | Playback method, device, terminal and the storage medium of HEVC video |
CN110099238A (en) * | 2019-05-31 | 2019-08-06 | 杭州涂鸦信息技术有限公司 | A kind of packaging method of video requency frame data, intelligent terminal and storage device |
-
2019
- 2019-12-27 CN CN201911382067.5A patent/CN111131868B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN111131868A (en) | 2020-05-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20150062353A1 (en) | Audio video playback synchronization for encoded media | |
US10129587B2 (en) | Fast switching of synchronized media using time-stamp management | |
CN101076121B (en) | Stream generating apparatus, imaging apparatus, data processing apparatus and stream generating method | |
CN104092920A (en) | Audio and video synchronizing method | |
CN102215429A (en) | Recording method for mobile TV | |
JPWO2012067219A1 (en) | CONTENT DATA GENERATION DEVICE, CONTENT DATA GENERATION METHOD, COMPUTER PROGRAM, AND RECORDING MEDIUM | |
EP2429136A1 (en) | Method and apparatus for carrying transport stream | |
CN105187896A (en) | Multi-segment media file playing method and system | |
JP5879169B2 (en) | Subtitle synchronized playback apparatus and program thereof | |
CN106385525A (en) | Video play method and device | |
EP2034733A2 (en) | Content reproduction | |
CN109040818B (en) | Audio and video synchronization method, storage medium, electronic equipment and system during live broadcasting | |
CN111131868B (en) | Video recording method and device based on player | |
US20080291328A1 (en) | Decoding apparatus for encoded video signals | |
US20090307185A1 (en) | Method for seamless playback of multiple multimedia files | |
US8213778B2 (en) | Recording device, reproducing device, recording medium, recording method, and LSI | |
US20080298781A1 (en) | Apparatus for recording audio-video data and method of recording audio-video data | |
JP3529679B2 (en) | Recording / playback device | |
JP2007124639A (en) | Method and system for storing data packets | |
US20110022400A1 (en) | Audio resume playback device and audio resume playback method | |
CN113395581B (en) | Audio playing method and device, electronic equipment and storage medium | |
KR100431548B1 (en) | Apparatus for reproducing a moving picture using stream header information | |
KR100956821B1 (en) | Method for playing Personal Video Recorder | |
KR100835909B1 (en) | Digital image processing device and operating method therefore | |
US9813689B2 (en) | Method for accelerated restitution of audio content and associated device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |