CN104717446A - Method for automatically converting videos of multiple formats to video of ITU 656 protocol PAL format - Google Patents

Method for automatically converting videos of multiple formats to video of ITU 656 protocol PAL format Download PDF

Info

Publication number
CN104717446A
CN104717446A CN201310682894.2A CN201310682894A CN104717446A CN 104717446 A CN104717446 A CN 104717446A CN 201310682894 A CN201310682894 A CN 201310682894A CN 104717446 A CN104717446 A CN 104717446A
Authority
CN
China
Prior art keywords
video
agreement
protocol
itu656
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310682894.2A
Other languages
Chinese (zh)
Other versions
CN104717446B (en
Inventor
王闯
贺莹
杨立成
林清
王国东
王海鹏
刘硕
杨敬宝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AVIC No 631 Research Institute
Original Assignee
AVIC No 631 Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by AVIC No 631 Research Institute filed Critical AVIC No 631 Research Institute
Priority to CN201310682894.2A priority Critical patent/CN104717446B/en
Publication of CN104717446A publication Critical patent/CN104717446A/en
Application granted granted Critical
Publication of CN104717446B publication Critical patent/CN104717446B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Television Systems (AREA)

Abstract

The invention relates to a method for automatically converting videos of multiple formats to a video of an ITU 656 protocol PAL format. The method comprises the following steps that 1, an automatic conversion system is set up; 2, input video signals are sent into a protocol detection module; 3, high level enable signals CEn drive a protocol N collection unit corresponding to a protocol N detection unit to collect effective pixels of the input video signals; 4, the high level enable signals CEn are used as control semaphore of a multiplexer switch controller; 5, a zooming process module zooms the resolution ratio of a video to 720* 576, and the video is written into an output storage unit; 6, a sending control module generates control pixel streams of an PAL format video blanking area according to the ITU656 protocol, and conversion of the input video to the PAL format video is achieved. The method solves the problem of integration generated in conversion from videos of any protocol format to the video of the PAL format, videos of any protocol format and any resolution ratio can be automatically converted to the PAL format video meeting the ITU656 protocol, and time for the video format conversion is short.

Description

Many video formats are to the automatic switching method of ITU656 agreement pal mode
Technical field
The invention belongs to Video processing, graph image field, be specifically related to the automatic switching method of a kind of many video formats to ITU656 agreement pal mode.
Background technology
Pal mode analog video is a kind of video format of classics, usually used as the standard interface of video frequency output in numerous application scenario.But for existing vision sensor, its video protocols exported is different, and the Video Quality Metric therefore often needing the various agreements exported by vision sensor is the pal mode meeting ITU656 agreement; Although there is the chip that various video format is changed to pal mode at present, this kind of chip has often only been supported encoding and decoding that are a kind of or a class input video.
Along with the development of electronic technology, large scale integrated circuit, adopt field programmable gate array (FPGA) to realize complicated control and processing capacity has very large advantage in integration, stability and reliability etc., study the wide application prospect that the various video form based on FPGA has to the automatic switching control method of the pal mode video meeting ITU656 agreement.
Summary of the invention
The present invention is the integration problem that the video in order to solve any protocol type is changed to pal mode, proposes the automatic switching method of a kind of many video formats to ITU656 agreement pal mode.
Technical solution of the present invention:
Many video formats are to the automatic switching method of ITU656 agreement pal mode, and its special character is, comprises the following steps:
1] automated conversion system is created:
Comprise protocol detection module: for carrying out agreement coupling to incoming video signal, and produce high level enable signal CEn or low-level enable signal according to matching result, comprise agreement 1 detecting unit, agreement 2 detecting unit ... and agreement N detecting unit;
Video acquisition module: gather the valid pixel of the incoming video signal matched through protocol detection module, comprises agreement 1 collecting unit, agreement 2 collecting unit ... and agreement N collecting unit; The collecting unit of various agreement and detecting unit one_to_one corresponding, described high level enable signal CEn inputs to the agreement N collecting unit of correspondence and multidiameter option switch controller;
Multidiameter option switch controller: under the control of high level enable signal CEn, buffers into collection memory cell by the effective pixel data that the video acquisition module that agreement is mated collects;
Gather memory cell: for the effective pixel data of buffer memory incoming video signal;
Convergent-divergent processing module: read effective pixel data for real time sequence from collection memory cell and adopt bilinear interpolation algorithm to be scaled the resolution sizes of 720*576, sending it to output memory cell simultaneously;
Export memory cell: for storing the effective pixel data after the process of convergent-divergent processing module;
And transmission control module: for producing the control pixel stream in pal mode video blanking district according to ITU656 agreement, and the pixel data after convergent-divergent is read from exporting order memory cell between SAV and EAV of pixel stream, be filled into the effective pixel region of ITU656 pixel stream, thus realize the conversion of input video to pal mode video;
2] vision signal of input is sent in protocol detection module respectively detects in each protocol detection unit, if the vision signal of input is mated with the agreement of this agreement N detecting unit, then this agreement N detecting unit produces the enable signal CEn of high level, and all the other protocol detection unit produce low-level enable signal simultaneously;
3] high level enable signal CEn drives the valid pixel of the agreement N collecting unit Gather and input vision signal corresponding with agreement N detecting unit; Low-level enable signal makes to be in reset mode with the agreement collecting unit corresponding to it simultaneously;
4] high level enable signal CEn is as the control signal amount of multidiameter option switch controller, makes a valid pixel of the vision signal of the agreement N collecting unit collection of protocols having coupling by multidiameter option switch controller cache to gathering memory cell;
5] convergent-divergent processing module is from the effective pixel data gathering memory cell order reading whole frame, and adopts bilinear interpolation algorithm to be scaled the resolution sizes of 720*576, is write simultaneously and exports memory cell;
6] control module produces pal mode video blanking district control pixel stream according to ITU656 agreement is sent, and the effective pixel data after convergent-divergent is read from exporting order memory cell between SAV and EAV of pixel stream, be filled into the effective pixel region of ITU656 pixel stream, thus realize the conversion of input video to pal mode video.
Protocol detection module and video acquisition module work according to the mode of parallel pipelining process, synchronously mate with each protocol detection unit, and produce matching result when frame of video end of input simultaneously.
Above-mentioned collection memory cell comprises buffering area A and buffering area B: concrete storing step is:
When current video frame data are stored into buffering area A, the previous frame video data reading storage from the B of buffering area sends to convergent-divergent processing module;
When next frame video data is stored into buffering B, the data reading current video frame from the A of buffering area send to convergent-divergent processing module.
The real-time analysis of above-mentioned protocol detection module also calculates the following protocol status parameter of input video stream: the line synchronizing signal Hsync pulse number comprised between opposite field synchronizing signal Vsync pulse; The line synchronizing signal Hsync pulse number comprised in field sync signal Vsync pulse width range; The pixel clock clk cycle number comprised between adjacent lines synchronizing signal Hsync pulse; The pixel clock clk cycle number comprised in line synchronizing signal Hsync pulse width range; The pixel clock clk cycle number comprised in data valid signal De pulse duration during valid pixel is capable; From field sync signal Vsync impulse hits play first valid pixel capable between the line synchronizing signal Hsync pulse number that comprises; Play the pixel clock clk cycle counting comprised between data valid signal De from line synchronizing signal pulse Hsync saltus step during valid pixel is capable.
Above-mentioned protocol detection module comprise the VESA protocol video detecting unit of various resolution, various resolution RawRGB format video detecting unit, meet the video detecting unit of SMPTE274 agreement, meet the detecting unit of ITU601, ITU656 and ITU709 protocol video; Described video acquisition module comprise the VESA protocol video collecting unit of various resolution, various resolution RawRGB format video collecting unit, meet the video acquisition unit of SMPTE274 agreement, meet the collecting unit of ITU601, ITU656 and ITU709 protocol video; And detectable protocol type independently can customize and cutting according to embody rule demand;
Above-mentioned steps 2] concrete steps be:
2.1] real-time synchronization calculates each state parameter of incoming video signal:
2.2] state parameter of each state parameter calculated with each agreement of corresponding protocol detection module is contrasted: if state parameter is consistent, then inputting video data belongs to this kind of agreement; Otherwise, then this kind of agreement is not belonged to.
The invention has the beneficial effects as follows:
The video of any protocol type and resolution can be automatically converted to the PAL format video meeting ITU656 agreement by the present invention, and video format conversion is consuming time little; Dynamic detects the change of video protocols, after input source video protocols changes, can complete the detection to its protocol type within the time interval of a two field picture input; Detectable protocol type independently can customize and cutting according to embody rule demand.
Accompanying drawing explanation
Fig. 1 is the automatic switching control method schematic diagram of various video agreement to pal mode video.
Embodiment
The present invention adopts FPGA to realize various video form to the automatic switching method of pal mode video meeting ITU656 agreement, by setting up many general video protocol data storehouse, the data flow of incoming video signal is analyzed, with protocol type belonging to various conventional video protocol data stream multilevel iudge, detected image resolution and frame per second simultaneously; Design drawing picture frame double buffering A and B, adopt the mode of ping-pong operation by the valid pixel of video stream data frame stored in buffering area A, simultaneously according to the resolution of image to the complete data frame of buffer memory in the B of buffering area adopt bilinear interpolation algorithm be scaled 720*576 resolution sizes and stored in output memory cell; Produce according to YCbCr4:2:2ITU656 agreement and control pixel stream, from output memory cell, read the effective pixel region that the view data after convergent-divergent is filled into ITU656 pixel stream, thus be implemented to the conversion of PAL video protocols.Realize details specific as follows:
1] design is for the detection module of various conventional video protocols (comprising the VESA agreement of various resolution, the RawRGB form of various resolution, ITU601, ITU656, ITU709 and SMPTE274 agreement), detection module, by the time interval of an analysis full frame images expert field sync signal and the Changing Pattern of blanking zone video data, judges whether input video belongs to this kind of agreement;
Detection module arranges the state parameter of following video protocols, be respectively: line synchronizing signal (Hsync) pulse number comprised between opposite field synchronizing signal (Vsync) pulse, the Hsync pulse number comprised in Vsync pulse width range, pixel clock (CLK) cycle count comprised between adjacent Hsync pulse, the clk cycle counting comprised in Hsync pulse width range, the clk cycle pulse number comprised in data valid signal (De) pulse duration during valid pixel is capable, from the saltus step of Vsync signal pulse play first valid pixel capable between (field blanking district) Hsync pulse number of comprising, during valid pixel is capable from the saltus step of Hsync signal pulse play De signal effectively between (horizontal blanking district) clk cycle counting of comprising,
2] data of input video and control signal wire (CLK, Hsync, Vsync and De) are sent into each video protocols detection module respectively, detection module analyzes the data flow of input picture frame, detect and calculate above-mentioned state parameter, if the parameter detected is consistent with the state parameter of agreement to be detected, then think that input video belongs to this kind of agreement, otherwise, then this kind of agreement is not belonged to; If certain agreement coupling input video, then the detection module of this kind of agreement produces the enable signal CEn of high level, drives the acquisition module of its correspondence; Other protocol detection modules export as low level signal simultaneously, and make video acquisition module corresponding to its rear end place be in reset mode;
3] a multidiameter option switch controller is designed, the CEn exported with each video protocols detection module is for control signal amount, the video data stream that each video protocols acquisition module gathers is input, and gating CEn is that the collection video data stream that high level is corresponding carries out follow-up buffer memory and convergent-divergent process operation;
4] double buffering A and B is designed, the valid pixel of adjacent two two field pictures that buffer memory arrives continuously, ping-pong operation is carried out to buffering area A and B, when current frame image being filled into buffering area A, adopt bilinear interpolation algorithm to be scaled 720*576 to the previous frame image of buffer memory in B and differentiate size, and be filled in transmission output memory cell; At subsequent time period, next frame image buffer storage is entered buffering area B and bilinear interpolation process is carried out to the picture frame in the A of buffering area and exports memory cell stored in transmission;
5] the control pixel stream in pal mode video blanking district is produced according to ITU656 agreement, and the pixel data after convergent-divergent is read from exporting order memory cell between SAV and EAV of pixel stream, be filled into the effective pixel region of ITU656 pixel stream, thus realize the conversion of input video to pal mode video.
Automatic switching control method of the present invention successful implementation in certain project, can realize automatically detecting the video of the various protocols of infrared, laser and visible light sensor collection, complete video scaling process and unify to be converted to the PAL format video meeting ITU656 agreement, the processing speed of Video Quality Metric is fast, exports steady and audible.

Claims (6)

1. video format more than, to the automatic switching method of ITU656 agreement pal mode, is characterized in that, comprises the following steps:
1] automated conversion system is created:
Comprise protocol detection module: for carrying out agreement coupling to incoming video signal, and produce high level enable signal CEn or low-level enable signal according to matching result, comprise agreement 1 detecting unit, agreement 2 detecting unit ... and agreement N detecting unit;
Video acquisition module: gather the valid pixel of the incoming video signal matched through protocol detection module, comprises agreement 1 collecting unit, agreement 2 collecting unit ... and agreement N collecting unit; The collecting unit of various agreement and detecting unit one_to_one corresponding, described high level enable signal CEn inputs to the agreement N collecting unit of correspondence and multidiameter option switch controller;
Multidiameter option switch controller: under the control of high level enable signal CEn, buffers into collection memory cell by the effective pixel data that the video acquisition module that agreement is mated collects;
Gather memory cell: for the effective pixel data of buffer memory incoming video signal;
Convergent-divergent processing module: read effective pixel data for real time sequence from collection memory cell and adopt bilinear interpolation algorithm to be scaled the resolution sizes of 720*576, sending it to output memory cell simultaneously;
Export memory cell: for storing the effective pixel data after the process of convergent-divergent processing module;
And transmission control module: for producing the control pixel stream in pal mode video blanking district according to ITU656 agreement, and the pixel data after convergent-divergent is read from exporting order memory cell between SAV and EAV of pixel stream, be filled into the effective pixel region of ITU656 pixel stream, thus realize the conversion of input video to pal mode video;
2] vision signal of input is sent in protocol detection module respectively detects in each protocol detection unit, if the vision signal of input is mated with the agreement of this agreement N detecting unit, then this agreement N detecting unit produces the enable signal CEn of high level, and all the other protocol detection unit produce low-level enable signal simultaneously;
3] high level enable signal CEn drives the valid pixel of the agreement N collecting unit Gather and input vision signal corresponding with agreement N detecting unit; Low-level enable signal makes to be in reset mode with the agreement collecting unit corresponding to it simultaneously;
4] high level enable signal CEn is as the control signal amount of multidiameter option switch controller, makes a valid pixel of the vision signal of the agreement N collecting unit collection of protocols having coupling by multidiameter option switch controller cache to gathering memory cell;
5] convergent-divergent processing module is from the effective pixel data gathering memory cell order reading whole frame, and adopts bilinear interpolation algorithm to be scaled the resolution sizes of 720*576, is write simultaneously and exports memory cell;
6] control module produces pal mode video blanking district control pixel stream according to ITU656 agreement is sent, and the effective pixel data after convergent-divergent is read from exporting order memory cell between SAV and EAV of pixel stream, be filled into the effective pixel region of ITU656 pixel stream, thus realize the conversion of input video to pal mode video.
2. many video formats according to claim 1 are to the automatic switching method of ITU656 agreement pal mode, it is characterized in that: protocol detection module and video acquisition module work according to the mode of parallel pipelining process, synchronously mate with each protocol detection unit, and produce matching result when frame of video end of input simultaneously.
3. many video formats according to claim 1 and 2 are to the automatic switching method of ITU656 agreement pal mode, it is characterized in that, described collection memory cell comprises buffering area A and buffering area B: concrete storing step is:
When current video frame data are stored into buffering area A, the previous frame video data reading storage from the B of buffering area sends to convergent-divergent processing module;
When next frame video data is stored into buffering B, the data reading current video frame from the A of buffering area send to convergent-divergent processing module.
4. many video formats according to claim 3 are to the automatic switching method of ITU656 agreement pal mode, it is characterized in that,
The real-time analysis of described protocol detection module also calculates the following protocol status parameter of input video stream: the line synchronizing signal Hsync pulse number comprised between opposite field synchronizing signal Vsync pulse; The line synchronizing signal Hsync pulse number comprised in field sync signal Vsync pulse width range; The pixel clock clk cycle number comprised between adjacent lines synchronizing signal Hsync pulse; The pixel clock clk cycle number comprised in line synchronizing signal Hsync pulse width range; The pixel clock clk cycle number comprised in data valid signal De pulse duration during valid pixel is capable; From field sync signal Vsync impulse hits play first valid pixel capable between the line synchronizing signal Hsync pulse number that comprises; Play the pixel clock clk cycle counting comprised between data valid signal De from line synchronizing signal pulse Hsync saltus step during valid pixel is capable.
5. many video formats according to claim 4 are to the automatic switching method of ITU656 agreement pal mode, it is characterized in that:
Described protocol detection module comprise the VESA protocol video detecting unit of various resolution, various resolution RawRGB format video detecting unit, meet the video detecting unit of SMPTE274 agreement, meet the detecting unit of ITU601, ITU656 and ITU709 protocol video; Described video acquisition module comprise the VESA protocol video collecting unit of various resolution, various resolution RawRGB format video collecting unit, meet the video acquisition unit of SMPTE274 agreement, meet the collecting unit of ITU601, ITU656 and ITU709 protocol video; And detectable protocol type independently can customize and cutting according to embody rule demand.
6. many video formats according to claim 5 are to the automatic switching method of ITU656 agreement pal mode, it is characterized in that,
Described step 2] concrete steps be:
2.1] real-time synchronization calculates each state parameter of incoming video signal:
2.2] state parameter of each state parameter calculated with each agreement of corresponding protocol detection module is contrasted: if state parameter is consistent, then inputting video data belongs to this kind of agreement; Otherwise, then this kind of agreement is not belonged to.
CN201310682894.2A 2013-12-12 2013-12-12 Automatic switching method from many video formats to ITU656 agreement pal modes Active CN104717446B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310682894.2A CN104717446B (en) 2013-12-12 2013-12-12 Automatic switching method from many video formats to ITU656 agreement pal modes

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310682894.2A CN104717446B (en) 2013-12-12 2013-12-12 Automatic switching method from many video formats to ITU656 agreement pal modes

Publications (2)

Publication Number Publication Date
CN104717446A true CN104717446A (en) 2015-06-17
CN104717446B CN104717446B (en) 2017-10-24

Family

ID=53416345

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310682894.2A Active CN104717446B (en) 2013-12-12 2013-12-12 Automatic switching method from many video formats to ITU656 agreement pal modes

Country Status (1)

Country Link
CN (1) CN104717446B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430297A (en) * 2015-12-11 2016-03-23 中国航空工业集团公司西安航空计算技术研究所 Automatic control system for conversion from multi-video format to IIDC protocol video format
CN113438474A (en) * 2021-06-28 2021-09-24 杭州加速科技有限公司 Camera module testing device and control method thereof
CN114268794A (en) * 2021-11-25 2022-04-01 兰州空间技术物理研究所 Russian nonstandard display system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008503135A (en) * 2004-06-18 2008-01-31 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Video format detector and integrated circuit comprising such a video format detector and method for identifying different standards and / or types of video formats
CN101853309A (en) * 2010-06-18 2010-10-06 中国石油化工集团公司 Log data format automatic identification and conversion method based on database
US20110149032A1 (en) * 2009-12-17 2011-06-23 Silicon Image, Inc. Transmission and handling of three-dimensional video content
CN102630059A (en) * 2012-03-23 2012-08-08 深圳创维数字技术股份有限公司 Method and device for realizing FLV video play

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008503135A (en) * 2004-06-18 2008-01-31 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Video format detector and integrated circuit comprising such a video format detector and method for identifying different standards and / or types of video formats
US20110149032A1 (en) * 2009-12-17 2011-06-23 Silicon Image, Inc. Transmission and handling of three-dimensional video content
CN101853309A (en) * 2010-06-18 2010-10-06 中国石油化工集团公司 Log data format automatic identification and conversion method based on database
CN102630059A (en) * 2012-03-23 2012-08-08 深圳创维数字技术股份有限公司 Method and device for realizing FLV video play

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430297A (en) * 2015-12-11 2016-03-23 中国航空工业集团公司西安航空计算技术研究所 Automatic control system for conversion from multi-video format to IIDC protocol video format
CN105430297B (en) * 2015-12-11 2018-03-30 中国航空工业集团公司西安航空计算技术研究所 The automatic control system that more video formats are changed to IIDC protocol videos form
CN113438474A (en) * 2021-06-28 2021-09-24 杭州加速科技有限公司 Camera module testing device and control method thereof
CN113438474B (en) * 2021-06-28 2023-03-14 杭州加速科技有限公司 Camera module testing device and control method thereof
CN114268794A (en) * 2021-11-25 2022-04-01 兰州空间技术物理研究所 Russian nonstandard display system
CN114268794B (en) * 2021-11-25 2024-05-03 兰州空间技术物理研究所 Russian nonstandard display system

Also Published As

Publication number Publication date
CN104717446B (en) 2017-10-24

Similar Documents

Publication Publication Date Title
CN104717442A (en) Method of automatically converting video of multiple formats to VESA (Video Electronics Standards Association)-protocol 1600*1200-resolution 60Hz-frame rate video
CN104717444A (en) Method of automatically converting video of multiple formats to VESA (Video Electronics Standards Association)-protocol 1920*1440-resolution 75Hz-frame rate video
CN107249101B (en) High-resolution image acquisition and processing device
CN103595924B (en) A kind of image fusion system based on Cameralink and method thereof
KR101659346B1 (en) Method and device for processing video image
CN103647918A (en) Video synchronization method and device
CN103248797A (en) Video resolution enhancing method and module based on FPGA (field programmable gate array)
CN104168487A (en) Video signal frame synchronization method and device
CN102427543B (en) Platform for processing frame synchronization 3D real-time video information and processing method thereof
CN109714621A (en) A kind of multichannel dynamic video analogy method and its processing system that timing is configurable
RU2013125228A (en) METHOD AND DEVICE FOR DETECTING INPUTS BY USING GESTURES
CN104717446A (en) Method for automatically converting videos of multiple formats to video of ITU 656 protocol PAL format
CN102118289B (en) Real-time image segmentation processing system and high-speed intelligent unified bus interface method based on Institute of Electrical and Electronic Engineers (IEEE) 1394 interface
CN105120235A (en) Industrial image collection system based on USB 3.0 interface, and image collection processing method of industrial image collection system
CN104717445A (en) Method for automatically converting videos of multiple formats to video of BT.656 protocol NTSC format
Birla FPGA based reconfigurable platform for complex image processing
CN103024430A (en) Control display method and system for simulating red, green and blue (RGB) signal
CN105430297B (en) The automatic control system that more video formats are changed to IIDC protocol videos form
CN102158655B (en) Jitter-free post-correction system for digital video interface (DVI)/high definition multimedia interface (HDMI)/display port (DP)/video graphics array (VGA) signals
CN107071267B (en) Double-path synchronous bright and dark pupil image acquisition method for sight tracking system
CN104836959A (en) FPGA-based Multi-mode automatic switchover collection system of array CMOS image sensor
CN104717443B (en) Automatic switching method from many video formats to SMPTE274 agreement 1080i resolution videos
CN102026018B (en) Multi-format digital video signal switching detection method
CN102054414A (en) Program controlled liquid crystal module test image generating system and control method thereof
CN105072387A (en) Video recording method for video door bell and video door bell

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant