CN102630010A - Wireless video transmission system and transmission method thereof - Google Patents

Wireless video transmission system and transmission method thereof Download PDF

Info

Publication number
CN102630010A
CN102630010A CN2012100904647A CN201210090464A CN102630010A CN 102630010 A CN102630010 A CN 102630010A CN 2012100904647 A CN2012100904647 A CN 2012100904647A CN 201210090464 A CN201210090464 A CN 201210090464A CN 102630010 A CN102630010 A CN 102630010A
Authority
CN
China
Prior art keywords
video
data
module
image
wireless
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012100904647A
Other languages
Chinese (zh)
Inventor
杜琳
张凡
李波
杨勇
马宏安
曹军勤
马列红
薛亚茹
李钧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shaanxi Fenghuo Communication Group Co Ltd
Original Assignee
Shaanxi Fenghuo Communication Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shaanxi Fenghuo Communication Group Co Ltd filed Critical Shaanxi Fenghuo Communication Group Co Ltd
Priority to CN2012100904647A priority Critical patent/CN102630010A/en
Publication of CN102630010A publication Critical patent/CN102630010A/en
Pending legal-status Critical Current

Links

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention relates to the field of wireless video transmission and discloses a wireless video transmission system and a transmission method thereof. The wireless video transmission system comprises a video acquisition module, an image extraction module, an encoder, a wireless transmission module, a wireless receiving module, a decoder, an image interpolation module and a video display module, wherein the video acquisition module is used for acquiring a video image to obtain video original data; the image extraction module is used for carrying out image extraction processing on the video original data to obtain video extraction data; the encoder is used for carrying out source encoding and channel encoding on the video extraction data to obtain vide transmission data; the wireless transmission module is used for transmitting the vide transmission data; the wireless receiving module is used for receiving the vide transmission data; the decoder is used for decoding the vide transmission data to obtain the video extraction data; the image interpolation module is used for carrying out image interpolation processing on the video extraction data to obtain video recovery data; and the video display module is used for displaying the video recovery data.

Description

A kind of wireless video transmission system and transmission method thereof
Technical field
The present invention relates to the wireless video transmission field, particularly a kind of wireless video transmission system and transmission method thereof.
Background technology
Along with the development of mobile communication business, the wireless video transport service has obtained to use very widely.But the characteristics of video information and wireless transmission environment have determined the wireless video transmission technology need solve many technical bottlenecks.
The characteristics of video information mainly comprise: (1) data volume is big.For the image of QCIF, its resolution is 176X144 (its value is 25344), that is to say that the pixel that every frame video image comprises is 25344.If each pixel representes that by 24 the data volume of a two field picture reaches 594kbit.Consider that real time video image transmits desired frame frequency (TV signal is 25fps), message transmission rate will reach 14.5Mbps.(2) real-time.People are that video pictures is smooth to the basic demand of vision signal, and transmission delay is little, and real-time is good.General data communication is lower to the requirement of real-time, and therefore for normal data communications, video communication requires better real-time property.
The characteristics of wireless transmission environment: (1) wireless signal-path band width resource-constrained.Because multipath fading, the time delay expansion, noise effect and multiple access interference etc., wireless channel what will face is a series of rugged environments, limited to the above bandwidth resources ten minutes of wireless channel that causes.Especially for the transmission of video signals that realizes big data quantity, the resource of wireless channel is nervous especially.The network that becomes when (2) wireless network is one.The network that the physical characteristics of wireless channel self became when having determined that it is one.
Understand the characteristics of above-mentioned video information and wireless transmission environment, can know that video information wants normal transmission in the wireless channel of resource-constrained, just necessarily need the amount of video information that transmit be compressed in the scope that wireless channel can hold as far as possible.Therefore; The transmission course of existing wireless video transmission system comprises that video acquisition, source encoding, chnnel coding, wireless channel, channel-decoding, source coding, video show; Its method is directly the video initial data of sampling to be sent in the encoder to encode; Transfer to decoder through wireless channel then, deliver to video display apparatus again through decoded video code flow and show.
Can be known that by above wireless video transmission method existing wireless video transmission system technology point mainly concentrates on the encoding and decoding technique of video, this also is the main support that systemic-function realizes.Video coding and decoding technology itself is very ripe; Be mainly reflected in one group of standard agreement realizing its function; These agreements have MPEG-1, MPEG-2, MPEG-4 and H.263, H.264 wait; They are mainly by existing two big ITU-T of standardization body and MPEG to formulate and accomplish in the world, and now agreements that adopt are MPEG-4 and H.264 more, and H.264 than its compression performance of MPEG-4 lifting have further been arranged.
With regard to its H.264 the algorithm itself in the agreement realize the coding and decoding video function, fairly perfect now.Yet the problem that existing wireless video transmission system exists is the restriction that receives its channel width limited, if want to transmit high-resolution video data, along with the increase of deal with data amount, it also just can not meet the demands.
For example, for the video data of transmission QCIF form, its resolution is 176X144 (its value is 25344), that is to say that the pixel that every frame video image comprises is 25344.If each pixel is represented by 24; The data volume of one two field picture reaches 594kbit; Frame frequency is 25fps; Data volume through after the compression H.264 needs the bandwidth of 40kbps~60kbps, that is to say, H.264 under the finite bandwidth of 40kbps~300kbps, can obtain smoothness as far as possible, show clearly.
Yet for the video data of transmission D1 form, its resolution is 720X576 (its value is 414720), that is to say that the pixel that every frame video image comprises is 414720, can see that its data volume is more than 16 times of QCIF.If same each pixel is represented by 24; Frame frequency is 25fps; The bandwidth that needs 1.4Mbps~1.6Mbps through the data volume after H.264 compressing; Need the bandwidth of 1.4Mbps~2.4Mbps through the data volume after the MPEG-4 compression, and through the data volume after the MPEG-2 compression even will reach the bandwidth of 2.4Mbps~4Mbps.
Therefore, can see if improve the resolution of transmission of video, that is to say data quantity transmitted in case increase, receive its band-limited restriction, existing wireless video transmission system just has been difficult to efficiently transmitting video data.
Summary of the invention
The object of the present invention is to provide a kind of wireless video transmission system and transmission method thereof, can under limited bandwidth, transmit high-resolution video information.
Principle of the present invention is based on existing wireless video transmission system; Increase the image contract module at its source encoding module front end; Thereby reduced in transmission course channel the data volume of the video information that will hold; And increase the image interpolation module in source coding module rear end, recover original video information, thereby adapted to the requirement of wireless channel transmission.Wherein, thus image contract is meant the image processing techniques that the resolution that reduced original image through certain algorithm process reduces the raw image data amount; Thereby being meant the resolution that has improved original image through certain algorithm process, image interpolation makes original image image restored treatment technology.
Technical scheme of the present invention is following.
(1) a kind of wireless video transmission system is characterized in that, comprises
Video acquisition module is gathered video image, obtains the video initial data;
The image contract module is carried out image contract to the video initial data and is handled, and obtains the video extracted data;
Encoder carries out source encoding, chnnel coding to the video extracted data, obtains the video transmission data;
Wireless transmitter module, emission video transmission data;
Wireless receiving module, receiver, video transmission data;
Decoder is decoded to the video transmission digital data, obtains the video extracted data;
The image interpolation module is carried out image interpolation process to the video extracted data, obtains the video recovery data,
Video display module shows the video recovery data.
In the technique scheme, be provided with filtration module between said video acquisition module and the image contract module, the video initial data is carried out filtering.
(2) a kind of wireless video transmission method is characterized in that, may further comprise the steps: at first, gather video image, obtain the video initial data; The video initial data is carried out image contract handle, obtain the video extracted data; Again the video extracted data is carried out source encoding, chnnel coding, obtain the video transmission data; Then,, again the video transmission data that receive are decoded, obtain the video extracted data through wireless transmitter module and wireless receiving module physical transfer video transmission data; At last, the video extracted data is carried out image interpolation process, obtain the video recovery data, and show through the video display module certificate.
In the technique scheme, said the video initial data is carried out earlier video being carried out filtering to the video initial data before image contract handles.
The present invention compares with existing wireless video transmission system, through after video acquisition module, increasing the image contract module, video resolution is reduced, and has reduced original data volume, has improved the treatment effeciency of encoder and wireless transmitter module.Accordingly, increase the image interpolation module behind the decoder, the video extracted data is carried out image interpolation process, obtain the video recovery data, recover video resolution.Technique scheme reduced in transmission course channel the video data volume that will hold, thereby adapted to the requirement of wireless channel transmission.
Description of drawings
Below in conjunction with accompanying drawing and embodiment the present invention is done further explain.
Fig. 1 is the structured flowchart of wireless video transmission system.
Embodiment
With reference to Fig. 1, be wireless video transmission system of the present invention, wherein, video acquisition module can be camera, its effect is to gather video image, obtains the video initial data.
The image contract module, the dsp chip of employing TI in particular for the TMS320DM64x series realization of Video processing, specifically can be TMS320DM642, TMS320DM648, TMS320DM6467 etc.; Wherein algorithm can adopt nearest-neighbor method, linear interpolation method, bicubic interpolation method.Present embodiment adopts nearest-neighbor method, and its principle is simple, and processing speed is fast, and function is the video initial data to be carried out image contract handle, and obtains the video extracted data; Adopt linear interpolation method to amplify the image smoothing that the image of generation produces than nearest-neighbor method, but can make the details of image possibly produce degeneration, when multiplication factor was bigger, this phenomenon was more obvious; Adopt bicubic interpolation method algorithm complex the highest, picture quality is higher, but processing speed slows down.
Encoder, the dsp chip of employing TI in particular for the TMS320DM64x series realization of Video processing, specifically can be TMS320DM642, TMS320DM648, TMS320DM6467 etc.; Its algorithm can adopt MPEG4, H264 encryption algorithm, preferentially adopts the H264 encryption algorithm good, and the video extracted data is carried out source encoding, chnnel coding, obtains the video transmission data.
Wireless transmitter module adopts ultrashort wave, microwave communication transmitter to realize, emission video transmission data; Corresponding wireless receiving module adopts ultrashort wave, microwave communication receiving equipment to realize, receiver, video transmission data.
Decoder, the dsp chip of employing TI in particular for the TMS320DM64x series realization of Video processing, specifically can be TMS320DM642, TMS320DM648, TMS320DM6467 etc.; Its algorithm can adopt MPEG4, H264 decoding algorithm, preferentially adopts the H264 decoding algorithm good, and the video transmission data are decoded, and obtains the video extracted data.
The image interpolation module, the dsp chip of employing TI in particular for the TMS320DM64x series realization of Video processing, specifically can be TMS320DM642, TMS320DM648, TMS320DM6467 etc.; Its algorithm can adopt nearest-neighbor method, linear interpolation method, bicubic interpolation method, and the video extracted data is carried out image interpolation process, obtains the video recovery data.Adopt nearest-neighbor method, its principle is simple, and processing speed is fast, and function is that the video extracted data is carried out image interpolation process, obtains the video recovery data.Adopt linear interpolation method to amplify the image smoothing that the image of generation produces than nearest-neighbor method, but the details generation of image is degenerated, when multiplication factor was bigger, this phenomenon was more obvious; Adopt bicubic interpolation method algorithm complex the highest, picture quality is higher, but processing speed slows down.
Video display module can show the video recovery data on computer display or common monitor through computer host computer application program.
The image interpolation method that following brief description the present invention uses always, the inverse process of image interpolation method is an image extraction method.
Nearest-neighbor method, its basic thought are to fill the image after the interpolation with the pixel value of fixing point in the original image, just original image are carried out pointwise and handle, and all use every bit wherein its gray value to carry out duplicating for m time (m is the interpolation multiple).The interpolating function that it adopts is a constant function (rectangular function):
This algorithm interpolation is simple, amount of calculation is very little, and in all interpolation methods, this interpolation method is fastest.But; This algorithm shortcomings is lower algebraically match rank; When grey level had trickle variations between the pixel that comprises in the image, nearest-neighbor method can produce artificial vestige in image, and the distortion of edge of image ladder is apparent in view; Blocking artifact occurs through regular meeting, the image border also possibly produce sawtooth effect.
Linear interpolation method is called the single order interpolation again, when adopting linear interpolation algorithm that image is amplified, image line and column signal is done twice processing, so this method often is called as bilinear interpolation.The basic thought of linear interpolation is: treat four pixels of interpolation point vicinity on every side and use different weights to carry out weighted average; Estimate the value of required pixel; The size of weight confirms that by the distance of interpolating pixel and surrounding pixel is far and near the weight of distance is little, and then weight is big on the contrary.The interpolating function that it adopts is a trigonometric function:
The image that linear interpolation the produces image that nearest-neighbor method produces of comparing is more level and smooth, degenerates but the details of image is produced, and when multiplication factor was bigger, this phenomenon was more obvious.
Bicubic interpolation is with a kind of three rank interpolation methods of pixel as a reference of 16 points around the interpolation point.Typical bicubic interpolation kernel function is:
g ( x ) = ( a + 2 ) x 3 - ( a + 3 ) x 2 + 1 0 &le; x < 1 ax 3 - 5 ax 2 + 8 ax + 4 a 1 &le; x < 2 0 2 &le; x
Wherein parameter a has several kinds of values, can be a=-1 ,-0.5,0.75 etc.The bicubic interpolation method has two demi continuities; Thereby interpolation result has good slickness, can reduce the edge crenellated phenomena, yet along with the increase of interpolation algorithm match order number; Algorithm complex also increases thereupon; Therefore algorithm operation quantity is big, and computing time is long, may show weak point for the requirement of real-time in the practical application.
In the wireless video transmission system of the present invention, the wireless video transmission is based on wireless channel to be carried out, and wireless channel is realized by wireless transmitter module and wireless receiving module.Wherein, encoder comprises source encoding module and channel coding module, and decoder comprises source coding module and channel decoding module.The mentioned image contract processing of the present invention is based on the completion of source encoding front end, just directly carries out down-sampling for the original video data of gathering and handles; Image interpolation process is based on the completion of source coding rear end, just before decoded video data being delivered to video display module, carries out the up-sampling interpolation and recovers to handle.
Transmission system through the present invention's design; For the video data of transmission D1, its resolution is 576X720, after the image contract resume module; If resolution is reduced to 288X352; Its data volume can reduce and is about originally 1/4, if resolution is reduced to 144X176, its data volume can reduce and is about original 1/16.In the process of implementing image contract, may produce spectral aliasing, therefore,, handle front end at image contract and need carry out Filtering Processing if there is aliasing, just increase the average treatment that filtration module carries out sampled value, can adopt Gaussian filter.
Through the video data behind the image contract; Delivering to encoder encodes, transfer to decoder via wireless channel then, there is the video data behind the decoder decode carrying out image interpolation process; This is the process that a video data recovers, and need video data be returned on the preceding resolution of transmission.Image interpolation process is the gray value that estimates each pixel of target image through the gray value of original image pixels in essence.This need be interpolation pixel mapping certain position to original image; The coordinate and the non-integer of common this position; Thereby, be through the predefined interpolating function of the pixel of " existence " (being positioned on the rounded coordinate) application around this position is tried to achieve its gray value.
Based on above-mentioned wireless video transmission system, its method may further comprise the steps: at first, gather video image, obtain the video initial data; Handle carrying out image contract after the filtering of video initial data, obtain the video extracted data; Again the video extracted data is carried out source encoding, chnnel coding, obtain the video transmission digital data; Then,, again the video transmission data that receive are decoded, obtain the video extracted data through wireless transmitter module and wireless receiving module physical transfer video transmission data; At last, the video extracted data is carried out image interpolation process, obtain the video recovery data, and show through the video display module certificate.
For example; Through the transmission system of the present invention's design, for the video image (frame of video) of transmission D1, its resolution is 576X720; After the image contract processing; If resolution is reduced to 288X352, its data volume reduce be about original 1/4, if same each pixel is represented by 24; Frame frequency is 25fps; The bandwidth of 350Kbps~400Kbps need be about through the data volume of compression after (H.264 standard code) H.264, the bandwidth of 350Kbps~600Kbps need be about through the data volume after the MPEG-4 compression (MPEG-4 standard code), and through the data volume after the MPEG-2 compression (Moving Picture Experts Group-2 coding) even will reach the bandwidth that is about 600Kbps~1Mbps; If resolution is reduced to 144X176; Its data volume reduces especially and is about original 1/16; If same each pixel representes that by 24 frame frequency is 25fps, need be about the bandwidth of 40Kbps~100Kbps through the data volume after H.264 compressing; The data volume of passing through after MPEG-4 compresses need be about the bandwidth of 40Kbps~150Kbps, and passes through the data volume after the MPEG-2 compression even will reach the bandwidth that is about 150Kbps~250K bps.Wherein, need to prove: the inferior QCIF of frame of video form, QCIF, CIF, 4CIF, D1 the brightness definition/resolution of correspondence respectively are 96 * 128,144 * 176,288 * 352,576 * 704,576 * 720.
Although more than combine accompanying drawing that embodiment of the present invention are described, the present invention is not limited to above-mentioned specific embodiments and applications field, and above-mentioned specific embodiments only is schematic, guiding, rather than restrictive.Those of ordinary skill in the art under the situation that does not break away from the scope that claim of the present invention protects, can also make a variety of forms under the enlightenment of this specification, these all belong to the row of the present invention's protection.

Claims (4)

1. a wireless video transmission system is characterized in that, comprises
Video acquisition module is gathered video image, obtains the video initial data;
The image contract module is carried out image contract to the video initial data and is handled, and obtains the video extracted data;
Encoder carries out source encoding, chnnel coding to the video extracted data, obtains the video transmission data;
Wireless transmitter module, emission video transmission data;
Wireless receiving module, receiver, video transmission data;
Decoder is decoded to the video transmission data, obtains the video extracted data;
The image interpolation module is carried out image interpolation process to the video extracted data, obtains the video recovery data,
Video display module shows the video recovery data.
2. wireless video transmission system according to claim 1 is characterized in that, is provided with filtration module between said video acquisition module and the image contract module, and the video initial data is carried out filtering.
3. a wireless video transmission method is characterized in that, may further comprise the steps: at first, gather video image, obtain the video initial data; The video initial data is carried out image contract handle, obtain the video extracted data; Again the video extracted data is carried out source encoding, chnnel coding, obtain the video transmission data; Then,, again the video transmission data that receive are decoded, obtain the video extracted data through wireless transmitter module and wireless receiving module physical transfer video transmission data; At last, the video extracted data is carried out image interpolation process, obtain the video recovery data, and show through video display module.
4. wireless video transmission method according to claim 3 is characterized in that, said the video initial data is carried out earlier video being carried out filtering to the video initial data before image contract handles.
CN2012100904647A 2012-03-30 2012-03-30 Wireless video transmission system and transmission method thereof Pending CN102630010A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012100904647A CN102630010A (en) 2012-03-30 2012-03-30 Wireless video transmission system and transmission method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012100904647A CN102630010A (en) 2012-03-30 2012-03-30 Wireless video transmission system and transmission method thereof

Publications (1)

Publication Number Publication Date
CN102630010A true CN102630010A (en) 2012-08-08

Family

ID=46588155

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012100904647A Pending CN102630010A (en) 2012-03-30 2012-03-30 Wireless video transmission system and transmission method thereof

Country Status (1)

Country Link
CN (1) CN102630010A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103096086A (en) * 2013-02-06 2013-05-08 上海风格信息技术股份有限公司 Method of sampling forward in multi-picture display to achieve system optimization
CN104427384A (en) * 2013-08-26 2015-03-18 联想(北京)有限公司 Data processing method, image demonstration method, data processing apparatus and demonstration equipment
CN106210745A (en) * 2016-08-31 2016-12-07 成都市和平科技有限责任公司 A kind of intelligent jpeg image coding/decoding system and method
CN106658095A (en) * 2016-10-18 2017-05-10 武汉斗鱼网络科技有限公司 Webcasting video transmission method, server and user equipment
CN108184116A (en) * 2017-12-18 2018-06-19 西南技术物理研究所 A kind of image rebuilding method suitable for the transmission of wireless data chain
CN111031324A (en) * 2019-12-09 2020-04-17 中国电子科技集团公司第二十研究所 Video data transmission method based on high-dimensional matrix transformation

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080273861A1 (en) * 2005-06-25 2008-11-06 Huawei Technologies Co., Ltd. Method for Measuring Multimedia Video Communication Quality
CN101835044A (en) * 2010-04-23 2010-09-15 南京邮电大学 Grouping method in frequency domain distributed video coding

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080273861A1 (en) * 2005-06-25 2008-11-06 Huawei Technologies Co., Ltd. Method for Measuring Multimedia Video Communication Quality
CN101835044A (en) * 2010-04-23 2010-09-15 南京邮电大学 Grouping method in frequency domain distributed video coding

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103096086A (en) * 2013-02-06 2013-05-08 上海风格信息技术股份有限公司 Method of sampling forward in multi-picture display to achieve system optimization
CN104427384A (en) * 2013-08-26 2015-03-18 联想(北京)有限公司 Data processing method, image demonstration method, data processing apparatus and demonstration equipment
CN106210745A (en) * 2016-08-31 2016-12-07 成都市和平科技有限责任公司 A kind of intelligent jpeg image coding/decoding system and method
CN106658095A (en) * 2016-10-18 2017-05-10 武汉斗鱼网络科技有限公司 Webcasting video transmission method, server and user equipment
CN108184116A (en) * 2017-12-18 2018-06-19 西南技术物理研究所 A kind of image rebuilding method suitable for the transmission of wireless data chain
CN111031324A (en) * 2019-12-09 2020-04-17 中国电子科技集团公司第二十研究所 Video data transmission method based on high-dimensional matrix transformation

Similar Documents

Publication Publication Date Title
US11361404B2 (en) Electronic apparatus, system and controlling method thereof
CN102630010A (en) Wireless video transmission system and transmission method thereof
CN101345870B (en) Encoding and decoding device for low-code rate video super-resolution reconstruction
TW201818346A (en) A method and system for providing high resolution image through super-resolution reconstruction
CN102811373A (en) Method for carrying out video broadcast on Internet and mobile Internet by mobile terminal
EP3038370A1 (en) Devices and method for video compression and reconstruction
Le et al. Computing offloading over mmWave for mobile VR: Make 360 video streaming alive
AU2018250308B2 (en) Video compression using down-sampling patterns in two phases
US20210352347A1 (en) Adaptive video streaming systems and methods
WO2021057480A1 (en) Video coding method and video decoding method, and related apparatuses
WO2021057479A1 (en) Video coding method, video decoding method, and related devices
US10448009B1 (en) Determining sample adaptive offset filter parameters
CN114125448A (en) Video encoding method, decoding method and related devices
US20110176742A1 (en) Image processing apparatus and image processing method
CN107222749B (en) A kind of chaos code constructing method for wireless video transmission
WO2021057478A1 (en) Video encoding and decoding method and related apparatus
US11336902B1 (en) Systems and methods for optimizing video encoding
He et al. Real-Time Neural Video Recovery and Enhancement on Mobile Devices
CN115695905A (en) Video stream recovery method, electronic device and computer-readable storage medium
US9432614B2 (en) Integrated downscale in video core
TW201121317A (en) Image capturing and transmission device and image receiving and reconstruction device.
CN110636295A (en) Video encoding and decoding method and device, storage medium and electronic device
CN102905129B (en) Distributed coding method of still image
He et al. NERVE: Real-Time Neural Video Recovery and Enhancement on Mobile Devices
WO2024078403A1 (en) Image processing method and apparatus, and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20120808