CN102404511A - Video postproduction system and information combination method of same - Google Patents
Video postproduction system and information combination method of same Download PDFInfo
- Publication number
- CN102404511A CN102404511A CN2010102819230A CN201010281923A CN102404511A CN 102404511 A CN102404511 A CN 102404511A CN 2010102819230 A CN2010102819230 A CN 2010102819230A CN 201010281923 A CN201010281923 A CN 201010281923A CN 102404511 A CN102404511 A CN 102404511A
- Authority
- CN
- China
- Prior art keywords
- video
- information
- behind
- input
- display effect
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Studio Circuits (AREA)
Abstract
The invention relates to a video postproduction system and an information combination method of the same, in particular to the method for combining information which applies specific display effect in a postproduction manner. According to an embodiment, a video is input through a user interface provided by the video postproduction system, and the information to be combined with the video and the applied display effect are input. The video postproduction system then decodes the video, extracts frame and time stamp and pixelates image. Matched with the input information, the effect, a set play time and other parameters, an input video is produced after decoding. An output video format can also be selected.
Description
Technical field
The present invention relates to the method for system system behind a kind of video and combining information thereof, be meant a kind of production method that information and display effect is incorporated into already present video especially.
Background technology
In the prior art; When playing a film; Show captions like need, need in regular turn captions be incorporated into film according to the time through film titler usually and show, the zone that needs captions of special standard to show when wherein film shows; Such as the background area that below film, shows a horizontal type black matrix, so that captions are presented in this zone.
In addition; Prior art more has can be arranged at outdoor various information display panels such as large-scale advertisement billboard, TV news picture or convenience store cashier; General objects is to show multifarious information through the information display panel of a limited area; Such as in order to obtain consumer's favor, can utilize the information display panel of various occasions to show the information of extensive stock, news etc.
And be the time according to film in the general film titler running of using, utilize needed literal the effect of transparency to be presented at the front end in the film.
About captions be incorporated into film coding techniques can (day for announcing: the captions detail file coding/decoding method and the device that 1997/05/21) are disclosed, this example be to describe the captions detail file to be encoded in the video image with reference to No. the 306113rd, TaiWan, China patent announcement.With video decode, capture the information of frame (frame) earlier, be written into character to afterwards and be written into the district, be written into the district corresponding to pixel (pixel) information data area, and contain dislocation information.Wherein, can change the effect that shows, combine pixel information and the captions of revising through font, color afterwards, encode being written into the district, behind combination video and captions, export through the color look-up table that shows captions.
Can be again with reference to the flow process of prior art captions synchronous display method shown in Figure 1; According to this general flow; At the beginning of step; Utilize data bank to set up the captions data (step S101) of waiting for output, data bank comprises that in this function each notes record has the data of the corresponding movie of captions position at least, and provides index (index) correctly to export according to this.The user can change according to demand, and the display effect (step S103) with decision demonstration captions comprises captions font, color etc.Because captions will comprise the starting position and the end position of synchronous corresponding image data according to the time or the position of the specific broadcast of the corresponding video of index, and can be from the mark of the controlled usefulness of data bank, step is introduced index (step S105) at this moment.
Be written into the captions data (step S107) in the data bank afterwards, captions can with video according to the index synchronous playing.In the process of displaying video, utilize timer to judge present play position, show (step S109) with synchronous pick-up captions data.
The described technology of Fig. 1 can be with reference to No. 384465 (day for announcing: the display unit and the display packing thereof of the interactive image sychronization captions that 2000/03/11) is disclosed of prior art TaiWan, China patent announcement.
Summary of the invention
The technology that the captions that provide with respect to prior art combine with video; Though have prior art can through change the captions color, font changes outside the display effect, the present invention more proposes the method for system system behind a kind of video and combining information thereof, after being written into vision signal; Can be through the information of back system means with required demonstration; The display effect that comprises selection combines the information of required demonstration to export in the lump video through coded program, produces the display effect that is different from prior art.
According to embodiment, system system receiver, video behind the video, the user through video after the inputting interface that provided of system system select video archive.The system system will carry out decoding behind the video, capture the wherein information of frame and contained time stamp.
The user then can pass through the information that user interface input desire combines with video, and produces the image of pixelation, follows the display effect that selection is desired to apply mechanically, and becomes the data that can combine with video after applying mechanically.
The system system then receives by the user and sets through the broadcast of interface setting behind the video, comprises and sets time started and the concluding time that input information shows, also comprises the perdurabgility of display effect etc.
With after selected effect combines, set combining information, display effect and video according to the time stamp of each frame of video with playing, through the input information of pixelation through each pixel information coding back generation one output video.Wherein in the process that video combines; Each frame that captures in the former video combines with the information of input with the reproduction time of setting according to time stamp; In the picture of each frame, set by effect, as rolling; Promptly do the displacement of captions, be combined into new video to the picture of each frame again according to the direction of rolling.Can select the output video form at last.
And use system system behind the video of method of above-mentioned combining information; According to embodiment; Mainly comprise the data processing unit that is linked to each circuit element; Handle behind the video each interelement signal in the system system, system is through the output/input unit incoming video signal, the vision signal that combines with information with the output warp.Particularly including the codec unit of decoding input video, and after encoding, be produced as the output signal of specific format.
System has an effect data bank, mainly is can be with the various information display effects of functional module stores.System more comprises selection boundary element that supplies user's use and the memory cell that is used for temporary data.
Specifically, said method and system can implement by hardware, also can in whole Moviemaking process, utilize the software method to carry out, and image application is handled captions are blended in the whole film, and applies mechanically the effect of captions rolling or captions.
Use the present invention, can let the user simply and easily according to different demands, picture or literal are merged in any film, and make different effects, can be used in media advertisement or the digital signage.
Description of drawings
Fig. 1 is shown as the flow process of prior art captions synchronous display method;
Fig. 2 is shown as the functional block diagram of system system behind the video of the present invention;
Shown in Figure 3 for the flow process of video combining information method of the present invention;
Fig. 4 A is shown as the sketch map of video inputting interface;
Fig. 4 B is shown as the interface sketch map of selecting the input archives;
Fig. 4 C is shown as the sketch map of information input interface;
Fig. 4 D is shown as the sketch map of selecting output format;
Fig. 4 E is shown as the sketch map of image processing process;
Fig. 4 F is shown as video output picture view.
Description of reference numerals: 201-video input; The output of 210-video; The 202-I/O device; The 203-output/input unit; The 204-display unit; The 205-codec unit; The 206-data processing unit; 207-effect data bank; 208-selects boundary element; The 209-memory cell; 40-video inputting interface; 401-increases video button; 403-video information district; The 405-information display area; The 42-information input interface; 421-literal input area; 423-effect selection district; 425-plays the setting district; 44-video input picture; 443-film district; The 441-subtitle region;
Step S101～synchronous the flow for displaying of S109 prior art captions;
The flow process of step S301～S321 video combining information of the present invention.
Embodiment
The present invention is the method for system system and combining information thereof behind a kind of video, particularly use one after the system means, such as utilizing a back system software; Or relevant work flow; Except being written into literal or pattern-information, more can pass through user interface, let the user import the information that desire combines with video; And after selecting display position, display effect, information and display effect are incorporated into already present video and export.
According to embodiment, the system system can be with reference to shown in Figure 2 behind the video, the functional block diagram of system system behind the video of the present invention.The system system can a software approach realize behind this video, or reaches through a signal processing circuit, like integrated circuit (IC, Integrated Circuit).
The system system mainly is made up of a data process unit 206 connected modules that respectively have specific function behind the video, particularly is used for through after the image processing, in conjunction with the information and the display effect of film and institute's desire demonstration, and exports new vision signal.
According to accompanying drawing; The system system comprises video output (210 behind the video; First vision signal) import the output/input unit 203 of (201, second vision signal of system system handles behind video) signal with video, the user can be through I/O device 202 input informations that are connected in output/input unit 203; Comprise the medium that stores film, camera device, host computer etc.; Video can such as terminal display, or directly be output in various multimedia billboard by the display unit that is connected in output/input unit 203 204 display result (second vision signal) at last.
Output/input unit 203 is connected in data processing unit 206; Data processing unit 206 is used for processing signals conversion and image processing; The information of user's input is carried out pixelation; Become the form that can combine with display effect with film, display effect is particularly formed by a plurality of effect algorithms that are stored in the effect data bank.The codec unit 205 that is connected in data processing unit 206 is then in order to first vision signal of decoding, and behind combining information, is specific format with signal encoding, exports second vision signal.System is particularly including effect data bank 207, and it connects data processing unit 206, and the principal character according to the present invention mainly is to store various information display effects, in effect data bank 207, will module be provided with the functional module stored in form according to user's selection.
Effect is handled through data processing unit 206 after the user selects, and the data that particularly combines the user to be imported by the user interface of selecting boundary element 208 to be provided comprises the display effect option of information (literal, image) and effect data bank 207.Select boundary element 208 to be connected in effect data bank 207, present menu through display and supply the user to select, receive by the user and select the instruction that produces, compare out the respective modules of data bank.After selecting, and cooperate other to set,, be used in input information, forming display effect, and combine original video signal through pixelation by a cover of a plurality of effect algorithms that are stored in effect data bank 207 like the adjustment of time, speed, display effect etc.Such as, according to the calculation of display effect, make Trajectory Design to each pixel, produce the effect of horse race lamp, upset, rolling etc.
Memory cell 209 is connected with data processing unit 206; It mainly is the temporary memory bank that is used for system system after the whole video; When especially carrying out the vision signal processing; Need video be temporary in the memory cell 209 through frame (frame) data that decoding produces, data processing unit 206 then takes out signal by memory cell 209, in conjunction with the content of input information, display effect and former input video.
Specifically; The system system can combine each effects module of being put down in writing in input video and the effect data bank 207 effectively behind the video that the present invention proposes; The information that makes can be shown on the video with specific display effect, particularly to the information of instant playback on film.
Use system system behind the above-mentioned video; The user can desire to be incorporated into literal, symbol or the pattern on the video through user interface (like above-mentioned selection boundary element 208) input; User interface more provides each display effect option to select to the user; System promptly receives one or more display effect options through user interface; As can demonstrate transparent, the translucent or opaque demonstration of the background frame between literal, pattern and symbol lines, be different from the display mode that need cook up the specific region, in the time of can be and hidden too many picture because of display message; Other display effects also comprise position, the demonstration time of selecting to be shown in picture, the display effect of appearing in one's mind, disappearing with various information.
The method of combining information can be with reference to flow process shown in Figure 3 in the system system behind the video.
Beginning is like step S301, and the system system receives a video behind the video, and the user can select a video archive through the inputting interface that system system behind the video is provided.Then, the system system carries out decoding (step S303) behind the video, and vision signal is become a sequence frame (frame) data after decoding; The Pixel Information that comprises each frame; And can capture wherein information, comprise the time stamp (step S305) of each frame at least, and be stored in the memory cell.
Like step S307; The system system produces a user interface behind the video; The user can desire the information that combines with video through the input of input field wherein, such as being passage, pattern or symbol, or the combination of various information; Receive input information (step S309) by system system behind the video, behind pixelation, be stored in the buffer.
Afterwards, like step S311, the system system receives the display effect selection through user interface behind the video; Such as; The user operates the selectionbar in the user interface, chooses a display effect in the effect data bank, like the transparency that can demonstrate background between literal, pattern and symbol lines, translucent etc.; Or the combination of different display effects, selected display effect is used for input information with cover.Wherein because the information via pixelation, can be easily and the mutual crossover of the pixel of each frame of film, the viewing area that does not need extra arrangement to have background produces with respect to film background transparent or translucent effect.
The system system then receives one and plays setting (step S313) behind the video; This setting can be behind the video system system according to selected display effect related broadcast set; Or the result who sets through user interface by the user; At least include time started and concluding time that input information shows, also comprise time started that each display effect shows and perdurabgility etc.
According to above-mentioned time set, selected display effect is used for the input information (comprising literal, pattern) through pixelation with cover, through data processing, and the data information (step S315) that formation can combine with video.Specifically, the information of input is mainly literal, with the corresponding time set of literal of input, and according to the frame of the corresponding relative time of time stamp of each frame, applies mechanically the effect of selection.
Then like step S317; Setting combining information, display effect and video according to time and broadcast, mainly is to have time stamp through each frame of video of decoding, and each information then combines with each frame according to playing setting with display effect; Carry out image processing through data processing unit; Set and time combining information, effect and video according to playing, will set with broadcast according to the time stamp of each frame of video through the information (literal or pattern) of pixelation and be incorporated into corresponding frame of time, in the picture that is incorporated into each frame that makes; And the displacement that set to produce captions according to effect; Such as the displacement of doing captions according to the direction of rolling, other effect comprises rolling, upset, velocity of displacement etc., is being combined into new video to the picture of each frame.
After image processing, each pixel information coding (step S319) back produces an output video (step S321).The system system provides the option of an output format behind this video when output video; Such as providing the user to select the File Format of desire output through options interface; After selecting, as the form of output video, such as mpg (moving picture expert group; Motion Picture Experts Group's form), mov (QuickTime movie form), avi (audio video interleaved, Audio Video Interleaved), mp4 output formats such as (MPEG-4 Part 14).
The system system can be implemented in a software program that is executed on the computer behind the above-mentioned video, and Fig. 4 A to Fig. 4 F then describes the implementation figure of this software program one by one.After after this user carries out routine, the sketch map of the video inputting interface that shows like Fig. 4 A will present a video inputting interface 40 on the screen, and this be a sketch map, and the unrestricted appearance attitude of routine after this.
User's increase video 401 buttons capable of using add a video archive; Or the video data on the VCD (VideoCompact Disc, video and audio CD disc), DVD carriers such as (Digital Versatile Disc, digital versatile discs); 403 data that then demonstrate the video archive that is written in video information district; This sketch map shows file name, the reproduction time of video, the archives size that includes input video, and can select title, the form of output video, with information such as its processing progress.Can have an information display area 405 in addition, progress and information that show image is handled are in comprising error message, making, process information such as completion.
Fig. 4 B is shown as the user can select an already present film archive through the interface of selecting the input archives in the software, and behind import file, program will be decoded, and capture the information of film.
The sketch map of the information input interface that then can show with reference to figure 4C, after being written into video archive, the user interface input information that the user can provide through routine after this.Back routine produces information input interface 42, and so figure shows, cooperates the foregoing description, wherein has literal input area 421, effect selection district 423 and plays setting district 425 etc.
The user can comprise that broadcasts such as input characters, selection display effect and setting zero-time, concluding time are set, and also comprise the selection output format through the interactive picture input information of information input interface 42.
Judge input video form and decoding through program, introduce information such as input characters, pattern or symbol and the display effect of applying mechanically afterwards, after combining, encode, export new video archive again.Especially to the information of each frame in the video and introducing, encode according to time and each the frame time stamp set.
Fig. 4 D demonstrates the various output formats that software can be supported, and the user by selecting interface is selected, and software program then can be according to selecting to carry out suitable encoding and decoding program.Fig. 4 E then follows the show image processing procedure, and the user can supervise handling procedure through this interface, can suitably judge wrong place.
New video is different from captions and video spaced manner after producing, and new video then itself has comprised through applying mechanically the information of display effect, the sketch map of video output picture shown in Fig. 4 F.Wherein video output picture 44 includes film district 443 and subtitle region 441; Captions comprise input informations such as literal, pattern and symbol; And non-ly generally be located at one and have on the specific region of background; And can be any position on the screen, and can pass through the various input informations of pixelation, become the pixel information that can combine with each frame of video.According to the embodiment of transparent demonstration, through with after each frame combines, make that the background between literal, pattern and symbol lines still can show, effect mainly is can the transparent processing captions, is blended in the film, makes not produce the background square that is not dissolved in picture.In other embodiments, the effect that captions occur also can produce the effect of upset, rolling or horse race lamp, except producing transparent and translucent display effect, more can arrange to cooperate other special display effects to combine with video and plays.
In sum; The system system particularly realizes the technology that input characters and already present image mutually combine behind the video of the present invention; Characteristic is to let the user simply and easily according to different demands; Picture or literal are merged in any film, and make different effects, can be used in media advertisement or the digital signage (Digital Signage).
Only the above is merely preferable possible embodiments of the present invention, and is non-so promptly limit to claim of the present invention, so the equivalent structure variation of using specification of the present invention and accompanying drawing content to do such as all in like manner is contained in the scope of the present invention, closes and gives Chen Ming.
Claims (10)
1. the method for the combining information of system system behind the video is characterized in that, comprising:
Receive a video;
This video of decoding;
Capture the information of this video, the information of this video comprises the frame that this video is included and the time stamp of each frame at least, and the information storage of this video is in a memory cell;
Receive an input information, through this input information of input field reception of a user interface;
With this input information pixelation, become the data information that combines with this video through a data processing unit;
Receive a display effect and select, select through this display effect of selectionbar reception of this user interface;
Receive one and play setting, comprise the demonstration time of this input information and the demonstration time that this display effect is selected at least;
Set with each frame of this video, this input information and apply mechanically the time stamp of the display effect of this input information according to this broadcast, this data processing unit combines this input information, display effect and this video; And
This input information, display effect of encoding and the information after this video combines produce an output video.
2. the method for the combining information of system system is characterized in that this input information is one of literal, pattern and symbol or its combination behind the video as claimed in claim 1.
3. the method for the combining information of system system behind the video as claimed in claim 2; It is characterized in that; One of this literal, pattern and symbol or its combination are behind pixelation; Form the pixel information that combines with each frame of this video, after combining, produce the transparent display effect that background shows between this literal, pattern or symbol lines.
4. the method for the combining information of system system is characterized in that behind the video as claimed in claim 1, and an initial time and the concluding time that comprises that at least this input information shows set in this broadcast, and cover is used for a perdurabgility of the display effect of this input information.
5. the method for the combining information of system system is characterized in that this display effect is formed by a plurality of effect algorithms that are stored in an effect data bank behind the video as claimed in claim 1.
6. the method for the combining information of system system is characterized in that behind the video as claimed in claim 1, and behind coding, the system system provides the option of an output format behind this video, after selecting, as the form of this output video.
7. system system behind the video of the method for an execution combining information as claimed in claim 1 is characterized in that, comprising:
One data processing unit is handled behind this video the interelement signal of each in the system system;
One output/input unit is connected in this data processing unit, is used to export one first vision signal and input one second vision signal;
One codec unit connects this data processing unit, this codec unit this first vision signal that is used to decode, and behind coding, be produced as this second vision signal of specific format;
One effect data bank connects this data processing unit, and this effect data bank is with the various information display effects of functional module stores;
One selects boundary element, is connected in this effect data bank, and this selection boundary element provides a user interface; And
One memory cell is connected with this data processing unit, this memory cell as this video after the system system temporary memory bank.
8. system system behind the video as claimed in claim 7 is characterized in that, this first vision signal forms the time stamp of a sequence frame data and each frame after this codec unit decoding, and is temporary in this memory cell.
9. system system behind the video as claimed in claim 7 is characterized in that, this user interface that the system system provides through this selection boundary element behind this video receives literal, symbol or the pattern of user's input.
10. system system behind the video as claimed in claim 9 is characterized in that, the system system receives one or more display effect option through this user interface behind this video.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102819230A CN102404511A (en) | 2010-09-15 | 2010-09-15 | Video postproduction system and information combination method of same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102819230A CN102404511A (en) | 2010-09-15 | 2010-09-15 | Video postproduction system and information combination method of same |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102404511A true CN102404511A (en) | 2012-04-04 |
Family
ID=45886249
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010102819230A Pending CN102404511A (en) | 2010-09-15 | 2010-09-15 | Video postproduction system and information combination method of same |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102404511A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1503554A (en) * | 2002-11-21 | 2004-06-09 | 余明和 | Device and method for making television advertisement and inserting into television program |
| CN1602051A (en) * | 2003-09-26 | 2005-03-30 | 松下电器产业株式会社 | Apparatus for generating video contents with balloon captions |
| JP2006004122A (en) * | 2004-06-17 | 2006-01-05 | Hitachi Ltd | Image processor, robotics device, and vehicle guidance device |
| CN1867990A (en) * | 2003-11-10 | 2006-11-22 | 三星电子株式会社 | Storage medium storing text-based subtitle data including style information, and apparatus and method of playing back the storage medium |
| CN101312506A (en) * | 2007-05-21 | 2008-11-26 | 株式会社卡西欧日立移动通信 | Captioned video playback apparatus and recording medium |
| CN101371307A (en) * | 2006-01-31 | 2009-02-18 | 株式会社东芝 | Information reproducing system using information storage medium |
| CN101540847A (en) * | 2008-03-21 | 2009-09-23 | 株式会社康巴思 | Caption producing system and caption producing method |
-
2010
- 2010-09-15 CN CN2010102819230A patent/CN102404511A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1503554A (en) * | 2002-11-21 | 2004-06-09 | 余明和 | Device and method for making television advertisement and inserting into television program |
| CN1602051A (en) * | 2003-09-26 | 2005-03-30 | 松下电器产业株式会社 | Apparatus for generating video contents with balloon captions |
| CN1867990A (en) * | 2003-11-10 | 2006-11-22 | 三星电子株式会社 | Storage medium storing text-based subtitle data including style information, and apparatus and method of playing back the storage medium |
| JP2006004122A (en) * | 2004-06-17 | 2006-01-05 | Hitachi Ltd | Image processor, robotics device, and vehicle guidance device |
| CN101371307A (en) * | 2006-01-31 | 2009-02-18 | 株式会社东芝 | Information reproducing system using information storage medium |
| CN101312506A (en) * | 2007-05-21 | 2008-11-26 | 株式会社卡西欧日立移动通信 | Captioned video playback apparatus and recording medium |
| CN101540847A (en) * | 2008-03-21 | 2009-09-23 | 株式会社康巴思 | Caption producing system and caption producing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1997153B (en) | A method and device for computer multi-video playing | |
| CN102027741B (en) | Generating a combined video stream from multiple input video streams | |
| CN101582982B (en) | Recording medium and method, reproduction apparatus and method, program and integrated circuit | |
| CN100472405C (en) | Multi-media reproduction device and menu screen display method | |
| CN101341457B (en) | Methods and systems for enhancing television applications using 3d pointing | |
| CN100546353C (en) | Be used to reproduce the equipment of storage medium with interactive graphic stream | |
| CN101536101B (en) | Encoding method and apparatus and decoding method and apparatus | |
| CN103282962B (en) | Content ordering | |
| CN102208171B (en) | Local detail playing method on portable high-definition video player | |
| CN101778282B (en) | Method for concurrently playing different media files | |
| CN1989480A (en) | Content reproduction device and menu screen display method | |
| CN101233504A (en) | Distributed software construction for user interfaces | |
| CN103533256A (en) | Method and device for processing subtitle and subtitle display system | |
| CN101430631B (en) | Method for interaction with multiple images and user interface device | |
| CN1826572A (en) | System and method of programmatic window control for consumer video players | |
| Bove et al. | Adding hyperlinks to digital television | |
| CN102404511A (en) | Video postproduction system and information combination method of same | |
| Caldwell | Televisuality as a semiotic machine: Emerging paradigms in low theory | |
| TWI531224B (en) | Multimedia Dynamic Advertisement Playing System and Method | |
| CN102724425B (en) | A kind of method that teletext template is broadcasted | |
| Chen et al. | A STUDY ON DEVELOPMENT AND CURRENT APPLICATION OF MOTION GRAPHIC IN TAIWAN’S POPULAR MUSIC | |
| Lugmayr et al. | E= MC2+ 1: a fully digital, collaborative, high-definition (HD) production from scene to screen | |
| Eastman | Designing on-air, print, and online promotion | |
| TW201212639A (en) | Video post-production system and method for combining information with video | |
| CN102082918A (en) | Caption machine for diversified caption rolling play |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120404 |