CN101472066A - Near-end control method of image viewfinding device and image viewfinding device applying the method - Google Patents

Near-end control method of image viewfinding device and image viewfinding device applying the method Download PDF

Info

Publication number
CN101472066A
CN101472066A CNA2007103055932A CN200710305593A CN101472066A CN 101472066 A CN101472066 A CN 101472066A CN A2007103055932 A CNA2007103055932 A CN A2007103055932A CN 200710305593 A CN200710305593 A CN 200710305593A CN 101472066 A CN101472066 A CN 101472066A
Authority
CN
China
Prior art keywords
image
acoustic information
information
identification
capture unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2007103055932A
Other languages
Chinese (zh)
Inventor
蔡昭宗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Altek Corp
Original Assignee
Altek Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Altek Corp filed Critical Altek Corp
Priority to CNA2007103055932A priority Critical patent/CN101472066A/en
Publication of CN101472066A publication Critical patent/CN101472066A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention relates to a near-end control method for an image acquisition device and an image acquisition device applying the method. The near-end control method for the image acquisition device comprises the following steps: the voice information and the image information are acquired; the voice recognition processing is performed to the voice information, and the image recognition processing is performed to the image information; whether the voice information is clearly recognized or not is judged to decide whether to further combine with the image information for auxiliary recognition; and the voice information is converted into a control command for execution.

Description

The near-end control method of image capture unit and use the image capture unit of this method
Technical field
The invention relates to a kind of control method of image capture unit, particularly a kind of in conjunction with sound and image identification function, so that the control method of the image capture unit that control command can accurately be passed on.
Background technology
Generally when using camera to take pictures, long or to grip the camera posture improper when the shutter time for exposure that camera sets, cause the user when pushing shutter, to produce the hand that the rocks phenomenon of shaking, the feasible photograph of taking thereby smudgy easily.In addition; if consider that photographer also will go into mirror together; and arround under nobody situation that can help; photographer just must adjust photographed scene, angle earlier, go into mirror position and camera parameters before taking pictures; start the pre-pattern of clapping of camera; and will arrive fixed point in zero count, this kind mode causes taking failure and needs repeatedly trial just can photograph desirable photo through regular meeting.In order to improve aforementioned contingent situation, and to carry out the wireless remote controller of controlling, make photographer can directly control camera and start shutter in the fixed point place at camera development, with take photo.Though the remote controller of this type provides wireless manipulation function, but the receiver that must make remote controller face camera as far as possible when being to use just can reach manipulation effect, and because remote controller meeting power consumption itself, therefore to note the dump energy number of remote controller battery often, and the little easy loss of remote controller volume also may cause the inconvenience in the use.
Summary of the invention
The object of the present invention is to provide a kind of near-end control method of image capture unit and use the image capture unit of this method.
For achieving the above object, the near-end control method of image capture unit provided by the invention may further comprise the steps:
(a) acquisition one acoustic information and an image information;
(b) this acoustic information is carried out speech recognition and handle, and this image information is carried out image identification handle;
(c) judge whether this acoustic information can know identification, whether carry out identification further combined with this image information is auxiliary with decision; And
(d) this acoustic information being converted to control command is carried out.
Described method, wherein, (b) is further comprising the steps of for step:
Filter out the outer sound of people's audio frequency range in this acoustic information; And
Analyze this acoustic information and whether comprise an extra voice, whether can save as a sample sound to determine this acoustic information.
Described method, wherein, this acoustic information is by frequency analysis or compare one and pre-record sample sound to judge whether to comprise this extra voice.
Described method, wherein, determine whether this acoustic information can save as the step of a sample sound after, further comprising the steps of:
Eliminate the background noise in this acoustic information.
Described method, wherein, step (b) is that this acoustic information and a speech database are compared.
Described method, wherein, (b) is further comprising the steps of for step:
Analyze this image information and whether comprise a portrait, whether the motion characteristic of this portrait is carried out image identification with decision and handle.
Described method, wherein, this motion characteristic comprises mouth deformationization, gesture or the limb action of people's face.
Described method, wherein, (c) is further comprising the steps of for step:
When this acoustic information can't be known identification, in a speech database, select at least one candidate's voice messaging that is comparable to this acoustic information, and emulation can the corresponding respectively image action message of this candidate's voice messaging.
Described method, wherein, select this candidate's voice messaging and emulation can the step of the corresponding respectively image action message of this candidate's voice messaging after, further comprising the steps of:
Compare this image information and whether reach certain similarity with this image action message respectively; And
When this image information and this image action message do not reach certain similarity, send a warning message or return step (a) and carry out identification again.
Image capture unit provided by the invention comprises:
One acquisition module is in order to capture an acoustic information and an image information;
One recognition module is handled in order to this acoustic information is carried out speech recognition, and this image information is carried out image identification handle;
Whether one judge module can know identification in order to judge this acoustic information, whether carries out identification further combined with this image information is auxiliary with decision; And
One modular converter is carried out in order to this acoustic information is converted to control command.
Described image capture unit wherein, also comprises a low pass filter, to filter the outer sound of people's audio frequency range in this acoustic information.
Described image capture unit wherein, also comprises an indicating member, can send a warning message.
By technical scheme of the present invention, the user can operate image capture unit of the present invention by the acoustic control mode, and be aided with the image identification function according to circumstances, and can improve known technology and utilize remote controller image capture unit to be controlled and easy power consumption of remote controller and the easy disappearance of losing with the identification degree of raising to sound instruction.
Description of drawings
Fig. 1 is the schematic diagram of image capture unit of the present invention.
Fig. 2 is the main flow chart of the near-end control method of image capture unit of the present invention.
Fig. 3 is the practical operation flow chart of the near-end control method of image capture unit of the present invention.
Primary clustering symbol description in the accompanying drawing:
Image capture unit 1
Acquisition module 10
Recognition module 20
Judge module 30
Modular converter 40
Low pass filter 50
Indicating module 60
Embodiment
The near-end control method of image capture unit of the present invention may further comprise the steps: capture an acoustic information and an image information; Acoustic information is carried out speech recognition handle, and image information is carried out image identification handle; Judge whether acoustic information can know identification, whether carry out identification further combined with image information is auxiliary with decision; Acoustic information is converted to control command to be carried out.By above-mentioned steps, the user can operate image capture unit of the present invention by the acoustic control mode, and is aided with the image identification function according to circumstances to improve the identification degree to sound instruction.
But image capture unit application of aforementioned method of the present invention is controlled, and image capture unit comprises an acquisition module, a recognition module, a judge module and a modular converter.Acquisition module is in order to capture an acoustic information and an image information; Recognition module is handled in order to acoustic information is carried out speech recognition, and image information is carried out image identification handle; Judge module is in order to judging whether acoustic information can know identification, whether carries out identification further combined with image information is auxiliary with decision; Modular converter is carried out in order to acoustic information is converted to control command.Design thus, image capture unit of the present invention can be operated with phonetic control command easily by the user, and avoids influencing because of misoperation the situation of institute's pick-up image definition.
For allowing above and other objects of the present invention, feature and advantage become apparent, cited below particularlyly go out specific embodiments of the invention, and conjunction with figs. is described in detail below.
Please refer to Fig. 1, is the schematic diagram of an embodiment of image capture unit of the present invention.As shown in Figure 1, image capture unit 1 of the present invention comprises acquisition module 10, recognition module 20, judge module 30 and modular converter 40.In one embodiment of this invention, each module can be made up of software program, hardware, firmware, circuit loop or its combination respectively; And electrically connect mutually between each module.Acquisition module 10 is in order to capture an acoustic information and an image information, and in the present embodiment, acquisition module 10 can comprise a microphone and a photosensory assembly (figure does not show), to carry out the action of signal capturing respectively at acoustic information and image information.Recognition module 20 can comprise a speech recognition unit 201 and an image identification unit 202, handles to carry out speech recognition at acoustic information respectively, and image information is carried out image identification handle.Judge module 30 is in order to judging whether acoustic information can know identification, whether carries out identification further combined with image information is auxiliary with decision.Modular converter 40 is in order to be converted to control command with acoustic information, so that image capture unit 1 is carried out control action.Design thus, when the user sends a phonetic control command, the acoustic information of this phonetic control command and image information are captured respectively and carry out identification by image capture unit 1 of the present invention, when acoustic information can be known identification, can directly acoustic information be converted to control command; And when acoustic information can't be known identification, again image information is cooperated acoustic information together to carry out identification, in the hope of differentiating the content of this phonetic control command more accurately, again its acoustic information is converted to control command.In the present embodiment, image capture unit 1 can be a digital camera, but also can be a digital camera or other device with image acquisition function replaces, and does not exceed with present embodiment.
In addition, image capture unit 1 of the present invention also comprises a low pass filter 50, can handle at the acoustic information that is captured, and to filter the outer sound of people's audio frequency range in the acoustic information, strengthens the signal of acoustic information.Image capture unit 1 also comprises an indicating member 60, when carrying out identification when the utilization acoustic information and in conjunction with image information, if still can't know the control command that identification conforms to acoustic information, then can send a warning message to remind the user by indicating member 60.
Be the main flow chart and the practical operation flow chart of the near-end control method of image capture unit of the present invention with reference to figure 2 and Fig. 3 in the lump please below.It is noted that, though below be the near-end control method that example illustrates image capture unit of the present invention with image capture unit shown in Figure 11, but the present invention is not to be applicable to that image capture unit 1 exceeds, the also applicable method of the present invention of any other image capture unit.As shown in Figures 2 and 3, below will describe each step of the near-end control method of image capture unit of the present invention in detail.
At first, the present invention carry out step 110: capture an acoustic information and an image information.As shown in Figure 1, the near-end control method of image capture unit of the present invention can be applicable to image capture unit 1, and this image capture unit 1 comprises acquisition module 10.When the user sends a phonetic control command, the acoustic information and the image information of this phonetic control command can be captured out respectively by acquisition module 10, use for follow-up comparison.
Then, carry out step 120: acoustic information is carried out speech recognition handle, and image information is carried out image identification handle.As shown in Figure 1, image capture unit 1 comprises recognition module 20, recognition module 20 comprises a speech recognition unit 201 and an image identification unit 202, and therefore obtained acoustic information and image information can be carried out the action of speech recognition and image identification by recognition module 20 respectively.
As shown in Figure 3, in one embodiment of this invention, step 120 also comprises step 121: filter out the outer sound of people's audio frequency range in the acoustic information.When the user sends phonetic control command, more or less there are some other sound to exist in its residing background environment, make acquisition module 10 all sound can be captured in the lump, therefore need to be beforehand with processing, other sound beyond people's audio frequency range is filtered out by low pass filter at acoustic information.General human sound frequency range is greatly about about 300~3000Hz, so the cut-off frequency of low pass filter can be located at about 3000Hz in the present embodiment.
Step 120 also comprises step 122: analyze acoustic information and whether comprise an extra voice, whether can save as sound comparison sample with the decision acoustic information.As shown in Figure 3, via the acoustic information that step 121 was handled, can be by frequency analysis or the comparison sample sound that the user prerecorded, to judge the sound that except the sound that the user was sent, whether comprises other people in this acoustic information.If in this step, judge the existence of no extra voice, then this acoustic information can be saved as a sample sound to help the comparison of rear backdrop noise.
If judge that in step 122 acoustic information includes the existence of extra voice, then carry out step 123: eliminate the background noise in the acoustic information.As shown in Figure 3, with pre-recording sample sound or carry out signal in the stored sample sound of step 122 with the acoustic information that includes extra voice and subtract each other processing, remove unnecessary extra voice and noise, to obtain the stronger acoustic information signal of noise ratio.
Then carry out step 124, according to the processing of 121 to 123 pairs of acoustic informations of abovementioned steps to strengthen acoustic information, and a speech database of acoustic information after will strengthening and recognition module 20 carries out speech recognition comparison, in the hope of finding out the voice command that conforms to acoustic information.
In addition, aspect image identification, step 120 also comprises step 125: analyze image information and whether comprise a portrait, whether the motion characteristic of portrait is carried out image identification with decision and handle.As shown in Figure 3, at first analyze, when in judging image information, including portrait and existing, promptly carry out the image identification action of step 126 at image information.In the present embodiment, the motion characteristic of portrait is the mouth deformationization of this people's face, that is when the user sends a voice control command this mouth shape continuous action of being followed of order.User's mouth deformationization can be noted in advance by recognition module 20, for the required application of subsequent step.It is noted that gesture, limb action that motion characteristic also can be used the user replace, and do not exceed with present embodiment.If when unmanned picture exists in judging image information, then carry out step 127, close the image identification action, differentiate user's phonetic control command purely with the voice recognition function.
Then carry out step 130: judge whether acoustic information can know identification, whether carry out identification further combined with image information is auxiliary with decision.At utilizing judge module 30 to be differentiated,, then carry out processing action in conjunction with the image information auxiliary identification if acoustic information can't know when being recognized as arbitrary control command through the acoustic information of speech recognition.
In one embodiment of this invention, if judging acoustic information in step 130 can't know under the situation of identification, then carry out step 131: when acoustic information can't be known identification, in a speech database, select at least one candidate's voice messaging that is comparable to acoustic information, and the image action message that emulation can corresponding each candidate's voice messaging.As shown in Figure 3, store plural voice messaging in the speech database, when recognition module 20 judges that acoustic informations can't fit like a glove arbitrary plural voice messaging, be that benchmark is selected more close at least one candidate's voice messaging in the speech data storehouse then with this acoustic information, and carry out respective action emulation at each selected candidate's voice messaging, to produce the corresponding image action message.The mouth deformation of being enumerated people's face with step 125 turns to example, can carry out corresponding mouth deformation simulation at each candidate's voice messaging in step 131, to produce the image action message of corresponding each candidate's voice messaging.
Carry out step 132 after step 131: whether comparison image information and each image action message reach certain similarity.As shown in Figure 3, the image action message that produces corresponding each candidate's voice messaging in the step 131 is compared mutually with the image information of handling through step 120, judged whether both similarity degrees can surpass certain threshold value.If when image information and image action message do not reach certain similarity, then carry out step 133, send a warning message to notify the user by indicating module 60, maybe can set and return step 120 and carry out identification again.Otherwise, if both similarities surpass threshold value, then carry out step 140, original sound information is corresponded to a certain control command.In this step, threshold value can decide by the default value of user or device.
Carry out step 140 at last: acoustic information is converted to control command is carried out.After confirming that by step 130 or step 132 acoustic information can meet a certain control command, sound instruction can be converted to control command to image capture unit by modular converter, carry out respective action to control image capture unit.
Pass through above-mentioned steps, the near-end control method of image capture unit of the present invention can utilize the acoustic control mode to assign instruction at image capture unit 1, when being subjected to external environment and influencing the definition of phonetic control command, cooperation is compared the image identification that the user carried out, can improve the identification of 1 pair of instruction of assigning of image capture unit, more convenient in controlling of image capture unit 1.
Only must notice that the foregoing description only is illustrative principle of the present invention and effect thereof, but not is used to limit the scope of the invention.Those skilled in the art all can be under know-why of the present invention and spirit, and embodiment is made an amendment and changes.The scope of the present invention should as the application the claim scope as described in.

Claims (12)

1, a kind of near-end control method of image capture unit may further comprise the steps:
(a) acquisition one acoustic information and an image information;
(b) this acoustic information is carried out speech recognition and handle, and this image information is carried out image identification handle;
(c) judge whether this acoustic information can know identification, whether carry out identification further combined with this image information is auxiliary with decision; And
(d) this acoustic information being converted to control command is carried out.
2, the method for claim 1, wherein step (b) may further comprise the steps:
Filter out the outer sound of people's audio frequency range in this acoustic information; And
Analyze this acoustic information and whether comprise an extra voice, whether can save as a sample sound to determine this acoustic information.
3, method as claimed in claim 2, wherein, this acoustic information is by frequency analysis or compare one and pre-record sample sound to judge whether to comprise this extra voice.
4, method as claimed in claim 2, wherein, determine whether this acoustic information can save as the step of a sample sound after, further comprising the steps of:
Eliminate the background noise in this acoustic information.
5, the method for claim 1, wherein step (b) is that this acoustic information and a speech database are compared.
6, the method for claim 1, wherein step (b) may further comprise the steps:
Analyze this image information and whether comprise a portrait, whether the motion characteristic of this portrait is carried out image identification with decision and handle.
7, method as claimed in claim 6, wherein, this motion characteristic comprises mouth deformationization, gesture or the limb action of people's face.
8, the method for claim 1, wherein step (c) may further comprise the steps:
When this acoustic information can't be known identification, in a speech database, select at least one candidate's voice messaging that is comparable to this acoustic information, and emulation can the corresponding respectively image action message of this candidate's voice messaging.
9, method as claimed in claim 8, wherein, select this candidate's voice messaging and emulation can the step of the corresponding respectively image action message of this candidate's voice messaging after, further comprising the steps of:
Compare this image information and whether reach certain similarity with this image action message respectively; And
When this image information and this image action message do not reach certain similarity, send a warning message or return step (a) and carry out identification again.
10, a kind of image capture unit comprises:
One acquisition module is in order to capture an acoustic information and an image information;
One recognition module is handled in order to this acoustic information is carried out speech recognition, and this image information is carried out image identification handle;
Whether one judge module can know identification in order to judge this acoustic information, whether carries out identification further combined with this image information is auxiliary with decision; And
One modular converter is carried out in order to this acoustic information is converted to control command.
11, image capture unit as claimed in claim 10 wherein, also comprises a low pass filter, to filter the outer sound of people's audio frequency range in this acoustic information.
12, image capture unit as claimed in claim 10 wherein, comprises an indicating member, can send a warning message.
CNA2007103055932A 2007-12-27 2007-12-27 Near-end control method of image viewfinding device and image viewfinding device applying the method Pending CN101472066A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNA2007103055932A CN101472066A (en) 2007-12-27 2007-12-27 Near-end control method of image viewfinding device and image viewfinding device applying the method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNA2007103055932A CN101472066A (en) 2007-12-27 2007-12-27 Near-end control method of image viewfinding device and image viewfinding device applying the method

Publications (1)

Publication Number Publication Date
CN101472066A true CN101472066A (en) 2009-07-01

Family

ID=40829161

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2007103055932A Pending CN101472066A (en) 2007-12-27 2007-12-27 Near-end control method of image viewfinding device and image viewfinding device applying the method

Country Status (1)

Country Link
CN (1) CN101472066A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103188549A (en) * 2011-12-28 2013-07-03 宏碁股份有限公司 Video playing device and operation method thereof
CN103186227A (en) * 2011-12-28 2013-07-03 北京德信互动网络技术有限公司 Man-machine interaction system and method
CN103399634A (en) * 2013-07-22 2013-11-20 瑞声科技(南京)有限公司 Gesture recognition system and gesture recognition method
CN104269172A (en) * 2014-07-31 2015-01-07 广东美的制冷设备有限公司 Voice control method and system based on video positioning
CN105022470A (en) * 2014-04-17 2015-11-04 中兴通讯股份有限公司 Method and device of terminal operation based on lip reading
WO2016150001A1 (en) * 2015-03-24 2016-09-29 中兴通讯股份有限公司 Speech recognition method, device and computer storage medium
WO2016173132A1 (en) * 2015-04-28 2016-11-03 中兴通讯股份有限公司 Method and device for voice recognition, and user equipment
CN106231196A (en) * 2016-08-16 2016-12-14 北京金山安全软件有限公司 Video shooting control method and device and electronic equipment
CN106653023A (en) * 2016-12-30 2017-05-10 深圳天珑无线科技有限公司 Method and system for triggering image acquisition by virtue of voice signal
CN107274236A (en) * 2017-08-09 2017-10-20 无锡北斗星通信息科技有限公司 Identity information analytical equipment
CN107368720A (en) * 2016-05-11 2017-11-21 中华映管股份有限公司 Intuitive interactive device and its interactive approach
CN109727596A (en) * 2019-01-04 2019-05-07 北京市第一〇一中学 Control the method and remote controler of remote controler
CN111292764A (en) * 2018-11-20 2020-06-16 新唐科技股份有限公司 Identification system and identification method

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103186227A (en) * 2011-12-28 2013-07-03 北京德信互动网络技术有限公司 Man-machine interaction system and method
CN103188549A (en) * 2011-12-28 2013-07-03 宏碁股份有限公司 Video playing device and operation method thereof
CN103399634A (en) * 2013-07-22 2013-11-20 瑞声科技(南京)有限公司 Gesture recognition system and gesture recognition method
CN103399634B (en) * 2013-07-22 2016-02-24 瑞声科技(南京)有限公司 Gesture recognition system and recognition methods
CN105022470A (en) * 2014-04-17 2015-11-04 中兴通讯股份有限公司 Method and device of terminal operation based on lip reading
CN104269172A (en) * 2014-07-31 2015-01-07 广东美的制冷设备有限公司 Voice control method and system based on video positioning
WO2016150001A1 (en) * 2015-03-24 2016-09-29 中兴通讯股份有限公司 Speech recognition method, device and computer storage medium
WO2016173132A1 (en) * 2015-04-28 2016-11-03 中兴通讯股份有限公司 Method and device for voice recognition, and user equipment
CN107368720A (en) * 2016-05-11 2017-11-21 中华映管股份有限公司 Intuitive interactive device and its interactive approach
CN106231196A (en) * 2016-08-16 2016-12-14 北京金山安全软件有限公司 Video shooting control method and device and electronic equipment
CN106653023A (en) * 2016-12-30 2017-05-10 深圳天珑无线科技有限公司 Method and system for triggering image acquisition by virtue of voice signal
CN107274236A (en) * 2017-08-09 2017-10-20 无锡北斗星通信息科技有限公司 Identity information analytical equipment
CN111292764A (en) * 2018-11-20 2020-06-16 新唐科技股份有限公司 Identification system and identification method
CN111292764B (en) * 2018-11-20 2023-12-29 新唐科技股份有限公司 Identification system and identification method
CN109727596A (en) * 2019-01-04 2019-05-07 北京市第一〇一中学 Control the method and remote controler of remote controler
CN109727596B (en) * 2019-01-04 2020-03-17 北京市第一〇一中学 Method for controlling remote controller and remote controller

Similar Documents

Publication Publication Date Title
CN101472066A (en) Near-end control method of image viewfinding device and image viewfinding device applying the method
US20220310095A1 (en) Speech Detection Method, Prediction Model Training Method, Apparatus, Device, and Medium
US20180167554A1 (en) Photographing method and mobile terminal
WO2020103526A1 (en) Photographing method and device, storage medium and terminal device
CN111443884A (en) Screen projection method and device and electronic equipment
CN109671106A (en) A kind of image processing method, device and equipment
CN108259758B (en) Image processing method, image processing apparatus, storage medium, and electronic device
CN108399349A (en) Image-recognizing method and device
CN106375590A (en) Volume adjustment method and device for smart terminal
CN104361558B (en) Image processing method, device and equipment
KR101762769B1 (en) Apparatus and method for capturing subject in photographing device
US20220270343A1 (en) Video image processing method and apparatus
CN111741284A (en) Image processing apparatus and method
CN114365482A (en) Large aperture blurring method based on Dual Camera + TOF
US10880463B2 (en) Remote control operation method for gesture post and gesture post remote control device
US20180151039A1 (en) Neighborhood Security Cameras
CN110471606A (en) Input method and electronic equipment
CN105704386A (en) Image acquisition method, electronic equipment and electronic device
CN111757007B (en) Image shooting method, device, terminal and storage medium
CN108156376A (en) Image-pickup method, device, terminal and storage medium
CN109143882A (en) A kind of control method and device
EP4060603A1 (en) Image processing method and related apparatus
JP2012151544A (en) Imaging apparatus and program
CN114520002A (en) Method for processing voice and electronic equipment
CN112764349A (en) Clothes hanger control method, clothes hanger, system and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Open date: 20090701