CN106205619A - Audio recognition method based on intelligent robot system and the system of identification - Google Patents
Audio recognition method based on intelligent robot system and the system of identification Download PDFInfo
- Publication number
- CN106205619A CN106205619A CN201610537538.5A CN201610537538A CN106205619A CN 106205619 A CN106205619 A CN 106205619A CN 201610537538 A CN201610537538 A CN 201610537538A CN 106205619 A CN106205619 A CN 106205619A
- Authority
- CN
- China
- Prior art keywords
- pressure signal
- user
- audio file
- described pressure
- intelligent robot
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Abstract
The invention discloses a kind of audio recognition method based on intelligent robot system and identification system, the method includes the multi-modal input data receiving user, and detects whether setting position exists pressure signal;Start voice recording function the phonetic entry of user to be recorded until described pressure signal stops when described pressure signal is identified as length by operation;The audio file recorded is processed, and according to the result processed to the multi-modal response message of user feedback.This method solve with the interactive voice of robot during, user does not knows the problem when robot starts speech recognition, the when of particularly each state of some robot the most substantially differentiation, use this clear and definite mode can improve mutual effectiveness, and it can be avoided that owing to have received the voice signal of mistake and the interaction error that causes, improve user-interaction experience.
Description
Technical field
The invention belongs to field in intelligent robotics, particularly relate to a kind of audio recognition method based on intelligent robot system
And identification system.
Background technology
Intelligent robot designed to be able to carry out multi-modal receive multi-modal input data alternately, the multimode to input
State data carry out processing and make multi-modal response feedback.Wherein, multi-modal input data can be that action inputs data, language
Sound input data and image input data etc..
Multi-modal input data can realize signals collecting by the sensor being arranged on intelligent robot.Such as,
Action input data can be received by touch sensor and imageing sensor, and input voice data can be by sound transducer
Receiving, image input data are received by imageing sensor.Good mutual in order to provide, need accurately to receive various multi-modal defeated
Enter data, therefore need badly and improve intelligent robot system to the treatment mechanism of multi-modal data and lifting intelligent robot system
Disposal ability to multi-modal data.
Summary of the invention
One of the technical problem to be solved is to need to provide one to promote intelligent robot system to multi-modal
The method of the disposal ability of data.
In order to solve above-mentioned technical problem, embodiments herein provide firstly a kind of based on intelligent robot system
Audio recognition method, including the multi-modal input data of reception user, and detects whether setting position exists pressure signal;When
Described pressure signal be identified as long by operation time start voice recording function and the phonetic entry of user recorded until institute
State pressure signal to stop;The audio file recorded is processed, and according to the result processed to the multi-modal response of user feedback
Information.
Preferably, identify described pressure signal, carry out timing including to described pressure signal, when timing time is more than setting
Time threshold time, identify described pressure signal for long by operation.
Preferably, also include before identifying described pressure signal interrupting the interaction mode that intelligent robot is current.
Preferably, the time threshold of described setting is more than or equal to 1S.
Preferably, the described audio file to recording processes, and is uploaded to cloud service including by the audio file of recording
Device;Described audio file is carried out semantic analysis;Result according to semantic analysis generates to be believed to the multi-modal response of user feedback
Breath.
Embodiments herein additionally provides a kind of speech recognition system based on intelligent robot system, including: pressure
Signal receiving module, it receives the multi-modal input data of user, and detects whether setting position exists pressure signal;Audio frequency
Document recording module, it is identified as long defeated to the voice of user by starting voice recording function when operating when described pressure signal
Enter to carry out recording until described pressure signal stops;Processing and responder module, the audio file recorded is processed by it, and root
According to the result processed to the multi-modal response message of user feedback.
Preferably, described audio file is recorded module and is included pressure signal recognition unit: described pressure signal recognition unit
Described pressure signal is carried out timing, when timing time is more than the time threshold set, identifies that described pressure signal is pressed for long
Operation.
Preferably, described pressure signal recognition unit is identifying that to interrupt intelligent robot before described pressure signal current
Interaction mode.
Preferably, the time threshold of described setting is more than or equal to 1S.
Preferably, the audio file recorded is processed by described process and responder module according to following steps: will record
Audio file be uploaded to Cloud Server;Described audio file is carried out semantic analysis;Result according to semantic analysis generate to
The multi-modal response message of user feedback.
Compared with prior art, the one or more embodiments in such scheme can have the advantage that or useful effect
Really:
By with the interactive voice of intelligent robot during increase a definite functions interactive mode, solve
During the interactive voice of robot, user does not knows when robot starts the problem of speech recognition, particularly
The when that each state of some robot the most substantially being distinguished, this clear and definite mode is used to improve mutual effective
Property, it is to avoid the interaction error caused owing to have received the voice signal of mistake, improves the interactive experience of user.
Other advantages of the present invention, target, and feature will be illustrated to a certain extent in the following description, and
And to a certain extent, will be apparent to those skilled in the art based on to investigating hereafter, or can
To be instructed from the practice of the present invention.The target of the present invention and other advantages can pass through description below, and right is wanted
The structure asking specifically noted in book, and accompanying drawing realizes and obtains.
Accompanying drawing explanation
Accompanying drawing is used for providing being further appreciated by of the technical scheme to the application or prior art, and constitutes description
A part.Wherein, the accompanying drawing expressing the embodiment of the present application is used for explaining the technical side of the application together with embodiments herein
Case, but it is not intended that the restriction to technical scheme.
Fig. 1 is the flow process signal of the audio recognition method based on intelligent robot system according to first embodiment of the invention
Figure;
Fig. 2 is the flow process signal of the audio recognition method based on intelligent robot system according to second embodiment of the invention
Figure;
Fig. 3 is the structural representation of the speech recognition system based on intelligent robot system according to third embodiment of the invention
Figure.
Detailed description of the invention
Describe embodiments of the present invention in detail below with reference to drawings and Examples, whereby how the present invention is applied
Technological means solves technical problem, and the process that realizes reaching relevant art effect can fully understand and implement according to this.This Shen
Please each feature in embodiment and embodiment, can be combined with each other under not colliding premise, the technical scheme formed
All within protection scope of the present invention.
When carrying out interactive voice with intelligent robot, first intelligent robot receives the phonetic entry letter data of user,
Again the input voice data received is identified, then issues the user with multi-modal feedback letter according to the result identified
Breath.In this process, completely the input voice data, being accurately received user is most important to subsequent treatment.
There is the indefinite problem of point of penetration to speech identifying function in intelligent robot of the prior art.Concrete manifestation
For, it is impossible in time, it is synchronously received the input voice data of user, to such an extent as to the data received are imperfect, and then can not be accurate
Really understand demand and the intention of user, cause intelligent robot can not make correct reaction in interactive voice, reduce
Consumer's Experience.
The present invention is directed to the problems referred to above, propose the interaction mechanism of a kind of input point of penetration that can specify speech data, under
Face describes in detail in conjunction with specific embodiments.
First embodiment:
Fig. 1 is the schematic flow sheet of the audio recognition method based on intelligent robot system according to the embodiment of the present invention,
As it can be seen, the method comprises the following steps:
Step S110, the multi-modal input data of reception user, and detect whether setting position exists pressure signal.
Step S120, the startup voice recording function phonetic entry to user when pressure signal is identified as length by operation
Carry out recording until pressure signal stops.
Step S130, to record audio file process, and according to process result to user feedback multi-modal should
Answer information.
Concrete, in step s 110, if user prepares to initiate voice dialogue to intelligent robot, first send one
Individual cue, for informing that the input voice data below intelligent robot is the inputs of effective data.
For example, user carries out growing by operation, such as at intelligent robot at the upper setting position of intelligent robot
Head, set position be provided with pressure transducer.This pressure transducer has the signal output of correspondence.Intelligent machine
According to the output signal of this pressure transducer, people may determine that the data that user is currently entered are effective speech data.
In order to prevent from receiving other invalid input information during speech data inputs, user should persistently touch
Touching the setting position on intelligent machine human body, such pressure transducer will have the output of continuous print signal, touch user
Mechanism sound intermediate frequency receive equipment and will persistently record the voice messaging of user.
In the step s 120, the continuous print sensor output signal received is identified as concrete by intelligent robot system
Operation.Including, the lasting pressure signal received is carried out timing, when timing time is more than the time threshold set, will
Pressure signal is judged as long by operation.
The setting of time threshold can according to the operating habit of user, the precision of sensor and intelligent robot system
Identification ability selects.In one embodiment of the invention, the time threshold of setting is set greater than equal to 1S.
After judging that the pressure signal received is as growing by operation, intelligent robot will call the recording function of audio file
Start the voice dialogue of user is recorded.User long press intelligent robot setting position can while to intelligent machine
Device people exports voice, thus realizes the recording to speech data.
It should be noted that judge pressure signal be one long by operation after can stop the timing to pressure signal,
Although now user is maintained as the pressed state to setting position, pressure transducer the most persistently has pressure signal to spread out of.
As long as intelligent robot system detects lasting pressure signal, input voice data will be carried out continuous print record
System.When the pressing operation of user stops, the output signal of pressure transducer will be undergone mutation, and intelligent robot is believed according to pressure
Number sudden change trigger one stop signal, this stopping signal can be used for the recording process of end-sound frequency file.
In step s 130, by processing audio file, generate should to the multi-modal of the multi-modal input information of user
Answer feedback.
Concrete, first the audio file of recording can be uploaded to Cloud Server, Cloud Server by intelligent robot system
Receive this audio file, audio file carried out semantic analysis, know the intention of user, and based on the result analyzed generate to
The multi-modal response of family feedback.Then this response is back to intelligent robot system, by intelligent robot system according to response
The instruction of information exports multi-modal data to user, can be the output etc. of action output, voice output and writings and image.
In the present embodiment, the clear and definite instruction information inputted to intelligent robot system based on user, so that intelligent
Robot system can know the time point of the input of the effective multi-modal input data of user exactly, it is possible to effectively keeps away
Exempting to receive invalid input data, this clear and definite interactive mode is conducive to improving interactive quality, improves Consumer's Experience.
Second embodiment:
Fig. 2 is the flow process signal of the audio recognition method based on intelligent robot system according to second embodiment of the invention
Figure, as shown in the figure:
First intelligent robot system receives the multi-modal input data of user, and detects whether setting position exists pressure
Force signal.If there is not pressure signal at this setting position, then continue to monitor the input of multi-modal data.If be detected that
There is pressure signal, then do following process.
After intelligent robot receives the output signal of pressure transducer, call immediately and interrupt logic, interrupt logic energy
Enough suspend the operation performed by intelligent robot system or the residing current state that logs off.
It follows that the pressure signal received is identified by intelligent robot system, knows method for distinguishing and first and implement
Method in example is identical, and the lasting pressure signal received is carried out timing, when timing time is more than the time threshold set
Time, pressure signal is judged as long by operation.
If long by operation by identifying that pressure signal is defined as, then open the recording of audio file.
When carrying out the recording of audio file, persistently detect pressure signal, and judge whether pressure signal stops.
If pressure signal does not stops, then proceed the recording of audio file.Until detecting that pressure signal stops knot
The recording of bundle audio file, its operation is all identical with the method in first embodiment, repeats no more.
If not being long by operation by identifying that pressure signal judges, then intelligent robot performs other default
Operation.
Intelligent robot system the most also can be called and interrupt logic, the shortest by operating, in order to avoid
Intelligent robot system mistake starts the recording to audio file, in the present embodiment, it is necessary to be identified as long at pressure signal
Received later when continuous print pressure signal meets, just can be carried out audio file simultaneously by operation and intelligent robot system
Record.
Interrupt that logic interrupts is the state of the operation performed by intelligent robot system or robot system, the most
Perform certain internal applications, or response is done in input to user in the way of multi-modal, calls in intelligent robot system
All can temporarily stop after interrupting logic to perform.
After the recording of end-sound frequency file, the audio file recorded can be uploaded to cloud clothes by intelligent robot system
Business device.
Cloud Server carries out speech analysis to audio file, determines the intention of user, generates feedback response, is back to intelligence
Robotic end.
Intelligent robot exports data according to feedback response to user and completes alternately.
The method of the present embodiment can make intelligent robot system based on interrupting logic working, it is to avoid to unsolicited audio frequency literary composition
The mistake response of part recording task.
Based on above-mentioned first embodiment and the exchange method of the second embodiment, it is possible to achieve following is mutual:
Pressing robot head with the head of a household, the persistent period is more than 1S, then loquiturs, and " you are good, robot, and today is northern
The weather in capital how ".The head of use hands sustained hold robot during talking with robot.After dialogue completes
Unclamp hands, after intelligent robot has performed semantic analysis according to the exchange method of first embodiment and the second embodiment, intelligence
Robot system starts feedback, " you also, Beijing weather today is pretty good, fine day, 20 degree to 25 degree ".
3rd embodiment:
Fig. 3 is the structural representation of the speech recognition system based on intelligent robot system according to third embodiment of the invention
Figure, as it can be seen, this system includes:
Pressure signal receiver module 31, it receives the multi-modal input data of user, and detects whether setting position is deposited
At pressure signal.
Audio file records module 32, its when pressure signal be identified as long by operation time start voice recording function to
The phonetic entry at family carries out recording until pressure signal stops.
Processing and responder module 33, the audio file recorded is processed by it, and anti-to user according to the result processed
Present multi-modal response message.
Further, audio file is recorded module 32 and is included pressure signal recognition unit, and pressure signal recognition unit is to pressure
Force signal carries out timing, when timing time is more than the time threshold set, identifies that pressure signal is long by operation.
After judging that the pressure signal received is as growing by operation, intelligent robot calls the recording merit of audio file
Can, start the phonetic entry of user is recorded.User can export voice to intelligent robot simultaneously, but keep right simultaneously
The touch condition of setting position.
Intelligent robot system persistently detects this pressure signal, when pressure signal stops, and the output letter of pressure transducer
Number will undergo mutation, intelligent robot triggers one according to the sudden change of pressure signal and stops signal, and this stopping signal can be used for tying
The recording process of bundle audio file.
It follows that the audio file recorded can be processed by process and responder module 33 according to following steps, will record
The audio file of system is uploaded to Cloud Server, and audio file is carried out semantic analysis, according to the result of semantic analysis generate to
The multi-modal response message of family feedback.
The present embodiment solves with the interaction of robot, and user does not knows when robot starts language
The problem of sound identification, the when of particularly the most substantially differentiation each state of some robot, can use this clear and definite side
Formula, makes robot be constantly in speech recognition state, starts the dialogue to user and carry out relevant feedback after unclamping.Automatically handing over
On the basis of Hu, increase the interactive mode of a definite functions newly for intelligent robot system, the mutual body of user can have been improved
Test.
Those skilled in the art should be understood that each module of the above-mentioned present invention or each step can be with general calculating
Device realizes, and they can concentrate on single calculating device, or is distributed in the network that multiple calculating device is formed
On, alternatively, they can realize with calculating the executable program code of device, it is thus possible to be stored in storage
Device is performed by calculating device, or they are fabricated to respectively each integrated circuit modules, or by many in them
Individual module or step are fabricated to single integrated circuit module and realize.So, the present invention be not restricted to any specific hardware and
Software combines.
Although the embodiment that disclosed herein is as above, but described content is only to facilitate understand the present invention and adopt
Embodiment, be not limited to the present invention.Technical staff in any the technical field of the invention, without departing from this
On the premise of spirit and scope disclosed by invention, in form and any amendment and change can be made in details implement,
But the scope of patent protection of the present invention, still must be defined in the range of standard with appending claims.
Claims (10)
1. an audio recognition method based on intelligent robot system, including:
Receive the multi-modal input data of user, and detect whether setting position exists pressure signal;
Start voice recording function when described pressure signal is identified as length by operation the phonetic entry of user is recorded
Until described pressure signal stops;
The audio file recorded is processed, and according to the result processed to the multi-modal response message of user feedback.
Method the most according to claim 1, it is characterised in that identify described pressure signal, including:
Described pressure signal is carried out timing, when timing time is more than the time threshold set, identifies that described pressure signal is
Long by operation.
Method the most according to claim 2, it is characterised in that also include before identifying described pressure signal:
Interrupt the interaction mode that intelligent robot is current.
The most according to the method in claim 2 or 3, it is characterised in that the time threshold of described setting is more than or equal to 1S.
Method the most according to any one of claim 1 to 4, it is characterised in that the described audio file to recording is carried out
Process, including:
The audio file of recording is uploaded to Cloud Server;
Described audio file is carried out semantic analysis;
Result according to semantic analysis generates the multi-modal response message to user feedback.
6. a speech recognition system based on intelligent robot system, including:
Pressure signal receiver module, it receives the multi-modal input data of user, and detects whether setting position exists pressure
Signal;
Audio file records module, and it is identified as long by starting voice recording function when operating to user when described pressure signal
Phonetic entry carry out recording until described pressure signal stop;
Processing and responder module, the audio file recorded is processed by it, and according to the result processed to user feedback multimode
State response message.
System the most according to claim 6, it is characterised in that described audio file is recorded module and included pressure signal identification
Unit:
Described pressure signal recognition unit carries out timing to described pressure signal, when timing time is more than the time threshold set
Time, identify that described pressure signal is long by operation.
System the most according to claim 7, it is characterised in that described pressure signal recognition unit is identifying described pressure letter
Interrupt, before number, the interaction mode that intelligent robot is current.
9. according to the system described in claim 7 or 8, it is characterised in that the time threshold of described setting is more than or equal to 1S.
10. according to the system according to any one of claim 6 to 9, it is characterised in that described process and responder module according to
The audio file recorded is processed by lower step:
The audio file of recording is uploaded to Cloud Server;
Described audio file is carried out semantic analysis;
Result according to semantic analysis generates the multi-modal response message to user feedback.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610537538.5A CN106205619A (en) | 2016-07-08 | 2016-07-08 | Audio recognition method based on intelligent robot system and the system of identification |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610537538.5A CN106205619A (en) | 2016-07-08 | 2016-07-08 | Audio recognition method based on intelligent robot system and the system of identification |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106205619A true CN106205619A (en) | 2016-12-07 |
Family
ID=57472673
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610537538.5A Pending CN106205619A (en) | 2016-07-08 | 2016-07-08 | Audio recognition method based on intelligent robot system and the system of identification |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106205619A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109743606A (en) * | 2018-12-29 | 2019-05-10 | 深圳Tcl数字技术有限公司 | Pronunciation inputting method, speech input device and storage medium |
CN110867197A (en) * | 2019-10-23 | 2020-03-06 | 吴杰 | Method and equipment for interrupting voice robot in real time in voice interaction process |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120278074A1 (en) * | 2008-11-10 | 2012-11-01 | Google Inc. | Multisensory speech detection |
CN204496732U (en) * | 2015-02-09 | 2015-07-22 | 深圳易科泰业科技有限公司 | Speech recognition children education machine |
CN204667052U (en) * | 2015-06-03 | 2015-09-23 | 深圳市轻生活科技有限公司 | A kind of intelligent sound interactive terminal |
CN105117195A (en) * | 2015-09-09 | 2015-12-02 | 百度在线网络技术(北京)有限公司 | Method and device for guiding voice input |
CN105491126A (en) * | 2015-12-07 | 2016-04-13 | 百度在线网络技术(北京)有限公司 | Service providing method and service providing device based on artificial intelligence |
CN105678990A (en) * | 2015-12-31 | 2016-06-15 | 赵旭 | Remote controller, and detection and control method thereof |
-
2016
- 2016-07-08 CN CN201610537538.5A patent/CN106205619A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120278074A1 (en) * | 2008-11-10 | 2012-11-01 | Google Inc. | Multisensory speech detection |
CN204496732U (en) * | 2015-02-09 | 2015-07-22 | 深圳易科泰业科技有限公司 | Speech recognition children education machine |
CN204667052U (en) * | 2015-06-03 | 2015-09-23 | 深圳市轻生活科技有限公司 | A kind of intelligent sound interactive terminal |
CN105117195A (en) * | 2015-09-09 | 2015-12-02 | 百度在线网络技术(北京)有限公司 | Method and device for guiding voice input |
CN105491126A (en) * | 2015-12-07 | 2016-04-13 | 百度在线网络技术(北京)有限公司 | Service providing method and service providing device based on artificial intelligence |
CN105678990A (en) * | 2015-12-31 | 2016-06-15 | 赵旭 | Remote controller, and detection and control method thereof |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109743606A (en) * | 2018-12-29 | 2019-05-10 | 深圳Tcl数字技术有限公司 | Pronunciation inputting method, speech input device and storage medium |
CN110867197A (en) * | 2019-10-23 | 2020-03-06 | 吴杰 | Method and equipment for interrupting voice robot in real time in voice interaction process |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017075965A1 (en) | Voice information processing method and device | |
CN104360736A (en) | Gesture-based terminal control method and system | |
CN103001858B (en) | The method of message, client and system is replied in instant messaging | |
WO2018133874A1 (en) | Method and device for sending warning message | |
CN109754801A (en) | A kind of voice interactive system and method based on gesture identification | |
CN108271078A (en) | Pass through voice awakening method, smart television and the storage medium of gesture identification | |
CN108874904A (en) | Speech message searching method, device, computer equipment and storage medium | |
CN103973542B (en) | A kind of voice information processing method and device | |
CN106205619A (en) | Audio recognition method based on intelligent robot system and the system of identification | |
CN107197098A (en) | A kind of call control method and electronic equipment | |
CN106531168B (en) | Voice recognition method and device | |
CN108600511A (en) | The control system and method for intelligent sound assistant's equipment | |
CN106887228B (en) | Robot voice control method and device and robot | |
CN104080026B (en) | A kind of method of information processing and a kind of line control earphone | |
CN106493747B (en) | A kind of method of intelligent robot from turn manual service | |
CN112242135A (en) | Voice data processing method and intelligent customer service device | |
CN107767860B (en) | Voice information processing method and device | |
CN114363547A (en) | Double-recording device and double-recording interaction control method | |
CN108510981A (en) | The acquisition methods and system of voice data | |
TW200821894A (en) | Voice control system and method for controlling computers | |
CN111027358B (en) | Dictation and newspaper reading method based on writing progress and electronic equipment | |
CN109866237A (en) | A kind of arousal function device for intelligent robot | |
WO2013123853A1 (en) | Man-machine conversation method and device | |
CN113840040B (en) | Man-machine cooperation outbound method, device, equipment and storage medium | |
CN104932796B (en) | A kind of control method and device of component drag and drop |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161207 |
|
RJ01 | Rejection of invention patent application after publication |