CN106205619A - Audio recognition method based on intelligent robot system and the system of identification - Google Patents

Audio recognition method based on intelligent robot system and the system of identification Download PDF

Info

Publication number
CN106205619A
CN106205619A CN201610537538.5A CN201610537538A CN106205619A CN 106205619 A CN106205619 A CN 106205619A CN 201610537538 A CN201610537538 A CN 201610537538A CN 106205619 A CN106205619 A CN 106205619A
Authority
CN
China
Prior art keywords
pressure signal
user
audio file
described pressure
intelligent robot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610537538.5A
Other languages
Chinese (zh)
Inventor
汪霄鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Guangnian Wuxian Technology Co Ltd
Original Assignee
Beijing Guangnian Wuxian Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Guangnian Wuxian Technology Co Ltd filed Critical Beijing Guangnian Wuxian Technology Co Ltd
Priority to CN201610537538.5A priority Critical patent/CN106205619A/en
Publication of CN106205619A publication Critical patent/CN106205619A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/28Constructional details of speech recognition systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Abstract

The invention discloses a kind of audio recognition method based on intelligent robot system and identification system, the method includes the multi-modal input data receiving user, and detects whether setting position exists pressure signal;Start voice recording function the phonetic entry of user to be recorded until described pressure signal stops when described pressure signal is identified as length by operation;The audio file recorded is processed, and according to the result processed to the multi-modal response message of user feedback.This method solve with the interactive voice of robot during, user does not knows the problem when robot starts speech recognition, the when of particularly each state of some robot the most substantially differentiation, use this clear and definite mode can improve mutual effectiveness, and it can be avoided that owing to have received the voice signal of mistake and the interaction error that causes, improve user-interaction experience.

Description

Audio recognition method based on intelligent robot system and the system of identification
Technical field
The invention belongs to field in intelligent robotics, particularly relate to a kind of audio recognition method based on intelligent robot system And identification system.
Background technology
Intelligent robot designed to be able to carry out multi-modal receive multi-modal input data alternately, the multimode to input State data carry out processing and make multi-modal response feedback.Wherein, multi-modal input data can be that action inputs data, language Sound input data and image input data etc..
Multi-modal input data can realize signals collecting by the sensor being arranged on intelligent robot.Such as, Action input data can be received by touch sensor and imageing sensor, and input voice data can be by sound transducer Receiving, image input data are received by imageing sensor.Good mutual in order to provide, need accurately to receive various multi-modal defeated Enter data, therefore need badly and improve intelligent robot system to the treatment mechanism of multi-modal data and lifting intelligent robot system Disposal ability to multi-modal data.
Summary of the invention
One of the technical problem to be solved is to need to provide one to promote intelligent robot system to multi-modal The method of the disposal ability of data.
In order to solve above-mentioned technical problem, embodiments herein provide firstly a kind of based on intelligent robot system Audio recognition method, including the multi-modal input data of reception user, and detects whether setting position exists pressure signal;When Described pressure signal be identified as long by operation time start voice recording function and the phonetic entry of user recorded until institute State pressure signal to stop;The audio file recorded is processed, and according to the result processed to the multi-modal response of user feedback Information.
Preferably, identify described pressure signal, carry out timing including to described pressure signal, when timing time is more than setting Time threshold time, identify described pressure signal for long by operation.
Preferably, also include before identifying described pressure signal interrupting the interaction mode that intelligent robot is current.
Preferably, the time threshold of described setting is more than or equal to 1S.
Preferably, the described audio file to recording processes, and is uploaded to cloud service including by the audio file of recording Device;Described audio file is carried out semantic analysis;Result according to semantic analysis generates to be believed to the multi-modal response of user feedback Breath.
Embodiments herein additionally provides a kind of speech recognition system based on intelligent robot system, including: pressure Signal receiving module, it receives the multi-modal input data of user, and detects whether setting position exists pressure signal;Audio frequency Document recording module, it is identified as long defeated to the voice of user by starting voice recording function when operating when described pressure signal Enter to carry out recording until described pressure signal stops;Processing and responder module, the audio file recorded is processed by it, and root According to the result processed to the multi-modal response message of user feedback.
Preferably, described audio file is recorded module and is included pressure signal recognition unit: described pressure signal recognition unit Described pressure signal is carried out timing, when timing time is more than the time threshold set, identifies that described pressure signal is pressed for long Operation.
Preferably, described pressure signal recognition unit is identifying that to interrupt intelligent robot before described pressure signal current Interaction mode.
Preferably, the time threshold of described setting is more than or equal to 1S.
Preferably, the audio file recorded is processed by described process and responder module according to following steps: will record Audio file be uploaded to Cloud Server;Described audio file is carried out semantic analysis;Result according to semantic analysis generate to The multi-modal response message of user feedback.
Compared with prior art, the one or more embodiments in such scheme can have the advantage that or useful effect Really:
By with the interactive voice of intelligent robot during increase a definite functions interactive mode, solve During the interactive voice of robot, user does not knows when robot starts the problem of speech recognition, particularly The when that each state of some robot the most substantially being distinguished, this clear and definite mode is used to improve mutual effective Property, it is to avoid the interaction error caused owing to have received the voice signal of mistake, improves the interactive experience of user.
Other advantages of the present invention, target, and feature will be illustrated to a certain extent in the following description, and And to a certain extent, will be apparent to those skilled in the art based on to investigating hereafter, or can To be instructed from the practice of the present invention.The target of the present invention and other advantages can pass through description below, and right is wanted The structure asking specifically noted in book, and accompanying drawing realizes and obtains.
Accompanying drawing explanation
Accompanying drawing is used for providing being further appreciated by of the technical scheme to the application or prior art, and constitutes description A part.Wherein, the accompanying drawing expressing the embodiment of the present application is used for explaining the technical side of the application together with embodiments herein Case, but it is not intended that the restriction to technical scheme.
Fig. 1 is the flow process signal of the audio recognition method based on intelligent robot system according to first embodiment of the invention Figure;
Fig. 2 is the flow process signal of the audio recognition method based on intelligent robot system according to second embodiment of the invention Figure;
Fig. 3 is the structural representation of the speech recognition system based on intelligent robot system according to third embodiment of the invention Figure.
Detailed description of the invention
Describe embodiments of the present invention in detail below with reference to drawings and Examples, whereby how the present invention is applied Technological means solves technical problem, and the process that realizes reaching relevant art effect can fully understand and implement according to this.This Shen Please each feature in embodiment and embodiment, can be combined with each other under not colliding premise, the technical scheme formed All within protection scope of the present invention.
When carrying out interactive voice with intelligent robot, first intelligent robot receives the phonetic entry letter data of user, Again the input voice data received is identified, then issues the user with multi-modal feedback letter according to the result identified Breath.In this process, completely the input voice data, being accurately received user is most important to subsequent treatment.
There is the indefinite problem of point of penetration to speech identifying function in intelligent robot of the prior art.Concrete manifestation For, it is impossible in time, it is synchronously received the input voice data of user, to such an extent as to the data received are imperfect, and then can not be accurate Really understand demand and the intention of user, cause intelligent robot can not make correct reaction in interactive voice, reduce Consumer's Experience.
The present invention is directed to the problems referred to above, propose the interaction mechanism of a kind of input point of penetration that can specify speech data, under Face describes in detail in conjunction with specific embodiments.
First embodiment:
Fig. 1 is the schematic flow sheet of the audio recognition method based on intelligent robot system according to the embodiment of the present invention, As it can be seen, the method comprises the following steps:
Step S110, the multi-modal input data of reception user, and detect whether setting position exists pressure signal.
Step S120, the startup voice recording function phonetic entry to user when pressure signal is identified as length by operation Carry out recording until pressure signal stops.
Step S130, to record audio file process, and according to process result to user feedback multi-modal should Answer information.
Concrete, in step s 110, if user prepares to initiate voice dialogue to intelligent robot, first send one Individual cue, for informing that the input voice data below intelligent robot is the inputs of effective data.
For example, user carries out growing by operation, such as at intelligent robot at the upper setting position of intelligent robot Head, set position be provided with pressure transducer.This pressure transducer has the signal output of correspondence.Intelligent machine According to the output signal of this pressure transducer, people may determine that the data that user is currently entered are effective speech data.
In order to prevent from receiving other invalid input information during speech data inputs, user should persistently touch Touching the setting position on intelligent machine human body, such pressure transducer will have the output of continuous print signal, touch user Mechanism sound intermediate frequency receive equipment and will persistently record the voice messaging of user.
In the step s 120, the continuous print sensor output signal received is identified as concrete by intelligent robot system Operation.Including, the lasting pressure signal received is carried out timing, when timing time is more than the time threshold set, will Pressure signal is judged as long by operation.
The setting of time threshold can according to the operating habit of user, the precision of sensor and intelligent robot system Identification ability selects.In one embodiment of the invention, the time threshold of setting is set greater than equal to 1S.
After judging that the pressure signal received is as growing by operation, intelligent robot will call the recording function of audio file Start the voice dialogue of user is recorded.User long press intelligent robot setting position can while to intelligent machine Device people exports voice, thus realizes the recording to speech data.
It should be noted that judge pressure signal be one long by operation after can stop the timing to pressure signal, Although now user is maintained as the pressed state to setting position, pressure transducer the most persistently has pressure signal to spread out of.
As long as intelligent robot system detects lasting pressure signal, input voice data will be carried out continuous print record System.When the pressing operation of user stops, the output signal of pressure transducer will be undergone mutation, and intelligent robot is believed according to pressure Number sudden change trigger one stop signal, this stopping signal can be used for the recording process of end-sound frequency file.
In step s 130, by processing audio file, generate should to the multi-modal of the multi-modal input information of user Answer feedback.
Concrete, first the audio file of recording can be uploaded to Cloud Server, Cloud Server by intelligent robot system Receive this audio file, audio file carried out semantic analysis, know the intention of user, and based on the result analyzed generate to The multi-modal response of family feedback.Then this response is back to intelligent robot system, by intelligent robot system according to response The instruction of information exports multi-modal data to user, can be the output etc. of action output, voice output and writings and image.
In the present embodiment, the clear and definite instruction information inputted to intelligent robot system based on user, so that intelligent Robot system can know the time point of the input of the effective multi-modal input data of user exactly, it is possible to effectively keeps away Exempting to receive invalid input data, this clear and definite interactive mode is conducive to improving interactive quality, improves Consumer's Experience.
Second embodiment:
Fig. 2 is the flow process signal of the audio recognition method based on intelligent robot system according to second embodiment of the invention Figure, as shown in the figure:
First intelligent robot system receives the multi-modal input data of user, and detects whether setting position exists pressure Force signal.If there is not pressure signal at this setting position, then continue to monitor the input of multi-modal data.If be detected that There is pressure signal, then do following process.
After intelligent robot receives the output signal of pressure transducer, call immediately and interrupt logic, interrupt logic energy Enough suspend the operation performed by intelligent robot system or the residing current state that logs off.
It follows that the pressure signal received is identified by intelligent robot system, knows method for distinguishing and first and implement Method in example is identical, and the lasting pressure signal received is carried out timing, when timing time is more than the time threshold set Time, pressure signal is judged as long by operation.
If long by operation by identifying that pressure signal is defined as, then open the recording of audio file.
When carrying out the recording of audio file, persistently detect pressure signal, and judge whether pressure signal stops.
If pressure signal does not stops, then proceed the recording of audio file.Until detecting that pressure signal stops knot The recording of bundle audio file, its operation is all identical with the method in first embodiment, repeats no more.
If not being long by operation by identifying that pressure signal judges, then intelligent robot performs other default Operation.
Intelligent robot system the most also can be called and interrupt logic, the shortest by operating, in order to avoid Intelligent robot system mistake starts the recording to audio file, in the present embodiment, it is necessary to be identified as long at pressure signal Received later when continuous print pressure signal meets, just can be carried out audio file simultaneously by operation and intelligent robot system Record.
Interrupt that logic interrupts is the state of the operation performed by intelligent robot system or robot system, the most Perform certain internal applications, or response is done in input to user in the way of multi-modal, calls in intelligent robot system All can temporarily stop after interrupting logic to perform.
After the recording of end-sound frequency file, the audio file recorded can be uploaded to cloud clothes by intelligent robot system Business device.
Cloud Server carries out speech analysis to audio file, determines the intention of user, generates feedback response, is back to intelligence Robotic end.
Intelligent robot exports data according to feedback response to user and completes alternately.
The method of the present embodiment can make intelligent robot system based on interrupting logic working, it is to avoid to unsolicited audio frequency literary composition The mistake response of part recording task.
Based on above-mentioned first embodiment and the exchange method of the second embodiment, it is possible to achieve following is mutual:
Pressing robot head with the head of a household, the persistent period is more than 1S, then loquiturs, and " you are good, robot, and today is northern The weather in capital how ".The head of use hands sustained hold robot during talking with robot.After dialogue completes Unclamp hands, after intelligent robot has performed semantic analysis according to the exchange method of first embodiment and the second embodiment, intelligence Robot system starts feedback, " you also, Beijing weather today is pretty good, fine day, 20 degree to 25 degree ".
3rd embodiment:
Fig. 3 is the structural representation of the speech recognition system based on intelligent robot system according to third embodiment of the invention Figure, as it can be seen, this system includes:
Pressure signal receiver module 31, it receives the multi-modal input data of user, and detects whether setting position is deposited At pressure signal.
Audio file records module 32, its when pressure signal be identified as long by operation time start voice recording function to The phonetic entry at family carries out recording until pressure signal stops.
Processing and responder module 33, the audio file recorded is processed by it, and anti-to user according to the result processed Present multi-modal response message.
Further, audio file is recorded module 32 and is included pressure signal recognition unit, and pressure signal recognition unit is to pressure Force signal carries out timing, when timing time is more than the time threshold set, identifies that pressure signal is long by operation.
After judging that the pressure signal received is as growing by operation, intelligent robot calls the recording merit of audio file Can, start the phonetic entry of user is recorded.User can export voice to intelligent robot simultaneously, but keep right simultaneously The touch condition of setting position.
Intelligent robot system persistently detects this pressure signal, when pressure signal stops, and the output letter of pressure transducer Number will undergo mutation, intelligent robot triggers one according to the sudden change of pressure signal and stops signal, and this stopping signal can be used for tying The recording process of bundle audio file.
It follows that the audio file recorded can be processed by process and responder module 33 according to following steps, will record The audio file of system is uploaded to Cloud Server, and audio file is carried out semantic analysis, according to the result of semantic analysis generate to The multi-modal response message of family feedback.
The present embodiment solves with the interaction of robot, and user does not knows when robot starts language The problem of sound identification, the when of particularly the most substantially differentiation each state of some robot, can use this clear and definite side Formula, makes robot be constantly in speech recognition state, starts the dialogue to user and carry out relevant feedback after unclamping.Automatically handing over On the basis of Hu, increase the interactive mode of a definite functions newly for intelligent robot system, the mutual body of user can have been improved Test.
Those skilled in the art should be understood that each module of the above-mentioned present invention or each step can be with general calculating Device realizes, and they can concentrate on single calculating device, or is distributed in the network that multiple calculating device is formed On, alternatively, they can realize with calculating the executable program code of device, it is thus possible to be stored in storage Device is performed by calculating device, or they are fabricated to respectively each integrated circuit modules, or by many in them Individual module or step are fabricated to single integrated circuit module and realize.So, the present invention be not restricted to any specific hardware and Software combines.
Although the embodiment that disclosed herein is as above, but described content is only to facilitate understand the present invention and adopt Embodiment, be not limited to the present invention.Technical staff in any the technical field of the invention, without departing from this On the premise of spirit and scope disclosed by invention, in form and any amendment and change can be made in details implement, But the scope of patent protection of the present invention, still must be defined in the range of standard with appending claims.

Claims (10)

1. an audio recognition method based on intelligent robot system, including:
Receive the multi-modal input data of user, and detect whether setting position exists pressure signal;
Start voice recording function when described pressure signal is identified as length by operation the phonetic entry of user is recorded Until described pressure signal stops;
The audio file recorded is processed, and according to the result processed to the multi-modal response message of user feedback.
Method the most according to claim 1, it is characterised in that identify described pressure signal, including:
Described pressure signal is carried out timing, when timing time is more than the time threshold set, identifies that described pressure signal is Long by operation.
Method the most according to claim 2, it is characterised in that also include before identifying described pressure signal:
Interrupt the interaction mode that intelligent robot is current.
The most according to the method in claim 2 or 3, it is characterised in that the time threshold of described setting is more than or equal to 1S.
Method the most according to any one of claim 1 to 4, it is characterised in that the described audio file to recording is carried out Process, including:
The audio file of recording is uploaded to Cloud Server;
Described audio file is carried out semantic analysis;
Result according to semantic analysis generates the multi-modal response message to user feedback.
6. a speech recognition system based on intelligent robot system, including:
Pressure signal receiver module, it receives the multi-modal input data of user, and detects whether setting position exists pressure Signal;
Audio file records module, and it is identified as long by starting voice recording function when operating to user when described pressure signal Phonetic entry carry out recording until described pressure signal stop;
Processing and responder module, the audio file recorded is processed by it, and according to the result processed to user feedback multimode State response message.
System the most according to claim 6, it is characterised in that described audio file is recorded module and included pressure signal identification Unit:
Described pressure signal recognition unit carries out timing to described pressure signal, when timing time is more than the time threshold set Time, identify that described pressure signal is long by operation.
System the most according to claim 7, it is characterised in that described pressure signal recognition unit is identifying described pressure letter Interrupt, before number, the interaction mode that intelligent robot is current.
9. according to the system described in claim 7 or 8, it is characterised in that the time threshold of described setting is more than or equal to 1S.
10. according to the system according to any one of claim 6 to 9, it is characterised in that described process and responder module according to The audio file recorded is processed by lower step:
The audio file of recording is uploaded to Cloud Server;
Described audio file is carried out semantic analysis;
Result according to semantic analysis generates the multi-modal response message to user feedback.
CN201610537538.5A 2016-07-08 2016-07-08 Audio recognition method based on intelligent robot system and the system of identification Pending CN106205619A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610537538.5A CN106205619A (en) 2016-07-08 2016-07-08 Audio recognition method based on intelligent robot system and the system of identification

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610537538.5A CN106205619A (en) 2016-07-08 2016-07-08 Audio recognition method based on intelligent robot system and the system of identification

Publications (1)

Publication Number Publication Date
CN106205619A true CN106205619A (en) 2016-12-07

Family

ID=57472673

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610537538.5A Pending CN106205619A (en) 2016-07-08 2016-07-08 Audio recognition method based on intelligent robot system and the system of identification

Country Status (1)

Country Link
CN (1) CN106205619A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109743606A (en) * 2018-12-29 2019-05-10 深圳Tcl数字技术有限公司 Pronunciation inputting method, speech input device and storage medium
CN110867197A (en) * 2019-10-23 2020-03-06 吴杰 Method and equipment for interrupting voice robot in real time in voice interaction process

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120278074A1 (en) * 2008-11-10 2012-11-01 Google Inc. Multisensory speech detection
CN204496732U (en) * 2015-02-09 2015-07-22 深圳易科泰业科技有限公司 Speech recognition children education machine
CN204667052U (en) * 2015-06-03 2015-09-23 深圳市轻生活科技有限公司 A kind of intelligent sound interactive terminal
CN105117195A (en) * 2015-09-09 2015-12-02 百度在线网络技术(北京)有限公司 Method and device for guiding voice input
CN105491126A (en) * 2015-12-07 2016-04-13 百度在线网络技术(北京)有限公司 Service providing method and service providing device based on artificial intelligence
CN105678990A (en) * 2015-12-31 2016-06-15 赵旭 Remote controller, and detection and control method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120278074A1 (en) * 2008-11-10 2012-11-01 Google Inc. Multisensory speech detection
CN204496732U (en) * 2015-02-09 2015-07-22 深圳易科泰业科技有限公司 Speech recognition children education machine
CN204667052U (en) * 2015-06-03 2015-09-23 深圳市轻生活科技有限公司 A kind of intelligent sound interactive terminal
CN105117195A (en) * 2015-09-09 2015-12-02 百度在线网络技术(北京)有限公司 Method and device for guiding voice input
CN105491126A (en) * 2015-12-07 2016-04-13 百度在线网络技术(北京)有限公司 Service providing method and service providing device based on artificial intelligence
CN105678990A (en) * 2015-12-31 2016-06-15 赵旭 Remote controller, and detection and control method thereof

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109743606A (en) * 2018-12-29 2019-05-10 深圳Tcl数字技术有限公司 Pronunciation inputting method, speech input device and storage medium
CN110867197A (en) * 2019-10-23 2020-03-06 吴杰 Method and equipment for interrupting voice robot in real time in voice interaction process

Similar Documents

Publication Publication Date Title
WO2017075965A1 (en) Voice information processing method and device
CN104360736A (en) Gesture-based terminal control method and system
CN103001858B (en) The method of message, client and system is replied in instant messaging
WO2018133874A1 (en) Method and device for sending warning message
CN109754801A (en) A kind of voice interactive system and method based on gesture identification
CN108271078A (en) Pass through voice awakening method, smart television and the storage medium of gesture identification
CN108874904A (en) Speech message searching method, device, computer equipment and storage medium
CN103973542B (en) A kind of voice information processing method and device
CN106205619A (en) Audio recognition method based on intelligent robot system and the system of identification
CN107197098A (en) A kind of call control method and electronic equipment
CN106531168B (en) Voice recognition method and device
CN108600511A (en) The control system and method for intelligent sound assistant's equipment
CN106887228B (en) Robot voice control method and device and robot
CN104080026B (en) A kind of method of information processing and a kind of line control earphone
CN106493747B (en) A kind of method of intelligent robot from turn manual service
CN112242135A (en) Voice data processing method and intelligent customer service device
CN107767860B (en) Voice information processing method and device
CN114363547A (en) Double-recording device and double-recording interaction control method
CN108510981A (en) The acquisition methods and system of voice data
TW200821894A (en) Voice control system and method for controlling computers
CN111027358B (en) Dictation and newspaper reading method based on writing progress and electronic equipment
CN109866237A (en) A kind of arousal function device for intelligent robot
WO2013123853A1 (en) Man-machine conversation method and device
CN113840040B (en) Man-machine cooperation outbound method, device, equipment and storage medium
CN104932796B (en) A kind of control method and device of component drag and drop

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20161207

RJ01 Rejection of invention patent application after publication