CN109785834B - Voice data sample acquisition system and method based on verification code - Google Patents
Voice data sample acquisition system and method based on verification code Download PDFInfo
- Publication number
- CN109785834B CN109785834B CN201910065909.8A CN201910065909A CN109785834B CN 109785834 B CN109785834 B CN 109785834B CN 201910065909 A CN201910065909 A CN 201910065909A CN 109785834 B CN109785834 B CN 109785834B
- Authority
- CN
- China
- Prior art keywords
- sample
- voice
- verification
- text
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a voice data sample acquisition system based on a verification code and a method thereof.A user terminal is connected with a voice verification and acquisition module, a user initiates a verification request through the user terminal, verification service is provided for the user terminal through the voice verification and acquisition module which mainly comprises a sample acquisition server, a sample database, a calling terminal and a voice-to-text server, when in use, the voice verification and acquisition module sends standard text sample data according to the verification request, and the user reads the text content of the standard text sample data through the user terminal according to an instruction to obtain a voice sample; the voice verification and acquisition module carries out voice-to-character processing on the voice sample to obtain an instant character sample, verification and comparison are carried out, the voice sample is acquired if the comparison is successful, and otherwise, the voice sample is discarded. The whole process only needs user verification participation, on-site collection is not needed, and compared with the traditional manual input method, the voice sample collection method is low in workload and sampling cost investment.
Description
Technical Field
The invention relates to a voice data acquisition technology, in particular to a voice data sample acquisition system and a voice data sample acquisition method based on verification codes.
Background
With the rapid development of big data industry and artificial intelligence deep learning, the demand for data samples is exponentially increased. Because both artificial intelligence and big data need to be processed based on the data acquisition of the front end, the data acquisition of the next step can be performed, and the data acquisition in different fields and application scenarios with different functions has great differences, especially relating to the acquisition of the biological characteristics of human bodies. Such as face recognition, image recognition, voice translation, etc., since the collected data samples relate to fingerprints, facial images, voice, etc. of different people, the collected data samples need to be collected in large quantities. In the prior art, the collection of voice data samples is generally carried out through manual entry, so that the consumption of human resources is large, and the data collection cost is increased.
CAPTCHA (CAPTCHA) is an abbreviation for "computer Automated publishing test to tell Computers and Humans Apart", a common fully Automated program that distinguishes between a computer and a human. The user may prevent, when using on the third platform: malicious password cracking, ticket swiping, forum water filling, identity verification and other functions, and verification codes become a passing mode of a plurality of websites/platforms. Therefore, it is a challenge in the data collection field to realize the collection of voice data samples based on the third platform and by the verification code technology.
Disclosure of Invention
The invention aims to provide a voice data sample collection system based on a verification code, aiming at the problems, the invention is based on a way of providing a verification code service for a third-party platform, and utilizes the wide participation of a user in the verification code service to smoothly and quickly finish the collection of the voice data sample, thereby effectively saving the cost of data collection.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
a voice data sample collection system based on a verification code comprises a user terminal and a voice verification and collection module, wherein the user terminal is connected with the voice verification and collection module and used for initiating a verification request to the voice verification and collection module;
the voice verification and acquisition module is used for receiving a verification request of the user terminal, sending character sample data to be recognized to the user terminal according to the verification request, receiving a voice sample sent by the user terminal, performing voice-to-character processing on the voice sample to obtain instant character sample data, then performing verification comparison on the instant character sample data and standard character sample data stored in the voice verification and acquisition module, and determining whether to acquire the voice sample according to a verification comparison result.
As a preferred embodiment, the voice verification and acquisition module comprises a sample acquisition server, a sample database, a calling terminal and a voice-to-text server,
the user terminal is connected with the sample acquisition server and is used for performing information interaction with the sample acquisition server and initiating a verification request to the sample acquisition server; the user terminal is also connected with the calling terminal and used for receiving a speech path call sent by the calling terminal and reading text sample data according to the speech path call so as to output a voice sample corresponding to the text sample data to the calling terminal;
the sample acquisition server is used for providing verification service for the user terminal; the sample acquisition server is also connected with the sample database and is used for calling the character sample data stored in the sample database; the sample acquisition server is also connected with the calling terminal and is used for controlling the calling terminal to initiate calling verification to the user terminal;
the sample database is connected with the sample acquisition server and is used for providing the serial number of the character sample and storing the identified sample label for the sample acquisition server; the sample database is also connected with the calling terminal and used for storing the voice sample sent by the calling terminal;
the calling terminal is connected with the sample acquisition server and used for receiving a calling control request of the sample acquisition server; the calling terminal is connected with the user terminal and is used for initiating a call to the user terminal; the calling terminal is also connected with the voice-to-text server and is used for controlling the voice-to-text server to convert the voice sample into a text sample; the calling terminal is also connected with a sample database and used for storing the voice sample and the text sample in a correlation manner;
the voice-to-text server is connected with the calling terminal and used for responding to the control from the calling terminal so as to convert the voice sample into the text sample.
In the above scheme, preferably, the voice verification and acquisition module further includes a third party platform, and the third party platform is connected to the sample acquisition server and is configured to receive a verification result of the sample acquisition server on the voice sample; and the third-party platform is connected with the user terminal.
In the above scheme, preferably, the sample database sequentially adds the text samples successfully recognized each time to a voice collection sample stack, and the voice sample data successfully verified by the sample collection server is stored in the stack.
In the foregoing scheme, preferably, the data sample includes text sample data and voice sample data.
The invention also provides a voice data sample acquisition method based on the verification code, which comprises the following steps:
s1, the sample collection server provides verification service for information interaction between a user and a third-party platform, and the user sends a verification request to the sample collection server through a user terminal;
s2, after receiving a verification request from a user terminal, the sample acquisition server sends a request for calling data sample data to the sample database, and after a response of the sample database is obtained, the sample data containing the character sample to be identified is obtained;
s3, the sample collection server binds and integrates the character sample and the serial number in the character sample data obtained in the step S2 as a data sample and an effective check code stored in the sample collection server, then a check code is correspondingly generated and sent to the user terminal, and meanwhile, the user is reminded to answer the telephone call of the calling terminal, and the data sample comprises the data sample serial number and the character sample data;
s4, the sample collection server sends a call request to the calling terminal and sends the data sample number obtained in the step S3;
s5, the calling terminal receives the calling request from step S4 and then calls the user terminal;
s6, ringing and picking up the phone by the user;
s7, the calling terminal plays a voice prompt for reading the text sample content to the user terminal;
s8, after hearing the voice prompt tone for starting reading, starting reading the text content of the text sample in the step S3, and hanging up after ending to generate a voice sample corresponding to the text content;
s9, the calling terminal caches the voice sample obtained in the step S8 and sends a request of voice to text to a voice to text server;
s10, the voice-to-text server performs voice-to-text processing on the voice sample obtained in the step S8 to obtain a voice-to-text result, wherein the voice-to-text result is an instant text sample, and the instant text sample is returned to the calling terminal;
s11, the calling terminal sends the instant text sample to the sample collection server for result comparison;
s12, the sample collection server compares the instant text sample with the standard text sample stored in the sample collection server through the check code obtained in the step S3;
s13, if the matching is successful, sending a request for storing the voice sample to the calling terminal, feeding back a message of successful verification to the user terminal, and simultaneously pushing a notice of successful user verification to the third-party platform, wherein the calling terminal stores the voice sample into a stack corresponding to the text sample of the sample database after receiving the request for storing the voice sample;
and S14, if the matching fails, sending an instruction of discarding the voice sample to the calling terminal, sending a message of failed verification to the user terminal, pushing a notice of failed user verification to the third-party platform, and removing the data of the voice sample after the calling terminal receives the notice of discarding the voice sample.
Due to the adoption of the technical scheme, the invention has the following beneficial effects:
1. when the system is used, the voice verification and acquisition module sends out character sample data according to the verification request, and the user reads the character content of the standard character sample data through the user terminal according to an instruction to obtain a voice sample; the voice verification and acquisition module carries out voice-to-character conversion processing on the voice sample to obtain an instant character sample, verification and comparison are carried out on the instant character sample and standard character sample data stored in the interior based on the check code, the voice sample is acquired if the comparison is successful, and the voice sample is discarded if the comparison is not successful. The whole process only needs user verification participation, on-site collection is not needed, and compared with the traditional manual input method, the voice sample collection method is low in workload and sampling cost investment.
2. The method for collecting the voice sample fully utilizes the wide participation of the user in the verification code service to complete the collection of the voice data sample, not only greatly saves the cost, but also can improve the accuracy of the collection of the voice sample by setting or improving the standard character sample data stored in the sample collection server in the system and perfecting the function of the voice-to-character server, and can greatly improve the normalization of the voice collection without being influenced by the factors of the dialect accent, the pronunciation standard and the like of an individual through the verification mode of converting the character into the voice-to-the voice and comparing the character with the character.
Drawings
FIG. 1 is a block diagram of a system for collecting a voice data sample based on a verification code according to the present invention.
FIG. 2 is a timing diagram illustrating a method for collecting a speech data sample based on a verification code according to the present invention.
Detailed Description
The following further describes the embodiments of the present invention with reference to the drawings.
A voice data sample collection system based on a verification code comprises a user terminal and a voice verification and collection module, wherein the user terminal is connected with the voice verification and collection module and used for initiating a verification request to the voice verification and collection module, a user reads text contents in text sample data according to an instruction sent by the voice verification and collection module and correspondingly generates a voice sample, the voice sample is sent to the voice verification and collection module by the user terminal, and the text sample data comprises a text sample and a serial number.
The voice verification and acquisition module is used for receiving a verification request of the user terminal, sending character sample data to be recognized to the user terminal according to the verification request, receiving a voice sample sent by the user terminal, performing voice-to-character processing on the voice sample to obtain instant character sample data, then performing verification comparison on the instant character sample data and standard character sample data stored in the voice verification and acquisition module, and determining whether to acquire the voice sample according to a verification comparison result.
As shown in fig. 1, the voice verification and collection module includes a sample collection server, a sample database, a call terminal, a voice-to-text server, and a third-party platform.
The user terminal and the sample acquisition server are used for performing information interaction with the sample acquisition server and initiating a verification request to the sample acquisition server; the user terminal is also connected with the calling terminal and used for receiving a speech path call sent by the calling terminal and reading the text sample data according to the speech path call so as to output a voice sample corresponding to the text sample data to the calling terminal.
The user terminal is specifically a device with networking, displaying and audio input and output functions, such as a smart phone, a tablet computer or a tablet computer with a sound box.
The sample collection server is used for providing verification service for the user terminal. The sample collection server is also connected with the sample database and used for calling the character sample data stored in the sample database. The sample collection server is also connected with the calling terminal and is used for controlling the calling terminal to initiate calling verification to the user terminal.
The sample database is connected with the sample collection server and used for providing the serial number of the character sample and storing the identified sample label for the sample collection server. The sample database is also connected with the calling terminal and used for storing the voice sample sent by the calling terminal.
The calling terminal is connected with the sample acquisition server and used for receiving a calling control request of the sample acquisition server; the calling terminal is connected with the user terminal and used for calling the user terminal. The calling terminal is also connected with the voice-to-text server and is used for controlling the voice-to-text server to convert the voice sample into a text sample; the calling terminal is also connected with the sample database and used for storing the voice sample and the text sample in a correlation mode. The call terminal may be specifically a call platform or a call server.
The voice-to-text server is connected with the calling terminal and used for responding to the control from the calling terminal so as to convert the voice sample into the text sample.
The third-party platform is connected with the sample acquisition server and used for receiving a verification result of the sample acquisition server on the voice sample; and the third-party platform is connected with the user terminal. The third party platform is specifically a third party company or organization of the voice data sample collection system service. The voice data sample acquisition system can provide verification service for a third-party platform.
And the sample database sequentially adds the character samples successfully recognized each time to a voice acquisition sample stack, and the voice sample data successfully verified by the sample acquisition server is stored in the stack.
The data samples comprise text sample data and voice sample data.
As shown in fig. 2, the present invention provides a method for collecting a voice data sample based on a verification code, which comprises the following steps:
s1, the sample collection server provides verification service for information interaction between a user and a third-party platform, and the user sends a verification request to the sample collection server through a user terminal;
s2, after receiving a verification request from a user terminal, the sample acquisition server sends a request for calling data sample data to the sample database, and after a response of the sample database is obtained, the sample data containing the character sample to be identified is obtained;
s3, the sample collection server binds and integrates the character sample and the serial number in the character sample data obtained in the step S2 as a data sample and an effective check code stored in the sample collection server, then a check code is correspondingly generated and sent to the user terminal, and meanwhile, the user is reminded to answer the telephone call of the calling terminal, and the data sample comprises the data sample serial number and the character sample data;
s4, the sample collection server sends a call request to the calling terminal and sends the data sample number obtained in the step S3;
s5, the calling terminal receives the calling request from step S4 and then calls the user terminal;
s6, ringing and picking up the phone by the user;
s7, the calling terminal plays a voice prompt for reading the text sample content to the user terminal;
s8, after hearing the voice prompt tone for starting reading, starting reading the text content of the text sample in the step S3, and hanging up after ending to generate a voice sample corresponding to the text content;
s9, the calling terminal caches the voice sample obtained in the step S8 and sends a request of voice to text to a voice to text server;
s10, the voice-to-text server performs voice-to-text processing on the voice sample obtained in the step S8 to obtain a voice-to-text result, wherein the voice-to-text result is an instant text sample, and the instant text sample is returned to the calling terminal;
s11, the calling terminal sends the instant text sample to the sample collection server for result comparison;
s12, the sample collection server compares the instant text sample with the standard text sample stored in the sample collection server through the check code obtained in the step S3;
s13, if the matching is successful, sending a request for storing the voice sample to the calling terminal, feeding back a message of successful verification to the user terminal, and simultaneously pushing a notice of successful user verification to the third-party platform, wherein the calling terminal stores the voice sample into a stack corresponding to the text sample of the sample database after receiving the request for storing the voice sample;
and S14, if the matching fails, sending an instruction of discarding the voice sample to the calling terminal, sending a message of failed verification to the user terminal, pushing a notice of failed user verification to the third-party platform, and removing the data of the voice sample after the calling terminal receives the notice of discarding the voice sample.
Namely, the principle of collecting the voice data samples of the invention is as follows: the method has the advantages that the method comprises the steps of converting characters into voice (reading character samples by a user and further obtaining voice samples) → converting the voice into characters (the voice converting character server performs voice converting character processing on the voice samples) → checking the characters and characters for comparison (the sample collection server performs checking comparison), and the recognition and collection process cannot be influenced by personal accents, personal pronunciations or dialects and other factors, so that the normalization of voice collection can be greatly improved.
The above description is intended to describe in detail the preferred embodiments of the present invention, but the embodiments are not intended to limit the scope of the claims of the present invention, and all equivalent changes and modifications made within the technical spirit of the present invention should fall within the scope of the claims of the present invention.
Claims (6)
1. A voice data sample collection system based on identifying codes is characterized in that: comprises a user terminal and a voice verification and acquisition module,
the user terminal is connected with the voice verification and acquisition module and used for initiating a verification request to the voice verification and acquisition module, a user reads character contents in character sample data according to an instruction sent by the voice verification and acquisition module and correspondingly generates a voice sample, the voice sample is sent to the voice verification and acquisition module by the user terminal, and the character sample data comprises a character sample and a serial number;
the voice verification and acquisition module is used for receiving a verification request of the user terminal, sending character sample data to be recognized to the user terminal according to the verification request, receiving a voice sample sent by the user terminal, performing voice-to-character processing on the voice sample to obtain instant character sample data, then performing verification comparison on the instant character sample data and standard character sample data stored in the voice verification and acquisition module, and determining whether to acquire the voice sample according to a verification comparison result.
2. The system of claim 1, wherein the voice data sample collection system based on the verification code comprises: the voice verification and acquisition module comprises a sample acquisition server, a sample database, a calling terminal and a voice-to-text server,
the user terminal is connected with the sample acquisition server and is used for performing information interaction with the sample acquisition server and initiating a verification request to the sample acquisition server; the user terminal is also connected with the calling terminal and used for receiving a speech path call sent by the calling terminal and reading text sample data according to the speech path call so as to output a voice sample corresponding to the text sample data to the calling terminal;
the sample acquisition server is used for providing verification service for the user terminal; the sample acquisition server is also connected with the sample database and is used for calling the character sample data stored in the sample database; the sample acquisition server is also connected with the calling terminal and is used for controlling the calling terminal to initiate calling verification to the user terminal;
the sample database is connected with the sample acquisition server and is used for providing the serial number of the character sample and storing the identified sample label for the sample acquisition server; the sample database is also connected with the calling terminal and used for storing the voice sample sent by the calling terminal;
the calling terminal is connected with the sample acquisition server and used for receiving a calling control request of the sample acquisition server; the calling terminal is connected with the user terminal and is used for initiating a call to the user terminal; the calling terminal is also connected with the voice-to-text server and is used for controlling the voice-to-text server to convert the voice sample into a text sample; the calling terminal is also connected with a sample database and used for storing the voice sample and the text sample in a correlation manner;
the voice-to-text server is connected with the calling terminal and used for responding to the control from the calling terminal so as to convert the voice sample into the text sample.
3. The system of claim 2, wherein the voice data sample collection system based on the verification code comprises: the voice verification and acquisition module further comprises a third-party platform, and the third-party platform is connected with the sample acquisition server and used for receiving a verification result of the sample acquisition server on the voice sample; and the third-party platform is connected with the user terminal.
4. The system of claim 2, wherein the voice data sample collection system based on the verification code comprises: and the sample database sequentially adds the character samples successfully recognized each time to a voice acquisition sample stack, and the voice sample data successfully verified by the sample acquisition server is stored in the stack.
5. The system of claim 1, wherein the voice data sample collection system based on the verification code comprises: the data samples comprise text sample data and voice sample data.
6. A voice data sample collection method based on verification codes is characterized by comprising the following steps:
s1, the sample collection server provides verification service for information interaction between the user and the third-party platform, and the user sends a verification request to the sample collection server through the user terminal;
s2, after receiving a verification request from the user terminal, the sample acquisition server sends a request for calling data sample data to the sample database, and after a response of the sample database is obtained, the sample data containing the character to be identified is obtained;
s3, the sample collection server binds and integrates the character sample and the serial number in the character sample data obtained in the step S2 as a data sample and an effective check code stored in the sample collection server, then a check code is correspondingly generated and sent to the user terminal, and meanwhile, the user is reminded to answer the telephone call of the calling terminal, and the data sample comprises the data sample serial number and the character sample data;
s4, the sample collection server sends a call request to the calling terminal and sends the data sample number obtained in the step S3;
s5, the calling terminal receives the calling request from step S4 and then calls the user terminal;
s6, ringing and picking up the phone by the user;
s7, the calling terminal plays a voice prompt for reading the text sample content to the user terminal;
s8, after hearing the voice prompt tone for starting reading, starting reading the text content of the text sample in the step S3, and hanging up after ending to generate a voice sample corresponding to the text content;
s9, the calling terminal caches the voice sample obtained in the step S8 and sends a request of voice to text to a voice to text server;
s10, the voice-to-text server performs voice-to-text processing on the voice sample obtained in the step S8 to obtain a voice-to-text result, wherein the voice-to-text result is an instant text sample, and the instant text sample is returned to the calling terminal;
s11, the calling terminal sends the instant text sample to the sample collection server for result comparison;
s12, the sample collection server compares the instant text sample with the standard text sample stored in the sample collection server through the check code obtained in the step S3;
s13, if the matching is successful, sending a request for storing the voice sample to the calling terminal, feeding back a message of successful verification to the user terminal, and simultaneously pushing a notice of successful user verification to the third-party platform, wherein the calling terminal stores the voice sample into a stack corresponding to the text sample of the sample database after receiving the request for storing the voice sample;
and S14, if the matching fails, sending an instruction of discarding the voice sample to the calling terminal, sending a message of failed verification to the user terminal, pushing a notice of failed user verification to the third-party platform, and removing the data of the voice sample after the calling terminal receives the notice of discarding the voice sample.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910065909.8A CN109785834B (en) | 2019-01-24 | 2019-01-24 | Voice data sample acquisition system and method based on verification code |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910065909.8A CN109785834B (en) | 2019-01-24 | 2019-01-24 | Voice data sample acquisition system and method based on verification code |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109785834A CN109785834A (en) | 2019-05-21 |
| CN109785834B true CN109785834B (en) | 2021-06-11 |
Family
ID=66502214
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910065909.8A Active CN109785834B (en) | 2019-01-24 | 2019-01-24 | Voice data sample acquisition system and method based on verification code |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109785834B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110223429A (en) * | 2019-06-19 | 2019-09-10 | 上海应用技术大学 | Voice access control system |
| CN111128136A (en) * | 2019-11-28 | 2020-05-08 | 星络智能科技有限公司 | User-defined voice control method, computer equipment and readable storage medium |
| CN112422377A (en) * | 2020-10-26 | 2021-02-26 | 深圳Tcl新技术有限公司 | Intelligent terminal control method and device and computer readable storage medium |
| CN112381512A (en) * | 2020-11-15 | 2021-02-19 | 周岳 | Verification system and verification method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107104803B (en) * | 2017-03-31 | 2020-01-07 | 北京华控智加科技有限公司 | User identity authentication method based on digital password and voiceprint joint confirmation |
| US9986394B1 (en) * | 2017-06-26 | 2018-05-29 | Amazon Technologies, Inc. | Voice-based messaging |
-
2019
- 2019-01-24 CN CN201910065909.8A patent/CN109785834B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109785834A (en) | 2019-05-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109785834B (en) | Voice data sample acquisition system and method based on verification code | |
| KR102250460B1 (en) | Methods, devices and systems for building user glottal models | |
| US9607621B2 (en) | Customer identification through voice biometrics | |
| WO2018113526A1 (en) | Face recognition and voiceprint recognition-based interactive authentication system and method | |
| CN110428820B (en) | Chinese and English mixed speech recognition method and device | |
| CN110047481B (en) | Method and apparatus for speech recognition | |
| CN109361825A (en) | Meeting summary recording method, terminal and computer storage medium | |
| CN108447471A (en) | Audio recognition method and speech recognition equipment | |
| CN111883140A (en) | Authentication method, device, equipment and medium based on knowledge graph and voiceprint recognition | |
| CN110266900B (en) | Method and device for identifying customer intention and customer service system | |
| CN102413100A (en) | Voice-print authentication system having voice-print password picture prompting function and realization method thereof | |
| CN111063355A (en) | Conference record generation method and recording terminal | |
| CN112397052B (en) | VAD sentence breaking test method, device, computer equipment and storage medium | |
| CN110766442A (en) | Client information verification method, device, computer equipment and storage medium | |
| CN109003600B (en) | Message processing method and device | |
| US20070033041A1 (en) | Method of identifying a person based upon voice analysis | |
| CN112487381A (en) | Identity authentication method and device, electronic equipment and readable storage medium | |
| CN111326154A (en) | Voice interaction method and device, storage medium and electronic equipment | |
| CN112509586A (en) | Method and device for recognizing voice print of telephone channel | |
| CN112417412A (en) | Bank account balance inquiry method, device and system | |
| CN109783822B (en) | Data sample identification system and method based on verification code | |
| TW200304638A (en) | Network-accessible speaker-dependent voice models of multiple persons | |
| CN111768789A (en) | Electronic equipment and method, device and medium for determining identity of voice sender thereof | |
| CN109273012B (en) | Identity authentication method based on speaker recognition and digital voice recognition | |
| CN111833907B (en) | Man-machine interaction method, terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |