CN104049964B - Chinese speech low coverage or the method for long-range control electromechanical equipment operation - Google Patents
Chinese speech low coverage or the method for long-range control electromechanical equipment operation Download PDFInfo
- Publication number
- CN104049964B CN104049964B CN201310083811.8A CN201310083811A CN104049964B CN 104049964 B CN104049964 B CN 104049964B CN 201310083811 A CN201310083811 A CN 201310083811A CN 104049964 B CN104049964 B CN 104049964B
- Authority
- CN
- China
- Prior art keywords
- chinese
- electromechanical equipment
- voice
- speech
- computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Document Processing Apparatus (AREA)
Abstract
The technical program is a kind of method of Chinese speech low coverage or long-range control electromechanical equipment operation, belongs to low coverage or long-distance intelligent electromechanical equipment automatic control technology field.The technology that the technical program uses is that the Chinese speech for inputting remote control device is converted into Chinese language text by Mandarin speech recognition module first by remote control device, then Chinese language text is sent to the computer system of control electromechanical equipment by network transmission module, then by computer program that is in the computer system for having previously been stored in control electromechanical equipment and binding with the keyword in the above-mentioned Chinese phonetics codes being converted into or Chinese character or the Chinese phonetic alphabet by the computer control execution module execution for handing over control electromechanical equipment after the successive logical order arrangement of execution.After having the technical program, the voice that can be convenient non-computer programming personnel's Chinese natural language passes through remote controler low coverage or long-range control electromechanical equipment operation.
Description
Technical field
The technical program belongs to low coverage or long-distance intelligent electromechanical equipment automatic control technology field.
Background technique
The current prior art wants low coverage or remotely controls electromechanical equipment, generally to carry out computer programming, also to carry out
Computer low coverage or telecommunication, this is the thing for being difficult to accomplish for general Non-computer Majors personnel, on the market
Although there is some technologies run by voice control electromechanical equipment, substantially some simple orders substantially " are said
One says " electromechanical equipment " making a motion ", and can only accomplish live real-time control, pass through remote control dress with Chinese natural language
It sets low coverage or remotely controls electromechanical equipment, allow electromechanical equipment that can be automatically performed a series of complex as long as in the case where meeting certain condition
There is presently no appearance for the technology of program operation, this just gives the ruck Chinese speech of a large amount of Non-computer Majors personnel
Low coverage or long-range control electromechanical equipment operation bring the obstacle for being difficult to go beyond.
Summary of the invention
The it is proposed of the technical program is exactly to solve above-mentioned these problems occur.Specifically the technical program passes through one
Kind Chinese speech low coverage controls the technology for the method that electromechanical equipment is run remotely to solve the above-mentioned problem.
The Chinese speech for inputting remote control device is passed through Chinese speech first using: remote control device and known by the technical program
Other module is converted into Chinese language text, then sends Chinese language to the computer system of control electromechanical equipment by network transmission module
This, then by have previously been stored in control electromechanical equipment computer system in and with it is above-mentioned be converted by 26 Latin alphabets
The calculating of keyword binding in the Chinese phonetics codes Chinese language text or Chinese character and words text or Chinese phonetic alphabet Chinese language text of spelling
Machine program is controlled according to the semanteme of non-key word by the computer of friendship control electromechanical equipment after the successive logical order arrangement executed
Execution module executes；
The Chinese language text includes the Chinese sentence text by forming comprising keyword and non-key word.
The computer system of the control electromechanical equipment can be desktop computer or laptop or server or
Person's cloud computer system, is also possible to embedded computer system.
The Chinese speech that the remote control device receives can be inputted by microphone, phone input or cable network input,
Or wireless network input.
The network transmission module covers cable network and wireless network software and hardware Transmission system and transmission module, comprising:
Fixed Telephony Transmission system, power line communication Transmission system, cable of cable TV communication transmission system, internet, local
Net, 2.5G, 3G, 4G, wifi, wimax, bluetooth, Zigbee short range double-direction radio networked system, CAN serial bus control local
Net system.
The remote control device refers to all devices that character text information can be sent to the computer system to be controlled,
It include: fixed-line telephone system, mobile phone, desktop computer, laptop, net book, individual digital information assistants PDA, remote control dress
It sets, information communication software module.
Electromechanical equipment is divided into both of which operation, one is automatic running patterns, and the mode is according to control in commencement of commercial operation
The computer system of electromechanical equipment processed to receive by Chinese speech it is converted Lai the understanding of Chinese language text carry out program automatically
Operation, and by the movement to be carried out or function to be achieved in the form of the speech synthesis of Chinese language text or the Chinese language text
Output；Another kind is inquiry affirmation mode, and the computer system of electromechanical equipment is controlled under the mode to according to received Chinese language
The Chinese language text that sound is converted into first correctly is corrected and is executed the optimization of program, and is fed back one and be properly corrected and execute
The Chinese language text that program optimization is crossed, the Chinese language text can also be exported in the form of Chinese speech by voice synthetic module, be passed through
It is executed after confirmation by the computer system control execution module of control electromechanical equipment.
The execution module includes driving uinit module and power unit module and performance unit module and interface list
Element module.
The remote control device or electromechanical equipment has the automatic training function of voice command, and remote control device operator is in term
Before sound order controls electromechanical equipment, remote control device or electromechanical equipment understand one rule Chinese of voice command that actively can execute it
Massage voice reading comes out, it is desirable that operator with read, and using operator with reading voice as template and with corresponding to the sound template
Control electromechanical equipment voice command or corresponding execution programmatic binding after be stored in remote control device or the control electromechanics is set
In standby computer system.
The operator includes Chinese putonghua speech, the voice of Chinese dialects, minority language with the voice of reading
Voice, foreign language voice, a kind of special sound that can be mutually distinguished with the sound of other voice commands.
The remote control device or electromechanical equipment with voice command automatically train operator with read voice command when, in addition to
Issue corresponding Chinese putonghua speech, additionally it is possible to voice, the minority language of Chinese dialects are issued according to preparatory setting
Voice, foreign language voice.
The remote control device or electromechanical equipment is when carrying out voice command and training automatically, the voice that actively can execute it
While ordering a rule Chinese speech is bright to read out, the voice command read aloud can be used into meaning according to preparatory setting
Consistent Chinese character, the Chinese phonetic alphabet, Chinese phonetics codes, minority language, foreign language words are shown from display screen；
The voice command that the remote control device or electromechanical equipment has can be and specifically electromechanical equipment be required to take certain
The voice command of kind movement, is also possible to the voice call instruction for the program module bound with certain prioritization scheme, which uses
It when voice command calls, does not require for some specific movement hair voice command, as long as and issuing the voice of purpose to be achieved
Order is found corresponding with the voice command excellent by the computer of control electromechanical equipment automatically according to purpose to be achieved
The program of change scheme simultaneously controls each of execution module completion above procedure requirement completion according to the various work orders of above procedure
Kind movement；
Various running parameters necessary to work are correctly completed to electromechanical equipment, if the department of computer science of control electromechanical equipment
When system thinks that operator is needed to provide, form of the meeting with voice or voice in conjunction with text actively passes through remote control device or electromechanics
Equipment is issued to operator and is inquired, until electromechanical equipment recognizes all necessary running parameters.
The Chinese phonetics codes are to regard individual Chinese character as monosyllable here as unit of word, should according to composition
Phonetic in " Scheme for the Chinese Phonetic Alphabet " of each syllable of word, with and only with 26 Latin alphabets to the initial consonant of the Chinese phonetic alphabet,
Referral letter, simple or compound vowel of a Chinese syllable, tone are taken first to encode and successively be spelled again by the sequential encoding of " acoustic code+Jie's code+rhyme code+tune code is simultaneous every syllable symbol "
It writes, and the coding of phonetic code by obtaining directly expresses Chinese information, when direct term syllable code indicates Chinese information
When, usage in punctuation is identical with the usage in punctuation of English, when coding multiple syllables of the same word do not have to
Space continuous programming code will have space to separate between word and word.
Since the technical program expresses Chinese information using the Chinese phonetics codes that 26 Latin alphabets indicate, and when direct
Term syllable code is come when indicating Chinese information, usage in punctuation is identical with the usage in punctuation of English, in this way
Ensure that the expression punctuation mark of Chinese information is all completely the same with ASCII character namely simultaneous with ASCII character 100% inside
Hold, ensures that whole system can be run in the computer of ASCII character system in this way.
Here it is worth noting that: when keying in the punctuation mark of Chinese phonetics codes and Chinese phonetics codes sentence with keyboard,
26 Latin alphabets and 26 letter keys of western language QWERTY keyboard for forming Chinese phonetics codes coding are completely identical corresponding one by one, the Chinese
The punctuation mark key of language phonetic code sentence is also identical corresponding one by one with the punctuation mark key of western language QWERTY keyboard, inputs Chinese speech
When code letter and punctuation mark, it is only necessary to strike the corresponding identical key mapping of western language QWERTY keyboard.
After having the technical program, can be convenient the voice of non-computer programming personnel's Chinese natural language pass through it is distant
Control device low coverage or long-range control electromechanical equipment operation.
Specific embodiment
A specific embodiment of the invention is further described below with reference to embodiment.
(1) coding method of each syllable sound, rhyme, tone of Chinese phonetics codes used by the technical program is using following
Method:
Note: the symbol after dash "-" is Chinese phonetic symbols, and the letter before dash "-" is the used Chinese
The coding of each syllable sound, rhyme, tone of language, it is same below, following control table is referred to as code table below:
1, the coded identification of acoustic code uses the letter character of the initial consonant almost the same with the Scheme for the Chinese Phonetic Alphabet, for example uses down
The coding form of this acoustic code in face:
b—b;p—p;m—m;f—f;d—d;t—t;
n—n;l—l;g—g;k—k;h—h;
J-zh, j;Q-ch, q;X-sh, x;r—r;
z—z;c—c;s—s;y—y;w—w。
2, Chinese phonetic alphabet referral letter (ü) is indicated using a letter in 26 Latin alphabets, for example uses following this Jie
The coding form of code:
i—i;u—u;y—ü。
3, the coding of rhyme code, to single vowel in addition to (ü) is indicated using a letter in 26 Latin alphabets, other uses
The composite vowel of letter character identical with the Chinese phonetic alphabet, the Chinese phonetic alphabet can use " Scheme for the Chinese Phonetic Alphabet " identical form,
It can also be encoded using a consonant, for example be carried out using following this letter character come the simple or compound vowel of a Chinese syllable to the Chinese phonetic alphabet
Coding:
a—a;o—o;e—e;i—i;u—u;y—ü;
k—ao;c—ai;s—an;x—ou;w—ei;n—en;
z—ua;l—uo;b—ang;d—ong;p—eng；
q—ing;g—ng;er—er;
r—i;" when i is only spelled with Chinese Pin Yin pseudonym zh, ch, sh phase, the coding r generation of the i phonetic code of the Chinese phonetic alphabet
Table ".That is: zhi, chi, shi of the Chinese phonetic alphabet uses jr, qr, xr of phonetic code to represent respectively.Jr or qr or the input of xr and er keyboard
When press J and R or Q and R or X and R and E and R two key mappings input respectively.
4, adjust the coding of code in addition to indicating the upper sound (∨) of the Chinese phonetic alphabet using the unused consonant v of a Chinese,
It indicates the tone of Chinese using vowel, for example is encoded using following letter to the tone of the Chinese phonetic alphabet:
A ---, high and level tone;E -/, rising tone;V-∨, upper sound;U-, falling tone;
O-phonetic does not mark softly tone mark, softly.
(2) it indicates to use following method using the Chinese phonetics codes Chinese information of above-mentioned coding:
As unit of word, regard individual Chinese character as monosyllable here, according to " the Chinese for each syllable for forming the word
Language phonetic plan " in phonetic, it is same successively by the sequential encoding of " acoustic code+Jie's code+rhyme code+tune code simultaneous every syllable symbol "
Multiple syllables of word do not have to space and separate write the two or more syllables of a word together, and the coding between word and word is separated with space, when Chinese information indicates
When in Chinese phonetics codes state, six kinds of point numbers, seven kinds of labels and the number of migrating are using form identical with English；
Here due to by independently with Chinese character regard monosyllable as, the side of encoding of chinese characters of the present invention
Method is identical with the method for Chinese language words syllable coding, is compiled in the present invention using single syllable coding by word is obtained after word write the two or more syllables of a word together
Code, be made of several words one group of word is known as phrase by us, and the coding of the used phrase of the present invention is the same as Chinese sentence
Encode it is identical, since word can indicate phrase and Chinese sentence, in the present invention used by phrase coding and the Chinese
The coding of sentence can be realized by the coding of word, a set of special without in addition formulating phrase and Chinese sentence
Coding, when generally indicating Chinese information as unit of whole sentence entire chapter is by word, when understanding generally do not need carry out homophone word
Selection, sound the sentence that will not be produced ambiguity in principle, with coding express when will not produce ambiguity.
The technical program is converted the Chinese speech received by Mandarin speech recognition module by voice input module
At Chinese phonetics codes or Chinese character or the Chinese phonetic alphabet, Mandarin speech recognition module can identify mould using Chinese-voice-code voice
Block, its working principles are as follows:
Some use Chinese-voice-code voice identification modules are enumerated below, and phonetic code or Chinese character are carried out to Chinese speech
The example of conversion:
1. Chinese speech is converted into Chinese phonetics codes:
Such as: we are read aloud with Chinese speech, and " we will use Chinese character and latin text."
(1) by searching for Chinese syllable sound template and Chinese speech the syllabified code control having previously been stored in computer
Table identifies corresponding Chinese syllable voice sequence after matching:
There is space between wov mno huiu xrv ydu hsu yyv laa dqa wnv.(syllable and syllable)
Or wovmnohuiuxrvyduhsuyyvlaadqawnv(without space between syllable and syllable)
(mn after skilledoIn schwa symboloIt can be omitted when not causing audio mixing, it is above following same.)
The letter for indicating tone is underlined in order to allow everybody to see here, the tone letter in phonetic code is simultaneously
Have sound insulation section to act on, tone no underscore in actual speech code, tone is simultaneous after skilled phonetic code can facilitate differentiation every syllabic sign
Out.
The complexity for just the completing a system so pure speech recognition process unrelated with the dictionary scale of system.
If Chinese speech is the dialect of the Chinese with certain dialectal accent or a certain China, as long as this China
The syllable and Chinese syllable of dialect have certain corresponding relationship, we pass through the above similar method i.e.: by searching for preparatory
It stores the Chinese with certain dialectal accent in a computer or there is the dialect syllable of certain corresponding relationship with Chinese syllable
Sound template and the Chinese speech syllabified code table of comparisons, identify corresponding Chinese syllable voice sequence, so that it may realize after matching
Chinese phonetics codes identification to the Chinese with certain dialectal accent or dialect, realizes the Chinese with certain dialectal accent or side
The conversion of speech and Chinese phonetics codes.
(2) voice sequence is subjected to the segmentation of words, the phonetic code conversion being finally completed as unit of word.
By searching for the Chinese phonetics codes word dictionary for having divided word in advance, by multiple syllable write the two or more syllables of a word together of the same word, word
It is separated between word with space and just obtains the following Chinese phonetics codes that we finally need:
wovmno huiu xrvydu hsuyyv laadqawnv.
Traditional speech recognition result in order to obtain, we can also carry out following conversion, need exist for it is emphasised that
The process and speech recognition system be not inevitable to be contacted, which can be detached from speech recognition system and independently transport
Row.
2. Chinese phonetics codes are converted into Chinese character and the Chinese phonetic alphabet:
By search respectively Chinese phonetics codes with as unit of word Chinese character and the related Chinese phonetic alphabet table of comparisons can be convenient
Chinese phonetics codes are converted into Chinese character and the Chinese phonetic alphabet by ground, such as:
Wovmno is by looking into acoustic code, Jie's code, rhyme code, adjusting code and the Chinese phonetic alphabet table of comparisons or according to table of comparisons generation
Chinese phonetics codes syllable or word and pinyin syllable or the word table of comparisons obtain w ǒ men, then it is single for being found by w ǒ men with word
The Chinese character " we " of position, and so on, the sentence of our available following phonetics and Chinese character composition:
“Wǒmen huì shǐyòng hànyǔ lādīngwěn。”
" we will use Chinese character and latin text."
When the phonetic code as unit of word passes through the Chinese phonetic alphabet as unit of word and the Chinese character as unit of word
After establishing corresponding relationship, once need the phonetic code as unit of word that can no longer need through the Chinese as unit of word
Phonetic, directly established with the Chinese character as unit of word corresponding relationship and implementation it is corresponding conversion.That is: " wovmno huiu
Xrvydu hsuyyv laadqawnv. " can be directly changed into " we will use Chinese character and latin text."
When meeting homonym, differentiate according to means such as the connection of Chinese lexical syntactic context and statistical laws laggard
Chinese character of the row as unit of word is selected.Such as: mailbag is loaded on ysvlune.Crude oil is loaded on ysvlune.In conjunction with upper and lower
The connection of text can see that " ysvlune " representative " cruise " in front one, behind " ysvlune " representative in one
" oil tanker ", this two word can be converted into " mailbag is loaded on cruise " and " crude oil is loaded on oil tanker " respectively.To other words
Situation is also.
The result of above-mentioned identification both individually can show or compare display,
And so on, in aforementioned manners, by can any multisyllable Mandarin speech recognition at Chinese phonetics codes, and according to
Need to be converted further into Chinese character or the Chinese phonetic alphabet, Chinese phonetics codes, Chinese character or the Chinese phonetic alphabet can individually be shown or right
According to display, based on these Chinese language words, so that it may the identification of any Chinese speech information is realized, to facilitate progress various
Chinese speech information processing.
Below using air conditioner as an example of electromechanical equipment, by taking the voice of the Chinese sentence of an input handset as an example
To illustrate that the specific implementation step of the technical program, computer described herein or computer system refer both to control electromechanical equipment
Or the computer system of control air conditioner:
For example our 2.5G that can send short messages to one or 3G mobile input the Chinese speech of following Chinese-character text:
" 2 points meeting room air-conditioning is opened in this afternoon, divulge information 10 minutes first, room temperature is then maintained at 25 degree."
Remote control device is first identified the Chinese speech received by the above-mentioned Chinese-voice-code voice in remote control device
Module is converted into Chinese phonetics codes or Chinese character, and Chinese-voice-code voice identification module is converted into Chinese phonetics codes or Chinese character all
It is a point sentence for good word, such as:
" 2 points meeting room air-conditioning is opened, divulged information 10 minutes first, then by room temperature in this afternoon
It is maintained at 25 degree."
The above-mentioned Chinese sentence indicated with Chinese phonetics codes are as follows:
Zcu jinatisa xiauwuv 2disv jiba huiuyiuxru kdatikv davkca, xxvxisa
tdafpa 10 fnajda, rxvhxu jiba xruwna bkvqre zcu 25 duu.
Then by 2.5G or 3G wireless transport module, the short message content of above-mentioned Chinese language text is dealt into and is bundled in control sky
In the computer system of tune machine electromechanical equipment, which is equipped with 2.5G or 3G radio SMS transmission and reception apparatus, class
Like we usually mobile phone can receive send short message it is the same, then will have previously been stored in control air-conditioning machine equipment computer system
In and with the computer program of the keyword binding in the above-mentioned Chinese phonetics codes being converted into or Chinese character or the Chinese phonetic alphabet by holding
The computer control execution module of control air-conditioning machine equipment is handed over to execute after capable successive logical order arrangement.Its detailed process is such as
Under:
Here the Chinese meaning that jinatisa is indicated with Chinese character is " today ", after this keyword is extracted, is calculated
Chance goes to look into calendar, and the date for finding today is such as on 2 1st, 2013, this date will be extracted conduct by computer
The program date parameter of air conditioner ventilation starting is added in the program of air conditioner ventilation starting, and similarly " 2 disv of xiauwuv " is used
The Chinese meaning that Chinese character indicates is " 2 pm ", after this crucial phrase is extracted, if computer is by 24 hours
Computer chronograph can be converted at 14 points automatically, and this time is extracted the program time parameter opened as air-conditioning and is added
Enter to open air-conditioning program in, if it is press 12 when timing, then computer this directly this time is extracted as opening
The program time parameter of air-conditioning is added in the program for opening air-conditioning, the Chinese that huiuyiuxru kdatikv is indicated with Chinese character here
Meaning of one's words justice is " meeting room air-conditioning ", and after this two keywords are extracted, computer can be gone with looking into " meeting room air-conditioning "
Location, after finding " meeting room air-conditioning " address, computer will be extracted this address as in air conditioner ventilation startup program
The destination address parameter of control equipment be added in the program of air conditioner ventilation starting, davkca is indicated with Chinese character here Chinese
Meaning is " opening ", and after this keyword is extracted, computer can go to look into " opening " air-conditioning program, finds " opening " sky
After the program of tune, this Program extraction will be come out the rule for pressing the successive logical order arrangement of execution by computer, by the Duan Cheng
Sequence module is placed on the foremost of entire program, as the program being first carried out, because logically, if air-conditioning is not beaten
It opens, the programs such as other ventilations and temperature control are that air-conditioning is can not to execute, so the program module that this section of air-conditioning here is opened is wanted
It is placed on the foremost of entire program, as the program being first carried out, similarly, if other programs are not prescribed with their elder generation
After execute program, and according to this logic judgment criteria by after computer discriminant auto arrangement program module it is successive suitable
Sequence, the rxvhxu jiba. Chinese meaning that xxvxisa and rxvhxu is indicated with Chinese character here be respectively " first " and " then ",
Since the two words do not have that corresponding computer program is corresponding with them, our this words are referred to as non-key word, in Chinese
In belong to conjunction, the two non-key words are meant that the program after xxvxisa will come immediately following journey behind rxvhxu
Before sequence, program when execution after xxvxisa is closely followed the subsequent program of rxvhxu and is first carried out than coming, here
The Chinese meaning that tdafpa is indicated with Chinese character is " ventilation ", after this keyword is extracted, computer can go to look into
The computer program of tdafpa binding, and the computer program extraction with tdafpa binding found is held according to what is be analyzed above
Row sequence is come behind the program module for opening air-conditioning, is executed after and then opening air-conditioning program, 10 fnajda here
Divulge information immediately tdafpa() after, computer can be determined that accordingly to be referred to ventilation time " 10 minutes ", and computer will incite somebody to action
It is extracted is added in air conditioner ventilation program as the ventilation duration parameters of air conditioner ventilation program, here xruwna
The Chinese meaning that bkvqre is indicated with Chinese character is " room temperature holding ", and after the two keywords are extracted, computer can go to look into
The computer program bound with xruwna bkvqre, and the computer program bound with xruwna bkvqre that will be found extracts
Out, and according to the execution sequence being analyzed above tdafpa(ventilation is come) behind program module, and then tdafpa(is logical
Wind) after program after execute, 25 duu(of zcu here is at 25 degree) kept immediately xruwna bkvqre(room temperature)
Later, computer can be determined that accordingly refers to that the temperature of " room temperature holding " is " 25 degree ", and computer will be extracted
As the holding of air-conditioning xruwna bkvqre(room temperature) temperature parameter of " room temperature holding " of program is added to air-conditioning xruwna
Bkvqre(room temperature is kept) in program program, so far, Chinese language text has been completed the computer that whole text need to transfer
Program, and carried out the connection of the successive execution sequence of correct procedure parameter assignment and program.
When above-mentioned entire computer program control air conditioner execution module work, COMPUTER DETECTION current time first, when
Current time reaches program Starting Executing Time: at 14 points (2 pm) on the 1st 2 months 2013, meeting room air-conditioning address is effective,
Computer program issues the control command for opening air-conditioning to the effective meeting room air-conditioning execution module in address, and execution module executes life
Meeting room air-conditioning is opened after order, and after meeting room air-conditioning is opened, and then computer runs air conditioner ventilation program, computer can control
Air-conditioning execution module open with the outdoor ventilation shaft being connected, while execution module under the action of air-conditioning in ventilation fan meeting
It starts to work, this is that room air and outdoor air can flow, and realizes the exchange of indoor and outdoor air, falls into a trap in this process
It calculates chance and constantly detects the dwell time whether ventilation time has arrived program setting, once detection ventilation time is set to program
Fixed dwell time is 10 minutes in present case, and computer can be closed to the sending instruction of air-conditioning execution module to be led to outdoor
Air port stops the ventilation with outdoor, just stopped the ventilation operation of air-conditioning under the execution movement effect of execution module, and then
Computer executes subsequent xruwna bkvqre(room temperature and keeps) program, this is that computer detects indoor environment temperature first,
It is 25 degree in present case if being lower than preset holding temperature, then computer program starts the execution module in air-conditioning
Execution heating movement, start heating device, so that air-conditioning is discharged to indoor circulating air temperature and rise, in the process, calculate
Machine is kept in xruwna bkvqre(room temperature) indoor environment temperature is constantly detected under the control of program, if indoor environment temperature
Reach the indoor environment temperature of preparatory program setting, computer issues the instruction for stopping heating to air-conditioning execution module, executes mould
Block heats air-conditioning heater stop after executing the command action；If being higher than preset holding temperature, in this case
It is 25 degree in example, then computer program starts the refrigerating plant in air-conditioning by execution module, and air-conditioning is made to be discharged to indoor circulation
Air themperature decline, in the process, computer is kept in xruwna bkvqre(room temperature) it constantly detects under the control of program
Indoor environment temperature, if indoor environment temperature reaches the indoor environment temperature of preparatory program setting, computer is executed to air-conditioning
Module issues the instruction for stopping refrigeration, after air-conditioning execution module executes the movement of the instruction, so that air-conditioning refrigeration plant stops system
Cold, computer just controls indoor environment temperature about 25 degree in cycles like this.Chinese-character text is also just completed in this way
Control by computer to electromechanical equipment.
Due to the difference that everyone word is accustomed to, some people may word not necessarily standard, at this moment can be in computer
In store synonym and the near synonym table of comparisons in advance, and by computer by the synonym and the near synonym table of comparisons of setting come automatic
Nonstandard word is converted into the Code words of computer approval, the keyword in computer must be the rule that computer is approved
Model word, such as: " open, open, opening " can unify to arrive " opening " this word by the table of comparisons, for another example: " turning off, close
Close, close " it can be unified to " closing " this word by the table of comparisons, and tied up in advance with corresponding computer program module
It is fixed.
Since computer programming language is in calling program module, often write with the English spelt by 26 Latin alphabets
Program call, 26 Latin alphabets belong to ASCII character range, and computer system operates normally that there is no problem, due to Chinese character
Internal Code system be not belonging to ASCII character range, if directlying adopt Chinese character sentence to call computer program, computer system is not
It can guarantee normal operation, therefore, Chinese-character text is first converted into Chinese phonetics codes and reruned by the technical program, due to Chinese speech
Code is spelt as English with 26 Latin alphabets, and punctuation mark is consistent with English, this ensure that the Chinese letter run
The Internal Code of breath is within the scope of ASCII character, so that it is guaranteed that the technical program can operate normally in computer systems.
And so on, due to the object in this example due to control, the movement of time, control object can pass through Chinese language
Sound is converted the change of the Chinese language text come and is changed, therefore is ok to the movement of other control objects, time and control object
Computer program calling is carried out using the above method and realizes the control to the electromechanical equipment of desired control.
Electromechanical equipment is divided into both of which operation, one is automatic running patterns, and the mode is according to control in commencement of commercial operation
The computer system of electromechanical equipment processed to receive by Chinese speech it is converted Lai the understanding of Chinese language text carry out program automatically
Operation, and by the movement to be carried out or function to be achieved in the form of the speech synthesis of Chinese language text or the Chinese language text
Output；
For example, in above example, computer understand receive by Chinese speech it is converted Lai Chinese language text letter
Breath, it is correct call bound program and according to it is correct execute logic execute it is tactic on the basis of, can export: " modern
Its 2 pm meeting room air-conditioning is opened, and divulges information 10 minutes first, room temperature is then maintained at 25 degree."
Voice after Chinese-character text information or the Chinese-character text speech synthesis, the converted next Chinese text information of the Chinese speech can also
To be converted into Chinese phonetics codes or foreign language or minority language output.
Another kind is inquiry affirmation mode, under the mode computer to receive by Chinese speech it is converted Lai Chinese language
This is first correctly corrected and is executed the optimization of program, and is fed back one and be properly corrected and execute the Chinese that program optimization is crossed
Text, the Chinese language text can also export in the form of speech by voice synthetic module, control execution module after confirmed and hold
Row.
Such as: computer receive with next section by Chinese speech it is converted Lai following meaning Chinese language text: " in the present
It 2 points are opened meeting room air-conditioning, divulge information 10 minutes first, room temperature is then maintained at 25 degree." calculate
Machine examination measures has had been subjected to 2 points of the morning at this time, the time can will be arranged automatically at 2 points in the afternoon, while being stored in advance in computer
Detecting in Chinese language text makes the more optimal Chinese language text of calling program with immediate one section of the Chinese language text, at this moment computer
It can export: " 2 points meeting room air-conditioning be opened, divulged information 10 minutes first, then in this afternoonWith air-conditioning pair Meeting room carry out sterilizing andRoom temperature is maintained at 25 degree." you confirm, send confirmation Chinese language text or other confirm
Information, computer is just using the Chinese language text as the Chinese language text eventually received, according to the step in case above, in addition
" air-conditioning sterilizing program " brings into operation when meeting preset condition.
The same above Chinese text information can be exported after voice synthetic module speech synthesis with speech form, should
Chinese-character text information also can be converted Chinese phonetics codes or foreign language or minority language output.
After being converted due to Chinese-character text by Chinese character and Chinese voice code bidirectional conversion module, Chinese character and Chinese phonetics codes can
To convert mutually, therefore in the narration of the technical program, all information indicated with Chinese character can use Chinese speech code table
Show, vice versa, does not just state here tired respectively in the narration of the technical program.
The computer system that electromechanical equipment is controlled described in the technical program can be desktop computer or laptop
Either server or cloud computer system, are also possible to embedded computer system.
The Chinese speech that the remote control device receives can be inputted by microphone, phone input or cable network input,
Or wireless network input.
The network transmission module covers cable network and wireless network software and hardware Transmission system and transmission module, comprising:
Fixed Telephony Transmission system, power line communication Transmission system, cable of cable TV communication transmission system, internet, local
Net, 2.5G, 3G, 4G, wifi, wimax, bluetooth, Zigbee short range double-direction radio networked system, CAN serial bus control local
Net system.
The remote control device refers to all devices that character text information can be sent to the computer system to be controlled,
Include: fixed-line telephone system, mobile phone, desktop computer, laptop, net book, individual digital information assistants PDA, remote controler,
Information communication software module.
The execution module includes driving uinit module and power unit module and performance unit module and interface list
Element module.
It is equally referred to above-mentioned case in the situation to work using above-mentioned software and hardware system or module, it is just no longer tired here
It states.
Above-mentioned Intelligent air conditioner has the automatic training function of voice command, and air-conditioning operators control with voice command
Before Intelligent air conditioner, the remote control device of air conditioner understands the one bright reading of rule Chinese speech of voice command that actively can execute it
Come, it is desirable that operator with read, and using operator with reading voice as template and with remote control device corresponding to the sound template
It is stored in after voice command binding in the computer system of remote control device or control air conditioner.
Above-mentioned operator includes Chinese putonghua speech, the voice of Chinese dialects, minority language with the voice of reading
Voice, foreign language voice, a kind of special sound that can be mutually distinguished with the sound of other voice commands.Such design master
Facilitate the various crowds of China, as long as the sound issued for computer is not obscured with bound program,
Some crackjaw deaf-mutes can mainly be considered using the special sound, this want they can issue it is a kind of can be with other voices
The special sound that the sound of order mutually distinguishes, remote control device or the computer for controlling air conditioner will be remembered and execute correlation
The program of binding, while in view of deaf-mute does not hear, thus air conditioner will execute order fed back to text importing it is deaf
Mute air-conditioning operators.
Above-mentioned remote control device or Intelligent air conditioner is removed when training operator with reading voice command automatically with voice command
The corresponding Chinese putonghua speech of sending, additionally it is possible to voice, the ethnic group's language of Chinese dialects are issued according to preparatory setting
Voice, the foreign language voice of speech.The people of standard Chinese is not understood in such arrangement conveniently mainly, combines foreign people,
These can be realized with the existing voices synthetic technology module such as Chinese phonetics codes voice synthetic module.
Above-mentioned remote control device or Intelligent air conditioner is when carrying out voice command and training automatically, the language that actively can execute it
One rule Chinese speech of sound order is bright while read out, being capable of purpose according to preparatory setting by the voice command read aloud
The consistent Chinese character of justice, the Chinese phonetic alphabet, Chinese phonetics codes, minority language, foreign language words are shown from display screen.
The voice command that above-mentioned remote control device or Intelligent air conditioner has can be and specifically Intelligent air conditioner be required to adopt
The voice command for taking certain to act is also possible to the voice call instruction for the program module bound with certain prioritization scheme, the mould
When block voice command calls, do not require for some specific movement hair voice command, as long as and issuing purpose to be achieved
Voice command is found and the voice command phase by the computer system of control electromechanical equipment automatically according to purpose to be achieved
The program of corresponding prioritization scheme is simultaneously transferred to the various movements that execution module completes above procedure requirement completion；
Such as: people can require air conditioner both to require to keep certain room temperature cold wind simultaneously to " old man and baby "
It blows preferably to mitigate, at this time computer will be found and bind air conditioner and both require " old man and baby " to keep certain
Room temperature simultaneously cold wind blow preferably to mitigate some programs, according to above procedure require action control execution module it is complete
The program behavior completed is required above procedure.
Various running parameters necessary to work are correctly completed to air conditioner, if the computer system of control electromechanical equipment
It, can be remote control device or air conditioner in the form of voice or voice are in conjunction with text, actively when thinking that operator is needed to provide
It issues and inquires to operator, until air conditioner recognizes all necessary running parameters.
Such as: what it is for air-conditioning heat preservation is that baby or old man or between twenty and fifty air conditioner can not be felt, if control
When the computer of electromechanical equipment needs to know, it can actively use preset voice can be by remote control device or air conditioner to behaviour
Author's inquiry: " room that I keeps the temperature live what kind of person is " people reply: " old man " or " baby " at this time controls machine
The computer of electric equipment will look for the program of " old man " or " baby ", correctly sorted and connected after finding and passed
Above-mentioned heat preservation " old man " or " baby are completed by the computer system control execution module to the computer system of control electromechanical equipment
The movement of the procedure stipulation in youngster " room.
Finally it should be pointed out that the Chinese language text in above-mentioned narration refers to that all indicate the character institute of Chinese information
Text of composition, including Chinese character, the Chinese phonetic alphabet, Chinese phonetics codes etc., and Chinese-character text refers to the Chinese being made of chinese character
Language information text.
By the above the technical program, we are realized with Chinese speech low coverage or long-range control Intelligent air conditioner work
Purpose.Similarly same to other electromechanical equipments, by above technical scheme, we equally be may be implemented with Chinese speech low coverage
Or long-range control electromechanical equipment operation, just no longer tire out one by one state here.
Claims (10)
1. a kind of Chinese speech low coverage or the method for long-range control electromechanical equipment operation, it is characterized in that: remote control device first will be defeated
The Chinese speech for entering remote control device is converted into Chinese language text by Mandarin speech recognition module, then by network transmission module to
The computer system for controlling electromechanical equipment sends Chinese language text, then will have previously been stored in the computer system of control electromechanical equipment
In and with the above-mentioned Chinese phonetics codes Chinese language text or Chinese character and words text or the Chinese by the spelling of 26 Latin alphabets being converted into
The computer program of keyword binding in language phonetic Chinese text is suitable by the successive logic executed according to the semanteme of non-key word
The computer control execution module of control electromechanical equipment is handed over to execute after sequence arrangement；
The Chinese language text includes the Chinese sentence text by forming comprising keyword and non-key word.
2. Chinese speech low coverage as described in claim 1 or the method for long-range control electromechanical equipment operation, it is characterized in that: institute
The computer system for the control electromechanical equipment stated can be desktop computer or laptop or server or cloud computer
System is also possible to embedded computer system；
The Chinese speech that the remote control device receives can be inputted by microphone, phone input or cable network input, or
Wireless network input.
3. Chinese speech low coverage as described in claim 1 or the method for long-range control electromechanical equipment operation, it is characterized in that: institute
Network transmission module is stated, cable network and wireless network software and hardware Transmission system and transmission module are covered, comprising: fixed-line telephone is logical
Interrogate Transmission system, power line communication Transmission system, cable of cable TV communication transmission system, internet, local area network, 2.5G, 3G,
4G, wifi, wimax, bluetooth, Zigbee short range double-direction radio networked system, CAN serial bus control LAN system.
4. Chinese speech low coverage as described in claim 1 or the method for long-range control electromechanical equipment operation, it is characterized in that: described
Remote control device refer to all devices that character text information can be sent to the computer system to be controlled, comprising: fixed electricity
Telephone system, mobile phone, desktop computer, laptop, net book, individual digital information assistants PDA, remote controler, information communication are soft
Part module.
5. Chinese speech low coverage as described in claim 1 or the method for long-range control electromechanical equipment operation, it is characterized in that: machine
Electric equipment is divided into both of which operation in commencement of commercial operation, and one is automatic running patterns, and the mode is according to control electromechanical equipment
Computer system to receive by Chinese speech it is converted Lai Chinese language text the automatic operation for carrying out program of understanding, and will
The movement to be carried out or function to be achieved are exported in the form of the speech synthesis of Chinese language text or the Chinese language text；It is another
It is inquiry affirmation mode, the computer system of electromechanical equipment is controlled under the mode to the Chinese being converted into according to received Chinese speech
Chinese language is originally first correctly corrected and is executed the optimization of program, and is fed back one and be properly corrected and execute what program optimization was crossed
Chinese language text, the Chinese language text can also be exported in the form of Chinese speech by voice synthetic module, it is confirmed after by controlling
The computer system control execution module of electromechanical equipment executes.
6. Chinese speech low coverage as described in claim 1 or the method for long-range control electromechanical equipment operation, it is characterized in that: institute
The execution module stated includes driving uinit module and power unit module and performance unit module and interface unit module.
7. Chinese speech low coverage as described in claim 1 or the method for long-range control electromechanical equipment operation, it is characterized in that: described
Remote control device or electromechanical equipment have the automatic training function of voice command, remote control device operator with voice command control machine
Before electric equipment, remote control device or electromechanical equipment understand the one bright reading of rule Chinese speech of voice command that actively can execute it
Come, it is desirable that operator is and electromechanical as template and with control corresponding to the sound template with the voice of reading using operator with reading
The computer of remote control device or the control electromechanical equipment is stored in after the voice command of equipment or corresponding execution programmatic binding
In system.
8. Chinese speech low coverage as claimed in claim 7 or the method for long-range control electromechanical equipment operation, it is characterized in that: described
Operator with the voice of reading include Chinese putonghua speech, the voice of Chinese dialects, the voice of minority language, foreign language
Voice, a kind of special sound that can be mutually distinguished with the sound of other voice commands；
The remote control device or electromechanical equipment is when training operator with reading voice command automatically with voice command, in addition to issuing
Corresponding Chinese putonghua speech, additionally it is possible to the language of the voice of Chinese dialects, minority language is issued according to preparatory setting
Sound, foreign language voice.
9. Chinese speech low coverage as claimed in claim 7 or the method for long-range control electromechanical equipment operation, it is characterized in that: described
Remote control device or electromechanical equipment when carrying out voice command and training automatically, one rule of voice command that actively can execute it is used
Chinese speech is bright while read out, by the voice command read aloud according to preparatory setting can with the consistent Chinese character of meaning,
The Chinese phonetic alphabet, Chinese phonetics codes, minority language, foreign language words are shown from display screen；
The voice command that the remote control device or electromechanical equipment has can be and electromechanical equipment is specifically required to take certain dynamic
The voice command of work is also possible to the voice call instruction for the program module bound with certain prioritization scheme, the module voice
When command calls, do not require for some specific movement hair voice command, as long as and issue the voice command of purpose to be achieved,
By the computer of control electromechanical equipment automatically according to purpose to be achieved, prioritization scheme corresponding with the voice command is found
Program and according to the various work orders of above procedure control execution module complete above procedure require complete various movements；
Various running parameters necessary to work are correctly completed to electromechanical equipment, if the computer system of control electromechanical equipment is recognized
When to need operator to provide, form of the meeting with voice or voice in conjunction with text actively passes through remote control device or electromechanical equipment
It issues and inquires to operator, until electromechanical equipment recognizes all necessary running parameters.
10. Chinese speech low coverage as described in claim 1 or the method for long-range control electromechanical equipment operation, it is characterized in that: institute
The Chinese phonetics codes stated are to regard individual Chinese character as monosyllable here as unit of word, according to forming each of the word
Phonetic in " Scheme for the Chinese Phonetic Alphabet " of syllable, with and only with 26 Latin alphabets to the initial consonant of the Chinese phonetic alphabet, referral letter, simple or compound vowel of a Chinese syllable,
Tone is taken first to encode and successively be spelt again by the sequential encoding of " acoustic code+Jie's code+rhyme code+tune code is simultaneous every syllable symbol ", and passes through
The coding of obtained phonetic code directly expresses Chinese information, when direct term syllable code is to indicate Chinese information, punctuate
The usage of symbol is identical with the usage in punctuation of English, when coding multiple syllables of the same word do not have to space and continuously compile
Code, will have space to separate between word and word；
The initial consonant of the Chinese phonetics codes all indicates with the consonant Latin alphabet, the sound of the phonetic code for indicating Chinese information
Mother other than initial consonant zh, ch, sh in " Scheme for the Chinese Phonetic Alphabet " are indicated with tri- consonant Latin alphabets of j, q, x respectively, remaining
Initial consonant with the expression of the consonant Latin alphabet of the same symbol in " Scheme for the Chinese Phonetic Alphabet ", zhi in " Scheme for the Chinese Phonetic Alphabet ",
Chi, shi indicate with jr, qr, xr of phonetic code respectively, and the er of the phonetic code of the er in " Scheme for the Chinese Phonetic Alphabet " is indicated, keyboard
It is keyed in respectively with j and r key, q and r key, x and r key and e the and r key on western language keyboard when key entry；
The Chinese phonetics codes with a letter y in 26 letters indicate single vowel in original " Scheme for the Chinese Phonetic Alphabet " and
The coding of ü in referral letter, remaining single vowel and referral letter uses and the single vowel and the identical symbol of referral letter in " Scheme for the Chinese Phonetic Alphabet "
Number；
The Chinese phonetics codes composite vowel in addition to in " Scheme for the Chinese Phonetic Alphabet " identical symbol expression other than, with one
Consonant indicates；
It adjusts four vowels of code and the unused letter v of a Chinese to indicate to the Chinese phonetics codes, uses the Latin alphabet
A, e, v, u, o respectively indicate high and level tone-, rising tone e in " Scheme for the Chinese Phonetic Alphabet " :/, upper sound v: ∨, falling tone u:, softly o is not marked.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310083811.8A CN104049964B (en) | 2013-03-16 | 2013-03-16 | Chinese speech low coverage or the method for long-range control electromechanical equipment operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310083811.8A CN104049964B (en) | 2013-03-16 | 2013-03-16 | Chinese speech low coverage or the method for long-range control electromechanical equipment operation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104049964A CN104049964A (en) | 2014-09-17 |
| CN104049964B true CN104049964B (en) | 2019-07-05 |
Family
ID=51502874
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310083811.8A Expired - Fee Related CN104049964B (en) | 2013-03-16 | 2013-03-16 | Chinese speech low coverage or the method for long-range control electromechanical equipment operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104049964B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104468572A (en) * | 2014-12-08 | 2015-03-25 | 上海大学 | Method for remote voice control over strain selecting instrument through Android mobile phone |
| CN106292691A (en) * | 2015-05-28 | 2017-01-04 | 上海能感物联网有限公司 | A kind of helm gear of Chinese speech remote control |
| CN106527188A (en) * | 2015-09-13 | 2017-03-22 | 上海能感物联网有限公司 | Automatic navigation method for Chinese text cluster remote control drive |
| CN106527186A (en) * | 2015-09-13 | 2017-03-22 | 上海能感物联网有限公司 | Method for realizing foreign language text cluster remote-control driver capable of performing automatic navigation |
| CN107146616B (en) | 2017-06-13 | 2020-05-08 | Oppo广东移动通信有限公司 | Equipment control method and related product |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101131689A (en) * | 2006-08-22 | 2008-02-27 | 苗玉水 | Bidirectional mechanical translation method for sentence pattern conversion between Chinese language and foreign language |
| CN102830687A (en) * | 2012-09-24 | 2012-12-19 | 杨炙龙 | Intelligent home control system and method |
-
2013
- 2013-03-16 CN CN201310083811.8A patent/CN104049964B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101131689A (en) * | 2006-08-22 | 2008-02-27 | 苗玉水 | Bidirectional mechanical translation method for sentence pattern conversion between Chinese language and foreign language |
| CN102830687A (en) * | 2012-09-24 | 2012-12-19 | 杨炙龙 | Intelligent home control system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104049964A (en) | 2014-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104049962B (en) | Foreign language voice low coverage or the method for long-range control electromechanical equipment operation | |
| CN103279363B (en) | The device that Chinese speech remote control computer program is run | |
| CN103279190B (en) | Chinese language text calls the device that computer program runs | |
| CN104049963B (en) | The method that Chinese speech controls electromechanical equipment operation | |
| CN103277874A (en) | Device for nonspecific persons to remotely control intelligent air conditioner by Chinese speech | |
| CN104020840B (en) | The method that foreign language text is remotely controlled computer program operation | |
| CN103279362A (en) | Device for remotely controlling operation of computer programs through foreign language texts | |
| CN104049964B (en) | Chinese speech low coverage or the method for long-range control electromechanical equipment operation | |
| CN104049960A (en) | Method for remotely controlling computer program operation through foreign-language voice | |
| CN104020942A (en) | Method for calling computer program to operate by Chinese text | |
| CN104020985A (en) | Method for remotely controlling computer program running by Chinese texts | |
| CN104239007B (en) | The method of Chinese natural human speech voice remote control electric light | |
| CN104376843A (en) | Chinese speech near-distance or remote car driving controlling method | |
| CN104423343A (en) | Method for performing near-distance or long-distance centralized cooperative control on household appliances by Chinese speech | |
| CN104235998A (en) | Method for non-specified people to remotely control intelligent air conditioner through Chinese phonetic symbols | |
| CN104049965B (en) | The method of foreign language voice control electromechanical equipment operation | |
| CN104049961A (en) | Method for performing remote control on computer program execution by use of Chinese speech | |
| CN104423353A (en) | Method for centrally and coordinatively controlling household appliances on spot by using Chinese speech | |
| CN104235042B (en) | The method of Chinese speech remote control electric fan | |
| CN105183719A (en) | Controller device for remote control of automobile driving by Chinese voice | |
| CN104049871A (en) | Method for calling and executing computer program by use of Chinese speech | |
| CN104238989B (en) | A method of intelligent refrigerator is controlled with Chinese speech | |
| CN104063206A (en) | Method for controlling operation of electromechanical equipment in short distance or long distance through Chinese texts | |
| CN105138518A (en) | Car system with Chinese voice remote control driving function | |
| CN104063371A (en) | Method for close or remote control on operation of electromechanical equipment through foreign language texts |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190705 Termination date: 20210316 |