CN110299138A - A kind of augmented reality assembly technology instructs system and method - Google Patents
A kind of augmented reality assembly technology instructs system and method Download PDFInfo
- Publication number
- CN110299138A CN110299138A CN201910574832.7A CN201910574832A CN110299138A CN 110299138 A CN110299138 A CN 110299138A CN 201910574832 A CN201910574832 A CN 201910574832A CN 110299138 A CN110299138 A CN 110299138A
- Authority
- CN
- China
- Prior art keywords
- voice
- speech recognition
- assembly
- recognition result
- interactive
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to a kind of augmented reality assembly technologies to instruct system and method, belong to augmented reality and assembling process technique field, solves the problems, such as human-computer interaction process inefficiency in existing augmented reality assembly visualization instruction course, is unable to satisfy practical set production requirement.System includes: voice interactive system, for receiving and identifying the voice of assembly crewman's input, obtains speech recognition result and be sent to instruct interactive system；It instructs interactive system to receive speech recognition result, judges whether speech recognition result is the phonetic control command that can be performed in current virtual assembly environment, if so, executing speech recognition result；If not, it is determined that the virtual assembly environment of executable speech recognition result, and the virtual assembly environment of executable speech recognition result is switched to, speech recognition result is executed in virtual assembly environment after handover.The system can effectively promote human-computer interaction process efficiency in augmented reality assembly instruction course, meet practical set production requirement.
Description
Technical field
The present invention relates to augmented reality and assembling process technique fields more particularly to a kind of augmented reality assembly technology to instruct
System and method.
Background technique
Being specifically defined of assembling work, which refers to, is assembled into a series of of complete product assembly according to process flow for part
Operant activity is one of important procedure during product processing.Currently, with turn of the market, the individual character of product user
Demand is also biased to diversification, but in traditional assembly technology, and assembly crewman is to learn and be familiar with all kinds of different assembling lines,
Reading assembly handbook or text need to be taken a significant amount of time, the time it takes cost is huge in entire assembling process.
The variation of product type can be such that assembled in situ personnel toggle in different information flows simultaneously, and assembled in situ personnel are come
Say it is a kind of added burden in cognition.Therefore it proposes to need to visualize guidance technology by augmented reality assembly technology to assist
Assembler carries out assembly and instructs work.
Augmented reality is the core in augmented reality assembly technology visualization guidance technology, be one can will be virtual
Scene realizes the technology for merging superposition with real world in the user visual field, and the application in product design, assembly field is
Quite extensively.Along with era development, Intelligent mobile equipment is also further developed, and the operational capability of intelligent mobile terminal obtains
To significantly being promoted, the introducing of simultaneous sensor and camera device is allowed directly in mobile terminals such as wearing type glasses
The upper complete augmented reality assembly technology visualization instruction course of completion is possibly realized.
But due to current mobile augmented reality assembly technology visualization instruction course interactive process mostly with touch screen or with
Based on gesture interaction form, while mostly based on versatility voice command, not for augmented reality assembly visualization instruction course
Representative key life is arranged to enable, leads to human-computer interaction process inefficiency, is unable to satisfy practical set production requirement, influences user
Usage experience and using effect.Previous scholars are merely focusing on product reinforced assembly Visualization Model and scene wash with watercolours mostly simultaneously
The optimization of dye is related to relatively fewer from the technical research on the reinforced assembly instruction course of assembly crewman side on improving.
Summary of the invention
In view of above-mentioned analysis, the present invention is intended to provide a kind of interactive voice system based on the guidance of augmented reality assembly technology
System and method, to solve human-computer interaction process inefficiency, Wu Faman in existing augmented reality assembly visualization instruction course
The problem of full border Assembling Production demand.
The purpose of the present invention is mainly achieved through the following technical solutions:
A kind of augmented reality assembly technology instructs system, and it includes: that voice is handed over that the augmented reality assembly technology, which instructs system,
Mutual system and instruct interactive system；Wherein,
The voice interactive system, the voice inputted for receiving and identifying assembly crewman, obtains speech recognition result, and
Institute's speech recognition result is sent to and described instructs interactive system；
It is described to instruct interactive system, the speech recognition result for receiving, judge institute's speech recognition result whether be
The phonetic control command that can be performed in current virtual assembly environment, if so, directly executing institute's speech recognition result；If it is not,
It then determines the virtual assembly environment of executable institute's speech recognition result, and switches to executable institute's speech recognition result
Virtual assembly environment, institute's speech recognition result is executed in virtual assembly environment after handover；
The virtual assembly environment for instructing interactive system include initial scene, assembly scene, assembly finished product virtually use
Scene.
On the basis of above scheme, the present invention has also done following improvement:
Further, the phonetic control command that can be performed under the initial scene includes at least one or more of: operation
Illustrate, start assembly, assembly demonstration, finished product detection demonstration；
The phonetic control command that can be performed under the assembly scene includes at least one or more of: the augmented reality
Each Assembly part, previous step, next step, resetting, return needed for assembling process；
The phonetic control command that can be performed under the assembly virtual usage scenario of finished product is corresponding according to the function of assembly finished product
Setting.
Further, the voice interactive system includes: interactive voice service module, speech recognition module, dictionary management mould
Block；Wherein,
It prestores in the dictionary management module comprising grammar file, the augmented reality is only stored in the grammar file
All phonetic control commands used in assembly technology；
The interactive voice service module is connected with the speech recognition module, for when having detected voice input,
The voice of input is received and stored, and the voice is sent to the speech recognition module, by the speech recognition mould
Block generates recognition result；The interactive voice service module is also used to for the recognition result being sent to guidance interaction system
System；
The speech recognition module is connected with the dictionary management module, for the voice received to be converted into spy
Word is levied, and carries out route matching with the phonetic control command prestored in the dictionary management module, the highest mesh of score will be matched
Other word is identified as recognition result.
Further, if the matching score of the Feature Words and the phonetic control command is lower than predetermined value, the voice
Identification module is unable to get speech recognition result, the speech recognition module to interactive voice service module feedback voice without
Method identification instruction, carries out feedback casting from the interactive voice service module to the assembly crewman.
Further, if the continuous n times of the voice interactive system can not identify that the voice of assembly crewman's input, the voice are handed over
Mutual service module calls the grammar file prestored in the dictionary management module, enhances described in Xiang Suoshu assembly crewman's voice broadcast
All phonetic control commands used in real assembly technology.
Further, the voice interactive system further includes audio Coordination module, for monitoring the interactive voice service mould
The voice input that block receives, when voice input is fuzzy or unintelligible, the audio Coordination module controls the voice
Interactive service module, which issues, re-enters the instruction of voice, and controls the interactive voice service module to receive voice again defeated
Enter.
Further, the augmented reality assembly technology instructs the system integration in wearing type glasses, the wearing type glasses
Including audio frequency apparatus, the audio frequency apparatus includes microphone and earphone, the audio frequency apparatus and the interactive voice service module
It is connected.
Further, it further includes that interactive voice wakes up key that augmented reality assembly technology, which instructs system, for waking up the voice
Interactive system.
The invention also discloses a kind of augmented reality assembly technology guidance methods, comprising the following steps:
The voice that assembly crewman's input is received and identified by voice interactive system, obtains speech recognition result, and by institute
Speech recognition result, which is sent to, instructs interactive system；
It instructs interactive system to receive institute's speech recognition result, judges whether institute's speech recognition result is current virtual dress
With the phonetic control command that can be performed in environment, if so, directly executing institute's speech recognition result；If not, it is determined that can hold
The virtual assembly environment of row institute speech recognition result, and switch to the Virtual assemble of executable institute's speech recognition result
Environment executes institute's speech recognition result in virtual assembly environment after handover；
The virtual assembly environment for instructing interactive system include initial scene, assembly scene, assembly finished product virtually use
Scene.
On the basis of above scheme, the present invention has also done following improvement:
Further, the voice interactive system executes the voice of following steps identification assembly crewman's input, obtains voice knowledge
Other result:
Interactive voice service module receives and stores the voice of input, and the voice is sent to the voice and is known
Other module；
The voice is converted into Feature Words by the speech recognition module, and with the language that is prestored in the dictionary management module
Sound control instruction carries out route matching, will match the highest target identification word of score as recognition result；
If the matching score of the Feature Words and the phonetic control command is lower than predetermined value, the speech recognition module
It is unable to get speech recognition result, the speech recognition module can not be identified to interactive voice service module feedback voice to be referred to
It enables, carries out feedback casting from the interactive voice service module to the assembly crewman
The present invention has the beneficial effect that:
Compared with the interactive voice of other field, the voice provided by the invention based on the guidance of augmented reality assembly technology is handed over
Mutual system and method has following advantage:
(1) development platform advantage: compared to other equipment, wearing type glasses and augmented reality assembly technology instruct field more
To match, but it is less for the development and application of particular platform equipment；
(2) specific aim is stronger: the interactive voice form of other field is unfolded mostly with versatility, not for actual
Augmented reality assembly technology instructs scene to be made a concrete analysis of with process, lacks the understanding for assembler's actual demand；
(3) working model refine: realize the refinement to actual field assembly environment analysis and refine, to assembly scene,
Product model and interactive voice environment have carried out systematization building.Therefore, improve augmented reality assembly technology visualization technique
Interactive voice shows on wearing type glasses platform, promotes user experience, refers to for promoting the visualization of augmented reality assembly technology
The validity and intuitive led have original practical value.
(4) human-computer interaction process efficiency in augmented reality assembly visualization instruction course is improved, can satisfy practical dress
The problem of with production requirement, promotes user experience.
It in the present invention, can also be combined with each other between above-mentioned each technical solution, to realize more preferred assembled schemes.This
Other feature and advantage of invention will illustrate in the following description, also, certain advantages can become from specification it is aobvious and
It is clear to, or understand through the implementation of the invention.The objectives and other advantages of the invention can by specification, claims with
And it is achieved and obtained in specifically noted content in attached drawing.
Detailed description of the invention
Attached drawing is only used for showing the purpose of specific embodiment, and is not to be construed as limiting the invention, in entire attached drawing
In, identical reference symbol indicates identical component.
Fig. 1 is that augmented reality assembly technology instructs system structure diagram in the embodiment of the present invention.
Specific embodiment
Specifically describing the preferred embodiment of the present invention with reference to the accompanying drawing, wherein attached drawing constitutes the application a part, and
Together with embodiments of the present invention for illustrating the principle of the present invention, it is not intended to limit the scope of the present invention.
A specific embodiment of the invention discloses a kind of augmented reality assembly technology and instructs system, structural schematic diagram
As shown in Figure 1, voice interactive system and instructing interactive system；Wherein, the voice interactive system, for receiving and identifying assembly
The voice of personnel's input, obtains speech recognition result, and institute's speech recognition result is sent to and described instructs interactive system；Institute
It states and instructs interactive system, the speech recognition result for receiving judges whether institute's speech recognition result is current virtual dress
With the phonetic control command that can be performed in environment, if so, directly executing institute's speech recognition result；If not, it is determined that can hold
The virtual assembly environment of row institute speech recognition result, and switch to the Virtual assemble of executable institute's speech recognition result
Environment executes institute's speech recognition result in virtual assembly environment after handover.It, will be described in view of actual assembling process
The virtual assembly environment for instructing interactive system includes initial scene, assembly scene, the assembly virtual usage scenario of finished product.In this system
Voice interactive system is integrated and independently of instructing interactive system to exist, and the two can all carry out interactive voice under any process, right
Augmented reality assembly technology instruction course is without influence.
Specifically, in actual application, instruct interactive system after receiving the speech recognition result, first according to guidance
The interactive interface that interactive system is currently shown determines current virtual assembly environment；Then it calls in current virtual assembly environment
All executable phonetic control commands, if speech recognition result is that the voice control that can be performed in current virtual assembly environment refers to
It enables, then directly executes institute's speech recognition result；If it is not, then calling all executable voice controls in other virtual assembly environments
System instruction, if speech recognition result is matched with a certain phonetic control command, by Virtual assemble belonging to the phonetic control command
Environment, is determined as the virtual assembly environment of executable current speech recognition result, and switches to and described the voice can be performed know
The virtual assembly environment of other result executes institute's speech recognition result in virtual assembly environment after handover.
The present invention also illustratively gives the phonetic control command that can be performed under each virtual assembly environment, it is preferable that institute
The phonetic control command that stating can be performed under initial scene includes at least one or more of: operating instruction starts assembly, assembly
Demonstration, finished product detection demonstration；The phonetic control command that can be performed under the assembly scene includes at least one or more of: institute
State each Assembly part, previous step, next step, resetting, return needed for augmented reality assembling process；The assembly finished product is empty
The phonetic control command that can be performed under quasi- usage scenario is correspondingly arranged according to the function of assembly finished product.
Information exchange is carried out with interactive system is instructed by means of voice interactive system in the present invention.Therefore, all voices are handed over
The setting of mutual system instructs Design of Interactive System both in this.Specifically, voice interactive system includes: interactive voice clothes
Business module, speech recognition module, dictionary management module；Wherein, it prestores in the dictionary management module comprising grammar file, institute
State all phonetic control commands for only storing in grammar file and using in the augmented reality assembly technology；It is stored in grammar file
Phonetic control command it is consistent with the phonetic control command stored in interactive system is instructed, with guarantee it is all can be by interactive voice system
The voice of system identification, can execute corresponding operation in instructing interactive system.The interactive voice service module and institute's predicate
Sound identification module is connected, for when having detected voice input, receiving and storing the voice of input, and by the voice
It is sent to the speech recognition module, recognition result is generated by the speech recognition module；The interactive voice service module is also
Described interactive system is instructed for the recognition result to be sent to；The speech recognition module and the dictionary management module phase
Even, for the voice received to be converted into Feature Words, and refer to the voice control prestored in the dictionary management module
It enables and carries out route matching, the highest target identification word of score will be matched as recognition result.
For the accuracy for being further ensured that recognition result, it is preferable that if the Feature Words and the phonetic control command
Match score and be lower than predetermined value, then the speech recognition module is unable to get speech recognition result, the speech recognition module to
Interactive voice service module feedback voice can not identify instruction, from the interactive voice service module to the assembly crewman
Carry out feedback casting.
If the continuous n times of voice interactive system can not identify the voice of assembly crewman's input, show the assembly crewman couple
Executable phonetic control command is not familiar with, and therefore, it is necessary to inform that all executable voice controls of assembly crewman refer to.Specifically
The function is accomplished in the following manner in ground: the interactive voice service module calls the language prestored in the dictionary management module
Method file, all phonetic control commands used in augmented reality assembly technology described in Xiang Suoshu assembly crewman's voice broadcast.
Specifically, the dictionary management module is responsible for the life of grammar file of the speech recognition engine in speech recognition process
At.Speech recognition engine (Recognition Engine) is one of the basic speech engine in Speech SDK, belongs to voice
The functional component of identification module.The grammar file main definitions set of the voice command words of the specific semantic function of offer, when mentioning
Get assembly user input voice characteristic information when, can directly be compiled parsing after grammar file in voice command words
Route matching is carried out, the particular content that assembly user inputs voice is identified and exported by mating structure.The speech recognition module
It is responsible for pre-processing input voice, and completes the real-time identification work to input voice.After proposing characteristic parameter, with dictionary
The identification dictionary that management module generates carries out route matching, exports the best entry of matching degree as recognition result.
Preferably, the voice interactive system further includes voice synthetic module, for being that text is anti-when feedback casting
When feedback, corresponding voice feedback is synthesized by the voice synthetic module and is broadcasted, and voice feedback casting is sent to institute
Predicate sound interactive service module carries out feedback casting by voice mode by the interactive voice service module.The voice closes
At module and interactive voice service module and audio Coordination module co-ordination, corresponding voice command is generated in the suitable time
The speech form of casting is fed back, while interactive voice service module being called to export voice feedback casting to user.Such as work as voice
(need to carry out voice input according to the key order set) when system receives " import model " voice command, with dictionary into
Row matching, after obtaining best match item, voice synthetic module calls interactive voice service module to export feedback voice, table to user
Bright specific command correlation.
Preferably, the voice interactive system further includes audio Coordination module, for monitoring the interactive voice service mould
The voice input that block receives, when voice input is fuzzy or unintelligible, the audio Coordination module controls the voice
Interactive service module, which issues, re-enters the instruction of voice, and controls the interactive voice service module to receive voice again defeated
Enter, until voice signal can be matched correctly.Audio Coordination module is responsible for monitoring the creation and refreshing of input signal in real time,
And state change of interactive voice process etc..Audio Coordination module belongs to control hinge sections, essential record current speech shape
State is scheduled coordination to the semantic task of input and output.
Preferably, the augmented reality assembly technology instructs the system integration in wearing type glasses, the wearing type glasses
Including audio frequency apparatus, the audio frequency apparatus includes microphone and earphone, the audio frequency apparatus and the interactive voice service module
It is connected.Preferably, it further includes that interactive voice wakes up key that augmented reality assembly technology, which instructs system, for waking up the interactive voice
System.
The present invention is by using 64 bit manipulation system of Win10 Desktop, subsidiary Intel Atom x7-Z8700 processor
With built-in camera, screen is not less than the resolution ratio of 640x480, supports touch screen interaction, system for content 4GB, is not less than 4 hours
The wearing type glasses in electric power cruise duration instruct voice interactive system to constitute with augmented reality assembly technology.Institute in wearing type glasses
Stating audio frequency apparatus includes microphone and earphone, provides the input/output interface of voice command signal for the wearing type glasses, with
Obtain the voice command signal of assembly user；The real scene and virtual mould that the wearing type glasses are shot by built-in camera
The fusion of type picture is formed by stacking, and building augmented reality assembly technology instructs interaction scenarios, to guarantee true environment and dummy model
Between registration.The wearing type glasses according to planning process route, carry out the real-time assembly workpiece video image of shooting empty
Quasi- assembly image and actual erecting yard image superposition are simultaneously shown on the displaying eyeglass of wearing type glasses.
In another embodiment of the invention, a kind of augmented reality assembly technology guidance method, including following step are disclosed
It is rapid:
The voice that assembly crewman's input is received and identified by voice interactive system, obtains speech recognition result, and by institute
Speech recognition result, which is sent to, instructs interactive system；
It instructs interactive system to receive institute's speech recognition result, judges whether institute's speech recognition result is current virtual dress
With the phonetic control command that can be performed in environment, if so, directly executing institute's speech recognition result；If not, it is determined that can hold
The virtual assembly environment of row institute speech recognition result, and switch to the Virtual assemble of executable institute's speech recognition result
Environment executes institute's speech recognition result in virtual assembly environment after handover；
The virtual assembly environment for instructing interactive system include initial scene, assembly scene, assembly finished product virtually use
Scene.
Specifically, the voice interactive system executes the voice of following steps identification assembly crewman's input, obtains voice knowledge
Other result:
Interactive voice service module receives and stores the voice of input, and the voice is sent to the voice and is known
Other module；
The voice is converted into Feature Words by the speech recognition module, and with the language that is prestored in the dictionary management module
Sound control instruction carries out route matching, will match the highest target identification word of score as recognition result；
If the matching score of the Feature Words and the phonetic control command is lower than predetermined value, the speech recognition module
It is unable to get speech recognition result, the speech recognition module can not be identified to interactive voice service module feedback voice to be referred to
It enables, carries out feedback casting from the interactive voice service module to the assembly crewman.
The specific implementation process of embodiment of the present invention method is referring to the above system embodiment, and the present embodiment is herein no longer
It repeats.Since the present embodiment is identical as systems approach embodiment principle, so this system also has above method embodiment corresponding
Technical effect.
It will be understood by those skilled in the art that realizing all or part of the process of above-described embodiment method, meter can be passed through
Calculation machine program is completed to instruct relevant hardware, and the program can be stored in computer readable storage medium.Wherein, institute
Stating computer readable storage medium is disk, CD, read-only memory or random access memory etc..
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto,
In the technical scope disclosed by the present invention, any changes or substitutions that can be easily thought of by anyone skilled in the art,
It should be covered by the protection scope of the present invention.
Claims (10)
1. a kind of augmented reality assembly technology instructs system, which is characterized in that the augmented reality assembly technology instructs system packet
It includes: voice interactive system and instructing interactive system；Wherein,
The voice interactive system obtains speech recognition result for receiving and identifying the voice of assembly crewman's input, and by institute
Speech recognition result, which is sent to, described instructs interactive system；
Described to instruct interactive system, the speech recognition result for receiving judges whether institute's speech recognition result is current
The phonetic control command that can be performed in virtual assembly environment, if so, directly executing institute's speech recognition result；If it is not, then really
Surely the virtual assembly environment of executable institute's speech recognition result, and switch to the void of executable institute's speech recognition result
Intend assembly environment, executes institute's speech recognition result in virtual assembly environment after handover；
The virtual assembly environment for instructing interactive system includes initial scene, assembly scene, the assembly virtual usage scenario of finished product.
2. augmented reality assembly technology according to claim 1 instructs system, which is characterized in that
The phonetic control command that can be performed under the initial scene includes at least one or more of: operating instruction starts to fill
Match, assemble demonstration, finished product detection demonstration；
The phonetic control command that can be performed under the assembly scene includes at least one or more of: the augmented reality assembly
Each Assembly part, previous step, next step, resetting, return needed for process；
The phonetic control command that can be performed under the assembly virtual usage scenario of finished product is correspondingly arranged according to the function of assembly finished product.
3. augmented reality assembly technology according to any one of claim 1 or 2 instructs system, which is characterized in that described
Voice interactive system includes: interactive voice service module, speech recognition module, dictionary management module；Wherein,
It prestores in the dictionary management module comprising grammar file, the augmented reality assembly is only stored in the grammar file
All phonetic control commands used in technique；
The interactive voice service module is connected with the speech recognition module, for receiving when having detected voice input
And the voice of input is stored, and the voice is sent to the speech recognition module, it is given birth to by the speech recognition module
At recognition result；The interactive voice service module, which is also used to for the recognition result being sent to, described instructs interactive system；
The speech recognition module is connected with the dictionary management module, for the voice received to be converted into feature
Word, and route matching is carried out with the phonetic control command prestored in the dictionary management module, the highest target of score will be matched
Identify word as recognition result.
4. augmented reality assembly technology according to claim 3 instructs system, which is characterized in that if the Feature Words and institute
The matching score of phonetic control command is stated lower than predetermined value, then the speech recognition module is unable to get speech recognition result, institute
Instruction can not be identified to interactive voice service module feedback voice by stating speech recognition module, service mould by the interactive voice
Block carries out feedback casting to the assembly crewman.
5. augmented reality assembly technology according to claim 4 instructs system, which is characterized in that if the interactive voice system
Continuous n times of uniting can not identify that the voice of assembly crewman's input, the interactive voice service module call the dictionary management module
In the grammar file that prestores, all voice controls used in augmented reality assembly technology described in Xiang Suoshu assembly crewman's voice broadcast
System instruction.
6. augmented reality assembly technology according to claim 3 instructs system, which is characterized in that the voice interactive system
It further include audio Coordination module, the voice input received for monitoring the interactive voice service module, when the voice is defeated
When entering to obscure or is unintelligible, the audio Coordination module controls the interactive voice service module and issues the finger for re-entering voice
It enables, and controls the interactive voice service module and receive voice input again.
7. augmented reality assembly technology according to claim 1 instructs system, which is characterized in that the augmented reality assembly
Technique instructs the system integration in wearing type glasses, and the wearing type glasses include audio frequency apparatus, and the audio frequency apparatus includes wheat
Gram wind and earphone, the audio frequency apparatus are connected with the interactive voice service module.
8. augmented reality assembly technology according to claim 1 instructs system, which is characterized in that augmented reality assembly technology
Instructing system further includes that interactive voice wakes up key, for waking up the voice interactive system.
9. a kind of augmented reality assembly technology guidance method, which comprises the following steps:
The voice that assembly crewman's input is received and identified by voice interactive system, obtains speech recognition result, and by institute's predicate
Sound recognition result, which is sent to, instructs interactive system；
It instructs interactive system to receive institute's speech recognition result, judges whether institute's speech recognition result is current virtual mounting ring
The phonetic control command that can be performed in border, if so, directly executing institute's speech recognition result；If not, it is determined that executable institute
The virtual assembly environment of speech recognition result, and switch to the Virtual assemble ring of executable institute's speech recognition result
Border executes institute's speech recognition result in virtual assembly environment after handover；
The virtual assembly environment for instructing interactive system includes initial scene, assembly scene, the assembly virtual usage scenario of finished product.
10. augmented reality assembly technology guidance method according to claim 9, which is characterized in that the interactive voice system
System executes the voice of following steps identification assembly crewman's input, obtains speech recognition result:
Interactive voice service module receives and stores the voice of input, and the voice is sent to the speech recognition mould
Block；
The voice is converted into Feature Words by the speech recognition module, and with the voice control that is prestored in the dictionary management module
System instruction carries out route matching, will match the highest target identification word of score as recognition result；
If the matching score of the Feature Words and the phonetic control command is lower than predetermined value, the speech recognition module can not
Speech recognition result is obtained, the speech recognition module can not identify instruction to interactive voice service module feedback voice,
Feedback casting is carried out from the interactive voice service module to the assembly crewman.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910574832.7A CN110299138A (en) | 2019-06-28 | 2019-06-28 | A kind of augmented reality assembly technology instructs system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910574832.7A CN110299138A (en) | 2019-06-28 | 2019-06-28 | A kind of augmented reality assembly technology instructs system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110299138A true CN110299138A (en) | 2019-10-01 |
Family
ID=68029293
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910574832.7A Pending CN110299138A (en) | 2019-06-28 | 2019-06-28 | A kind of augmented reality assembly technology instructs system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110299138A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110825233A (en) * | 2019-11-11 | 2020-02-21 | 电子科技大学 | Man-machine interaction system based on AR guidance |
| CN111862771A (en) * | 2020-07-30 | 2020-10-30 | 江苏建筑职业技术学院 | Prefabricated structure construction synchronous guidance system and method based on building information model |
| CN112581634A (en) * | 2020-11-26 | 2021-03-30 | 北京航天智造科技发展有限公司 | Implementation method of collaborative virtual assembly training system based on custom model and process planning |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105931645A (en) * | 2016-04-12 | 2016-09-07 | 深圳市京华信息技术有限公司 | Control method of virtual reality device, apparatus, virtual reality device and system |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN106512393A (en) * | 2016-10-14 | 2017-03-22 | 上海异界信息科技有限公司 | Application voice control method and system suitable for virtual reality environment |
| CN106847272A (en) * | 2016-12-12 | 2017-06-13 | 北京光年无限科技有限公司 | With the data interactive method of the intelligent robot of operation association |
| CN107645651A (en) * | 2017-10-12 | 2018-01-30 | 北京临近空间飞艇技术开发有限公司 | A kind of remote guide method and system of augmented reality |
| CN108427346A (en) * | 2018-04-02 | 2018-08-21 | 广州大学 | A kind of fabricated construction hoist controlling management system |
| CN108874363A (en) * | 2018-07-03 | 2018-11-23 | 百度在线网络技术（北京）有限公司 | Object control method, apparatus, equipment and storage medium for AR scene |
| CN109189213A (en) * | 2018-08-15 | 2019-01-11 | 华中科技大学 | A kind of assembling process of products augmented reality guidance method based on movable computer |
-
2019
- 2019-06-28 CN CN201910574832.7A patent/CN110299138A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN105931645A (en) * | 2016-04-12 | 2016-09-07 | 深圳市京华信息技术有限公司 | Control method of virtual reality device, apparatus, virtual reality device and system |
| CN106512393A (en) * | 2016-10-14 | 2017-03-22 | 上海异界信息科技有限公司 | Application voice control method and system suitable for virtual reality environment |
| CN106847272A (en) * | 2016-12-12 | 2017-06-13 | 北京光年无限科技有限公司 | With the data interactive method of the intelligent robot of operation association |
| CN107645651A (en) * | 2017-10-12 | 2018-01-30 | 北京临近空间飞艇技术开发有限公司 | A kind of remote guide method and system of augmented reality |
| CN108427346A (en) * | 2018-04-02 | 2018-08-21 | 广州大学 | A kind of fabricated construction hoist controlling management system |
| CN108874363A (en) * | 2018-07-03 | 2018-11-23 | 百度在线网络技术（北京）有限公司 | Object control method, apparatus, equipment and storage medium for AR scene |
| CN109189213A (en) * | 2018-08-15 | 2019-01-11 | 华中科技大学 | A kind of assembling process of products augmented reality guidance method based on movable computer |
Non-Patent Citations (1)
| Title |
|---|
| 刘晓晖: "基于中文语音交互的虚拟装配技术研究", 《中国优秀硕士学位论文全文数据库》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110825233A (en) * | 2019-11-11 | 2020-02-21 | 电子科技大学 | Man-machine interaction system based on AR guidance |
| CN111862771A (en) * | 2020-07-30 | 2020-10-30 | 江苏建筑职业技术学院 | Prefabricated structure construction synchronous guidance system and method based on building information model |
| CN112581634A (en) * | 2020-11-26 | 2021-03-30 | 北京航天智造科技发展有限公司 | Implementation method of collaborative virtual assembly training system based on custom model and process planning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104777911B (en) | A kind of intelligent interactive method based on holographic technique | |
| CN110299138A (en) | A kind of augmented reality assembly technology instructs system and method | |
| WO2021253743A1 (en) | Method and system for switching scene functions of robot, storage medium and smart robot | |
| CN109326289A (en) | Exempt to wake up voice interactive method, device, equipment and storage medium | |
| JP6671483B2 (en) | Method and apparatus for controlling smart devices and computer storage media | |
| CN105785813A (en) | Intelligent robot system multi-modal output method and device | |
| CN106378781A (en) | Service robot guide system and method | |
| CN110909439A (en) | AR-based assembly method and device and terminal | |
| CN109491562A (en) | A kind of interface display method and terminal device of voice assistant application program | |
| CN105677716A (en) | Computer data acquisition, processing and analysis system | |
| WO2020186934A1 (en) | Method, apparatus, and electronic device for generating animation containing dynamic background | |
| WO2024027661A1 (en) | Digital human driving method and apparatus, device and storage medium | |
| CN112596722A (en) | Building block programming method and device, storage medium and electronic equipment | |
| CN110442700A (en) | Man-machine more wheel dialogue methods and system, smart machine for human-computer interaction | |
| CN109671429A (en) | Voice interactive method and equipment | |
| CN110414429A (en) | Face cluster method, apparatus, equipment and storage medium | |
| CN106792044A (en) | The sound control method and device of a kind of intelligent television | |
| CN109324515A (en) | A kind of method and controlling terminal controlling intelligent electric appliance | |
| CN110000777A (en) | Multihead display robot, multi-display method and device, readable storage medium storing program for executing | |
| CN115858080A (en) | Method, device, equipment and storage medium for designing human-computer interaction interface | |
| CN109550232A (en) | Touch control device and its response method, device | |
| CN108388399A (en) | The method of state management and system of virtual idol | |
| CN106933122A (en) | Train display intelligent interactive method and system | |
| CN114757155B (en) | Conference document generation method and device | |
| CN106197394A (en) | Air navigation aid and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191001 |
|
| RJ01 | Rejection of invention patent application after publication |