CN107993511A - Virtual culinary art training system and method based on motion sensing manipulation - Google Patents
Virtual culinary art training system and method based on motion sensing manipulation Download PDFInfo
- Publication number
- CN107993511A CN107993511A CN201711493859.0A CN201711493859A CN107993511A CN 107993511 A CN107993511 A CN 107993511A CN 201711493859 A CN201711493859 A CN 201711493859A CN 107993511 A CN107993511 A CN 107993511A
- Authority
- CN
- China
- Prior art keywords
- culinary art
- virtual
- main frame
- scene
- control main
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
A kind of virtual culinary art training system based on motion sensing manipulation, including：Control main frame, display, information acquisition device, force feedback equipment, scene 3D simulation modelings system, cooking process physical simulation system；Include scene 3D simulation modelings system, cooking process physical simulation system in the control main frame；The scene 3D simulation modelings system is used for the model element for building virtual culinary art scene；The cooking process physical simulation system is used for the rule for defining cooking process；Display is used for the model scene for showing cooking process；Described information collector is used for the operation for gathering user in cooking process, includes the seizure of the signal capture and voice signal of gesture motion, inputs to control main frame；The force feedback equipment is presented as the pot hand handle shape in cooking system, control signal is sent to show that culinary art scene makes corresponding adjustment to display terminal to control main frame for the operation according to user, and receives the feedback information of control main frame with to user's progress force feedback.
Description
Technical field
The present invention relates to technical field of virtual reality, more particularly to a kind of virtual culinary art training system based on motion sensing manipulation
And method.
Background technology
The study conventional method of cooking skill generally includes written menu word teaching, television teaching, internet teaching
And true man's guidance etc.；Menu word is imparted knowledge to students, and television teaching and internet teaching etc. lack real-time, interactive, and user obtains letter
It can not be fed back after breath；And true man's guided teaching, there is a situation where to waste actual food materials and raw material with largely repeating.
The content of the invention
In view of this, the present invention proposes a kind of virtual culinary art training system and method based on motion sensing manipulation.
A kind of virtual culinary art training system based on motion sensing manipulation, it includes such as lower component：Control main frame, display, letter
Cease collector, force feedback equipment, scene 3D simulation modelings system, cooking process physical simulation system；
The control main frame is electrically connected with display, information acquisition device, force feedback equipment at the same time；
Include scene 3D simulation modelings system, cooking process physical simulation system in the control main frame；
The scene 3D simulation modelings system is used for the model element for building virtual culinary art scene；The cooking process physics
Analogue system is used for the rule for defining cooking process；
The display is used for the model scene for showing cooking process；
Described information collector is used to gathering the operation of user in cooking process, including the signal capture of gesture motion and
The seizure of voice signal, inputs to control main frame；
The force feedback equipment is presented as the pot hand handle shape in cooking system, for the operation according to user to control
Host sends control signal to show that culinary art scene makes corresponding adjustment to display terminal, and receives the feedback of control main frame
Information is with to user's progress force feedback；
In the virtual culinary art training system of the present invention based on motion sensing manipulation,
Include motion capture system, voice capture system in described information collector；
The motion capture system is used for gesture motion and the identification for catching collection user；
The voice capture system is used to catch the sound of collection user and carries out speech recognition.
The present invention also provides a kind of virtual culinary art training method based on motion sensing manipulation, it is grasped by above-mentioned based on body-sensing
The virtual culinary art training system of control realizes that the virtual culinary art training method based on motion sensing manipulation includes the following steps：
S1, pass through motion capture system, the operation information of voice capture system acquisition user in information acquisition device；
S2, by control main frame judge that the operation information of user belongs to gesture motion, the operation to force feedback equipment, sound
One kind in voice messaging, when belonging to gesture motion, jumps to step S3；When belonging to the operation to force feedback equipment, jump
Go to step S4；When belonging to acoustic vocal, step S5 is jumped to；
S3, by control main frame judge whether to need to be adjusted model of place, when needing adjustment, passes through scene 3D
Simulation modeling system is adjusted element in virtual culinary art model of place；
S4, judge whether to need to be adjusted model of place or need to feed back force feedback equipment force bearing adjustment,
When needing to be adjusted model of place, element in virtual culinary art model of place is adjusted by scene 3D simulation modelings system
It is whole；When needing to feed back force feedback equipment force bearing adjustment, force feedback is adjusted by force feedback equipment；
S5, according to voice recognition result judge whether to need to be adjusted model of place.
In the virtual culinary art training method of the present invention based on motion sensing manipulation,
S51, judged by control main frame speech recognition whether be validated user control voice information, for validated user
Control voice information when, jump to step S52；
S52, by control main frame judge whether to need to be adjusted model of place, when needing adjustment, passes through scene
3D simulation modelings system is adjusted element in virtual culinary art model of place.
Implement the virtual culinary art training system provided by the invention based on motion sensing manipulation and method has compared with prior art
There is following beneficial effect：
A kind of cooking skill based on virtual reality is provided, the interactive experience sense in cooking process has been greatly reinforced, has been
Application to human-computer interaction technology；
The mode being combined based on scene 3D simulation modelings with cooking process physical simulation is provided, can support that it is user to expand
Self-defined culinary art flow；
A kind of cooking skill interacted based on motion sensing manipulation technology is provided, including force feedback, user catch pot
Pommel has real gravity-feed tank；
Device structure is simple, and peripheral apparatus only includes display terminal and operating side, occupies little space, and without virtual eye
Mirror or other peripheral apparatus；
Provide a kind of cooking skill interacted based on motion sensing manipulation technology, including remote interaction technique, user
Corresponding oil bottle etc. need not be clicked on, after information acquisition device recognizes the gesture of crawl oil bottle on display, oil bottle is selected；Identification
To after the action being thrown into pot, oil bottle is toward pouring into oil in pot；After recognizing stopping action, stop oil, oil bottle and return to initial shape
State；
The speech recognition system based on voice capture is provided, auxiliary body-sensing interactive system completes cooking process.
Brief description of the drawings
Fig. 1 is the virtual culinary art training system structure diagram based on motion sensing manipulation of the embodiment of the present invention；
Fig. 2 is the virtual culinary art training method flow chart based on motion sensing manipulation of the embodiment of the present invention.
Embodiment
As shown in Figure 1, a kind of virtual culinary art training system based on motion sensing manipulation, including：
Control main frame：The control main frame is electrically connected with display, information acquisition device and force feedback equipment respectively；
Display：Model scene for showing cooking process etc.；Partial information collector is integrated in display periphery；
Information acquisition device：For gathering the operation of user in cooking process, include the signal capture and sound of gesture motion
The seizure of sound signal, inputs to control main frame；
Force feedback equipment：Presented as the pot hand handle shape in cooking system, the operation for having more user is such as run spoon
Control signal is sent to show that culinary art scene makes corresponding adjustment to display terminal to control main frame, and receives control main frame
Feedback information with to user carry out force feedback；
Scene 3D simulation modeling systems：For building the model element of virtual culinary art scene, system is as control main frame
A part；
Cooking process physical simulation system：For defining the rule of cooking process, a part of the system as control main frame；
Motion capture system：For catch collection user gesture motion and identification, system as information acquisition device one
Part；
Voice capture system：For catching the sound of collection user and carrying out speech recognition, system is as information acquisition device
A part.
Virtual culinary art training system provided in an embodiment of the present invention based on motion sensing manipulation, can break away from and carry virtual glasses
The constraint of peripheral apparatus, including control main frame, display, information acquisition device, force feedback equipment；Based on virtual reality and body-sensing skill
Art shows cooking process in the high reduction degree of display terminal, and human-computer interaction is realized by signal picker and force feedback equipment.
As shown in Fig. 2, the present invention also provides a kind of virtual culinary art training method based on motion sensing manipulation, it passes through above-mentioned
Virtual culinary art training system based on motion sensing manipulation realizes that the virtual culinary art training method based on motion sensing manipulation includes as follows
Step：
S1, pass through motion capture system, the operation information of voice capture system acquisition user in information acquisition device；
S2, by control main frame judge that the operation information of user belongs to gesture motion, the operation to force feedback equipment, sound
One kind in voice messaging, when belonging to gesture motion, jumps to step S3；When belonging to the operation to force feedback equipment, jump
Go to step S4；When belonging to acoustic vocal, step S5 is jumped to；
S3, by control main frame judge whether to need to be adjusted model of place, when needing adjustment, passes through scene 3D
Simulation modeling system is adjusted element in virtual culinary art model of place；
S4, judge whether to need to be adjusted model of place or need to feed back force feedback equipment force bearing adjustment,
When needing to be adjusted model of place, element in virtual culinary art model of place is adjusted by scene 3D simulation modelings system
It is whole；When needing to feed back force feedback equipment force bearing adjustment, force feedback is adjusted by force feedback equipment；
S5, according to voice recognition result judge whether to need to be adjusted model of place.
In the virtual culinary art training method of the present invention based on motion sensing manipulation,
S51, judged by control main frame speech recognition whether be validated user control voice information, for validated user
Control voice information when, jump to step S52；
S52, by control main frame judge whether to need to be adjusted model of place, when needing adjustment, passes through scene
3D simulation modelings system is adjusted element in virtual culinary art model of place.
Implement the virtual culinary art training system provided by the invention based on motion sensing manipulation and method has compared with prior art
There is following beneficial effect：
A kind of cooking skill based on virtual reality is provided, the interactive experience sense in cooking process has been greatly reinforced, has been
Application to human-computer interaction technology；
The mode being combined based on scene 3D simulation modelings with cooking process physical simulation is provided, can support that it is user to expand
Self-defined culinary art flow；
A kind of cooking skill interacted based on motion sensing manipulation technology is provided, including force feedback, user catch pot
Pommel has real gravity-feed tank；
Device structure is simple, and peripheral apparatus only includes display terminal and operating side, occupies little space, and without virtual eye
Mirror or other peripheral apparatus；
Provide a kind of cooking skill interacted based on motion sensing manipulation technology, including remote interaction technique, user
Corresponding oil bottle etc. need not be clicked on, after information acquisition device recognizes the gesture of crawl oil bottle on display, oil bottle is selected；Identification
To after the action being thrown into pot, oil bottle is toward pouring into oil in pot；After recognizing stopping action, stop oil, oil bottle and return to initial shape
State；
The speech recognition system based on voice capture is provided, auxiliary body-sensing interactive system completes cooking process.
It is understood that for those of ordinary skill in the art, it can be conceived with the technique according to the invention and done
Go out other various corresponding changes and deformation, and all these changes and deformation should all belong to the protection model of the claims in the present invention
Enclose.
Claims (4)
1. a kind of virtual culinary art training system based on motion sensing manipulation, it is characterised in that it includes such as lower component：Control main frame,
Display, information acquisition device, force feedback equipment, scene 3D simulation modelings system, cooking process physical simulation system；
The control main frame is electrically connected with display, information acquisition device, force feedback equipment at the same time；
Include scene 3D simulation modelings system, cooking process physical simulation system in the control main frame；
The scene 3D simulation modelings system is used for the model element for building virtual culinary art scene；The cooking process physical simulation
System is used for the rule for defining cooking process；
The display is used for the model scene for showing cooking process；
Described information collector is used for the operation for gathering user in cooking process, includes the signal capture and sound of gesture motion
The seizure of signal, inputs to control main frame；
The force feedback equipment is presented as the pot hand handle shape in cooking system, for the operation according to user to control main frame
Control signal is sent to show that culinary art scene makes corresponding adjustment to display terminal, and receives the feedback information of control main frame
To carry out force feedback to user.
2. the virtual culinary art training system based on motion sensing manipulation as claimed in claim 1, it is characterised in that
Include motion capture system, voice capture system in described information collector；
The motion capture system is used for gesture motion and the identification for catching collection user；
The voice capture system is used to catch the sound of collection user and carries out speech recognition.
3. a kind of virtual culinary art training method based on motion sensing manipulation, it is grasped by being based on body-sensing as claimed in claim 1 or 2
The virtual culinary art training system of control is realized, it is characterised in that the virtual culinary art training method based on motion sensing manipulation is included such as
Lower step：
S1, pass through motion capture system, the operation information of voice capture system acquisition user in information acquisition device；
S2, by control main frame judge that the operation information of user belongs to gesture motion, the operation to force feedback equipment, acoustic vocal
One kind in information, when belonging to gesture motion, jumps to step S3；When belonging to the operation to force feedback equipment, jump to
Step S4；When belonging to acoustic vocal, step S5 is jumped to；
S3, by control main frame judge whether to need to be adjusted model of place, when needing adjustment, is emulated by scene 3D
Modeling is adjusted element in virtual culinary art model of place；
S4, judge whether to need to be adjusted model of place or need to feed back force feedback equipment force bearing adjustment, is needing
When being adjusted to model of place, element in virtual culinary art model of place is adjusted by scene 3D simulation modelings system；
When needing to feed back force feedback equipment force bearing adjustment, force feedback is adjusted by force feedback equipment；
S5, according to voice recognition result judge whether to need to be adjusted model of place.
4. the virtual culinary art training method based on motion sensing manipulation as claimed in claim 3, it is characterised in that
S51, judged by control main frame speech recognition whether be validated user control voice information, in the control for validated user
During voice messaging processed, step S52 is jumped to；
S52, by control main frame judge whether to need to be adjusted model of place, when needing adjustment, is imitated by scene 3D
True modeling is adjusted element in virtual culinary art model of place.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711493859.0A CN107993511A (en) | 2017-12-31 | 2017-12-31 | Virtual culinary art training system and method based on motion sensing manipulation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711493859.0A CN107993511A (en) | 2017-12-31 | 2017-12-31 | Virtual culinary art training system and method based on motion sensing manipulation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107993511A true CN107993511A (en) | 2018-05-04 |
Family
ID=62040600
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711493859.0A Pending CN107993511A (en) | 2017-12-31 | 2017-12-31 | Virtual culinary art training system and method based on motion sensing manipulation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107993511A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961893A (en) * | 2018-05-11 | 2018-12-07 | 浙江引力波网络科技有限公司 | A kind of virtual reality interactive simulation experience system based on VR equipment |
| CN112908081A (en) * | 2021-01-29 | 2021-06-04 | 武汉烽火技术服务有限公司 | Network teaching practical training system based on virtualization slice and use method thereof |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103929495A (en) * | 2014-05-01 | 2014-07-16 | 陈桂芳 | Cooking skill retaining system based on network remote control |
| CN105867634A (en) * | 2016-04-25 | 2016-08-17 | 张锦浩 | Virtual family cooking learning system |
| CN106774876A (en) * | 2016-12-12 | 2017-05-31 | 大连文森特软件科技有限公司 | Based on the culinary art accessory system that AR augmented realities and menu are generated |
| CN106774877A (en) * | 2016-12-12 | 2017-05-31 | 大连文森特软件科技有限公司 | Culinary art accessory system based on AR augmented realities and network shopping mall |
| CN107170318A (en) * | 2017-06-29 | 2017-09-15 | 三峡大学 | A kind of cook's verification of professional technical ability and checking system based on virtual reality |
-
2017
- 2017-12-31 CN CN201711493859.0A patent/CN107993511A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103929495A (en) * | 2014-05-01 | 2014-07-16 | 陈桂芳 | Cooking skill retaining system based on network remote control |
| CN105867634A (en) * | 2016-04-25 | 2016-08-17 | 张锦浩 | Virtual family cooking learning system |
| CN106774876A (en) * | 2016-12-12 | 2017-05-31 | 大连文森特软件科技有限公司 | Based on the culinary art accessory system that AR augmented realities and menu are generated |
| CN106774877A (en) * | 2016-12-12 | 2017-05-31 | 大连文森特软件科技有限公司 | Culinary art accessory system based on AR augmented realities and network shopping mall |
| CN107170318A (en) * | 2017-06-29 | 2017-09-15 | 三峡大学 | A kind of cook's verification of professional technical ability and checking system based on virtual reality |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961893A (en) * | 2018-05-11 | 2018-12-07 | 浙江引力波网络科技有限公司 | A kind of virtual reality interactive simulation experience system based on VR equipment |
| CN112908081A (en) * | 2021-01-29 | 2021-06-04 | 武汉烽火技术服务有限公司 | Network teaching practical training system based on virtualization slice and use method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6902683B2 (en) | Virtual robot interaction methods, devices, storage media and electronic devices | |
| CN107203953B (en) | Teaching system based on internet, expression recognition and voice recognition and implementation method thereof | |
| CN106710590B (en) | Voice interaction system and method with emotion function based on virtual reality environment | |
| CN107665708B (en) | Intelligent voice interaction method and system | |
| US20180088663A1 (en) | Method and system for gesture-based interactions | |
| CN106997243B (en) | Speech scene monitoring method and device based on intelligent robot | |
| CN112162628A (en) | Multi-mode interaction method, device and system based on virtual role, storage medium and terminal | |
| CN105959718A (en) | Real-time interaction method and device in video live broadcasting | |
| CN107797663A (en) | Multi-modal interaction processing method and system based on visual human | |
| CN108475113A (en) | Use the detection of the hand gestures of posture language centrifugal pump | |
| CN107066081B (en) | Interactive control method and device of virtual reality system and virtual reality equipment | |
| CN107741781A (en) | Flight control method, device, unmanned plane and the storage medium of unmanned plane | |
| CN106528859A (en) | Data pushing system and method | |
| CN206711600U (en) | The voice interactive system with emotive function based on reality environment | |
| WO2019119314A1 (en) | Simulated sandbox system | |
| CN107993511A (en) | Virtual culinary art training system and method based on motion sensing manipulation | |
| CN107480766A (en) | The method and system of the content generation of multi-modal virtual robot | |
| TW201947427A (en) | Man-machine dialog method, client, electronic device and storage medium | |
| CN106502382A (en) | Active exchange method and system for intelligent robot | |
| CN108257441A (en) | Support the virtual culinary art training system and method based on motion sensing manipulation of more menus | |
| KR20220130000A (en) | Ai avatar-based interaction service method and apparatus | |
| CN111383642A (en) | Voice response method based on neural network, storage medium and terminal equipment | |
| CN107692669A (en) | A kind of artificial intelligence baby accompanies and attends to robot and its method of accompanying and attending to | |
| CN109656362B (en) | Virtual augmented reality device, control method and system thereof, and computer storage medium | |
| CN110633357A (en) | Voice interaction method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180504 |