CN108319373A - A kind of virtual reality fusion food intake system for virtual reality - Google Patents
A kind of virtual reality fusion food intake system for virtual reality Download PDFInfo
- Publication number
- CN108319373A CN108319373A CN201810330770.0A CN201810330770A CN108319373A CN 108319373 A CN108319373 A CN 108319373A CN 201810330770 A CN201810330770 A CN 201810330770A CN 108319373 A CN108319373 A CN 108319373A
- Authority
- CN
- China
- Prior art keywords
- real
- food container
- virtual
- virtual reality
- computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 230000037406 food intake Effects 0.000 title claims abstract description 23
- 235000012631 food intake Nutrition 0.000 title claims abstract description 23
- 230000004927 fusion Effects 0.000 title claims abstract description 16
- 235000013305 food Nutrition 0.000 claims abstract description 77
- 230000006698 induction Effects 0.000 claims description 22
- 230000003287 optical effect Effects 0.000 claims description 5
- NBIIXXVUZAFLBC-UHFFFAOYSA-N Phosphoric acid Chemical compound OP(O)(O)=O NBIIXXVUZAFLBC-UHFFFAOYSA-N 0.000 claims description 4
- 239000000284 extract Substances 0.000 claims description 4
- 230000001939 inductive effect Effects 0.000 claims description 4
- 238000007654 immersion Methods 0.000 description 7
- 239000000470 constituent Substances 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 235000012054 meals Nutrition 0.000 description 3
- 238000000034 method Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000011800 void material Substances 0.000 description 2
- 240000007594 Oryza sativa Species 0.000 description 1
- 235000007164 Oryza sativa Nutrition 0.000 description 1
- 241000190070 Sarracenia purpurea Species 0.000 description 1
- 235000015895 biscuits Nutrition 0.000 description 1
- 230000001055 chewing effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 235000009566 rice Nutrition 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2215/00—Indexing scheme for image rendering
- G06T2215/16—Using real world measurements to influence rendering
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of virtual reality fusion food intake systems for virtual reality, and user is enabled to realize accurate food intake in the virtual environment using head-mounted display.The technical scheme is that：Tracking equipment, for tracking real food container, the real-time position information for obtaining real food container is sent to computer.Video camera setting obtains real scene image and is sent to computer in the top of food container, acquisition.Computer controls HMD according to the real-time position information of real food container and renders virtual food container in the corresponding position of virtual scene, and virtual food container is consistent with real food container geometry.Computer control HMD shows real food container edge internal image in virtual scene inside the edge of virtual food container.
Description
Technical field
The present invention relates to technical field of virtual reality, and in particular to a kind of virtual reality fusion food intake for virtual reality
System.
Background technology
Now with the universal of virtual reality applications, user becomes increasingly popular using head-mounted display in virtual environment
Middle to carry out various prolonged activities, such as viewing, in virtual theatre environment, user can stay indoors and just experience shadow
The enjoyment of institute's viewing.In the case where long-time uses head-mounted display, there are the demands of food intake by user, but due to
The user for wearing head-mounted display can not see object with the real world, and food intake at present needs user to take the helmet
It can carry out, this will significantly influence the usage experience of user.
It is directed to this problem at present, there is the following two kinds solution：
Scheme one：Using when head-mounted display and the interaction of real world, the program is realized and is shown wearing wear-type
In the virtual environment of device crawl and holding water cup function, without take head-mounted display can complete it is simple with real world
Interaction, and feeling of immersion is not reduced as far as possible, it takes sb's mind off sth.The program provides virtual experience using the Oculus Rift helmets,
Using two external sieve skill cameras, acquire in real world that a certain range of image, acquisition appear in the range before user plane
Hand, cup, keyboard etc. are superimposed upon in existing virtual scene, and reinforce its profile, are reached using head-mounted display
When can facilitate the purpose interacted with cup.The program one needs to carry out complicated image zooming-out.And in virtual scene, do not deposit
In corresponding dummy object, being directly embedded into for real-world object can cause Realistic Images of Virtual Scene to reduce.
Scheme two：Project Nourished, the application having a meal in virtual reality this solution provides one, it is intended to
The food of low-calorie in reality is shown as delicious food, guiding user health drink in virtual environment using virtual reality
Food.Scheme provides virtual experience using the Oculus Rift helmets, and inertial sensor and biosensor detection are assembled on tableware
The position of tableware and the state of food, are identified food using deep learning algorithm, and render user in the helmet more
Want the food eaten.The system is further equipped with skeleton motion sensor, increases chewing experience for user, enhances the authenticity of food.
The program has provided comprehensive experience of having a meal to the user, but its equipment is complicated, operand second is that a dedicated application of having a meal
Greatly, be not suitable for using in daily virtual reality system, and special tableware needs specific customization, increases the cost of system.It uses
The tableware of gyroscope detection and food position are easy, there are error, to lead to the reduction of system feeling of immersion.
Therefore how to ensure that user realizes accurate food intake in the virtual environment using head-mounted display, to
For user, the activity in virtual environment provides possibility for a long time, does not reduce system feeling of immersion, is urgently to be resolved hurrily at present ask
Topic.
Invention content
In view of this, the present invention provides a kind of virtual reality fusion food intake system for virtual reality, enable to
User realizes accurate food intake in the virtual environment using head-mounted display, to for user for a long time in virtual ring
Activity provides possibility in border, does not reduce system feeling of immersion.
In order to achieve the above objectives, the technical scheme is that：A kind of virtual reality fusion food intake for virtual reality
System, including tracking equipment, video camera, real food container, computer and head-mounted display HMD.
Tracking equipment, for tracking real food container, the real-time position information for obtaining real food container is sent to meter
Calculation machine.
Video camera setting obtains real scene image and send to computer in the top of food container, acquisition.
Computer controls HMD according to the real-time position information of real food container and renders void in the corresponding position of virtual scene
Quasi- food container, virtual food container are consistent with real food container geometry.
Computer extracts real food container edge internal image in real scene image, and control HMD is virtual in virtual scene
Real food container edge internal image is shown inside the edge of food container.
Optionally, tracking equipment includes the induction point of base station and setting quantity or the tracking of view-based access control model SLAM principles
System.
The quantity of induction point is arbitrarily chosen, and induction point is optical sensor or sonac.
The induction point of setting quantity is set to the surface of real food container.
Base station, for emitting signal, emitted signal is received by induction point；Base station is additionally operable to obtain the induction of induction point
Signal obtains real food container real-time position information according to inductive signal.
Optionally, the induction point of quantity is set as optical sensor；Base station is the base stations Lighthouse.
Optionally, video camera is using camera built-in in head-mounted display HMD.
Optionally, video camera is demarcated so that the coordinate system of video camera and the coordinate system one of head-mounted display HMD
It causes.
Advantageous effect：
The image zooming-out real food container edge internal image for the real world that the present invention is obtained using video camera utilizes
Tracking equipment controls the position of virtual food container in head-mounted display HMD, and a pair of with the position of real food container one
It answers, the image of the real food of extraction is merged with virtual scene, to make the user of head-mounted display virtual reality can be with
Accurate acquisition real food container as real world freely absorbs food, and without taking the helmet, do not need other yet
Auxiliary.Using the method for virtual reality fusion, while not breaking virtual environment feeling of immersion, the experience sense of user is enhanced, is compared
Virtual things in virtual environment at present, true food can more evoke the desire of user's feed.It can increase in virtual reality
The enjoyment of (such as viewing, game) in scene meets the basic physiological demand of user and the desire of food intake in special screne,
Also be simultaneously it is following for a long time using the food intake problem of the user of virtual environment in head-mounted display provide one kind it is low at
This simple, effective scheme.
Description of the drawings
Fig. 1 is shown by the virtual reality fusion food intake system composed structure for virtual reality that the embodiment of the present invention provides
It is intended to；
The virtual reality fusion food intake constituent system components position for virtual reality that Fig. 2 is provided by the embodiment of the present invention
Set relationship front view；
The virtual reality fusion food intake constituent system components position for virtual reality that Fig. 3 is provided by the embodiment of the present invention
Set relationship vertical view；
The virtual reality fusion food intake constituent system components position for virtual reality that Fig. 4 is provided by the embodiment of the present invention
Set relationship side view.
Specific implementation mode
The present invention will now be described in detail with reference to the accompanying drawings and examples.
Referring to FIG. 1, an embodiment of the present invention provides a kind of virtual reality fusion food intake system for virtual reality,
It is characterized in that, including：Tracking equipment, video camera, real food container, computer and head-mounted display HMD.
Real food container shapes can be selected according to user demand.
Tracking equipment, for tracking real food container, the real-time position information for obtaining real food container is sent to meter
Calculation machine.
Video camera setting obtains real scene image and is sent to computer in the top of food container, acquisition；The embodiment of the present invention
In, camera built-in in head mounted displays HMD may be used in video camera, external camera can also be used, when using external
It when video camera, needs to demarcate external camera so that the coordinate system and head-mounted display of external camera video camera
The coordinate system of HMD is consistent.
Computer controls HMD according to the real-time position information of real food container and renders void in the corresponding position of virtual scene
Quasi- food container, virtual food container are consistent with real food container geometry.Virtual food container and physical containers it is several
What size is consistent, and texture mapping can have more user demand and be selected, the spatial position in virtual environment and physical containers
Position is aligned one by one, can accurately perceive the position of actual containers in virtual environment by the position user of virtual container,
Can accurately be taken actual containers.
Computer extracts real food container edge internal image in real scene image, and control HMD is virtual in virtual scene
Real food container edge internal image is shown inside the edge of food container.The figure in true environment is obtained using video camera
Picture, by image processing techniques, by image physical containers mouth edge and container internal image extract, be fused to virtual ring
In border in virtual container, when the hand of user is entered in virtual container, user can accurately feel it can also be seen that the hand of oneself
The accurate crawl of food may be implemented in the relative position for knowing oneself hand and food.
The present invention will solve the problems, such as the food intake of the non-water quality such as biscuit, puffed rice of the user in virtual environment, realize
The accurate crawl of food container and food, the mode of virtual reality fusion enhance food while not breaking user's feeling of immersion
The sense of reality, user more has feeding urges.
It closes the virtual reality fusion food intake constituent system components position for virtual reality that the embodiment of the present invention is provided
Owner's view, vertical view and side view difference are as shown in Figure 2,3, 4, and video camera therein uses external camera.
In the embodiment of the present invention, tracking equipment can be the system comprising base station and the induction point for setting quantity, can also
It is the system that tracking system of view-based access control model SLAM etc. can realize following function.
The quantity of induction point is arbitrarily chosen, and induction point can be optical sensor or sonac.
The induction point of setting quantity is set to the surface of real food container.
Base station, for emitting signal, emitted signal is received by induction point；Base station is additionally operable to obtain the induction of induction point
Signal obtains real food container real-time position information according to inductive signal.Base station can be but not limited to Lighthouse.
The image zooming-out real food container edge internal image for the real world that the present invention is obtained using video camera utilizes
Tracking equipment controls the position of virtual food container in head-mounted display HMD, and a pair of with the position of real food container one
It answers, the image of the real food of extraction is merged with virtual scene, to make the user of head-mounted display virtual reality can be with
Accurate acquisition real food container as real world freely absorbs food, and without taking the helmet, do not need other yet
Auxiliary.Using the method for virtual reality fusion, while not breaking virtual environment feeling of immersion, the experience sense of user is enhanced, is compared
Virtual things in virtual environment at present, true food can more evoke the desire of user's feed.It can increase in virtual reality
The enjoyment of (such as viewing, game) in scene meets the basic physiological demand of user and the desire of food intake in special screne,
Also be simultaneously it is following for a long time using the food intake problem of the user of virtual environment in head-mounted display provide one kind it is low at
This simple, effective scheme.
To sum up, the above is merely preferred embodiments of the present invention, it is not intended to limit the scope of the present invention.It is all
Within the spirit and principles in the present invention, any modification, equivalent replacement, improvement and so on should be included in the protection of the present invention
Within the scope of.
Claims (5)
1. a kind of virtual reality fusion food intake system for virtual reality, which is characterized in that including：
Tracking equipment, video camera, real food container, computer and head-mounted display HMD；
The tracking equipment obtains the real-time position information of the real food container for tracking the real food container
It is sent to the computer；
The video camera setting is sent to the computer in the top of the food container, acquisition real scene image；
The computer according to the real-time position information of the real food container control the HMD virtual scene corresponding positions
It sets and renders virtual food container, the virtual food container is consistent with the real food container geometry；
The computer extracts real food container edge internal image in the real scene image, controls the HMD in virtual field
The real food container edge internal image is shown inside the edge of virtual food container described in scape.
2. the system as claimed in claim 1, which is characterized in that the tracking equipment be include base station and setting quantity induction point
Tracking system；
The quantity of the induction point is arbitrarily chosen, and the induction point is optical sensor or sonac；
The induction point of the setting quantity is set to the surface of the real food container；
The base station, for emitting signal, emitted signal is received by the induction point；The base station, is additionally operable to described in acquisition
The inductive signal of induction point obtains the real food container real-time position information according to the inductive signal.
3. system as claimed in claim 2, which is characterized in that the induction point for setting quantity as optical sensor, or
Sonac.
4. the system as claimed in claim 1, which is characterized in that the video camera uses in the head-mounted display HMD
The camera or external camera set.
5. the system as claimed in claim 1, which is characterized in that demarcated to the video camera so that the video camera
Coordinate system is consistent with the coordinate system of head-mounted display HMD.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810330770.0A CN108319373A (en) | 2018-04-13 | 2018-04-13 | A kind of virtual reality fusion food intake system for virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810330770.0A CN108319373A (en) | 2018-04-13 | 2018-04-13 | A kind of virtual reality fusion food intake system for virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108319373A true CN108319373A (en) | 2018-07-24 |
Family
ID=62898387
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810330770.0A Withdrawn CN108319373A (en) | 2018-04-13 | 2018-04-13 | A kind of virtual reality fusion food intake system for virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108319373A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11321909B2 (en) | 2019-08-26 | 2022-05-03 | International Business Machines Corporation | Tracking and rendering physical volumetric substances in virtual reality |
| CN115004281A (en) * | 2020-02-07 | 2022-09-02 | 多玩国株式会社 | Viewing terminal, viewing method, viewing system, and program |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063183A (en) * | 2011-02-12 | 2011-05-18 | 深圳市亿思达显示科技有限公司 | Virtual input device of grove type |
| CN106575159A (en) * | 2014-08-22 | 2017-04-19 | 索尼互动娱乐股份有限公司 | Glove interface object |
| CN208888764U (en) * | 2018-04-13 | 2019-05-21 | 北京理工大学 | A kind of virtual reality fusion food intake system for virtual reality |
-
2018
- 2018-04-13 CN CN201810330770.0A patent/CN108319373A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063183A (en) * | 2011-02-12 | 2011-05-18 | 深圳市亿思达显示科技有限公司 | Virtual input device of grove type |
| CN106575159A (en) * | 2014-08-22 | 2017-04-19 | 索尼互动娱乐股份有限公司 | Glove interface object |
| CN107368183A (en) * | 2014-08-22 | 2017-11-21 | 索尼互动娱乐股份有限公司 | Glove ports object |
| CN208888764U (en) * | 2018-04-13 | 2019-05-21 | 北京理工大学 | A kind of virtual reality fusion food intake system for virtual reality |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11321909B2 (en) | 2019-08-26 | 2022-05-03 | International Business Machines Corporation | Tracking and rendering physical volumetric substances in virtual reality |
| CN115004281A (en) * | 2020-02-07 | 2022-09-02 | 多玩国株式会社 | Viewing terminal, viewing method, viewing system, and program |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106170083B (en) | Image processing for head mounted display device | |
| JP6538897B2 (en) | Game machine with space sensing | |
| CN106232192B (en) | The object for appreciation game device of video camera with rotatable placement | |
| US20210090340A1 (en) | Systems and methods for generating and facilitating access to a personalized augmented rendering of a user | |
| CN106255916B (en) | Track the method and system of head-mounted display (HMD) and the calibration for the adjustment of HMD headband | |
| CN106873778B (en) | Application operation control method and device and virtual reality equipment | |
| CN106462233B (en) | The method and apparatus attracted for showing equipment viewer's sight | |
| CN106484115B (en) | For enhancing and the system and method for virtual reality | |
| US20140368539A1 (en) | Head wearable electronic device for augmented reality and method for generating augmented reality using the same | |
| CN109643014A (en) | Head-mounted display tracking | |
| US11967026B1 (en) | Virtual reality detection and projection system for use with a head mounted display | |
| US20160070343A1 (en) | Information processing method and electronic device | |
| CN108292490A (en) | Display control unit and display control method | |
| CN111881861A (en) | Display method, device, equipment and storage medium | |
| CN107533833A (en) | Head mounted display, information processor, information processing system and content-data output intent | |
| JP6656382B2 (en) | Method and apparatus for processing multimedia information | |
| CN111028597B (en) | Mixed reality foreign language scene, environment and teaching aid teaching system and method thereof | |
| CN108319373A (en) | A kind of virtual reality fusion food intake system for virtual reality | |
| CN208888764U (en) | A kind of virtual reality fusion food intake system for virtual reality | |
| US20230386147A1 (en) | Systems and Methods for Providing Real-Time Composite Video from Multiple Source Devices Featuring Augmented Reality Elements | |
| JP6775669B2 (en) | Information processing device | |
| CN110882536A (en) | Chess and play game system based on AR equipment | |
| CN105894581B (en) | Method and device for presenting multimedia information | |
| US20200336717A1 (en) | Information processing device and image generation method | |
| US11907434B2 (en) | Information processing apparatus, information processing system, and information processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20180724 |