CN107632702B - Holographic projection system adopting light-sensing data gloves and working method thereof - Google Patents
Holographic projection system adopting light-sensing data gloves and working method thereof Download PDFInfo
- Publication number
- CN107632702B CN107632702B CN201710689771.XA CN201710689771A CN107632702B CN 107632702 B CN107632702 B CN 107632702B CN 201710689771 A CN201710689771 A CN 201710689771A CN 107632702 B CN107632702 B CN 107632702B
- Authority
- CN
- China
- Prior art keywords
- light
- holographic projection
- holographic
- signals
- touch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a holographic projection system adopting light-sensing data gloves, which comprises light-sensing data gloves, holographic projection equipment and a central signal processing terminal, wherein the light-sensing data gloves comprise light sensors, track data sensors, a touch simulation unit and a first communication module, the holographic projection equipment comprises a holographic projection laser projection unit, a light reflected wave collection unit and a second communication module, and the central signal processing terminal comprises a signal processing module, a holographic image control module, a touch control module and a third communication module. The invention can see very vivid images without wearing virtual reality equipment, realizes the induction of holographic projection images through the light sensation data gloves, realizes the matching and timely interaction of hand actions and holographic projection images through the analysis of light ray data and light sensation data glove actions, obtains corresponding contact signals through analyzing the contact image signals, simulates corresponding touch senses and increases real feeling.
Description
Technical Field
The invention relates to the field of holographic projection, in particular to a holographic projection system adopting light-sensing data gloves.
Background
The virtual reality is that a three-dimensional virtual world is generated by utilizing computer simulation, sensory simulation about vision, hearing and touch of a user is provided, a closed virtual reality experience space is formed for the user through specific equipment such as a helmet and glasses, and the user can feel a virtual scene in all directions according to images in the helmet or glasses. The virtual reality takes a user as a main body, and different pictures and contents can be developed along with the change of limbs or thinking of the user. At present, both Sony and HTC have equipment for promoting virtual reality experience, and equipment including magic mirror, ant vision and the like is developed domestically. The holographic projection technology is used for recording light waves of an object by utilizing the principles of interference and diffraction, so that a real three-dimensional image is reproduced, and a user can watch a 3D effect by naked eyes without wearing any equipment. The holographic projection technology is generally suitable for product exhibition, automobile clothing release meeting, stage program and other aspects, and is
The holographic projection technology is only limited to visual ornamental effect at present and cannot be touched. This reduces the sensory pleasure of people.
Disclosure of Invention
It is an object of the present invention to provide a holographic projection system using photo-sensitive data gloves to solve the above-mentioned problems of the background art.
In order to achieve the purpose, the invention provides the following technical scheme:
a holographic projection system adopting light-sensing data gloves comprises light-sensing data gloves, holographic projection equipment and a central signal processing terminal, wherein the light-sensing data gloves comprise light sensors, track data sensors, a touch simulation unit and a first communication module, the light sensors are used for collecting light waves and converting light wave analog signals into digital signals, the track data sensors are used for collecting hand track signals, the touch simulation unit is used for simulating simple touch, the first communication module is used for realizing signal transmission, the holographic projection equipment comprises a holographic projection laser projection unit, a light reflected wave collection unit and a second communication module, the holographic projection laser projection unit is used for playing pictures of holographic projection, the light reflected wave collection unit is used for collecting light reflected signals after projection is blocked, the second communication module is used for realizing signal transmission, the central signal processing terminal comprises a signal processing module, a holographic image control module, a touch control module and a third communication module, wherein the signal processing module is used for comprehensively processing light-induced data glove signals and signals of holographic projection equipment after collection, the holographic image control module is used for realizing transformation and playing of holographic images according to hand motion tracks, the touch control module is used for controlling a touch simulation unit, and the third communication module is used for realizing signal transmission.
As a further scheme of the invention: the first communication module, the second communication module and the third communication module realize signal transmission through a wireless network or Bluetooth.
The working method of the holographic projection system adopting the photo-induction data gloves comprises the following specific steps:
step one, modeling a 3D coordinate system position of a holographic projection device and a light induction data glove: analyzing the color of the contact surface of the current light-induced data glove and the holographic projection equipment according to the signal of the light sensor to obtain a contact picture; analyzing and determining the space positions of the light-induced data glove and the holographic image through the signals of the light reflected wave collecting unit; analyzing the current hand action gesture through signals of a track data sensor, integrating and processing the signals, accurately determining the spatial position between the current light-induced data glove and a holographic projection playing picture through matching with the current holographic projection playing picture, and establishing a 3D coordinate system position modeling by taking the position of the light-induced data glove as a center and the holographic projection playing picture as a background;
step two, interaction between the holographic projection equipment and the light-induced data glove: determining the shape of the current gesture according to the signal of the track data sensor; determining the light image change of the contact image of the light sensing data glove at the moment according to the signals of the light sensor and the light reflected wave collecting unit; analyzing the holographic projection image matched with the current light-induced data glove interaction action according to the signal, and realizing interactive matching picture playing by controlling a holographic projection laser projection unit; and controlling the touch simulation unit according to the content of the matched picture, so as to realize the touch of pressure, temperature and pain.
Compared with the prior art, the invention has the beneficial effects that: the invention can see the vivid image projected by holographic projection without wearing virtual reality equipment, realizes the induction of holographic projection image through light sensation data gloves, realizes the matching and timely interaction of hand action and holographic projection picture through the analysis of light data and light sensation data gloves, obtains corresponding contact signal through analyzing the contact picture signal, simulates corresponding touch sense, increases the real feeling, reduces the wearing of head or glasses equipment, realizes the interaction of holographic image and hand action, and has good use effect.
Drawings
FIG. 1 is a schematic diagram of a holographic projection system employing a light-sensitive data glove.
FIG. 2 is a diagram of a method of operation of a holographic projection system employing a light sensitive data glove.
Wherein: the system comprises a 1-photoinduction data glove, a 2-holographic projection device, a 3-central signal processing terminal, a 4-light sensor, a 5-track data sensor, a 6-touch simulation unit, a 7-first communication module, an 8-holographic projection laser projection unit, a 9-light reflected wave collection unit, a 10-second communication module, an 11-signal processing module, a 12-holographic image control module, a 13-touch control module and a 14-third communication module.
Detailed Description
The technical solution of the present patent will be described in further detail with reference to the following embodiments.
Referring to fig. 1-2, a holographic projection system using light-sensing data gloves includes light-sensing data gloves 1, a holographic projection device 2 and a central signal processing terminal 3, where the light-sensing data gloves 1 include a light sensor 4, a trajectory data sensor 5, a haptic simulation unit 6 and a first communication module 7, the light sensor 4 is used for light wave collection and light wave analog signals are converted into digital signals, the trajectory data sensor 5 is used for hand trajectory signal collection and the trajectory data sensor 5 is distributed over the light-sensing data gloves 1, the haptic simulation unit 6 is used for simple touch simulation, the first communication module 7 is used for signal transmission, the holographic projection device 2 includes a holographic projection laser projection unit 8, a light reflected wave collection unit 9 and a second communication module 10, the holographic projection laser projection unit 8 is used for image playing of holographic projection, the light reflected wave collecting unit 9 is used for collecting the light reflected signals after the projection is blocked, the second communication module 10 is used for realizing the transmission of the signals, and the central signal processing terminal 3 is used for processing the signals
The system comprises a signal processing module 11, a holographic image control module 12, a touch control module 13 and a third communication module 14, wherein the signal processing module 11 is used for comprehensive processing of collected signals of the light-induced data glove 1 and signals of the holographic projection device 2, the holographic image control module 12 is used for realizing transformation and playing of a holographic image according to a hand motion track, the touch control module 13 is used for controlling the touch simulation unit 5, and the third communication module 14 is used for realizing signal transmission. The first communication module, the second communication module and the third communication module realize signal transmission through a wireless network or Bluetooth.
The working method of the holographic projection system adopting the photo-induction data gloves comprises the following specific steps:
step one, modeling a 3D coordinate system position of a holographic projection device and a light induction data glove: analyzing the color of the contact surface of the current light-induced data glove and the holographic projection equipment according to the signal of the light sensor to obtain a contact picture; analyzing and determining the space positions of the light-induced data glove and the holographic image through the signals of the light reflected wave collecting unit; analyzing the current hand action gesture through signals of a track data sensor, integrating and processing the signals, accurately determining the spatial position between the current light-induced data glove and a holographic projection playing picture through matching with the current holographic projection playing picture, and establishing a 3D coordinate system position modeling by taking the position of the light-induced data glove as a center and the holographic projection playing picture as a background;
step two, interaction between the holographic projection equipment and the light-induced data glove: determining the shape of the current gesture according to the signal of the track data sensor; determining the light image change of the contact image of the light sensing data glove at the moment according to the signals of the light sensor and the light reflected wave collecting unit; analyzing the holographic projection image matched with the current light-induced data glove interaction action according to the signal, and realizing interactive matching picture playing by controlling a holographic projection laser projection unit; and controlling the touch simulation unit according to the matched picture content to realize the touch senses such as pressure, temperature, pain and the like.
The user can realize the simulation and the training of the complicated operation under the actual condition through the use to the light induction data gloves, realizes accurate operation. For example, in the application of medical operation practice, the system can realize holographic projection of organs and positions to be operated, medical personnel can simulate operation after wearing the equipment gloves, and can be familiar with organ changes and touch feeling under real operation through the feedback of the touch simulation unit, so that the operation execution process can be sensed in an all-around manner, and the accidental risk in the actual operation implementation process can be reduced.
According to the invention, a 3D space position coordinate system of the hand position and holographic projection is established through a light sensor and a light reflected wave collecting unit; realizing the picture interaction with holographic projection by hand track action signal processing and light induction data correction; through the touch simulation unit, touch induction is realized, and interactive real feeling is enhanced. According to the invention, a helmet display or glasses do not need to be worn, a user can interact the multi-perceptibility of virtual reality with an image projected by a holographic projection technology through a light sensor and a track data sensor in a light-sensing data glove, and can change a holographic image picture through touch and obtain the tactile feedback of the holographic image at the same time.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.
Claims (3)
1. A holographic projection system adopting light-sensing data gloves is characterized by comprising light-sensing data gloves, holographic projection equipment and a central signal processing terminal, wherein the light-sensing data gloves comprise light sensors, track data sensors, a touch simulation unit and a first communication module, the light sensors are used for collecting light waves and converting light wave analog signals into digital signals, the track data sensors are used for collecting hand track signals, the touch simulation unit is used for simulating simple touch, the first communication module is used for realizing signal transmission, the holographic projection equipment comprises a holographic projection laser projection unit, a light reflected wave collection unit and a second communication module, the holographic projection laser projection unit is used for playing pictures of holographic projection, and the light reflected wave collection unit is used for collecting light reflected waves after projection is blocked, the central signal processing terminal comprises a signal processing module, a holographic image control module, a touch control module and a third communication module, wherein the signal processing module is used for comprehensively processing light-induced data glove signals and holographic projection equipment signals after collection, the holographic image control module is used for realizing transformation and playing of holographic images according to hand motion tracks, the touch control module is used for controlling a touch simulation unit, and the third communication module is used for realizing signal transmission.
2. The holographic projection system using photo-sensing data gloves of claim 1, wherein the first, second and third communication modules all achieve signal transmission through wireless network or bluetooth.
3. A method of operating a holographic projection system using light sensitive data gloves according to any of claims 1-2, characterized by the following steps:
step one, modeling a 3D coordinate system position of a holographic projection device and a light induction data glove: analyzing the color of the contact surface of the current light-induced data glove and the holographic projection equipment according to the signal of the light sensor to obtain a contact picture; analyzing and determining the space positions of the light-induced data glove and the holographic image through the signals of the light reflected wave collecting unit; analyzing the current hand action gesture through signals of a track data sensor, integrating and processing the signals, accurately determining the spatial position between the current light-induced data glove and a holographic projection playing picture through matching with the current holographic projection playing picture, and establishing a 3D coordinate system position modeling by taking the position of the light-induced data glove as a center and the holographic projection playing picture as a background;
step two, interaction between the holographic projection equipment and the light-induced data glove: determining the shape of the current gesture according to the signal of the track data sensor; determining the light image change of the contact image of the light sensing data glove at the moment according to the signals of the light sensor and the light reflected wave collecting unit; analyzing the holographic projection image matched with the current light-induced data glove interaction action according to the signal, and realizing interactive matching picture playing by controlling a holographic projection laser projection unit; and controlling the touch simulation unit according to the content of the matched picture, so as to realize the touch of pressure, temperature and pain.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710689771.XA CN107632702B (en) | 2017-08-14 | 2017-08-14 | Holographic projection system adopting light-sensing data gloves and working method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710689771.XA CN107632702B (en) | 2017-08-14 | 2017-08-14 | Holographic projection system adopting light-sensing data gloves and working method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107632702A CN107632702A (en) | 2018-01-26 |
| CN107632702B true CN107632702B (en) | 2020-06-30 |
Family
ID=61099268
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710689771.XA Active CN107632702B (en) | 2017-08-14 | 2017-08-14 | Holographic projection system adopting light-sensing data gloves and working method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107632702B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108932060A (en) * | 2018-09-07 | 2018-12-04 | 深圳众赢时代科技有限公司 | Gesture three-dimensional interaction shadow casting technique |
| CN109360516A (en) * | 2018-09-17 | 2019-02-19 | 北京唐冠天朗科技开发有限公司 | A kind of enterprise product displaying device and method |
| CN111504273A (en) * | 2020-05-09 | 2020-08-07 | 王军 | Three-dimensional digital sand table engine technology and device based on unmanned aerial vehicle aerial photography |
| CN118092672B (en) * | 2024-04-24 | 2024-07-12 | 广州美术学院 | Intelligent equipment interaction system and device based on image |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102784479A (en) * | 2011-05-20 | 2012-11-21 | 德信互动科技（北京）有限公司 | Holographic projection somatosensory interactive system and holographic projection somatosensory interactive method |
| CN202844541U (en) * | 2012-08-09 | 2013-04-03 | 陈滟滪 | Holographic displayed video game device |
| CN104317403A (en) * | 2014-10-27 | 2015-01-28 | 黄哲军 | Wearable equipment for sign language recognition |
| CN105553497A (en) * | 2015-12-21 | 2016-05-04 | 滨州学院 | Wearable electronic communication equipment |
| CN106445168A (en) * | 2016-11-01 | 2017-02-22 | 中南大学 | Intelligent gloves and using method thereof |
| CN106483756A (en) * | 2016-09-30 | 2017-03-08 | 上海飞来飞去新媒体展示设计有限公司 | Bore hole 3D line holographic projections methods of exhibiting |
| CN106951098A (en) * | 2017-05-22 | 2017-07-14 | 杨怀宁 | A kind of VR systems sense of touch gloves apparatus and its implementation |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8819591B2 (en) * | 2009-10-30 | 2014-08-26 | Accuray Incorporated | Treatment planning in a virtual environment |
| US9916009B2 (en) * | 2013-04-26 | 2018-03-13 | Leap Motion, Inc. | Non-tactile interface systems and methods |
-
2017
- 2017-08-14 CN CN201710689771.XA patent/CN107632702B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102784479A (en) * | 2011-05-20 | 2012-11-21 | 德信互动科技（北京）有限公司 | Holographic projection somatosensory interactive system and holographic projection somatosensory interactive method |
| CN202844541U (en) * | 2012-08-09 | 2013-04-03 | 陈滟滪 | Holographic displayed video game device |
| CN104317403A (en) * | 2014-10-27 | 2015-01-28 | 黄哲军 | Wearable equipment for sign language recognition |
| CN105553497A (en) * | 2015-12-21 | 2016-05-04 | 滨州学院 | Wearable electronic communication equipment |
| CN106483756A (en) * | 2016-09-30 | 2017-03-08 | 上海飞来飞去新媒体展示设计有限公司 | Bore hole 3D line holographic projections methods of exhibiting |
| CN106445168A (en) * | 2016-11-01 | 2017-02-22 | 中南大学 | Intelligent gloves and using method thereof |
| CN106951098A (en) * | 2017-05-22 | 2017-07-14 | 杨怀宁 | A kind of VR systems sense of touch gloves apparatus and its implementation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107632702A (en) | 2018-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Yang et al. | Gesture interaction in virtual reality | |
| El Saddik et al. | Haptics technologies: Bringing touch to multimedia | |
| CN108815804B (en) | VR upper limb rehabilitation training platform and method based on MYO arm ring and mobile terminal | |
| CN111460875B (en) | Image processing method and apparatus, image device, and storage medium | |
| CN107632702B (en) | Holographic projection system adopting light-sensing data gloves and working method thereof | |
| CN103793060B (en) | A kind of user interactive system and method | |
| CN103713737B (en) | Virtual keyboard system used for Google glasses | |
| Carvalheiro et al. | User redirection and direct haptics in virtual environments | |
| CN204695231U (en) | Portable helmet immersion systems | |
| CN106873778A (en) | A kind of progress control method of application, device and virtual reality device | |
| CN113316754B (en) | System and method for switching between modes of tracking real world objects of artificial reality interface | |
| CN105374251A (en) | Mine virtual reality training system based on immersion type input and output equipment | |
| Tachi et al. | Haptic media construction and utilization of human-harmonized “tangible” information environment | |
| Asaad | Virtual reality and augmented reality technologies: A closer look. | |
| Villegas et al. | Realistic training in VR using physical manipulation | |
| Radoeva et al. | Overview on hardware characteristics of virtual reality systems | |
| Saggio et al. | Augmented reality for restoration/reconstruction of artefacts with artistic or historical value | |
| CN206697069U (en) | Multimedia equipment and digital video interactive | |
| CN111276022A (en) | Gastroscope simulation operation system based on VR technique | |
| CN109426336A (en) | A kind of virtual reality auxiliary type selecting equipment | |
| Thalmann et al. | Virtual reality software and technology | |
| Liu | Analysis of Interaction Methods in VR Virtual Reality | |
| CN106020468A (en) | Glove controlled augmented reality system | |
| CN219302988U (en) | Augmented reality device | |
| Czesak et al. | Fusion of pose and head tracking data for immersive mixed-reality application development |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |