CN110928416A - Immersive scene interactive experience simulation system - Google Patents

Immersive scene interactive experience simulation system Download PDF

Info

Publication number
CN110928416A
CN110928416A CN201911244507.0A CN201911244507A CN110928416A CN 110928416 A CN110928416 A CN 110928416A CN 201911244507 A CN201911244507 A CN 201911244507A CN 110928416 A CN110928416 A CN 110928416A
Authority
CN
China
Prior art keywords
workstation
simulation system
output
interactive experience
visitor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911244507.0A
Other languages
Chinese (zh)
Inventor
连欣玥
路邵珺
陈忠强
连帅凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai University of Engineering Science
Original Assignee
Shanghai University of Engineering Science
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai University of Engineering Science filed Critical Shanghai University of Engineering Science
Priority to CN201911244507.0A priority Critical patent/CN110928416A/en
Publication of CN110928416A publication Critical patent/CN110928416A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00Advertising or display means not otherwise provided for
    • G09F19/12Advertising or display means not otherwise provided for using special optical effects
    • G09F19/18Advertising or display means not otherwise provided for using special optical effects involving the use of optical projection means, e.g. projection of images on clouds
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00Combined visual and audible advertising or displaying, e.g. for public address
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • H04N9/3147Multi-projection systems

Abstract

The invention discloses an immersive scene interactive experience simulation system. In the invention, the immersive scene interactive experience simulation system puts pictures on the walls, ceilings and floors around a room through the projector, the position and the action of the visitor are captured in real time by the capturing unit, so that the server can conveniently capture the position information and the action information of the visitor by the capturing unit, sending an adjustment instruction to the graphic workstation, the graphic workstation receiving the picture adjustment instruction sent by the server to adjust the corresponding picture information, and the adjusted picture information is put on the projection screen through the corresponding projector, so that the put picture can be changed correspondingly according to the action of the visitor, and in addition, the audio playing unit can play relative music according to the action of the visitor or the put picture, so that the sense of reality and the sense of interaction of the visitor can be improved, and the visitor can feel the effect of being personally on the scene.

Description

Immersive scene interactive experience simulation system
Technical Field
The invention relates to the field related to image processing display technology, in particular to an immersive scene interaction experience simulation system.
Background
With the development of society and the progress of science and technology, a virtual reality technology appears at present, and the immersion and interactivity of the virtual reality technology can bring strong and vivid sensory impact to users to obtain the experience of being personally on the scene, but the current virtual simulation technology has the defects of weak reality, poor interaction, incapability of achieving the effect of being personally on the scene and the like.
To this end, we propose an immersive scene interactive experience simulation system.
Disclosure of Invention
The invention aims to provide an immersive scene interactive experience simulation system to solve the problems in the background art.
In order to achieve the purpose, the invention adopts the following technical scheme:
immersive sight interactive experience simulation system, including control end, server, figure workstation, image acquisition workstation, audio playback unit, image display unit and catching unit, the output of control end is connected with the input of server, the output of server is connected with the input of figure workstation, the output of figure workstation passes through the signal line and is connected with the image display unit, the output of catching the unit passes through the wire and is connected with the image acquisition workstation, the image acquisition workstation passes through the wire and is connected with the server, the input of audio playback unit is connected with the output of figure workstation.
Preferably, the image display unit comprises a plurality of projectors and a projection screen, the graphic workstation is connected with the plurality of projectors, the graphic workstation transmits image data to the projectors through the segmentation unit, the projectors put images on the projection screen, and the projection screen plays simulation scene pictures.
Preferably, the partitioning unit includes a matrix splitter, an output end of the graphics workstation is connected to an input end of the matrix splitter, and output ends of the matrix splitter are respectively connected to the plurality of projectors through signal lines.
Preferably, the projector is projected in the direction of the surrounding walls, ceiling and floor.
Preferably, the projector is an industrial projector.
Preferably, the capturing unit comprises a camera and a sensor, the output end of the camera is connected with the input end of the image acquisition workstation through a wire, the camera is used for acquiring the actions of the visitor, the output end of the sensor is connected with the input end of the image acquisition workstation through a wire, and the sensor is used for capturing the position of the visitor.
Preferably, the capturing unit further comprises an infrared sensor for capturing the visitor in real time.
Preferably, the camera passes through the switch and is connected with the server, the specification of switch is based on the quantity setting of camera, the camera adopts starlight level camera, just the camera possesses the highlight inhibition function.
Preferably, the audio playing unit is used for playing music matched with the scene, the audio playing unit comprises a plurality of sound boxes and an equalizer, the input end of each sound box is connected with the output end of the equalizer through a conducting wire, and the input end of the equalizer is connected with the output end of the graphics station through a conducting wire.
Compared with the prior art, the invention has the beneficial effects that:
in the invention, the immersive scene interactive experience simulation system puts pictures on the walls, ceilings and floors around a room through the projector, the position and the action of the visitor are captured in real time by the capturing unit, so that the server can conveniently capture the position information and the action information of the visitor by the capturing unit, sending an adjustment instruction to the graphic workstation, the graphic workstation receiving the picture adjustment instruction sent by the server to adjust the corresponding picture information, and the adjusted picture information is put on the projection screen through the corresponding projector, so that the put picture can be changed correspondingly according to the action of the visitor, and in addition, the audio playing unit can play relative music according to the action of the visitor or the put picture, so that the sense of reality and the sense of interaction of the visitor can be improved, and the visitor can feel the effect of being personally on the scene.
Drawings
Fig. 1 is a schematic structural diagram of an immersive scene interaction experience simulation system according to the present invention.
In the figure: 1. a server; 2. an image acquisition workstation; 3. a capturing unit; 31. a camera; 32. a sensor; 33. an infrared sensor; 4. an audio playing unit; 41. an equalizer; 42. sounding; 5. a graphics workstation; 6. an image display unit; 61. a projector; 62. a projection screen; 7. and a control end.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Referring to fig. 1, the invention further provides an immersive scene interactive experience simulation system, which includes a control end 7, a server 1, a graphic workstation 5, an image acquisition workstation 2, an audio playing unit 4, an image display unit 6 and a capturing unit 3, wherein an output end of the control end 7 is connected with an input end of the server 1, an output end of the server 1 is connected with an input end of the graphic workstation 5, an output end of the graphic workstation 5 is connected with the image display unit 6 through a signal line, an output end of the capturing unit 3 is connected with the image acquisition workstation 2 through a wire, the image acquisition workstation 2 is connected with the server 1 through a wire, and an input end of the audio playing unit 4 is connected with an output end of the graphic workstation 5; the control end 7 is used for controlling each unit; the server 1 is configured to process and analyze the data captured by the capture unit 3, convert the processed and analyzed result into an instruction, and send the instruction to the corresponding graphic workstation 5, so that the graphic workstation 5 can change the picture and transmit the changed picture to the corresponding projector 61.
The image display unit 6 comprises a plurality of projectors 61 and a projection screen 62, the graphic workstation 5 is connected with the plurality of projectors 61, the graphic workstation 5 transmits image data to the projectors 61 through the segmentation unit, the projectors 61 project the images on the projection screen 62, and the projection screen 62 plays and demonstrates simulation scene pictures.
The segmentation unit comprises a matrix splitter, the output end of the graphic workstation 5 is connected with the input end of the matrix splitter, the output end of the matrix splitter is respectively connected with the projectors 61 through signal lines, the projectors 61 with the matched number can be conveniently selected according to the size of the projection screen 62, the matrix splitter is used for perfectly splitting the pictures according to the number of the projectors 61, the pictures placed on the projection screen 62 are kept to be complete pictures, and the placing effect of the pictures is not influenced.
The projector 61 is placed in the surrounding walls, ceiling and ground, so that visitors can be immersed in the picture in all directions, the reality sense is improved, and the visitors can feel personally on the scene.
Wherein, projecting apparatus 61 is industry projecting apparatus 61, and industry projecting apparatus 61 has fine projection effect, and the picture definition of throwing out is high, can not influence visitor's the experience of watching.
Wherein, the unit 3 of catching includes camera 31 and sensor 32, camera 31's output passes through the wire and is connected with the input of image acquisition workstation 2, camera 31 is used for gathering visitor's action, sensor 32's output passes through the wire and is connected with the input of image acquisition workstation 2, sensor 32 is used for catching visitor's position, the picture of being convenient for to project makes corresponding change along visitor's position and action, improve this immersive sight interactive experience simulation system and visitor's interactive sense.
Wherein the capturing unit 3 further comprises an infrared sensor 33, the infrared sensor 33 being adapted to capture the visitor in real time.
Wherein, camera 31 is connected with server 1 through the switch, the specification of switch sets up based on camera 31's quantity, camera 31 adopts starlight level camera 31, and camera 31 possesses the highlight inhibition function, starlight level and the camera 31 that possesses the highlight inhibition can avoid the highlight to blind what camera 31 caused, starlight level camera 31 does not contain infrared lamp simultaneously, it is convenient to hide, infrared lamp on the camera 31 can not appear influences visitor's visit experience, starlight level camera 31 compares infrared camera 31 and gathers the picture clearer simultaneously, avoid catching the action and the position that unit 3 can't accurate catching visitor.
The audio playing unit 4 is used for playing music matched with a scene, the audio playing unit 4 comprises a plurality of sound boxes 42 and an equalizer 41, the input end of the sound box 42 is connected with the output end of the equalizer 41 through a lead, the input end of the equalizer 41 is connected with the output end of the graphic station through a lead, and the reality sense of a visitor's picture in a room is improved by playing corresponding music, so that the visitor has a sense of being personally on the scene.
In the invention, the immersive scene interactive experience simulation system puts pictures on the peripheral walls, ceilings and the ground of a room through the projector 61, captures the position and the action of a visitor in real time through the capture unit 3, is convenient for the server 1 to send an adjusting instruction to the graphic workstation 5 according to the position information of the visitor and the action information of the visitor captured by the capture unit 3, the graphic workstation 5 receives the picture adjusting instruction sent by the server 1 to adjust corresponding picture information, and puts the adjusted picture information on the projection screen 62 through the corresponding projector 61, so that the put pictures can be changed correspondingly according to the action of the visitor, in addition, the audio playing unit 4 can play relative music according to the action of the visitor or the put pictures, so as to improve the reality and the interactive sense of the visitor, the immersive scene interactive experience simulation system is suitable for various closed rooms, can be used in places such as music restaurants, exhibition halls, families, offices and the like, and has good applicability.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.

Claims (9)

1. Immersive sight interactive experience simulation system, its characterized in that, including control end, server, figure workstation, image acquisition workstation, audio playback unit, image display unit and catching unit, the output of control end is connected with the input of server, the output of server is connected with the input of figure workstation, the output of figure workstation passes through the signal line and is connected with the image display unit, the output of catching the unit passes through the wire and is connected with the image acquisition workstation, the image acquisition workstation passes through the wire and is connected with the server, the input of audio playback unit is connected with the output of figure workstation.
2. The immersive scene interactive experience simulation system of claim 1, wherein the image display unit comprises a plurality of projectors and a projection screen, wherein the graphics workstation is connected to the plurality of projectors, wherein the graphics workstation transmits image data to the projectors through the segmentation unit, wherein the projectors project images onto the projection screen, and wherein the projection screen simulates scene images as a result of playing the scenes.
3. The immersive scene interactive experience simulation system of claim 2, wherein the partitioning unit comprises a matrix splitter, an output of the graphics workstation being connected to an input of the matrix splitter, an output of the matrix splitter being connected to the plurality of projectors respectively via signal lines.
4. The immersive scene interactive experience simulation system of claim 2, wherein the projector is projected in the direction of the surrounding walls, ceiling and floor.
5. The immersive scene interactive experience simulation system of claim 2, wherein the projector is an industrial projector.
6. The immersive scene interactive experience simulation system of claim 1, wherein the capturing unit comprises a camera and a sensor, an output of the camera is connected to an input of the image capture workstation via a wire, the camera is configured to capture an action of the visitor, an output of the sensor is connected to an input of the image capture workstation via a wire, and the sensor is configured to capture a position of the visitor.
7. The immersive scene interactive experience simulation system of claim 1, wherein the capture unit further comprises an infrared sensor for capturing visitors in real time.
8. The immersive scene interactive experience simulation system of claim 6, wherein the cameras are connected with the server through a switch, the specification of the switch is set based on the number of the cameras, the cameras adopt starlight level cameras, and the cameras have a strong light suppression function.
9. The immersive scene interactive experience simulation system of claim 1, wherein the audio playing unit is configured to play music matched to the scene, the audio playing unit comprises a plurality of speakers and an equalizer, an input of the speakers is connected to an output of the equalizer through a wire, and an input of the equalizer is connected to an output of the graphics station through a wire.
CN201911244507.0A 2019-12-06 2019-12-06 Immersive scene interactive experience simulation system Pending CN110928416A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911244507.0A CN110928416A (en) 2019-12-06 2019-12-06 Immersive scene interactive experience simulation system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911244507.0A CN110928416A (en) 2019-12-06 2019-12-06 Immersive scene interactive experience simulation system

Publications (1)

Publication Number Publication Date
CN110928416A true CN110928416A (en) 2020-03-27

Family

ID=69858403

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911244507.0A Pending CN110928416A (en) 2019-12-06 2019-12-06 Immersive scene interactive experience simulation system

Country Status (1)

Country Link
CN (1) CN110928416A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112462939A (en) * 2020-11-24 2021-03-09 苏州华恒展览设计营造有限公司 Interactive projection method and system
CN114664142A (en) * 2022-03-30 2022-06-24 石家庄有鱼文化传播有限公司 Integrated VR (virtual reality) fish culture and teaching system
CN114924455A (en) * 2022-05-23 2022-08-19 浙江联美展示科技有限公司 Projection interactive item-showing device
CN115665437A (en) * 2022-12-21 2023-01-31 深圳市易云数字科技有限责任公司 Scene customizable on-site interactive AR slow live broadcast system
CN115793845A (en) * 2022-10-10 2023-03-14 北京城建集团有限责任公司 Intelligent exhibition hall system based on holographic images

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104317546A (en) * 2014-10-29 2015-01-28 深圳市时空数码科技有限公司 Situational interactive experience simulation system
CN105183161A (en) * 2015-09-02 2015-12-23 胡剑颖 Synchronized moving method for user in real environment and virtual environment
CN106559657A (en) * 2015-09-28 2017-04-05 株式会社理光 Method, control device and the system of tiled display are carried out using multiple projection screens
CN107197221A (en) * 2017-05-23 2017-09-22 成都希德电子信息技术有限公司 Mono signal multi-projector splicing optical projection system
CN110045832A (en) * 2019-04-23 2019-07-23 叁书云(厦门)科技有限公司 Immersion safety education experience system and method based on AR interaction

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104317546A (en) * 2014-10-29 2015-01-28 深圳市时空数码科技有限公司 Situational interactive experience simulation system
CN105183161A (en) * 2015-09-02 2015-12-23 胡剑颖 Synchronized moving method for user in real environment and virtual environment
CN106559657A (en) * 2015-09-28 2017-04-05 株式会社理光 Method, control device and the system of tiled display are carried out using multiple projection screens
CN107197221A (en) * 2017-05-23 2017-09-22 成都希德电子信息技术有限公司 Mono signal multi-projector splicing optical projection system
CN110045832A (en) * 2019-04-23 2019-07-23 叁书云(厦门)科技有限公司 Immersion safety education experience system and method based on AR interaction

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112462939A (en) * 2020-11-24 2021-03-09 苏州华恒展览设计营造有限公司 Interactive projection method and system
CN114664142A (en) * 2022-03-30 2022-06-24 石家庄有鱼文化传播有限公司 Integrated VR (virtual reality) fish culture and teaching system
CN114924455A (en) * 2022-05-23 2022-08-19 浙江联美展示科技有限公司 Projection interactive item-showing device
CN115793845A (en) * 2022-10-10 2023-03-14 北京城建集团有限责任公司 Intelligent exhibition hall system based on holographic images
CN115793845B (en) * 2022-10-10 2023-08-08 北京城建集团有限责任公司 Wisdom exhibition room system based on holographic image
CN115665437A (en) * 2022-12-21 2023-01-31 深圳市易云数字科技有限责任公司 Scene customizable on-site interactive AR slow live broadcast system

Similar Documents

Publication Publication Date Title
CN110928416A (en) Immersive scene interactive experience simulation system
WO2021098582A1 (en) System and method for displaying virtual reality model
US9794541B2 (en) Video capture system control using virtual cameras for augmented reality
KR102077108B1 (en) Apparatus and method for providing contents experience service
US11113884B2 (en) Techniques for immersive virtual reality experiences
CA2910448A1 (en) Content generation for interactive video projection systems
CN103533445B (en) Flying theater playing system based on active interaction
CN104010179B (en) Multi-user clustering and viewpoint calculating system and method based on multiple three-dimensional pictures
CN102339629B (en) Immersive tunnel multimedia interactive display system and method thereof
CN105611237A (en) Method for simulating five cameras by utilizing double cameras for education recording and broadcasting
CN110730340B (en) Virtual audience display method, system and storage medium based on lens transformation
CN108052206B (en) Video playing method and device and electronic equipment
CN110933350A (en) Electronic cloud mirror recording and broadcasting system, method and device
KR20110006976A (en) Mutimedia syncronization control system for display space from experience space
CN108563410B (en) Display control method and electronic equipment
CN109741464B (en) Method and apparatus for displaying real scenes
KR102080618B1 (en) System dispaying assistant contents on real billiard table
CN113315885B (en) Holographic studio and system for remote interaction
US10596452B2 (en) Toy interactive method and device
CN113259544B (en) Remote interactive holographic demonstration system and method
CN114615556A (en) Virtual live broadcast enhanced interaction method and device, electronic equipment and storage medium
CN209748722U (en) Projection real-time interaction device
CN105629654A (en) Augmented reality-based novel dream theater
CN113259602B (en) Method and system for scheduling interactive holographic video
CN218103295U (en) Performance control system for composite theater

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200327

RJ01 Rejection of invention patent application after publication