CN110427103B - Virtual-real fusion simulation experiment multi-channel interaction method and system - Google Patents

Virtual-real fusion simulation experiment multi-channel interaction method and system Download PDF

Info

Publication number
CN110427103B
CN110427103B CN201910618413.9A CN201910618413A CN110427103B CN 110427103 B CN110427103 B CN 110427103B CN 201910618413 A CN201910618413 A CN 201910618413A CN 110427103 B CN110427103 B CN 110427103B
Authority
CN
China
Prior art keywords
connecting rod
motor
control subsystem
subsystem
stereo sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910618413.9A
Other languages
Chinese (zh)
Other versions
CN110427103A (en
Inventor
曹明亮
张浩洋
钟勇
刘欣
霍颖瑜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Foshan University
Original Assignee
Foshan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Foshan University filed Critical Foshan University
Priority to CN201910618413.9A priority Critical patent/CN110427103B/en
Publication of CN110427103A publication Critical patent/CN110427103A/en
Application granted granted Critical
Publication of CN110427103B publication Critical patent/CN110427103B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Toys (AREA)

Abstract

The invention provides a multi-channel interaction method and a multi-channel interaction system for a virtual-real fusion simulation experiment, wherein a pose equation of a temperature sensing control subsystem, an olfactory control subsystem, a vibration control subsystem and a stereo sound subsystem is established, and the poses of the temperature sensing control subsystem, the olfactory control subsystem, the vibration control subsystem and the stereo sound subsystem are calculated and adjusted through the pose equation, so that the temperature sensing control subsystem, the olfactory control subsystem, the vibration control subsystem and the stereo sound subsystem in the multi-channel interaction system are kept at the most suitable positions, the user experience is improved, the virtual reality immersion sense is enhanced, and the user obtains the experience effect which is more similar to the real environment through the cooperation of a plurality of channels of vision, hearing, touch and smell.

Description

Virtual-real fusion simulation experiment multi-channel interaction method and system
Technical Field
The disclosure relates to the technical field of virtual reality, single chip microcomputer control and data communication, in particular to a virtual-real fusion simulation experiment multi-channel interaction method and system.
Background
In the field of virtual reality technology, the technology of virtual-real fusion interaction plays an important role. Regarding various virtual-real fusion interaction schemes at present, mainly tactile feedback is taken as a main part, most of the schemes are realized through a handle, a remote controller, an intelligent glove and the like, and the schemes mainly comprise button and vibration feedback, and the interaction device has the advantages of convenience and free use in applications such as games and the like, but cannot adapt to wider application scenes; the motion capture system is also an important method for virtual-real fusion interaction, and can enable a user to obtain complete immersion and really enter a virtual world. However, the number of motion capture systems for VR in the market is not large, and some existing motion capture systems can only be used in a specific scene, and can only be used after a long calibration and wearing time, so that the motion capture systems cannot be widely popularized and applied.
In order to enhance the virtual reality immersion, the interaction mode needs to be matched through a plurality of channels of vision, hearing, touch and smell, so that the user can obtain the experience effect which is more similar to the real environment. Therefore, designing a device to simulate the environment in the virtual-real fusion simulation experiment process is a key point in the virtual-real fusion simulation experiment.
Disclosure of Invention
The invention aims to provide a virtual-real fusion simulation experiment multi-channel interaction method and system, which are used for establishing pose equations of a temperature control subsystem, an olfactory control subsystem, a vibration control subsystem and a stereo sound effect subsystem, and calculating and adjusting the poses of the temperature control subsystem, the olfactory control subsystem, the vibration control subsystem and the stereo sound effect subsystem through the pose equations.
The utility model provides a virtual-real fusion simulation experiment multi-channel interaction method and a system, wherein the virtual-real fusion simulation experiment multi-channel interaction method comprises the following steps:
step 1, initializing a multi-channel interactive system, and connecting control terminal equipment with a controller;
step 2, establishing pose equations of a temperature sensing control subsystem, an olfactory control subsystem, a vibration control subsystem and a stereo sound effect subsystem;
and 3, calculating and adjusting the poses of the temperature sensing control subsystem, the smell control subsystem, the vibration control subsystem and the stereo sound effect subsystem through a pose equation.
Further, in step 1, the multichannel interactive system comprises a temperature sensing control subsystem, an olfactory control subsystem, a stereo sound subsystem, a vibration control subsystem, a controller, a control terminal device, a first connecting rod, a second connecting rod, a third connecting rod, a fourth connecting rod, a first motor, a second motor, a third motor and a fourth motor; the vibration control subsystem is connected with the temperature sensing control subsystem through a first connecting rod, the temperature sensing control subsystem is connected with the smell control subsystem through a second connecting rod, the smell control subsystem is connected with the stereo sound effect subsystem through a third connecting rod, and the stereo sound effect subsystem is connected with the motor through a fourth connecting rod; a first angular displacement sensor and a first motor are arranged at the connection part of the first connecting rod and the temperature sensing control subsystem; a second angular displacement sensor and a second motor are arranged at the connection part of the second connecting rod and the olfactory control subsystem; a third angular displacement sensor and a third motor are arranged at the connection part of the third connecting rod and the stereo sound effect subsystem; the fourth motor is connected with the fourth motor, and the first motor, the second motor, the third motor and the fourth motor are respectively used for rotating the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod to adjust the pose.
Hereinafter, the temperature sensing control subsystem, the smell control subsystem, the stereo sound subsystem and the vibration control subsystem are collectively called subsystems, and the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod are collectively called connecting rods; the first motor, the second motor, the third motor and the fourth motor are collectively called as motors; the adjusting positions of the first motor, the second motor, the third motor and the fourth motor respectively correspond to the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod; when any one connecting rod is adjusted by the motor, the corresponding connecting rod is adjusted by the motor; the meaning that the connecting rod corresponds to the motor is that the first motor corresponds to the first connecting rod, the second motor corresponds to the second connecting rod, the third motor corresponds to the third connecting rod, and the fourth motor corresponds to the fourth connecting rod.
Further, in step 2, the method for establishing the pose equations of the temperature sensing control subsystem, the olfactory control subsystem, the vibration control subsystem and the stereo sound effect subsystem comprises the following steps: the lengths of the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod are respectively l1,l2,l3,l4Calculating the pose equation of the subsystem according to the length of each connecting rod and the angular displacement of the motor corresponding to the connecting rod,
x=l1sinθ1+l2sin(θ12)+l3sin(θ123)+l4sin(θ1234) (1)
y=l1cosθ1+l2cos(θ12)+l3cos(θ123)-l4cos(θ1234) (2)
θ′=θ1234-180° (3)
the angular displacement is the angular displacement theta of the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod measured by the angular displacement sensori(i=1,2,3,4)。
Further, in step 3, the method for calculating and adjusting the poses of the temperature sensing control subsystem, the olfactory control subsystem, the vibration control subsystem and the stereo sound effect subsystem through the pose equation comprises the following steps:
establishing a pose adjustment model of each subsystem through a pose equation:
Figure BDA0002124726120000031
Figure BDA0002124726120000032
Figure BDA0002124726120000033
ai(i-1, …, 4) is the tie rod length,
Figure BDA0002124726120000034
angular displacement for adjusting the position and attitude of the connecting-rods, i.e. by
Figure BDA0002124726120000035
Carrying out pose adjustment to achieve a proper pose;
Figure BDA0002124726120000036
Figure BDA0002124726120000037
Figure BDA0002124726120000038
wherein:
Figure BDA0002124726120000039
the positions and postures of the temperature sensing control subsystem, the smell control subsystem, the vibration control subsystem and the stereo sound effect subsystem are obtained from the above, start-stop signals and forward and reverse rotation signals are sent out, and the corresponding connecting rods are adjusted by the motors to carry out angular displacement
Figure BDA00021247261200000310
Rotating, namely adjusting the angles of the temperature sensing control subsystem, the smell control subsystem, the vibration control subsystem and the stereo sound effect subsystem so as to adjust the pose, wherein when a start-stop signal received by the motor is at a high level, the motor rotates, otherwise, the motor stops; when the positive and negative rotation signals received by the motor are high level, the motor rotates positively, otherwise, the motor rotates negatively.
The multichannel interaction system comprises a temperature sensing control subsystem, an olfactory control subsystem, a stereo sound effect subsystem, a vibration control subsystem, a controller, control terminal equipment, a first connecting rod, a second connecting rod, a third connecting rod, a fourth connecting rod, a first motor, a second motor, a third motor and a fourth motor; the vibration control subsystem is connected with the temperature sensing control subsystem through a first connecting rod, the temperature sensing control subsystem is connected with the smell control subsystem through a second connecting rod, the smell control subsystem is connected with the stereo sound effect subsystem through a third connecting rod, and the stereo sound effect subsystem is connected with the motor through a fourth connecting rod; a first angular displacement sensor and a first motor are arranged at the connection part of the first connecting rod and the temperature sensing control subsystem; a second angular displacement sensor and a second motor are arranged at the connection part of the second connecting rod and the olfactory control subsystem; a third angular displacement sensor and a third motor are arranged at the connection part of the third connecting rod and the stereo sound effect subsystem; the fourth motor is connected with the fourth motor, and the first motor, the second motor, the third motor and the fourth motor are respectively used for rotating the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod to adjust the pose.
Furthermore, the temperature-sensing control subsystem at least comprises a temperature and humidity sensor, a heating module, a refrigerating module, a humidifying module and a plurality of relays; the environment temperature and humidity are collected by a controller through a temperature and humidity sensor, and are regulated by a heating, refrigerating and humidifying device controlled by a relay in real time in the experimental process by using a closed-loop control mode and combining a PID (proportion integration differentiation) controller; heating, cooling and humidifying devices include, but are not limited to, air conditioners.
Furthermore, the smell control subsystem at least comprises a steering engine, an atomizing sheet driver, an atomizing sheet and a blower; in the experimentation, when using the apparatus or the material that have the smell, control terminal sends the instruction to the controller, and the controller selects different smell reagents through the rotation of control steering wheel, and the rethread atomizing piece atomizes the smell reagent to the air is gived off to the control air-blower with the smell.
Further, the vibration control subsystem includes at least a motor drive plate, one or more vibration motors; according to the experimental effect and physical collision, the vibration effect is simulated and generated, such as horizontal projectile motion experiment, inclined plane trolley sliding friction vibration and the like in the physical experiment.
Furthermore, the stereo sound effect subsystem at least comprises a key, a Bluetooth module, a sound device and a virtual reality head-mounted display device (VR head display); realize the bluetooth speaker effect, functions such as virtual button or entity button control volume, broadcast in the accessible VR experimental scene.
Further, the controller includes but is not limited to any one of an ARM microcontroller, a 51-series single chip microcomputer, a TMS320F2812 control chip, an LPC 2100-series chip, an 8051-series chip, and a DSP56F 800-series control chip.
Further, the control terminal device includes but is not limited to a PC, a tablet computer, a mobile phone, etc., and is connected with the controller through bluetooth, zigbee, and wired communication.
The beneficial effect of this disclosure does: the temperature sensing control subsystem, the smell control subsystem, the vibration control subsystem and the stereo sound effect subsystem in the multi-channel interaction system are kept in the most suitable positions, user experience is improved, virtual reality immersion is enhanced, and through cooperation of the plurality of channels of vision, hearing, touch and smell, a user obtains an experience effect which is more similar to a real environment.
Drawings
The foregoing and other features of the present disclosure will become more apparent from the detailed description of the embodiments shown in conjunction with the drawings in which like reference characters designate the same or similar elements throughout the several views, and it is apparent that the drawings in the following description are merely some examples of the present disclosure and that other drawings may be derived therefrom by those skilled in the art without the benefit of any inventive faculty, and in which:
fig. 1 is a flowchart illustrating a virtual-real fusion simulation experiment multi-channel interaction method and system according to the present disclosure;
fig. 2 is a block diagram of a virtual-real fusion simulation experiment multi-channel interactive system according to the present disclosure.
Detailed Description
The conception, specific structure and technical effects of the present disclosure will be clearly and completely described below in conjunction with the embodiments and the accompanying drawings to fully understand the objects, aspects and effects of the present disclosure. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Fig. 1 is a schematic diagram illustrating a virtual-real fusion simulation experiment multi-channel interaction method and a system workflow diagram according to the present disclosure, fig. 2 is a schematic diagram illustrating a virtual-real fusion simulation experiment multi-channel interaction system module architecture, and a special equipment management method according to the present disclosure is described below with reference to fig. 1 and fig. 2.
The utility model provides a virtual-real fusion simulation experiment multi-channel interaction method and system, which comprises the following steps:
step 1, initializing a multi-channel interactive system, and connecting control terminal equipment with a controller;
step 2, establishing pose equations of a temperature sensing control subsystem, an olfactory control subsystem, a vibration control subsystem and a stereo sound effect subsystem;
and 3, calculating and adjusting the poses of the temperature sensing control subsystem, the smell control subsystem, the vibration control subsystem and the stereo sound effect subsystem through a pose equation.
Further, in step 1, the multichannel interactive system comprises a temperature sensing control subsystem, an olfactory control subsystem, a stereo sound subsystem, a vibration control subsystem, a controller, a control terminal device, a first connecting rod, a second connecting rod, a third connecting rod, a fourth connecting rod, a first motor, a second motor, a third motor and a fourth motor; the vibration control subsystem is connected with the temperature sensing control subsystem through a first connecting rod, the temperature sensing control subsystem is connected with the smell control subsystem through a second connecting rod, the smell control subsystem is connected with the stereo sound effect subsystem through a third connecting rod, and the stereo sound effect subsystem is connected with the motor through a fourth connecting rod; a first angular displacement sensor and a first motor are arranged at the connection part of the first connecting rod and the temperature sensing control subsystem; a second angular displacement sensor and a second motor are arranged at the connection part of the second connecting rod and the olfactory control subsystem; a third angular displacement sensor and a third motor are arranged at the connection part of the third connecting rod and the stereo sound effect subsystem; the fourth motor is connected with the fourth motor, and the first motor, the second motor, the third motor and the fourth motor are respectively used for rotating the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod to adjust the pose.
Hereinafter, the temperature sensing control subsystem, the smell control subsystem, the stereo sound subsystem and the vibration control subsystem are collectively called subsystems, and the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod are collectively called connecting rods; the first motor, the second motor, the third motor and the fourth motor are collectively called as motors; the adjusting positions of the first motor, the second motor, the third motor and the fourth motor respectively correspond to the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod; when any one of the connecting rods is adjusted by the motor, the corresponding connecting rod is adjusted by the motor.
Further, in step 2, the method for establishing the pose equations of the temperature sensing control subsystem, the olfactory control subsystem, the vibration control subsystem and the stereo sound effect subsystem comprises the following steps: the lengths of the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod are respectively l1,l2,l3,l4Calculating the pose equation of the subsystem according to the length of each connecting rod and the angular displacement of the motor corresponding to the connecting rod,
x=l1sinθ1+l2sin(θ12)+l3sin(θ123)+l4sin(θ1234) (1)
y=l1cosθ1+l2cos(θ12)+l3cos(θ123)-l4cos(θ1234) (2)
θ′=θ1234-180° (3)
the angular displacement is the angular displacement theta of the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod measured by the angular displacement sensori(i=1,2,3,4)。
Further, in step 3, the method for calculating and adjusting the poses of the temperature sensing control subsystem, the olfactory control subsystem, the vibration control subsystem and the stereo sound effect subsystem through the pose equation comprises the following steps:
establishing a pose adjustment model of each subsystem through a pose equation:
Figure BDA0002124726120000061
Figure BDA0002124726120000062
Figure BDA0002124726120000063
ai(i-1, …, 4) is the tie rod length,
Figure BDA0002124726120000064
angular displacement for adjusting the position and attitude of the connecting-rods, i.e. by
Figure BDA0002124726120000071
Carrying out pose adjustment to achieve a proper pose;
Figure BDA0002124726120000072
Figure BDA0002124726120000073
Figure BDA0002124726120000074
wherein:
Figure BDA0002124726120000075
the positions and postures of the temperature sensing control subsystem, the smell control subsystem, the vibration control subsystem and the stereo sound effect subsystem are obtained from the above, start-stop signals and forward and reverse rotation signals are sent out, and the corresponding connecting rods are adjusted by the motors to carry out angular displacement
Figure BDA0002124726120000076
Rotating, namely adjusting the angles of the temperature sensing control subsystem, the smell control subsystem, the vibration control subsystem and the stereo sound effect subsystem so as to adjust the pose, wherein when a start-stop signal received by the motor is at a high level, the motor rotates, otherwise, the motor stops; when the positive and negative rotation signals received by the motor are high level, the motor rotates positively, otherwise, the motor rotates negatively.
The multichannel interaction system comprises a temperature sensing control subsystem, an olfactory control subsystem, a stereo sound effect subsystem, a vibration control subsystem, a controller, control terminal equipment, a first connecting rod, a second connecting rod, a third connecting rod, a fourth connecting rod, a first motor, a second motor, a third motor and a fourth motor; the vibration control subsystem is connected with the temperature sensing control subsystem through a first connecting rod, the temperature sensing control subsystem is connected with the smell control subsystem through a second connecting rod, the smell control subsystem is connected with the stereo sound effect subsystem through a third connecting rod, and the stereo sound effect subsystem is connected with the motor through a fourth connecting rod; a first angular displacement sensor and a first motor are arranged at the connection part of the first connecting rod and the temperature sensing control subsystem; a second angular displacement sensor and a second motor are arranged at the connection part of the second connecting rod and the olfactory control subsystem; a third angular displacement sensor and a third motor are arranged at the connection part of the third connecting rod and the stereo sound effect subsystem; the fourth motor is connected with the fourth motor, and the first motor, the second motor, the third motor and the fourth motor are respectively used for rotating the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod to adjust the pose.
Furthermore, the temperature-sensing control subsystem at least comprises a temperature and humidity sensor, a heating module, a refrigerating module, a humidifying module and a plurality of relays; the environment temperature and humidity are collected by a controller through a temperature and humidity sensor, and are regulated by a heating, refrigerating and humidifying device controlled by a relay in real time in the experimental process by using a closed-loop control mode and combining a PID (proportion integration differentiation) controller; heating, cooling and humidifying devices include, but are not limited to, air conditioners.
Furthermore, the smell control subsystem at least comprises a steering engine, an atomizing sheet driver, an atomizing sheet and a blower; in the experimentation, when using the apparatus or the material that have the smell, control terminal sends the instruction to the controller, and the controller selects different smell reagents through the rotation of control steering wheel, and the rethread atomizing piece atomizes the smell reagent to the air is gived off to the control air-blower with the smell.
Further, the vibration control subsystem includes at least a motor drive plate, one or more vibration motors; according to the experimental effect and physical collision, the vibration effect is simulated and generated, such as horizontal projectile motion experiment, inclined plane trolley sliding friction vibration and the like in the physical experiment.
Furthermore, the stereo sound effect subsystem at least comprises a key, a Bluetooth module, a sound device and a virtual reality head-mounted display device (VR head display); realize the bluetooth speaker effect, functions such as virtual button or entity button control volume, broadcast in the accessible VR experimental scene.
Further, the controller includes but is not limited to any one of an ARM microcontroller, a 51-series single chip microcomputer, a TMS320F2812 control chip, an LPC 2100-series chip, an 8051-series chip, and a DSP56F 800-series control chip.
Further, the control terminal device includes but is not limited to a PC, a tablet computer, a mobile phone, etc., and is connected with the controller through bluetooth, zigbee, and wired communication.
The virtual-real fusion simulation experiment multi-channel interaction method and system can be operated in computing equipment such as desktop computers, notebooks, palm computers and cloud servers. The device in which the virtual-real fusion simulation experiment multi-channel interaction method and system can be operated can comprise, but not limited to, a processor and a memory. It will be understood by those skilled in the art that the example is only an example of the virtual-real fusion simulation experiment multi-channel interaction method and system, and does not constitute a limitation to the virtual-real fusion simulation experiment multi-channel interaction method and system, and may include more or less components than the actual one, or combine some components, or different components, for example, the virtual-real fusion simulation experiment multi-channel interaction method and system may further include an input-output device, a network access device, a bus, and the like.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general processor can be a microprocessor or the processor can also be any conventional processor and the like, the processor is a control center of the virtual-real fusion simulation experiment multi-channel interaction method and system operation device, and various interfaces and lines are utilized to connect all parts of the whole virtual-real fusion simulation experiment multi-channel interaction method and system operation device.
The memory can be used for storing the computer program and/or the module, and the processor realizes various functions of the virtual-real fusion simulation experiment multi-channel interaction method and system by running or executing the computer program and/or the module stored in the memory and calling data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
While the present disclosure has been described in considerable detail and with particular reference to a few illustrative embodiments thereof, it is not intended to be limited to any such details or embodiments or any particular embodiments, but it is to be construed as effectively covering the intended scope of the disclosure by providing a broad, potential interpretation of such claims in view of the prior art with reference to the appended claims. Furthermore, the foregoing describes the disclosure in terms of embodiments foreseen by the inventor for which an enabling description was available, notwithstanding that insubstantial modifications of the disclosure, not presently foreseen, may nonetheless represent equivalent modifications thereto.

Claims (7)

1. A multi-channel interaction method for a virtual-real fusion simulation experiment is characterized by comprising the following steps:
step 1, initializing a multi-channel interactive system, and connecting control terminal equipment with a controller;
step 2, establishing pose equations of a temperature sensing control subsystem, an olfactory control subsystem, a vibration control subsystem and a stereo sound effect subsystem;
calculating and adjusting the poses of the temperature sensing control subsystem, the smell control subsystem, the vibration control subsystem and the stereo sound effect subsystem through a pose equation;
in the step 1, the multichannel interaction system comprises a temperature sensing control subsystem, an olfactory control subsystem, a stereo sound effect subsystem, a vibration control subsystem, a controller, control terminal equipment, a first connecting rod, a second connecting rod, a third connecting rod, a fourth connecting rod, a first motor, a second motor, a third motor and a fourth motor; the vibration control subsystem is connected with the temperature sensing control subsystem through a first connecting rod, the temperature sensing control subsystem is connected with the smell control subsystem through a second connecting rod, the smell control subsystem is connected with the stereo sound effect subsystem through a third connecting rod, and the stereo sound effect subsystem is connected with the motor through a fourth connecting rod; a first angular displacement sensor and a first motor are arranged at the connection part of the first connecting rod and the temperature sensing control subsystem; a second angular displacement sensor and a second motor are arranged at the connection part of the second connecting rod and the olfactory control subsystem; a third angular displacement sensor and a third motor are arranged at the connection part of the third connecting rod and the stereo sound effect subsystem; the fourth motor is connected with the fourth motor, and the first motor, the second motor, the third motor and the fourth motor are respectively used for rotating the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod to adjust the pose.
2. A multi-channel interactive system for a virtual-real fusion simulation experiment is characterized by comprising a temperature sensing control subsystem, an olfactory control subsystem, a stereo sound effect subsystem, a vibration control subsystem, a controller, control terminal equipment, a first connecting rod, a second connecting rod, a third connecting rod, a fourth connecting rod, a first motor, a second motor, a third motor and a fourth motor; the vibration control subsystem is connected with the temperature sensing control subsystem through a first connecting rod, the temperature sensing control subsystem is connected with the smell control subsystem through a second connecting rod, the smell control subsystem is connected with the stereo sound effect subsystem through a third connecting rod, and the stereo sound effect subsystem is connected with the motor through a fourth connecting rod; a first angular displacement sensor and a first motor are arranged at the connection part of the first connecting rod and the temperature sensing control subsystem; a second angular displacement sensor and a second motor are arranged at the connection part of the second connecting rod and the olfactory control subsystem; a third angular displacement sensor and a third motor are arranged at the connection part of the third connecting rod and the stereo sound effect subsystem; the fourth motor is connected with the fourth motor, and the first motor, the second motor, the third motor and the fourth motor are respectively used for rotating the first connecting rod, the second connecting rod, the third connecting rod and the fourth connecting rod to adjust the pose.
3. The multi-channel interactive system for the virtual-real fusion simulation experiment of claim 2, wherein the temperature-sensing control subsystem at least comprises a temperature and humidity sensor, a heating module, a refrigerating module, a humidifying module and a plurality of relays; the environment temperature and humidity are collected through a temperature and humidity sensor by adopting a controller, and the environment temperature and humidity are regulated by controlling a heating device, a refrigerating device and a humidifying device through a relay in real time in an experimental process by using a closed-loop control mode and combining a PID (proportion integration differentiation) controller.
4. The virtual-real fusion simulation experiment multichannel interaction system according to claim 2, wherein the olfactory control subsystem at least comprises a steering engine, an atomizing sheet driver, an atomizing sheet and a blower.
5. The virtual-real fusion simulation experiment multichannel interactive system according to claim 2, wherein the vibration control subsystem at least comprises a motor driving board and one or more vibration motors.
6. The virtual-real fusion simulation experiment multichannel interaction system as claimed in claim 2, wherein the stereo sound effect subsystem at least comprises a key, a bluetooth module, a sound device, and a virtual-real head-mounted display device.
7. The virtual-real fusion simulation experiment multichannel interactive system as claimed in claim 2, wherein the controller includes but is not limited to any one of an ARM microcontroller, a 51-series single chip microcomputer, a TMS320F2812 control chip, an LPC 2100-series chip, an 8051-series chip, and a DSP56F 800-series control chip.
CN201910618413.9A 2019-07-10 2019-07-10 Virtual-real fusion simulation experiment multi-channel interaction method and system Active CN110427103B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910618413.9A CN110427103B (en) 2019-07-10 2019-07-10 Virtual-real fusion simulation experiment multi-channel interaction method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910618413.9A CN110427103B (en) 2019-07-10 2019-07-10 Virtual-real fusion simulation experiment multi-channel interaction method and system

Publications (2)

Publication Number Publication Date
CN110427103A CN110427103A (en) 2019-11-08
CN110427103B true CN110427103B (en) 2022-04-26

Family

ID=68409155

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910618413.9A Active CN110427103B (en) 2019-07-10 2019-07-10 Virtual-real fusion simulation experiment multi-channel interaction method and system

Country Status (1)

Country Link
CN (1) CN110427103B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111009158B (en) * 2019-12-18 2020-09-15 华中师范大学 Virtual learning environment multi-channel fusion display method for field practice teaching

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102592484A (en) * 2010-11-16 2012-07-18 韩国电子通信研究院 Reconfigurable platform management apparatus for virtual reality-based training simulator
CN105344101A (en) * 2015-11-19 2016-02-24 广州玖的数码科技有限公司 Frame and mechanical motion synchronization simulation racing car equipment and simulation method
CN106095108A (en) * 2016-06-22 2016-11-09 华为技术有限公司 A kind of augmented reality feedback method and equipment
CN206167874U (en) * 2016-09-08 2017-05-17 微美光速资本投资管理(北京)有限公司 Virtual reality game machine
CN207924671U (en) * 2018-03-07 2018-09-28 赵莉莉 Based on manipulate dynamics High Precision Simulation simulator and with its simulation model
CN109951718A (en) * 2019-04-11 2019-06-28 李蕴梅 A method of it can 360 degree of panorama captured in real-time live streamings by 5G and VR technology

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10630873B2 (en) * 2017-07-27 2020-04-21 Command Sight, Inc. Animal-wearable first person view system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102592484A (en) * 2010-11-16 2012-07-18 韩国电子通信研究院 Reconfigurable platform management apparatus for virtual reality-based training simulator
CN105344101A (en) * 2015-11-19 2016-02-24 广州玖的数码科技有限公司 Frame and mechanical motion synchronization simulation racing car equipment and simulation method
CN106095108A (en) * 2016-06-22 2016-11-09 华为技术有限公司 A kind of augmented reality feedback method and equipment
CN206167874U (en) * 2016-09-08 2017-05-17 微美光速资本投资管理(北京)有限公司 Virtual reality game machine
CN207924671U (en) * 2018-03-07 2018-09-28 赵莉莉 Based on manipulate dynamics High Precision Simulation simulator and with its simulation model
CN109951718A (en) * 2019-04-11 2019-06-28 李蕴梅 A method of it can 360 degree of panorama captured in real-time live streamings by 5G and VR technology

Also Published As

Publication number Publication date
CN110427103A (en) 2019-11-08

Similar Documents

Publication Publication Date Title
US10445939B2 (en) Tactile interaction in virtual environments
IL299278A (en) Methods and system for generating and displaying 3d videos in a virtual, augmented, or mixed reality environment
CN105611053A (en) Mobile robot control system based on smart phone
WO2017148410A1 (en) Information interaction method, device and system
CN111354434B (en) Electronic device and method for providing information thereof
CN106871333A (en) Method, the apparatus and system of a kind of scenery control air-conditioning in virtual world
CN105321201A (en) Cloud light baking-based mobile terminal 3D real-time rendering method and system
CN103258338A (en) Method and system for driving simulated virtual environments with real data
WO2020034863A1 (en) Display method and virtual reality device
CN108596827A (en) Three-dimensional face model generation method, device and electronic equipment
CN110427103B (en) Virtual-real fusion simulation experiment multi-channel interaction method and system
CN108548300A (en) Air-conditioning method and device, electronic equipment
CN110249626A (en) Implementation method, device, terminal device and the storage medium of augmented reality image
CN105571052A (en) Path setting executing method, control method and system for intelligent terminal air equipment
CN109829982B (en) Model matching method, device, terminal equipment and storage medium
CN113119098A (en) Mechanical arm control method, mechanical arm control device and terminal equipment
WO1995035140A1 (en) Method of and apparatus for controlling direction of object
CN106095271A (en) Method of adjustment and the electric terminal of angle play by a kind of file
CN108490832A (en) Method and apparatus for sending information
US20210268373A1 (en) Force feedback to improve gameplay
EP3261737B1 (en) Modifying haptic effects for slow motion
CN105261041A (en) Information processing method and electronic device
Deng et al. A motion sensing-based framework for robotic manipulation
CN106779047B (en) A kind of information processing method and device
CN111353941A (en) Space coordinate conversion method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant