TWI814486B - Somatosensory generation system with temperature control effect - Google Patents

Abstract

A somatosensory generation system with temperature control effect, which mainly includes: an integrated sensory effect controller used to access built-in audio or control signals in games, movies, AR/VR, or application software, and an integrated sensory effect conversion device to convert the audio or control signals The signal is converted into a dedicated signal output corresponding to the action or event to drive at least one body sensing effect device. The vehicle is provided with a plurality of staggered body sensing sensors to correspond to the parts close to the human body's torso and limbs. Each body sensing sensor In addition to receiving the exclusive signal of the action or event to generate the corresponding specific waveform and amplitude, it is also equipped with a heating device that can generate corresponding instantaneous heating corresponding to the action or event, so that it can truly reflect the development of the scene content and the audio and video of the character's movements. The effect is to instantly generate immersive somatosensory and tactile feedback that synchronizes waveform amplitude and temperature, greatly improving the fidelity of real-life effects in games, movies, AR/VR, or application software, and effectively enhancing the immersive presence of user experience.

Description

Somatosensory generation system with temperature control effect

The present invention relates to the technical field of somatosensory feedback, and in particular, to a somatosensory generating system with a temperature control effect.

With the advancement and development of science and technology, the somatosensory feedback technology of human-computer interaction can add interactive effects on the basis of film and vision, and is effectively combined and used in dynamic movies and dynamic games. Somatosensory, also known as somatosensory, is a general term for touch, pressure, temperature, pain and proprioceptive physiological sensations. For example, early IMAX movies used a huge screen with specially designed 4D seats, which vibrated, tilted, and rocked according to the development of the movie plot, allowing people to immerse themselves in the movie characters during the viewing process, creating a special immersive, realistic and thrilling experience.

In recent years, game consoles, AR/VR and computer 3D image processing technology have made great progress. In order to provide players with more realistic sensory stimulation, tactile sensations have been added to game control interfaces such as mice, joysticks, steering wheels, etc. The feedback (haptic feedback) project allows the game to simultaneously generate relative vibrations in response to actions or events and transmit them to the player's wrist, strengthening sensory stimulation and improving the fidelity of game operation simulation.

Most of the current somatosensory feedback devices use single-frequency left-right vibration eccentric motors to achieve somatosensory vibrations. Although they can be used in conjunction with relevant scenes in movies or games, commands can be used to transmit the drive motor vibrations to enhance the realism of audio-visual actions or events. However, its structural design can only generate vibration through the left and right swing of the eccentric motor and cannot achieve the effect of replicating the real body feeling. At the same time, it cannot achieve the temperature sensation and touch effect of the object, so it cannot effectively simulate the scene content and truly reflect it on the player.

In addition, most of the somatosensory vibrators on current somatosensory feedback devices are single or several. For example, they can only produce vibrations in certain areas of the body. There are few effect points, the realism that can be achieved is limited, and the vibration provided is limited. The effect is limited to a single frequency vibration, and the vibration intensity is designed to only provide the most basic size adjustment settings for certain actions or events.

When used, each somatosensory feedback device must be set independently. It lacks compatibility and cannot cooperate with somatosensory feedback devices in other parts of the body for collaborative sensing. It cannot be developed and applied in conjunction with plot content. For example, when a bullet penetrates the chest and back, The magnitude of the force, sequence, and path changes of the reaction points in various parts of the body, etc., personally do not feel the realism of the application. Of course, it cannot provide an immersive experience in large-scale combat games where the power of simulated bomb explosions spreads in all directions, and multiple people can experience different wave amplitudes at different locations, resulting in technical problems such as insufficient authenticity and effectiveness of somatosensory simulation.

In view of this, the main purpose of the present invention is to provide a somatosensory generating system with a temperature control effect. The best implementation of this system is mainly installed on wearable items, such as vests, bottoms, or one-piece body suits. Body Suit), etc., or seats, etc., but are not actually limited to this. The system mainly includes: an integrated sense effect controller, an integrated sense effect conversion device, and at least an integrated sense effect device; wherein the somatosensory effect controller provides package software through API (application programming interface) "application programming interface" or SDK (Software Development Kit) "software development tool kit" interface allows developers of games, movies, AR (Augmented Reality)/VR (virtual reality), or application software to convert their audio effects into Write and input the audio or control command signal generated by the exclusive signal corresponding to the audio action or event into the somatosensory effect controller, and transmit it to the somatosensory effect conversion device in a wired or wireless manner; The somatosensory effect conversion device has a built-in DSP digital signal processor, which is responsible for decoding the control command signal and converting it into the corresponding somatosensory wave type, amplitude, position, temperature, etc., and driving the somatosensory effect device through the somatosensory response device; The sensing effect device is provided with a plurality of staggered somatosensory sensors to correspond to the parts close to the human body's trunk and limbs. Each somatosensory sensor is composed of a lower shell, a built-in T-iron, and an upper cover. The upper cover A cylindrical upper winding coil is protruding from the inside of the body to be placed in the groove of the T-iron, so that the somatosensory sensor receives the exclusive signal of the action or event and generates the corresponding waveform and amplitude; at the same time, the upper cover is provided with a heating device Produce corresponding instantaneous heating with a dedicated signal corresponding to the action or event.

In a preferred implementation, the somatosensory effect device is further a piece of clothing, a seat, or a combination of a seat and clothing, but is not limited to this.

In a preferred implementation, the somatosensory effect conversion device can be driven by dual modes of Audio audio or command data, but it is not limited to this in practice.

In this way, when the motion-sensing effect controller is connected to the built-in audio or control signal of a game, movie, AR/VR, or application software, it can correspondingly provide a dedicated signal output for the action or event to drive the motion-sensing effect device. A plurality of staggered somatosensory sensors are used to receive the exclusive signal of the action or event to generate a corresponding specific waveform and amplitude; and a heating device is installed on them to generate corresponding instantaneous heating in response to the action or event, so that it can Audio and video effects that truly reflect the content of the scene and the actions of the characters can instantly produce immersive somatosensory feedback, such as touching, fighting, shooting, blasting, etc., and produce different corresponding vibration or heat effects on the torso and limbs of the human body. The conduction expansion highlights its reaction point distribution, waveform mode, force intensity, duration, diffusion mode, and diffusion range, etc., thereby greatly improving the fidelity of real-life effects in games, movies, or application software, and effectively enhancing the immersion of the user experience. Sense of presence.

100: Somatosensory generation system with temperature control effect

1: Somatosensory effect controller

10: Control command output module

11: Packaged software

101: Controller ID command output control

102: Somatosensory effect conversion device ID command output control

103: Timestamp instruction output control

104: Motion sensor ID command output control

105: Waveform mode command output control

106: Vibration series command output control

107: Temperature series command output control

2: Somatosensory effect conversion device

211:Audio signal receiver

212:A/D linear digital signal converter

213:Integrated circuit built-in audio bus

214: Command instruction receiver

215:Serial bus

221:Audio output splitter

222:OP operational amplifier

223: Thermal reaction temperature control output device

25:DSP digital signal processor

26:Memory

3: Somatosensory effect device

30: Motion sensor

31: Lower shell

32: Built-in T iron

33: Upper cover body

34:Cylinder

35: coil

36:Heating device

310: Clothes

320: Seat

330:Cushion

Figure 1 is a configuration diagram of the system of the present invention.

Figure 2 is a three-dimensional exploded view of the somatosensory sensor of the present invention.

Figure 3 is a combined cross-sectional view of the somatosensory sensor of the present invention.

Figure 4 is a block diagram of the system of the present invention.

Figure 5 is a schematic diagram of the clothes with the somatosensory effect device of the present invention.

Figure 6 is a schematic diagram of the somatosensory effect device seat of the present invention.

Figure 7 is a schematic diagram of the combination of the seat and clothes of the somatosensory effect device of the present invention.

In order to facilitate the understanding of the content of the present invention and the effects that can be achieved, specific embodiments are listed in conjunction with the drawings, and the detailed description is as follows: Please refer to Figures 1 to 4, a body with a temperature control effect provided by the present invention. The sense generating system 100 mainly includes: an integrated sense effect controller 1, an integrated sense effect conversion device 2, and at least an integrated sense effect device 3; wherein the somatosensory effect controller 1 provides package software 11 through API or SDK (Software Development Kit) ) interface method allows developers of games, movies, AR/VR, or application software to write their audio special effects, and the audio or control command signals generated by the exclusive signals corresponding to audio actions or events are transmitted to playback devices such as audio and video players, Computers, PCs, game consoles, etc. are connected in a wired manner, and their output terminals are wired, such as using but not limited to USB Type C interface, or wireless transmission methods to provide A dedicated signal output corresponding to an action or event of audio stream or control command (command data) is connected to drive the somatosensory effect conversion device 2; the somatosensory effect conversion device 2 has a built-in DSP digital signal processor 25 responsible for The control command signal is decoded and converted into the corresponding somatosensory wave type, amplitude, position, temperature, etc., and is used to drive the somatosensory effect device 3 through the somatosensory response device; the somatosensory effect device 3 is provided with a plurality of staggered somatosensory sensors 30 , corresponding to the parts that are close to the human body's trunk and limbs. Each somatosensory sensor 30 is composed of a lower housing 31, a built-in T-iron 32, and an upper cover 33, wherein a cylinder 34 is protruding on the inside of the upper cover 33. The winding coil 35 is placed in the groove of the T-iron 32 so that the body sensor 30 receives the exclusive signal of the action or event and generates a corresponding waveform and amplitude; at the same time, a heating device 36 is provided on the upper cover 33 to Exclusive signals for actions or events should produce corresponding instantaneous heating.

In a preferred implementation, the heating device 36 is composed of a heating wire or a graphene electric heating sheet, but it is not limited to this in practice.

In a preferred implementation, as shown in Figures 5 to 7, the somatosensory effect device 3 is further a piece of clothing 310, a seat 320, or a combination of a seat 320 and clothing 310, but is not limited to this. .

In a preferred implementation, as shown in Figure 1, the somatosensory effect device 3 is further attached with a pillow 330, which is also provided with a plurality of staggered somatosensory sensors 30 so that the user can place it on a seat or sofa. Provides somatosensory feedback on the back.

A preferred implementation is as shown in Figures 1 and 4, in which the somatosensory effect conversion device 2 further has a DSP digital signal processor 25 connected to a memory 26, which has built-in dedicated signals for multiple actions or events. , including at least WAV, MP3, or MID with output waveforms of different action or event types When playing sound effects, the exclusive signal length of each action or event is between 50ms and 2000ms but is not limited, corresponding to the somatosensory feedback effects of different audio and video actions or events.

In a preferred implementation, the present invention is designed to provide a package software 11 for the somatosensory effect controller 1, which can provide tabular menu check settings for each action or event, so that a plurality of somatosensory sensors 30 can be driven simultaneously when acting, but each other's reaction points Parameters such as distribution, waveform mode, force intensity, time length, diffusion mode, and diffusion range are controlled differently, so that it can realize human body dynamics reproduction or simulation according to the action or event plot content, which basically includes at least: the feeling of objects moving on human skin Touch temperature information and its code, movement information and code of the relationship between human body position changes and force, and vibration information and code of the feeling of an object emitting vibration and acting on the human body, such as touch, fighting, shooting, huge The vibration of blasting sounds, etc., but is not limited to this in practice.

In a preferred implementation, the somatosensory effect conversion device 2 can be a wired or wireless dual-mode input, and its input end has at least one audio signal receiver 211 connected to an A/D linear digital signal converter 212 to convert the analog signal into The first signal source fed by the built-in audio bus 213 of the I ² S digital integrated circuit can receive the somatosensory feedback effect corresponding to the action or event according to the plot development of the audio-visual story, such as fighting, shooting, blasting, etc., but it is not actually Not limited to this. And a second signal source fed by a command receiver 214 through an I ² C or SPI serial bus 215, so that it can receive operation commands from audio and video players, computers, PCs, game consoles, etc. Somatosensory feedback relative to actions or events, such as touch, punch, shooting reaction force, etc., but is not limited to this in practice.

In a preferred implementation, the output end of the somatosensory effect conversion device 2 has an audio output distributor 221, which is linearly connected to the DSP digital signal processor 25, and drives the plurality of somatosensory sensors 30 with corresponding outputs through a plurality of OP operational amplifiers 222, And a thermal reaction temperature control output device 223 drives each heating device 36 on the plurality of somatosensory sensors 30 with a corresponding output to generate corresponding instantaneous heating.

In a preferred implementation, the somatosensory effect controller 1 further builds a control command output module 10. The module receives the transmitted control command packet content, which at least includes: a controller ID command output control 101, a sense of unity Effect conversion device ID command output control 102, a time stamp command output control 103, an integrated sense sensor ID command output control 104, a waveform mode command output control 105, a vibration level command output control 106, and a temperature level command output Control 107.

In a preferred implementation, when the present invention is applied, the somatosensory effect controller 1 and the somatosensory effect conversion device 2 can be configured in one-to-one or one-to-many information connection. It is particularly worth mentioning that the somatosensory effect conversion device 2 of the present invention has a dual-mode design and can be driven in dual modes of general standard Audio audio or command data, and can be used for each action or event. The table format menu provides check settings so that multiple somatosensory sensors 30 can be driven simultaneously when activated, but each somatosensory sensor 30 has its own response point distribution, waveform mode, force intensity, time length, diffusion mode, and diffusion range. The parameter control commands can be different, and the application can truly reproduce actions or events according to the plot content, as well as the dynamic simulation of the response of time and space distance to human body feedback.

Thereby, as shown in Figures 1 to 7, when the somatosensory effect controller 1 is connected to audio or control signals from games, movies, AR/VR, or application software, it can output signals to the somatosensory effect in a wired or wireless manner. The conversion device 2 drives an exclusive signal corresponding to the action or event, receives the exclusive signal of the action or event through a plurality of staggered somatosensory sensors 30 and generates a corresponding specific waveform and amplitude; and is equipped with a heating device The device 36 can generate corresponding instantaneous heating corresponding to the action or event, so that it can truly reflect the scene content and audio-visual effects of the character's movements, and instantly generate immersive somatosensory feedback, such as: touching, fighting, shooting, blasting, etc., while being closely attached The human body's trunk and limbs produce different corresponding vibration or thermal effects respectively. The conduction expansion highlights its reaction point distribution, waveform mode, force intensity, time length, diffusion mode, and diffusion range, etc., thereby greatly improving games, movies, or Simulation of real-life effects using software Reality, for example, when a bullet penetrates the chest and back, the magnitude of the force, sequence, and path changes of the reaction points of various parts of the body, etc., or in large-scale combat games, the power of simulated bomb explosions spreads in all directions, and multiple people Different amplitudes are felt at different locations, effectively enhancing the immersive presence of the user experience.

To sum up, the invention is novel and practical and fully meets the patent requirements, and an invention patent application is filed. However, the above are only preferred embodiments of the present invention, and should not be used to limit the scope of the present invention; therefore, all equivalent changes and modifications made based on the patent scope of the present invention and the content of the creation specification shall be It is within the scope covered by the patent of this invention.

100: Somatosensory generation system with temperature control effect

1: Somatosensory effect controller

10: Control command output module

11: Packaged software

101: Controller ID command output control

102: Somatosensory effect conversion device ID command output control

103: Timestamp instruction output control

104: Motion sensor ID command output control

105: Waveform mode command output control

106: Vibration series command output control

107: Temperature series command output control

2: Somatosensory effect conversion device

3: Somatosensory effect device

30: Motion sensor

310: Clothes

320: Seat

330:Cushion

Claims (8)

A somatosensory generation system with temperature control effect, mainly including: an integrated feeling effect controller, an integrated feeling effect conversion device, and at least an integrated feeling effect device; wherein the somatosensory effect controller provides package software through an API (application programming interface) or SDK (Software Development Kit) interface, allowing developers of games, movies, AR (Augmented Reality)/VR (virtual reality), or application software to write their audio special effects and generate exclusive signals corresponding to audio actions or events. The audio or control command signal is input to the somatosensory effect controller and transmitted to the somatosensory effect conversion device in a wired or wireless manner; the somatosensory effect conversion device has a built-in DSP digital signal processor responsible for decoding the control command signal. And converted into corresponding somatosensory wave type, amplitude, position, temperature, etc., through the somatosensory response device to drive the somatosensory effect device; the somatosensory effect device is equipped with a plurality of staggered somatosensory sensors to correspond to the body feeling close to the human body. For the torso and limbs, each somatosensory sensor is composed of a lower shell, a built-in T-iron, and an upper cover. A cylindrical winding coil is protruding from the inside of the upper cover to be inserted into the groove of the T-iron. , so that the somatosensory sensor receives the exclusive signal of the action or event and generates a corresponding waveform and amplitude; at the same time, a heating device is provided on the upper cover to generate corresponding instantaneous heating corresponding to the exclusive signal of the action or event. The somatosensory generating system with temperature control effect as described in claim 1, wherein the somatosensory effect device is further a piece of clothing, a seat, or a combination of a seat and clothes. The somatosensory generating system with temperature control effect as described in claim 2, wherein the somatosensory effect device is further attached with a pillow on which are provided a plurality of staggered somatosensory sensors. As claimed in claim 1, the somatosensory generating system with temperature control effect, wherein the heating device is composed of a heating wire or a graphene electric heating sheet. As for the somatosensory generation system with temperature control effect described in claim 1, the somatosensory effect conversion device can be driven by dual modes of Audio audio or command data. As for the somatosensory generation system with temperature control effect described in claim 1, the somatosensory effect controller further builds a control command output module, and the module receives the transmitted control command packet content, which at least includes: A controller ID command output control, an integrated sensing effect conversion device ID command output control, a time stamp command output control, an integrated sensing sensor ID command output control, a waveform mode command output control, a vibration series command output control, and a Temperature series command output control. The somatosensory generation system with temperature control effect as described in claim 1, wherein the somatosensory effect conversion device further has a DSP digital signal processor connected to a memory, and the memory has dedicated signals for multiple actions or events, At least include WAV, MP3, or MID playback sound effects with output waveforms of different action or event types. The exclusive signal length of each action or event is between 50ms and 2000ms, corresponding to the somatosensory feedback of different audio and video actions or events; The somatosensory effect conversion device is a wired or wireless dual-mode driver, and its input end has at least one audio signal receiver connected to an A/D linear digital signal converter to convert analog signals into I ² S integrated circuit built-in audio A first signal source fed by the bus, and a second signal source fed by a command receiver via an I ² C or SPI serial bus; the output end of the somatosensory effect conversion device has at least one audio output distribution The device drives the plurality of somatosensory sensors through a plurality of OP operational amplifiers with corresponding outputs, and a thermal reaction temperature control output device drives each heating device on the plurality of somatosensory sensors with corresponding outputs to generate corresponding instantaneous heating. The somatosensory generation system with temperature control effect as described in claim 1, wherein the somatosensory effect controller and the somatosensory response effect conversion device are information-connected and provide check boxes in a table format menu for each action or event. Select settings so that multiple somatosensory sensors are driven simultaneously when acting, but each somatosensory sensor has its own response point distribution, waveform mode, force intensity, time length, and diffusion. Parameter control commands such as mode and diffusion range enable the real reproduction of actions or events according to the plot content, as well as the dynamic simulation of the response of time and space distance to human body feedback.

Images