WO2017059618A1

WO2017059618A1 - Method and device for simulating scenes

Info

Publication number: WO2017059618A1
Application number: PCT/CN2015/094405
Authority: WO
Inventors: 侯东风
Original assignee: 侯东风
Priority date: 2015-10-08
Filing date: 2015-11-12
Publication date: 2017-04-13
Also published as: CN105302299A

Abstract

Disclosed is a method for simulating scenes, the method comprising: acquiring any one or more types of information for describing the current scene; converting the any one or more types of information into dot-matrix signals; and controlling a vibrator array to vibrate according to the dot-matrix signals, so that a user can perceive the current scene. Also disclosed is a device for simulating scenes, the device processing information, such as picture, sound, video, light, action, environment, weather, emotion, feeling, and various processes, of an externally preset or an instant scene into dot-matrix signals, controlling each small tactile generation device in the vibrator array to vibrate, the vibration process and the touch process being felt by a user by means of the skin, thereby delivering the exact information of the current scene to the user, enabling the user, whose the eyes cannot see, to perceive the current environment in real time, so as to remind the user to ward off a danger.

Description

Method and device for simulating a scene

Technical field

The present invention relates to intelligent technologies, and in particular, to a method and apparatus for simulating a scene.

Background technique

At present, people's lives have been improved by various smart technologies. The smart terminal can perceive the person's behavior, actions and even emotions through various sensors, and then perform corresponding operations based on the person's behavior, action or current mood, such as playing the corresponding music, automatically opening the related application, and the like.

Although smart technology has penetrated into every aspect of people's lives, there is no way or product that allows people to sense the current environment in real-time without their eyes, to help people avoid dangers, take timely protective measures or Defence, for example, the fighter pilot's tumbling and lifting action in the air is blinded by sudden acceleration and sudden overload. At this time, it is impossible to know the specific direction of the aircraft in the sky, the direction of the nose, the speed of flight, and whether there is any in front. Obstacle, etc., in this case, a method is needed to enable the pilot to sense the current scene in real time through the sense of body, to avoid danger and adjust the flight speed and flight direction of the aircraft in time.

Summary of the invention

In order to solve the existing technical problems, the embodiments of the present invention provide a method and an apparatus for simulating a scenario.

To achieve the above objective, the technical solution of the embodiment of the present invention is implemented as follows:

A method of simulating a scene, the method comprising:

Obtaining any one or more kinds of information used to describe the current scene;

Converting any one or more of the information into a lattice signal;

The control vibrator array vibrates according to the lattice signal so that the user can perceive the current scene.

The information for describing the current scene includes: scene information, and/or sound information, and/or weather information, and/or motion track information of a person or an animal, and/or user emotion feature information, and/or Or preset scene information.

Wherein the method comprises:

Collecting scene information, sound information, motion track information of a person or an animal, and/or emotional feature information of the user;

Converting the scene information, the sound information, the motion track information, and/or the emotion feature information into a lattice signal, respectively;

The control vibrator array vibrates in accordance with the lattice signal such that the user can perceive the scene, sound, motion trajectory and/or own emotional state of the current scene.

The method includes: collecting weather information of a current scene; generating a lattice signal corresponding to the weather information according to a preset configuration; and controlling the vibrator array to vibrate according to the lattice signal, so that the user can perceive the current scene. the weather.

The method includes: acquiring preset scene information currently selected by the user; generating a corresponding dot matrix signal corresponding to the preset scene information according to the preset configuration; and controlling the vibrator array to vibrate according to the lattice signal, so that The user can perceive the preset scene.

An apparatus for simulating a scene, the apparatus comprising:

a signal converter for converting any one or more kinds of information used to describe the current scene into a lattice signal and transmitting the signal to the controller;

a controller, configured to control each tactile sensation device of the vibrator array to vibrate according to a lattice signal transmitted by the signal converter;

The vibrator array includes a plurality of regularly arranged haptic generating devices.

The device further includes: an collecting device, configured to collect any one or more kinds of information used to describe the current scene.

The collection device includes: a video collection device, an audio collection device, an action track collection device, and/or a character emotion feature collection device, and/or a touch device.

Wherein, the vibrator array comprises a plurality of rectangularly arranged tactile sense devices.

Wherein, the carrier of the vibrator array is a garment.

An embodiment of the present invention further provides a method for simulating a scenario, including:

Obtain environmental information;

Generating a lattice signal simulating the environmental information according to a preset conversion manner;

According to the lattice signal, the target haptic generating device that controls the corresponding position performs vibration, the target haptic generating device is plural, and a plurality of the target haptic generating device arrays are patterned in the same pattern as the environmental information.

Preferably, the obtaining the environmental information in the step includes:

Get an image of the current scene;

Performing binarization processing on the image of the current scene to generate a binary image;

Find the light and dark boundary line in the binary image as the environmental information, or find the bright area in the binary image as the environmental information, or find the dark area in the binary image as the environmental information.

Preferably, the step of converting the environmental information into a lattice signal according to a preset conversion manner includes:

A dot matrix signal is generated according to the image boundary of the current scene according to the light and dark boundary line, and the shape of the pattern formed by the plurality of target haptic generating devices corresponding to the position of the dot matrix signal is the same as the shape of the light and dark boundary line.

Preferably, the obtaining the environmental information in the step includes:

The obtained force position information of the current scene and the force degree information corresponding to each force position are taken as the environmental information.

Generating a lattice signal according to the force position information, and a shape of a pattern formed by the plurality of target haptic generating devices corresponding to the position of the lattice signal is the same as a shape of a graphic corresponding to the force position information;

The vibration intensity information of the target haptic generating device corresponding to each lattice signal is calculated according to the stress degree information corresponding to each acceptance position.

Preferably, the step of controlling the target haptic generating device at the corresponding position according to the lattice signal comprises:

Finding a target haptic generating device corresponding to the lattice signal;

According to the vibration intensity information of the target haptic generating device, a predetermined number of vibration units are simultaneously vibrated in the same target haptic generating device.

Preferably, before the step of controlling the corresponding position of the target haptic generating device to vibrate according to the lattice signal, the method further includes:

Get the tilt angle of the current scene;

According to the tilt angle, the dot matrix signal is adjusted such that the tilt angle of the pattern formed by the adjusted dot matrix signal is the same as the tilt angle of the current scene.

Embodiments of the present invention also provide a vibrating fabric using a method of simulating a scene, including:

A plurality of haptic generating devices and processors disposed in an array, the processors being electrically coupled to each of the haptic generating devices, respectively; the processor being operative to perform a method of simulating a scene.

Preferably, each of the haptic generating devices is composed of a plurality of vibration units, each of which is electrically connected to the processor.

Preferably, the plurality of vibration units of the same haptic generating device are sequentially disposed in the first direction.

Preferably, a gyroscope electrically connected to the processor is further included for acquiring an inclination angle of the current scene.

In addition, the method and device for simulating a scene in the embodiment of the present invention process information such as pictures, sounds, videos, lights, actions, environments, weather, emotions, feelings, various processes, etc. of external presets or instant scenes. The array signal controls each small tactile sensation device in the vibrator array to vibrate, thereby simulating and outputting various vibration conditions, thereby expressing images, directions, motions, spaces, positions, emotions, environments, and weather of various preset or instant scenes. , feelings, processes, etc., allowing the user to feel the vibration process and the touch process through the skin, thereby transmitting the exact information of the current scene, and also enabling the real-time perception of the current environment in the case where the eyes are not visible. To remind people to avoid danger.

DRAWINGS

In the drawings, which are not necessarily to scale, the Like reference numerals with different letter suffixes may indicate different examples of similar components. The drawings generally illustrate the various embodiments discussed herein by way of example and not limitation.

1 is a schematic flowchart of a method for simulating a scene according to an embodiment of the present invention;

2 is a schematic flowchart of a method for simulating a scene according to an embodiment of the present invention;

3 is a schematic view showing a vibration state of a vibrator array according to an embodiment of the present invention;

4 is a schematic flowchart of a method for simulating a scene according to Embodiment 2 of the present invention;

FIG. 5 is a schematic flowchart of a method for simulating a scenario according to Embodiment 3 of the present invention; FIG.

6 is a schematic flowchart of a method for simulating a scene according to Embodiment 4 of the present invention;

7 is a schematic flowchart of a method for simulating a scene according to Embodiment 5 of the present invention;

FIG. 8 is a schematic flowchart of a method for simulating a scene according to Embodiment 6 of the present invention; FIG.

FIG. 9 is a schematic structural diagram of a device for simulating a scene according to an embodiment of the present invention; FIG.

FIG. 10 is a schematic diagram of simulation of an electronic game scene according to an embodiment of the present invention; FIG.

FIG. 11 is a schematic diagram of a method for optimizing a simulated scene by using a gyroscope according to an embodiment of the present invention.

detailed description

The present invention provides a method and apparatus for simulating a scene, and controls the vibrator array to perform an orderly vibration so that the user can perceive various states of the corresponding scene through the sense of body. The vibrator array can include a plurality of closely arranged tactile stimulating devices that, when in use, abut the human body. After learning the relevant information of the current scene, it is converted into a lattice signal, and the vibrator array is controlled to vibrate according to the lattice signal, thereby simulating the current scene by the sense of body. The specific embodiment of the haptic generating device may be one of a plurality of types: a vibrator, a pressure device, a tightener, a gas pump, a heater, a refrigerator, an electric shock device, and a needle plucking device.

As shown in FIG. 1 , a method for simulating a scene by a body feeling according to an embodiment of the present invention is characterized in that: the method includes:

Step 101: Acquire any one or more kinds of information used to describe the current scene.

Here, the information for describing the current scene may include: scene information, and/or sound information, and/or weather information, and/or motion track information of a person or an animal, and/or user emotion feature information, and / or preset scene information.

Step 102: Convert any one or more kinds of information into a lattice signal;

Step 103: Control the vibrator array to vibrate according to the lattice signal, so that the user can perceive the current scene.

Embodiment 1

As shown in FIG. 2, the implementation process of the simulation scenario method in this embodiment may include the following steps:

Step 201: Collect video information of a current scene by using a video capture device such as a camera;

For example, when the current scene is a mountain view, the mountain view is photographed by a camera, and the video signal of the mountain view is wirelessly transmitted to the video signal converter.

Step 202: Convert the video information into a matrix signal by using a video signal converter;

Here, the video signal converter generates a plurality of vibration signals according to characteristics of each of the pixel regions in the mountain view, the plurality of vibration signals form the lattice signals, and each of the vibration signals corresponds to one tactile sensation device, each vibration The signal includes the frequency, amplitude, duration, and vibration time interval at which the haptic generating device operates.

For example, for mountain views, the lattice signal is such that the vibrator array can vibrate in the shape of a mountain view.

Specifically, there are two specific embodiments for converting the image of the current scene into environmental information. The first type is a line graphic as environmental information; the second type is a piece graph as environmental information. For a picture taken by a camera or a camera, after binarization, it is inevitably divided into two areas, light and dark, which may be interlaced. Then, in the interlaced position, a light-dark boundary is formed. For the first case, a line graph using such a light-dark boundary is used as the environmental information. For the second case, use a bright area (white area, brightness is 255) or dark area (brightness is 0) as environmental information.

For example, in the picture between the mountains and the sky, after binarization, the mountain is usually treated as a dark area, and the sky is treated as a bright area. Then the mountain can be used as environmental information or the sky as an environment according to predetermined regulations. Information can also be used as the environmental information in the picture, the edge of the mountain.

In use, the lattice signal is a trigger signal that controls the haptic generating device. The lattice signal can be understood as a signal carrying position information(s) of the haptic generating device that needs to be triggered, and working intensity information carrying the haptic generating device that needs to be triggered. The lattice signal can also be understood as a trigger signal similar to a high level, the trigger signal is a plurality, each trigger signal corresponds to a haptic generating device, and the haptic generating device starts to work after receiving the trigger signal.

Step 203: transmitting the lattice signal to the vibrator array through an electrical connection line;

In general, a plurality of haptic generating devices can be disposed on a carrier and arranged in accordance with certain rules to form an array of vibrators. For example, the plurality of haptic generating devices may be arranged in a rectangular shape on the carrier, and the material of the carrier may be selected according to requirements, and may be a soft material or a hard material.

Step 204: Each haptic generating device in the vibrator array vibrates according to a frequency, an amplitude, and the like set by the lattice signal, so that the user perceives the scene of the current scene through the vibration of each haptic generating device in the haptic generating device array. .

In practical applications, the vibrator array can be placed in close contact with the user's skin surface position, and when the vibrator array vibrates, the vibrations of the various tactile sense devices are used to make the user perceive the current scene. For example, for a mountain view, as shown in FIG. 3, each of the vibrating tactile sensation devices has a mountain view shape, just like a person draws a mountain view behind, so that the user perceives that the current scene is a mountain view.

The plurality of haptic generating devices are arranged in a predetermined manner, such as an array arrangement, a circular arrangement, and the like. The tactile sensation device controlled by the lattice signal is the target tactile sensation device. Target touch When the generating device is working, the pattern formed is the same as the pattern of the environmental information. Further, in this way, the user's external screen (the screen captured by the current camera) can be presented.

Embodiment 2

As shown in FIG. 4, the implementation process of the simulation scenario method in this embodiment may include the following steps:

Step 401: Collect audio information of a current scene through an audio collection device such as a microphone.

Step 402: Convert the audio information into a matrix signal by using a specific encoding program in the audio signal converter;

Here, the audio signal converter generates a plurality of vibration signals according to characteristics of each frequency band in the audio signal, the plurality of vibration signals forming the lattice signals, each vibration signal corresponding to one haptic generating device, each vibration signal The frequency, amplitude, duration, and vibration time interval when the tactile sensation device vibrates are included.

Step 403: transmitting the lattice signal to the vibrator array through an electrical connection line;

Step 404: each small tactile sensation device in the vibrator array vibrates according to a frequency, an amplitude, and the like set by the lattice signal, so that the user perceives the current scene through the vibration of each tactile sensation device in the tactile sensation device display. Sound condition.

In practical applications, the vibrator array can be placed in close contact with the user's skin surface position, and when the vibrator array vibrates, the vibrations of the various tactile sense devices are used to make the user feel the sound condition of the current scene. For example, when a fighter pilot makes a tumbling lift in the air due to sudden acceleration and sudden blinding, other flying objects are close to being incapable of sensing. Then, by collecting sounds from other flying objects, they can be converted into vibrations of the vibrator array, so that the pilot It is able to sense whether there are flying objects near and close to the speed and distance. Specifically, the amplitude of the vibrator array can be controlled according to the strength of the audio signal, so that the pilot can perceive the strength of the sound, thereby determining the distance between the flying object and itself, and the speed of the approaching and the like.

The step 401 is not the only way to obtain the audio information, that is, the audio information can be directly obtained, and the audio information may be collected by the audio collection device, or may be pre-generated. If you can obtain an audio file in advance, you can determine the audio by parsing the content of the audio file. Audio information of the file. When the target haptic generating device vibrates, the target haptic generating device can be adjusted in accordance with the fluctuation of the volume to form a pattern having a different height or a different size. That is, as the volume/tone is increased, the pattern formed by the target haptic generating device is enlarged; when the volume/tone is lowered, the pattern formed by the target haptic generating device is reduced. Alternatively, the pattern corresponding to different music may be agreed with the user in advance, for example, the first type of music may correspond to the pattern of the plum blossom, and then when the music is being played, the pattern of the plum blossom is always formed by the target tactile generating device, when the tone is When the volume changes, the size of the plum pattern is changed.

Embodiment 3

As shown in FIG. 5, the implementation process of the simulation scenario method in this embodiment may include the following steps:

Step 501: Collect motion track information of a person or an animal by using a motion sensor.

Step 502: Convert the motion track information into a lattice signal by using a specific encoding program in the signal converter.

Here, the signal converter generates a plurality of vibration signals according to characteristics of each of the track segments in the motion track information, the plurality of vibration signals form the dot matrix signals, and each of the vibration signals corresponds to one tactile sense device, each vibration The signal includes the frequency, amplitude, duration, and time interval of the vibration when the haptic generating device vibrates.

Step 503: transmitting the lattice signal to the vibrator array through an electrical connection line;

Step 504: Each haptic generating device in the vibrator array vibrates according to a frequency, an amplitude, and the like set by the lattice signal, so that the user perceives the current scene by the vibration of each haptic generating device in the haptic generating device display. Or animal movement characteristics.

In practical application, the vibrator array can be placed close to the user's surface close to the skin surface, and when the vibrator array vibrates, the vibrations of the tactile sense devices are used to different degrees, so that the user perceives the action characteristics of the human or animal in the current scene. . For example, the user may be made to perceive the following action characteristics: being stroked, being cut by a knife, being shot by a gun, being hugged, and the like. For the action of palm pressing or the like, the vibrator array exhibits a palm pressing state by the vibration of the plurality of tactile sensation devices and expresses the pressing force by the amplitude of the vibration.

It should be noted that there are roughly two ways to use sensors to obtain human or animal motion trajectories.

The first type is to set a sensor group (such as a contact sensor, an infrared sensor, etc.) on the peripheral surface or one side surface of an object. When the user touches a sensor at a different position, the corresponding acquisition can be generated. The signal, when the user's hand moves, will inevitably touch different sensors, that is, when the sensor that receives the signal (the sensor touched by the user's hand) changes, the user is also explained. The hand (which can also be the other torso of the body) has been displaced, creating a trajectory of motion.

The second type is a positioning device that carries a six-axis sensor on the user, and the positioning device can directly detect the movement (ie, the motion trajectory) of the portion carrying the positioning device.

For the first mode, it can usually be used when two users interact with each other remotely, for example, the first user operates a signal collecting object (the object of one or one side of the surface is provided with a sensor group). The first user captures the object by touch signal or slides on the signal acquisition object to enable the sensor on the signal acquisition object to receive the motion trajectory. Then, through the subsequent steps, the action track is transmitted to the vibration device worn by the second user by means of an electronic signal, and the target tactile sense device on the second user wears the device to regularly vibrate to simulate signal acquisition. The sliding trajectory collected by the object realizes the simulation of the scene. Of course, the second user can also operate a signal acquisition object at the same time to control the vibration device worn by the first user, thereby achieving the interaction between the two parties. For example, remote sex, remote parties can generate touch signals through touch screen, touch doll, touch gloves (signal collection objects), etc., and transmit signals through telephone, computer network, Bluetooth, ultrasonic or wired/wireless, etc. The array (wearing device) allows the other party to experience where they want to touch or touch. And can control the vibration of the electric sex device in the penis and vagina to complete remote sex. Another example is real-time online interaction. When the network interaction or video chat is often unable to express the behavior and feelings of the participants, he can transmit signals through the network through instant or preset. The vibration array can be wireless, Bluetooth. The signals are synchronously received, so that the person wearing the vibration array knows the vibration feeling.

Compared with the first one, the second method is more suitable for the case of intense activity. Specifically, after the positioning device is used, the user's body will form a corresponding motion trajectory when moving (usually, it is necessary to uniformly acquire a large number of locators to achieve complete motion trajectory acquisition), and then, the motion track is obtained. The trace is converted into an electronic signal, which is then transmitted to the wearable device. The target tactile sensation device on the wearable device performs regular vibration according to the motion trajectory collected by the locator, thereby completing the simulation of the scene.

Of course, in the specific use, the above two methods can be used simultaneously to use the first way to achieve the trajectory information transmission on the signal acquisition object, and the second method to achieve the user body dancing. Trajectory information transfer.

Embodiment 4

As shown in FIG. 6, the implementation process of the simulation scenario method in this embodiment may include the following steps:

Step 601: Collect, by using a sensor, emotion characteristic information of the user in the current scenario;

Step 602: Convert the emotion feature information into a matrix signal by using a specific encoding program in the signal converter.

Here, the signal converter generates a plurality of vibration signals according to the emotion characteristic information, the plurality of vibration signals form the lattice signal, each vibration signal corresponds to one haptic generating device, and each of the vibration signals includes a haptic generating device vibration Frequency, amplitude, duration and vibration time interval.

Step 603: transmitting the lattice signal to the vibrator array through an electrical connection line;

In general, a plurality of haptic generating devices can be disposed on a carrier and arranged in accordance with certain rules to form an array of vibrators. For example, the plurality of tactile sensation devices may be arranged in a rectangular shape on the carrier, and the material of the carrier may be selected according to requirements, and may be a soft material (such as clothes, etc.) or a hard material (such as a hard plate or the like).

Step 604: Each haptic generating device in the vibrator array vibrates according to a frequency, an amplitude, and the like set by the lattice signal, so that the user perceives that he is in the current scene through the vibration of each haptic generating device in the haptic generating device array. The emotional state underneath.

In practical applications, the vibrator array can be placed close to the user's surface close to the skin surface, and when the vibrator array vibrates, the vibrations of the tactile sense devices are stimulated to different degrees, so that the user perceives the emotional state of the current scene. Thereby, it helps the user's image to perceive whether the current state mood is stable. For example, the user can be made to perceive the following emotional states: quiet, arrogant, feelings of being soaked in sea water, and the like.

For example, for the feeling of being soaked by seawater, the vibration of the vibrator array exhibits a state of sea wave.

Embodiment 4

As shown in FIG. 7, the implementation process of the simulation scenario method in this embodiment may include the following steps:

Step 701: Collect weather state information of a current scene by using a sensor or other device.

Step 702: Convert the weather state information into a lattice signal by using a specific encoding program in the signal converter.

Here, the signal converter generates a corresponding dot matrix signal according to the weather state information in the current scene and the corresponding relationship between the pre-configured weather state and the lattice signal, the dot matrix signal includes a plurality of vibration signals, and each of the vibration signals corresponds to one touch sense. A generating device, each of the vibration signals including a frequency, an amplitude, a duration, and a vibration time interval when the haptic generating device vibrates.

Here, the dot matrix signals corresponding to various weather states may be configured in the signal converter in advance, and the corresponding dot matrix signals are generated when the corresponding weather state is sensed. For example, a corresponding dot matrix signal is set for clear weather, and a corresponding dot matrix signal is set for rainy weather, and dot matrix signals of different amplitudes or different frequencies can be set according to the magnitude of rain; for snow, wind, cold, Hot, hail, squally, etc. can also set the corresponding dot matrix signal. The specific settings may be set according to actual needs, or may be set by the user.

Step 703: transmit the lattice signal to the vibrator array through an electrical connection line;

Step 704: Each haptic generating device in the vibrator array vibrates according to a frequency, an amplitude, and the like set by the lattice signal, so that the user perceives the current scene in the current scene through the vibration of each haptic generating device in the haptic generating device display. The weather conditions below.

In practical applications, the vibrator array can be placed in close contact with the user's skin surface, and the tactile sense devices of the vibrator array vibrate according to a preset mode, so that the user perceives the weather condition of the current scene.

Embodiment 6

As shown in FIG. 8, the implementation process of the simulation scenario method in this embodiment may include the following steps:

Step 801: Pre-configure one or more preset scene options. After the user selects the preset scene, the related information of the preset scene is transmitted to the signal converter.

Here, when the preset scene option is pre-configured, the related information (such as the identification number, number, or name) of the corresponding scene is pre-configured, and the corresponding dot matrix signal parameters are configured corresponding to the corresponding scene. The specific settings may be set according to actual needs, or may be set by the user.

Step 802: Generate a corresponding dot matrix signal according to the related information of the preset scene by using a specific encoding program in the signal converter.

Here, the signal converter generates a corresponding dot matrix signal according to the lattice signal parameter corresponding to the preset scene, the dot matrix signal includes a plurality of vibration signals, each vibration signal corresponds to one haptic generating device, and each of the vibration signals includes a haptic generating device Frequency, amplitude, duration, and vibration time interval during vibration.

Step 803: transmitting the lattice signal to the vibrator array through an electrical connection line;

Step 804: each small tactile sensation device in the vibrator array vibrates according to a frequency, an amplitude, or the like set by the lattice signal, so that the user can perceive the vibration through the vibration of each tactile sense device in the tactile sense device display. Preset scene.

In practical applications, the vibrator array can be placed in close contact with the user's skin surface, and the tactile sense devices of the vibrator array vibrate according to a preset mode, so that the user perceives that he or she perceives a preset preset. Scenes.

The methods disclosed in the above embodiments can be roughly divided into two categories. The first type is that the environmental information is collected in real time by sensors and the like; the second type is automatically generated according to the virtual scene in the computer. The following describes the case where the concentration is not explained in the foregoing.

The first category, that is, the environmental information is collected in real time by devices such as sensors. In simple terms, if it is not convenient to use language for communication, that is, in some secret occasions, such as the performance of a drama, two people standing on the stage can only speak lines, when someone forgets the words, Then another person on the stage can form a motion track signal by touching the sensor group on the body, and then transmitting the motion track signal to the wearing device of the forgetting person by wireless transmission, thereby wearing the target touch on the device. The generating device performs regular vibrations, thereby completing the transmission of the motion trajectory information. For another example, it is unrealistic for two people who are far apart from each other to directly observe the gestures of the remote person through the naked eye. At this time, the motion track information can be transmitted in the above manner.

There are many scenarios for using the first type of method, and a few are listed below.

1, in the night environment, in the process of encircling criminals, because the environment is dark, or the police officers are isolated from each other, police officers can not see each other, and can not make a sound (can not disturb the criminals), fingering the sensor touchpad (sensor group), resulting in a corresponding motion trajectory, then the surrounding police officers will Experience the information that the companion wants to pass to himself (the target tactile sensation device on the vibrating fabric forms the trajectory formed by the finger by regular vibration).

2, in concerts or similar large-scale events, the organizers and performers hope that the audience will experience the performance better, enhance the effect, and usually take the dance and other ways to interact with the audience. At this time, the motion sender (usually the singer) can slide the motion trajectory on the sensor group, and the wireless device transmits the wearable device worn by the viewer (provided with a large number of target haptic generating devices) according to the singer. The motion trajectory performs simultaneous vibration. In turn, the interaction between the two is strengthened.

3, at night, or in some extreme flight conditions, it is difficult for the pilot to visually distinguish the current state of the aircraft. For offshore flights, it is difficult for pilots to distinguish between the sea and the sky; as in the case of near-snow, it is difficult for pilots to determine the sky and the underside. Especially after the aircraft has been turned over, it is more difficult to accurately determine the current flight state, and it is easy to have a flight disaster. The aircraft can use its internal preset sensing device (gravity sensor, etc.) to respectively determine the current state of the aircraft (such as face up/down), and then vibrate by controlling the target vibration unit on the vibrating fabric worn by the pilot. In turn, the pilot is informed of the current flight status (eg, the target tactile sensation devices are arranged in a horizontal row while vibrating, indicating that the aircraft is currently facing up, and the target tactile sensation devices are arranged in a tandem row while vibrating, indicating that the aircraft is currently facing down). It is also possible to capture the picture in front by the camera on the aircraft, and distinguish the scene in the current picture by binarization processing (if the sky and the mountain are in the picture, after binarization, the area of the sky is Pure white, the area of the mountain is pure black), and further vibrate according to the screen control sensor corresponding to different scenes (the sensor corresponding to the white area can be vibrated, and the sensor corresponding to the black area can also be vibrated. It is the sensor vibration corresponding to the black and white boundary line, so that the pilot can know the scene in front of the aircraft without observing the naked eye.

The second type, that is, the environmental information is set in advance, that is, the case where the vibration law of the control haptic generating device is set in advance in the computer. Such situations are used in many cases. Compared with the first case, this type of signal does not need to be collected by sensors, so the scene used is more free. Moreover, in the second case, when the target tactile sensation device vibrates, the motion trajectory signals collected by the first type of the sensor are stored in the computer in advance, and when the extraction is required, according to the signal stored in the computer Control the target sensor on the vibrating fabric to vibrate. In addition to the combination with the first category, the actual environment that the second category can imitate is more extensive. Here are a few simple examples.

1, when being attacked in video games, you can simulate a variety of different feelings of being attacked, such as being cut by various knives, various gunshots, various blast injuries, wrestling, oppression, encountering whirlwinds, etc. Specifically, as shown in FIG. 10, the blade, the gunshot wound, the blast injury, the wrestling, the encounter with the whirlwind and the pressing in the figure can be performed according to the actual situation. If a knife is injured, when it is actually scratched by a knife, it is usually that the tool is drawn along the straight line on the victim. Therefore, the target tactile sensation device can be arranged in a straight line while vibrating to simulate a knife wound. At the same time, the degree of reduction can be further improved by adjusting the vibration intensity of the target tactile sensation device at different positions. For example, when a knife wound is formed, the force at the position on both sides of the knife wound is small, the depth of the knife edge is shallow; the force at the middle position of the knife wound is small, and the depth of the knife edge is deep. When the target tactile sensation device vibrates, the vibration intensity of the target tactile sensation device corresponding to the position where the blade edge is shallow may be small, and vice versa, the vibration intensity of the target tactile sensation device corresponding to the shallower blade position is large. The process of the knife wound is to generate a sequence vibration according to the shape of the knife. For example, the vibration intensity of the injured position of the gunshot wound is greater than the general injury (such as boxing injury, falls, etc.), so when imitating the gunshot wound, the vibration intensity of the injured part should be large. The blast injury is mainly caused by shrapnel and gravel splashing. Therefore, multiple points of the blast injury should be injured at the same time. The wrestling and pressing are similar, and the actual situation should be used to control the multiple target tactile generating devices to vibrate at the same time (the target tactile generating device forms a shape that mimics the actual situation, such as a hand shape, an arm shape, etc.), and the cyclone is similar, and should simulate the actual situation. A plurality of target haptic generating devices are controlled to sequentially circulate vibrations.

2, in the medical process (especially refers to the treatment process of touches such as massage). The patient may first be allowed to wear clothing provided with a tactile stimulating device. Then, by controlling the target tactile sensation device in the tactile sensation device to perform regular vibration, the massage of the doctor is mimicked, so that the doctor's hand error can be avoided, and the problem of not massaging the acupuncture point no longer occurs.

In hypnosis or psychotherapy, the patient can experience the situation that the doctor wants him to experience. The human body has five senses, such as sight, hearing, touch, etc., and it is difficult for the same hypnotist to convey the message to the user through the five senses at the same time. Therefore, the vibration fabric carrying the tactile generating device can be released to convey the tactile information to the user.

Another example is the soothing of the surgery, which quiets the patient by simulating a kind of soothing vibration. The purpose is also to simulate the state of touch and touch by the regular vibration of the target tactile sensation device, thereby completing the comfort of the patient.

3, when watching movies, that is, when watching movies in different kinds of theaters. The viewer can be pre-applied to wear the vibrating fabric, and then the theater system can issue different commands to the vibrating fabric as the picture changes. The target tactile sensation device on the vibrating fabric is vibrated to achieve the target tactile sensation device vibrating with the film, thereby improving the perception of the viewer.

4, when the baby is being nursed, the baby often has a crying phenomenon. If no one comforts, the baby will always cry until the cry is tired. In this case, the baby can be wore the vibrating fabric in advance, and the regular vibration of the target tactile sense device on the vibrating fabric can be used to imitate the mother's touch, so that even if no one cares for the baby, the baby can be comforted. In particular, the different crying of children indicates different meanings, and many parents cannot effectively distinguish these crying sounds, leading to the appeasement mistakes. At this time, the baby's crying sound can be collected by the sound collecting device, and then the system finds the touching manner corresponding to the crying sound (the vibration mode of the target tactile sense generating device, and the correspondence between the vibration mode and the crying sound can be experienced. The personnel confirms well in advance), and then the system sends a control command to the vibrating fabric, so that the target tactile sensation device performs regular vibration, thereby specifically pacifying the baby.

In the above, only a part of the actual situation is listed, and there are many scenarios that can be used, and the list is not exhaustive. In order to improve the user's feelings better, based on the solution disclosed in the above example, the gyroscope can be added to the user wearing the vibrating fabric, and the current posture of the user can be detected by a gyroscope or the like. (can detect the tilt angle), such as lying down, tilting, standing upright, etc. Then, according to the result detected by the gyroscope, the pattern formed by the lattice signal is adjusted so that the inclination angle of the pattern formed by the lattice signal can be understood as the inclination of the pattern formed by the target tactile sensation device controlled by the lattice signal. The angle) is the same as the tilt angle of the current scene (the tilt angle detected by the gyroscope). For example, when the user is in the left-inclined state, the water level should be appropriately tilted when the user is in the state of seawater, as shown in FIG. The picture on the left is a diagram of the body erect state. The middle picture shows the state where the body is tilted, but the sea line is not tilted. The right picture shows the body tilt and the sea line is also tilted. It can be seen that the right picture is closer to the actual state. The specific inclination angle of the sea line should be determined according to the inclination angle measured by the gyroscope. Similarly, it can also be used to prevent motion sickness and seasickness. When the vehicle is tilted, the vibration array produces a horizontal replenishment effect, so that the user feels that there is no such The slope.

As shown in FIG. 9, an embodiment of the present invention further provides an apparatus for simulating a scene, where the apparatus may include: an acquisition device, a signal converter, a controller, and a vibrator array; the vibrator array includes a plurality of A regularly arranged haptic generating device, the vibrator array being electrically connected to the controller. In practical applications, the signal converter and the collecting device may be connected in a plurality of manners, such as wireless, wired, etc., and the signal converter is electrically connected to the controller.

The collecting device is configured to collect any one or more kinds of information used to describe the current scene, and transmit the collected information to the signal converter.

a signal converter, configured to convert information collected by the collection device into a lattice signal, and transmit the lattice signal to the controller;

And a controller, configured to control, according to the lattice signal, each of the haptic generating devices in the vibrator array to vibrate, so that the user can perceive the current scene. In specific use, the processor may include an acquisition device, a signal converter and a controller, and may also include a signal converter (in this case, the signal converter may be understood as a device that generates a lattice signal according to a preset instruction or an external command). And a controller (which can be understood as a device that controls a plurality of haptic generating devices according to a lattice signal), or only a controller.

Specifically, the collection device may be a video capture device (such as a camera, etc.), and/or an audio capture device (such as a microphone, etc.), and/or an action track acquisition device (such as a gyroscope, an acceleration sensor, etc.), and/or A character emotion feature collection device (such as a heart rate sensor, etc.), and/or a touch device. The collection device may further include a device having a physical button or a touch device capable of providing a user selection interface. The controller controls a user selection interface to be displayed on the touch device, and a pre-configured preset scene option is displayed on the user selection interface for the user to select.

In practical applications, the signal converter may include a video signal converter, an audio signal converter, and/or other types of signal converters. The carrier of the vibrator array can be a garment or other substance that can be in close contact with the body.

In practical applications, the embodiment of the present invention can finely describe the scene and the action process by covering hundreds of tactile generating devices (such as vibrators) in the human body, for example, the fighter pilot performs the tumbling lifting action in the air due to the rapid acceleration. Sudden overload and blindness. At this time, it is impossible to know the specific orientation of the aircraft, where the nose is washed, and where it flies by remote communication. With the method and device of the embodiment of the present invention, the pilot can pass the whole back with the vibration of the whole sense. Covering hundreds of micro-tactile generating devices in real-time, the direction, terrain, topography, location, image, airport runway and other information in the form of composite vibration, just like "writing" or "moving movies" on the skin surface, making it Safe blind drop to the airport.

In an actual application, the vibrator array including hundreds of tactile generating devices may be attached to the skin surface or the inner side of the garment, and the external preset or instant picture, sound, and the like may be adopted by the method and device of the embodiment of the present invention. Scenes, videos, light, motion, environment, weather, emotions, feelings, various processes and other information are processed into lattice signals, and various vibrations are simulated and output, making hundreds of thousands of The tactile sensation device differs in vibration duration, vibration interval, vibration frequency, and vibration amplitude, thereby representing images, directions, motions, spaces, positions, emotions, environments, weather, feelings, processes, etc. of various preset or instant scenes. The user can feel the vibration process and the touch process through the skin, thereby transmitting the exact information of the current scene, and can also perform the template of the preset scene.

The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.

Claims

A method of simulating a scene, the method comprising:

Obtaining any one or more kinds of information used to describe the current scene;

Converting any one or more of the information into a lattice signal;

The control vibrator array vibrates according to the lattice signal so that the user can perceive the current scene.
The method according to claim 1, wherein the information for describing a current scene comprises: scene information, and/or sound information, and/or weather information, and/or motion track information of a person or an animal. And/or user emotional feature information, and/or preset scene information.
The method of claim 2 wherein said method comprises:

Collecting scene information, sound information, motion track information of a person or an animal, and/or emotional feature information of the user;

Converting the scene information, the sound information, the motion track information, and/or the emotion feature information into a lattice signal, respectively;

The control vibrator array vibrates in accordance with the lattice signal such that the user can perceive the scene, sound, motion trajectory and/or own emotional state of the current scene.
The method of claim 2 wherein said method comprises:

Collecting weather information of the current scene;

Generating a lattice signal corresponding to the weather information according to a preset configuration;

The control vibrator array vibrates according to the lattice signal so that the user can perceive the weather of the current scene.
The method of claim 2 wherein said method comprises:

Obtaining preset scene information currently selected by the user;

Generating a corresponding dot matrix signal corresponding to the preset scene information according to a preset configuration;

The control vibrator array vibrates according to the lattice signal, so that the user can perceive the preset scene.
An apparatus for simulating a scene, the apparatus comprising:

a signal converter for converting any one or more kinds of information used to describe the current scene into a lattice signal and transmitting the signal to the controller;

a controller for controlling the vibrator array according to a lattice signal transmitted by the signal converter Each of the haptic generating devices vibrates;

The vibrator array includes a plurality of regularly arranged haptic generating devices.
The device according to claim 6, wherein the device further comprises: an collecting device, configured to collect any one or more kinds of information used to describe the current scene.
The device according to claim 7, wherein the collection device comprises: a video collection device, an audio collection device, an action track collection device, and/or a character emotion feature collection device, and/or a touch device.
A device according to any one of claims 6 to 8, wherein the vibrator array comprises a plurality of rectangularly arranged haptic generating devices.
The device of claim 9 wherein the carrier of the array of vibrators is a garment.
A method of simulating a scene, comprising:

Obtain environmental information;

Generating a lattice signal simulating the environmental information according to a preset conversion manner;

According to the lattice signal, the target haptic generating device that controls the corresponding position performs vibration, the target haptic generating device is plural, and a plurality of the target haptic generating device arrays are patterned in the same pattern as the environmental information.
A method of simulating a scene according to claim 11 wherein:

The obtaining environmental information in the step includes:

Get an image of the current scene;

Performing binarization processing on the image of the current scene to generate a binary image;

Find the light and dark boundary line in the binary image as the environmental information, or find the bright area in the binary image as the environmental information, or find the dark area in the binary image as the environmental information.
A method of simulating a scene according to claim 12, wherein

The step of converting the environmental information into a lattice signal according to a preset conversion manner includes:

A dot matrix signal is generated according to the image boundary of the current scene according to the light and dark boundary line, and the shape of the pattern formed by the plurality of target haptic generating devices corresponding to the position of the dot matrix signal is the same as the shape of the light and dark boundary line.
The method for simulating a scene according to claim 11, wherein the step of acquiring the environment information comprises:

The obtained force position information of the current scene and the force degree information corresponding to each force position are taken as the environmental information.
A method of simulating a scene according to claim 14, wherein

The step of converting the environmental information into a lattice signal according to a preset conversion manner includes:

Generating a lattice signal according to the force position information, and a shape of a pattern formed by the plurality of target haptic generating devices corresponding to the position of the lattice signal is the same as a shape of a graphic corresponding to the force position information;

The vibration intensity information of the target haptic generating device corresponding to each lattice signal is calculated according to the stress degree information corresponding to each acceptance position.
The method of simulating a scene according to claim 15, wherein the step of controlling the target haptic generating device at the corresponding position according to the lattice signal to perform vibration comprises:

Finding a target haptic generating device corresponding to the lattice signal;

According to the vibration intensity information of the target haptic generating device, a predetermined number of vibration units are simultaneously vibrated in the same target haptic generating device.
The method for simulating a scene according to claim 11, wherein before the step of controlling the corresponding position of the target haptic generating device to vibrate according to the lattice signal, the method further comprises:

Get the tilt angle of the current scene;

According to the tilt angle, the dot matrix signal is adjusted such that the tilt angle of the pattern formed by the adjusted dot matrix signal is the same as the tilt angle of the current scene.
A vibrating fabric using the method of simulating a scene as claimed in claims 11-17, comprising:

A plurality of haptic generating devices and processors disposed in an array, the processors being electrically coupled to each of the haptic generating devices, respectively; the processor for performing the method of claims 11-17.
The vibrating fabric of claim 18, wherein each of said haptic generating devices is comprised of a plurality of vibrating units, each of said vibrating units being electrically coupled to said processor.
The vibrating fabric according to claim 19, wherein the plurality of vibrating units of the same tactile sensation device are sequentially disposed in the first direction.
The vibrating fabric of claim 18, further comprising a gyroscope electrically coupled to said processor for obtaining an angle of inclination of the current scene.