TWM600411U - Behavior data processing system - Google Patents

Abstract

This creation provides a behavior data processing system, which includes a sensor, an interactive sensor, and a virtual reality headset. The sensor is arranged on the user to detect the position change of the user to generate an action signal; the interactive sensor is set on a human body model, and the interactive sensor can be based on the interactive relationship between the user and the human body model An interactive behavior signal is determined; the virtual reality headset based on the motion behavior signal detected by the sensor and the interactive behavior signal detected by the interactive sensor can accurately simulate the interactive relationship between the user and the virtual character, thereby improving The authenticity of the simulated experience.

Description

Behavioral Data Processing System

This creation is about a virtual reality processing technology, especially a behavioral data processing system.

The pace of life of modern people is becoming more and more compact. Many people spend their time at work. In their daily work, they usually use the social software of electronic devices to interact with their relatives and friends around them. Among them, the social software has text interaction and voice interaction. Function, and cannot provide the authenticity of the simulation experience, thereby reducing the fun of social interaction.

In recent years, the rapid development of virtual technology, such as virtual reality, augmented reality and mixed reality, can provide users and virtual characters to simulate social interaction; however, for virtual reality experience, virtual reality equipment can only make a single judgment The behaviors and actions of the user may easily misjudge the actual behavior of the user, thereby reducing the accuracy of the simulated social interaction, thereby reducing the authenticity of the simulated interaction.

In order to solve the above-mentioned problems, this creation provides a behavior data processing system that can enhance the authenticity of the interaction between the user and the virtual character, thereby enhancing the effect of the simulation experience.

To achieve the above objective, this creation provides a behavior data processing system, which includes a sensor, an interactive sensor, and a virtual reality headset. The sensor is arranged on the user, and the sensor is used to detect the position change track of the user to generate an action signal; the interactive sensor is set in a human body model, and the interactive sensor can be based on the interaction between the user and the human body model The virtual reality headset is coupled to the sensor and the interactive sensor. The virtual reality headset is provided with a virtual interactive database, a virtual reality module, an image display module, and A signal processing module. The virtual interactive database stores a plurality of virtual interactive data. The virtual interactive data is provided with a virtual character corresponding to the human body model. The virtual reality module obtains virtual interactive data from the virtual interactive database and displays the virtual interactive data through the image display module. The group performs display, the user can watch the virtual character in a virtual social field, and the signal processing module performs simulated interaction with the virtual character at least according to the action behavior signal and the interactive behavior signal.

In this way, the sensor can accurately obtain the user's body change, and the interactive sensor can sense the state of the user touching the human body model, so that the virtual reality headset can detect the motion and behavior signals according to the sensor and interactive sensing The interactive behavior signal detected by the device can accurately simulate the interaction between the user and the virtual character, thereby improving the reality of simulated social interaction and achieving the effect of immersive experience.

Please refer to FIG. 1 to FIG. 5. The present creation provides a behavior data processing system, which includes a sensor 10, an interactive sensor 20 and a virtual reality headset 30.

The sensor 10 is worn on the user 100. The sensor 10 is used to detect the position change track of the user 100 to generate an action signal. In a preferred embodiment, the sensor 10 is a speedometer, a gyroscope, and air pressure A group consisting of a meter, a magnetometer, an electronic compass, and a heart rate detector, and the sensor 10 is worn on the waist, chest and back of the user 100 to detect the posture, direction, angle, and displacement of the user’s 100 body , Heart rhythm, speed and other functions; please cooperate with Figure 1 and Figure 2. The sensor 10 includes a motion detection module 11 and a first communication module 12, the motion detection module 11 is based on the posture of the user 100 The group consisting of change, direction change, angle change, displacement change, and speed change is used as a basis for judging the position change track of the user 100, and the motion detection module 11 generates motion behavior signals, and the first communication module 12 is used for Transmission action signal.

The interactive sensor 20 is arranged in a human body model 200. The interactive sensor 20 can sense the multiple actions of the user 100 touching the human body model 200 and determine an interactive behavior signal based on the actions. In a preferred embodiment , The human body model 200 is a humanoid doll, and the interactive sensor 20 can be one of a pressure sensor, a temperature sensor and a humidity sensor; please cooperate with FIG. 1 and FIG. 3, the interactive sensor 20 includes a The interaction detection module 21 and a second communication module 22. The interaction detection module 21 determines the interaction behavior based on the pressure position, pressure change, temperature change and humidity change generated by the user 100 touching the human body model 200 The second communication module 22 is used to transmit interactive behavior signals.

The virtual reality headset 30 is worn on the head of the user 100 and is coupled to the sensor 10 and the interactive sensor 20. The virtual reality headset 30 is provided with a virtual interactive database 31 and a virtual reality model. Group 32, an image display module 33, and a signal processing module 34. The virtual interactive database 31 stores a plurality of virtual interactive data. The virtual interactive data is provided with a virtual character corresponding to the human body model 200. In a preferred embodiment Please cooperate with FIG. 5, the virtual interactive database 31 is provided with an image data unit 311 and a voice data unit 312. The image data unit 311 is used to store virtual interactive data, and the voice data unit 312 is used to store a plurality of interactive voice data.

The virtual reality module 32 obtains virtual interactive data from the virtual interactive database 31 and displays it through the image display module 33. The user 100 can watch the virtual character in a virtual social field. The signal processing module 34 at least acts according to the action The behavior signal and the interactive behavior signal perform simulated interaction with the virtual character. Please cooperate with FIG. 5. The signal processing module 34 of this embodiment is provided with a viewing angle adjustment unit 341 and an interactive simulation unit 342. The viewing angle adjustment unit 341 can be based on the action signal , And adjust the viewing angle and distance of the user 100 to view the virtual character, the interactive simulation unit 342 can determine the position of the limb of the user 100 in contact with the virtual character according to the interactive behavior signal, that is, when the user 100 is in contact with the human model 200 At this time, the interactive simulation unit 342 can correspondingly present the position of the body of the virtual character being touched.

In a preferred embodiment, as shown in FIGS. 2 to 5, the virtual reality headset 30 is provided with a third communication module 35 and a voice playback module 36, and the third communication module 35 is coupled to the sensor The first communication module 12 of 10 and the second communication module 22 of the interactive sensor 20, wherein the connection of the third communication module 35 with the first communication module 12 and the second communication module 22 includes but not Limited to wireless connections such as Radio Frequency Identification (RFID) and Bluetooth (Blue tooth), the third communication module 35 is used to receive the action signal transmitted by the first communication module 12, and the second communication module 22 The interactive behavior signal transmitted.

The voice play module 36 can play the interactive voice data output by the voice data unit 312. When the virtual reality headset 30 receives the interactive behavior signal triggered by the interactive sensor 20, the signal processing module 34 simulates the interaction The unit can obtain the corresponding interactive voice data from the voice data unit 312 according to the interactive behavior signal, and play it by the voice playback module 36. In this way, the user 100 touches the human body model 200 and can generate sounds, as if the authenticity of real interaction is achieved .

It is worth mentioning that the interactive sensor 20 further includes a model status module 23. The model status module 23 determines the overall outline and current position of the human body model 200 to generate model status information, and uses the second communication module 22 is transmitted to the third communication module 35. The virtual reality module 32 can correspondingly present the virtual character according to the model state information, so that the user 100 can obtain the current position and posture state of the virtual character in the virtual social field, thereby improving The accuracy of simulated observation.

In this way, the sensor 10 can accurately obtain the body change of the user 100, and the interactive sensor 20 can sense the state of the user 100 contacting the human body model 200, so that the virtual reality headset 30 can detect the movement according to the sensor 10 The behavior signal and the interaction behavior signal detected by the interaction sensor 20 can accurately simulate the interaction between the user 100 and the virtual character, allowing the user 100 to feel as if they are actually interacting or touching, making the experience more real. In turn, the authenticity of simulated social interaction is improved, and the effect of immersive experience is achieved.

In a preferred embodiment, as shown in FIG. 5, the virtual reality headset 30 is further provided with a sound processing module 37 and a voice interaction module 38.

The voice processing module 37 can receive a voice to be recognized from the user 100, and process the voice to be recognized into a voice signal; the voice interaction module 38 receives the voice signal from the voice processing module 37, and interacts virtually according to the voice signal The voice data unit 312 of the database 31 obtains the corresponding interactive voice data, and finally it is played by the voice playback module 36. In this way, the present creation can further provide sound feedback, so that the user 100 can feel as if it is real In dialogue and interaction with virtual characters, the fun of simulated social interaction is enhanced.

In summary, this creation has the following effects:

1. The virtual reality headset 30 can accurately simulate the interaction between the user 100 and the virtual character through the auxiliary detection of the sensor 10 and the interactive sensor 20, thereby improving the reality of simulated social interaction and achieving an immersive experience Effect.

2. This creation can provide video and sound feedback, so that the user 100 can feel as if they are actually interacting with virtual characters, thereby enhancing the fun of simulated social interaction.

The above-mentioned embodiments are only used to illustrate the creation, not to limit the scope of the creation. All modifications or changes that do not violate the spirit of this creation belong to the scope of this creation.

100: user 200: Mannequin 10: Sensor 11: Motion detection module 12: The first communication module 20: Interactive sensor 21: Interactive detection module 22: The second communication module 23: Model State Module 30: Virtual reality headset 31: Virtual Interactive Database 311: Image Data Unit 312: Voice Data Unit 32: Virtual Reality Module 33: Image display module 34: signal processing module 341: viewing angle adjustment unit 342: Interactive Simulation Unit 35: The third communication module 36: Voice playback module 37: Sound processing module 38: Voice interaction module

Figure 1 is a system architecture diagram of this creative embodiment. FIG. 2 is a schematic diagram of the structure of the sensor according to the creative embodiment. FIG. 3 is a schematic diagram of the structure of the interactive sensor according to the creative embodiment. FIG. 4 is a schematic diagram of the structure of the virtual reality headset of the creative embodiment. Figure 5 is a functional diagram of the implementation of the virtual reality headset of the creative embodiment.

100: user

200: Mannequin

10: Sensor

20: Interactive sensor

30: Virtual reality headset

Claims (10)

A behavioral data processing system, which includes: A sensor configured on the user, the sensor is used to detect the position change track of the user to generate an action signal; An interactive sensor, which is set on a human body model, the interactive sensor can sense a plurality of actions of the user touching the human body model, and determine an interactive behavior signal based on the actions; and A virtual reality headset coupled to the sensor and the interactive sensor. The virtual reality headset is provided with a virtual interactive database, a virtual reality module, an image display module, and a signal processing Module, the virtual interactive database stores a plurality of virtual interactive data, the virtual interactive data is provided with a virtual character corresponding to the human body model, the virtual reality module obtains the virtual interactive data from the virtual interactive database, and uses The image display module displays, the user can watch the virtual character in a virtual social field, and the signal processing module performs simulated interaction with the virtual character at least according to the motion behavior signal and the interactive behavior signal. The behavior data processing system according to claim 1, wherein the sensor includes a motion detection module and a first communication module, and the motion detection module uses the user's posture change, direction change, and angle change The group consisting of displacement change and speed change is used as a basis for judging the user's position change trajectory, and the motion detection module generates the motion behavior signal, and the first communication module is used to transmit the motion behavior signal. The behavior data processing system according to claim 2, wherein the sensor is selected from the group consisting of a speedometer, a gyroscope, a barometer, a magnetometer, an electronic compass, and a heart rhythm detector. The behavior data processing system according to claim 2, wherein the interactive sensor includes an interactive detection module and a second communication module, and the interactive detection module is generated based on the user contacting the human body model The pressure position, pressure change, temperature change, and humidity change are used to determine the interactive behavior signal, and the second communication module is used to transmit the interactive behavior signal. The behavior data processing system according to claim 4, wherein the interactive sensor can be one of a pressure sensor, a temperature sensor, and a humidity sensor. The behavioral data processing system according to claim 4, wherein the virtual reality headset is provided with a third communication module, and the third communication module is coupled to the first communication module and the second communication module , The third communication module is used to receive the action signal transmitted by the first communication module and the interactive behavior signal transmitted by the second communication module. The behavior data processing system according to claim 6, wherein the interactive sensor further includes a model state module, and the model state module determines the overall outline and current position of the human body model to generate model state information, It is transmitted to the third communication module through the second communication module, and the virtual reality module can correspondingly present the virtual character according to the model state information. The behavior data processing system according to claim 6, wherein the signal processing module is provided with a viewing angle adjustment unit and an interactive simulation unit, and the viewing angle adjustment unit can adjust the user's viewing angle of the virtual character according to the action signal And distance, the interactive simulation unit can determine the position of the limbs of the user simulated touching the virtual character according to the interactive behavior signal. The behavior data processing system according to claim 8, wherein the virtual interactive database is provided with an image data unit and a voice data unit, the image data unit is used to store the virtual interactive data, and the voice data unit is used to store A plurality of interactive voice data, the analog interactive unit obtains the corresponding interactive voice data from the voice data unit according to the interactive behavior signal, and the virtual reality headset is further provided with a voice playback module for playing the interactive voice data . The behavior data processing system according to claim 9, wherein the virtual reality headset is provided with a voice processing module and a voice interaction module, and the voice processing module can receive a voice to be recognized from the user , And process the to-be-recognized voice into a voice signal, the voice interactive module obtains the matching interactive voice data from the voice data unit according to the voice signal, and plays it by the voice playing module.

Images