TWI635418B - Wearable virtual interactive display system - Google Patents

Abstract

The present invention relates to a wearable virtual reality interactive display system, which comprises an integrated sensing device and generates a plurality of sensing signals; a wear sensing signal integrating device is connected to the somatosensory detecting device, and generates a limb motion recognition information according to the sensing signal. An interactive display output device is connected to the wear sensing signal integration device, and generates an interactive display image information according to the sensing signal and the body motion recognition information; a display device is connected to the interactive display output device, and displays an interaction according to the interactive display image information; Show images. The invention senses a performer's limb movements and generates a sensing signal by the body sensing device, and controls the interactive performance image information of the interactive performance output device to achieve the real-time interactive effect of the virtual world.

Description

Wearable virtual interactive display system

The invention is a performance system, in particular a wearable virtual reality interactive performance system.

The performance of dynamic art performances has become more diverse with the development of science and technology, and is no longer limited to live performances on the live stage, or the use of display and projection devices to deliver fixed images and music. Among them, the virtual and digital digital performance can change the video playback sequence or trigger a specific sound and light effect according to human operation during the performance, and has a more varied and interesting presentation mode, which is the mainstream of the development of dynamic art performance in recent years.

The existing virtual and digital digital display is generally operated by an operator according to a pre-edited script operation interface to control the playback device to play a relatively virtual background, soundtrack and virtual character action, and perform with the performers of the physical world; When the performance progresses to the next stage, another operator's operation plays another relative background, soundtrack and avatar action. The corresponding background, soundtrack and avatar actions are set when the digital script is edited, and can only be played during the performance. That is to say, the performer of the physical world must perform according to the edited script, and perform with the virtual character or virtual background. However, if the performer is temporarily unable to perform, or suddenly forgets the action of the next virtual character, the performer's performance will not be able to cooperate with the virtual character, making the performance unsuccessful or fail. Therefore, it is necessary to further improve the virtual and digital digital display mode of the prior art.

Due to the existing virtual and digital digital performances, the content must be arranged before the performance, and only the set virtual images and music can be played during the performance, with the real world table. When the performer performs, when the performer is unable to perform the action of the virtual character, the result of the performance of the performer of the physical world and the virtual image will cause the performance to be unsuccessful or fail. Therefore, the present invention provides a wearable virtual reality interactive performance system, which causes a corresponding response of the virtual image through the performance action of the performer, thereby avoiding a gap between the performer's performance content and the virtual image.

The wearable virtual reality interactive display system comprises: an integrated sensing device, a wear sensing signal integration device, an interactive display output device, and a display device; the body sensing device includes a plurality of wearable detection units, each The wearable detection unit has a number, and the wearable detection unit is configured to sense a user's motion and respectively generate a sensing signal; wherein each of the wearable detection units generates a sensing signal The wear sensing signal integration device is connected to the body sensing device to receive the sensing signals generated by each of the wearable detection units, and according to each of the wearable detection units The generated sensing signal generates a limb motion recognition information; the interactive display output device is connected to the wear sensing signal integrating device to receive the limb motion recognition information, and the sensing signals of each of the wearable detecting units; the interactive exhibit output The device generates an interactive display image information according to the limb motion recognition information and the sensing signals of each of the wearable detecting units; the display device is connected to the Dynamic performances output means for receiving the image information and displaying interactive performances an interactive video performances.

The interactive display image information generated by the interactive display output device is generated according to the body motion recognition information, so the interactive display image information generates corresponding motion changes according to the sensing signals generated by the wearable detection units. Or an animation effect; that is, the performer can guide the virtual object or the virtual character in the interactive performance image through the change of the body movement at any time, so that the interactive performance image can match the performance of the performer on the stage. As a result, the performance During the performance, the interactive display image can be controlled on the spot, avoiding the situation that the physical world performer and the virtual world's character action or animation effects cannot be matched, resulting in a situation in which the performance is not smooth or failed.

10‧‧‧Skin detection device

11‧‧‧Wearing detection unit

20‧‧‧ Wearable sensing signal integration device

21‧‧‧Sensor signal collection module

22‧‧‧ limb motion recognition module

30‧‧‧Interactive show output device

31‧‧‧ Wearable sensing signal receiving module

32‧‧‧Exhibition execution engine

33‧‧‧Virtual Character and Scene Drawing Module

34‧‧‧Virtual Character and Animation Effects Control Module

35‧‧‧3D graphics engine

40‧‧‧ display device

50‧‧‧Digital script editing and generating device

51‧‧‧Virtual Object Editing Module

52‧‧‧ Wear position corresponding editing module

53‧‧‧Virtual and Interactive Rules Editing Module

54‧‧‧Execution script generation module

60‧‧‧Integrated communication bus

61‧‧‧ original sensing signal channel

62‧‧‧ Body Motion Identification Information Channel

63‧‧‧Executive script delivery channel

1 is a block diagram of a preferred embodiment of a wearable virtual reality interactive display system of the present invention.

2 is a block diagram of a preferred embodiment of a preferred embodiment of the wearable virtual reality interactive display system of the present invention.

3 is a block diagram of a wear sensing signal integration device of a preferred embodiment of the wearable virtual reality interactive display system of the present invention.

4 is a block diagram showing another preferred embodiment of a preferred embodiment of the wearable virtual reality interactive display system of the present invention.

FIG. 5 is a block diagram showing still another preferred embodiment of a preferred embodiment of the wearable virtual reality interactive display system of the present invention.

As shown in FIG. 1 , the present invention includes an integrated sensing device 10 , a wear sensing signal integrating device 20 , an interactive display output device 30 , and a display device 40 . The body sensing device 10 includes a plurality of Each of the wearable detection units 11 has a number; each of the wearable detection units 11 is configured to sense a user's limb motion and generate a sensing signal, the sensing The signal includes the number of each of the wearable detection units 11.

The wear signal integration device 20 is connected to the motion detection device 10 by wire or wirelessly to receive the sensing signal, and generates a limb motion recognition information according to the sensing signals of the wearable detection unit 11.

The interactive performance output device 30 is connected to the wear sensing signal integration device 20 to receive the sensing signals of the wearable detection unit 11 and the limb motion recognition information, and the interactive performance output device 30 identifies the information according to the limb motion. Each of the sensing signals of the wearable detecting unit 11 generates an interactive display image information.

The display device 40 is connected to the interactive display output device to receive the interactive display image information and display an interactive display image.

The wearable detection unit 11 generally includes a gyroscope and an accelerometer, the gyroscope generates a rotation value and the accelerometer generates an acceleration value, and the wearable detection unit 11 integrates the rotation value and the acceleration value. And generating the sensing signal. After receiving the sensing signal, the wear sensing signal integration device 20 determines the moving direction and speed of the wearable detecting unit 11 according to the rotation value and the acceleration value, thereby confirming wearing the wearable detecting unit 11 The direction of movement of the various parts of the performer's body and the movement information of the limb.

The wearer wears the wearable detection unit 11 of the body sensing device 10 and performs a limb motion to generate the sensing signals, and further receives the wearable signals by the wear signal integration device 20 The sensing signal of the detecting unit 11 is detected and identified to generate the limb motion recognition information. The performer performs different body motions, that is, generates different sensing signals and body motion recognition information, and controls the interactive performance output device 30 to generate corresponding interactive performance image information. In this way, the interactive display image displayed by the display device 40 is generated according to the physical movement of the performer, and the interactive display image may be changed according to different user actions, so that the performer can control the scene at the present moment. The purpose of interactive display of images is to avoid situations in which the interactive world of performers and virtual worlds cannot be matched.

Referring to FIG. 2, in a preferred embodiment of the present invention, the virtual reality interactive display system further includes a digital script editing and generating device 50 connected to the interactive performance output device 30. The digital script editing and generating device 50 includes a virtual object editing module 51 and a wear position corresponding editing. The module 52, a virtual interactive editing rule module 53, and an execution script generating module 54 are provided. The virtual object editing module generates 51 virtual object information, the virtual object information includes a virtual character setting information, a music queue setting information, and a scene sequence setting information; the wearing position corresponding editing module 52 generates a wearable The location correspondence information, the virtual interaction rule editing module 53 generates a virtual interaction rule information. The execution script generating module 54 is connected to the virtual object editing module 51 to receive the virtual object information, and is connected to the wearing position corresponding editing module 52 to receive the wearing position corresponding information, and is connected to the virtual interactive editing rule module 53. Receiving the virtual reality interaction rule information, the execution script generation module 54 integrates the virtual object information, the wear position corresponding information, the virtual reality interaction rule information, generates an execution script, and transmits the execution script to the interactive performance output device 30.

The virtual character setting information of the virtual object information is an image setting message of a human or non-human character in the virtual interactive performance image. The music setting information includes the music content information to be played relative to when the interactive performance image is displayed or displayed. The scene sequence setting information includes a background graphic or image setting message in the interactive image. The wear position corresponding information is a part information of the virtual character in the interactive show image corresponding to each of the wearable detection units 11 , and the wearer corresponding to the number of each wearable detection unit 11 wears each wearable detection. The limb position of unit 11. For example, the wearable detection unit 11 of the number 1 corresponds to the right-hand part of the virtual character in the interactive show image, and is worn by the wearer-detecting unit 11 of the performer in the right-hand part.

The digital script editing and generating device 50 is operated by a user. The virtual object editing module 51 is operated to edit the virtual object information according to the performance requirement, and the wearing position corresponding editing module 52 is operated to edit the wearing position corresponding information, and the virtual interactive editing rule module 53 is operated to edit The virtual and interactive rules information. After the editing as described above is completed, the information is transmitted to the execution script generation module 54 to generate the execution script, and is executed 30 by the interactive performance output device. That is, the user can set the interactive performance by operating the digital script editing and generating device 50. The background of the output image and the music, the virtual character part corresponding to each of the wearable detection units 11, and the rules for interaction between the physical world performer and the virtual interactive display image via the wearable detection unit 11 are performed.

As shown in FIG. 3, the sensing signal integration device 20 further includes a sensing signal collection module 21 and a limb motion recognition module 22; the sensing signal collection module 21 connects the wearables by wire or wirelessly. The detecting unit 11 continuously receives the sensing signals of the wearable detecting units 11, and the limb motion recognition module 22 is connected to the sensing signal collecting module 21, and continuously receives the wearable detecting units. The sensing signal of the eleventh is determined according to the rotation value and the acceleration value in the continuously flowing sensing signal to determine whether a special limb motion occurs to generate a limb motion recognition information and transmitted to the interactive performance output device 30.

The virtual reality interaction rule information generated by the virtual reality interaction rule editing module 53 is a condition message for triggering an animation special effect event according to the body motion recognition information, and the interactive performance output device 30 receives the virtual reality interaction rule information and the limb in the execution script. After the action identification information, determining whether the received body motion recognition information satisfies the condition for triggering an animation special effect event according to the virtual reality interaction rule information; if the interactive performance output device 30 determines that the trigger condition of an animation special effect event has been satisfied, An animation effect information is transmitted, and the animation effect information is transmitted to the display device 40 to display an animation special effect image.

For example, the virtual reality interaction rule information in the execution script includes: when the wearable detection unit 11 of the number 1 moves up quickly, a condition of generating a spark animation effect, and the interactive performance output device 30 is sensed by the sensing The limb motion recognition module 22 of the signal integration device 20 receives the limb motion recognition information that the wearable detection unit 11 of the number 1 quickly moves upward. The interactive performance output device 30 determines that the condition of the spark animation effect event has been satisfied, thereby generating a spark animation effect information, and transmitting the spark animation effect information to the display device 40 to display a spark animation effect image.

Referring to FIG. 4, in another preferred embodiment of the present invention, the interactive display output device 30 includes a wear sensing signal receiving module 31, a show execution engine 32, a virtual character and a scene drawing module. 33. A three-dimensional graphics engine 35, a virtual character and animation effect control module 34. The wear sensing signal receiving module 31 is connected to the sensing signal collecting module 21 to receive the sensing signals of the wearable detecting unit 11; the performance executing engine 32 is connected to the executing script generating module 54 to receive The exercise script is connected to the wear sensing signal receiving module 31 to receive the sensing signals, and is connected to the limb motion recognition module 22 of the wear sensing signal integration device 20 to receive the limb motion recognition information. The performance execution engine 32 generates a three-dimensional dynamic virtual character image information and a three-dimensional dynamic scene in cooperation with the virtual character and scene drawing module 33, the three-dimensional graphics engine 35, and the virtual character and animation effect control module 34 according to the execution script. The image information is integrated to generate the interactive display image information and transmitted to the display device 40.

The performance execution engine 32 further determines whether the physical motion recognition information condition for triggering an animation special effect event is satisfied according to the virtual reality interaction rule information and the limb motion recognition information in the execution script; if the performance execution engine 32 determines an animation special effect event When triggered, the virtual character and scene drawing module 33, the three-dimensional graphics engine 35, the virtual character and animation effect control module 34 generate an animation effect event information, and transmit the information to the display device 40 to enable the display. Device 40 displays an animated special effect image.

In the wearable virtual reality interactive display system of the present invention, the performer of the physical world interacts with the role of the virtual world as an animation special event. After the performer makes a specific limb movement, and the limb movement is recognized by the limb movement recognition module 22, the performance execution engine 32 determines whether to trigger an animation special effect event according to the virtual reality interaction rule information. For example, when the right hand of the performer is quickly lifted, the limb motion recognition module 22 receives the sensing signal of the wearable detecting unit 11 of the number 1 and performs limb motion recognition to generate a wearable number of one. Knowing that the unit 11 quickly moves up the body motion recognition information; since the virtual reality interaction rule information includes: when the number 1 wearable check list When the element 11 moves up quickly, a condition of a spark animation effect is generated. After the show execution engine 32 receives the limb motion recognition information, the condition for triggering a spark animation effect is determined according to the virtual and real interaction rule information, so the virtual The character and scene drawing module 33, the three-dimensional graphics engine 35, the virtual character and animation effect control module 34 generate a spark animation effect image information and transmit the same to the display device 40, and the sparking effect is displayed by the display device 40.

As shown in FIG. 4, in the preferred embodiment, the sensing signal generated by each of the wearable detecting units 11 includes the number of the wearable detecting unit 11, and the performance executing engine 32 executes the script. The wear location corresponding information is used to learn the virtual character part corresponding to each wearable detection unit 11, and the sensing signal condition for triggering a virtual image guiding event is known by the virtual reality interaction rule information. The performance execution engine 32 further determines the displacement and velocity of each of the wearable detection units 11 in the space according to the rotation value and the acceleration value of the continuously flowing sensing signals, thereby triggering a virtual image guidance event. The performance execution engine 32 cooperates with the virtual character and scene drawing module 33, the three-dimensional graphics engine 35, the virtual character and animation effect control module 34, and guides the virtual character in the three-dimensional dynamic virtual character image information. The movement of the wearable detecting unit 11 is changed.

In the wearable virtual reality interactive display system of the present invention, there is another way for the performer of the physical world to interact with the role of the virtual world to guide the event for the virtual character. The performance execution engine 32 knows the virtual character parts corresponding to the wearable detection unit 11 according to the wear position corresponding information. When the performer makes an action, the sensing signal continuously flows into the performance through the sensing signal receiving module 31. The engine 32, the show execution engine 32 guides the virtual character portion to generate a corresponding movement according to each of the sensing signals. For example, the show execution engine 32 knows that the wearable detection unit 11 of the number 1 corresponds to the nose portion of an elephant avatar according to the wear position corresponding information, and the performer will wear the wearable number of the number 1 The right hand of the unit 11 is oscillated in a horizontal direction, and the sensing signal of the wearable detecting unit 11 of the number 1 is continuously flown into the performance executing engine 32 via the sensing signal collecting module 21 and the wear sensing signal receiving module 31, and is triggered. The show execution engine 32 executes a virtual character guide event. The performance of the show The engine 32 determines that the wearable detecting unit 11 of the number 1 is performing a horizontal swing according to the continuously flowing sensing signal, thereby cooperating with the virtual character and scene drawing module 33, the virtual character and animation special effect control module 34, The three-dimensional graphics engine 35 guides the nose portion of the elephant virtual character in the three-dimensional dynamic virtual character image information to generate a corresponding horizontal swing.

In summary, in the wearable virtual reality interactive display system of the present invention, the performers in the physical world and the characters in the virtual world have two different interaction modes, one is an animation special effect event, and the other is a virtual character guiding event. The two interactions make the interaction between the performers of the physical world and the characters of the virtual world more diverse, and the content of the show is more interesting.

Referring to FIG. 5, in another preferred embodiment of the present invention, the wearable virtual reality interactive display system further includes an integrated communication bus 60 including an original sensing signal channel 61 and a limb motion recognition information channel 62. One execution script is sent to channel 63. The original sensing signal channel 61 is connected to the sensing signal collecting module 21 of the sensing signal integration device 20, the limb motion recognition module 22 of the sensing signal integration device 20, and the wear sensing signal of the interactive performance output device 30. The receiving module 31, wherein the limb motion recognition module 22 and the wear sensing signal receiving module 31 pass the original sensing signal channel 61 to receive the sensing signals of the wearable detecting unit 11.

The limb motion recognition information channel 62 is connected to the limb motion recognition module 22 of the wearable sensing signal integration device 20, and the performance execution engine 32 of the interactive performance output device 30, wherein the performance execution engine 32 identifies the information through the limb motion. Channel 62 receives the limb motion recognition information.

The execution script delivery channel 63 is coupled to the execution script generation module 54 of the digital script editing and generating device 50 and the performance execution engine 32 of the interactive performance output device, wherein the performance execution engine 32 transmits the channel 63 through the execution script. The executive script.

The integrated communication bus 60 is used as a distribution device for information circulation in the system. The sensing signal collecting module 21 of the wearable sensing signal integration module 20 transmits the sensing signals to the original sensing signal channel 61, and the limb motion recognition module 22 and the wearing sense of the sensing signal are required. Measurement The signal receiving module 31 is connected to the original sensing signal channel 61 to obtain the sensing signals. The limb motion recognition module 22 sends the limb motion recognition information to the limb motion recognition information channel 62, and the limb motion recognition information needs to be obtained. The performance execution engine 32 is connected to the limb motion recognition information channel 62 to obtain the limb motion recognition information. Similarly, the execution script generation module 54 transmits the execution script to the execution script delivery channel 63, which is required to obtain the execution script. The show execution engine 32 then connects the execution script delivery channel 63 to receive the execution script. In other words, the modules and devices that generate or integrate information in the system only need to send information to the integrated communication bus 60, and the modules or devices that need the information only need to be connected to the integrated communication bus 60. In order to receive the required information, it is possible to prevent the information from being delayed or erroneous due to multiple transmissions and receptions, resulting in the output interactive interactive image not being smooth.

The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Although the present invention has been disclosed in the above preferred embodiments, it is not intended to limit the present invention. A person skilled in the art can make some modifications or modifications to equivalent embodiments by using the above-disclosed technical contents without departing from the technical scope of the present invention, but without departing from the technical solution of the present invention, according to the present invention. Technical Substantials Any simple modifications, equivalent changes and modifications made to the above embodiments are still within the scope of the technical solutions of the present invention.

Claims (4)

A wearable virtual interactive display system includes: an integrated sensing device, comprising a plurality of wearable detecting units, each of the wearable detecting units having a number, and the wearable detecting units are for sensing Detecting a user's action and respectively generating a sensing signal; wherein each of the wearable detecting units generates a sensing signal including a number of each of the wearable detecting units; and a wear sensing signal integrating device includes a sensing signal collection module, connected to the somatosensory detecting device to receive sensing information generated by each of the wearable detecting units; a limb motion recognition module connected to the sensing signal collecting module, and according to each The sensing information generated by the wearable detecting unit generates a limb motion recognition information; an interactive display output device is connected to the limb motion recognition module of the wear sensing signal integrating device to receive the limb motion recognition information, and connect each The sensing signal collecting module of the wearable detecting unit receives the sensing signal; the interactive display output device identifies the information according to the limb motion and each of the wearing The sensing signal of the detecting unit generates an interactive display image information; a digital script editing and generating device is connected to the wear sensing signal integration device and the interactive performance output device; wherein the digital script editing and generating device includes a virtual object editing module generates a virtual object information; wherein the virtual object information includes a virtual character setting information, a music queue setting information, and a scene setting information; and a wearing position corresponding to the editing module generates a wearable position corresponding information; a virtual interactive rule editing module, generating a virtual interactive rule information; an execution script generating module, connecting the virtual object editing module to receive the virtual object information; connecting the wear position corresponding editing mode a group to receive the corresponding information of the wearing position; connect the virtual interactive rule editing module to receive the virtual interactive rule information; and execute the script generating module integration The virtual object information, the wearable location correspondence information, the virtual reality interaction rule information, generate an execution script, and transmit to the interactive performance output device; wherein the interactive performance output device is configured according to the execution script, the physical motion recognition information, and the The sensing information of the wearable detection unit generates the interactive display image information; a display device is connected to the interactive display output device to receive the interactive display image information and display an interactive display image; wherein: the interactive display output device includes a wear sensing signal receiving module is connected to the sensing signal collecting module of the wear sensing signal integrating device to receive the sensing signals of each of the wearable detecting units; and an exhibition execution engine is connected to the digital script editing And the execution script generating module of the generating device, configured to receive the execution script, and connect the limb motion recognition module of the wear sensing signal integration device to receive the limb motion recognition information, and connect to the wear sensing signal receiving module. Receiving a sensing signal of each of the wearable detecting units; a virtual character and a scene a three-dimensional graphics engine; a virtual character and animation special effect control module; wherein the virtual reality interaction rule generation module generates: the virtual reality interaction rule information includes: determining whether to trigger an animation special effect event according to the physical motion recognition information condition The performance execution engine generates a three-dimensional dynamic virtual character image information and a three-dimensional dynamic scene image information according to the execution script and the virtual character and scene drawing module, the three-dimensional graphics engine, and the virtual character and animation special effect control module. And determining, according to the virtual reality interaction rule information and the body motion recognition information, whether the condition information of the limb motion recognition triggering the animation special effect event has been satisfied; When the interactive performance output device determines that the physical motion recognition information condition of the animation special effect event is satisfied, the interactive performance output device generates an animation special effect information, and displays an animation special effect in the interactive performance image through the display device. The wearable virtual reality interactive display system according to claim 1, wherein: the virtual reality interaction rule information generated by the virtual reality interaction rule editing module further comprises: determining whether to trigger a virtual image guidance event according to each of the sensing signals; the interaction The performance output device determines, according to the virtual reality interaction rule information and each of the sensing signals, whether the sensing signal condition for triggering the virtual image guiding event is satisfied; and when the interactive display output device determines the sensing signal that triggers the virtual image guiding event When the condition is satisfied, the interactive display output device guides the action change of the three-dimensional dynamic virtual character image information of the interactive display image information according to each of the sensing signals. The wearable virtual interactive display system according to claim 2, wherein the display execution engine generates the virtual according to the wear position corresponding information in the execution script and the sensing signals of the wearable detection units. Image guide event. The wearable virtual reality interactive display system of claim 1, further comprising an integrated communication bus, connected to the wear sensing signal integration device, the interactive performance output device, and the digital script editing and generating device; wherein the integrated communication The bus bar includes: an original sensing signal channel, the sensing signal collecting module connected to the wear sensing signal integrating device, the limb motion recognition module, and the wear sensing signal receiving module connected to the interactive display output device The wear sensing signal receiving module of the wear sensing signal integrating device and the wear sensing signal receiving module of the interactive display output device receive the sensing signals of each of the wearable detecting units through the original sensing signal channel; ; a limb motion recognition information channel, connected to the limb motion recognition module of the wear sensing signal integration device and the performance execution engine of the interactive performance output device; wherein the performance execution engine of the interactive performance output device identifies the information channel through the limb motion Receiving the limb motion recognition information; performing a script delivery channel, connecting the execution script generation module of the digital script editing and generation device, and the performance execution engine of the interactive performance output device; wherein the performance execution engine of the interactive performance output device is passed The execution script delivery channel receives the execution script.