TWM645926U - An augmented reality system with interaction with reality devices - Google Patents

Abstract

This creation is an augmented reality system that interacts with real-world devices, including a plurality of unmanned aerial drones, a processing server and at least one smart mobile processing device. The unmanned flying remote control aircraft moves and locates within a predetermined coordinate range, and generates coordinate positioning information based on the flight changes of each unmanned flying remote control aircraft. The processing server sends a control command to the unmanned flying remote control aircraft based on each coordinate positioning information, and controls the unmanned flying remote control aircraft to fly in groups within a predetermined coordinate range based on a game value. The smart mobile processing device is used to display images from the unmanned aerial vehicle and to trigger changes in game values.

Description

An augmented reality system with interaction with reality devices

This creation is about an augmented reality system that interacts with reality devices, especially an augmented reality system that can interact with the audience in a group flight performance of unmanned aerial vehicles.

Nowadays, in order to increase advertising promotion and increase the merchant's exposure, some merchants will use drones to perform group flights, and combine lighting and sound effects to create a drone flight show. However, such a drone flight show is only a one-sided performance and cannot interact and cooperate with the audience. Therefore, after the performance is over, there will no longer be any information connection with the merchants.

Or, some merchants will organize game activities to achieve the benefits of advertising promotion for the merchants through the combination of games and products. However, most of these activities are devoid of anything new. If there is nothing special about the activity, it will appear unchanged, which can easily make consumers feel boring. In the end, it will still be difficult to attract consumers' attention.

Therefore, how to provide a drone flight performance combined with game interaction, so that the audience can not only enjoy the performance, but also interact and cooperate with the drone, increase the audience's attention and sense of participation, and enrich the changes in game interaction, thereby achieving The effectiveness of merchants' advertising promotion will be the issue and focus of this case.

One of the purposes of this creation is to provide an augmented reality system that combines the flight performance of an unmanned aircraft with game interaction, so that the audience can not only enjoy the performance but also interact and cooperate with the unmanned aircraft, and have the ability to interact with real-life devices.

Another purpose of this creation is to provide an augmented reality system that can effectively increase the audience's attention and sense of participation for promotion and marketing, with the ability to interact with real-life devices.

The invention provides an augmented reality system that interacts with a real-world device. The augmented reality system includes a plurality of unmanned aerial remote controllers, a processing server and at least one smart mobile processing device. The unmanned flight remote control aircraft respectively include a flight remote control terminal wireless transmission unit and a positioning control unit. The positioning control unit is used to control the movement and positioning of the unmanned flying remote control aircraft in a predetermined coordinate range, and generate coordinate positioning information based on the flight changes of each unmanned flying remote control aircraft. The processing server includes a server-side wireless transmission unit and a processing unit. The server-side wireless transmission unit is respectively signal-connected to each of the flight remote control side wireless transmission units of the unmanned flying remote control machine and receives the coordinate positioning information. The processing unit sends a control command to the unmanned flying remote control machine through a server-side wireless transmission unit based on each of the coordinate positioning information, and controls the unmanned flying remote control machine within the predetermined coordinate range based on a game value. Group flight combination. The smart mobile processing device respectively includes a mobile wireless transmission unit, an image capture unit and a display control interface unit. The mobile wireless transmission unit is signal-connected to the server wireless transmission unit. The image capturing unit is configured to move toward the predetermined coordinate range and capture images of the unmanned aerial remote control aircraft. The display control interface unit is used to display the image screen of the unmanned aerial vehicle remote control machine, and has at least one trigger button. The trigger button is used to trigger and change the game value. When the trigger button is touched When sending, the trigger result is returned to the processing unit, and the processing module calculates the changed game value.

As mentioned above, in the augmented reality system, the processing unit controls the unmanned aerial vehicle to arrange and present multiple groups of dynamic three-dimensional array combinations within the predetermined coordinate range. The processing unit includes a database and a processing module. The database is used to store multiple action group instruction sets, and the action group instruction sets respectively correspond to the dynamic three-dimensional queue combination. The processing module is used to calculate the game value and select one of the corresponding action group instruction sets according to the game value to control the unmanned flying remote control aircraft to fly in clusters according to the selected action group instruction set. The corresponding dynamic three-dimensional queue combination is combined.

In the augmented reality system as described above, when the trigger button of the display control interface unit is triggered, the trigger result is returned to the processing unit, and the processing module calculates the changed game value. , to control the unmanned flying remote control aircraft.

In the augmented reality system as mentioned above, the game value is a blood volume of a game monster, and the dynamic three-dimensional images are different changes of the game monster corresponding to different blood volumes.

The augmented reality system as mentioned above, wherein the processing unit includes an augmented reality module that generates at least one virtual game monster image on the display control interface unit corresponding to the position of the unmanned aerial remote control unit, And combine the virtual reality image with the image captured by the image capturing unit.

In the augmented reality system as described above, when the trigger button of the display control interface unit is triggered, the trigger result is returned to the processing unit, and the processing module calculates the changed game value. , to control the game monster image to show corresponding game changes.

In the augmented reality system as described above, the predetermined coordinate range is first defined by four unmanned flying remote control aircraft in the vertical direction of the ground in the air, and the angular coordinates of four rectangles are recorded by the processing unit.

In the augmented reality system as described above, the display control interface unit further has a range frame. When the range frame is aligned with the unmanned aerial vehicle remote control and the trigger button is pressed, it is determined that the The trigger button is a valid trigger.

In the augmented reality system as described above, the processing server further includes a reward redemption unit that transmits a virtual coupon to the smart mobile processing device when the game value reaches a predetermined standard.

As mentioned above, the augmented reality system, wherein the smart mobile processing device is a smart phone and/or smart tablet.

This creation is an augmented reality system that interacts with real-life devices. It uses smart phones or smart tablets to interact with unmanned flight remote control machines in augmented reality, so that the audience can not only enjoy the flight show, but also interact with the unmanned aerial vehicle. The game interaction with the flying remote control machine not only increases the audience's attention and sense of participation, but also enriches the changes in the game interaction, thereby achieving the benefits of advertising promotion for the merchants and achieving all the above purposes.

1: Unmanned aerial vehicle with remote control

11: Unmanned aerial vehicle wireless transmission unit

12: Positioning control unit

2: Processing server

21: Server-side wireless transmission unit

22: Processing unit

221:Database

222: Processing module

23:Reward redemption unit

3:Smart mobile processing device

31: Mobile wireless transmission unit

32:Image capture unit

33: Display control interface unit

331: Trigger button

332: Range box

23T: Virtual coupon

Figure 1 shows a block diagram of an augmented reality system with interaction with a reality device according to a first embodiment of the invention; Figure 2 is an unmanned vehicle with an augmented reality system with interaction with the reality device of Figure 1 A schematic diagram of the predetermined positioning coordinate range of the flying remote control aircraft; Figure 3 is a block diagram of the use of the processing unit of the augmented reality system of Figure 1 that interacts with the reality device; Figure 4 shows a block diagram of an augmented reality system with interaction with a reality device according to a second embodiment of the present invention; Figures 5A and 5B are the augmented reality system with interaction with a reality device of Figure 4 A schematic diagram of a smart mobile processing device; and FIG. 6 is a schematic diagram of a virtual coupon with an augmented reality system interacting with a reality device in FIG. 4 .

The present invention creates a first embodiment of an augmented reality system that interacts with real devices. As shown in Figure 1 , it includes a plurality of unmanned aerial remote controllers 1, a processing server 2 and at least one smart mobile processing device 3. The unmanned flying remote control aircraft 1 includes a flying remote control terminal wireless transmission unit 11 and a positioning control unit 12 . The positioning control unit 12 is used to control the movement and positioning of the unmanned flying remote control aircraft 1 within a predetermined coordinate range, and to generate coordinate positioning information based on the flight changes of each unmanned flying remote control aircraft 1 . The processing server 2 includes a server-side wireless transmission unit 21 and a processing unit 22 . The server-side wireless transmission unit 21 is respectively connected with signals to each flight remote control side wireless transmission unit 11 of the unmanned flying remote control machine 1 and receives the coordinate positioning information. The processing unit 22 sends a control command based on each coordinate positioning information to the unmanned flying remote control machine through the server-side wireless transmission unit 21, and controls the unmanned flying remote control machine 1 to fly in a group within a predetermined coordinate range according to a game value.

Referring also to FIG. 2 , the predetermined coordinate range is first defined by four unmanned aerial remote controllers 1 in the vertical direction of the ground in the air, and the corner coordinates of four rectangles are recorded by the processing unit 22 . The smart mobile processing device 3 respectively includes a mobile wireless transmission unit 31, an image capture unit 32 and a display control interface unit 33. The mobile wireless transmission unit 31 is signal-connected to the server wireless transmission unit 21 . The image capturing unit 32 is configured to face the predetermined coordinate range and capture the image of the unmanned aerial remote control aircraft 1 . The display control interface unit 33 is used to display the image screen of the unmanned flying remote control 1 and has at least one trigger button 331. The trigger button 331 is used to trigger and change the game value. When the trigger button 331 is triggered, the trigger result is returned. to the processing unit 22, and the processing module 222 calculates the changed game value. The smart mobile processing device may be a smart phone and/or smart tablet.

Referring also to FIG. 3 , in this example, the processing unit 22 controls the unmanned aerial remote control aircraft 1 to arrange and present multiple groups of dynamic three-dimensional formation combinations within the predetermined coordinate range. The processing unit 22 includes a database 221 and a processing module 222. The database 221 is used to store multiple action group instruction sets, and the action group instruction sets respectively correspond to different dynamic three-dimensional queue combinations. The processing module 222 is used to calculate the game value, and select one of the corresponding action group instruction sets according to the calculated game value, so as to control the unmanned flying remote control machine 1 to control the group flight combination according to the selected action group instruction set. The corresponding dynamic three-dimensional queue combination is produced. When the trigger button 331 of the display control interface unit 33 is triggered, the trigger result is returned to the processing unit 22 , and the processing module 222 calculates the changed game value to control the unmanned aerial remote controller 1 .

For example, the dynamic three-dimensional queue combination is to combine game monsters flying in the air. The game value is the blood volume, and it has the status of full health, half full health and a little residual health, and multiple players press the trigger button on the monster. 331 attacks, and then controls the unmanned flying remote control aircraft 1 to form a flight combination corresponding to the dynamic three-dimensional formation combination according to different blood volume states.

The second embodiment of the present invention is an augmented reality system that interacts with a reality device. As shown in FIG. 4 , the processing unit 22 includes an augmented reality module 223 corresponding to the position of the unmanned flying remote control machine 1 . The display control interface unit 33 generates at least one virtual game monster image, and combines the virtual reality image with the image captured by the image capturing unit 32 . When the trigger button 331 of the display control interface unit 33 is When triggered, the trigger result is returned to the processing unit 22, and the processing module 222 calculates the changed game value to control the game monster image to show corresponding game changes, such as an attacked game screen. For example, the dynamic three-dimensional formation combination of the unmanned aerial vehicle 1 is the game monster, the virtual game monster image generated is the follower monster, and the trigger button 331 triggers the attack on the follower monster, and the number of follower monsters knocked down is used as the game value. basis for change.

Referring to FIGS. 5A and 5B together, the display control interface unit 33 further has a range frame 332. When the range frame 332 is aligned with the game monster image virtually converted by the unmanned aerial remote controller 1 and the trigger button 331 is pressed, Only then can it be determined that the trigger button 331 is a valid trigger.

In this example, the processing server 2 further includes a reward redemption unit 23. When the game value reaches a predetermined standard, a virtual point ticket 23T is transmitted to the smart mobile processing device 3, and the player displays the virtual point ticket through the smart mobile processing device 3. 23T and exchange it (as shown in Figure 6).

This creation is an augmented reality system that interacts with real-life devices. A dedicated application (APP) is installed on a smartphone or smart tablet, allowing users to interact with unmanned aerial vehicles through the smart phone or smart tablet. The augmented reality interactive cooperation with the remote control drone allows the audience to not only enjoy the flight show but also interact with the unmanned flying remote control drone in games. In this way, the audience's attention and sense of participation can be greatly enhanced. The cooperation of augmented reality can also enrich the changes in game interaction, thereby achieving the benefits of advertising promotion for merchants and achieving all the above purposes.

The embodiments of this invention are described above, but they are not intended to limit the scope of the patent rights claimed by this invention. The scope of patent protection shall depend on the appended patent application scope and its equivalent fields. Any changes or modifications made by those with ordinary knowledge in the art without departing from the spirit or scope of this patent shall be equivalent changes or designs completed within the spirit disclosed in this invention, and shall be included in the following patent application scope. within.

1: Unmanned aerial vehicle with remote control

11: Unmanned aerial vehicle wireless transmission unit

12: Positioning control unit

2: Processing server

21: Server-side wireless transmission unit

22: Processing unit

3:Smart mobile processing device

31: Mobile wireless transmission unit

32:Image capture unit

33: Display control interface unit

331: Trigger button

Claims (10)

An augmented reality system that interacts with a reality device. The augmented reality system includes: a plurality of unmanned flight remote control machines, each of which includes a flight remote control terminal wireless transmission unit and a positioning control unit for controlling the unmanned aerial vehicle. The flight remote control aircraft moves and locates in a predetermined coordinate range, and generates coordinate positioning information based on the flight changes of each unmanned flight remote control aircraft; a processing server includes: a server-side wireless transmission unit, which is connected to the signals respectively Each flight remote control terminal wireless transmission unit of the unmanned flight remote control aircraft receives the coordinate positioning information; and a processing unit sends a control command based on each coordinate positioning information and transmits it to the unmanned flight remote control through the server-side wireless transmission unit. aircraft, and control the unmanned flight remote control aircraft to fly together in the predetermined coordinate range according to a game value; at least one smart mobile processing device includes: a mobile wireless transmission unit, which is a signal connected to the server wireless transmission unit; an image capture unit for facing the predetermined coordinate range and capturing the image frames of the unmanned flying remote control machines; and a display control interface unit for displaying the image frames of the unmanned flying remote control machines, and having At least one trigger button is used to trigger and change the game value. When the trigger button is triggered, the trigger result is returned to the processing unit, and the processing unit calculates the changed game value. The augmented reality system as described in claim 1, wherein the processing unit is to control the unmanned aerial vehicles to arrange and present multiple groups of dynamic three-dimensional array combinations in the predetermined coordinate range, wherein the processing unit includes: a database, It is used to store multiple action group instruction sets, and these action group instruction sets respectively correspond to some dynamic three-dimensional queue combinations; and a processing module is used to calculate the game value and select the corresponding actions according to the game value. One of the group command sets is used to control the dynamic three-dimensional formation combination corresponding to the selected cluster flight combination of the unmanned flying remote control aircraft according to the selected action group command set. The augmented reality system as described in claim 2, wherein when the trigger buttons of the display control interface unit are triggered, the trigger result is returned to the processing unit, and the processing module calculates the changed game value, To control these unmanned aerial vehicles. The augmented reality system as described in claim 3, wherein the game value is a blood volume of a game monster, and the dynamic three-dimensional images are different changes of the game monster corresponding to different blood volumes. The augmented reality system as claimed in claim 1, wherein the processing unit includes an augmented reality module that generates at least one virtual game monster image on the display control interface unit corresponding to the positions of the unmanned aerial vehicles. images, and combines the virtual reality images with the images captured by the image capture unit. The augmented reality system as described in claim 5, wherein when the trigger buttons of the display control interface unit are triggered, the trigger result is returned to the processing unit, and the processing module calculates the changed game value, To control the game monster image, the corresponding game changes will occur. The augmented reality system as described in claim 1, wherein the predetermined coordinate range is first defined by four unmanned aerial remote control drones in the air perpendicular to the ground direction as the corner coordinates of four rectangles, and is recorded by the processing unit. The augmented reality system as described in claim 1, wherein the display control interface unit further has a range frame. When the range frame is aligned with the unmanned flying remote control machines and the trigger button is pressed, the trigger is determined. The key press is a valid trigger. The augmented reality system of claim 1, wherein the processing server further includes a reward redemption unit that transmits a virtual coupon to the smart mobile processing device when the game value reaches a predetermined standard. The augmented reality system of claim 1, wherein the smart mobile processing device is a smart phone and/or smart tablet.