TW201910971A - Interactive method of augmented reality and system thereof with which a player must cooperate with a virtual image to move so as to improve the reality simulation effect in interaction - Google Patents

Abstract

Provided are an interactive method of augmented reality and a system thereof, which are implemented by performing communication by a network server with an electronic device. The method mainly comprises providing an application program installed on the electronic device for presenting a reality image on a display interface of the electronic device, and capable of receiving a location message from the electronic device to acquire a coordinate position of the electronic device; and loading more than one first virtual image, and displaying the same on the display interface of the electronic device; determining a moving path of the first virtual image according to a predefined mapping information; and performing a predefined action instruction according to changes in the coordinate position of the electronic device, so that the first virtual image moves in the image displayed on the display interface according to the moving path. Accordingly, during the interaction with a player, the player must cooperate with the first virtual image to move, so as to improve the reality simulation effect in interaction.

Description

Augmented reality interactive method and system thereof

The present invention relates to an interactive method and system thereof, and more particularly to an interactive method and system for augmenting reality.

Focusing on the latest technology issues, you will find that whether it is Virtual Reality, Augmented Reality, or even Mixture Reality, it is dramatically changing the world of human visual sense.

Among them, AR mainly adds some virtual objects in the real space, and the users basically still exist in the real world. Take the most popular mobile game "Pokémon Go" as an example, which is the most application of AR. Good representative, in "Pokémon Go", the player can reach the position of the elf according to the map guide, and then watch the virtual elf and baby ball in the real image through the mobile phone screen. In this way, a visual effect of throwing a baby ball in a real environment to capture various elves is generated.

However, during the game, it is not difficult to find that the aforementioned virtual sprite can only be in the fixed position, but can not interact with the player in position change. In other words, "Pokémon Go" successfully takes the player Out of the outdoors, but most of the players still only play in the fixed position, so it creates a screen of a fixed-point game like a zombie.

Accordingly, it is an object of the present invention to provide an interactive method and system for augmented reality that enhances the immersive effects of interaction.

Thus, the interactive method for augmenting reality of the present invention is implemented by a network server communicating with an electronic device, including a display interface capable of presenting a real-world image, for calculating a coordinate position of the coordinate device. A positioning module, a communication module for outputting a position message, and a processor, the position information including the coordinate position, and the augmented reality interaction method comprises the following steps:

(a): providing an application installed on the electronic device, wherein the electronic device loads more than one first virtual image and displays on the display interface of the electronic device to start interaction.

(b): receiving the location information, and acquiring a coordinate location of the electronic device according to a predefined map information, where the map information includes a road marking corresponding to the road of the real environment and a building identifier corresponding to the real environment.

(c): determining a moving path of the first virtual image according to the map information.

(d): moving the first virtual image in the screen displayed by the display interface of the electronic device according to the preset movement instruction according to a preset motion instruction.

The augmented reality interactive system of the present invention communicates with an electronic device, and the electronic device includes an image capturing module for capturing a real-world image in a physical environment, and a display interface for loading the real-world image. And a positioning module for calculating the coordinates of the coordinates, the interactive system of the augmented reality includes:

a web server, providing an application installed on the electronic device, capable of receiving a location message from the electronic device, acquiring a coordinate position of the electronic device, and loading more than one first virtual image and displaying a display interface of the electronic device, and determining a moving path of the first virtual image according to a predefined map information, and executing a predefined action instruction according to the change of the coordinate position of the electronic device, where the map information includes The road marking corresponding to the road of the real environment and the building marking corresponding to the real environment, the motion command is used to move the first virtual image according to the moving path on the screen displayed by the display interface of the electronic device.

The effect of the present invention is to cause the first virtual image to move in the real image according to the moving path. In this way, during the interaction with the player, the player must cooperate with the first virtual image to move, thereby enhancing the immersive effect of the interaction.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same reference numerals.

Referring to Figures 1 and 2, an embodiment of an augmented reality interactive system of the present invention communicates with an electronic device 1. In the embodiment, the electronic device 1 includes an image capturing module 11 for capturing the real-world image A in the physical environment, a display interface 12 for loading the real-world image A, and a coordinate for calculating the coordinates. a positioning module 13 of position L1 (Fig. 6), a communication module 14 for outputting a position message S1, and the image capturing module 11, the display interface 12, the positioning module 13, the communication module The group 14 is electrically connected to a processor 15. The position information S1 includes the aforementioned coordinate position L1. The image capturing module 11 is a photographic lens in this embodiment. The display interface 12 is a touch screen in this embodiment. In this embodiment, the positioning module 13 is a GPS module that receives the GPS signal. When not limited thereto, the positioning module 13 can also be a Wifi module that receives the Wifi signal. In addition, it should be noted that the electronic device 1 may be a portable mobile communication device, a tablet, smart glasses, or a smart contact lens that omits the image capturing module 11 .

The augmented reality interactive system includes a web server 2.

Referring to FIG. 2, FIG. 3, FIG. 6, and FIG. 7, the network server 2 is combined with the steps of the first embodiment, and is described as follows:

Step 31: An application is installed on the electronic device 1. The application 15 is executed by the processor 15 of the electronic device 1. The electronic device 1 loads the real-world image A and one or more first virtual images R1. The plurality of second virtual images R2 and the plurality of third virtual images R3 are displayed on the screen of the display interface 12 of the electronic device 1 to start interaction.

In this embodiment, the first virtual image R1 is an elf chasing the player, and the second virtual image R2 is a replenishment pill of the accumulated bonus points P, and the third virtual image R3 is capable of causing the player to catch up. The exposed power pill, and a plurality of second virtual images R2 are sequentially arranged between the adjacent two third virtual images R3.

Step 32: Receive a location message S1 from the electronic device 1, and acquire a coordinate position L1 of the electronic device 1 according to a predefined map information M. In this embodiment, the map information M adopts a google map, and includes a road sign M1 corresponding to the road of the real environment, and a building sign M2 corresponding to the structure of the real environment.

Step 33: Determine a moving path T of the first virtual image R1 according to the map information M. In this embodiment, the movement path T defines a trajectory from the placement position L2 to the current coordinate position L1 of the electronic device 1 according to the map information M, and the placement position L2 is separated from the real environment by the coordinate position L1. At least 1 meter or more.

Step 34: Calculate a relative position of the first virtual image R1 and the coordinate position L1 of the electronic device 1 according to a preset first motion instruction, and make the first virtual image R (not shown) according to a preset. The speed of the moving path T moves relative to the coordinate position L1.

It should be noted that, in this embodiment, the interaction is a pursuit game, and if the player is caught by the first virtual image R1, the phased interaction will end. Therefore, if the player does not want to end the interaction, he must go quickly. , or running, or changing the walking path to avoid being caught by the first virtual image R1.

Step 35: Calculate the moving speed V and the moving distance D of the electronic device 1 according to the position change of the electronic device 1 in one unit time.

Step 36: Determine whether the aforementioned moving speed V is greater than a comparison value V ₀ . If not, proceed to step 37, and if yes, proceed to step 38.

Step 37: The real image A is loaded, and the real image A, the first virtual image R1, the second virtual image R2, and the third virtual image R2 are displayed on the display interface 12 of the electronic device 1. Then, the interaction I shown in FIG. 4 and the interaction II shown in FIG. 5 are performed.

It should be noted that, in the embodiment, in step 31 and step 37, when the display interface 12 of the electronic device 1 displays the real image A, the first virtual image R1, the second virtual image R2, and the second virtual image R2. The third virtual image R2 is sequentially displayed in the middle of the display interface 12.

Step 38: The map information M is loaded, and the first virtual image R1, the second virtual image R2, and the third virtual image R2 are displayed on the map information M in the display interface 12 of the electronic device 1. Then, the interaction I shown in FIG. 4 and the interaction II shown in FIG. 5 are performed.

When the player starts to walk or run, it is not suitable for staring at the display interface 12 of the electronic device 1, and is not suitable for capturing the real image A. Therefore, switching to the map information M helps the player to quickly browse the first The relative position of the virtual image R1 to the player and the approximate distance from the player's location L1.

Interaction I, see Figure 3, Figure 4, and Figures 2, 6, and 7.

Step 40: Determine whether the moving distance D is equal to a multiple of the reverse distance D ₁ according to a preset reverse distance D ₁ . If not, proceed to step 41. If yes, proceed to step 43.

It should be noted that the distance actually separated by the third virtual image R3 in the map information M is equivalent to the reverse distance D ₁ .

Step 41: It is determined whether the current coordinate position L1 of the electronic device 1 is the same as the position of any one of the first virtual images R1 in the map information M. If yes, proceed to step 42, and if no, return to step 35.

Step 42: Execute a predefined second action instruction, transmit a status message S2, display it on the display interface 12 of the electronic device 1, and end the phased interaction. This status message S2 is used in this embodiment to inform the end of the interaction.

According to the foregoing, when the location of the first virtual image R1 in the map information M is the same as the coordinate position L2 of the player, it indicates that the player has been caught by the first virtual image R1.

Step 43: Remove the third virtual image R3 closest to the coordinate position L1. In this way, on behalf of the Seto, eating a powerful pill, you can reverse the rules and eat the elf representing the first virtual image R1.

Step 44: The first virtual image R1 is moved in a direction opposite to the coordinate position L1 within a preset inversion time t according to a random path.

Step 45: It is judged whether the inversion time t is reached, if yes, return to step 35, and if no, proceed to step 46.

Step 46: It is determined whether the current coordinate position L1 of the electronic device 1 is the same as the position of any one of the first virtual images R1 in the map information M. If yes, proceed to step 47, and if no, return to step 45.

Step 47: The first virtual image R1 of step 44 is removed, and a predetermined number of bonus points P are accumulated, and then, return to step 35.

Thereby, the player should avoid being chased by the first virtual image R1, and end the interaction, and can also reverse the situation according to the moving distance D of the player (ie, the electronic device 1), and catch up with the first virtual image R1, and how many bonus points are obtained. Number P.

Interaction II, see Figure 3, Figure 5, and Figure 2, Figure 6, Figure 7.

Step 48: Determine whether the moving distance D is equal to a multiple of the unit distance D ₂ according to a preset unit distance D ₂ . If yes, proceed to step 49. If no, return to step 35. The aforementioned unit distance D _{2 is} smaller than the aforementioned reverse distance D ₁

Step 49: The second virtual image R2 closest to the coordinate position L1 is removed, and a bonus point P is accumulated, and the process returns to step 35.

In the presentation of the screen, the fruit is eaten according to the movement of the player, whereby the player can also avoid the catching of the first virtual image R1, and can also according to the moving distance D of the player (ie, the electronic device 1). , decide how many bonus points P to get, and cooperate with the game design, so that the player can accumulate the bonus points P and carry out more game play during the walking process, because the general knowledge in the field can infer the expansion details according to the above description. Therefore, there is no more explanation.

Referring to Figure 8, there is shown a second embodiment of the present invention which is substantially identical to the first embodiment except that:

This second embodiment omits the interaction II. Thereby, although there is no second virtual image R2 in the second embodiment, the player can still avoid being caught by the first virtual image R1 during fast walking, running, or changing the walking path, or The first virtual image R1 is chased after the situation is reversed, and interacts with the first virtual image R1.

Through the above description, the advantages of the foregoing embodiments can be summarized as follows:

The present invention enables the first virtual image R1 to move in the display interface of the electronic device 1 according to the moving path T or in a random manner, and interacts with the player in the real environment, not only can the player be successfully Bringing out the outdoors, and during the interactive game, the player must move with the first virtual image R1, thereby enhancing the immersive effect of the interaction.

However, the above is only the embodiment of the present invention, and the scope of the invention is not limited thereto, and all the simple equivalent changes and modifications according to the scope of the patent application and the patent specification of the present invention are still Within the scope of the invention patent.

1‧‧‧Electronic device

11‧‧‧Image capture module

12‧‧‧Display interface

13‧‧‧ Positioning Module

14‧‧‧Communication module

15‧‧‧ processor

2‧‧‧Web server

31~49‧‧‧Step process

A‧‧‧real image

S1‧‧‧Location Message

L1‧‧‧ coordinates

L2‧‧‧ placement

R1‧‧‧ first virtual image

R2‧‧‧ second virtual image

R3‧‧‧ third virtual image

P‧‧‧ reward points

M‧‧‧Map Information

M1‧‧‧ road marking

M2‧‧‧ building sign

T‧‧‧Moving path

V‧‧‧ moving speed

V ₀ ‧‧‧ comparison value

D‧‧‧Moving distance

D ₁ ‧‧‧Reverse distance

D ₂ ‧‧‧unit distance

t‧‧‧Reversal time

S2‧‧‧ Status Message

Other features and advantages of the present invention will be apparent from the embodiments of the present invention, wherein: Figure 1 is a schematic diagram illustrating an interactive method of augmented reality of the present invention and a first preferred embodiment of the system Figure 2 is a block diagram of the first embodiment; Figure 3 is a flow chart of the first embodiment; Figure 4 is a flow chart of the interaction I in the first embodiment; Figure 5 is the first FIG. 6 is a schematic diagram illustrating that the first embodiment loads a first virtual image and a plurality of second virtual images and displays a display interface of an electronic device; FIG. Is a schematic diagram illustrating that the first embodiment loads a map information and displays the display interface of the electronic device; and FIG. 8 is a schematic diagram illustrating the interactive method of the augmented reality of the present invention and a second of the system thereof Preferred embodiment.

Claims (11)

An interactive method for augmenting reality is implemented by a network server communicating with an electronic device, including a display interface capable of presenting a real-world image, and a positioning module for calculating a coordinate position a communication module for outputting a location message, and a processor, wherein the location information includes the coordinates of the coordinates, and the method for interacting the augmented reality comprises the following steps: (a) providing an application installed on the electronic device For the electronic device to load more than one first virtual image and display the display interface of the electronic device to start interaction; (b): receiving the location information, and acquiring the electronic device according to a predefined map information a coordinate position of the device, the map information includes a road marking corresponding to the road of the real environment, and a building marking corresponding to the real environment; (c): determining a moving path of the first virtual image according to the map information; and (d ): causing the first virtual image to follow the moving path in the electronic device according to a preset motion instruction Moves in the screen displayed by the display interface. The method for interacting with the augmented reality according to claim 1, wherein the moving path in the step (c) is a trajectory defining a placement position to a current coordinate position of the electronic device according to the map information, the placement position and the The coordinate positions are spaced apart by the distance of the real environment. The method of interacting with the augmented reality according to claim 2, wherein the action instruction of step (d) comprises: calculating a relative position of the coordinate position of the first virtual image and the electronic device according to a preset moving speed And moving the first virtual image relative to the coordinate position. The method for interacting with the augmented reality according to claim 3, wherein the step (d) includes the step (d-1), and the first virtual image is displayed on the electronic device according to the moving path according to the action instruction. Moving in the screen displayed by the interface, step (d-2), calculating the moving speed of the electronic device and the moving distance according to the position change of the electronic device in one unit time, and step (d-3), determining the movement Whether the speed is greater than a preset comparison value, and if yes, performing step (d-4), presenting the foregoing real-world image displayed on the display interface of the electronic device, and if not, performing step (d-5) to load the map Information and display on the display interface of the electronic device. The method for interacting augmented reality according to claim 4, wherein the step (a) further loads the plurality of second virtual images, so that the second virtual image is displayed in a screen of the display interface of the electronic device. The method for interacting augmented reality according to claim 5, further comprising the step (e) after the step (d): determining, according to a preset unit distance, whether the moving distance is equal to a multiple of the unit distance, if Yes, proceed to step (f), if no, go back to step (d-2), step (f): remove the second virtual image closest to the coordinate position, and accumulate a bonus point, then return to the step (d-2). The method for interacting with the augmented reality according to claim 5, further comprising the step (g) after the step (d): determining whether the current coordinate position of the electronic device is in the map information with any of the first virtual images. The location is the same, if yes, proceed to step (h), if not, return to step (d-2); and step (h): execute another predefined action command. The method for interacting with augmented reality as claimed in claim 7, wherein the action instruction of step (h) comprises transmitting a status message and displaying the display interface of the electronic device. The method of interacting with augmented reality as described in claim 8, wherein the status message is used to inform the end of the interaction. The method for interacting augmented reality according to claim 7, further comprising the step (i) after the step (d): determining whether the moving distance is equal to a multiple of the reverse distance according to a preset reverse distance If yes, proceed to step (j), if not, perform step (g), step (j), causing the first virtual image to be reversed from the coordinate according to a random path within a preset inversion time Position shift, the reverse distance is greater than the unit distance, step (k): determining whether the reverse time is reached, if yes, returning to step (d-2), if not, performing step (1), step (1) : determining whether the current coordinate position of the electronic device is the same as the position of any of the first virtual images in the map information, and if yes, performing step (m), if not, returning to step (k), step (m) : The first virtual image of step (1) is removed, and a predetermined number of bonus points are accumulated, and then, return to step (d-2). An augmented reality interactive system for communicating with an electronic device including a display interface capable of presenting a real-world image, a positioning module for calculating a coordinate position, and a position information outputting a communication module, and a processor, the location information includes the coordinate position, the augmented reality interactive system includes: a network server, providing an application installed on the electronic device, and receiving the location information, and Obtaining a coordinate position of the electronic device according to a predefined map information, and loading one or more first virtual images, displaying the display interface of the electronic device, and then making the first according to a preset motion instruction The virtual image moves in the screen displayed on the display interface of the electronic device according to the moving path.