TWI568481B - Augmented reality game system and method - Google Patents

Description

Augmented reality game system and method

The present invention relates to an augmented reality game system and method, and more particularly to an augmented reality game system and method for pre-creating a virtual space.

Survival games are very popular game projects in recent years. However, when playing a game, it is often limited by the venue or the number of people to make the game less fun. For example, when the number of participants is too small, it may not be possible to group them smoothly. At this time, if a virtual player can be introduced as a general electronic game, the situation of insufficient number of people can be obtained. As a technique for introducing virtual players into survival games, augmented reality is a project worth considering. In addition, Augmented Reality technology can also introduce virtual images into the field of survival games to simulate objects or terrain, making the game more versatile.

However, in the general survival game, the situation often hides behind the bunker. Therefore, if the augmented reality technology constructs the virtual target as a virtual player, the virtual target must be a three-dimensional image and not only on a flat image. Appears and must be able to perform more complex interactions with players or users. Considering that the current augmented reality technology mostly uses a sensor such as a camera to scan and augment the real-world target (such as an AR card or a QR code) to generate a virtual target, it is difficult to make it possible to move around freely and with the player. The virtual target of interaction. Therefore, in order to meet the needs for survival games, it is necessary to construct a virtual target using an augmented reality approach different from the current technology.

In view of the above-mentioned problems of the prior art, it is an object of the present invention to provide an augmented reality system and method for enabling a player to easily survive and enjoy more fun.

According to one aspect of the present invention, an augmented reality game method is proposed. The augmented reality game system includes a processor and a wearable display device. The processor reads the environmental data of the real environment, creates a virtual space according to the environmental data, and creates a virtual target in the virtual space. The wearable display device is coupled to the processor, and the processor receives the information of the virtual target and causes the user to see the target image of the virtual target mapped to the real environment.

Preferably, the wearable display device can be a head mounted display device.

Preferably, wherein the augmented reality game system may further comprise a smart device. The smart device is connected to the wearable display device. The wearable display device can use the antenna included in the smart device as the signal transceiver, or use the storage unit included in the smart device as the data storage, or use the display light source included in the smart device as the image display source.

Preferably, wherein the augmented reality game system may further comprise a signal transmitter. The user can use the signal transmitter to send a shooting signal, the shooting signal contains the direction and position information, the processor calculates the interaction result with the virtual target in the virtual space according to the shooting signal, and maps the interaction result to the target image of the real environment. .

Preferably, wherein the target image is a three-dimensional image.

According to another object of the present invention, an augmented reality game method is proposed. The augmented reality game method includes reading environmental information of the real environment to the processor; the processor creates a virtual space according to the environmental data; the processor creates a virtual target in the virtual space; and the processor transmits the information of the virtual target The wearable display device is provided for the user to see the target image of the virtual target mapped to the real environment from the wearable display device.

Preferably, the wearable display device is a head mounted display device.

Preferably, the wearable display device is connected to the smart device, and is transmitted or received by the antenna included in the smart device, or stored by the storage unit included in the smart device, or displayed by the display light source included in the display device. image.

Preferably, the method for augmenting the reality game further comprises the user transmitting the shooting signal by using the signal transmitter, the shooting signal includes a position and direction message; the processor receives the shooting signal, and calculates the virtual signal according to the shooting signal. The interaction result of the virtual target interaction; and the processor transmitting the interaction result to the wearable display device, so that the user sees the result of the interaction result mapped to the target image of the real environment from the wearable display device.

Preferably, wherein the target image is a three-dimensional image.

As described above, the augmented reality system and method of the present invention may have one or more of the following advantages:

(1) The augmented reality system and method can map a virtual image in a virtual space, thereby allowing the user to see the corresponding target image without any object in the real environment.

(2) The augmented reality system and method can perform complex actions corresponding to the target images seen in the real environment by pre-writing the active script of the virtual target.

(3) The augmented reality system and method can make the game more varied by generating a plurality of virtual images in the virtual space, thereby allowing the user to see a corresponding plurality of target images in the real environment. .

1, 2‧‧‧user end

10‧‧‧ processor

20‧‧‧Wear-type display device

30‧‧‧Smart device

40‧‧‧Signal transmitter

100‧‧‧Real environment

200‧‧‧virtual space

300‧‧‧virtual targets

400‧‧‧ Target image

401‧‧‧Virtual object imagery

402‧‧‧virtual environment imagery

403‧‧‧Virtual material image

A, A’‧‧‧ points

P11, P12, P13, P14‧‧

S11, S12, S13, S14, S21, S22, S23‧‧‧ steps

Figure 1 is a system block diagram of a first embodiment of the augmented reality game system of the present invention.

Fig. 2 is a flow chart showing the first embodiment of the augmented reality game method of the present invention.

Figure 3 is a schematic diagram showing the stages of the first embodiment of the augmented reality game system of the present invention.

Figure 4 is a system block diagram of a second embodiment of the augmented reality game system of the present invention.

Figure 5 is a system block diagram of a third embodiment of the augmented reality game system of the present invention.

Figure 6 is a flow chart showing a third embodiment of the augmented reality game method of the present invention.

Figure 7A is a front elevational view of the image seen by the user of the fourth embodiment of the augmented reality game system of the present invention.

Figure 7B is a side elevational view of the image seen by the user of the fourth embodiment of the augmented reality game system of the present invention.

Figure 8 is a schematic diagram of an image seen by a user of a fifth embodiment of the augmented reality game system of the present invention.

Figure 9 is a schematic diagram of an image seen by a user of a sixth embodiment of the augmented reality game system of the present invention.

The technical features, contents, and advantages of the present invention, as well as the advantages thereof, can be understood by the present inventors, and the present invention will be described in detail with reference to the accompanying drawings. The subject matter is only for the purpose of illustration and supplementary description. It is not necessarily the true proportion and precise configuration after the implementation of the present invention. Therefore, the scope and configuration relationship of the attached drawings should not be limited to the scope of patent application of the present invention. Narration.

The embodiments of the augmented reality game system and method according to the present invention will be described below with reference to the related drawings. For ease of understanding, the same components in the following embodiments are denoted by the same reference numerals.

Please refer to FIG. 1 and FIG. 2 , which are respectively a flowchart of a system block diagram and an augmented reality game method of the augmented reality game system of the present invention. In the first diagram, the augmented reality game system of the present invention includes a processor 10 and a wearable display device 20. In step S11 of Fig. 2, the processor 10 reads the environmental data of the real environment. In step S12, the processor 10 creates a virtual space based on the environmental data. In step S13, the processor 10 creates a virtual target in the virtual space. Finally, in step S14, the wearable display device 20 is connected to the processor 10, and the processor 10 receives the information of the virtual target and allows the user to see the target image of the virtual target mapped to the real environment.

More specifically, please refer to FIG. 3, which is a schematic diagram of various stages of the first embodiment of the augmented reality game system of the present invention. In the figure, stages P11, P12, P13 and P14 correspond to steps S11, S12, S13 and S14 of Fig. 2, respectively. In stage P11, after determining the venue for the game, the environmental data of the real environment 100 is read by the processor. Thereafter, in stage P12, the processor 10 creates the virtual space 200 by the environmental data received in the stage P11. In phase P13, processor 10 generates virtual target 300 in virtual space 200. most Thereafter, in stage P14, the processor 10 transmits the message of the virtual target 300 to the wearable display device 20, so that the user wearing the wearable display device 20 can see the target image 400 corresponding to the virtual target 300. That is, the wearable display device 20 transmits the information of the location and the angle of view to the processor 10, and the processor 10 determines whether the virtual target 300 will be seen when the user is in the virtual space 200, and When the virtual target 300 can be seen, the virtual target 300 should appear in the user's field of view. In this way, since the virtual space 200 is created according to the data of the real environment 100, the virtual space 200 and the real environment 100 can completely correspond to the terrain, location, and the like. When it is determined that the virtual target 300 should be visible to the user in the virtual space 200, the processor 10 transmits the corresponding information to the wearable display device 20 worn by the user, so that the user sees through the wearable display device 20. In the real environment 100, a target image 400 is superimposed thereon. For example, in stage P14 of FIG. 3, when the user wears the wearable display device 20 at point A in the real environment 100 and faces the low wall, the wearable display device 20 transmits its position and viewing angle. To the processor 10. Thus, the processor 10 can find the corresponding location point A' in the virtual environment 200 and determine that the user is facing the low wall when in the virtual environment 200. Next, the processor 10 determines that the user sees the virtual target 300 whose upper body is exposed to the low wall in the virtual environment 200, and transmits the message back to the wearable display device 20. The user can see through the wearable display device 20 that the target image 20 is superimposed on the low wall of the real environment 100, so that the user sees the scene similar to the low wall and hides the person. The virtual target 300 is not only moved in a fixed place after being generated, but may be based on a script action written by the designer in advance, and the processor 10 immediately transmits a message to the wearable display device 20 so that the user can also see. The target image 400 projected to the virtual world 100 to the real world 100 is based on the situation of the script activity.

Preferably, the wearable display device 20 can be a head mounted display device.

Where the wearable display device 20 is a head mounted display device, the imaging element of the wearable display device 20 can be positioned in front of the user's eyes, for example, the imaging member can be formed in the form of eyeglasses. The wearable display device 20 can be integrally fixed to the user's head, so that the wearable display device 20 is not easily detached even if the user has a vigorous activity in the game.

Please refer to FIG. 4, which is a system block diagram of a second embodiment of the augmented reality game system of the present invention. In the figure, the augmented reality game system may further include a smart device 30. The smart device 30 is connected to the wearable display device 20. The wearable display device 20 can use the antenna included in the smart device 30 as the signal transceiver, or use the storage unit included in the smart device 30 as the data storage, or use the display light source included in the smart device 30 as the image display source. .

That is to say, when the game progresses, the user terminal 1 can include the wearable display device 20 and the smart device 30, and the wearable display device 20 can be electrically or physically connected to the smart device 30. The smart device 30 can be a smart phone, a smart watch, or the like. Since the smart device 30 is almost an item carried by everyone, the wearable display device 20 uses the functions included in the smart device 30 in conjunction with the smart device 30. For example, the smart device 30 has an antenna device for external signal transmission. When the wearable display device 20 is combined with the smart device 30, the antenna of the smart device 30 and the processor 10 can be used for signal transmission. . In another embodiment, the smart device 30, such as a smart phone, can use the card of the wearable display device 20 to fix the smart device 30 in front of the user's eyes, and the user can utilize the display screen of the smart device 30. The real environment in which it is seen, as well as the target image 400 produced by the message from processor 10 is seen. In still another embodiment, the wearable display device 20 is electrically connected to the smart device. 30. The storage device inside the smart device 30 is used to store information such as time, personal settings, and scores of the game.

Please refer to FIG. 5, which is a system block diagram of a third embodiment of the augmented reality game system of the present invention. In the figure, the augmented reality game system may further include a signal transmitter 40, and the user terminal 2 may include the wearable display device 20, the smart device 30 and the signal transmitter 40 at the same time. The user can use the signal transmitter 40 to send a shooting signal, the shooting signal includes the direction and position information, and the processor 10 calculates the interaction result of interacting with the virtual target 300 in the virtual space 200 according to the shooting signal, and maps the interaction result to the real environment. 100 target image 400.

Specifically, the signal transmitter 40 can be gun-shaped, for example, can be made into a rifle, and the user pulls the trigger to send a firing signal to the processor 10 to simulate the effect of shooting the bullet. Please refer to FIG. 6, which is a flowchart of a third embodiment of the augmented reality game method of the present invention. In the figure, in step S21, the user transmits a shooting signal by the signal transmitter 30, and the processor 10 receives the shooting signal, and the shooting signal contains the direction and position information. That is to say, the firing signal can be used to simulate where the user is emitting and where to fire the bullet. At step S22, the processor 10 calculates the interaction result of the firing signal with the virtual target 300 in the virtual space 200, such as whether the result of hitting the virtual target 300, and returns the interactive result to the wearable display device 20 in step S23. For example, if it is determined that the bullet hits the virtual target 300, the script of the virtual target 300 can be written to the virtual target 300 and then falls to the ground after the shot is fired, and the processor 10 can return to the result of determining that the virtual target 300 has fallen to the ground. The display device 20 is displayed, and the user can see through the wearable display device 20 that the target image 400 in the real environment 100 is down. Alternatively, in a case where it is determined that the bullet does not hit the virtual target 300, the script of the virtual target 300 can be written to the virtual target 300 to find a mask when a shooting signal is emitted nearby without being hit, and thus, use The target image 400 in the real environment 100 is seen through the wearable display device 20 looking for masking.

Preferably, the target image 400 can be a three-dimensional image.

Please refer to FIG. 7A and FIG. 7B , which are respectively a front view and a side view of the image seen by the user of the fourth embodiment of the augmented reality game system of the present invention. When the processor 10 determines that the user should see the front side of the virtual target 300 in the virtual space, the signal transmitted by the processor 10 to the wearable display device 20 causes the user to see the image as shown in FIG. 7A. In FIG. 7A, the processor 10 can determine that the lower half of the virtual image 300 is blocked by the low wall according to the current location and direction of the user, so that the signal transmitted by the processor 10 to the wearable display device 20 is only used. The upper body of the virtual image 300 is seen (in FIGS. 7A to 9 , the broken line indicates the target image 400 seen by the user, and the solid line indicates the real object in the real environment). It should be noted that the low wall seen by the user at this time is a real low wall, and the target image 400 seen seems to be partially blocked by the real low wall. Referring to FIG. 7B, when the user position is determined to be in the virtual space 200 on the side of the virtual image 300 and the low wall, the processor 10 transmits to the user that the target image 400 is not blocked by the low wall. side. Therefore, the target image 400 of the present invention can be a three-dimensional stereoscopic image, and the display image method of the wearable display device 20 can be further adjusted. For example, the parallax of the two eyes can be used to make the target image 400 seen by the user more stereoscopic. sense.

Please refer to FIG. 8 , which is a schematic diagram of an image seen by a user of a fifth embodiment of the augmented reality game system of the present invention. In the figure, the virtual target 300 and the corresponding target image 400 that the processor 10 can generate are not limited to virtual players, and can also generate a virtual environment or an item. For example, as shown in the figure, processor 10 can create a virtual low wall in virtual environment 300 and Combine with real low walls in environmental data. After transmitting this message to the wearable display device 20, the user can see the virtual environment image 402, that is, it can be seen that the low wall seems to be lengthened. Of course, the modifications that can be made to the augmented reality system and method of the present invention are not limited thereto, such as virtual smoke images and virtual flame images. The use of such a virtual environment image can increase the complexity of the game when the real environment 100 is too monotonous, thereby increasing the user's interest in the game. Further, the processor 10 can also generate the virtual item image 401. As shown in FIG. 8, the virtual item can be a flag, and the processor 10 transmits the message of the virtual item to the wearable display device 20, so that the user can The wearable display device 20 sees the virtual item image 402. When the processor determines that the position of the user coincides with the position of the virtual item, that is, the virtual flag, the processor transmits a message to the wearable display device 20 that the user has snatched the banner. This can increase the likelihood of implementing different types of games and make the game more varied.

In addition, the augmented reality game system and method of the present invention can also modify the appearance of the terrain in the original real environment 100. Specifically, when constructing the real environment 100 for playing games, the materials used may cause a sense of discomfort to the user due to cost or safety considerations. For example, the aforementioned low wall can be made of rubber in order to prevent the user from being injured, but seeing the rubber wall in the survival game scene may make the user feel awkward. More specifically, please refer to FIG. 9, which is a schematic diagram of an image seen by a user of a sixth embodiment of the augmented reality game system of the present invention. In the figure, the processor 10 of the augmented reality game system or method of the present invention can also generate a virtual material according to the terrain of the real environment 100 according to the designer's pre-design, and transmit the virtual material message to the wearable display device 20. In the user's field of view, the virtual material image 403 is attached to the surface of the low wall in the real environment 100, and the low wall is made to look like, for example, a brick. Similarly, the virtual material image can also contain the surface of the environment that the user sees. Row processing, for example, depreciation of the wall surface that the user sees, such as mottled or stained, allows the user to have a sense of presence when playing the game.

The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.

100‧‧‧Real environment

200‧‧‧virtual space

300‧‧‧virtual targets

400‧‧‧ Target image

A, A’‧‧‧ points

P11, P12, P13, P14‧‧

Claims (10)

An augmented reality game system, comprising: a processor, which reads an environmental data of a real environment, creates a virtual space according to the environmental data, creates a virtual target in the virtual space; and wears a display device Connected to the processor, the processor receives the information of the virtual target, and causes a user to see the virtual target mapped to a target image of the real environment; and a smart device connected to the wearable A display device using the smart device to include a display light source as an image display source. The augmented reality game system of claim 1, wherein the wearable display device is a helmet-type display device. The augmented reality game system according to claim 1, wherein the wearable display device uses the smart device to include one antenna as a signal transceiver, or uses the smart device to include one of the storage units. As a data storage. The augmented reality game system of claim 1, further comprising: a signal transmitter, wherein the user uses the signal transmitter to send a shooting signal, the shooting signal includes a direction and a position message, The processor calculates an interaction result of interacting with the virtual target in the virtual space according to the shot signal, and maps the interaction result to the target image of the real environment. An augmented reality game system as described in claim 1, wherein the target The image is a three-dimensional image. An augmented reality game method, comprising: reading an environment data of a real environment to a processor; the processor creates a virtual space according to the environment data; the processor creates a virtual target in the virtual space; And the processor transmits the information of the virtual target to a wearable display device, so that a user sees the virtual target from the wearable display device to map to a target image of the real environment; wherein the wearable display device Connected to a smart device, and the image is displayed by the smart device including one of the display light sources. The augmented reality game method of claim 6, wherein the wearable display device is a helmet type display device. The augmented reality game method of claim 6, wherein the wearable display device comprises one antenna for transmitting and receiving signals, or the smart device includes one of the storage units for storing data. . The method for augmented reality game according to claim 6 , further comprising: the user transmitting a shot signal by using a signal transmitter, the shot signal includes a position and direction message; and the processor receives the shot signal And calculating an interaction result with the virtual target interaction in the virtual space according to the shooting signal; The processor transmits the interaction result to the wearable display device, so that the user sees from the wearable display device the result of mapping the interaction result to the target image of the real environment. The augmented reality game method of claim 6, wherein the target image is a three-dimensional image.