CN110882536A

CN110882536A - Chess and play game system based on AR equipment

Info

Publication number: CN110882536A
Application number: CN201811043010.8A
Authority: CN
Inventors: 房晓俊; 张宇
Original assignee: Taap Yi Hai (shanghai) Technology Co Ltd
Current assignee: Taap Yi Hai (shanghai) Technology Co Ltd
Priority date: 2018-09-07
Filing date: 2018-09-07
Publication date: 2020-03-17

Abstract

The invention provides a chess and a chess playing game system, wherein the chess comprises a chessboard and chess pieces, the chessboard which is subjected to virtual-real fitting is displayed simultaneously through the visual field of AR display equipment, real chess pieces and virtual chess pieces are displayed on the chessboard which is subjected to virtual-real fitting, and the chess pieces comprise go, Chinese chess, military chess, Chinese checkers or flight chess. The chess game playing system comprises the chess, AR display equipment and network equipment, wherein the network equipment is used for carrying out network link on the AR display equipment in one space and the plane display equipment and the VR display equipment in the other space or on the other pair of AR display equipment.

Description

Chess and play game system based on AR equipment

Technical Field

The present invention relates to an interactive system, and more particularly, to a chess and an AR device-based chess game system, wherein the chess game system is applied to a virtual-real interactive chess game, and real chess game is interacted with virtual images.

Background

Augmented Reality (AR) is a branch of virtual Reality technology, and is an important means for multimedia technology to be implemented in the three-dimensional field, and images, videos, 3D models and the like are projected to human eyes together with real environment light, so that people feel that virtual images are observed in the real world, and the technology aims to cover the virtual world on a screen in the real world and interact with the virtual world. The existing augmented reality technology is mainly applied to medical treatment, manufacture and maintenance, television virtual broadcasting and other aspects.

The chess game is popular with people since birth, can lead people to experience the pleasure of the game in the game process, can also enhance the mental power of people and improve the intelligence level of players. In addition, the chess game has entertainment and education functions and is an important means for people to communicate with each other in daily life, and friends or acquaintances communicate with each other through mutual communication in the process of the real-world game, so that the feelings of the friends are deepened. If the chess is played with strangers, the chess can be played by friends through communication in the chess playing process, and therefore new friends can be reached. The types of chess games are also various, such as weiqi, Chinese chess, military chess and the like, different people have different preferences, and each kind of chess game has different game rules, which is also the reason why people enjoy chess games.

The player can touch the chessboard and the chessmen in the actual playing process of the chess game, hear the sound of falling chessmen in the playing process and the sound communicated with the game player, and watch the moving process of the chessmen in real time, thereby giving a sense of reality and experience. Some players think about the strategy of playing chess by the gesture of holding chess with fingers in the chess playing process, which are the reasons for enhancing people's favor of playing chess games. The pure physical chess playing game can be played only by using the same chessboard when players are in the same place at the same time, but because the life rhythm is accelerated at present, two players can hardly play the game by drawing out the time at the same time. In particular, it is also largely impossible for friends in two different places to increase the friendship between two persons by playing a game of chess.

With the development of computer technology and the selection of people for life diversity, many games which can only be played in reality before are designed to be 'electronic games', and the electronic games are installed on electronic equipment terminals such as mobile phones, computers or PADs. People interact with man-machines through the terminal devices or "fight" friends or strange players in a network environment. With the gradual improvement of games, the electronic games bring great convenience to players, for example, game programs carried by terminal devices can help beginners to learn playing methods of playing chess, guide the steps of playing chess of the beginners, and the like.

In fact, people cannot realize the reality of chess playing real objects in the chess playing game played by a computer or other equipment, and people always play chess with a machine. If people fight through Artificial Intelligence (AI), such as an alpha dog, but because of the imbalance in difficulty, it is difficult for users to appreciate the enjoyment of the game, either win the game very easily or lose the game. In addition, the benefit of enhanced interpersonal communication of the chess game itself is lost in the face of "machine" chess playing. Secondly, the chess playing in the virtual world, no matter the game is man-machine interaction or the game is played by the player through the network space, when the player can not touch the real chess pieces in the game process, the player can not hear the real sound when the player and the opponent play the chess pieces, and the player gradually loses the interest of the game playing chess and the fun in the game process.

Further, it is also designed that players play a game by operating a robot arm, but the robot arm is difficult to be suitable for most players due to the high cost of mechanical manufacturing and processing.

The invention with application number 201810050821.4 provides a near-eye see-through head-display optical system, which includes a first lens, a second lens and a miniature image display, wherein the first lens and the second lens are both attached to the miniature image display, and the first lens and the second lens are both uniform-thickness free-form surface lenses. By the optical system structure of the near-eye perspective head display provided by the invention, the times of light refraction in the optical system structure can be reduced, and the aberration of light emitted by the miniature image display in each direction can be eliminated, so that the image can not be subjected to aberration when the miniature image display is seen in each direction and angle.

The utility model discloses an application No. 201821172477.8 provides an AR display device on the basis of above-mentioned optical system, wherein AR display device includes at least one show/projector and at least one optical device, and real image passes through optical device constitutes, and the virtual image passes through show/projector constitutes in optical device, real image and virtual image combine to appear in same visual field, wherein optical device includes at least one main lens and at least one free-form surface lens, the free-form surface lens is used for reflecting the image that show/projector throws; and the main lens is used for reflecting the image projected by the display/projector again. This AR equipment can accomplish big visual angle, small, light weight, wears the experience that the user can have immersive AR and feels.

The invention with application number 201810994555.0 further provides a head-mounted virtual-real interaction device and a virtual-real interaction method based on the aforementioned patent, wherein the head-mounted virtual-real interaction device comprises a head-mounted AR display device for displaying at least a 3D virtual image in a field of view of the head-mounted AR display device; and the virtual-real interaction device is used for acquiring the behavior action or the control instruction of the person wearing the head-mounted AR display equipment and changing or controlling the content of the 3D virtual image according to the behavior action or the control instruction.

Disclosure of Invention

One of the main advantages of the present invention is to provide a new chess and game playing system, which shows a real chessboard or a chessboard which can simultaneously show a virtual-real fit through the viewing field of the AR display device, and shows the real chess pieces and virtual chess pieces on the real chessboard or the chessboard which shows a virtual-real fit. Different (at least 2) users in different air experience the near play reality.

According to some embodiments of the invention, the chess includes, but is not limited to, go, chess, military chess, checkers, or flight chess, among others.

According to some embodiments of the present invention, a virtual chessboard is formed by the AR display device acquiring the length, width and height information of the real chessboard and the plate lines on the real chessboard. For example, the surface line refers to the longitude and latitude line and/or the surface contour line of the go board.

According to some embodiments of the invention, the real chessboard is provided with an altimeter, a gyroscope, an identification bar code for positioning, an identification two-dimensional code for positioning, or the plate line with light positioning. The dish surface line with the light positioning function is characterized in that lamps such as LEDs are arranged below the transparent or light-transmitting dish surface line, and light emitted by the lamps passes through the dish surface line of the chessboard to form the dish surface line with the light transmission effect. The chessboard is also provided with a power supply module for supplying power to various sensors or LED lamps and the like which need electricity.

According to some embodiments of the invention said real chess board is provided with a microphone or a pressure sensor or a pressure circuit switch for positioning the real chess pieces.

According to some embodiments of the invention the base of the pawn is provided with a magnet.

According to some embodiments of the present invention, the real chessboard is correspondingly provided with electromagnetic inductors or grid circuits. And the cross points of the grid circuit are provided with magnetosensitive sheets or contact points.

According to some embodiments of the invention, the pawn is a glass-shell LED pawn or a plastic-shell LED pawn. The LED emits light or does not emit light, and the LED emits light with different colors according to setting.

The invention further provides a (different-space interactive) chess playing game system, which comprises the AR display device in addition to the chessboard and the chess pieces in the same space. This is the simplest stand-alone mode, including players, boards, pawns and AR display devices.

According to some embodiments of the invention, further comprising ① a flat display device, ② VR display device, or ③ another said piece of chess and another said AR display device, in another space;

the method also comprises B (multiple connection modes of 3 Unet dual-machine modes) that the AR display device in one space is directly linked with the ① plane display device and the ② VR display device in the other space or ③ that the AR display device in the other space, but not limited to the playing of both sides.

According to some embodiments of the present invention, the AR display device in one space assumes a role of a background server for dual-machine interactive operation. The AR display device in any space is the processor of the own, and also takes charge of the background servers of both parties, that is, the relationship between the master and the slave, and the master AR display device takes charge of the background servers of both parties. Of course, the background SERVER of the third party can be used as the master, and the foreground processors of the first party and the second party can be used as the slaves.

According to some embodiments of the present invention, in network mode, the AR display device in one space is network-linked with the ① flat panel display device, the ② VR display device in another space, or the ③ another pair of the AR display devices.

According to some embodiments of the invention, the network link comprises a local area network link, a wide area network link, or an internet of things link.

According to some embodiments of the invention, the network device links at least two different spaces, and at least one pair of the chess pieces and one pair of the AR display devices are provided in each of the different spaces. It is suitable for special multi-side game mode-square military chess and hexagonal Chinese checkers, etc..

According to some embodiments of the present invention, the network device includes a background server for supporting interactive operations of the parties.

According to some embodiments of the invention the background server comprises a memory for storing a chess game database, chess board information, and/or a path trajectory or a falling order of the pieces for each different party. The chessboard information comprises length, width and height, chessboard surface information and the like.

According to some embodiments of the invention, the backend server further comprises a determining module or a hosting module,

the judging module is used for judging the size of the chess pieces or judging the win-or-lose of the chess playing according to the chess playing rules in the chess playing game database;

and the escrow module is used for replacing an instruction-escrowing party with a chess-playing rule in the chess-playing game database to play virtual chess. The images of the virtual pawns appear in the system and in the display devices of the parties.

According to some embodiments of the invention, a virtuality-reality fit chessboard is simultaneously visualized through the AR display device, the planar display device, or the VR display device, and the real chess pieces and the virtual chess pieces are visualized on the virtuality-reality fit chessboard.

According to some embodiments of the present invention, the AR display device in the one space visualizes the real chess board at the 1 st perspective (of the present party), or visualizes the real chess board at the 1 st perspective and the virtual chess board (of the other party) at the same time, and visualizes the real chess piece at the 1 st perspective and the virtual chess piece (at the 1 st perspective) (of the spatial position) at the other party on the real chess board or the virtual-real fitted chess board. Wherein, the 1 st visual angle is the viewing angle of the own party at playing, the 2 nd visual angle is the viewing angle of the other party at playing (a certain party), and the 3 rd visual angle is the viewing angle of the non-playing participant, or is called the view angle of the emperor and is regarded as the viewing angle of the bystander.

According to some embodiments of the invention, logging into the network device, presenting the virtual chess board through the ① AR display device, ② VR display device, or ③ flat display device of a non-chess game direct participant, and presenting the virtual chess pieces of each party on the virtual chess board.

Some embodiments according to the invention comprise an immersive head-mounted display device, an AR all-in-one machine, a digital glass mirror, a digital glass desktop, a display, a smart mobile device, or an AR helmet connectable to said smart mobile device.

According to some embodiments of the invention, the immersive head-mounted display device comprises an image-mounted display, a transmissive head-mounted display, or an image-transmissive combined head-mounted display.

With the help of the immersive head-mounted display device and the virtual-real interactor (see invention application No. 201810994555.0), the user can also perform virtual chess pieces in the virtual chessboard and interact with users in different spaces (either users fitting virtual-real or users playing virtual chess in the same virtual chessboard). The size of the virtual chessboard can be determined according to user settings.

The invention has at least one of the following beneficial effects:

1. the chessboard and the chessmen provided by the invention allow users to play games in different spaces by using the real chessmen, and the users can really experience the hand feeling of the real chessboard and the chessmen of the own party and the visual sensation and the sound sensation which are not affected when the two parties play games. Both parties play chess on a real chessboard, and the feeling and feedback can meet the visual, auditory and tactile feelings of players when playing chess to the maximum extent.

2. The chess provided by the invention can transmit the operation images of other game players in other spaces to the own space in real time through the AR equipment, so that the players in the own space can experience real game feeling.

3. The chess and chess playing game system provided by the invention can allow a player to play games in a plurality of game modes such as a stand-alone game, a player fighting game and the like by using real chess pieces in a own space, and can assist the user to play games through a hosting mode or a judgment module so as to give the player a game pleasure combining virtual and reality.

4. The invention provides a chess and a chess playing game system, which enables players to obtain virtual game images of game players in different spaces in the real space of the players and play virtual and real games with the players of the opposite side through game operation carried out on the players.

5. The chess and chess playing game system provided by the invention enables bystanders (non-participants of the game) to have an opportunity to acquire virtual and real combined game images at the visual angles of game players in different spaces. Namely, the game progress can be viewed from the 1 st view of a certain player, and the game progress can also be viewed from the god view (the 3 rd view).

6. AR go (game) is a better experience than VR go or PC go because vision, hearing and touch are fed back simultaneously. As long as both parties use the AR device/equipment provided by the invention, similar Song ● Zhao teacher-show poem Yougu (Youge passenger) yellow plum season family rain and green grass pond everywhere frogs can not appear. If the chess pieces are not about to fall in the middle of the night, the chess pieces are knocked down to fall off the flowers. The user does not have to pay during the process of tuning, centering, and paying.

Further objects and advantages of the invention will be fully apparent from the ensuing description and drawings. These and other objects, features and advantages of the present invention will become more fully apparent from the following detailed description, the accompanying drawings and the claims.

Drawings

FIG. 1 is a system block diagram of a chess game system according to a first preferred embodiment of the present invention.

FIG. 2 is a conceptual diagram of the chess playing game system according to the first preferred embodiment of the present invention.

FIG. 3A is a system block diagram of a chess game system according to a first preferred embodiment of the present invention.

FIG. 3B is a system diagram of a chess game system according to a first preferred embodiment of the present invention.

FIG. 4A is a system diagram of the man-machine interaction mode of the chess playing game system according to the first preferred embodiment of the present invention.

FIG. 4B is a system diagram of the player interaction mode of the chess game system according to the first preferred embodiment of the present invention.

FIG. 5 is a diagram of a player's usage scenario of the chess game playing system according to the first preferred embodiment of the present invention.

FIG. 6 is a first implementation of the board fitting of the chess gaming system according to the first preferred embodiment of the present invention.

FIG. 7 is a second implementation of the board fitting of the chess game system according to the first preferred embodiment of the present invention.

FIG. 8 is a third embodiment of the board fitting of the chess game system according to the first preferred embodiment of the present invention.

FIG. 9A is a fourth embodiment of the board fitting of the game system according to the first preferred embodiment of the present invention, wherein the current virtual board image and the actual board are not fitted.

FIG. 9B is a fourth embodiment of the board fitting of the chess game system according to the first preferred embodiment of the present invention, wherein the current virtual board image and the actual board are adjusted to fit each other.

FIG. 10 is a fifth implementation of the board fitting of the chess game system according to the first preferred embodiment of the present invention.

FIG. 11A is a schematic diagram of a display interface of a player of the chess game system according to the first preferred embodiment of the present invention.

Fig. 11B is a schematic view of a display interface of an opponent player of the chess game system according to the first preferred embodiment of the present invention.

FIG. 12 is a schematic diagram of a virtual space generated by the chess game playing system according to the first preferred embodiment of the present invention.

FIG. 13A is a diagram illustrating virtual chess piece image fitting of the chess game system according to the first preferred embodiment of the present invention, wherein the current perspective is the perspective of the player of the other party.

FIG. 13B is a schematic diagram of the virtual chess piece image fitting of the chess game system according to the first preferred embodiment of the present invention, wherein the current viewing angle is the viewing angle of the opponent player.

FIG. 14 is a diagram of another embodiment of virtual chess piece image fitting of the chess game system according to the first preferred embodiment of the present invention.

Fig. 15A is a schematic view of another game application of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a Chinese checkers game.

Fig. 15B is a schematic view of another game application of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a flight chess game.

Fig. 16A is a schematic view of an application of another game of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a chinese chess game.

Fig. 16B is a schematic view of an application of another game of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a chess game.

Fig. 17A is a schematic view of another game application of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a virtual space diagram of a military chess game.

Fig. 17B is a schematic view of another game application of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a schematic view of a perspective of a player of a military chess game.

Fig. 18 is a system block diagram of the chess game system according to the second preferred embodiment of the present invention.

FIG. 19 is a diagram illustrating a game scenario of the chess game playing system according to the second preferred embodiment of the present invention.

Fig. 20 is a system block diagram of the chess game system according to the third preferred embodiment of the present invention.

Fig. 21A is a schematic view of the chess game system according to the third preferred embodiment of the present invention.

Fig. 21B is a game scene diagram of the chess playing game system according to the third preferred embodiment of the present invention.

Fig. 22 is a game interaction method of the chess game playing system according to the first preferred embodiment of the present invention.

Detailed Description

The following description is presented to disclose the invention so as to enable any person skilled in the art to practice the invention. The preferred embodiments in the following description are given by way of example only, and other obvious variations will occur to those skilled in the art. The basic principles of the invention, as defined in the following description, may be applied to other embodiments, variations, modifications, equivalents, and other technical solutions without departing from the spirit and scope of the invention.

It will be understood by those skilled in the art that in the present disclosure, the terms "longitudinal," "lateral," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in an orientation or positional relationship indicated in the drawings for ease of description and simplicity of description, and do not indicate or imply that the referenced devices or components must be in a particular orientation, constructed and operated in a particular orientation, and thus the above terms are not to be construed as limiting the present invention.

It is understood that the terms "a" and "an" should be interpreted as meaning that a number of one element or element is one in one embodiment, while a number of other elements is one in another embodiment, and the terms "a" and "an" should not be interpreted as limiting the number.

Referring to fig. 1 to 10 of the drawings of the present invention, a chess game system according to the present invention is set forth in the following description, wherein said chess game system collects information on a real object actually existing in a real environment, and acquires image information of the collected real object of the real environment, and fits the image information of the real environment to the real object; the chess game playing system also receives virtual image information and projects the virtual image information to a real environment. In other words, the chess game system allows a user to operate interactively with a real object and a virtual image that are actually present in a real environment. Further, according to another aspect of the present invention, the chess game system of the present invention is applied to at least one chess game, allowing a user to play chess by manipulating chess pieces, a board, and a virtual chess piece board image. Particularly, the virtual-real interactive chess playing game allows at least two players to respectively operate the chess pieces of the own party in different spaces, play chess and the image information of the chess pieces, the chessboard and the like generated by the other players in the space of the own party. It will be appreciated that a user or player may simultaneously present a virtual-to-real fitted chess board through the field of view of the AR display device, and present real and virtual chess pieces on said appearing virtual-to-real fitted chess board. It is worth mentioning that the chess includes go, chess, military chess, checkers or flight chess. According to a first preferred embodiment of the present invention, the type of said chess is herein described by way of example only and not by way of limitation.

It will be appreciated that the chess game system allows different users to interact with the video information of other players in their respective physical operating spaces by manipulating their own physical objects or other items capable of being informative. The chess playing game system receives operation information of other users or players and projects a virtual image of the operation information into a real operation space of the own user; the chess playing game system collects response information made by a user of the own party after receiving virtual images of operation information of other players, wherein the response information can be sound information or action image information; the chess game system converts the corresponding information of the own user into image information to be projected to the real operation space of other players, so that other players can obtain the operation information of the own user and respond to the operation information of the own user.

In detail, the chess playing game system comprises at least one reality information acquisition module 10 (also called a virtual reality interactor, see the invention with application number 201810994555.0 for details), at least one augmented reality module 20 connected with the reality information acquisition module 10 in communication, an interactive fitting module 30, and a network device 200 (optional). Any of the real information collecting modules 10 is used to collect information of actual objects or objects existing in the current real environment, wherein the information includes image information, sound information, and operation or action information of the objects. The information of the actual article in the current real environment that real information acquisition module 10 gathered is transmitted to augmented reality module 20 with interactive fitting module 30, by interactive fitting module 30 will the information of the actual article in the real environment that information acquisition module 10 gathered correspondingly generates a virtual image information, interactive fitting module 30 correspondingly generates ground virtual image information is provided to augmented reality module 20, by augmented reality module 20 provides a virtual image information to the user based on current real environment to make the user correspondingly see a virtual image information in real environment. It will be understood by those skilled in the art that the virtual image information may be from the operation space of the current user, that is, the interactive fitting module 30 fits the operation information of the current user to the augmented reality module 20. Accordingly, the virtual image information may also come from other operation spaces or operation information of other users.

It is worth mentioning that, the so-called stand-alone mode is the information collecting module 10 of the chess game system, and the augmented reality module 20 and the interactive fitting module 30 may be implemented by an AR display device 100. Briefly, the AR display device 100 includes the information acquisition module 10, the augmented reality module 20, and the interactive fitting module 30.

It is understood that the so-called dual mode is that the interactive fitting module 30 is configured as a server of the chess game system, or the interactive fitting module 30 is a component of the server of the chess game. It will be understood by those skilled in the art that the interactive fitting module 30 may be integrated in the AR display device 100, or may be implemented as a separate computing device, wherein the server is communicatively connected to the AR display device 100 to interactively transmit the information collected by the display information collecting module 10.

In the chess playing game system, the AR display device 100 in one space simultaneously shows the real chess board and the virtual chess board of the side at the 1 st perspective, and shows the real chess pieces of the side at the 1 st perspective and the virtual chess pieces of the other parties (multi-party participants) on the imaginary-real fitted chess board. Preferably, said virtual board and said virtual pawns are fitted to a real board and a real pawn. Likewise, the AR display device 100 in another space can also display the real chess piece of the present party and the virtual chess piece of the other party.

Therefore, the network mode is a mode in which the network device 200 is used to transmit and receive the virtual image information. The image information, the sound information, and the like in the real environment acquired by the real information acquisition module 10 are transmitted to the augmented reality module 20 and the interactive fitting module 30 via the network device 200. Similarly, the network device 200 is further configured to receive a virtual image message and/or a sound message, and transmit the received virtual image message and/or sound message to the augmented reality module 20 and the interactive fitting module 30, so that the augmented reality module 20 provides the received virtual image message and/or sound message to the user, so that the user can obtain the virtual image message and the sound message received by the network device 200 at the same time of obtaining the real environment information. It will be understood by those skilled in the art that the augmented reality module 20 allows the user to receive the virtual image information while viewing the object information in a real environment. In other words, the augmented reality module 20 projects the light emitted from the real object in the real environment and the light generated by the virtual image information to the eyes of a user at the same time, so that the virtual image and the real object in the real environment are displayed on the same screen. It is understood that the user perceives, when viewing, that the real object in the real environment and the virtual image are in the same space.

It should be noted that any one of the real information collecting modules 10 of the chess game system is used for collecting actual information of a real space, wherein the actual information may be image information of an object existing in the real space, or sound information, image action information, and the like generated in the real space. Therefore, when the chess game system comprises two or more real information acquisition modules 10, the chess game system can be used for acquiring the actual information of a plurality of real spaces, wherein the real spaces can be the real spaces belonging to different environments and different places.

Correspondingly, the chess playing game system also comprises two or more augmented reality modules 20, the augmented reality modules 20 provide the real environment information of the current space and the virtual image information acquired by the real information acquisition module 10 of the chess playing game system for the user at the same time, wherein the virtual image information comprises the virtual image information acquired by the current space and the virtual image information acquired by the real information acquisition module 10 in other real environments, so that the user can acquire the actual information of the current environment and the virtual image information of other spaces at the same time. In other words, the augmented reality module 20 of the chess game system acquires virtual image information in other real environments and fits the virtual image information in the current environment.

It will be understood by those skilled in the art that the real information of a real space acquired by any of the real information acquisition modules 10 is transmitted to the augmented reality module 20 of the current space via the network device 200, and the real environment information and the virtual image information of the current environment of the user can be provided by the augmented reality module 20 of the current space. In addition, the network device 200 in the current environmental space receives actual information of a real space acquired by the real information acquisition module 10 in other environmental spaces, and then the virtual image information and the real environmental information of the current environment are provided to the user in a fitting manner by the augmented reality module 20.

It should be noted that the chess game system converts the actual image information of different environmental spaces into a virtual image information through the interactive fitting module 30, and transmits the generated virtual image information to the augmented reality modules 20 of different environmental spaces, respectively. In other words, the chess playing game system obtains the actual image information of an environmental space through the real information collecting module 10 of the current environmental space, wherein the actual image information includes the operation information of the user and the image of the actual object in the environmental space, and provides the virtual image information of other environmental spaces to the augmented reality module 20 of the current environment, so that the user interacts with the virtual image by operating the actual object in the current physical space.

As shown in fig. 1, the reality information collecting module 10 includes an image information collecting module 11 and a sound information collecting module 12, wherein the image information collecting module 11 is used for collecting image information of a real object in a real environment, wherein the image information may be picture information, graphic information, or movie animation information. The image information collected by the image information collection module 11 of the real information collection module 10 is transmitted to the interactive fitting module 30, and then the received image information of the current environment collected by the image information collection module 11 is processed by the interactive fitting module 30, and a virtual image information of the real environment is extracted. The interactive fitting module 30 transmits the extracted virtual image information to the augmented reality module 20 of the current environmental space and provides the extracted virtual image information to other augmented reality modules 20. Similarly, the image information acquired by the image information acquisition module 11 in the other environmental space is processed by the interactive fitting module 30 and then provided to the augmented reality module 20 in the current environmental space, and the augmented reality module 20 provides the real environmental information and the virtual image information corresponding to the other environment to the user synchronously.

Preferably, the image information collecting module 11 is implemented as a camera device, wherein the camera device is capable of collecting the entity image information in the current environment. More preferably, the received image information collecting module 11 is further configured to transmit the collected physical image information to the interactive fitting module 30 in real time through the network device 200. It should be noted that, according to the first preferred embodiment of the present invention, the image capturing device 11 is only used as an example and is not limited thereto. The implementation of the image information collecting module 11 according to other preferred embodiments of the present invention can also be applied thereto, as long as the image information of the real environment can be obtained, and the present invention is not limited thereto.

The sound information collecting module 12 of the reality information collecting module 10 is used for collecting sound information of the current environment, wherein the sound information includes sound generated by a user and sound generated during operation of the user. Preferably, the sound information collected by the sound information collection module 12 is transmitted to the augmented reality module 20 in another environmental space through the network connection module 40, so that the image information generated by the user operation is transmitted to another user synchronously with the sound information.

Preferably, the sound information collection module 12 of the reality information collection module 10 is implemented as a microphone device. More preferably, the sound information of the environmental space collected by the microphone device and the image information collected by the image information collecting module 11 are transmitted to the augmented reality module 20 in real time. It should be noted that, according to the first preferred embodiment of the present invention, the sound collection device 12 is implemented as a microphone device, which is only used as an example and is not limited herein. The implementation of the sound collection module 12 according to other preferred embodiments of the present invention can also be applied to this embodiment, as long as the sound collection module can obtain the sound information of the real environment, and the present invention is not limited thereto.

Referring to fig. 1 and 2 of the drawings, the augmented reality module 20 of the chess game system is used for providing a user with virtual and real coexisting environmental information. In other words, the augmented reality module 20 of the chess game system provides the received virtual image information and sound information of the current environmental space and the other environmental spaces collected by the reality information collecting module 10 to the user, so that the user can obtain the virtual image information of the other environmental spaces at the same time of obtaining the current real environmental information.

Accordingly, the augmented reality module 20 includes an image projection module 21 and a sound transmission module 22. The image projection module 21 of the augmented reality module 20 is configured to provide virtual image information to a user. It should be noted that the image projection module 21 provides the virtual image information to the user in the real environment space, so that the user can acquire the virtual image information while acquiring the current environment space view. It is understood that the image projection module 21 of the augmented reality module 20 provides the virtual image information to the user, which includes images, graphic information, video motion information, and the like. In other words, the image information acquired by the reality information acquiring module 10 in other environmental spaces is processed by the interactive fitting module to obtain the virtual image information, wherein the virtual image information is projected to the current environmental space by the image projecting module 21 of the augmented reality module 20.

It should be noted that the image projection module 21 of the augmented reality module 20 projects the virtual image information into the current environment space in real time, so that the user can obtain the virtual image information in time and interact with the virtual image information in real time.

The sound delivery module 22 of the augmented reality module 20 is configured to deliver sound information to the current ambient space. It is understood that the sound information collected by the sound information collection module 12 of the reality information collection module 10 is transmitted to the sound transmission module 22 of the augmented reality module 20 via the network device 200, and then the sound information is transmitted to the current environment space by the sound transmission module 22. Preferably, the sound transmission module 22 of the augmented reality module 20 is implemented as an earphone device or a loudspeaker device, and sound information is transmitted to the current user through the sound transmission module 22.

It should be noted that the image information and the sound information of an environmental space collected by the reality information collecting module 10 are synchronously transmitted to the image projecting module 21 and the sound transmitting module 22 of the augmented reality module 20 by the network device 200, so that a user can synchronously capture the virtual image information and the sound information of the environmental space. Namely, when playing chess, the visual sense, the auditory sense and the tactile sense of the user are simultaneously satisfied, and the user is immersed in the three-sense enjoyment similar to the real chess playing.

It should be noted that the augmented reality module 20 of the chess game system according to the first preferred embodiment of the present invention is only used as an example and not a limitation in the present invention. Accordingly, other implementations of the augmented reality module 20 according to other embodiments of the present invention may also be applied herein, as the present invention is not limited in this respect.

As shown in fig. 1 and fig. 2 of the accompanying drawings, the interactive fitting module 30 of the chess game system is used for processing the image information of the real object in the current environmental space acquired by the real information acquisition module 10 to generate a virtual image information corresponding to the image information, wherein the virtual image information is obtained by arranging all or part of the image information acquired by the real information acquisition module 10. The virtual imagery information is fitted to the augmented reality module 20 of the current environmental space and to the augmented reality module 20 of the other environmental space. In addition, the image information of different environmental spaces acquired by the real information acquisition module 10 of different environmental spaces is also fitted into a virtual environmental space. It is understood that the virtual environment space may receive the virtual image information corresponding to the image information acquired by the real information acquisition module 10 from different real environment spaces. In other words, the virtual image information corresponding to different environment spaces is correspondingly fitted and displayed in the same virtual environment space.

It will be understood by those skilled in the art that the interactive fitting module 30 of the chess game system is used to fit virtual image information to the augmented reality module 20 so that the user can correspond to each other when acquiring real image information and virtual image information. It can be understood that the real image and the virtual image correspond to each other, and the real image and the virtual image correspond to each other. The static correspondence means that the virtual image corresponds to the real image in a static process. It is understood that the real image is projected directly to the user's eyes through the augmented reality module 20, so the virtual image is adjusted to fit the real image by adjusting the size and projection angle of the virtual image through various adjustment methods. The dynamic correspondence refers to a dynamic change of the real image information acquired by the augmented reality module 20 in the moving process of the augmented reality module 20. Accordingly, the corresponding virtual image moves along with the movement of the augmented reality module 20, and the outline and the imaging angle of the virtual image also change, so that the virtual image always corresponds to the real image acquired by the current real environment.

As shown in fig. 1, the interactive fitting module 30 further includes a solid fitting module 31, a virtual image fitting module 32, and a virtual-real fitting module 33. The entity fitting module 31 is configured to fit the image information of the current real environment acquired by the real information acquiring module 10 of the current environmental space to the augmented reality module 20 of the current environmental space. In other words, the real image information of the current environmental space is collected, and then processed into a virtual image information by the entity fitting module 31, and then the virtual image information is fitted to the augmented reality module 20 of the current environmental space. The augmented reality module 20 in the current environmental space projects the virtual image information processed by the entity fitting module 31 to the user together with the real environmental information in the current environmental space. It can be understood that, the user obtains the actual image information in the current environmental space through the augmented reality module 20, and also obtains the virtual image information obtained by the entity fitting module 31 of the interactive fitting module 30 after processing the actual image information in the current environmental space.

The virtual image fitting module 32 of the interactive fitting module 30 is configured to convert at least two different pieces of the image information acquired by the real information acquisition module 10 into virtual image information, and integrate the virtual image information into virtual image information in a virtual space by the virtual image fitting module 32. It should be noted that, the virtual image fitting module 32 does not simply superimpose the image information acquired by the real information acquisition module 10, but correspondingly sets the virtual images generated by the corresponding entity objects in different environmental spaces in the virtual space based on a specific angle and spatial position.

Accordingly, the virtual-real fitting module 33 of the interactive fitting module 30 is configured to obtain a virtual image information after being processed based on the image information collected by the real information collecting module 10, and fit the virtual image information to the augmented reality module 20 corresponding to other space. In other words, the virtual-real fitting module 33 of the interactive fitting module 30 is used for receiving the virtual image information corresponding to other environmental spaces and fitting the acquired virtual image information to the augmented reality module 20 of the current environmental space.

It should be noted that the virtual image information obtained by processing the actual image information in the current environmental space by the entity fitting module 31 of the interactive fitting module 30 is a real object corresponding to the actual existence in the current environmental space. Therefore, the external contour of the virtual image corresponds to the real object contour of the real object in the current environmental space, and the imaging angle of the virtual image is also adjusted to be suitable for the angle of the augmented reality module 20 in the current environmental space for providing the real image information.

It should be noted that the real information collecting module 10 is used for collecting image information corresponding to an actual object in an environmental space in real time, and when a position relationship of the object in the environmental space changes, or the object is increased/decreased, or a shape of the object changes, the image information of the current environmental space collected by the real information collecting module 10 changes, so that virtual image information corresponding to any one of the augmented reality modules 20 also changes, and the virtual image information corresponding to the virtual space also changes.

In accordance with another aspect of the present invention, there is further provided an interactive method of a chess game system, comprising the steps of:

acquiring virtual image information and projecting the virtual image information to an environment space;

acquiring response information of at least one article in the environment space based on the virtual image information; and

and fitting virtual image information based on the collected response information.

Referring to fig. 3A to 14 of the drawings, a first embodiment of a chess game system based on the chess game system according to a first preferred embodiment of the present invention will be described in the following description. The chess game system is applied to a go game, a gobang game, a Chinese checkers game or a game with a plurality of undifferentiated chessmen, such as a flight chess game. It will be appreciated that there are two or more of the above types of game pieces, each player operating one of the types of game pieces; both parties/multiple parties share the same chess playing system to operate game chess pieces, and the chess piece placement positions can be determined through the longitude and latitude lines or the square lines of the chess pieces placement in the chessboard. The virtual-real interactive game allows a user to operate a real game tool to interact with virtual game image information generated by the system based on the principle of the chess game system, wherein the virtual game image may be image information acquired by the real information acquisition module 10 when another game player operates the real game tool, or a virtual game image generated by the chess game system.

It will be appreciated that the chess playing game system allows at least one player to operate a real game tool in a real environment space to play a "man-machine interaction game" mode with the game system, or play a "player battle game" mode with other players.

Fig. 3A to 5 show a chess game of the chess game system according to the first preferred embodiment of the present invention. FIG. 4A illustrates a user wearing an AR device to operate the board and pieces of the I-go game in an environmental space in human-machine engagement with the game play system. In other words, the user interacts with the virtual game image generated by the game playing system by wearing the AR device to operate the go board and the chess pieces. The AR device includes the reality information collecting module 10, the augmented reality module 20, the interactive fitting module 30 and the network device 200 of the chess game system. It will be appreciated that the reality information capture module 10 of the chess game system is embodied as a camera device, wherein the camera device is mounted to the AR device so as to capture the field of view of the environment in front of the user. The augmented reality module and the interactive fitting module 30 are integrally provided in the AR device. The interactive fitting module 30 fits the obtained virtual image information to the augmented reality module 20, and provides the actual image information in the current real environment and the fitted virtual image information to the user wearing the AR device through the augmented reality module 20. Accordingly, the user can simultaneously acquire the actual image information in the current real environment and the fitted virtual image information by wearing the AR device.

FIG. 4B illustrates at least two users respectively wearing an AR device to operate the playing boards and playing pieces of a I-go game in different environmental spaces to play a space-by-space game match between players. It is worth mentioning that in the player battle mode, the AR device worn by the user is the same as the AR device worn by the user in the interpersonal battle mode, but the difference is that the source of the virtual image information obtained by any user in the game process is different. Any user operates the weiqi pieces in the current real environment space to interactively fight with the image information of a virtual piece. In the player fighting mode, the virtual chess piece image information acquired by one player is the virtual chess piece image information generated by the real chess piece images acquired by the AR devices worn by other players. It will be appreciated that a user wearing the AR device is able to capture the virtual Weiqi piece image and respond accordingly based on the actual piece condition of his own chess. The reality information collecting module 10 of the chess game system collects the response action information of the user operating the weiqi pieces, and converts the collected response action information into the virtual image information of the corresponding pieces by the interactive fitting module 30.

It should be noted that, according to the first preferred embodiment of the present invention, in the player match mode of the chess game system, the AR devices operated by the users may be configured to be the same AR devices, that is, the AR devices are identical in structure and function to the AR devices in the human-machine match module. It will be understood by those skilled in the art that the chess game system can also be configured as a main AR device, and at least one auxiliary AR device communicatively connected to the main AR device, wherein the main AR device comprises the reality information collecting module 10, the augmented reality module 20, the interactive fitting module 30 and the network device 200 of the chess game system. Correspondingly, the auxiliary AR device includes the reality information collecting module 10, the augmented reality module 20, and the network device 200, and the auxiliary AR device receives and transmits game interaction information to the interaction fitting module 30 of the main AR device through the network device 200. It can be appreciated that the primary AR display device in one space assumes the role of a background server for dual-machine interactive operation.

It will be appreciated by those skilled in the art that, with the UNET networking technology of Unity, two users who need to play games must be in the same WIFI network, and that, no matter which device first starts the program, the device that first starts the program can act as a (background) server, and when another device starts the program, it will automatically connect to the previous server.

When the two devices are successfully connected, the chess player can enter the position for selecting the chess side, and after the selection is finished, the two devices enter a chess playing interface

The grid coordinate in front of the left sides of the chessboard of the two parties is set to be (0,0) in the virtual chess, and when the coordinate positions of the virtual chess pieces are synchronized, the two parties are synchronized, and the coordinates are converted. The conversion mode is as follows:

suppose the coordinates of the chess pieces below the first square are (0,0), then (19,19) is displayed below the second square, and (1,0) is displayed below the first square, (18,19), then the conclusion is that the position of the chess pieces on the first square is (X, Y), then (19-X,19-Y) is displayed on the second square.

Similarly, the positions of the chess pieces on the second party (X, Y) are also (19-X,19-Y) displayed on the first party.

And (3) graphic display: generating and displaying (after edge finding and fitting) a weiqi board and chessmen of a second party in a superimposed manner in a first space by adopting an image rendering technology of Direct3D or OpenGL; in the second space, the first square generates and superposes the weiqi board and the first square chessman in the second space; and simultaneously, generating a virtual weiqi board in a third space (network space), and superposing and displaying virtual images of the chess pieces of the first party and the second party.

OpenCV technical description OpenCV is called openSource Computer Vision Library in its entirety, and is a cross-platform Computer Vision Library. OpenCV was initiated and developed by intel corporation and issued with BSD license authorization and is available for free use in business and research areas. OpenCV may be used to develop real-time image processing, computer vision, and pattern recognition programs. The program library can also use IPP of Intel company to process the technical description of Unet in an acceleration way, namely a network interaction module of a Unity game engine aiming at networking, 2 horizontal networking devices, wherein one processor of the Unity game engine is used as a processor of the party and also used as background servers of the two parties. I.e. master-slave relationship. Of course, a background SERVER (SERVER) of a third party may be used as a master, and foreground processors of both parties a and b may be used as slaves.

The network device 200 is used to network link the AR display device 100 in one space with the flat display device, the VR display device, or another sub-AR display device 100 in another space. The connection between the network device 200 and the AR display device 100 includes a local area network link, a wide area network link, or an internet of things link. The internet of things is linked, and the specific positions of the real chess pieces on the real chessboard can be directly obtained.

It should be noted that the server of the chess game system may be disposed in the network device 200, that is, the network device 200 may further process the data collected by the AR display device 100 during the process of transmitting the data to the AR display device 100.

In accordance with the first preferred embodiment of the present invention, the network device 200 is linked to at least two different spaces, and at least one pair of the chess pieces 40 and one pair of the AR display devices 100 are provided in each of the different spaces. In other words, the network device 200 is connected to at least two AR display devices 100 for game operations by players using the AR display devices 100 in different spaces. It will be appreciated by those skilled in the art that for different classes of games the network device 200 can connect two or more of the AR display devices 100 based on the number of players and the type of game for different players to play in different spatial environments in response to the AR display devices 100. In particular, in a game of playing chess such as flight chess, square military chess, and hexagonal checkers, the network device 200 can connect a plurality of AR display devices.

Fig. 5 to 10 of the drawings illustrate the interaction process between the user and the virtual chess piece image by operating the actual chess pieces in the chess game system according to the first preferred embodiment of the present invention. The chess game system comprises the chess game system, and further comprises a chessboard 40, at least one chess piece 50 and a game management module 60. The playing board 40 is a real playing board as understood by those skilled in the art, wherein the playing pieces 50 comprise a plurality of playing

pieces

50A, 50B, etc., as shown in fig. 7 and 8, any one of the playing pieces is considered to be unique during the playing operation and can only occupy one position. The game management module 60 is used for managing the game progress of the user in the process of carrying out virtual-real game interaction, and explaining the mutual relationship between the virtual chess piece images of the virtual-real interaction game and the relationship between the virtual chess piece images and the actual chessboard.

It should be noted that the chess pieces 50 and the chessboard 40 in the chess game system can be ordinary chess pieces or chessboard, and the position information, the external contour information, etc. of the chess pieces 50 and the chessboard 40 are passed through the reality information collection module 10 in the process of virtual-real interaction with the user. It will be understood by those skilled in the art that the chess pieces 50 and the chessboard 40 in the chess game system can also be an information collection device based on the AR device worn by the user, and the information collection device transmits the position information and the contour information of the chess pieces and chessboard to the interactive fitting module 30 directly through the network device 200. In other words, the chess pieces 50 and the chessboard 40 in the chess game system are integrated in the reality information collection module 10.

The real information collecting module 10 of the chess playing game system collects the actual image information of the chessboard and the chesses of the current environment space of the user, the actual image information of the chessboard and the chesses is transmitted to the entity fitting module 31 of the interactive fitting module 30, the entity fitting module 31 obtains the image information of a virtual chessboard and the chesses based on the actual images of the chesses and the chessboard collected by the real information collecting module 10, and fits the image information of the virtual chessboard and the chesses to the augmented reality module 20. It can be understood that, the user sees the image information of the virtual chessboard and the chess pieces being superimposed on the corresponding real chessboard and the chess pieces in the real environment space through the AR device.

As will be appreciated by those skilled in the art, the augmented reality module 20 projects virtual images corresponding to real objects in the real environment into the eyes of the user. In order to prevent the virtual images of the chess pieces and the chessboard corresponding to the chess pieces and the chessboard from covering the chess pieces and the chessboard in the real environment, the entity fitting module 31 of the interactive fitting module 30 fits the virtual images of the chess pieces and the chessboard in the augmented reality module 20 in the current environment to be the frames or the outer contour lines corresponding to the chess pieces and the chessboard. It can be understood that the AR device worn on the head of the user projects the virtual image information of the external outlines or borders corresponding to the chessboard and the chessmen in the current environmental space collected by the real information collecting module 10 to the head of the user, so that the light of the chessboard and the chessmen in the display space is not covered while the user obtains the virtual image information.

It should be noted that the image information of the chess pieces and the chessboard collected by the real information collection module 10 in the current real environment is used by the entity fitting module 31 of the interactive fitting module 30 to generate a virtual frame image information corresponding to the chess pieces and the chessboard. The virtual frame image information of the chess pieces and the chessboard is projected to the eyes of the user by the augmented reality module 20.

Figure 6 of the accompanying drawings shows a first embodiment of the entity fitting process of the interactive fitting module 30 of the chess game system of the present invention. The entity fitting module 31 of the interactive fitting module 30 is implemented as a laser profile scanner, through which the height, angle, imaging parameters, etc. of the chessboard 40 and the chess pieces 50 in the real environment space are directly obtained. The entity fitting module 31 of the interactive fitting module 30 obtains the virtual image information of the chessboard 40 and the chess pieces 50 in the current environmental space directly acquired by the laser contour scanner, and transmits the virtual image information to the augmented reality module 20.

Accordingly, the augmented reality module 20 further includes a board image adjusting module 23 and a space positioning module 24. The chessboard image adjusting module 23 is configured to adjust the positions of the chess pieces image information projected to the eyes of the user on the virtual chessboard corresponding to the chess board 40 and the chess pieces 50 in the real environment space obtained by the entity fitting module 31 of the interactive fitting module 30. In other words, the board image adjusting module 23 is configured to adjust the virtual images of the board 40 and the playing pieces 50 corresponding to the position relationship of the board 40 and the playing pieces 50 in the real environment when the user wears the AR device. The virtual chessboard is adjusted in the up/down and left/right directions by the chessboard image adjustment module 23, and the virtual images corresponding to the chesses correspond to the actual position relationship between the chessboard 40 and the chesses 50.

Accordingly, the spatial positioning module 24 is used to position the augmented reality module 20 at an environmental position in space, so that the augmented reality module 20 can accurately fit the virtual image information corresponding to the chess board 40 and the chess pieces 50 to the positions corresponding to the chess board 40 and the chess pieces 50 in the real environmental space during the movement process. Preferably, the spatial location module 24 is implemented as a gyroscope.

The length, width and height information of the real chessboard and the real disc line on the chessboard are obtained through the AR display device 100 to form a virtual chessboard. That is, a virtual chessboard is directly obtained by the AR display apparatus 100 by acquiring image information of the chessboard 50 or the chess pieces 40.

The invention further provides several virtual-real fitting schemes, such as using a 2D/3D laser profile scanner to locate (e.g., go chessboard) edges, i.e., directly acquiring height, angle and imaging parameters. As will be appreciated by those skilled in the art, OpenCV is a cross-platform computer vision library issued based on BSD licenses (open sources) that can run on Linux, Windows, Android, and Mac OS operating systems. The method is light and efficient, is composed of a series of C functions and a small number of C + + classes, provides interfaces of languages such as Python, Ruby, MATLAB and the like, and realizes a plurality of general algorithms in the aspects of image processing and computer vision. The 'frame type graph' can be output by calling an edge searching function in OpenCV, and boundary searching and positioning can be carried out on the weiqi board, the longitude and latitude lines and the weiqi pieces.

OpenGL (Open Graphics Library) refers to a specialized graphical program interface that defines a cross-programming language, cross-platform programming interface specification. The method is used for three-dimensional images (two-dimensional images can also be used), and is a bottom layer graphic library which is powerful and convenient to call.

OpenGL is the most widely accepted 2D/3D graphics API in the industry, is windows or other operating systems independent, and is network transparent. OpenGL helps programmers achieve high-performance, highly-obtrusive visual representations on hardware devices such as PCs, workstations, supercomputers, etc., to address software development.

That is to say, the edge-finding fitting technology adopts the OpenCV technology to extract feature points of the chessboard through SIFT, then the feature points are input into a feature matching library, a camera of the device is used for shooting a visible picture of a visual field, then an original image is converted into a single-channel gray image, binarization processing is carried out, edge points are obtained through black-white pixel value difference, a proper area is found at the edge points, the relative distance and the coordinates of the head display and the chessboard are calculated through the combination of the processed 2D image and 3DOF, and the coordinates of the virtual chessboard of the head display are moved to be overlapped with the real chessboard.

Figure 7 of the drawings of the invention shows an alternative embodiment of the entity fitting process of the interactive fitting module 30 of the chess game system of the present invention. The real information collecting module 10 collects the image information of the chessboard 40 and the chessmen 50 in the current real environment space, and transmits the collected image information to the interactive fitting module 30, so as to extract the virtual image information corresponding to the chessboard 40 and the chessmen 50 by the entity fitting module 31 of the interactive fitting module 30, and fit the virtual image information to the augmented reality module 20.

In this alternative embodiment, at least three board positioning devices 41A are disposed in the board 40A, wherein the board positioning devices 41A are disposed at least two corners of four corners of the board 40A, respectively, and the board positioning devices 41A are used for recording current height, angle and imaging parameter information of the board 40A. The entity fitting module 31 of the interactive fitting module 30 obtains the chessboard positioning devices 41A in the chessboard 40A collected by the reality information collecting module 10. Preferably, the board positioning device 41A of the chessboard 40A is implemented as a two-dimensional code attached to the surface of the chessboard 40A, the entity fitting module 31 of the interactive fitting module 30 obtains the positioning information of the two-dimensional code in the chessboard 40A collected by the reality information collecting module 10, so as to obtain the current position of the virtual image of the chessboard 40A, and the virtual image information corresponding to the chessboard 40 is transmitted to the augmented reality module 20 by the entity fitting module 31 of the interactive fitting module 30.

Accordingly, the augmented reality module 20 further includes a board image adjusting module 23 and a space positioning module 24. It should be noted that, in the present modified embodiment, the chessboard image adjustment module 23 and the spatial orientation module 24 of the augmented reality module 20 are the same as the chessboard image adjustment module 23 and the spatial orientation module 24 in the first preferred embodiment.

Figure 8 of the drawings of the invention shows an alternative embodiment of the entity fitting process of the interactive fitting module 30 of the chess game system of the present invention. In the present modified embodiment, the chessboard 40B is implemented as a luminous chessboard device, wherein at least one information collecting lamp 41B is provided on each side of the length, width and height of the chessboard 40B and in the longitude and latitude lines of the chessboard correspondingly. It is understood that the light emitted from the information collecting lamps 41B of the length, width, height and longitude and latitude of the chessboard 40B can be identified by a light sensing device, so as to obtain the height, angle and imaging parameter information of the chessboard 40B. Preferably, the information collecting lamp is implemented as an LED lamp. Correspondingly, the chessboard is also provided with a power supply module for supplying power to each electric sensor or LED lamp. The chessboard is provided with a height meter, a gyroscope, an identification bar code for positioning, an identification two-dimensional code for positioning or the chessboard line with light positioning. The AR display device obtains the surface line information of the chessboard by scanning or irradiating the chessboard, or by sensing the sensing device of the chessboard 40B.

As will be appreciated by those skilled in the art, the pawn 50 is a glass-shell LED pawn or a plastic-shell LED pawn. The pawns 50 may send a signal to the AR display device 100, i.e. 1 gyroscope per real pawn 50, or the AR display device captures the position information of the pawn 50, thus fitting a virtual image of the pawn 50.

Accordingly, the entity fitting module 31 of the interactive fitting module 30 is implemented as a light sensing device for locating the position information, angle information, imaging parameter information, etc. of the object by collecting specific light. The entity fitting module 31 of the interactive fitting module 30 receives the actual image information of the chessboard 40B of the current real environment, which is collected by the real information collecting module 10, wherein the image information of the chessboard 40B includes the light information generated by the information collecting lamp 41B arranged in the chessboard 40B. The light information generated by the information collecting lamp 41B is identified by the entity fitting module 31 of the interactive fitting module 30, and the height, angle and imaging parameter information corresponding to the chessboard 40B in the current real environment space are obtained by the entity fitting module 31 of the interactive fitting module 30. The height, angle, and imaging parameter information corresponding to the chessboard 40B are transmitted to the augmented reality module 20 by the entity fitting module 31 of the interactive fitting module 30.

FIGS. 9A and 9B of the drawings illustrate an alternative embodiment of the entity fitting process of the interactive fitting module 30 of the chess game system of the present invention. In this modified embodiment, the real information collecting module 10 collects the image information corresponding to the chessboard 40 and the chessmen 50 existing in the current real environment space, and transmits the image information corresponding to the chessboard 40 and the chessmen 50 to the entity fitting module 31 of the interactive fitting module 30. The entity fitting module 31 extracts corresponding virtual image information based on the received image information corresponding to the chessboard 40 and the chessmen 50, and transmits the extracted virtual image information to the augmented reality module 20.

The entity fitting module 31 of the interactive fitting module 30 generates a virtual image corresponding to the chessboard 40 and the chess pieces 50, and transmits the virtual image information corresponding to the chessboard 40 and the chess pieces 50 to the augmented reality module 20. It is conceivable that the virtual chessboard 40, pieces 50 generated by the interactive fitting module 30 may have different virtual image information from the chessboard 40, pieces 50 in the real environment space, and the shape, inclination, perspective angle, size, etc. of the pieces 50. It should be noted that the difference between the above-mentioned alternative embodiments is that, in this alternative embodiment, the entity fitting module 31 of the interactive fitting module 30 generates a virtual image corresponding to the chessboard 40 and the chess pieces 50 in advance, and then adjusts information such as the imaging size and shape of the virtual image in the augmented reality module 20.

Accordingly, by adjusting the virtual image information of the playing pieces 50 received by the augmented reality module 20 to fit the playing board 40 corresponding to the real environment space, the size, shape, perspective angle, inclination, etc. of the playing pieces 50. The augmented reality module 20 further includes a board image adjusting module 23 and a space positioning module 24. The chessboard image adjusting module 23 is configured to adjust the positions of the chess pieces image information projected to the eyes of the user on the virtual chessboard corresponding to the chess board 40 and the chess pieces 50 in the real environment space obtained by the entity fitting module 31 of the interactive fitting module 30. In other words, the board image adjusting module 23 is configured to adjust the virtual images of the board 40 and the playing pieces 50 corresponding to the position relationship of the board 40 and the playing pieces 50 in the real environment when the user wears the AR device. The chessboard is adjusted in the up-down direction, the left-right direction by the chessboard image adjusting module 23, and the virtual images corresponding to the chesses are corresponding to the actual position relationship between the chessboard 40 and the chesses 50.

Accordingly, the spatial positioning module 24 is used to position the augmented reality module 20 at an environmental position in space, so that the augmented reality module 20 can accurately fit the virtual image information corresponding to the chess board 40 and the chess pieces 50 to the positions corresponding to the chess board 40 and the chess pieces 50 in the real environmental space during the movement process. Preferably, the spatial location module 24 includes a gyroscope, an altimeter, and the like.

Figure 10 of the drawings of the invention shows an alternative embodiment of the entity fitting process of the interactive fitting module 30 of the chess game system of the present invention. In this modified embodiment, the real information collecting module 10 collects the image information corresponding to the chessboard 40 and the chessmen 50 existing in the current real environment space, and transmits the image information corresponding to the chessboard 40 and the chessmen 50 to the entity fitting module 31 of the interactive fitting module 30. The entity fitting module 31 obtains height information of the chessboard 40 in the current real environment space, information of the angle at which the chessboard 40 is placed, and the like based on the received image information corresponding to the chessboard 40 and the chessmen 50. In other words, the entity fitting module 31 fits the virtual image to the chessboard 40 corresponding to the real environmental space based on the acquired image information of the chessboard 40 acquired by the real information acquisition module 10. The entity fitting module 31 determines information such as perspective angle and imaging parameters of the chessboard 40 based on the image information.

It should be noted that, in the present modified embodiment, the entity fitting module 31 obtains the image information of the entity chessboard 40 in the current environmental space based on the real information collecting module 10, and obtains the virtual image corresponding to the chessboard 40 corresponding to the image information. Therefore, when the AR device worn on the head of the user moves, the position of the camera device at the upper end of the AR device and the angle of the acquired information change, and then the size, the position, the imaging angle, and the like of the virtual chessboard image corresponding to the chessboard 40 correspondingly generated by the entity fitting module 31 also change. Namely, the virtual chessboard and the chessmen are always kept in a fitting state with the real chessboard under the condition that the real chessboard is still in the field of view of the user.

11A and 11B of the accompanying drawings illustrate the interactive fitting process of the game board of the chess playing game system of the present invention in different real spaces. It will be appreciated that two users interactively compete against the virtual chess piece that the user sees the other side by manipulating the actual chess piece in the own space in different spaces. The user acquires the position of the opposite user playing chess through the augmented reality module 20 and responds thereto by the user. The action information of the self user operating the self chess and the position information of the chess are obtained by the reality information collecting module 10, and the position information of the chess of the self user is transmitted to the augmented reality module 20 of the opposite user by the interactive fitting module 30. Thus, the users of both parties, namely the players, operate the own chess pieces to fight the virtual image. The game management module 60 is used to locate the position of each of the playing pieces 50 in the playing board 40. Accordingly, the game management module 60 further includes a coordinate defining module 61, wherein the coordinate defining module 61 describes the playing positions of the longitude and latitude lines in the chessboard 40 and describes the position of each chess piece 50 based on the position information of the chessboard 40 and the chess pieces 50 in the current real environment space acquired by the real information acquisition module 10, so that the virtual image information of the chess pieces 50 generated by the interaction fitting module 30 can be accurately projected to the accurate positions of the corresponding chessboard 40.

FIGS. 11A and 11B of the drawings show the display interfaces of the players of the two-player chess game system of the present invention. In a real operation space, the real information collecting module 10 of the chess game playing system collects the position information of the chessboard 40 and the chessmen 50 in the current operation space, and the coordinate defining module 61 of the game management module 60 defines the current position relationship between the chessboard 40 and the chessmen 50. It can be understood that the conventional weiqi board is composed of 19 horizontal lines and 19 vertical lines, and 361 intersections are provided, and the outermost lines are called border lines. Today's boards are 19 × 19, 13 × 13, 9 × 9, which are common, and some are the rarer ones 15 × 15, 17 × 17. For example, in a 19 × 19 go board, the coordinate definition module 61 of the game management module 60 gives each intersection in the board 40a two-dimensional coordinate position (0,0), (0,1) … (1,1), (1,2), (1,3), …, (19, 19). It will be appreciated that the coordinate definition module 61 of the game management module 60 may define the start of coordinates of the board 40 starting from any position. Preferably, the lower left corner in any chessboard is set as a coordinate starting point, the abscissa of the chessboard increases from left to right in sequence, and the ordinate of the chessboard increases from bottom to top in sequence. The coordinate definition module 61 of the game management module 60 defines that each pawn in the board can only occupy a fixed coordinate position, such as the position (5,16) occupied by the virtual image of the current white son.

It is worth mentioning that the user uses the position of the chessboard before the user's eyes as the starting point of the coordinates during the fighting process, that is, the coordinate position of the intersection set by the self chessboard and the coordinate position of the same intersection set by the opposite player are symmetrical about the center. In other words, the current position of the virtual white son image in the self player is (5,16), and then the position occupied by the physical white son in the opponent player's board is (14, 3). In short, the position of the physical chess piece in the self chessboard is (X, Y), and the position of the virtual chess piece image displayed in the opposite chessboard is (19-X, 19-Y).

SIFT (Scale Invariant Feature transform) -Invariant Feature transform, an efficient region detection algorithm proposed by David G.Lowe in 1999 (Object registration from Local Scale-Invariant Features), was perfected in 2004 (diagnostic Image Features from scales-Invariant Keypoints). The SIFT features are invariant to rotation, scale scaling, brightness change and the like, are very stable local features, and are widely applied at present.

Fig. 11A of the accompanying drawings shows an operation diagram of the player of the present invention, in which the game system collects image information of the chess board 40 and the chess pieces 50 in the current real environment space through the real information collection module 10, and projects virtual images corresponding to the chess board 40 and the chess pieces 50 on the augmented reality module 20 through the interactive fitting module 30. A user wearing the AR device can see virtual images of his own white physical pawns 50a and the opposing player's black pawns 50b in his own environmental space through the AR device. Accordingly, fig. 11B of the accompanying drawings shows an operation display interface of the opponent player, and the opponent player can see virtual images of the black chess pieces and the white chess pieces of the opponent player by wearing or using the AR device.

As shown in fig. 12, based on the real information collecting module 10 collecting the chessboard 40, the image information of each chess piece 50 is fitted to the same virtual chessboard. The virtual image fitting module 32 of the interactive fitting module 30 extracts the virtual image information corresponding to the actual image information of the chessboard 40 and the chessmen 50 in the real environment space collected by the at least one real information collection module 10, and fits the virtual image information to the same virtual chessboard. It can be understood that, for the human-computer interaction mode, the virtual image fitting module 32 of the interaction fitting module 30 only needs to receive image information of a player's playing piece 50 in the real environment space, extract virtual image information corresponding to the image information of the playing piece 50, and then fit a virtual image of the playing piece 50 in the virtual chessboard of the virtual space according to the position coordinate information corresponding to the playing piece 50. In the player battle mode, the interactive fitting module 30 and the virtual image fitting module 32 need to receive image information of the chess pieces 50 in different real environment spaces of the players, respectively extract virtual chess piece images corresponding to the chess pieces 50 in different spaces, and fit the virtual image information to the same virtual chessboard.

FIGS. 13A and 13B of the drawings illustrate the interaction of the operation of the two parties of the chess game system of the present invention. The virtual-real fitting module 33 of the interactive fitting module 30 projects the virtual image of the chess piece to the augmented reality module 20, and the augmented reality module 20 projects the virtual chess piece image to the eyes of the user. It should be noted that the entity fitting module 31 of the interactive fitting module 30 projects the virtual images of the chess board 40 and the chess pieces 50 of the own real environment space to the augmented reality module 20 of the current real environment, and the virtual images of the chess board 40 and the chess pieces 50 are adjustably adapted to the outline images of the borders of the entity chess board 40 and the chess pieces 50.

Accordingly, the virtual-real fitting module 33 of the interactive fitting module 30 generates a filling virtual image based on the image information of the physical chess pieces 50 collected by the game management module 60 of the game system or the real information collection module 10 of one player, correspondingly transmits the filling virtual image corresponding to the chess pieces 50 to the augmented reality module 20 of the other player, and projects the filling virtual image to the eyes of the user through the augmented reality module 20.

Fig. 13A and 13B show an embodiment of the virtual pawn image of the chess game system fitted on a physical board 40. The own player is operating a pawn 50, such as a black pawn, in the own real environment space. The real information collection module 10 of the own real environment space collects the chessboard 40, the chess pieces 50 and the image information of the hand movements of the user operating the chess pieces in the current real environment. The virtual-real fitting module 33 of the interactive fitting module 30 is configured to extract a virtual fill image of the playing piece 50 and the action of the user operating the playing piece 50, and transmit the extracted virtual image to the augmented reality module 20 of another player, so that the virtual fill image of the playing piece 50 is projected to the eyes of the player by the augmented reality module 20.

It is worth mentioning that the virtual-real fitting module 33 of the interactive fitting module 30 extracts the chess pieces 50 and the user operation information in the same way as the edge-finding fitting process of the entity fitting module 31 of the interactive fitting module 30. The difference is that the virtual-real fitting module 33 projects virtual images taken in different real environment spaces into the augmented reality module 20 of the current real environment, and the virtual-real fitting module 33 generates a filling virtual image. The virtual image received by the user through the augmented reality module 20 may be a virtual image with stereo padding, and the user may have better experience in acquiring better reality.

In addition, the user can also obtain the gesture action of the opposite player in the process of operating the chess piece through the augmented reality module 20, and the true chess playing experience can be more experienced. It can be understood that the real information collecting module 10 obtains the image information of the current real environment space and also obtains the voice information of the user during the chess playing process, and the voice information is transmitted to the augmented reality module 20 by the network device 200 in synchronization with the virtual image information, so that the user can also hear the sound of the chess playing while seeing the chess playing action.

Figure 14 shows another embodiment of the virtual pawn image of the chess game system of the invention fitted on a physical chessboard 40. The chess game system obtains a virtual chess piece image corresponding to a chessboard 40 by using special chess pieces, the chessboard, and based on the mutual position relationship between the chess pieces 50 and the chessboard 40.

It is worth mentioning that the board 40 and the pawns 50 are arranged to be communicatively connected to the interaction fitting module 30, and that position data information of the pawns 50 on the board 40 is sent by the board 40 or the pawns 50 to the interaction fitting module 30. It will be appreciated by a person skilled in the art that electromagnetic sensing means are provided in the pawn 50 and the board 40, and that when a pawn 50 is placed at a position on the board 40, the board generates a corresponding electromagnetic induction signal and generates corresponding position data of the pawn 50. The position data information of the chess pieces 50 is sent to the virtual-real fitting module 33 of the interactive fitting module 30 by the chessboard 40, and the virtual-real fitting module 33 generates a virtual chess piece image information at the position corresponding to the chess pieces 50 and transmits the virtual chess piece image information to the augmented reality module 20. It is understood that the virtual image generated by the virtual-real fitting module 33 is a virtual image generated based on the position of the real chess piece, and may not be a virtual image obtained by performing edge finding fitting on the real chess piece 50. Therefore, the user can select the proper color, size, shape, etc. of the virtual chess piece image during the operation process. Preferably, the base of the chess pieces 50 is provided with a magnet, and a sensing device capable of sensing the magnet signal is arranged at the position of the lower piece of the chess board 40.

Accordingly, the game management module 60 further comprises a chess piece adjustment module 62, wherein the chess piece adjustment module 62 is used for adjusting the size, shape, filling color and other information of the virtual chess piece image generated corresponding to the chess piece 50. The chess piece adjusting module 62 generates a virtual image information corresponding to the chess piece 50 based on the position information of the chess piece 50 placed on the chessboard 40 received by the virtual-real fitting module 33 of the interactive fitting module 30. It is understood that the chess piece adjustment module 62 generates a virtual chess piece image corresponding to a position based on the position information of a chess piece, and adjusts the color, size, shape, etc. of the virtual chess piece image by the chess piece adjustment module 62.

It should be noted that the virtual-real fitting module 33 of the interactive fitting module 30 generates a virtual image information corresponding to the chess piece 50 based on the position of the chess piece 50, and correspondingly transmits the virtual image information to the augmented reality module 20. It will be understood by those skilled in the art that the virtual-real fitting module 33 of the interactive fitting module 30 is based on the user's motion and displays the user's motion gesture information in the augmented reality module 20 of the other party. In this optional embodiment, the virtual-real fitting module 33 of the interactive fitting module 30 is the augmented reality module 20 that fits the virtual image information corresponding to the chess piece 50 to the opposite environment space based on the relative position relationship of the chess piece 50 on the chessboard 40. Therefore, the virtual-real fitting module 33 can accurately fit the virtual image corresponding to the chess piece 50 to the augmented reality module 20. However, it is conceivable that, in the present modified embodiment, a virtual image of the chess piece 50 may be generated based on only the position corresponding to the chess piece 50 without fitting the gesture motion information of the user.

It should be noted that, according to an aspect of the present invention, the virtual-real fitting module 33 of the interactive fitting module 30 may also adopt other feasible fitting methods, such as a pressure sensor arranged under a chessboard, obtaining the position information of the chess piece 50 through a pressure sensor or a pressure circuit switch, generating a virtual chess piece image corresponding to the chess piece 50 by the virtual-real fitting module 33 based on the position information of the chess piece 50, transmitting the virtual chess piece image to the augmented reality module 20, and projecting the virtual chess piece image to the eyes of the user by the augmented reality module 20. The chessboard 40 may also be configured as a powered gridding circuit, and the chess pieces placed at corresponding positions can trigger the circuit to be turned on, so as to obtain the position information of the corresponding chess pieces 50. It will be appreciated by those skilled in the art that the way in which the virtual-real fitting module 33 of the interactive fitting module 30 fits the virtual pawn image is only an example and not a limitation in the present invention, and thus other suitable ways may be applied thereto.

Correspondingly, the game management module 60 further comprises a game interaction module 63, wherein the game interaction module 63 is configured to generate virtual chess piece image information and perform virtual-real interactive game engagement with the player. In other words, the game interaction module 63 of the game management module 60 is configured to play a game against a user. The game interaction module 63 generates a virtual chess piece image based on the image information of the chess pieces in the current real environment collected by the real information collection module 10, fits the virtual chess piece image to the virtual chessboard in the virtual space, and transmits the virtual image information to the augmented reality module 20.

It will be appreciated by those skilled in the art that the game interaction module 63 of the game management module 60 generates a virtual chess piece image based on the position information of the player's chess pieces on the current game board and based on the difficulty level of the match-up game, wherein the virtual chess piece image is projected on the player's board so that the player can acquire the virtual chess piece image through the augmented reality module 20 and select a playing position based on the image information of the game interaction module 63 for game play.

The game interaction module 63 of the game management module 60 further includes a game guiding module 631 and a game switching module 632. The game guiding module 631 generates at least one prompt message based on the current position of the player, wherein the prompt message may be a virtual chess image message or a prompt voice message. It is understood that the virtual chess image information generated by the game guiding module 631 is guiding information for prompting the user to play chess or giving the user a chess position. It is understood that the game guide module 631 of the game interaction module 63 assists the player in learning the training.

The game switching module 632 is configured to switch the game view angle for the current user or switch different game scenes for the user. The chess game system is characterized in that a player obtains the current real environment information of the player and virtual image information fitting the current real environment through the augmented reality module 20 in the process that the player carries out man-machine battles or player battles. In addition, in order to facilitate the user to know the game or help the player to read the game, the game system further has a virtual space, wherein the virtual space has a virtual chessboard, virtual chess piece images and the like. The chess pieces at the corresponding positions in the chess boards of the two players are mapped in the virtual chess board of the virtual space, that is, the virtual space comprises the chess boards 40 of the two players and the virtual images corresponding to the chess pieces 50. Accordingly, the game switching module 632 is adjustable to switch the game view angle or the game space for the user. It will be appreciated that the user wearing the AR device may switch the viewing angle of the game, or choose to view a different game space, by the user's head movements.

FIGS. 15A and 15B of the drawings illustrate several other applications of the chess game system of the present invention. The chess game system is applied to a Chinese checkers game, a gobang game, or a flight chess game and the like which are indiscriminate chess games. It will be appreciated by those skilled in the art that the chess pieces used by any one of the above-mentioned several types of chess game are identical or unique, and the positions of the chess pieces placed on the chessboard can be uniquely determined by the position coordinates of the cross points of the longitude and latitude lines or the lines. The game management module 60 of the chess game playing system sets the playing rules of different game programs based on different types of game types.

It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real information collection module 10 is transmitted to the interactive fitting module 30, the interactive fitting module 30 generates a corresponding virtual chessboard and chessman image based on the chessboard and chessman image information of the current environment space collected by the real information collection module 10, and fits the virtual chessboard and chessman image to the augmented reality module 20 of the current environment space by the entity fitting module 31; generating a virtual chess piece image corresponding to the current chess piece image, and fitting the chess piece image to a virtual game chessboard of a virtual game space; and the augmented reality module 20 for generating a pair of virtual chess images corresponding to the chess pieces and fitting the virtual chess images to other environmental spaces by the virtual-real fitting module 33. It is understood that the augmented reality module 20 cooperatively projects environment information of the current environment in combination with the fitted virtual image information to the eyes of the user based on the received virtual image information, so that the user views the virtual image information in the current real space and operates the real chess pieces in the real chessboard to play against the virtual chess piece images.

Figures 16A and 16B of the drawings of the invention show two further applications of the chess game system of the present invention. The chess playing game system is applied to a Chinese chess or a chess game. For the game with different chessmen on the chessboard, the mutual relations among the chessmen with different types do not exist independently, but have the superposition relation according to the size sequence of the chessmen. It will be appreciated that for chess or Chinese chess, there is a size relationship between pieces, and small pieces will be "eaten" or removed after being overlaid by large pieces. The user can thus remove the pieces of his own board that have been "eaten" according to the mutual overlapping relationship between the pieces during the game.

It is worth mentioning that for the Chinese chess or the chess game, the types of the chess pieces in the chessboard are different, and the mutual relations among the chess pieces are different. Said coordinate defining module 61 of said game managing module 60 of said game playing system defines each piece of players of both parties of the game in addition to the coordinates defining the piece points in the board given to said board 40, and a game ID on a per piece basis, so as to keep track of the course of movement of each piece.

It will be appreciated that the game interaction module 63 of the game management module 60 of the chess playing game system sets the play rules for different game programs based on game type and sets the relation of game pieces to be eaten with respect to the size relation of the pieces in the game. It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real information collection module 10 is transmitted to the interactive fitting module 30, the interactive fitting module 30 generates a corresponding virtual chessboard and chessman image based on the chessboard and chessman image information of the current environment space collected by the real information collection module 10, and fits the virtual chessboard and chessman image to the augmented reality module 20 of the current environment space by the entity fitting module 31; generating a virtual chess piece image corresponding to the current chess piece image, and fitting the chess piece image to a virtual game chessboard of a virtual game space; and the augmented reality module 20 for generating a pair of virtual chess images corresponding to the chess pieces and fitting the virtual chess images to other environmental spaces by the virtual-real fitting module 33.

Correspondingly, the game interaction module 63 of the game management module 60 further includes a game prompt module 633, wherein the game prompt module 633 judges the relation between the eating and the eaten between the chess pieces of the two parties in the game process based on the game type of the current game and the correlation between the chess pieces in the game, and when the relation between the eating and the eaten occurs in the game chess pieces, the game prompt module 633 gives prompt information to the current user and the images of the virtual chess pieces hidden from the eating in the augmented reality modules of the two parties. When a player of one party plays a game while playing a game, he/she manipulates his/her own chess piece to eat the chess piece of the other party, hides the image of the virtual chess piece eaten by the physical chess piece by the game prompting module 633 of the game management module 60, and prompts the user of the other party to remove the eaten physical chess piece.

It is worth mentioning that the network device 200 is used to connect the AR display device 100 and coordinate the progress of the chess game. Accordingly, the network device 200 further comprises a background server 210, wherein the background server 210 is used for undertaking various data of interactive operations of the parties, such as game data, chessboard data, chess data information, and the like. The backend server 210 is a computing device with computing and game operation related functions.

The background server 210 of the network device 200 further comprises at least one memory 220, wherein the memory is configured to store a chess game database, chess board information, and/or a path trajectory or a falling order of the chess pieces different for each party. Briefly, the memory is used to store board information such as the length, width and height of the board, board surface information, etc. The background server 210 further comprises a judging module 230 and a hosting module 240, wherein the judging module 230 is configured to judge the size of the chess pieces or judge win-or-lose of the chess pieces according to the chess playing rules in the chess playing game database. The escrow module 240 is configured to replace a requester of an escrow instruction according to the playing rules in the playing game database, and perform virtual playing.

FIGS. 17A and 17B of the drawings illustrate another application of the chess game system of the present invention. The chess playing game system is applied to a military chess game, wherein the game interaction module 63 of the game management module 60 of the chess playing game system sets playing rules of different game programs based on the current game thinking game type. It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real information collection module 10 is transmitted to the interactive fitting module 30, the interactive fitting module 30 generates a corresponding virtual chessboard and chessman image based on the chessboard and chessman image information of the current environment space collected by the real information collection module 10, and fits the virtual chessboard and chessman image to the augmented reality module 20 of the current environment space by the entity fitting module 31; generating a virtual chess piece image corresponding to the current chess piece image, and fitting the chess piece image to a virtual game chessboard of a virtual game space; and the augmented reality module 20 for generating a pair of virtual chess images corresponding to the chess pieces and fitting the virtual chess images to other environmental spaces by the virtual-real fitting module 33.

It is worth mentioning that for the game of military flags, both game pieces are defined by the coordinate definition module 61 of the game management module 60 with a unique ID. The game prompting module 633 of the game interaction module 63 judges the relation between the eating and the eaten of the chess pieces of the two parties in the game process based on the game type of the current game and the mutual relation between the chess pieces in the game, and when the relation between the eating and the eaten of the game chess pieces appears, the game prompting module 633 gives the current user prompting information and the images of the virtual chess pieces hidden from the augmented reality modules of the two parties. When a player of one party plays a game while playing a game, he/she manipulates his/her own chess piece to eat the chess piece of the other party, hides the image of the virtual chess piece eaten by the physical chess piece by the game prompting module 633 of the game management module 60, and prompts the user of the other party to remove the eaten physical chess piece.

It can be understood that the army flag game is different from the Chinese chess in that players of both army flags can know the arrangement of the chess pieces of the own player and the friend player under the condition that the arrangement of the chess pieces of the other player is not known, and in a third party, namely a virtual game space, the game chess pieces of both players or a plurality of players are simultaneously displayed in a virtual chessboard. Therefore, the virtual chess piece image of the enemy player acquired by the own augmented reality module 20 is the chess piece image of the covered content. Determining, by the game prompt module 633 of the game interaction module 63 of the game management module 60, a size relationship between a current physical chess piece and a covered virtual chess piece.

It is understood that logging on to the network device 200 renders the virtual chess board by means of the AR display device 100, VR display device or flat display device of the direct participants of the non-chess game, and renders the virtual chess pieces of the respective parties on the virtual chess board. That is, a user may use the AR display device 100 or other viewing device to connect to the network device 200 through a network, thereby acquiring game data in the virtual game space, and present the virtual chess board in a virtual space of a third party, and present the virtual chess pieces of each party on the virtual chess board.

Referring to fig. 18 and 19 of the drawings, a second preferred embodiment of a chess gaming system according to the present invention is set forth in the following description. The chess playing game system is applied to a go game, a gobang game, a Chinese checkers game, or a game with various nondifferential chesses such as a flight chess game, and can also be applied to games with various types of differentiative chesses such as Chinese chess, military chess, and the like. The chess game system comprises the reality information acquisition module 10C, the augmented reality module 20C, the interactive fitting module 30C and the network equipment 200C of the chess game system. In other words, the chess playing game system also performs game interaction operation based on the fact that the chess playing game system collects the image information of the physical game board and the chess pieces in the real environment space and the virtual image displayed in the real environment space. Correspondingly, the chess game system further comprises a chessboard 40C and at least one chess piece 40C, it is understood that the chessboard 40C and the chess piece 40C can be ordinary chessboard, chess pieces, or special chessboard chess pieces adapted to the interactive fitting module 30C.

It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real information collection module 10C is transmitted to the interactive fitting module 30C, wherein the interactive fitting module 30C generates a corresponding virtual chessboard, chessman image based on the chessboard and chessman image information of the current environment space collected by the real information collection module 10C, and fits the virtual chessboard, chessman image to the augmented reality module 20C of the current environment space by the entity fitting module 31C; generating a virtual chess piece image corresponding to the current chess piece, and fitting the chess piece image to a virtual game chessboard of a virtual game space; and the augmented reality module 20C generating a pair of virtual chess images corresponding to the chess pieces and fitting the virtual chess images to other environmental spaces by the virtual-real fitting module 33C. It is understood that the augmented reality module 20C cooperatively projects environment information of the current environment in combination with the fitted virtual image information to the eyes of the user based on the received virtual image information, so that the user views the virtual image information in the current real space and operates the real chess pieces in the real chess board to play against the virtual chess piece images.

Accordingly, in a second preferred embodiment of the chess game system of the present invention, the chess game system further comprises a game management module 60C, wherein the game management module 60C is used for managing and explaining the relationship between the virtual chess piece images generated by the interaction fitting module 30C in the chess game system and the physical chess pieces in the real environment space.

As shown in fig. 19, the AR chess game system is used on a flat panel display device, different from the first preferred embodiment of the present invention, in the second preferred embodiment of the present invention, wherein the real information collecting module 10C of the chess game system is implemented as a camera device, the real information collecting module 10C is used for collecting the actual image information of the user operating the chessboard 40C and the chessmen 50C in the current real environment space and collecting the gesture information of the current user, and transmitting the collected information of the environment space to the interactive fitting module 30C, and extracting the virtual image information related to the game by the interactive fitting module 30C.

Preferably, the real information collecting module 10C is set to the user, that is, the camera device collects the actual image information of the current environment space towards the user. It is understood that the video information of the user captured by the reality information capturing module 10C can be transmitted to the augmented reality module of the other player at the other end in real time, so that the user can communicate with the other player in the form of video chat during the game operation.

Accordingly, the real information collecting module 10C includes an image information collecting module 11C and a sound information collecting module 12C, wherein the image information collecting module 11C is used for collecting image information of a real object in a real environment, wherein the image information may be picture information, graphic information or movie animation information. The sound information collection module 12C is used for collecting sound information in the current real environment space and transmitting the sound information to the augmented reality module 20C of the environment space of other players via the network device, so as to realize synchronous interaction of voice information and image information. Preferably, the sound information collecting module 12C is implemented as a microphone device, and more preferably, the microphone is disposed at or around the chessboard 40C.

In addition to the function of the augmented reality module 20 in the first preferred embodiment, the augmented reality module 20C further includes a display screen device 25C, by means of the augmented reality module 20C, the received virtual image information is projected into the current real environment space, especially the virtual chess piece image is projected onto the user's chessboard 40C, so that the user can obtain the virtual chess piece image on the chessboard 40C and make corresponding action response based on the virtual chess piece image. It is understood that the virtual image projected outward by the augmented reality module 20C may be a stereoscopic image or a two-dimensional planar image based on user action setting. The display screen 25C receives the image information of the current user acquired by the reality information acquisition module 10C, and displays the image information of the user on the display screen 25C, so that the opposite player can acquire the real-time image of the current user in the game process.

The interactive fitting module 30C has substantially the same function as the interactive fitting module 30 in the first preferred embodiment, except that the interactive fitting module 30C does not need to project the virtual image information of the chessboard 40C of the current real environment space extracted based on the image information acquired by the real information acquisition module 10C on the augmented reality module 20C of the current real environment space.

It should be noted that, in the second preferred embodiment of the chess game system of the present invention, the user no longer needs to wear an AR device to operate the game, wherein the operation information of one player and the virtual image information of the chess pieces are fitted to the augmented reality module 20C of the other player through the interactive fitting module 30C, and the fitted virtual image is projected to the chessboard 40 by the augmented reality module 20C without directly projecting the fitted image light to the eyes of the user.

Referring to fig. 20 and 21 of the drawings, a third preferred embodiment of a chess game system according to the present invention is set forth in the following description. The chess playing game system is applied to a go game, a gobang game, a Chinese checkers game, or a game with various nondifferential chesses such as a flight chess game, and can also be applied to games with various types of differentiative chesses such as Chinese chess, military chess, and the like. The chess game system comprises the reality information acquisition module 10D, the augmented reality module 20D, the interactive fitting module 30D and the network equipment 200D of the chess game system. In other words, the chess playing game system also performs game interaction operation based on the fact that the chess playing game system collects the image information of the physical game board and the chess pieces in the real environment space and the virtual image displayed in the real environment space. Correspondingly, the chess game system further comprises a chessboard 40D and at least one chess piece 40D, it is understood that the chessboard 40D and the chess piece 40D can be ordinary chessboard, chess pieces, or special chessboard chess pieces adapted to the interactive fitting module 30D.

It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real information collection module 10D is transmitted to the interactive fitting module 30D, wherein the interactive fitting module 30D generates a corresponding virtual chessboard, chessman image based on the chessboard and chessman image information of the current environment space collected by the real information collection module 10D, and fits the virtual chessboard, chessman image to the augmented reality module 20D of the current environment space by the entity fitting module 31D; generating a virtual chess piece image corresponding to the current chess piece image, and fitting the chess piece image to a virtual game chessboard of a virtual game space; and the augmented reality module 20D generating a pair of virtual chess images corresponding to the chess pieces and fitting the virtual chess images to other environmental spaces by the virtual-real fitting module 33D. It is understood that the augmented reality module 20D cooperatively projects environment information of the current environment in combination with the fitted virtual image information to the eyes of the user based on the received virtual image information, so that the user views the virtual image information in the current real space and operates the real chess pieces in the real chess board to play against the virtual chess piece images.

As shown in fig. 20 and 21, the real information collecting module 10D has the same function as the real information collecting module 10C in the second preferred embodiment. The augmented reality module 20D in the third preferred embodiment has substantially the same functions as those of the first preferred embodiment, except that the augmented reality module 20 is implemented as a digital glass desktop with a display function, a flat display device such as a digital glass mirror, a VR display device, etc., and the augmented reality module 20 directly displays the received image information of the virtual chess pieces on the digital glass desktop or the digital glass mirror. In a third preferred embodiment of the present invention, the chessboard 40D of the chess playing game system is implemented as a virtual chessboard, and the chessboard 40D is provided by the augmented reality module 20D and displayed on the desktop or mirror of the augmented reality module 20D.

It is understood that the augmented reality module 20 may be an AR display device 100, or a flat display device or a VR display device, wherein the flat display device or the VR display device simultaneously renders a virtual-real fitted chessboard, and renders the real chess pieces and the virtual chess pieces on the virtual-real fitted chessboard. In brief, a player may place a real game piece on the flat display device, wherein the flat display device gives a reaction information based on a position of the game piece placed by the player, wherein the reaction information is a virtual image information displayed on the flat display device.

Accordingly, the AR display device 100 adapted to the chess game system may be implemented as an immersive helmet-mounted display device, an AR all-in-one machine, a digital glass mirror, a digital glass desktop, a display, a smart mobile device, or an AR helmet connectable to the smart mobile device. The immersive helmet-mounted display device comprises an image-type head-mounted display, a transmission-type head-mounted display, or an image transmission combined head-mounted display.

It can be understood that the real information collecting module 10D detects the position of the chess piece 50D and the type of the chess piece in the current real environment space and the information of the movement interaction of the chess piece through a pressure sensor or a pressure circuit switch, or a light sensing device, or an electromagnetic sensing device, which are arranged under the digital glass desktop.

It should be noted that the chess playing game system in the third preferred embodiment of the present invention is different from the chess playing game system in the second preferred embodiment in that the chessboard 40D is fitted to the augmented reality module 20D, and a virtual chessboard is provided by the augmented reality module 20D.

Referring to FIG. 22 of the drawings, in accordance with another aspect of the present invention, there is provided a game interaction method for a virtual-real interaction game, comprising the steps of:

2201: acquiring virtual image information and projecting the virtual image information to an environment space;

2202: collecting response information of at least one piece in the environment space based on the virtual image information; and

2203: and extracting virtual image information corresponding to the chessmen based on the collected response information of the chessmen.

In the above method step 2201, the virtual image information includes image information of a chessboard 40 and at least one chess piece 50. The virtual image information is projected to the user's eyes through an augmented display module 20 so that the user responds to the game based on the projected virtual image information.

Before the above method step 2201, the method further comprises the following steps: fitting a virtual chessboard image to the chessboard in the current environment space.

In the above step 2202 of the method, the response information of the chess pieces includes image information of the chess pieces and sound information during the movement of the chess pieces. The game response of at least one chess piece in the current real environment is collected by a real information collection module 10, wherein the game response comprises the movement of the chess piece, the addition of the chess piece, the removal of the chess piece in the chessboard, and the like.

In step 2203, the image information of the current real environment acquired by the real information acquisition module 10 is transmitted to an interactive fitting module 30, and the virtual image information of the chess pieces in the current real environment space is extracted by the interactive fitting module 30. The method step 2203 further comprises the steps of:

22031: receiving the extracted virtual chess piece image information and fitting to the chessboard 40 of the current environmental space based on the virtual chess piece image information;

22032: receiving the extracted virtual chess piece image information and a virtual chessboard fitted to a virtual space based on the virtual chess piece image information; and

22033: receiving the extracted virtual pawn image information and fitting the chessboard 40 to another environmental space based on the virtual pawn image information.

It will be appreciated by persons skilled in the art that the embodiments of the invention described above and shown in the drawings are given by way of example only and are not limiting of the invention. The objects of the invention have been fully and effectively accomplished. The functional and structural principles of the present invention have been shown and described in the examples, and any variations or modifications of the embodiments of the present invention may be made without departing from the principles.

Claims

1. A chess, comprising a chessboard and chess pieces, characterized in that through the field of view of an AR display device, a real chessboard or a virtuality-reality fitted chessboard is visualized, and the real chess pieces and virtual chess pieces are visualized on the real chessboard or the virtuality-reality fitted chessboard.

2. The board game of claim 1, wherein the board game comprises a go, a chess, a military chess, a checkers, or a flight chess.

3. The board game of claim 1 or 2, wherein the virtual board game is formed by the AR display device acquiring the length, width and height information of the real board game and the board line on the real board game.

4. The chess according to claim 3, characterised in that the real chessboard is provided with altimeters, gyroscopes, identification barcodes for positioning, identification two-dimensional codes for positioning, or the bobbin threads with light positioning.

5. The chess according to claim 4, wherein said real chessboard is equipped with a microphone, or a pressure sensor or a pressure circuit switch for positioning the real chess pieces.

6. The chess of claim 3, wherein the base of the chess piece is provided with a magnet.

7. The chess according to claim 6, wherein the real chessboard is correspondingly provided with electromagnetic inductors or grid circuits.

8. The chess of claim 3, wherein the chess pieces are glass-shelled LED chess pieces or plastic-shelled LED chess pieces.

9. A chess game system as claimed in claim 1, further comprising said AR display device in the same space.

10. The chess gaming system of claim 9, further comprising a flat display device, a VR display device, or another pair of said chess and another pair of said AR display devices, in another space; the AR display equipment in one space is directly linked with the plane display equipment and the VR display equipment in the other space or the other pair of AR display equipment to form a master link and a slave link of the double-player.

11. The system of claim 10, wherein the AR display devices in a space assume the role of a back-end server for dual-machine interaction.

12. The chess gaming system of claim 10, further comprising a network device for network linking the AR display device in one space with the planar display device, VR display device, or another pair of the AR display devices in another space.

13. A chess gaming system according to claim 12, characterised in that the network link comprises a local area network link, a wide area network link or an internet of things link.

14. A chess gaming system according to claim 12, characterised in that said network device links at least two different spaces, at least one pair of said chess and one pair of said AR display devices being provided in each of said different spaces.

15. A chess game system according to claim 12, characterised in that said network device includes a background server for assuming interactive operation of the parties.

16. A chess game system according to claim 11 or 15, characterised in that said background server comprises a memory for storing a chess game database, board information and/or the path trajectories or the falling order of said pieces for each different party.

17. The chess gaming system of claim 16, wherein the backend server further comprises a determination module or a hosting module,

and the escrow module is used for replacing an instruction-escrowing party with a chess-playing rule in the chess-playing game database to play virtual chess.

18. A chess gaming system according to claim 9 or 10 or 12 or 13 or 14, characterised in that a virtuality-reality fit chessboard is simultaneously visualized by means of said AR display device, planar display device or VR display device, and that said real and said virtual chess pieces are visualized on said virtuality-reality fit chessboard.

19. The chess gaming system of claim 18, wherein said AR display device in said one space visualizes said real chess board at view 1 or said real chess board and virtual chess board at view 1 simultaneously, and visualizes said real chess piece at view 1 and said virtual chess piece at the other party on said real chess board or on a virtual-to-real fit chess board.

20. The system of claim 18, wherein the virtual board is presented via the AR display device, VR display device, or flat display device of a non-direct player of the game logged onto the network device, and the virtual pieces of each player are presented on the virtual board.

21. The AR display device of a chess gaming system of claim 9, comprising an immersive helmet-mounted display device, an AR all-in-one machine, a digital glass mirror, a digital glass desktop, a display, a smart mobile device, or an AR helmet to which the smart mobile device may be connected.

22. The AR display device of a chess game system according to claim 21, characterised in that the immersive head-mounted display device comprises an image head-mounted display, a transmissive head-mounted display, or an image transmissive combined head-mounted display.