KR102560162B1 - System for providing online board game using augmented reality - Google Patents

Abstract

a plurality of photographing devices for photographing a game board of a board game in which a plurality of users participate and words or cards placed on or around the game board; A plurality of user terminals that collect images captured by the plurality of photographing devices, respectively generate coordinate information on positions of the board and the horse from the collected images, receive the coordinate information generated from images photographed by other photographing devices, and insert images of horses or cards of other users into images captured by the photographing device to generate augmented reality images; a server that receives the coordinate information from the plurality of user terminals, synchronizes the received coordinate information with each other, and provides the synchronized plurality of coordinate information to the plurality of user terminals; And a system for providing an online board game using augmented reality including a plurality of display devices displaying the augmented reality image is disclosed.

Description

Online board game providing system using augmented reality {SYSTEM FOR PROVIDING ONLINE BOARD GAME USING AUGMENTED REALITY}

The present invention relates to a system for providing an online board game using augmented reality, and more particularly, to a system for providing an online board game using augmented reality, which can implement a board game played online while communicating between users offline, very similar to offline.

In general, board games such as chess and chess are a type of typical offline entertainment in which game participants face-to-face and move pieces on a board game board.

However, in a social environment where contact between people must be cut off as much as possible due to the epidemic of infectious diseases, offline direct users face-to-face to enjoy board games can become a burden on each other, become reluctant to each other, and cause social problems in the future.

On the other hand, various systems that implement board games online have already been developed and serviced, but most of the board game services provided online are specialized for online, and there is a clear difference from offline board games where you can feel the pleasure while communicating with your opponent while facing each other.

The present invention has a technical problem to solve the problem of providing an online board game providing system using augmented reality implemented online so that users can play a board game while communicating face-to-face offline very similarly to offline.

According to one aspect of the present invention,

a plurality of photographing devices for photographing a game board of a board game in which a plurality of users participate and words or cards placed on or around the game board;

A plurality of user terminals that collect images captured by the plurality of photographing devices, respectively generate coordinate information on positions of the board and the horse from the collected images, receive the coordinate information generated from images photographed by other photographing devices, and insert images of horses or cards of other users into images captured by the photographing device to generate augmented reality images;

a server that receives the coordinate information from the plurality of user terminals, synchronizes the received coordinate information with each other, and provides the synchronized plurality of coordinate information to the plurality of user terminals; and

A plurality of display devices displaying the augmented reality image

An online board game providing system using augmented reality is provided.

According to one aspect of the present invention, the horse or card has a marker, and the user terminal can identify the horse or card by recognizing the marker in images captured by the plurality of photographing devices.

According to one aspect of the present invention, the user terminal may receive an image of the game board, recognize a region corresponding to the game board in the image, detect coordinates occupied by the recognized game board on the image, and provide the detected coordinates to the server.

According to one aspect of the present invention, the user terminal may set a movable range in which the piece or card can move in the image of the game board based on the coordinates of the game board.

According to one aspect of the present invention, the user terminal detects coordinate information where the horse or card is located, compares the movable range with coordinate information where the horse or card is located, and determines the movement position of the horse or card. It can be provided to the server.

A system for providing an online board game using augmented reality according to an aspect of the present invention may further include an LED box that turns on various patterns according to inputs of participants who access the chat room when the user terminal accesses a chat room of board game participants provided in the server.

A system for providing an online board game using augmented reality according to an aspect of the present invention may further include action dice having a plurality of faces on which functions requested by the user are displayed. When one side of the action dice is photographed by the photographing device, the user terminal may receive an image of one side of the action die, recognize the captured side, and perform a function displayed on the recognized side.

A system for providing an online board game using augmented reality according to an embodiment of the present invention makes it possible to enjoy a board game similarly to enjoying a face-to-face board game offline through online by displaying the position or image of a word or card of a remotely located board game participating user on an augmented reality image.

A system for providing online board games using augmented reality according to various embodiments of the present invention allows board game users to enjoy board games while communicating similarly to real off-line online, thereby providing a more useful and effective business model in an environment where distancing is required due to an epidemic of an infectious disease.

1 is a block diagram of an online board game providing system using augmented reality according to an embodiment of the present invention.
2 is an exemplary diagram illustrating a situation in which a chess game is enjoyed using the online board game providing system using augmented reality according to an embodiment of the present invention.
3 is a diagram showing an example of words and cards for a board game photographed by a photographing device of an online board game providing system using augmented reality according to an embodiment of the present invention.
4 is an exemplary diagram illustrating a situation in which a board game is enjoyed using an online board game providing system using augmented reality according to an embodiment of the present invention.
5 is a diagram showing an example of an image of each user and an augmented reality image captured in the system for providing an online board game using augmented reality according to an embodiment of the present invention.
6 is a flowchart illustrating the operation of an online board game providing system using augmented reality according to an embodiment of the present invention.
7 shows an example of an LED box included in an online board game providing system using augmented reality according to an embodiment of the present invention.
8 is a development view of action dice included in the system for providing an online board game using augmented reality according to an embodiment of the present invention.
FIG. 9 is a diagram showing an example of functions corresponding to images displayed on each side of the action dice shown in FIG. 8 .

Since the present invention can apply various transformations and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, it should be understood that this is not intended to limit the present invention to specific embodiments, and includes all transformations, equivalents, and substitutes included in the spirit and scope of the present invention.

In describing the present invention, if it is determined that a detailed description of related known technologies may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. In addition, numbers (eg, first, second, etc.) used in the description process of this specification are only identifiers for distinguishing one component from another component.

In addition, throughout the specification, when one component is referred to as "connected" or "connected" to another component, the one component may be directly connected or directly connected to the other component, but unless otherwise specifically stated, it should be understood that it may be connected or connected through another component in the middle. In addition, throughout the specification, when a certain component is said to "include", it means that it may further include other components without excluding other components unless otherwise stated. In addition, terms such as “unit” and “module” described in the specification mean a unit that processes at least one function or operation, which means that it can be implemented by one or more hardware or software or a combination of hardware and software.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a system for providing an online board game using augmented reality according to an embodiment of the present invention, and FIG. 2 is an exemplary view showing a situation in which a chess game is enjoyed using the system for providing an online board game using augmented reality according to an embodiment of the present invention. 4 is an exemplary view showing a situation in which a board game is enjoyed using an online board game providing system using augmented reality according to an embodiment of the present invention, and FIG.

Here, FIG. 2 shows a chess game as an example of a board game, and FIG. 4 shows a board game in which a piece is moved by a specific number of moves using dice as an example of the board game.

1 to 5, a system for providing an online board game using augmented reality according to an embodiment of the present invention includes photographing devices 11 and 12 provided for each user (user A and user B) enjoying a board game, user terminals 21 and 22, and display devices 31 and 32, and may include a server 40 for synchronizing information on board game screens of a plurality of users.

Each of the plurality of photographing devices 11 and 12 photographs the game board 100 and 200 of a board game in which a plurality of users participate and the words or cards 110 and 210 placed on or around the game board, thereby generating an image of a board game progress state for each user participating in the board game. Various embodiments of the present invention provide a system for enjoying a board game using online, where only each user's words or cards are placed on an actual board game board prepared for each user.

A plurality of images respectively captured by the plurality of photographing devices 11 and 12 may be provided to a plurality of user terminals 21 and 22 provided for each of a plurality of users.

A marker M may be displayed on an object captured by the photographing devices 11 and 12 to indicate that it is an identification object. For example, a marker M such as a 2D QR code may be provided at the lower end of the pieces 110 and 120 of a chess game or at one area of the cards 110 and 120 . This marker M can be used as a means for more clearly indicating that it is an object to be identified in an image by the user terminals 21 and 22 to be described later.

The user terminals 21 and 22 may receive images of each user's board game board 100 and 200 and pieces or cards 110 and 210 captured by the photographing devices 11 and 12, detect coordinates of an area corresponding to the board game board, and generate coordinate information of a position where pieces or cards of the board game are placed during the game.

For example, when an online board game starts, the user terminals 21 and 22 receive an image of the board game boards 100 and 200, recognize an area corresponding to the board game boards 100 and 200 in the image, and detect coordinates occupied by the recognized board game boards 100 and 200 on the image. Here, the coordinates may be arbitrarily set two-dimensional coordinates on the image.

In addition, the user terminals 21 and 22 may set a movable range in which the words or cards 110 and 210 disposed on or around the board game boards 100 and 200 that move during the board game are played.

In addition, the user terminals 21 and 22 may detect coordinate information on the actual location of the pieces or cards 110 and 210 disposed on or around the game boards 100 and 200, and may compare a predetermined range of movement when the pieces or cards 110 and 210 move. The user terminals 21 and 22 determine the moving position of the horse or card 110 and 210 when the horse or card 110 and 210 moves within a preset movable range, and may provide coordinate information about the location of the determined horse or card 110 and 210 to the server 40.

In addition, the user terminals 21 and 22 may receive coordinate information of the board game board and horse (or card) of other users who have participated in the board game from the server 40, and utilize the received coordinate information to generate an augmented reality image displaying the other user's horse in the image taken by the photographing device 11.

Here, the user terminals 21 and 22 may be terminals including a storage unit in which an application for performing an online board game is stored and a processor to execute the application stored in the storage unit. An online board game providing system according to various embodiments of the present invention may be implemented by executing an application installed on the user terminals 21 and 22 . The applications installed in the user terminals 21 and 22 include various calculations and processing algorithms required for the operation of the online board game providing system according to various embodiments of the present invention, and the operation of the user terminals 21 and 22 as described above can be achieved by the algorithms included in the applications.

The above-described functions (e.g., board game board recognition, coordinate setting and detection, movable position setting, horse or card recognition, etc.) performed through execution of applications installed on the user terminals 21 and 22 may be implemented by various image processing techniques known in the image processing field, and the applications installed on the user terminals 21 and 22 may be produced by appropriately combining known image processing techniques for the implementation of the present invention.

In addition, the user terminals 21 and 22 are terminals capable of transmitting and receiving data by applying a known wired/wireless communication technology. That is, the user terminals 21 and 22 may transmit coordinate information obtained from an image of a board game board of a user participating in the board game to the server, and may include a communication module capable of receiving coordinate information by other users from the server 40. In addition, the user terminals 21 and 22 may have a communication protocol capable of receiving images captured by the photographing devices 11 and 12 and transmitting augmented reality images generated by the display devices 31 and 32 .

The server 40 synchronizes the coordinate information provided by the user terminals 21 and 22 from the image of the board game board and the horse (or card) of each user participating in the board game to determine the position of all the users' horses (or cards) participating in the board game at a specific time point, and may store the synchronized coordinate information at each synchronization time point.

In addition, the server 40 may transmit synchronized coordinate information to the user terminals 21 and 22 of each user participating in the board game. As described above, the user terminals 21 and 22 may receive synchronized coordinate information on the words (or cards) of other users from the server 40, and based on the received coordinate information on the words (or cards) of other users, an augmented reality image displaying the words (or cards) of other users may be generated in the image received from the photographing devices 11 and 12.

The display devices 31 and 32 are devices for displaying augmented reality images generated by the user terminals 21 and 22, and may be implemented as display devices included in the user terminals 21 and 22 or augmented reality glasses.

6 is a flowchart illustrating the operation of an online board game providing system using augmented reality according to an embodiment of the present invention.

Referring to FIG. 6 , the system for providing an online board game using augmented reality according to an embodiment of the present invention can be operated by a user executing an application for participating in an online board game on the user terminals 21 and 22, accessing the server 40 using the executed application, and performing login (S11).

Subsequently, the user selects the type of board game he or she wants to enjoy using the executed application (S12), and participates in a room opened by another user to participate in the selected board game or creates a room in the server 40 to allow other users to participate in the board game (S13). At this time, a chat room capable of conducting text or voice conversations between users participating in the game may be separately opened (S14).

Here, an embodiment of the present invention may further include an LED box that helps communication between users participating in a board game together when participating in a chat room.

7 shows an example of an LED box included in an online board game providing system using augmented reality according to an embodiment of the present invention.

One of the fun that users can get through board games is offline communication. Sufficient communication is possible through chatting and voice chatting, but in the case of voice chatting, it is difficult to check many problems such as the use of profanity, and chatting is difficult to communicate quickly without a keyboard. In order to compensate for this, an LED box 50 as shown in FIG. 7 may be applied to help transfer emotions or play a board game.

The LED box 50 may be connected to the user terminals 21 and 22 through short-range wireless communication such as Bluetooth, and receive various control signals from the user terminals 21 and 22 running the online board game application. The LED 51 may emit light in various ways.

For example, when participating in a chat room through an application, the LED 51 of the LED box 50 is turned on, and the LED 51 of the LED box 50 may be turned on so that emoticons of participating users are displayed. The LED box 50 may display emoticons transmitted between game participants in real time. Users can send pre-set emoticons through the box or select and send emoticons on the app. In addition, since the LED box 50 has a built-in vibration motor, it is possible to express opinions between players through vibration.

Again, referring to FIG. 6 , the game may be started when all required persons for the board game are filled (S15).

When the game starts, first, the photographing devices 11 and 12 provided for each user photograph the board game board of each user, and the user terminals 21 and 22 receive the image of the board game board 100 and 200 from the photographing device 11 and 12, recognize the area corresponding to the board game board 100 and 200 from the received image (S16), detect the coordinates of the board game board, fix the coordinates, and send the coordinate information to the server It can be provided to (40) and stored in the storage device 41 in the server 40 (S17). The coordinates of the board game boards 100 and 200 stored in the storage device 41 of the server 40 are compared with the coordinates of the board game boards 100 and 200 of other users to synchronize the positions of the pieces (or cards). Can be used.

Subsequently, the user terminals 21 and 22 may set a range in which the pieces or cards 110 and 120 of the board game can move during the game based on the coordinates of the board game boards 100 and 200 detected in step S17 (S18). Information on the movable range of the board game pieces or cards 110 and 120 may be stored in advance in the board game movable range table 42 provided in the server 40, and the user terminals 21 and 22 may receive information on the movable range of the corresponding game from the board game movable range table 42 and apply the information to the board game board for which the coordinates are determined. In particular, the user terminals 21 and 22 may generate an augmented reality image displaying a movable range in a photographed image of the board game board and display it on the display devices 31 and 32 (S24).

Then, as the board game progresses, when the user moves the pieces or cards 110 and 210 and the turn is completed, the photographing devices 11 and 12 photograph the board game board and the pieces or cards in a state in which the turn is completed to create an image (S19), and the user terminals 21 and 22 can detect the position of the moved pieces or cards in the image (S20).

Subsequently, the user terminals 21 and 22 check whether the detected position of the horse or card is within the movable range set in step (S18) (S21), and if it is within the movable range, finally determine the position of the horse or card (S22), and check whether the determined position is abnormal within the actual game rule (S23). It is possible to perform a synchronization process with one coordinate information.

A system for providing an online board game using augmented reality according to an embodiment of the present invention generates an image of a board game board and a horse or card when a user's turn ends, and determines the position of the horse or card through a recognition process, thereby minimizing system load required for image detection and recognition.

Subsequently, the user terminals 21 and 22 receive the synchronized coordinate information stored in the server 40, and generate an augmented reality image displaying the horse or card at the position of the horse or card corresponding to the synchronized coordinate information, and display it on the display units 31 and 32 (S24).

Then, by repeating steps S20 to S24 each time each user's turn is completed, the board game can be continuously played.

On the other hand, in the system for providing online board games using augmented reality according to an embodiment of the present invention, a photographing device, a user terminal, and a display device may be physically implemented in the form of a single device such as a smart phone or a smart pad. That is, by using a camera mounted on the back of a smart phone or smart pad, a user's board game board and horse (card) are photographed, and an augmented reality image displaying another user's horse (card) in the captured image can be displayed on the front display of the smartphone or smart pad.

In this way, when a single device such as a smart phone is used, since the range that a camera can capture is small and the display itself is small, only a part of the board game board is displayed, causing user inconvenience. In order to solve this inconvenience, in one embodiment of the present invention, when it is not the turn of the user participating in the game using the smart phone, the smartphone is placed on the floor so that the board game board is not photographed through the camera. Augmented reality images of the entire board game board can be displayed. That is, when the photographing devices 11 and 12 cannot capture the board game board, the user terminals 31 and 32 may generate and display an augmented reality image displaying the position of a piece or card recently synchronized with the entire board game board image previously stored in the display devices 21 and 22.

This feature is useful when the size of the display device is small, and may be provided as an option that a user can select in an application installed in the user terminals 31 and 32 .

In addition, the system for providing an online board game using augmented reality according to an embodiment of the present invention may further include action dice for receiving an input requested by a user from a user participating in the game.

8 is a development view of an action dice included in a system for providing an online board game using augmented reality according to an embodiment of the present invention, and FIG. 9 is a view showing an example of functions corresponding to images displayed on each side of the action dice shown in FIG. 8 .

8 and 9 , the user exposes a surface displaying a desired function among several faces of an action dice in a turn waiting state to a photographing device 11 or 12 to photograph the corresponding face, and the user terminals 31 and 32 receiving an image of one side of the action dice can perform a function corresponding to one face of the photographed action dice.

For example, when the face corresponding to the 'next turn' is recognized, the user terminals 31 and 32 may provide the server 40 with a signal for proceeding with the next turn.

In addition, when the side corresponding to the 'previous horse' is recognized, the user terminals 31 and 32 may enlarge the augmented reality image corresponding to the turn performed immediately before to be displayed on the display devices 21 and 22 .

In addition, when the face corresponding to 'my horse' is recognized, the user terminals 31 and 32 display an augmented reality image magnified around the action immediately before the user's own horse or the current horse on the display devices 21 and 22. Can be displayed.

In addition, when a surface corresponding to the 'current screen' is recognized, the user terminals 31 and 32 may display an augmented reality image representing the state of the board game currently in progress on the display devices 21 and 22 .

In addition, when a side corresponding to the 'full map' is recognized, the user terminals 31 and 32 may display an augmented reality image displaying the entire board game board on the display devices 21 and 22 .

In addition, when a plane corresponding to 'screen movement' is recognized, the user terminals 31 and 32 detect an operation of a pointing means such as a finger recognized by the photographing devices 11 and 12 in real time and perform a corresponding operation. When the display devices 21 and 22 are mounted on a motorized tripod, etc., the user terminals 31 and 32 move the direction of the motorized tripod according to the moving direction of the recognized indicating means, so that the display devices 21 and 22 can be displayed in a direction desired by the user. When the electric tripod is not applied, the augmented reality image currently displayed on the display devices 21 and 22 may be displayed by moving it according to the moving direction of the pointing means.

As described above, the system for providing online board games using augmented reality according to various embodiments of the present invention allows users to enjoy board games similarly to enjoying face-to-face board games online and offline by displaying words or locations of cards or images of remotely located board game users on augmented reality images.

A system for providing online board games using augmented reality according to various embodiments of the present invention allows board game users to enjoy board games while communicating similarly to real off-line online, thereby providing a more useful and effective business model in an environment where distancing is required due to an epidemic of an infectious disease.

Although the above has been described with reference to the embodiments of the present invention, those skilled in the art can easily understand that the present invention can be variously modified and changed within the scope not departing from the spirit and scope of the present invention described in the claims below.

Claims (7)

a plurality of photographing devices for photographing a game board of a board game in which a plurality of users participate and words or cards placed on or around the game board;
A plurality of user terminals that collect images captured by the plurality of photographing devices, respectively generate coordinate information on positions of the board and the horse from the collected images, receive the coordinate information generated from images photographed by other photographing devices, and insert images of horses or cards of other users into images captured by the photographing device to generate augmented reality images;
a server that receives the coordinate information from the plurality of user terminals, synchronizes the received coordinate information with each other, and provides the synchronized plurality of coordinate information to the plurality of user terminals; and
Includes a plurality of display devices for displaying the augmented reality image,
The horse or card has a marker, and the user terminal identifies the horse or card by recognizing the marker in images captured by the plurality of photographing devices;
The server synchronizes the coordinate information provided by each user terminal from the image of the game board and the horse or card of each user participating in the board game to determine the position of the horse or card of all users participating in the board game at a specific point in time, and stores the synchronized coordinate information at each synchronization point,
The user terminal,
Information on the movable range of the corresponding game is received from the board game movable range table pre-stored in the server and applied to the game board for which the coordinates are determined, thereby setting the movable range in which the horse or card can move in the image of the game board based on the coordinates of the game board,
An augmented reality image displaying a movable range in an image of a game board is generated and displayed on a display device of the user terminal,
Detecting coordinate information where the piece or card is located, comparing the movable range with coordinate information where the piece or card is located, determining the moving position of the piece or card, and providing it to the server. delete According to claim 1,
The user terminal receives an image of the game board, recognizes an area corresponding to the game board in the image, detects coordinates occupied by the recognized game board on the image, and provides the coordinates to the server. An online board game providing system using augmented reality, characterized in that. delete delete The method of claim 1,
When the user terminal accesses a chat room of board game participants provided in the server, an LED box for lighting various patterns according to inputs of participants who access the chat room is further included. The method of claim 1,
A system for providing an online board game using augmented reality, characterized in that it further comprises an action dice having a plurality of faces on which functions requested by the user are displayed, and when one face of the action dice is photographed by the photographing device, the user terminal receives an image of one face of the action dice, recognizes the photographed face, and performs a function displayed on the recognized face.