KR20210040728A - Billiards System Capable of Movable Entertainment Object Presentation - Google Patents

Abstract

The present invention is to provide a billiards system capable of realizing a motion-variable entertainment object so that a user can enjoy the game of billiards more interestingly through an entertainment function that can induce fun beyond the user's imagination. According to the present invention, the billiards system may comprise: a projector unit for projecting an image of a second object including an entertainment object onto a billiard table; a camera unit for photographing an image of a first object including a billiard ball or a cue; and a server for distinguishing and recognizing the image of the first object and the image of the second object.

Description

Billiards System Capable of Movable Entertainment Object Presentation}

The present invention relates to a billiard system capable of displaying a motion variable entertainment object.

The conventional billiard system equipped with a camera visually induces interest in the billiard game through various images that are linked to the billiard ball or exceed the user's expectations, and are only to confirm the playback of the billiard game that has been completed or provide simple coaching information. No system has been proposed that allows you to feel more interesting and enjoy the game than when playing billiards.

The present invention is to provide a billiard system capable of implementing a motion-variable entertainment object so that a billiard game can be enjoyed more interestingly through an entertainment function that can cause fun beyond the user's imagination.

The billiard system of the present invention includes a projector unit for projecting an image of a second object including an entertainment object onto a pool table; A camera unit for photographing an image of a first object including a billiard ball or a cue table; A server for distinguishing and recognizing an image of the first object and an image of the second object; It may include.

Here, the first object may be photographed by the camera unit, and the second object may be moved from the top surface of the billiard ball so as to be interlocked with the movement path of the first object.

In the present invention, the entertainment object projected from the projector unit is implemented as a clear image on the top of the pool table, the entertainment object can be moved in conjunction with the billiard ball, and the entertainment object uses the top of the pool table as a background screen to create a movie or video game effect. I can.

A second object that moves as an entertainment object linked to the first object (a billiard ball or cue table), a target or division that penetrates the top of the pool table as a second object, a second object that is linked to the billiard ball and moves like a movie, and a division as a second object A score may be indicated in each area, or an entertainment object may be implemented as a second object in which the plate rotates when the billiard ball passes. It is possible to implement a billiard system that shows high-value content that stimulates the user's imagination.

Visual effects can be maximized by inserting a specific picture image or color in the divided area, and since the image projected through the projector is expressed in the form of light on the top of the pool table, it can be used as a normal billiard table by turning off the projector.

The entertainment object projected on the top of the pool table may be changed to another entertainment object at any time according to the player's preference, or a fun element of the second object linked to the first object may be added, so that various transformations may be possible.

1 is a schematic diagram of an apparatus for implementing the billiard system of the present invention.
2 is a block diagram of a billiard system according to the present invention.
3 is a diagram showing an example in which an entertainment object is projected onto an upper surface of a pool table through the projector unit of the present invention.
4 and 6 are perspective views of a billiard table in which an embodiment of the entertainment object of the present invention is implemented.
5 is a perspective view of a billiard table in which another embodiment of the entertainment object of the present invention is implemented.

Referring to FIGS. 1 and 2, the billiard system of the present invention may include a camera unit 200 for photographing a pool table 100, a projector unit 300, a server 400, and a display unit 500.

The billiard system of the present invention includes a projector unit 300 for projecting an image of a second object including an entertainment object onto the pool table 100, and a camera unit for photographing an image of a first object including a billiard ball or cue table 102 200, a server 400 for distinguishing and recognizing the image of the first object and the image of the second object may be included. In addition to the image of the first object and the image of the second object, it may include a display unit 500 that displays various games or menus.

As the first object, the billiard ball may include a water polo 104, a first object 106 and a second object 107.

The cue table 102 or the billiard ball may be a first object to be recognized by the server 400 through photographing by the camera unit 200. The second object 120 is a virtual image projected by the projector unit 300 to the pool table 100 in order to implement augmented reality, and may be at least one of a fish picture, a recommended route, a menu button, an animation character, and an entertainment object. I can.

Meanwhile, a 2D image captured by the camera unit 200 and transmitted to the server 400 may be defined as the camera unit image 201. The 2D image transmitted by the server 400 to the projector unit 300 to be projected on the top surface 110 of the pool table 100 may be defined as a projector unit image 301, an image of a second object, or a content image. .

The image of the first object may be defined as an image of the billiard ball or cue table 102 recognized by edge detection or other methods. The image of the first object may be a black-and-white image or an infrared image containing the outline of the billiard ball or cue table 102, and may be a color image containing the color of the billiard ball or cue table 102.

When the three-dimensional coordinate system of the top surface of the pool table 110 is defined as the pool table coordinate system 105, the pool table coordinate system 105 may vary according to the installation position or angle of the pool table 100. When the 3D coordinate system of the camera unit 200 is defined as the camera unit coordinate system 205, the camera unit coordinate system 205 may vary according to the installation position or angle of the camera unit 200. When the 3D coordinate system of the projector unit 300 is defined as the projector unit coordinate system 305, the projector unit coordinate system 305 may vary according to the installation position or angle of the projector unit 300.

The server 400 includes a camera unit image 201, which is a two-dimensional coordinate system,-a camera unit coordinate system 205, which is a three-dimensional coordinate system,-a pool table coordinate system 105, which is a three-dimensional coordinate system,-a projector unit coordinate system 305, which is a three-dimensional coordinate system- Each coordinate system may be mapped or calibrated so that a specific point 190 is recognized as the same coordinate value or a one-to-one corresponding coordinate value as the coordinate systems of the projector image 301, which is a two-dimensional image, are interconnected.

After mapping or calibrating each coordinate system, the server 400 converts the coordinate value of the specific point 190 into the same or one-to-one coordinate values in the camera unit image 201, the pool table top surface 110, and the projector unit image 301. I can recognize it.

For example, a specific point 190 having a coordinate value of [10, 70, 0] in the pool table coordinate system 105 of the pool table 100 is a 2D coordinate in the camera unit image 201 or the projector unit image 301 It can be recognized as a value [10, 70].

The server 400 includes a coordinate value of a billiard ball or cue table 102 that is a first object of the pool table top surface 110 by mapping or calibration, and a second object projected from the projector unit 300 to the pool table top surface 110 The coordinate value of the content image of 120 may be time synchronized or interlocked.

According to the present invention, a first object is photographed with the camera unit 200, and an entertainment object such as a fish, which is the second object 120, can be moved on the top surface 110 of the pool table so as to be linked to the movement path of the first object, the billiard ball. have. The projector image generated by the server 400 includes the second object 120 and may be modified in real time so that the second object 120 is linked to the movement path of the first object. Various postures and moving shapes of the second object 120 are previously stored in a database of the server, and an optimal database may be extracted by interlocking with the movement of the first object.

4 and 6, fish images 120a and 120b are shown as entertainment objects included in the second object.

In the fish images 120a and 120b included in the second object, the distance between the second object and the first object is the trigger range (△1) of the apparatus 104 or the trigger range (△) of the first object ball 106). In the state outside 2), the second object may not be linked to the first object and may move along an arbitrary movement path within the predefined first area 610.

In the fish images 120a and 120b included in the second object, the distance between the second object and the first object is the trigger range (△1) of the apparatus 104 or the trigger range (△) of the first object ball 106). 2) In the following state, the second object is interlocked with the movement of the first object and may be evasively maneuvered to the second area 620 away from the first object.

A feature of the present invention in which the projection area of the second object is determined as one of the first area or the second area while comparing the separation distance between the first object and the second object with the trigger ranges (△1, △2) is a billiard ball or There is an advantage of being able to implement a character image linked to the movement of the cue.

When the separation distance of the second object is out of the trigger range, the second object moves within the first area on the top of the pool table, and when the position of the billiard ball approaches the second object within a predetermined range, an avoidance path to avoid the billiard ball As an example, the second object may be moved to the second area. This makes it possible to implement various augmented reality according to the mutual interworking of the first object and the second object, and can be a core content constituting a real-time game.

The content image, which is the second object 120, may include a recommended route having the highest 3-cushion probability of a billiard ball, a menu button, a shop, a speed display bar of the cue platform 102, an animation, a game information button, and the like.

The second object 120 may be linked to the movement of the first object, and the second object 120 may be displayed on the first area 610 outside a predetermined trigger range from the first object. If the separation distance between the first object and the second object is reduced to less than the trigger range, the second object 120 may be displayed at a position farther than the trigger range from the first object. Can be moved to.

This logic can also be applied when clicking the menu button of FIG. 5 as an entertainment object. When the user approaches the end of the first object, the queue stand 102, within the trigger range, which is a predetermined distance from the second object 120, a new event may occur. Similar to the event in which the image of the fish moves away from the second area, logic for executing a menu button may be executed.

That is, when the distance between the first object and the second object approaches within the trigger range, it is the core of the present invention that a new event is executed. There can be two representative types of new events. The first new event is logic in which the second object is moved so that the separation distance between the first object and the second object exceeds the trigger range. The second new event is the logic that the second object performs an additional function. That is, when the distance between the first object and the second object approaches within the trigger range, the second object executes its own function as shown in FIG. 5. When the function of the corresponding menu button is released, when the separation distance between the first object and the second object is out of the trigger range, the second object may maintain the initial value and maintain the initial value without performing any function.

As described above, according to the separation distance between the first object and the second object, a new event is performed when the separation distance is within the trigger range, and when the separation distance exceeds the trigger range, the second object maintains a predefined initial state or initial value. And a new event may not occur. When the billiard system is operated by this logic, the user may cause a change in the second object through an activity of bringing the first object that can be controlled by the user closer to the second object. This can be a core configuration of the present invention that enables playing games or content.

The server 400 is a means for generating the projector image 301, and the server 400 already knows the coordinate values of the image of the fish, which is the second object 120, or the image of the projector 301 of the menu button. The server 400 may recognize a coordinate value of the camera unit image 201 of the first object, the queue table 102, from the image captured by the camera unit 200. When the coordinate values of the camera unit image 201 of the first object and the coordinate values of the projector unit image 301 of the second object 120 approach within a predetermined range, the server 400 is instructed to move the fish image or press the menu button. It is determined that it has been pressed, and the server 400 executes the corresponding function.

The projector unit 300 may project a projector unit image 301 including a content image of the second object 120 for which the coordinate value is already known, to the top surface 110 of the pool table.

The server 400 may recognize the coordinate value of the queue stand 102 from the camera unit image 201. When the coordinate value of the camera unit image 201 of the first object, Qdae 102, and the coordinate value of the projector unit image 301 of the content image, which is the second object 120, are approached within a predetermined range, the server 400 It is possible to regard the execution of the image as commanded and perform a function corresponding to the content image.

The server 400 receives the superimposed image of the image of the first object and the image of the second object captured by the camera unit 200, and separates the image of the first object through vision processing of the superimposed image. Images can be recognized.

1 and 4, the projector unit 300 may be installed on a ceiling spaced a predetermined distance from the pool table 100 so that an image can be projected on the upper surface of the pool table 100. When the projector unit 300 is installed on the ceiling, it may be installed at an upper center of the pool table 100 or at a position inclined from the upper center of the pool table 100 because mapping of the server 400 is possible. The projector unit 300 may be configured as a beam projector capable of projecting an image.

The display unit 500 may display a stroke method including a water polo and a table tennis ball, a shop, a collision thickness, an intensity required for hitting the water polo, and a hitting method on a separate touch screen screen other than the pool table 100.

Referring to FIG. 2, the server 400 includes an image conversion unit 410, an error correction unit 420, an object identification unit 430, a coordinate determination unit 440, a direction detection unit 450, and a path estimation unit 460. ), a path extraction unit 470, an object tracking unit 480, and a point calculation unit 490.

[Video coordinate system transformation]

The image conversion unit 410 may be a device for converting and recognizing a coordinate value of a billiard ball in a 3D coordinate system from an image captured through the camera unit 200. The image conversion unit 410 grasps the transformation matrix between the camera unit coordinate system 205, which is the reference coordinate system of the camera unit 200, and the pool table coordinate system 105, which is the reference coordinate system of the pool table 100, and based on the transformation matrix, the camera From the image photographed by the unit 200, a coordinate value of the position of the billiard ball at which coordinate of the pool table 100 may be obtained. The image conversion unit 410 is a conversion matrix between the projector unit coordinate system 305 and the pool table coordinate system 105, which is a reference coordinate system of the projector unit 300, or between the projector unit coordinate system 305 and the camera unit coordinate system 205 The image and position of each 3D coordinate system can be freely recognized through the transformation matrix.

An image photographed through the camera unit 200 inclined with respect to the pool table 100 captures a real three-dimensional image as a two-dimensional image. Therefore, it is necessary to convert a two-dimensional image photographed with an oblique line into a real three-dimensional coordinate system.

The image conversion unit 410 converts an image captured in a two-dimensional coordinate system into a coordinate value in a three-dimensional coordinate system in order to eliminate an error between the object image captured through the camera unit 200 and the object located in the actual pool table 100. can do.

In the camera unit coordinate system 205, the optical axis direction of the camera unit 200 may be Zc, and the horizontal and vertical directions perpendicular to the optical axis may be Xc and Yc. In the projector unit coordinate system 305, the optical axis direction may be Zp, and the horizontal and vertical directions perpendicular to the optical axis may be Xp and Yp. The pool table coordinate system 105 may be a coordinate system based on the pool table 100. After setting the coordinate system of the camera unit coordinate system 205, the projector unit coordinate system 305, and the pool table 100, the position of the object may be known through coordinate conversion.

[Identification of billiard balls and cues (102)]

The camera unit 200 may acquire an image of a first object, which is a classification recognition image of the billiard ball or cue table 102. On the other hand, when the image of the second object projected from the projector unit 300 to the pool table 100 includes a menu button, pointing the menu button to the cue table 102 compares the distance between the two objects with a predetermined value. Through logic It can be determined whether the user has pressed the menu button.

You can recognize the billiard ball by distinguishing and recognizing the edge of the billiard ball in the video taken with the camera. By distinguishing and recognizing the cue unit 102, the cue unit 102 can be known. If you use a color camera, you can see the color of the first object, the billiard ball.

The object identification unit 430 converts the image so that the color can be displayed in three forms of hue, saturation, and business card, and after removing noise by processing the converted image through labeling image processing, a billiard ball and a cue stand ( 102).

The object identification unit 430 may form a group by attaching the same label to adjacent pixels in order to recognize a billiard ball by binarizing the image composed of the HSV color space.

The error correction unit 420 may correct the outline of the billiard ball by limiting a high-frequency region forming the outline of the billiard ball recognized through the object identification unit 430.

[Recommended route estimate]

The coordinate determination unit 440 may coordinate the position of the billiard ball identified by the object identification unit 430. The direction detection unit 450 may detect the coordinates of the billiard ball and a direction from the handle of the cue table 102 to the tip and detect the linear motion direction of the cue table 102. The handle is a part for the user to hold the cue stand 102, and the tip is a part that is attached to the end of the cue stand 102 and makes physical contact when the cue stand 102 hits the billiard ball.

Referring to FIG. 1, the path predictor 460 may predict a movement prediction path L in which the billiard ball is to be moved according to the detected linear direction. It can be seen that the movement prediction path L is projected on the top surface of the pool table 100. Therefore, when hitting the apparatus 104 through the cue table 102, the path through which the apparatus 104 moves can be predicted. The movement prediction path L may be generated according to the separation angle, reflection angle, and rotation angle theory.

[Route extraction and guidance]

The path extraction unit 470 may search for at least one path direction to move the cue ball 104 according to the coordinates of the billiard ball recognized by the object recognition unit 430, and may calculate a stroke method corresponding to the path direction. . The path direction may search for a direction in which the apparatus 104 is to be moved through any one of a separation angle, a reflection angle, and a rotation angle.

The projector unit 300 may allow the path direction and stroke method derived through the path extraction unit 470 to be implemented in the pool table 100.

In addition, in order to move the billiard ball on the top surface of the pool table 100 according to the path, the point, intensity (for example, displayed to be activated by a bar graph for each intensity), and the thickness of the dotted circle in FIG. 3 are set to the pool table 100 ) Can be displayed on one side of the upper surface 110.

Referring to Figure 3, if you want to move the billiard ball through the expected path, if you hit the upper right of the cue ball 104 a little hard and hit the first object ball 106 thinly, the second object ball 107 can also be hit. It's the path.

[Route tracking and point calculation]

When the apparatus 104 is moved by the cue table 102, the object tracking unit 480 may track the apparatus 104 by identifying a region in which the color distribution of the apparatus 104 is concentrated in real time. According to the tracking of the water polo 104, it is possible to check whether the water polo 104 hits the wall (Cushion) of the pool table 100 or the object ball.

The point calculation unit 490 is a device for obtaining a score and calculating a failure by recognizing a recommended path of the apparatus 104 and a collision between the first object ball 106 and the second object ball 107.

The point calculation unit 490 automatically calculates the point, and the score can be output by the display unit 500 or projected as a content image on the top surface 110 of the pool table 100 through the projector unit 300. have.

[Content image]

The present invention outputs various types of content images pre-stored through the server 400 connected to the projector unit 300 as an image through the projector unit 300 to provide an image in the form of light on the pool table 100 and the top surface 110 of the pool table. Can be projected to show.

Referring to FIG. 4, the entertainment object 120 of the present invention may be provided as an image reminiscent of a pool table 100 as if it were a pond.

Specifically, when a plurality of fishes, which are the second object, swim around and when the first object, a billiard ball, passes by, a wave shape is realized as the billiard ball passes, and when the first object, a billiard ball, approaches the fish, which is the second object, You can implement an act of running away from surprise.

The movement path of the billiard ball, which is the first object placed on the upper surface 110 of the pool table 100, is in a state of being tracked and recognized in advance. Among the images projected on the upper surface 110 of the pool table 100 through the projector unit 300, the image of the fish playing is already stored in the server 400 as data representing various types of fish swimming.

Therefore, when a moving billiard ball approaches a swimming fish, an image of the fish running away because of surprise can be realized.

In addition, when the billiard ball moves, it is possible to implement an image in which a wave is generated from the rear of the billiard ball. The pool table 100 can produce an image like a pond, and when playing a billiard game, it is possible to enjoy a billiard game more interestingly by creating an environment like playing a billiard game in a pond.

Referring to FIG. 5, another type of entertainment object 130 may be implemented on the top surface 110 of the pool table 100.

Looking at the details of the entertainment object 130, a plurality of partitions 131 having a predetermined area may be formed, and an entertainment object having a plate portion 132 in the partition may be implemented.

Such an entertainment object may be provided as an entertainment object in which an operation in which the plate unit 132 is rotated and restored when the billiard ball moves from the top surface 110 of the pool table 100 is implemented. The plate portion 132 may be a menu button on which a predetermined function is performed. During a billiard game, since the operation in which the plate of the partition is rotated whenever the billiard ball passes through the upper surface 110 of the pool table 100 is implemented, the billiard game can be enjoyed more interestingly.

In addition, as another entertainment object, the present invention may implement various entertainment objects such as an image in which a flame is generated from the rear of the billiard ball when the billiard ball moves, a space background image on the top surface 110 of the pool table 100, and Santa Claus.

100: pool table 102: cue table
104: water polo 106: first red ball
107: the second red ball 110: the top of the pool table
122: pointer 120,130: entertainment object
131: division part 132: plate part
134: point
200: camera unit 300: projector unit
400: server 410: image conversion unit
420: error correction unit 430: object identification unit
440: coordinate determination unit 450: direction detection unit
460: path estimation unit 470: path extraction unit
480: object tracking unit 490: point calculation unit
500: display unit

Claims (6)

A projector unit for projecting an image of a second object including an entertainment object onto a pool table;
A camera unit for photographing an image of a first object including a billiard ball or a cue table;
A server for distinguishing and recognizing an image of the first object and an image of the second object; Including,
Photographing the first object with the camera unit,
Billiard system for moving the second object on the top surface of the billiard ball so as to be linked to the movement path of the first object.
The method of claim 1,
The projector unit image generated by the server includes the second object,
The server modifies the posture and position of the second object in real time so that the second object is linked to the movement path of the first object,
The posture and shape of the second object are pre-stored in the database of the server, and the database of the posture and shape of the second object is extracted by interlocking with the movement of the first object.
The method of claim 1,
The second object,
In a state in which the separation distance between the second object and the first object is out of the trigger range, the second object is not linked to the first object and moves along an arbitrary movement path within a predefined first area,
When the distance between the second object and the first object is less than the trigger range, the second object is interlocked with the movement of the first object and evasively maneuvers into a second area away from the first object.
The method of claim 1,
By comparing the distance between the first object and the second object with a trigger range, the projection area of the second object is determined as one of a first area or a second area, and the second object is linked to the movement of the first object. 2 Billiard system for projecting an image of an object onto the pool table.
The method of claim 1,
Fish swim so that a pond is displayed on the top of the pool table,
When the billiard ball passes, a wave is realized,
When the billiard ball approaches the swimming fish, the fish is surprised and runs away,
The fish, the pond, and the wave are represented on the pool table in the form of a virtual image.
The method of claim 1,
Forming a partition having a predetermined area on the top surface of the pool table through the projector unit,
A plate portion is formed in the partition portion,
A billiard system in which a menu corresponding to the plate part is executed when the billiard ball approaches the plate part.

Images