KR102317914B1 - Billiards System Capable of Movable Entertainment Object Presentation - Google Patents

Abstract

The billiards system of the present invention includes: a projector unit for projecting an image of a second object including an entertainment object on a billiard table; a camera unit for photographing an image of a first object including a billiard ball or a cue table; a server for distinguishing between the image of the first object and the image of the second object; may include.

Description

Billiards System Capable of Movable Entertainment Object Presentation

The present invention relates to a billiards system capable of displaying a motion-variable entertainment object.

The conventional billiards system installed with a camera visually stimulates interest in the billiard game through various images that exceed the user's expectation, such as interlocking with a billiard ball, or simply providing coaching information for a completed billiard game. A system that can be more interesting and enjoyable than the game of billiards has not been proposed.

An object of the present invention is to provide a billiards system capable of realizing a motion-variable entertainment object so that the user can enjoy the game of billiards more interestingly through an entertainment function that can induce fun beyond the user's imagination.

The billiards system of the present invention includes: a projector unit for projecting an image of a second object including an entertainment object on a billiard table; a camera unit for photographing an image of a first object including a billiard ball or a cue table; a server for distinguishing between the image of the first object and the image of the second object; may include.

Here, the first object may be photographed with the camera unit, and the second object may be moved on the upper surface of the billiard ball so as to be linked to a movement path of the first object.

According to the present invention, the entertainment object projected from the projector is implemented as a clear image on the top surface of the billiard table, the entertainment object can move in conjunction with the billiard ball, and the entertainment object utilizes the top surface of the billiard table as a background screen to produce a movie or video game effect. can

A first object, a billiard ball, or a second object that moves as an entertainment object linked to a cue table, a target or compartment that is transmitted through the top surface of the billiard table as a second object, a second object that moves like a movie in conjunction with the billiard ball, and a second object that moves as a second object It is possible to implement an entertainment object as a second object in which a score is marked in each area or a plate is rotated when a billiard ball passes. It is possible to implement a billiards system that shows high value-added content that stimulates the user's imagination.

A specific picture image or color can be inserted into the partitioned area to maximize the visual effect, and the projected image through the projector is expressed in the form of light on the top surface of the pool table, so if the projector unit is turned off, it can be used as a normal billiard table.

The entertainment object projected on the top surface of the billiard table may be changed to another entertainment object at any time according to the player's preference, and a fun element of the second object linked to the first object may be added, so that various transformations may be possible.

1 is a schematic diagram of an apparatus for implementing the billiard system of the present invention;
2 is a block diagram of the billiard system of the present invention.
3 is a view showing an example in which the entertainment object is projected onto the top surface of the billiard table through the projector unit of the present invention.
4 and 6 are perspective views of a billiard table in which an embodiment of the entertainment object of the present invention is implemented.
5 is a perspective view of a billiard table in which another embodiment of the entertainment object of the present invention is implemented.

1 and 2 , the billiards system of the present invention may include a camera unit 200 for photographing the pool table 100 , a projector unit 300 , a server 400 , and a display unit 500 .

The billiards system of the present invention includes a projector unit 300 that projects an image of a second object including an entertainment object onto the billiard table 100, and a camera unit that shoots an image of a first object including a billiard ball or cue table 102 200 , and a server 400 that distinguishes and recognizes the image of the first object and the image of the second object. It may include a display unit 500 for displaying various games or menus in addition to the image of the first object and the image of the second object.

As the first object, the billiard ball may include a cue ball 104 , a first red ball 106 and a second red ball 107 .

The cue table 102 or the billiard ball may become the first object to be recognized by the server 400 through the photographing of the camera unit 200 . The second object 120 is a virtual image projected by the projector unit 300 onto the pool table 100 to implement augmented reality, and is to be at least one of a fish picture, a recommended route, a menu button, an animation character, and an entertainment object. can

Meanwhile, a 2D image captured by the camera unit 200 and transmitted to the server 400 may be defined as the camera unit image 201 . The 2D image transmitted by the server 400 to the projector unit 300 to be projected on the top surface 110 of the pool table 100 may be defined as the projector unit image 301, the image of the second object, or a content image. .

The image of the first object may be defined as an image of a billiard ball or cue table 102 recognized by edge detection or other methods. The image of the first object may be a black-and-white image or an infrared photographed image containing the outline of the billiard ball or cue table 102 , or a color image containing the color of the billiard ball or cue table 102 .

When the three-dimensional coordinate system of the top surface 110 of the billiard table is defined as the billiard table coordinate system 105 , the billiard table coordinate system 105 may vary depending on the installation position or angle of the billiard table 100 . When the three-dimensional coordinate system of the camera unit 200 is defined as the camera unit coordinate system 205 , the camera unit coordinate system 205 may vary depending on the installation position or angle of the camera unit 200 . When the three-dimensional coordinate system of the projector unit 300 is defined as the projector unit coordinate system 305 , the projector unit coordinate system 305 may vary depending on the installation position or angle of the projector unit 300 .

The server 400 is a two-dimensional coordinate system of the camera unit image 201 coordinate system - a three-dimensional coordinate system camera unit coordinate system 205 - a three-dimensional coordinate system pool table coordinate system 105 - a three-dimensional coordinate system projector unit coordinate system 305 - Each coordinate system may be mapped or calibrated so that a specific point 190 is recognized as the same coordinate value or one-to-one corresponding coordinate value while the coordinate systems of the projector unit image 301, which are two-dimensional images, are interconnected.

After mapping or calibrating each coordinate system, the server 400 converts the coordinate value of the specific point 190 into the same or one-to-one corresponding coordinate value in the camera unit image 201, the pool table top surface 110, and the projector unit image 301. can recognize

For example, a specific point 190 having a coordinate value of [10, 70, 0] in the pool table coordinate system 105 of the pool table 100 is a 2D coordinate in the camera unit image 201 or the projector unit image 301 . It can be recognized as the value [10, 70].

The server 400, by mapping or calibration, a coordinate value of a billiard ball or cue table 102, which is a first object on the top surface of the billiard table 110, and a second object projected by the projector unit 300 onto the top surface 110 of the billiard table It is possible to time-synchronize or link the coordinate values of the content image, which is (120).

According to the present invention, the first object is photographed with the camera unit 200 , and entertainment objects such as fish, which is the second object 120 , can be moved on the top surface 110 of the billiard table so as to be linked to the movement path of the first object, the billiard ball. have. The projector image generated by the server 400 includes the second object 120 and may be modified in real time so that the second object 120 is linked to the movement path of the first object. Various postures and moving shapes of the second object 120 are stored in advance in a database of the server, and optimal database extraction can be achieved by interlocking with the movement of the first object.

4 and 6 , fish images 120a and 120b are illustrated as entertainment objects included in the second object.

In the fish images 120a and 120b included in the second object, the distance between the second object and the first object is the trigger range (Δ1) of the water polo 104 or the trigger range (Δ) of the first red ball 106). In the state out of 2), the second object may move along an arbitrary movement path within the predefined first area 610 without interlocking with the first object.

In the fish images 120a and 120b included in the second object, the distance between the second object and the first object is the trigger range (Δ1) of the water polo 104 or the trigger range (Δ) of the first red ball 106). 2) In the following state, the second object is linked to the movement of the first object and may be maneuvered to avoid the second area 620 away from the first object.

A feature of the present invention in which the projection area of the second object is determined as either the first area or the second area while comparing the separation distance between the first object and the second object with the trigger range (Δ1, Δ2) is a billiard ball or It has the advantage of being able to implement a character image that is linked to the movement of the cue table.

If the separation distance of the second object is out of the trigger range, the second object moves within the first area on the top surface of the billiard table. As a result, the second object may be moved to the second area. This enables various augmented reality implementations according to the interworking of the first object and the second object, and may be a core content constituting a real-time game.

The content image, which is the second object 120 , may include a recommended route with the highest 3-cushion probability of a billiard ball, a menu button, a restaurant, a speed display bar of the cue table 102, animation, a game information button, and the like.

The second object 120 may be linked to the movement of the first object, and the second object 120 may be displayed in the first area 610 outside a predetermined trigger range from the first object. If the separation distance between the first object and the second object is reduced to less than or equal to the trigger range, the second object 120 may be displayed at a location spaced apart from the first object at least more than the trigger range in the second area 620 . can be moved to

Such logic may be applied even when the menu button of FIG. 5 is clicked as an entertainment object. When the user approaches the end of the cue table 102, which is the first object, within a trigger range that is a predetermined distance from the second object 120, a new event may occur. Similar to the previous event in which the fish image moves away from the second region, logic for executing the menu button may be executed.

That is, it is the core of the present invention that a new event is executed when the separation distance between the first object and the second object approaches within the trigger range. There may be two representative types of new events. The first new event is the logic that the second object is moved so that the separation distance of the first object and the second object exceeds the trigger range. The second new event is the logic for the second object to perform an additional function. That is, when the separation distance between the first object and the second object approaches within the trigger range, as shown in FIG. 5 , the second object executes a unique function. The function release of the corresponding menu button may maintain the initial value without performing any function while the second object maintains the initial value when the separation distance between the first object and the second object is out of the trigger range.

As such, according to the separation distance of the first object and the second object, if the separation distance is within the trigger range, a new event is performed, and if the separation distance exceeds the trigger range, the second object maintains a predefined initial state or initial value and new events may not occur. When the billiard system is operated by such logic, the user may cause a change in the second object through an activity of bringing the first object that the user can control to the second object. This can be a core component of the present invention that enables playing a game or content.

The server 400 is a means for generating the projector unit image 301 , and the server 400 already knows the coordinate values of the second object 120 , the fish image or the menu button, of the projector unit image 301 . The server 400 may recognize the coordinate values of the camera unit image 201 of the cue table 102 , which is the first object, from the image captured by the camera unit 200 . When the coordinate value of the camera unit image 201 of the first object and the coordinate value of the projector unit image 301 of the second object 120 approaches within a predetermined range, the server 400 commands execution of the fish image or the menu button It is determined that it has been pressed, and the server 400 executes the corresponding function.

The projector unit 300 may project the projector unit image 301 including the content image of the second object 120 for which the coordinates are known on the top surface 110 of the billiard table.

The server 400 may recognize the coordinate values of the cue table 102 from the camera unit image 201 . When the coordinate value of the camera unit image 201 of the cue table 102 that is the first object and the coordinate value of the projector unit image 301 of the content image that is the second object 120 approaches within a predetermined range, the server 400 determines that the user It is considered that the execution of the image has been commanded and the function corresponding to the content image can be performed.

The server 400 receives the superimposed image of the image of the first object and the image of the second object photographed by the camera unit 200, and separates the image of the first object through vision processing of the superimposed image. image can be recognized.

1 and 4 , the projector unit 300 may be installed on a ceiling spaced from the pool table 100 by a predetermined distance so that an image can be projected on the upper surface of the pool table 100 . When the projector unit 300 is installed on the ceiling, it may be installed at the upper center of the billiard table 100 , or may be installed at an inclined position from the upper center of the billiard table 100 because mapping of the server 400 is possible. The projector unit 300 may be configured as a beam projector capable of projecting an image.

The display unit 500 may display the stroke method including the water polo and the red ball, the point, the thickness of the collision, the strength required to hit the water polo, and the hitting method on a separate touch screen screen other than the pool table 100 .

Referring to FIG. 2 , the server 400 includes an image conversion unit 410 , an error correcting unit 420 , an object identification unit 430 , a coordinate determination unit 440 , a direction detection unit 450 , and a path estimation unit 460 . ), a path extraction unit 470 , an object tracking unit 480 , and a point calculation unit 490 .

[Image coordinate system transformation]

The image conversion unit 410 may be a device for recognizing a billiard ball coordinate value of a 3D coordinate system from an image captured by the camera unit 200 . The image conversion unit 410 determines a transformation matrix between the camera unit coordinate system 205 that is the reference coordinate system of the camera unit 200 and the pool table coordinate system 105 that is the reference coordinate system of the pool table 100, and based on the transformation matrix, the camera From the image taken by the unit 200, it is possible to obtain a coordinate value at which coordinates of the billiard table 100 the billiard ball is located. The image conversion unit 410 is a transformation matrix between the projector unit coordinate system 305 and the pool table coordinate system 105, which is the reference coordinate system of the projector unit 300, or between the projector unit coordinate system 305 and the camera unit coordinate system 205. Through the transformation matrix, images and positions of each 3D coordinate system can be freely recognized.

The image taken through the camera unit 200 tilted with respect to the billiard table 100 is a three-dimensional real image is taken as a two-dimensional image. Therefore, it is necessary to convert a two-dimensional image taken with an oblique line into an actual three-dimensional coordinate system.

The image conversion unit 410 converts an image captured in a two-dimensional coordinate system into a coordinate value of a three-dimensional coordinate system in order to eliminate an error between an object image captured through the camera unit 200 and an object located in the actual pool table 100 . can do.

In the camera unit coordinate system 205 , the optical axis direction of the camera unit 200 may be Zc, and horizontal and vertical directions perpendicular to the optical axis may be Xc and Yc. In the projector unit coordinate system 305, the optical axis direction may be Zp, and the horizontal and vertical directions perpendicular to the optical axis may be Xp and Yp. The pool table coordinate system 105 may be a coordinate system based on the pool table 100 . After setting the coordinate system of the camera unit coordinate system 205 , the projector unit coordinate system 305 , and the pool table 100 , the position of the object can be known through coordinate transformation.

[Identification of billiard ball and cue table 102]

The camera unit 200 may acquire an image of the first object, which is a recognition image of the billiard ball or the cue table 102 . On the other hand, when the menu button is included in the image of the second object projected from the projector unit 300 to the pool table 100, pointing the menu button to the cue table 102 compares the separation distance between the two objects with a predetermined value. Through logic, it may be determined whether the user has pressed the menu button.

The billiard ball can be identified by distinguishing and recognizing the edge of the billiard ball in the image captured by the camera. If the cue stand 102 is distinguished and recognized, the cue stand 102 can be recognized. If the color camera is used, the color of the first object, the billiard ball, may be known.

The object identification unit 430 converts the image so that the color can be displayed in three forms of hue, saturation, and business card, and after removing noise through labeling image processing on the converted image, a billiard ball and a cue table ( 102) is a device for identifying.

The object identification unit 430 may form a group by attaching the same number (label) to adjacent pixels to recognize a billiard ball by binarizing an image formed in the HSV color space.

The error correction unit 420 may correct the outline of the billiard ball by limiting a high-frequency region forming the outline of the billiard ball recognized through the object identification unit 430 .

[Prediction of recommended route]

The coordinate determination unit 440 may coordinate the position of the billiard ball identified by the object identification unit 430 . The direction detecting unit 450 may detect the direction of linear motion of the cue table 102 by detecting the coordinates of the billiard ball and the direction from the handle to the tip of the cue table 102 . The handle is a part for the user to hold the cue table 102, and the tip is a part attached to the end of the cue table 102 and physically contacted when the cue table 102 hits the billiard ball.

Referring to FIG. 1 , the path estimation unit 460 may predict a movement prediction path L on which the billiard ball will move according to the detected straight line direction. It can be seen that the movement prediction path L is projected on the upper surface of the pool table 100 . Accordingly, when the cue ball 104 is hit through the cue table 102 , the path along which the cue ball 104 moves can be predicted. The movement prediction path L may be generated according to the separation angle, reflection angle, and rotation angle theory.

[Route Extraction and Guidance]

The path extraction unit 470 searches for at least one path direction in which the cue ball 104 is to be moved according to the coordinates of the billiard ball recognized by the object recognition unit 430, and calculates a stroke method corresponding to the path direction. . The path direction may be searched for a direction to move the cue ball 104 through any one of a separation angle, a reflection angle, and a rotation angle.

The projector unit 300 may implement the path direction and stroke method derived through the path extraction unit 470 in the pool table 100 .

In addition, in order to move the billiard ball on the upper surface of the billiard table 100 according to the path, the billiard table 100 shown in the dotted circle of FIG. ) may be displayed on one side of the upper surface 110 .

Referring to FIG. 3 , if you want to move the billiard ball through the expected path, if you hit the upper right corner of the cue ball 104 a little hard to hit the first red ball 106 thinly, the second red ball 107 can also be hit. is the path

[Route tracking and point counting]

When the cue ball 104 is moved by the cue table 102 , the object tracking unit 480 may track the cue ball 104 by identifying an area where the color distribution of the cue ball 104 is concentrated in real time. By tracking the cue ball 104 , it can be checked whether the cue ball 104 hits the wall (cushion) of the pool table 100 or the red ball.

The point calculation unit 490 is a device for recognizing the recommended path of the cue ball 104 and the collision between the first red ball 106 and the second red ball 107 to calculate score acquisition and failure.

The point calculation unit 490 automatically calculates the points, and the score is output by the display unit 500 or projected as a content image on the top surface 110 of the pool table 100 through the projector unit 300 . have.

[Content image]

In the present invention, various types of content images stored in advance through the server 400 connected to the projector unit 300 are output as images through the projector unit 300, and the image in the form of light on the top surface 110 of the pool table 100 can be displayed by projecting

Referring to FIG. 4 , the entertainment object 120 of the present invention may be provided as an image of the pool table 100 reminiscent of a pond.

Specifically, a plurality of fish as the second object swims around, and when the billiard ball as the first object passes, a wave shape is realized as the billiard ball passes, and when the billiard ball as the first object approaches the fish as the second object swimming You can implement the behavior of running away by surprise.

The movement path of the first object, the billiard ball, placed on the upper surface 110 of the billiard table 100 is tracked and recognized in advance. Among the images projected on the upper surface 110 of the pool table 100 through the projector unit 300 , the image of the fish playing is already stored in the server 400 as various data on the swimming shape of the fish.

Therefore, when a moving billiard ball approaches a swimming fish, an image of the fish running away in surprise can be realized.

Also, when the billiard ball moves, an image waving at the back of the billiard ball may be realized. The billiard table 100 can produce an image like a pond, and when playing billiards, it is possible to enjoy the game of billiards more interestingly by creating an environment like playing a game of billiards in a pond.

Referring to FIG. 5 , a different type of entertainment object 130 may be implemented on the upper surface 110 of the billiard table 100 .

Looking at the details of the entertainment object 130 , a plurality of compartments 131 having a predetermined area may be formed, and an entertainment object having a plate unit 132 in the compartment may be implemented.

Such an entertainment object may be provided as an entertainment object in which, when a billiard ball moves on the upper surface 110 of the billiard table 100 , an operation of rotating and restoring the plate unit 132 is implemented. The plate unit 132 may be a menu button on which a predetermined function is performed. During the game of billiards, a motion of rotating the plate of the compartment is implemented whenever the billiard ball passes the upper surface 110 of the billiard table 100, so that you can enjoy the game of billiards more interestingly.

In addition, as another entertainment object, the present invention can implement various entertainment objects, such as an image in which a flame is generated from the back of the billiard ball when the billiard ball moves, a cosmic background image on the upper surface 110 of the billiard table 100, and Santa Claus.

100: billiard table 102: cue table
104: water polo 106: first red ball
107: second red ball 110: top surface of the billiard table
122: pointer 120,130: entertainment object
131: compartment 132: plate part
134: points
200: camera unit 300: projector unit
400: server 410: video conversion unit
420: error correction unit 430: object identification unit
440: coordinate determination unit 450: direction detection unit
460: path estimation unit 470: path extraction unit
480: object tracking unit 490: point calculation unit
500: display unit

Claims (6)

a projector unit for projecting an image of a second object including an entertainment object on the pool table;
a camera unit for photographing an image of a first object including a billiard ball or a cue table;
a server for distinguishing and recognizing the image of the first object and the image of the second object; including,
Taking the first object with the camera unit,
moving the second object on the upper surface of the billiard ball so as to be linked to the movement path of the first object;
While comparing the separation distance between the first object and the second object with a trigger range, the projection area of the second object is determined as one of the first area or the second area, and the second object linked to the movement of the first object is determined. 2 Project the image of the object onto the pool table,
The second object is
When the separation distance between the second object and the first object is out of the trigger range, the second object moves along an arbitrary movement path within a predefined first area without interlocking with the first object,
In a state in which the separation distance between the second object and the first object is less than or equal to the trigger range, the second object is linked to the movement of the first object, and the billiard system avoids maneuvering to a second area away from the first object. According to claim 1,
The projector unit image generated by the server includes the second object,
The server corrects the posture and position of the second object in real time so that the second object is linked to the movement path of the first object,
The posture and shape of the second object are stored in advance in the database of the server, and the database is extracted with respect to the posture and shape of the second object by interlocking with the movement of the first object.
delete delete According to claim 1,
The fish swims so that a pond is created on the upper surface of the billiard table,
When the billiard ball passes, a wave is realized,
When the billiard ball approaches the swimming fish, the fish runs away by surprise,
The fish, the pond and the wave are represented on the billiard table in the form of a virtual image billiards system.
According to claim 1,
forming a partition having a predetermined area on the upper surface of the billiard table through the projector;
A plate portion is formed in the partition portion,
When the billiard ball approaches the plate part, a menu corresponding to the plate part is executed.

Images