KR20200009720A - A system for management and assistance of billiard game - Google Patents

Abstract

The present invention relates to a management and assistance system for billiard games, which comprises: an analysis unit for analyzing a hitting image of a player through a shot image received from a shooting means; a digital scoreboard; a display unit which displays the hitting image, analysis content analyzed through the analysis unit, or a guide image; and a storage unit which stores the hitting image and game information of the player and provides it to a terminal connected to a server. The analysis unit analyzes the hitting image of the player through the shot image, accumulates and stores a course and success of each hitting shot, derives information on a specific gravity for each course selected by the player, a success rate for each course, and a course having a low success rate for the analyzed player through the analysis, and provides the information to the display unit or the terminal.

Description

Billiard game management and assistance system {A SYSTEM FOR MANAGEMENT AND ASSISTANCE OF BILLIARD GAME}

The present invention relates to a system for managing and assisting billiard games.

In the meantime, the billiard halls have a billiard table and scoreboards for calculating their scores and operated a billiard room.

If you provide a variety of services, such as providing a replay video to the guests visiting the billiards room, analyze the batting, and provide a variety of information, you can enjoy a variety of fun and help improve your skills, There is no technology that implements this correctly.

In addition, even if some implementations, only the image is stored and can be viewed again, but the degree of application compared to the development of other electronic, communication and other technologies.

The background art of the present invention is disclosed in Korean Patent Laid-Open Publication No. 10-2003-0078981 or the like, but the fundamental solution to the above-mentioned problem is not presented.

The present invention for solving the above problems is to analyze the shots of the user by analyzing the shot image, through which the player mainly hits the course, calculates the success rate for each course, and the information to help the player's ability to increase Billiard game management and assistance system can be provided.

In addition, when the point is input to the digital scoreboard of the present invention, the game of the billiard game to capture the image determined to have obtained the point from the batting image of the player, merge the scored image captured during a game to create a highlight image And an auxiliary system.

In addition, the present invention can provide a billiard game management and assistance system that provides a guide to the player by analyzing the position of the ball on the pool table to project a point or project image on the pool table.

Problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

Billiard game management and auxiliary system according to an embodiment of the present invention for solving the above problems, an analysis unit for analyzing the player's batting image through the captured image received from the shooting means, digital scoreboard, the batting image, And a display unit for displaying the analysis contents or the guide image analyzed through the analysis unit, and a storage unit for storing game information of the batting image and the player and providing the game information to a terminal connected to a server. Analyze the player's batting video through, accumulate and store the course and success of each hit, and for the course of the course selected by the player, the success rate by course and the success rate of the corresponding player analyzed through this Derived information is provided to the display unit or the terminal.

In addition, when a point is input to the digital scoreboard, the player's batting video captures an image determined to have obtained the point as a scored image, and merges the scored images captured during one game to highlight the corresponding game. It further includes a highlight generator for generating and storing in the storage.

The apparatus may further include a plurality of laser pointers that project the laser toward the billiard table. The analyzer may analyze the current position of the ball on the pool table through the captured image when receiving a course recommendation from the player through the display unit. Extracting one or more recommended courses that can be scored and displayed on the display unit, and displaying a cue ball for hitting the recommended course selected by the player to the display unit, and displaying a cushion corresponding to a path through which the cue ball passes in the recommended course. It further comprises a guide providing for projecting a laser using the laser point in the position.

In addition, the projector for projecting light toward the billiard table and the position of the ball on the pool table to determine the cue ball and the target ball to extract one or more guide courses that can be scored, and the path of the guide course through the projector It further includes a guide providing unit for displaying as billiards.

The guide providing unit may match the extracted one or more guide courses with a success rate for each course of the player, select a guide course that matches a course having a low success rate, and route the selected guide course through the projector. It is characterized by projecting as billiards.

The guide providing unit may calculate the probability of a kiss occurring when the player hits the guide course and display the result on the display unit, predict the point where the kiss occurs, and display the result on the billiard table through the projector. One or more methods for avoiding kisses are derived and expressed through the display.

The analyzing unit may analyze the current batting attitude and cue ball of the player through the photographed image to derive an expected path of the cue ball expected when the player hits the batting spot and the cue of the cue ball. Project the expected path through the projector onto a billiard pool table.

The analyzer may calculate a position and probability of a kiss occurring in the expected path, and display the calculated probability and position through the display or display the billiard table through the projector to avoid the kiss. A method is derived and information about it is displayed through the display unit.

In addition, the server checks the position of the cue ball on the billiard table and the at least one object in the image received from the photographing means to generate status information, and matched the billiard images stored in the database with the status information at least one An image is displayed on the display unit.

In addition, when the training mode is selected by the player through the display unit, a plurality of course lists are displayed and the plurality of training courses assigned to the course selected by the player from the course list are sequentially provided to the player, but the player Projecting the position of the cue ball and the target ball stored in each training course to the billiard table through the projector so that the cue ball and the target ball can be arranged on the pool table according to the training course, and the projector is guided by the guide course assigned to the training course. Through the billiards projection to provide the player with a training guide.

According to the present invention as described above, by analyzing the player's batting video to provide information that helps to improve the player's ability, the visitor to the billiard room, in addition to simply enjoying the game to improve their skills in addition to the game This can be an effect that will make you have a lot of fun.

In addition, the present invention captures the scored images from the captured image to generate a highlight image to be viewed by the user, thereby providing an effect of providing a user edited the main scene rather than providing a simple replay.

In addition, the present invention provides a guide to the user by analyzing the position of the ball on the billiard table, it is also helpful for improving the user's skills, the effect of allowing customers who give up halfway to feel the difficulty in billiards can learn by themselves Can be exercised.

Effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram illustrating a billiard game management and assistance system according to an embodiment of the present invention.
2 is a block diagram of a billiard game management and assistance system according to an embodiment of the invention.
3 is an exemplary view illustrating that a laser pointer according to an embodiment of the present invention projects the recommended course onto a pool table cushion.
4 is an exemplary view illustrating that the projector according to the embodiment of the present invention projects the path of the guide course as a billiard.
5 is an exemplary diagram illustrating selecting a training course according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating operations of a CPU and a GPU according to parallel processing technique 1 and parallel processing technique 2 according to another embodiment of the present invention; FIG.

Advantages and features of the present invention, and methods for achieving them will be apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be embodied in various different forms, only the present embodiments are intended to complete the disclosure of the present invention, and those skilled in the art It is provided to fully inform the skilled person of the scope of the invention, which is defined only by the scope of the claims.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and / or “comprising” does not exclude the presence or addition of one or more other components in addition to the mentioned components. Like reference numerals refer to like elements throughout, and "and / or" includes each and all combinations of one or more of the mentioned components. Although "first", "second", etc. are used to describe various components, these components are of course not limited by these terms. These terms are only used to distinguish one component from another. Therefore, of course, the first component mentioned below may be the second component within the technical spirit of the present invention.

Unless otherwise defined, all terms used in the present specification (including technical and scientific terms) may be used in a sense that can be commonly understood by those skilled in the art. In addition, terms that are defined in a commonly used dictionary are not ideally or excessively interpreted unless they are specifically defined clearly.

Hereinafter, with reference to the accompanying drawings will be described an embodiment of the present invention;

Prior to the description, the meaning of terms used in the present specification will be briefly described. However, it is to be noted that the description of the terms is intended to help the understanding of the present specification, and therefore, the terms are not used to limit the technical spirit of the present invention unless explicitly stated as limiting the present invention.

Cue Ball: The ball that the player must hit. In general, different colors of cue balls are assigned to each player during the game, and the cue balls are played with the target balls. In the present invention, black balls are shown on the drawings for the purpose of describing the embodiments.

Our point: The position on the cue ball that the player hits. The direction of the ball, the rotational force, etc. will change depending on which player hits the cue ball.

Goal ball: A ball that is the player's goal to hit a cue ball. For example, a three-cushion game includes two goal balls, after which the cue ball hits the cushion after the first ball is hit. Goals will be scored if you bounce more than once and hit the second goal ball.

Billiard table: means a billiard table where you play billiards. In the embodiments to be described below, the three-cushion game proceeds as an example, but the present invention is not limited thereto, and there are various types of billiard games such as four-cushion, nine balls, and pocket balls.

1 is a view showing a billiard game management and auxiliary system according to an embodiment of the present invention, Figure 2 is a block diagram of a billiard game management and auxiliary system according to an embodiment of the present invention, Figure 3 is an embodiment of the present invention 4 is an exemplary view illustrating the laser pointer 220 projecting the recommended course to the pool table 320 cushion, and FIG. 4 is a view of the projector 250 according to the embodiment of the present invention. FIG. 5 is an exemplary diagram illustrating projecting by), and FIG. 5 is an exemplary diagram illustrating selecting a training course according to an exemplary embodiment of the present invention.

1 to 5, a billiard game management and assistance system according to an embodiment of the present invention will be described.

Billiard game management and auxiliary system 10 according to an embodiment of the present invention is the analysis unit 110, the display unit 100, the storage unit 120, the highlight generator 140, the laser pointer 220, guide agent Study 130 is included.

The analysis unit 110 analyzes the batter image of the player through the captured image received from the photographing means 210.

At this time, the photographing means 210 is installed in a place spaced a predetermined distance from the billiard table 320, it is preferable to be installed so as to shoot the upper surface of the billiard table 320, preferably installed at a predetermined height from the center of the billiard table 320 Therefore, photographing the upper surface of the billiard table 320 at a vertical angle may prevent the occurrence of an error.

The display unit 100 displays a digital scoreboard, a player's batting image, an analysis content analyzed by the analyzer 110, and a guide image to help the player.

In general, the billiard room is to allow players to calculate the score using the plate, in the embodiment of the present invention by providing a digital scoreboard through the display unit 100 to enable the player to calculate the score.

In addition, the digital scoreboard may be a number, the shape of the score display, such as may apply the shape of the tablet is not limited.

In addition, while displaying the player's batting image in real time, after a predetermined time it can be displayed to the user through the display unit 100 to reconfirm his batting after the batting.

In more detail, the analysis unit 110 analyzes the player's batting image through the shot image, accumulates and stores the course and success of each batting, the specific gravity of each course selected by the player, the success rate for each course and the same Information about the course having a low success rate of the corresponding player analyzed through the analysis is provided to the display unit 100 or the terminal 310.

According to the exemplary embodiment of the present invention, components such as the analyzer 110, the storage 120, the guide provider 130, and the highlight generator 140 may be embedded together in the display 100.

However, the display unit 100 may be used only as a means for expressing a screen and voice and receiving a predetermined input from the player, and the rest of the functions may be performed in a server, but is not limited thereto.

In addition, the display unit 100 may display an advertisement image or order food. In this case, it may be linked with various order applications.

In the course of billiards, there are turning, turning, turning, competition, combing, double rail, etc.

Players who play billiards often prefer certain courses according to their inclination, rather than hitting all of the above courses in the same way.

As a result, I often hit the course I prefer or prefer without knowing it, which often does not help me improve my skills.

Therefore, the analysis unit 110 according to an embodiment of the present invention analyzes the batting and accumulates and stores the course and success rate of each batting, and provides information on the specific gravity of the course selected by the player, the success rate by course . Then, through this process, the player derives a course having a low success rate and informs the player so that he / she knows a weak course.

For example, player A accumulates data such as 30 turns 60% success, 35 turns 65% success, 28 turns 59% success, 27 matches 58% success, 15 draws 30% success. If there is, the analysis unit 110 causes the display unit 100 or the terminal 310 to inform the player A that the success rate of the course that is deviated from the course is low.

The storage unit 120 stores the batting video and the game information of the player and provides the same to the terminal 310 connected to the server 300.

In this case, the server 300 stores information such as an ID for identifying a player, and the player may log in before starting a game through the display unit 100.

Accordingly, the player may log in by accessing the server 300 by using an application and a program of the terminal 310, and check his / her batting image and game information.

In addition, according to an embodiment of the present invention, the display unit 100 may display a virtual keyboard on the screen so that the player can log in.

In addition, the display unit 100 may include a photographing means to photograph the face of the player, store the biometric information, and automatically log in by recognizing the face when the player later revisits.

In addition, the display unit 100 includes a fingerprint recognition means, and scans and stores the fingerprint of the player, and stores the corresponding biometric information and automatically logs in by recognizing the fingerprint when the player revisits.

In addition, the billiard room may be installed in a storage box for storing the billiard cue table, each billiard cue table is stored in a different storage box, can be dispensed by being opened and closed independently. And, the cue table storage box is paired with the display units 100 provided in the billiard room. When the player logs in using the biometric information of the player to the display unit 100, the library storing the personal cue table of the player is automatically stored. Is opened and closed so that the player can take his cue.

In addition, in another embodiment, a rail for moving the billiard cue table may be provided on the wall surface of the billiard room. Then, when the player logs in through the display unit, a box in which the cue table of the player is stored is opened, and when the robot arm catches the cue table and puts the cue table on the rail, the rail is moved to position the billiard table where the player is located. The cue table is moved to.

Therefore, the player does not need to find his cue table, and can receive his cue table automatically moved to the billiard table where he is located.

In addition, the system according to an embodiment of the present invention may store information about the length and weight of each cue table in the billiard room, store information about the cue table that the player plays, analyzes the game of the player to the corresponding player By providing information (weight, length, etc.) about the cue table with the highest average (average score), the cue table that suits the player can be recommended.

In addition, the display unit 100 may provide an advertisement and a link for purchasing the cue table to allow the player to purchase the cue table.

When the point generator is input to the digital scoreboard, the highlight generator 140 captures a video, which is determined to have been obtained from the batting image of the player, as a scoring image, and merges the scoring images captured during one game to match the corresponding game. Generates a highlight image and stores it in the storage unit 120.

Previously, only the function of recording a player's bat video and then replaying it was provided, which may be inconvenient because the length of the video is too long because it includes many unnecessary scenes.

Therefore, since the highlight generator 140 captures the score image determined to be recognized as the score and merges the score images captured during one game to generate the highlight image of the game, the player may display the terminal 310 or the display. Through the unit 100, it is possible to briefly watch the highlight image of his game.

You can also share the highlight video to your friends or friends using the share function.

In this case, the analysis unit 110 may check the position of the ball on the billiard table 320 in the captured image, and cut the image from the time just before the ball is hit until the ball stops to capture the scoring image.

The laser pointer 220 is installed to be spaced apart from the billiard table 320 by a predetermined distance, and projects the laser toward the billiard table 320.

When receiving the course recommendation mode from the player through the display unit 100, the analysis unit 110 analyzes the current position of the ball on the billiard table 320 through the captured image, extracts and displays one or more recommendable courses that can be scored. Expressed to the unit 100.

In addition, the guide providing unit 130 expresses the shop of the cue ball 230 for hitting the recommended course selected by the player to the display unit 100, the cushion corresponding to the path that the cue ball 230 passes in the recommended course The laser emits using the laser point at the positions of.

This is a recommended course of turning (Outside angle shot) in Figure 3, the cue ball 230 hits the first goal sphere 235, one point 221, two points 222 of the cushion 3 points 223, 4 points 224 after hitting the second target sphere 237 is illustrated.

Therefore, the guide provider 130 projects the above 1 point 221, 2 points 222, 3 points 223, 4 points 224 through the laser point, the player scores when hitting the point You get the information that you can.

In addition, the player may be selected how many points to project. Since the player's ability is different, there may be a player who wants to project only one point 221 instead of all points, so the number of points to be projected can be selected.

A guide course for turning is illustrated in FIG. 4 in the same manner as in FIG. 3.

The projector 250 is installed to be spaced apart from the billiard table 320 by a predetermined distance, and projects light in the direction of the billiard table 320.

The guide providing unit 130 checks the position of the ball on the billiard table 320 to determine the cue ball 230 and the target ball to extract one or more guide courses that can be scored, and the path of the guide course through the projector 250 through the billiard table. Indicated by 320.

In this case, as when projecting through the laser pointer, one or more guide courses may be expressed through the display unit 100 and one of them may be input from the player.

In addition, the guide provider 130 projects the guide course selected by the player to the billiard table 320 through the projector 250.

For those who play billiards professionally, there is no difficulty in choosing a course, but beginners and intermediates may have difficulty choosing a course, and there may be many courses that you do not know. Accordingly, the guide provider 130 may check the current balls of the billiard table 320 to extract scoreable courses and provide information to the player.

Beginners who play billiards often have difficulty in playing and lose interest. Thus, by projecting the course to the billiard table 320 through the projector 250, a person can learn by themselves without informing them. It is effective.

In addition, the guide providing unit 130 calculates a probability that a kiss occurs when the player hits the guide course and displays it on the display unit 100, and anticipates a point where the kiss will occur, the billiard table (eg, through the projector 250). In operation 320, one or more methods for avoiding a kiss are derived and displayed through the display unit 100.

To help explain the invention, a brief description of the "kiss" will be given in a three-cushion race.

In this case, the goal sphere may be scored after first adjusting the cushion without first matching the goal sphere, but to illustrate the example, the goal sphere may be matched first.

The kiss is scored when the cue ball 230 hits the first goal ball 235 to hit the first goal ball 235 three or more times after hitting the cushion of the pool table 320 more than the second goal ball 237, This is a case where the cue ball 230 and the first target sphere 235 collide with each other before the second target sphere 237 fits.

When a player hits such a kiss, most of the time, the result is a failure to score. If you are not a professional player, it is not easy to anticipate and avoid this kiss.

Therefore, the guide providing unit 130 according to the embodiment of the present invention informs the point where the kiss will occur, and informs the method for avoiding this to help the player.

Therefore, the guide providing unit 130 provides information on the probability of the kiss to occur in the guide course, the point where the kiss will occur, and the thickness of the cue ball 230 and the target sphere and the cue ball 230 as a method for avoiding the kiss. Information about the rotational force, our shop, etc. can be derived and provided.

In addition, the analysis unit 110 analyzes the current hit posture of the player, the point of the cue ball 230 through the captured image, when the player proceeds to the current hit posture and the point of the cue ball 230 cue ball 230 Deriving an expected path of, and project the derived expected path to the billiard table 320 through the projector 250.

Such a simulation mode may be executed when a simulation button is input from a player through the display unit 100.

In general, the player thinks of the progression path of the cue ball 230 in his head and hits the cue ball 230, but the path of the cue ball 230 may actually be different.

Therefore, by using the simulation mode as described above, when the player hits the current batting posture, the cue ball 230 of our shop, it is possible to check the expected path through the light projected on the billiard table 320, based on this You can change the batting posture or our shop.

Through this, the player can correct his posture and learn about the thickness of the ball and the ball.

At this time, the analysis unit 110 analyzes the captured image, analyzes the player's leg angle, waist angle, gaze, the angle of the arm from the ground or billiard table 320 to analyze the current batting position of the player.

If it is determined that at least one of the analysis elements is out of a preset posture range, information on an incorrect posture of the corresponding player may be provided.

In addition, the analysis unit 110 may analyze the photographed image to calculate the angle of the cue table of the player from the billiard table 320, and may display a warning when the angle becomes greater than or equal to a preset angle.

The server 300 checks the position of the cue ball 230 and the one or more target balls on the billiard table 320 in the photographed image to generate state information, and matches the billiard images and state information stored in the database, one or more matched. The image is displayed on the display unit 100.

In more detail, the server 300 matches a plurality of billiard images stored in the database with the status information, selects a billiard image (similar situation) that matches the current situation of the player, and displays the corresponding billiard image on the display unit 100. Will be displayed.

Through this, the player can check how the other player or the player scored in a situation similar to his current state through the billiard video, and play with reference to this.

In addition, according to an embodiment of the present invention, it is possible to provide a training mode to the player.

When the training mode is selected by the player through the display unit 100, the guide providing unit 130 displays a plurality of course lists, and sequentially delivers the plurality of training courses assigned to the course selected by the player from the course list. to provide.

At this time, the position of the cue ball 230 and the target ball stored in each training course to the billiard table 320 through the projector 250 so that the player can place the cue ball 230 and the target ball on the billiard table 320 as a training course. Projecting the guide course assigned to the training course to the pool table 320 through the projector 250, to provide a training guide to the player.

As mentioned in the course above, the plurality of course lists includes course lists for turning, turning, turning, competition, combing, double rail, and the like.

The storage unit 120 stores a plurality of training courses assigned to each course, and each training course stores a ball position and a guide course.

Therefore, the guide providing unit 130 projects the position of the ball of the training course to the billiard table 320 through the projector 250, and when the ball is placed in the position by the player, a guide that can score the training course Projecting the course through the projector 250 to the pool table 320 provides the player with a training guide.

When the player completes the training course, the guide provider 130 may proceed to the next training course according to a predetermined process.

In addition, a scanning device (not shown) for recognizing the positions of the balls on the billiard table 320 may be provided in the empty space under the cushion of the billiard table 320 according to the embodiment of the present invention.

Since a predetermined empty space is provided below the cushion of most billiards table 320, when a scanning apparatus is provided at the corresponding position, the position of the ball can be scanned without affecting the game.

Then, the analysis unit 110 receives the scanned data from the scanning device, analyzes the coordinates of each ball to calculate the position coordinates of the current ball on the billiard table 320, and image it and display it to the display unit 100 can do.

In addition, by using the position information of the balls calculated in this way, it is also possible to implement the above-described embodiments.

In another embodiment of the present invention to be described below is an embodiment using a SIFT algorithm to de-wapping the image taken by the photographing means.

The billiard table has a flat top surface due to the characteristics of the game. When shooting through the shooting means, the image is not flat as the billiard table due to the angle, lens, and perspective, so that the screen analysis may be distorted.

In addition, the method may be used to stitch an image photographed by two or more photographing means, and the two methods may be used in combination.

Embodiments to be described below may be used in combination with the embodiments described with reference to FIGS. 1 to 5 above.

FIG. 6 is a diagram illustrating operations of a CPU and a GPU according to the parallel processing method 1 and the parallel processing method 2 according to another embodiment of the present invention.

Referring to FIG. 6, a billiard game management and auxiliary system according to another embodiment of the present invention may include a stitching device, and the stitching device may include a CPU, a GPU, and a controller including a plurality of cores.

The stitching apparatus according to the embodiment of the present invention is used for a stitching process for extracting feature points from an image of a pool table photographed from a plurality of photographing means.

The control unit performs an input task for performing an input process of an image, an SIFT task for extracting feature points from an image, and an output task for performing an output process of an image in order to parallelize the stitching process for the image input through the photographing means. As such, the CPU and GPU can be controlled to perform parallelism in consideration of three tasks.

The stitching process performed through the stitching apparatus is divided into an input process read to the CPU, a part of extracting feature points from an image, and an output process of generating and outputting a panoramic image by connecting two images based on the feature points.

For example, the remaining cores may be idle while performing the stitching process of extracting feature points from one core. The controller may determine a data distribution amount of each core so that idle time of each core can be minimized. For example, the controller may determine the amount of data distribution for SIFT processing in each of the CPU and the GPU by dividing the speed of the GPU by the increase in the speed of the GPU.

The controller performs parallel processing using any one of the parallel processing technique 1 and the parallel processing technique 2 based on the stitching processing time, the input processing time of the image, and the output processing time of the image, which are required to extract the feature points from the GPU. You can decide whether or not to perform. That is, the controller may determine whether to perform parallel processing using any one of the predefined parallel processing techniques based on the execution time of the three tasks identified above.

For example, the controller calculates an input processing time t1 of an image performed in a CPU, calculates an output processing time t3 of an image performed in a CPU, a stitching processing time t2 in a CPU, The stitching processing time (T _{GPU (t2)} ) can be calculated. Then, the control unit calculates the input processing time t1, the output processing time t3, the stitching processing time t2 in the CPU, the stitching processing time T _{GPU (t2) in the GPU} , and Equations 1 to 1 below. A technique for performing parallel processing may be determined based on the algorithm of Equation 6, Table 1.

는 CPU 및 GPU를 동시에 이용하여 t1, t2, t3를 처리하는데 소요되는 시간으로서, 총 처리시간(total execution time)을 나타내며, t1은 CPU에서의 영상의 입력처리시간, t2는 CPU 또는 GPU에서의 스티칭 처리시간, 즉, SIFT 처리시간(t2), t3는 CPU에서의 영상의 출력처리시간을 나타내고, n은 CPU의 코어의 수, m은 영상(프레임)의 수를 나타낼 수 있다. 그리고, T_{CPU( )}와 T_{GPU( )}는 병렬처리기법 1(scenario 1)에 따라 수행되는 멀티코어 CPU(multicore-CPU) 및 멀티코어 GPU(multicore-GPU)에서 모듈들의 처리 시간(execution time)을 나타낼 수 있다. 여기서, t₁, t₂, t₃는 CPU의 처리 시간(execution time)에 영향을 주고, t2는 GPU의 처리 시간(execution time)에 영향을 줄 수 있다.In Equation 1,

Is the time taken to process t1, t2, and t3 using the CPU and GPU simultaneously, and represents the total execution time, t1 is the input processing time of the image in the CPU, t2 is the The stitching processing time, i.e., SIFT processing time t2 and t3, represents the output processing time of the image in the CPU, n may represent the number of cores of the CPU, and m may represent the number of images (frames). In addition, T _{CPU ()} and T _{GPU ()} are the execution time of modules in a multicore CPU and a multicore GPU that are executed according to parallel processing technique 1. Can be represented. Here, t ₁ , t ₂ , and t ₃ may affect the execution time of the CPU, and t2 may affect the execution time of the GPU.

According to Equation 1, a larger value of the time t ₁ , t ₂ , t ₃ is processed by the CPU and the time required to process t2 by the GPU (that is, the SIFT processing time of the GPU), the input processing time (t1), Parallel processing method 1 is performed based on the output processing time t3, the number of CPU cores n, and the number of frames of the image m, and overlaps t ₁ and t ₃ to reduce idle time. It can be seen that.

In Equation 1, the processing time T _CPU () of the _CPU performed according to the parallel processing method 1 may be expressed as Equation 2 below.

In Equation 2, n-1 represents an n-1th image (i.e., n-1th frame), and DataCopyTime is a time taken to copy data from the CPU to the GPU for SIFT parallelism, that is, the data of the GPU. The copy time can be indicated.

The SPEEDUPCPU may represent a speed increase value of the CPU measured for the CPU, and the SPEEDUPGPU may represent a speed increase value of the GPU measured for the GPU.

According to Equation 2, as stitching processing (feature point extraction), that is, SIFT processing in parallel at the same time in the CPU and GPU, the t2, that is, SIFT processing time can be divided into SPEEDUPCPU and SPEEDUPGPU. As shown in Equation 2, the processing time T _CPU () of the _CPU performed according to the parallel processing method 1 may be determined by t ₁ , t ₂ , and t ₃ .

In Equation 2, the data copy time DataCopyTime may be calculated based on the data transfer time from the CPU to the GPU and the data transfer time from the GPU to the CPU (eg, the time required to transfer the processing result to the CPU). The data transfer time from the CPU to the GPU and the data transfer time from the GPU to the CPU may be calculated based on the input data amount and the output data amount of the GPU.

In Equation 1, the time T _GPU () required to perform the stitching process, that is, the SIFT process, according to the parallel processing technique 1 may be expressed as Equation 3 below.

In Equations 1 to 3, the simultaneous processing of the CPU and the GPU according to the parallel processing method 1 (scenario 1) has been described, and the total processing in the simultaneous processing on the CPU and the GPU according to the parallel processing method 2 (scenario 2). The total execution time may be expressed as in Equation 4 below.

In Equation 4, the time required to perform stitching processing, i.e., SIFT processing, on the CPU according to the parallel processing method 2 T _CPU () and the time required to perform stitching processing, ie, SIFT processing, on the _GPU T _GPU (). May be expressed as Equations 5 and 6, respectively.

According to Equation 4 to Equation 6, it can be seen that the parallel processing technique 2 (scenario 2) reduces idle time by overlapping t ₁ or t ₂ with the data copy time of the GPU.

In the case of the parallel processing technique 1, the input processing time t ₁ and the output processing time t ₃ are better than the parallel processing technique 2 when the stitching processing (feature point extraction), that is, the time when the SIFT processing (t ₂ ) is performed on the GPU. Can have performance. In addition, when t ₁ and t ₂ are smaller than the data copy time of the GPU, parallel processing method 2 may have better performance than parallel processing method 1.

As such, the controller performs the best performance for simultaneous processing of the CPU and GPU on the images (frames) currently input through a simple operation comparing t1, t2, and t2 processing time (t ₂ on GPU) of the GPU. A parallel processing technique (eg, parallel processing technique 1 and parallel processing technique 2) having a value may be determined, and simultaneous processing of the CPU and the CPU may be controlled according to the determined technique.

Here, the controller may compare the t ₁ , t ₂ , and t ₂ processing time (t ₂ on GPU) of the GPU according to the algorithm of Table 1 below to determine the most suitable parallel processing technique in the current situation.

과 상기 입력처리시간 t₁의 크기를 비교할 수 있다. 이때, 입력처리시간 t₁이

보다 작은 경우, 제어부는 병렬처리기법 1에 따라 해당 영상에 대한 병렬처리, 즉, CPU와 GPU의 동시 처리를 수행하는 것으로 결정할 수 있다. 그리고,

이 입력처리시간 t₁ 보다 작지 않은 경우, 즉, t₁ 이상인 경우, 제어부는 병렬처리기법 2에 따라 해당 영상에 대한 병렬처리, 즉, CPU와 GPU의 동시처리를 수행하는 것으로 결정할 수 있다. 한편, 상기 출력처리시간 t3 이 입력처리시간 t₁보다 큰 경우에도, 마찬가지로, 제어부는 상기

과 출력처리시간 t₃을 비교하여 해당 영상의 병렬처리를 병렬처리기법 1 및 2 중 어느 것으로 수행할지 여부가 결정될 수 있다.According to Table 1 above, the control unit may calculate the stitching processing time, that is, the SIFT processing time (t2 on GPU) for the CPU and the GPU. The controller may compare the larger value of the input processing time t ₁ and the output processing time t _{3 with} the size of the stitching processing time in the GPU, that is, the value of the SIFT processing time t ₂ on GPU. For example, when the input processing time t ₁ is greater than the output processing time t ₃ , the controller may control the stitching processing time (ie, SIFT processing time) t ₂ on GPU to increase the speed of the GPU ( Calculated by dividing by (SPEEDUPGPU)

And the size of the input processing time t ₁ can be compared. At this time, the input processing time t ₁

In a smaller case, the controller may determine to perform parallel processing on the corresponding image, that is, simultaneous processing of the CPU and the GPU, according to the parallel processing technique 1. And,

When the input processing time is not less than t ₁ , that is, when t ₁ or more, the control unit may determine to perform parallel processing on the corresponding image, that is, simultaneous processing of the CPU and the GPU, according to the parallel processing technique 2. On the other hand, even when the output processing time t3 is larger than the input processing time t ₁ , the control unit is similar to

And the output processing time t ₃ may be determined whether the parallel processing of the corresponding image is performed by the parallel processing techniques 1 and 2.

As such, when a technique to perform parallel processing is determined, the controller controls the CPU and GPU to perform a stitching process (ie, feature point extraction) corresponding to a data distribution amount (ie, SIFT data distribution amount) according to the determined parallel processing technique. can do.

For example, when it is determined that the parallel processing is performed by the parallel processing technique 1, the controller performs the input processing of the image on the GPU during the idle time of the CPU generated as the image stitching processing is performed on the GPU. And control the GPU. That is, the controller may control the CPU to perform input processing during the idle time in order to reduce the idle time of the CPU (ie, the host core of the CPU) generated when the GPU processes the data.

As another example, when it is determined to perform parallel processing using the parallel processing technique 2, the controller may control the GPU to perform a plurality of SIFT processes predefined at the GPU.

As such, the CPU performs stitching and data input / output processing of the data corresponding to the data distribution amount of the CPU among the total data to be processed according to the parallel processing method 1 or 2, and the GPU is applied to the data distribution amount of the GPU among the total data. By performing the stitching processing of the corresponding data according to the parallel processing technique 1 or 2 (that is, simultaneously processing the stitching processing for extracting the feature points in parallel on the CPU and the GPU), the time required for the stitching processing can be reduced.

The task may include a task for input processing such as reading an image, a task for stitching processing (that is, a SIFT process) for extracting and attaching feature points to the read image, and a stitching process. It can be divided into tasks for output processing. At this time, the input processing and the output processing are difficult to parallelize due to data dependency in one image, and the stitching processing for extracting feature points can be parallelized. Accordingly, the input processing and the output processing can be parallelized on a task basis so that parallelism can be performed on multiple images, and the data parallelization can be performed on the stitching processing.

At this time, it takes time to pass the data to be calculated from CPU to GPU (data transfer time from CPU to GPU) and time to receive the result value (GPU to CPU) during data parallelism. Parallelism may be performed in consideration of time. That is, as shown in Equation 2 above, the parallelization using the GPU may be performed based on the parallel processing technique 1 410 or the parallel processing technique 2 420 in consideration of the data copy time DataCopyTime.

In FIG. 6, reference numeral 410 denotes parallel processing using a CPU and a GPU according to the parallel processing technique 1, wherein the parallel processing technique 1 is used in the CPU so as to reduce the idle time of the CPU generated during data processing of the GPU. It may have a parallel processing structure that performs input processing. In other words, the parallel processing method 1 performs input processing (t ₁ ) and stitching processing (i.e., SIFT processing for extracting feature points) on the CPU, and simultaneously copies data for stitching processing (i.e., extracts feature points) from the GPU. A technique for performing SIFT processing to extract the data, i.e., an idle time by overlapping the input processing t ₁ and the output processing t _{3 for} each image (i.e., frame) by the copy-calculation-copy method of the GPU. It can represent a technique for reducing the idle time.

As such, when performing parallel processing according to the parallel processing method 1 (410), the influence of the input processing performed by the CPU may affect the stitching processing (feature point extraction) performed by the CPU. As such, parallel processing may be performed with the structure of parallel processing technique 2 (420) to remove the influence of the input processing on the CPU on the stitching processing.

420 denotes parallel processing using a CPU and a GPU according to the parallel processing method 2. The parallel processing method 2 reduces a CPU idle time by processing a predetermined number of SIFTs at a time (for example, four) on the GPU. It may have a structure to make. In other words, parallel processing technique 2 performs stitching processing (i.e. SIFT processing for extracting feature points) on the CPU, and simultaneously stitches processing (i.e. SIFT processing for extracting feature points) by copying data for stitching processing on the GPU. As a technique, the GPU is calculated for each number of cores of the CPU (for example, four frames), and in the second parallel processing, the input processing is performed by changing the order of the input processing t1 and output processing t3 in the CPU. A technique of reducing idle time by overlapping the data copy time of the processing t1 and the output processing t3 can be described.

For example, referring to 410, in the case of the parallel processing method 1, stitching processing (that is, SIFT) extracting feature points from the GPU for each image for each image 1 to 4 (ie, frames 1 to 4). Then, it can be confirmed that the processing result value transmitted for each image is transmitted to the CPU. On the other hand, referring to 420, in the case of parallel processing method 2, it is confirmed that stitching processing (ie, SIFT processing) for extracting feature points from images 1 to 4, that is, four images, is performed at once on the GPU. Can be. In addition, it can be confirmed that the result values processed for the images 1 to 4 are transmitted at once from the GPU to the CPU. As described above, it is more difficult to bundle a plurality of images and process the SIFT at once than in the case of the parallel processing technique 1, but the time required for the image input processing (that is, the input processing time) is the stitching process (SIFT processing). In this case, the parallelism may be performed on the image using the parallel processing technique 1 or the parallel processing technique 2 depending on the situation based on the algorithm 1 of Table 1.

Although the embodiments have been described by the limited embodiments and the drawings as described above, various modifications and variations are possible to those skilled in the art from the above description. For example, the described techniques may be performed in a different order than the described method, and / or components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different form than the described method, or other components. Or, even if replaced or substituted by equivalents, an appropriate result can be achieved.

In the above, embodiments of the present invention have been described with reference to the accompanying drawings, but those skilled in the art to which the present invention pertains may realize the present invention in other specific forms without changing the technical spirit or essential features thereof. I can understand that. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

10: Billiard Game Management and Assistant System
100: display unit 110: analysis unit
120: storage unit 130: guide providing unit
140: highlight generation unit 210: photographing means
220: laser point 221: 1 point
222: 2 points 223: 3 points
224: 4 points 230: cue ball
235: Second purpose sphere 237: Second purpose sphere
250: projector 300: server
310: terminal 320: pool table

Claims (10)

An analysis unit for analyzing a batting image of the player through the captured image received from the photographing means;
A display unit for displaying a digital scoreboard, the hit image, analysis contents analyzed through the analysis unit, or a guide image; And
It includes a storage unit for storing the batting video and the game information of the player to provide to the terminal connected to the server,
The analysis unit,
Analyze the player's batting image through the shot image, accumulate and store the course and success of each bat, and the ratio of the course selected by the player, the success rate for each course and the success rate of the corresponding player analyzed through this Billiard game management and assistance system that derives information about the course and provides it to the display unit or the terminal. The method of claim 1,
When a point is input to the digital scoreboard, the player's batting image captures an image determined to have obtained the point as a scoring image, and merges the scoring images captured during one game to generate a highlight image of the corresponding game. And a highlight generator to store the storage in the storage unit. The method of claim 1,
A plurality of laser pointer for projecting the laser in the billiard table direction,
The analysis unit,
When receiving a course recommendation from the player through the display unit, by analyzing the current position of the ball on the billiard table through the captured image to extract one or more recommended courses that can be scored, and to express to the display unit,
A guide providing unit for expressing the shop of the cue ball for hitting the recommended course selected by the player to the display unit, and projecting the laser using the laser point to the positions of the cushion corresponding to the path through which the cue ball passes in the recommended course Including more, billiard game management and assistant system. The method of claim 1,
A projector projecting light toward the pool table; And
Checking the position of the ball on the billiard table to determine the cue ball and the target ball to extract one or more guide courses that can be scored, and further comprising a guide providing unit for displaying the path of the guide course through the projector to the pool table, billiard game Management and auxiliary systems. The method of claim 4, wherein
The guide providing unit,
Matching the extracted one or more guide courses with the success rate for each course of the player, select a guide course matching the course with a low success rate, and project the path of the selected guide course to the billiards through the projector , Billiards game management and assistant system. The method of claim 4, wherein
The guide providing unit,
At least one for calculating the probability that a kiss occurs when the player hits the guide course and displays it on the display unit, anticipates the point where the kiss will occur, displays it on the pool table through the projector, and avoids the kiss. Billiard game management and assistance system, which draws a method and expresses it through the display. The method of claim 5,
The analysis unit,
Analyzing the current bat attitude and cue ball of the player through the photographed image, deriving the expected path of the cue ball expected when the player hits the current bat posture and the cue of the cue ball, and calculates the expected path Billiards game management and assistant system, projecting to the billiard pool table through the projector. The method of claim 7, wherein
The analysis unit,
Calculating the probability and location of the kiss in the expected path, and expressing the calculated probability and location on the display unit or displaying on the billiard table through the projector;
Billiard game management and assistance system for deriving a method for avoiding the kiss and expressing information about it through the display unit. The method of claim 1,
The server,
Identifying the position of the cue ball on the billiard table and one or more target balls in the image received from the photographing means to generate status information, and match the billiard images stored in the database with the status information and display one or more matching images to the display unit. , Billiards game management and assistant system. The method of claim 4, wherein
When the training mode is selected by the player through the display unit, a plurality of course lists are displayed.
Provide a plurality of training courses assigned to the course selected by the player from the course list to the player in sequence,
Projecting the cue ball and the target ball stored in each training course to the pool table through the projector so that the player can place the cue ball and the target ball on the pool table according to the training course,
Billiard game management and assistance system for providing a training guide to the player by projecting the guide course assigned to the training course to the billiards through the projector.

Images