KR20240002869A - Method for projecting virtual billiard game image on billiard table, projector device and image projection server for performing the same - Google Patents

Abstract

A method for projecting a virtual billiard game image on a billiard table and a projector device for performing the same are disclosed. A projector according to an embodiment includes a processor that generates a virtual billiard game image from an actual billiard game image, and a projection image output module that projects the generated virtual billiard game image toward the upper surface of the billiard table, the processor From the real-life billiards game image, extract path information where the real-life cue ball moves on the real-life billiard table and collides with at least one real-time object ball, and based on the extracted path information, virtual cue balls move on the virtual billiard table. A virtual billiard game image is generated including a movement path where the cue ball moves and collides with at least one virtual object ball.

Description

Method for projecting a virtual billiard game image on a billiard table, a projector device and an image projection server for performing the same

The present invention relates to a technology for projecting a virtual billiard game image on a billiard table.

Billiards is a game in which several players compete for scores by hitting billiard balls placed on a billiard table with their own cue sticks. It is important to win the game that the player hits the exact point on the cue ball intended by the billiard cue so that the cue ball moves along the intended path and collides with several object balls.

There are usually billiard table points (or billiard table cushion points) of white dots around the billiard table. There are 9 billiard table points in one direction of the billiard table, and 5 points in the other direction. Players who play billiards can refer to billiard table points in deciding which direction to hit the cue ball. Players can easily identify the specific location of the billiard ball on the billiard table cushion through the billiard table points.

General players want to practice the movements of the cue ball and object balls by watching the video of the billiards game of experts, but in the past, it was difficult for the general player to position the billiard balls on their billiard table in the same way as the video of the billiard game of the expert. There was no way for players to intuitively understand the billiard ball movements of experts and reproduce those movements.

The projector device according to one embodiment includes a processor that generates the virtual billiard game image from an actual billiard game image, and a projection image output module that projects the generated virtual billiard game image toward the upper surface of the billiard table. And the processor extracts, from the real-life billiard game image, path information on which the real-life cue ball moves on the real-life billiard table and collides with at least one real-time object ball, and based on the extracted path information, virtual The virtual billiard game image may be generated including a movement path where the virtual cue ball moves on the billiard table and collides with at least one virtual object ball.

The path information may include change information over time in the positional coordinates of the target ball of the field trip and change information over time in the position coordinates of the at least one target ball of the field trip.

Within the virtual billiard game image, the virtual cue ball and the at least one virtual object ball may move over time along the movement path.

The movement path is displayed by a plurality of circular images corresponding to the virtual apparatus and the at least one virtual object ball, and the plurality of circular images may be arranged along the movement path at set intervals. .

The plurality of circular images may be displayed sequentially along the movement path.

The plurality of circular images may include at least two different types of circular images.

The two or more different types of circular images may include a translucent circular image and an opaque circular image.

The plurality of circular images may be displayed as circular images of the same shape at a plurality of points on the movement path.

The plurality of points may include a point where the virtual cue ball collides with the at least one virtual object ball or a point where the virtual cue ball contacts a corner of the virtual billiard table.

The processor extracts billiard table points from the real-time billiard game image, and provides the path information based on a positional relationship between the arrangement of the extracted billiard table points and the real-time cue ball or the at least one real-time target ball. can be extracted.

The processor applies a learned neural network-based recognition model to the real-time billiard game image to extract the positions of the real-time cue ball and the at least one real-time object ball from the real-time billiard game image, and the extracted The route information may be extracted based on the locations of the target ball of the field trip and the at least one target ball of the field trip.

The processor may generate the virtual billiard game image in which the virtual cue ball and the at least one virtual object ball move on the movement path at a speed according to a user command.

The processor receives a user command from a user to select any one virtual billiard ball among the virtual cue ball and the at least one virtual object ball, and the selected virtual billiard ball moves on the movement path. You can create a billiards game image.

An image projection server that projects a virtual billiard game image on a billiard table using a projector according to an embodiment includes a processor that generates the virtual billiard game image from an actual billiard game image, and the generated virtual billiard game. It includes a communication module that transmits an image to the projector device through a communication network, and the transmitted virtual billiard game image can be projected from the projector device to the upper surface of the billiard table.

The processor extracts, from the photorealistic billiards game image, path information on which a real-life cue ball moves on a real-life billiard table and collides with at least one real-time object ball, and based on the extracted path information, creates a virtual billiards table. The virtual billiard game image including a movement path along which the virtual cue ball and at least one virtual object ball move on the table can be generated.

The path information may include change information over time in the positional coordinates of the target ball of the field trip and change information over time in the position coordinates of the at least one target ball of the field trip.

Within the virtual billiard game image, the virtual cue ball and the at least one virtual object ball may move over time along the movement path.

The processor receives a user command from the user to select one virtual billiard ball among the virtual cue ball and the at least one virtual object ball, and displays a plurality of circular images corresponding to the selected virtual billiard ball. The virtual billiard game image placed on the movement path of the selected virtual billiard ball can be created.

The plurality of circular images may be sequentially displayed along the movement path of the selected virtual billiard ball.

The processor receives a user command to adjust a time interval at which the plurality of circular images are sequentially displayed, and the plurality of circular images are sequentially displayed at the adjusted time interval along the movement path of the selected virtual billiard ball. The displayed virtual billiard game image can be created.

The processor extracts billiard table points from the real-time billiard game image, and provides the path information based on a positional relationship between the arrangement of the extracted billiard table points and the real-time cue ball or the at least one real-time target ball. can be extracted.

According to one embodiment, a method of projecting a virtual billiard game image based on a real-life billiard game image includes, from the real-life billiard game image, a real-life cue ball moving on a real-life billiard table and colliding with at least one real-time object ball. Extracting path information, based on the extracted path information, generating the virtual billiard game image including a movement path where a virtual cue ball moves on a virtual billiard table and collides with at least one virtual object ball. It may include an operation and an operation of projecting the generated virtual billiard game image onto the upper surface of an actual billiard table.

The path information may include change information over time in the position coordinates of the target ball of the field trip and change information over time in the position coordinates of the at least one target ball of the field trip.

Within the virtual billiard game image, the virtual cue ball and the at least one virtual object ball may move over time along the movement path.

1 is a diagram illustrating an outline of an image projection system according to an embodiment.
FIG. 2 is a diagram for explaining the configuration of a projector device according to an embodiment.
FIG. 3 is a diagram illustrating an outline of an image projection system according to another embodiment.
FIG. 4 is a diagram illustrating providing a virtual billiard game image corresponding to an actual billiard game image by connecting to an external device according to an embodiment.
FIG. 5 is a diagram illustrating a virtual billiard game image generated in response to a user command to show the cue ball path in one embodiment.
FIG. 6 is a diagram illustrating a virtual billiard game image generated according to a user command to show the path of the first object ball in one embodiment.
FIG. 7 is a diagram for explaining a virtual billiard game image generated according to a user command to show the path of the cue ball and the first object ball in one embodiment.
FIG. 8 is a diagram illustrating a virtual billiard game image generated according to a user command to show a point at which a cue ball and a first object ball collide, in one embodiment.
FIG. 9 is a diagram illustrating a virtual billiard game image generated according to a user command to show the first point where the cue ball touches the edge of the billiard table, in one embodiment.
FIG. 10 is a diagram illustrating a virtual billiard game image generated according to a user command to show a second point where the cue ball touches the edge of the billiard table, in one embodiment.
FIG. 11 is a diagram illustrating a virtual billiard game image generated according to a user command to show all collision points of the cue ball in one embodiment.
Figure 12 is a flowchart of a method for projecting a virtual billiard game image according to an embodiment.

Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be changed and implemented in various forms. Accordingly, the actual implementation form is not limited to the specific disclosed embodiments, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical idea described in the embodiments.

Terms such as first or second may be used to describe various components, but these terms should be interpreted only for the purpose of distinguishing one component from another component. For example, a first component may be named a second component, and similarly, the second component may also be named a first component.

When a component is referred to as being “connected” to another component, it should be understood that it may be directly connected or connected to the other component, but that other components may exist in between.

Singular expressions include plural expressions unless the context clearly dictates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. In this specification, terms such as “comprise” or “have” are intended to designate the presence of the described features, numbers, steps, operations, components, parts, or combinations thereof, and are intended to indicate the presence of one or more other features or numbers, It should be understood that this does not exclude in advance the possibility of the presence or addition of steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art. Terms as defined in commonly used dictionaries should be interpreted as having meanings consistent with the meanings they have in the context of the related technology, and unless clearly defined in this specification, should not be interpreted in an idealized or overly formal sense. No.

The term “module” used in this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

The term ‘~part’ used in this document refers to software or hardware components such as FPGA or ASIC, and the ‘~part’ performs certain roles. However, ‘~part’ is not limited to software or hardware. The '~ part' may be configured to reside on an addressable storage medium and may be configured to reproduce on one or more processors. For example, '~part' refers to software components, object-oriented software components, components such as class components and task components, processes, functions, properties, procedures, May include subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. The functions provided within components and ‘parts’ may be combined into a smaller number of components and ‘parts’ or may be further separated into additional components and ‘parts’. Additionally, components and parts may be implemented to refresh one or more CPUs within a device or secure multimedia card. Additionally, ‘~part’ may include one or more processors.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the accompanying drawings, identical components will be assigned the same reference numerals regardless of the reference numerals, and overlapping descriptions thereof will be omitted.

1 is a diagram illustrating an outline of an image projection system according to an embodiment.

Referring to FIG. 1 , the image projection system 100 may include a billiard table 120 and a projector device 110 . The projector device 110 may be spaced apart from the billiard table 120 and positioned above the top of the billiard table 120 . The separation distance between the upper surface of the billiard table 120 and the projector device 110 may be, for example, a distance between 1 m and 10 m, and the projector device 110 may be placed or installed on the ceiling of the space where the billiard table 120 is placed. However, the scope of the examples is not limited thereto. The billiard table 120 may be a billiard table for, for example, four-ball, three-ball, pocketball, or snooker. In this specification, 'billiard game' may be referred to as a billiard game or billiard match. There may be billiard table points 125 around the four corners of the billiard table 120 for 4-ball, 3-ball, and pocket ball games. For example, there may be 9 billiard table points 125 in one direction of the billiard table 120 and 5 points in the other direction.

The projector device 110 may project (or output) a projection image toward the upper surface (eg, cover sheet) of the billiard table 120. In one embodiment, the projector device 110 may generate a projection image including virtual billiard balls 130, 135, and 140 corresponding to image objects and project the image onto the billiard table 120. In the projection image, the virtual billiard balls 130, 135, and 140 may be displayed as various types of images representing billiard balls.

Alternatively, the projector device 110 generates a projection image including the virtual billiard balls 130, 135, and 140 and the movement path of at least one of the virtual billiard balls 130, 135, and 140 to display the billiard table ( 120) can also be projected. The projection image projected by the projector device 110 may include a specific picture, logo, trademark, and/or text, and through this, the projector device 110 expresses the content to be advertised in the projection image in various forms. It can also be used as an advertising device.

Conventionally, when a user wants to practice by implementing the billiard ball arrangements of a billiard game watched through TV broadcasts or YouTube on the billiard table 120, the approximate positions of the billiard balls are determined from the billiard game image and the billiard table 120 Billiard balls had to be placed on the table. The positions of the billiard balls arranged in this way are inaccurate, and there is an inconvenience in that it is difficult for users to accurately place the billiard balls in the same position repeatedly for practice. Additionally, users had to watch the billiards game repeatedly to check the path the billiard balls took during the game.

However, through the virtual billiard balls 130, 135, and 140 of the projected image projected onto the billiard table 120 through the projector device 110 according to the embodiment, the user can select the billiard ball from the billiard table 120. It can be placed accurately without error. Additionally, the user can easily check the movement path of the billiard balls in a billiard game through the virtual billiard balls 130 in the projection image and effectively practice to actually implement the movement path.

The projector device 110 improves educational effectiveness by enabling accurate and consistent billiard ball placement and hitting during billiard education or billiard practice, and can significantly help improve the skills of practitioners.

As an example of the projector device 110 according to the present invention, a beam projector that is commonly used today can be used. A beam projector passes light from a light source through a lens and projects it onto a screen or wall, using cathode ray tube (CRT), liquid crystal display (LCD), and/or digital optical technology (DLP). : Digital Light Processing) can be adopted. As another example, although the basic structure is the same as that of the beam projector, laser projector technology that uses a laser as a light source may be used as the image projection technology of the projector device 110.

FIG. 2 is a diagram for explaining the configuration of a projector device according to an embodiment.

Today, billiard games by famous billiard players are provided to users through TV channels or Internet video channels. In addition, a service is provided that records billiard game videos of general users and stores them on a server, and allows users to easily search for their game videos through mobile devices when they want. According to an embodiment of the present invention, a user can reproduce the arrangement and movement of specific billiard balls within the billiard games provided above on the billiard table through the projector device 210.

Referring to FIG. 2, the projector device 210 (e.g., the projector device 110 of FIG. 1) may include a processor 222, a memory 224, a projection image output module 226, and a communication module 228. You can. Each component of the projector device 210 may communicate with each other through the communication bus 229.

The processor 222 controls the overall operation of the projector device 210. The processor 222 may be composed of one or more processors, and the processor 222 may be a general-purpose processor such as a central processing unit (CPU), an application processor (AP), a digital signal processor (DSP), or a neural processing unit (NPU). unit) may be included.

In one embodiment, the processor 222 may receive an actual billiard game image from an external device (e.g., mobile device 240, touch board panel device 250, or server) through the communication network 221. Here, the touch board panel device 250 refers to a device used to manage or control a billiards game in a place where a billiard table is installed (e.g., a billiard room, a billiard practice range, or a billiard stadium), for example, a touch board panel device ( 250) may be connected to the system where the billiard table is installed via a network or to an external server via the Internet.

The processor 222 may generate a virtual billiard game image, which is a projection image, from an actual billiard game image. The actual billiard game image and the virtual billiard game image may be a single still video frame at a specific point in time, or may be a video containing a plurality of video frames according to the passage of time. The processor 222 extracts billiard balls placed on the billiard table in the real-life billiard game image to generate a virtual billiard game image, and the billiard balls extracted from the real-life billiard game image are placed on the billiard table in the real-life billiard game image. The placed position and color of each extracted billiard ball can be determined. The processor 222 may distinguish between cue balls and object balls based on the colors of the extracted billiard balls.

In the present invention, a real-life billiards game image may mean an image taken with a camera of a billiards game played on a real billiard table or an image taken with a camera of the display of an electronic device that plays an image of a billiards game. there is. The actual billiards game image may include an image taken of a blackboard in the form of the top of a billiard table used for billiards lessons. The actual billiard game image may include images taken from billiards-related books, photographs, handwritten records, prints, and publications, including drawings or photographs of the top of a billiard table with billiard balls placed on it.

In the present invention, a virtual billiard game image refers to an image created based on an actual billiard game image and projected onto the upper surface of an actual billiard table by the projector device 210. In addition, the actual cue ball and the actual object ball refer to the cue ball and object ball placed on the billiard table in the actual billiard game image, respectively, and the virtual cue ball and virtual object ball refer to the billiards included in the virtual billiard game image. As balls, they correspond to the object ball of the actual game and the object ball of the actual game, respectively.

In order to extract billiard balls from a real-life billiard game image, define a plurality of objects corresponding to a plurality of billiard balls in the image and distinguish them from each other based on properties such as shape and color of the defined objects, Image processing technology may be used to obtain position coordinate values by calculating the relative positions of these distinct objects on the billiard table.

The position coordinates according to the present invention may be expressed as coordinate values based on a coordinate system formed with the corners of one side and the corners of the other side of the billiard table as the X-axis and Y-axis, respectively. Alternatively, the position coordinates are calculated as the positions of the billiard balls on a square billiard table by taking into account at least one of the length of the billiard edges, the positions of points arranged on the billiard edges, the size of the billiard balls, and the relative distances between the billiard balls. It can be interpreted as uniquely determined location information.

The processor 222 extracts (or obtains) positional coordinates corresponding to the positions of the billiard balls placed on the billiard table from the actual billiard game image, and determines the positions of the virtual billiard balls based on the positional coordinates of each of the extracted billiard balls. You can decide. In one embodiment, the processor 222 sets reference points for determining the positions of at least one cue ball and a plurality of object balls from the actual billiard game image, and sets at least one reference point based on the set reference points from the actual billiard game image. Position coordinates for the cue ball and a plurality of object balls can be obtained.

As an example, four vertices where the corners of a billiard table in a real-life billiard game image meet each other may be set as reference points. As another example, points existing around the billiard table (or billiard table cushion points) may be set as reference points. As another example, arbitrary points constituting each side of a rectangular shape formed by the four corners of a billiard table in an actual billiard game image can be set as reference points. Based on the set reference points, the relative coordinates of the billiard balls placed on the actual billiard table can be calculated as the position coordinates of the billiard balls.

The processor 222 may determine the positions of the virtual cue ball and virtual object balls on the virtual billiard table based on the acquired position coordinates. The processor 222 may generate a virtual billiard game image in which virtual cue balls and virtual object balls are arranged based on the determined position. The processor 222 may generate a virtual billiard game image based on color information and location information assigned to each virtual billiard ball.

The photorealistic billiards game image may include path information where at least one photorealistic billiard ball moves on the photorealistic billiard table and collides with another photorealistic billiard ball. For example, an image of a real-life billiard game may include path information where at least one real-time cue ball moves on a real-time billiard table and collides with at least one real-time object ball.

The processor 222 may extract path information from the actual billiard game image. The processor 222 includes a movement path of at least one virtual billiard ball among the virtual billiard balls and the virtual billiard balls placed on the virtual billiard table based on path information extracted from the actual billiard game image. You can create an image of a virtual billiards game. For example, the processor 222 may create a virtual cue ball that includes a movement path where a virtual cue ball moves on a virtual billiard table and collides with at least one virtual object ball, based on path information extracted from an actual billiard game image. You can create a billiards game image.

In another embodiment, an external device (e.g., mobile device 240, touch board panel device 250, or server) extracts path information from an actual billiard game image and sends the extracted path information to the projector device 210. can be transmitted to. The processor can receive route information from an external device.

The processor 222 generates a virtual billiard game image including virtual billiard balls arranged on a virtual billiard table and a movement path of at least one of the virtual billiard balls based on path information transmitted from an external device. can do. For example, the processor 222 creates a virtual billiard game image including a movement path of at least one of the virtual cue ball or the virtual object balls on the virtual billiard table, based on the path information included in the actual billiard game image. can be created.

In one embodiment, the path information may include change information in the position coordinates of a billiard ball on a billiard table to indicate the movement of at least one billiard ball among the actual billiard balls over time. For example, the path information includes information about changes over time in the position coordinates of a billiard ball relative to a cue ball on an actual billiard table and information about changes over time in the position coordinates of a billiard ball relative to at least one object ball of the real world. can do. As another example, the position coordinates of the billiard ball may be expressed as coordinate values based on a coordinate system formed with the corner of one side of the billiard table and the corner of the other side as the X-axis and Y-axis, respectively. Path information may include changes in coordinate values over time in the coordinate system. According to one embodiment, path information may be expressed as a mathematical function with X coordinates and Y coordinates as parameters.

Based on the path information, the processor 222 may generate a virtual billiard game image in which at least one of the virtual billiard balls moves with time on the movement path. For example, the processor 222 may generate a virtual billiard game image in which each of the virtual cue ball and at least one virtual object ball moves over time based on the path information. The movement path may be displayed by images of virtual billiard balls placed on the virtual billiard game image at intervals along the movement path. For example, the movement path may be displayed by a plurality of circular images corresponding to a virtual cue ball and at least one virtual object ball. A plurality of circular images may be arranged along the movement path at set intervals. A plurality of circular images may be displayed sequentially along the corresponding movement path. For example, the movement path is composed of a plurality of cue ball circular images corresponding to a virtual cue ball and a plurality of object ball circular images corresponding to at least one virtual object ball arranged at set intervals along the movement path. can be displayed. The movement path includes a plurality of cue ball circular images corresponding to a virtual cue ball and a plurality of object ball circular images corresponding to at least one virtual object ball arranged at set time intervals along the movement path. It can be displayed by . As another example, the movement path is composed of a plurality of cue ball circular images corresponding to a virtual cue ball and a plurality of object ball circular images corresponding to at least one virtual object ball arranged at set distance intervals along the movement path. It may be displayed.

The projector device 210 can provide the user with a realistic movement of the billiard ball during billiard play by showing the movement path of the virtual billiard ball over time through a virtual billiard game image projected on the billiard table.

In one embodiment, the remote controller 230 can remotely control the project device 210 through the communication network 221. The remote controller 230 may include, for example, a power control unit 232 and various function control units 234 for controlling the functions of the projector device 210. The power control unit 232 and the function control unit 234 may be implemented as a button type or a touch type. The function control units 234 are function control units for selecting a virtual billiard ball to display a movement path among virtual billiard balls in a virtual billiard game image projected on the billiard table, and/or included in the virtual billiard game image. It may include a functional control panel for changing logos/pictures/text, etc. The user can select at least one virtual billiard ball whose movement path is displayed on the billiard table by manipulating the function control unit 234.

Memory 224 stores information necessary for processor 222 to perform processing operations. For example, the memory 224 may store at least one of instructions executable by the processor 222, location information assigned to the virtual billiard balls, a movement path of the virtual billiard balls, and a virtual billiard game image. Memory 224 may include volatile memory such as RAM, DRAM, SRAM, and/or non-volatile memory known in the art such as flash memory.

The projection image output module 226 may project a virtual billiard game image toward the upper surface of the billiard table. The projection image output module 226 includes a lighting unit including a light source that generates an image signal corresponding to a virtual billiard game image, and a lens and/or mirror for refracting, reflecting, enlarging, and/or reducing the image signal. can do. The projection image output module 226 may also include an optical film for optical effects or a film for superimposing pictures, logos, text, etc. on the virtual billiard game image.

The communication module 228 can communicate with an external device through the communication network 221 according to wired communication and/or wireless communication. As an example, the communication module 228 may perform wireless communication of a short-range communication network such as Bluetooth, Wireless Fidelity (WiFi) direct, or IrDA.

The communication module 228 may receive a control signal from an external device, and the processor 222 may determine a virtual billiard ball to display a movement path in a virtual billiard game image based on the control signal received from the external device. there is. The external device includes, for example, at least one of a remote controller 230, a touch board panel device 250, or a mobile device 240 capable of generating a control signal to determine a virtual billiard ball to display a movement path. can do.

Depending on the embodiment, the projector device 210 may further include a camera (not shown). The camera can acquire billiard table images taken of the billiard table. For example, a user's billiards play can be recorded as an actual billiard game image. The processor 222 may project the recorded real-life billiard game image onto a virtual billiard game sheet on the billiard table through the projection image output module 226.

Depending on the embodiment, the processor 222 may detect whether the user's billiard cue stick hits an actual billiard ball by analyzing the actual billiard table image acquired through a camera and/or sensor data from a sensor (e.g., a microphone). You can. For example, if the movement of an actual billiard ball is detected by contact with a billiard cue in an actual billiard table video, or if the sound of a billiard ball being hit by a billiard cue is detected in sound data acquired by a microphone, the user's It can be detected that the billiard cue hits an actual billiard ball. When it is detected that the billiard cue hits the actual billiard ball, the processor 222 stops projection of the virtual billiard game image on the billiard table so that the user can easily perceive the movement of the billiard ball on the actual billiard table. can do. That is, according to the present invention, the user can maximize the practice effect of the billiard game by effectively projecting the positions and movements of virtual billiard balls on the actual billiard table.

Depending on the embodiment, the projection image output module 226 may be located in a space physically spaced apart from the processor 222, the memory 224, and the communication module 228. For example, the projected image output module 226 may be located above the top surface of the billiard table, and the processor 222, memory 224, and communication module 228 may be located on the ground where the billiard table is placed. . The projection image output module 226 located in a separate space may communicate with the processor 222, the memory 224, and the communication module 228 through a communication network. If the projection image output module 226 is located in a space physically separated from the processor 222, memory 224, and communication module 228, the projection image output module 226 may be installed in a separate communication module (not shown) for communication. poetry) may be further included. The processor 222 may transmit the generated virtual billiard game image to the projection image output module through a communication network. The transmitted virtual billiard game image may be projected onto the upper surface of the actual billiard table by the projection image output module 226.

As another example, the processor 222, memory 224, and communication module 228 may be located within the touch board panel device 250.

Figure 3 shows another embodiment of an image projection system according to the present invention.

Referring to FIG. 3, the image projection system 200 includes a plurality of projector devices 270, 271, and 272 (e.g., the projector device 110 of FIG. 1) and a plurality of billiard tables 280, 281, and 282. and an image projection server 260. The image projection server 260 is connected to a plurality of projector devices 270, 271, and 272 through a communication network 261. Each of the projector devices 270, 271, and 272 may be spaced apart from each of the billiard tables 280, 281, and 282 and positioned above the upper surface of the billiard tables 280, 281, and 282. The plurality of billiard tables 280, 281, and 282 may be located in different billiard rooms, or may be located in one billiard room.

Unlike the embodiment shown in FIGS. 1 and 2, in the embodiment of FIG. 3, a processor for generating a virtual billiard game image from an actual billiard game image is located in the image projection server 260, and the projector devices 270, 271, Using 272), virtual billiard game images are projected onto the billiard tables 280, 281, and 282, respectively.

Referring to FIG. 3, the image projection server 260 may include a processor 262, a memory 264, and a communication module 266. Each component of the image projection server 260 may communicate with each other through the communication bus 269.

The processor 262 generates a virtual billiard game image from the actual billiard game image, and the communication module 266 can transmit the generated virtual billiard game image to the projector devices 270, 271, and 272 through a communication network. . The transmitted virtual billiard game image is projected from the projector devices 270, 271, and 272 to the upper surface of the billiard table (280, 281, and 282). The processor 262 extracts path information from the real-life billiard game image, where the real-life cue ball moves on the real-life billiard table and collides with at least one real-time object ball, and based on the extracted path information, creates a virtual billiard table. A virtual billiard game image is generated including a virtual cue ball and a movement path along which at least one virtual object ball moves.

Since the detailed operations of the processor 262, memory 264, and communication module 266 are similar to the processor 222, memory 224, and communication module 228 described in the embodiment of FIG. 2, detailed operations thereof are provided. The description will be omitted below.

FIG. 4 is a diagram illustrating how a projector device or an image projection server according to an embodiment is connected to an external device to provide a virtual billiard game image corresponding to an actual billiard game image.

Referring to FIG. 4, an actual billiard game image 310 is displayed on an external device 305 (e.g., smartphone, tablet PC, PDA, laptop). In the example of FIG. 3 , the realistic billiard game image 310 includes a realistic cue ball 315, a realistic first object ball 320, and a realistic second object ball 325, and the cue ball 315 is It may be a video of the video moving and colliding with the first object ball 320.

While watching a billiard game, a user can actually capture or photograph a billiard game image showing the billiard ball arrangement that is desired to be implemented on the billiard table 355. For example, the user can use the external device 305 to watch a billiards game through TV broadcasts or YouTube, and capture a billiard game image showing the billiard ball arrangement to be directly implemented during the billiard game scene or capture a billiard game image showing the billiard ball arrangement to be implemented directly during the billiard game scene. You can film or record. The external device 305 may function as a remote controller that controls the functions of the image projection systems 100 and 200. As another example, while watching a billiard game on TV, a user may capture a billiard game image showing the billiard ball arrangement to be implemented on the billiard table 355, or film or record the billiard game. Users can shoot or record videos as well as single video frames. When a user shoots or records a video, the photo-realistic billiard game image 310 shows at least one photo-realistic billiard ball (e.g., cue ball 315) moving so that at least one other photo-realistic billiard ball (e.g., the first cue ball 315) moves. It may include path information that collides with the object sphere 320).

The user can transmit the actual billiard game image 310 obtained by capturing, filming, or recording to the image projection system 100, 200 through the communication network 321. The processors 222 and 262 extract the billiard table 327 from the received real-life billiard game image 310 and determine the respective positions and colors of the billiard balls 315, 320, and 325 located within the billiard table 327. can be extracted. Depending on the embodiment, billiard table points may be further extracted from the actual billiard game image 310, and the processor may extract the billiard table points based on the arrangement of the billiard table points and the positional relationship between the billiard balls 315, 320, and 325. The positions of the billiard balls 315, 320, and 325 within 327 can be determined.

In one embodiment, object extraction based on feature points or deep learning (or machine learning) is performed to extract the positions and colors of each of the billiard balls 315, 320, and 325 from the actual billiard game image 310. (or recognition) algorithms may be used. For example, in the real-life billiard game image 310, the four corners of the billiard table 327, the billiard table points, and the center points of the billiard balls 315, 320, and 325 are extracted as feature points, and the feature points of the Based on the positional relationship, the positions of the billiard balls 315, 320, and 325 within the billiard table 327 may be determined.

At this time, the color properties of the billiard balls 315, 320, and 325 may also be extracted from the actual billiard game image 310, and the colors of the billiard balls 315, 320, and 325 may be recognized. As another example, a real-life billiard game image 310 is input to a learned neural network-based recognition model, and billiard balls 315, 320, 325 are placed in the real-life billiard game image 310 output from the recognition model. The positions and colors of each of the billiard balls 315, 320, and 325 within the billiard table 327 may be determined based on the position coordinates and color attributes. The recognition model may be a model learned to extract and output the position coordinates and color attributes of billiard balls from each of a large number of learning images. Each of the learning images corresponds to billiard game images in which billiard balls are arranged differently, and are images for which the actual position values and actual color values of the billiard balls are known. In the learning process of the recognition model, the recognition model compares the position coordinates and color properties of the billiard balls output for a certain learning image with the actual position value and actual color value known for the corresponding learning image, and the outputs of the recognition model (billiard balls) The process of updating the parameters of the recognition model may be repeatedly performed so that the difference between the balls' position coordinates and color attributes) and actual values (position value and color value) is minimized.

In one embodiment, the processors 222 and 262 generate the photo-realistic billiard game image 310 based on the location information and color information about the billiard balls 315, 320, and 325 extracted from the photo-realistic billiard game image 310. The positions and colors of the virtual billiard balls 330, 345, and 350 in the virtual billiard game image may be determined to correspond to the positions and colors of the billiard balls 315, 320, and 325. The processors 222 and 262 may distinguish between the cue ball and the object ball based on the respective colors of the billiard balls 315, 320, and 325 in the actual billiard game image 310. For example, in the actual billiard game image 310, white or yellow billiard balls may be distinguished as cue balls, and red and/or yellow billiard balls may be distinguished as object balls. Yellow billiard balls can be distinguished as cue balls or object balls depending on the type of billiard game or billiard game situation. However, the scope of the embodiment is not limited to this, and the processors 222 and 262 provide a realistic billiards game based on the colors of the cue ball and object balls determined by the type of billiard game (e.g., 4-ball, 3-cushion, pocket ball). In image 310, the cue ball and object ball can be distinguished.

The processor may extract path information from the actual billiard game image 310.

In one embodiment, the processor may extract path information from the real-life billiard game image 310 based on the arrangement of billiard table points and the positional relationship between the real-life billiard balls 315, 320, and 325. The processors 222 and 262 store information within the billiard table 327 based on the arrangement of billiard table points and the positional relationship between the billiard balls 315, 320, and 325 from two or more image frames of the actual billiard game image 310. The positions and colors of each of the billiard balls 315, 320, and 325 can be extracted. The processors 222 and 262 may extract path information based on changes in the positions of the billiard balls 315, 320, and 325 in two or more image frames.

In another embodiment, the processors 222 and 262 generate path information based on the positions and colors of the real-life cue ball and at least one real-time object ball extracted from the real-life billiard game image using a learned neural network-based recognition model. can be extracted. The processors 222 and 262 may extract the location and color of at least one real-time object ball using a neural network-based recognition model learned from two or more image frames of the real-time billiard game image 310. The processors 222 and 262 may extract path information based on changes in the positions of the billiard balls 315, 320, and 325 in two or more image frames.

The processors 222 and 262 operate at least one of the virtual billiard balls 330, 345, and 350 and the virtual billiard balls 330, 345, and 350 arranged on the virtual billiard table based on the extracted path information. A virtual billiard game image including the movement path can be created. For example, the processors 222 and 262 include a virtual cue ball 330 and virtual object balls 345 and 350 on a virtual billiard table based on path information extracted from the actual billiard game image 310. And a virtual billiard game image including the movement path of at least one of the virtual cue ball 330 or the virtual object balls 345 and 350 may be generated. The projector device 210 of FIG. 1 may project a virtual billiard game image generated using the projection image output module 226 toward the upper surface of the billiard table 355 . Alternatively, the image projection server 260 of FIG. 3 may project a virtual billiard game image generated using the projector devices 270, 271, and 272 toward the upper surface of the billiard table 355.

In another embodiment, the external device 305 may extract path information from the actual billiard game image 310 and transmit the extracted path information to the image projection systems 100 and 200. The processors 222 and 262 process the virtual billiard balls 330, 345 and 350 and the virtual billiard balls 330 and 345 placed on the virtual billiard table based on the path information received from the external device 305. , 350), a virtual billiard game image including at least one movement path may be generated.

In a virtual billiard game image according to an embodiment, at least one of the virtual billiard balls 330, 345, and 350 may move with time on the movement path of the virtual billiard ball. For example, the billiard game image projected on the billiard table 355 of FIG. 4 may show the movement of the virtual cue ball 330 over time in the form of a video. In one embodiment, the processors 222 and 262 receive a user command from the user to adjust the speed at which at least one of the virtual billiard balls 330, 345, and 350 moves on the movement path of the virtual billiard ball, A virtual billiard game image may be created in which at least one of the virtual billiard balls 330, 345, and 350 moves at a speed according to a user command received on the movement path. For example, the processors 222 and 262 may generate a virtual billiard game image in which at least one of the virtual cue ball 330 or the virtual object balls 345 and 350 moves at a speed according to a user command on a movement path. You can.

In a virtual billiard game image according to another embodiment, the movement path of any one virtual billiard ball among the virtual billiard balls included in the virtual billiard game image is arranged at intervals along the movement path of the virtual billiard ball. It can be displayed by a plurality of circular images of the corresponding virtual billiard ball. For example, the movement path of the real-life cue ball 315 in the realistic billiard game image 310 may be displayed as the movement path of the virtual cue ball 330 on the virtual billiard game image, and the virtual cue ball 330 The movement path of may be displayed by a plurality of apparatus images 332, 334, 336, and 340 arranged at set intervals along the movement path of the virtual apparatus 330.

In order to display the movement path, circular images of the virtual billiard ball placed on the virtual billiard game image at intervals along the movement path of the virtual billiard ball are displayed at a time of at least one of the actual billiard balls based on the path information. The change in position may be expressed at equal time intervals. For example, a plurality of cue ball images or a plurality of object ball images arranged along a movement path may display a change in the position of at least one of the actual cue ball or object balls over time at equal time intervals based on the path information. It may be indicated. In the example of FIG. 4, the cue polo images 332, 334, 336, and 340 arranged on the virtual billiard game image at intervals along the movement path of the virtual cue ball 330 are displayed according to the time of the cue ball 315. The change in position may be expressed at equal time intervals.

In order to display the movement path, images of the virtual billiard ball placed on the virtual billiard game image at set intervals along the movement path of the virtual billiard ball are displayed at the time of at least one of the actual billiard balls based on the path information. The change in location may be expressed at equal distance intervals. For example, in the example of FIG. 4, the distance intervals between the cue polo images 332, 334, 336, and 340 placed on the virtual billiard game image at intervals along the movement path of the virtual cue ball 330 are the same. can do.

In one embodiment, the virtual billiard game image may be a billiard game image that sequentially or simultaneously displays circular images of virtual billiard balls arranged at intervals along a movement path. For example, the virtual billiard game image may be a billiard game image that sequentially displays a plurality of cue ball images or a plurality of object ball images over time. In the example of FIG. 4, the display starts from the virtual apparatus 330 along the movement path of the virtual apparatus 330, and over time the apparatus image 332, apparatus image 334, apparatus image 336, and apparatus polo are displayed. Images 340 may be displayed sequentially.

On a virtual billiard game image, a plurality of circular images indicating the movement path of the virtual billiard ball may include at least two different types of circular images. For example, the plurality of circular images may include a translucent circular image and an opaque circular image.

For example, the apparatus images 332, 334, 336, and 340 corresponding to the virtual apparatus 330 may include at least two different types of apparatus images. The water polo images 332, 334, 336, and 340 may include a translucent water polo image (eg, water polo image 332) and an opaque water polo image (eg, water polo image 340). In a translucent circular image, the circle may be displayed as a dotted line, and in an opaque circular image, the circle may be displayed as a solid line. Alternatively, the translucent circular image and the opaque circular image may be displayed in different colors to distinguish them from each other. However, this is only an example and the apparatus images corresponding to the virtual apparatus 330 may be various types of apparatus images.

In one embodiment, a plurality of circular images representing the movement path of a virtual billiard ball may be displayed as circular images of the same shape at a plurality of points on the movement path. The plurality of points are points where the virtual cue ball 330 collides with at least one virtual object ball (e.g., virtual object ball 345) or points where the virtual cue ball 330 contacts the edge of the virtual billiard table. It may include a point (e.g., a point where the virtual cue polo images 415, 420, and 425 of FIG. 5 are placed). For example, the movement path may be displayed as a first type of cue polo image at at least one specific point on the movement path, and may be displayed as a second type of cue polo image at another point. For example, the movement path of the virtual apparatus 330 includes an opaque apparatus image 340 located at the collision point and arrival point, and translucent apparatus images 332, 334 located at the remaining points on the movement path. 336).

In a billiards game, because the movement paths of the cue ball and object balls can be very different depending on which part of the object balls the cue ball collides with, the moment of collision between the cue ball and object balls must be handled very carefully. Therefore, according to the present invention, in the virtual billiard game image, some of the cue polo images 332, 334, 336, and 340 (cue polo images 332, 334, 336) are displayed translucent and some of the remaining portions (cue polo images ( 340)) is displayed opaquely, allowing the user to better identify characteristic points on the movement path. The virtual cue ball 330, the virtual first object ball 345, and the virtual second object ball 350 may also be displayed in various forms. For example, the virtual cue ball 330, the virtual first object ball 345, and the virtual second object ball 350 may be displayed in an opaque or translucent form. The virtual cue ball 330 displayed on the actual billiard table 355, the cue ball images 332, 334, 336, 340, the virtual first object ball 345 and the virtual second object ball 350 are transparent. The degree can be adjusted by user settings.

In this way, the projector device 210 and the image projection server 260 are based on the location information and path information of the billiard balls included in the actual billiard game image, and provide a virtual billiard ball location corresponding to the corresponding billiard ball location information and A virtual billiard game image including a virtual billiard ball movement path corresponding to the corresponding billiard ball path information can be created. Through the virtual billiard game image projected on the billiard table 355, the user accurately implements the arrangement of the billiard balls 315, 320, and 325 shown in the actual billiard game image on the actual billiard table 355 and time You can check the movement route according to .

In one embodiment, virtual billiard game images may be generated differently depending on user commands. Hereinafter, virtual billiard game images that are differently generated according to user commands will be described with reference to FIGS. 5 to 11. 5 to 11, it is assumed that the user is playing a 3-ball billiards game.

In the virtual billiard game images shown in FIGS. 5 to 11, the virtual cue ball 405 collides with the left portion of the virtual first object ball 435 and rotates the billiard table clockwise, forming two corners and an order. It shows a movement path that collides again with the virtual second object ball 440 after contact.

In one embodiment, the processors 222 and 262 may generate a virtual billiard game image that displays various information needed by the user on the movement path of the virtual billiard balls. For example, a user may input a user command to the image projection system 100 or 200 to select a billiard ball whose movement path is to be displayed. The processors 222 and 262 may generate a virtual billiard game image including a movement path of a virtual billiard ball corresponding to the billiard ball selected by a user command. For example, the user may input a user command to select at least one of the movement path of the cue ball, the movement path of the first object ball, and the movement path of the second object ball, and the processors 222 and 262 may select the billiard ball selected by the user. You can create a virtual billiards game image that shows the ball's path of movement. In FIGS. 5 to 11, the user command is input as a voice command, but the form of the user command is not limited to a voice command. For example, user commands may be input to the image projection systems 100 and 200 using the function manipulation unit of the remote controller 230.

Referring to FIG. 5 , a real billiard table 403 is shown on which a virtual billiard game image including the movement path of the virtual cue ball is projected according to a user command 407.

The virtual billiards game image includes a virtual cue ball 405, a virtual first object ball 435, and a virtual cue ball corresponding to the real-life cue ball, the real-life first object ball, and the real-life second object ball in the real-life billiard game image. It may include a second object sphere 440. The projector device may project a virtual billiard game image including a virtual cue ball 405, a virtual first object ball 435, and a virtual second object ball 440 onto the actual billiard table 403. . The user may view the virtual billiard game image projected on the actual billiard table 403 and input a user command 407 commanding to show the cue ball's movement path to the image projection system 100, 200. The image projection systems 100 and 200 may generate a virtual billiard game image including the movement path of the virtual cue ball 405 in response to receiving a user command 407 and project it on the billiard table 403. .

The movement path of the cue ball in the virtual billiard game image is a virtual cue ball 405 arranged at intervals on the movement path and cue polo images corresponding to the virtual cue ball (e.g., cue polo images 410, 415, 420, It can be displayed as 430)). Because multiple cue polo images are displayed simultaneously on the billiard table, the user can intuitively understand the cue ball movements at a glance and practice by imitating them.

Among the virtual apparatus 405 and apparatus images (eg, apparatus images 410, 415, 420, 430), at least some (eg, virtual apparatus 405, apparatus image 415) are displayed opaquely. , other parts (e.g., the cue polo image 410) may be displayed semi-transparently. For example, the virtual billiard game image includes a virtual cue ball 405, cue polo images 415, opaquely displayed at the starting point on the moving path of the virtual cue ball, the collision point with the object ball, and the contact point with the edge. 420, 425, 430) and cue polo images (e.g., cue polo image 410) displayed semitransparently on the movement path of the virtual cue polo. Since the movement path of the cue ball can be very different depending on which points on the edge of the billiard table it contacts or which part of the object ball it collides with, cue ball images 415, 420 of a plurality of points in contact with the edge , 425) and the cue ball image 430 at the point of collision with the object ball are prominently displayed, making it easier for the user to understand the cue ball's movement path.

In one embodiment, the virtual billiard game image includes the virtual cue ball 405 and cue polo images (e.g., cue polo images 410, 415, 420, 425, 430) disposed on the movement path of the virtual cue ball 405. )) may be a virtual billiard game image displayed sequentially according to time from the virtual cue ball 405 at the starting point to the cue polo image 430 at the final collision point.

Referring to FIG. 6 , a real billiard table 403 is shown on which a virtual billiard game image including the movement path of the virtual first object ball is projected according to a user command 507.

The virtual billiards game image includes a virtual cue ball 405, a virtual first object ball 515, and a virtual second object ball corresponding to the cue ball, first object ball, and second object ball in the actual billiard game image ( 440) may be included. The projector device may project a virtual billiard game image including a virtual cue ball 405, a virtual first object ball 435, and a virtual second object ball 440 onto the actual billiard table 403. . The user may view the virtual billiard game image projected on the actual billiard table 403 and input a user command 507 commanding to show the movement path of the first object ball to the image projection system 100, 200. The image projection systems 100 and 200 generate a virtual billiard game image including the movement path of the virtual first object ball 435 in response to receiving the user command 507, and project it on the billiard table 403. can do.

In Figure 6, an image in which the virtual first object ball 435, which collided with the virtual cue ball 405, is arranged as object ball 520, object ball 525, object ball 530, and object ball 540. This illustrates that they moved sequentially.

In the virtual billiard game image, the movement path of the first object ball is determined by the virtual first object ball 435 and first object ball images (e.g., first object ball images 520) arranged at intervals on the movement path. , 525, 530, 540)). The virtual billiard game image including the movement path of the virtual first object ball 435 may further include an cue ball image 510 colliding with the starting point of the virtual first object ball 435.

At least some of the virtual first object sphere 435 and first object sphere images (e.g., first object sphere images 520, 525, 530, 540) (e.g., virtual first object sphere 435) ) may be displayed opaquely, and other parts (e.g., the first object sphere image 520) may be displayed semitransparently. For example, the virtual billiard game image includes a virtual first object ball 435 and first object ball images 525, 530, and 540 displayed opaquely at the starting point and collision point on the movement path of the virtual first object ball. ) and images of the first object ball (eg, the virtual first object ball 520) displayed translucently on the movement path of the virtual first object ball.

In one embodiment, the virtual billiard game image includes the virtual first object ball 435 and first object ball images (e.g., the first object ball 435) disposed on the movement path of the virtual first object ball 435. A virtual billiards game image that displays images (520, 525, 530, 540) sequentially according to time from the virtual first object ball 435 at the starting point to the first object ball image 540 at the arrival point. It can be.

In one embodiment, the user selects billiard ball images (e.g., cue polo images 410, 415, first object ball images 520, 525, 530, 540) that indicate the movement path of the virtual billiard game image. When displayed sequentially according to time, billiard ball images (e.g., cue polo images 410, 415, first object ball images 520, 525, 530, 540) are sequentially displayed in the virtual billiard game image. A user command (e.g., user command 409 in FIG. 5 and user command 509 in FIG. 6) that adjusts the time interval displayed as fast or slow can be input into the image projection system 100, 200.

For example, the image projection systems 100 and 200 may provide a user command (e.g., user command 407, user command 507) commanding to show the movement path of at least one virtual billiard ball among cue balls or object balls. Accordingly, a billiard game image that sequentially displays billiard ball images (e.g., cue ball images 405, 410, first object ball images 435, 520) arranged on the movement path of the virtual billiard ball. It can be projected onto an actual billiard table (e.g., billiard table 403). The user views a virtual billiard game image projected on a billiard table (e.g., billiard table 403) and issues a user command 409 to command to display the sequentially displayed virtual billiard ball images faster or more slowly. A user command 509 may be input to the image projection system 100 or 200. The image projection system 100, 200 displays billiard ball images on the movement path (e.g. cue polo images 405, 410, etc.) in response to receiving a user command (e.g. user command 409, user command 509). A virtual billiard game image in which the time interval between the display of the first object ball images 435 and 520 is shorter or longer can be created and projected on an actual billiard table (eg, billiard table 403).

In one embodiment, a user may input a user command to the image projection system 100 or 200 to select two or more movement paths of realistic billiard balls included in an image of a realistic billiard game. For example, referring to FIG. 7 , a real billiard table 403 is shown on which a virtual billiard game image including a movement path of a virtual cue ball and a first object ball is projected according to a user command 607. The user may input a user command 607 to the image projection system 100 or 200 to command to show the movement path of the cue ball and the first object ball. The processors 222 and 262 generate a virtual billiard game image including the movement path of the virtual cue ball 405 and the first object ball 435 in response to receiving the user command 607, and the billiard table 403 ) can be projected onto. By simultaneously showing the movements of the cue ball and object ball in one image, the user can intuitively understand the movement of the billiard balls before and after the collision.

In one embodiment, the user sends a user command to the image projection system (100) to show the point (or so-called 'thickness') where one of the billiard balls included in the photo-realistic billiard game image collides with another billiard ball. , 200). For example, referring to FIG. 8 , a billiard table is shown on which a virtual billiard game image indicating a point where a virtual cue ball and a virtual first object ball collide is projected according to a user command 707.

The user may input a user command 707 to the image projection system 100 or 200 to show the point where the cue ball and the first object ball collide. The processors 222 and 262 generate a virtual billiard game image including a cue ball image 510 hitting a virtual first object ball in response to receiving the user command 707 and display the generated virtual billiard game image. It can be projected onto the billiard table 403. Since the win or loss of a billiards game is largely dependent on the thickness of the cue ball and the first object ball and the collision point between the cue ball and the first object ball, the embodiment according to FIG. 7 provides the user with information on the moment of collision between the cue ball and the first object ball. Provides an image that allows more focus.

In one embodiment, the user commands the cue ball included in the photo-realistic billiard game image to show one of the points (so-called 'cushions') where it touches the edge of the billiard table in the photo-realistic billiard game image. Commands may be entered into the image projection systems 100 and 200.

Referring to FIG. 9, an image 510 of a cue ball collides with the virtual first object ball 435 on the movement path of the virtual cue ball 405 according to a user command 807 and first collides with the virtual billiard table. An actual billiard table 403 is shown on which a virtual billiard game image including a cue polo image 415 is projected.

The user may enter a user command 807 into the image projection system 100, 200 instructing the display to show the first point where the cue ball contacts the corner of the billiard table (also referred to as the 'first cushion point'). . The processors 222 and 262 generate a virtual billiard game image including an image 415 of a cue ball contacting a corner of a virtual billiard table in response to receiving a user command 807 and display the generated virtual billiard game image. It can be projected onto the billiard table 403.

Since the point where the edge of the cue ball first contacts has a great influence on the win or loss of a billiard game, the embodiment according to FIG. 9 provides the user with an image that allows the user to focus more on the first cushion point.

Referring to FIG. 10, an image 510 of a cue ball colliding with the virtual first object ball 435 on the movement path of the virtual cue ball 405 according to a user command 907, first colliding with the virtual billiard table. A real billiard table 403 is shown on which a virtual billiard game image is projected, including a cue ball image 415 that collides with the virtual billiard table and a second cue ball image 420 that collides with the virtual billiard table.

The user may enter a user command 907 into the image projection system 100, 200 instructing the display to show the second point where the cue ball contacts the edge of the billiard table (also referred to as the 'second cushion point'). . The processors 222 and 262 generate a virtual billiard game image including an image 420 of a cue ball hitting a virtual billiard table a second time in response to receiving a user command 907 and generate the generated virtual billiard game image. can be projected onto the billiard table 403. Since the overall movement path of the cue ball is determined depending on which points the cue ball makes contact with the corners in turn, the embodiment according to FIG. 10 provides the user with an image that allows the user to understand the entire movement path of the cue ball at a glance.

Referring to FIG. 11, an image 510 of a cue ball colliding with the virtual first object ball 435 on the movement path of the virtual cue ball 405 according to a user command 1007, first colliding with the virtual billiard table. A virtual billiard game image including a cue polo image 415 hitting a virtual billiard table a second time, an image 420 of a cue ball hitting a virtual billiard table a third time, and a cue polo image hitting a virtual billiard table a third time 425 are projected onto the actual screen. A billiard table 403 is shown.

The user may input a user command 1007 to the image projection system 100 or 200 to show all collision points before the cue ball collides with the virtual second object ball 440. In response to receiving the user command 1007, the processors 222 and 262 generate a cue ball image 510 hitting the virtual first object ball 435 and an cue ball image 415 hitting the virtual billiard table for the first time. , generate a virtual billiard game image including an image 420 of a cue ball hitting a virtual billiard table a second time and an image 425 of a cue ball hitting a virtual billiard table a third time, and generate a virtual billiard game image can be projected onto the billiard table 403.

Figure 12 is a flowchart of a method for projecting a virtual billiard game image according to an embodiment.

In operation 1105, the processors 222 and 262 may extract, from the real-life billiard game image, information on a path in which the real-time cue ball moves on the real-time billiard table and collides with at least one real-time object ball. The actual billiard game image may be received from an external device (eg, the mobile device 240, the touch board panel device 250, or a server in FIG. 2).

The processors 222 and 262 may extract path information from the actual billiard game image based on the arrangement of billiard table points and the positional relationship between the actual billiard balls. The path information may include change information in the position coordinates of the billiard ball on the billiard table to indicate the movement of at least one billiard ball among the actual billiard balls over time. For example, the path information includes information about changes over time in the position coordinates of a billiard ball relative to a cue ball on an actual billiard table and information about changes over time in the position coordinates of a billiard ball relative to at least one object ball of the real world. can do.

The processors 222 and 262 extract the respective positions and colors of the billiard balls within the billiard table based on the arrangement of the billiard table points and the positional relationship between the billiard balls from two or more video frames of the actual billiard game image. You can. Processors 222 and 262 may extract path information based on changes in the positions of billiard balls in two or more image frames.

In another embodiment, the processors 222 and 262 generate path information based on the positions and colors of the real-life cue ball and at least one real-time object ball extracted from the real-life billiard game image using a learned neural network-based recognition model. can be extracted. The processors 222 and 262 may extract the location and color of at least one object ball of the live game using a neural network-based recognition model learned from two or more video frames of the live billiard game image. The processor 222 may extract path information based on changes in the positions of billiard balls in two or more image frames.

In another embodiment, the processor may receive route information from an external device.

In operation 1110, the processors 222 and 262 execute a virtual billiard game, including virtual billiard balls placed on a virtual billiard table and a movement path of at least one of the virtual billiard balls based on the path information. Images can be created. For example, the processors 222 and 262 include a movement path in which a virtual cue ball moves on a virtual billiard table and collides with at least one virtual object ball, based on path information extracted from an actual billiard game image. A virtual billiards game image can be created.

Based on the path information, the processors 222 and 262 may generate a virtual billiard game image in which at least one of the virtual billiard balls moves with time on the movement path. For example, the processors 222 and 262 may generate a virtual billiard game image in which each of the virtual cue ball and at least one virtual object ball moves over time based on the path information. In one embodiment, the processors 222 and 262 receive a user command from the user to adjust the speed at which at least one of the virtual billiard balls moves on the movement path of the virtual billiard ball, and at least one of the virtual billiard balls One can create a virtual billiard game image that moves at a speed according to the user command received on the movement path. For example, the processors 222 and 262 may generate a virtual billiard game image in which at least one of the virtual cue ball or virtual object balls moves along a movement path at a speed according to a user command.

In a virtual billiard game image according to another embodiment, the movement path of any one virtual billiard ball among the virtual billiard balls included in the virtual billiard game image is arranged at intervals along the movement path of the virtual billiard ball. It can be displayed by a plurality of circular images of the corresponding virtual billiard ball. For example, the movement path may be displayed by a plurality of circular images corresponding to a virtual cue ball and at least one virtual object ball. A plurality of circular images may be arranged along the movement path at set intervals. A plurality of circular images may be displayed sequentially along the corresponding movement path. For example, the movement path is composed of a plurality of cue ball circular images corresponding to a virtual cue ball and a plurality of object ball circular images corresponding to at least one virtual object ball arranged at set intervals along the movement path. can be displayed. The movement path includes a plurality of cue ball circular images corresponding to a virtual cue ball and a plurality of object ball circular images corresponding to at least one virtual object ball arranged at set time intervals along the movement path. It can be displayed by . As another example, the movement path is composed of a plurality of cue ball circular images corresponding to a virtual cue ball and a plurality of object ball circular images corresponding to at least one virtual object ball arranged at set distance intervals along the movement path. It may be displayed.

In order to display the movement path, circular images of the virtual billiard ball placed on the virtual billiard game image at intervals along the movement path of the virtual billiard ball are displayed at a time of at least one of the actual billiard balls based on the path information. The change in position may be expressed at equal time intervals. For example, a plurality of cue ball images or a plurality of object ball images arranged along a movement path may display a change in position over time of at least one of the actual cue ball or the actual object ball at equal time intervals based on the path information. It may be indicated. In order to display the movement path, images of the virtual billiard ball placed on the virtual billiard game image at set intervals along the movement path of the virtual billiard ball are displayed at the time of at least one of the actual billiard balls based on the path information. The change in location may be expressed at equal distance intervals.

On a virtual billiard game image, a plurality of circular images indicating the movement path of the virtual billiard ball may be displayed as circular images of the same shape at a plurality of points on the movement path. On a virtual billiard game image, a plurality of circular images indicating the movement path of the virtual billiard ball may include at least two different types of circular images. For example, the plurality of circular images may include a translucent circular image and an opaque circular image. For example, water polo images corresponding to a virtual water polo may include at least two different types of water polo images. Apparatus images may include a translucent apparatus image (e.g., apparatus image 332 in FIG. 4) and an opaque apparatus image (e.g., apparatus image 340 in FIG. 4). However, this is only an example, and the water polo images corresponding to the virtual water polo may be of various types.

A plurality of circular images representing the movement path of the virtual billiard ball may be displayed as circular images of the same shape at a plurality of points on the movement path. The plurality of points may include a point where the virtual cue ball collides with at least one virtual object ball or a point where the virtual cue ball contacts a corner of the virtual billiard table.

In operation 1115, a projector device (eg, projector device 110 or projector device 210) may project the virtual billiard game image generated in operation 1110 onto the upper surface of an actual billiard table. The projector device can provide the user with a realistic movement of the billiard ball during billiard play by showing the movement path of the virtual billiard ball over time through a virtual billiard game image projected on the actual billiard table. The virtual billiard game image may be created within the projector and projected onto the upper surface of the billiard table, or alternatively, it may be created in an external device or image projection server and transmitted to the projector device through a communication network, and the transmitted virtual billiard game image may be It can also be projected onto the top of the billiard table through a projector device.

The embodiments described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, and a field programmable gate (FPGA). It may be implemented using a general-purpose computer or a special-purpose computer, such as an array, programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and software applications running on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, independently or collectively, to configure a processing unit to operate as desired. The processing unit can be commanded. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and thus stored or executed in a distributed manner. Software and data may be stored on a computer-readable recording medium.

The method according to the embodiment may be implemented in the form of program instructions (eg, instructions) that can be executed through various computer means and recorded on a computer-readable medium. A computer-readable medium may store program instructions, data files, data structures, etc., singly or in combination, and the program instructions recorded on the medium may be specially designed and constructed for the embodiment or may be known and available to those skilled in the art of computer software. there is. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

The hardware devices described above may be configured to operate as one or multiple software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited drawings, those skilled in the art can apply various technical modifications and variations based on this. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims (25)

In the projector device for projecting a virtual billiard game image on a billiard table,
a processor that generates the virtual billiard game image from an actual billiard game image; and
A projection image output module that projects the generated virtual billiard game image toward the upper surface of the billiard table,
The processor,
From the real-life billiards game image, extract path information where the real-life cue ball moves on the real-life billiard table and collides with at least one real-time object ball,
Based on the extracted path information, generating the virtual billiard game image including a movement path where a virtual cue ball moves on a virtual billiard table and collides with at least one virtual object ball,
Projector device. According to paragraph 1,
The route information is,
A projector device comprising change information over time in position coordinates for the live shooting apparatus and change information over time in position coordinates for the at least one live shooting target ball. According to paragraph 1,
A projector device in which the virtual cue ball and the at least one virtual object ball move with time along the movement path within the virtual billiard game image. According to paragraph 1,
The movement path is,
Displayed by a plurality of circular images corresponding to the virtual cue ball and the at least one virtual object ball,
A projector device, wherein the plurality of circular images are arranged along the movement path at set intervals. According to paragraph 4,
A projector device, wherein the plurality of circular images are sequentially displayed along the movement path. According to paragraph 4,
A projector device, wherein the plurality of circular images include at least two different types of circular images. According to clause 6,
A projector device, wherein the two or more different types of circular images include a translucent circular image and an opaque circular image. According to clause 6,
A projector device, wherein the plurality of circular images are displayed as circular images of the same shape at a plurality of points on the movement path. According to clause 8,
The plurality of points include a point where the virtual cue ball collides with the at least one virtual object ball or a point where the virtual cue ball contacts a corner of the virtual billiard table. According to paragraph 1,
The processor,
Extract billiard table points from the actual billiard game image,
A projector device that extracts the path information based on a positional relationship between the arrangement of the extracted billiard table points and the cue ball of the live test or the at least one object ball of the live test. According to paragraph 1,
The processor,
Applying the learned neural network-based recognition model to the real-life billiard game image to extract the positions of the real-time cue ball and the at least one real-time object ball from the real-time billiard game image,
A projector device that extracts the route information based on the positions of the extracted live shooting object ball and the at least one live shooting object ball. According to paragraph 1,
The processor,
A projector device that generates the virtual billiard game image in which the virtual cue ball and the at least one virtual object ball move on the movement path at a speed according to a user command. According to paragraph 1,
The processor is
Receiving a user command from a user to select one virtual billiard ball among the virtual cue ball and the at least one virtual object ball,
A projector device that generates the virtual billiard game image in which the selected virtual billiard ball moves on the movement path. In an image projection server that projects a virtual billiard game image on a billiard table using a projector device,
a processor that generates the virtual billiard game image from an actual billiard game image; and
A communication module that transmits the generated virtual billiard game image to the projector device through a communication network
Including,
An image projection server wherein the transmitted virtual billiard game image is projected from the projector device to the upper surface of the billiard table. According to clause 14,
The processor,
From the real-life billiards game image, extract path information where the real-life cue ball moves on the real-life billiard table and collides with at least one real-time object ball,
An image projection server that generates the virtual billiard game image including a movement path along which a virtual cue ball and at least one virtual object ball move on a virtual billiard table, based on the extracted path information. According to clause 15,
The route information is,
An image projection server comprising change information over time in position coordinates for the live shooting cue and change information over time in position coordinates for the at least one live shooting target ball. According to clause 15,
An image projection server wherein the virtual cue ball and the at least one virtual object ball move with time along the movement path within the virtual billiard game image. According to clause 15,
The processor is
Receiving a user command from a user to select one virtual billiard ball among the virtual cue ball and the at least one virtual object ball,
An image projection server that generates the virtual billiard game image in which a plurality of circular images corresponding to the selected virtual billiard ball are disposed on a movement path of the selected virtual billiard ball. According to clause 18,
An image projection server wherein the plurality of circular images are sequentially displayed along a movement path of the selected virtual billiard ball. According to clause 18,
The processor is
Receiving a user command to adjust a time interval at which the plurality of circular images are sequentially displayed,
An image projection server that generates the virtual billiard game image in which the plurality of circular images are displayed sequentially at the adjusted time interval along the movement path of the selected virtual billiard ball. According to clause 15,
The processor,
Extract billiard table points from the actual billiard game image,
An image projection server that extracts the path information based on a positional relationship between the arrangement of the extracted billiard table points and the cue ball of the live shot or the at least one object ball of the live shot. In a method of projecting a virtual billiard game image based on a real billiard game image,
extracting, from the realistic billiard game image, information on a path in which a real-life cue ball moves on a real-life billiard table and collides with at least one real-time object ball;
Based on the extracted path information, generating the virtual billiard game image including a movement path where a virtual cue ball moves on a virtual billiard table and collides with at least one virtual object ball; and
An operation of projecting the generated virtual billiard game image onto the upper surface of an actual billiard table.
Method, including. According to clause 22,
The route information is,
A method comprising change information over time in positional coordinates of the target ball of the field trip and change information over time in position coordinates of the at least one target ball of the field trip. According to clause 22,
A method in which the virtual cue ball and the at least one virtual object ball move with time along the movement path within the virtual billiard game image. A computer-readable storage medium storing instructions for executing the method according to any one of claims 22 to 24.

Images