WO2019128504A1

WO2019128504A1 - Method and apparatus for image processing in billiards game, and terminal device

Info

Publication number: WO2019128504A1
Application number: PCT/CN2018/115386
Authority: WO
Inventors: 梁栋
Original assignee: 深圳市超级视觉科技有限公司
Priority date: 2017-12-28
Filing date: 2018-11-14
Publication date: 2019-07-04
Also published as: CN108090486A; CN108090486B

Abstract

Provided are a method and apparatus for image processing in a billiards game, and a terminal device. The method is applied to a system including a photographing apparatus, and comprises: collecting video information including a table top of a billiards table and billiards balls on the table top by means of a photographing apparatus (101); and analyzing the video information based on a constructed projection model including the photographing apparatus and billiards ball positions to obtain position information of the billiards balls, wherein the billiards balls in an image included in the video information are elliptical in shape (102). In the method, billiards balls in an image included in video information are elliptical in shape, and position information of the billiards balls in the image in the video information is obtained based on a projection model, so that the accuracy of position information is improved. In addition, the method is simple to implement and has greater practicability and usability.

Description

Image processing method, device and terminal device in billiard game

Technical field

The invention relates to the field of machine vision recognition technology, in particular to an image processing method, device and terminal device in a billiard game.

Background technique

In recent years, machine vision has begun to be applied to electronic scoring of billiard games. The existing implementation manner is as follows: the video of the billiard game is collected by the photographing device, and then the position information of the billiards on the billiard table surface is obtained through the established model, and then the subsequent operation is performed to realize electronic scoring. Therefore, obtaining the location information of billiards on the billiard table is a key step.

technical problem

However, in the existing model, the billiards are regarded as a circle, and then the billiards are positioned to obtain the position information of the billiards. Moreover, since the height of the camera from the table of the billiard table is limited, the ball is seen as a visual source, and the shape of the ball (unless located at the center of the center) is not circular, so the billiard is regarded as a circle. Inevitably, there is a large error or even an error in the obtained billiard position information.

Technical solution

In view of this, an embodiment of the present invention provides an image processing method and apparatus in a billiard game to solve the problem of the image processing method in the billiard game in the prior art.

A first aspect of the embodiments of the present invention provides an image processing method in a billiard game, which is applied to a system including a photographing apparatus, and the image processing method includes:

Collecting, by the photographing device, video information of a billboard including a billiard table and a billiard on the countertop;

The video information is analyzed based on the constructed projection model including the photographing device and the billiard position to obtain position information of the billiard; the video information includes an image in which the billiard shape is an ellipse.

Optionally, the video information includes distribution information of an elliptical area corresponding to each billiard on a table surface;

The video information is analyzed based on the constructed projection model including the shooting device and the billiard position, and the position information of the billiard is obtained:

An elliptical region conforming to the projection model is detected from the distribution information;

Determining, according to the spatial geometric position relationship of the elliptical region corresponding to the billiard in the shooting model, the positional information of the elliptical region conforming to the projection model, and calculating the elliptical region The location information of the billiards.

Optionally, analyzing, according to the constructed projection model including the shooting device and the billiard position, the position information of the billiards from the video information includes:

Dividing the video information into a plurality of frames;

And dividing, according to the projection model, an elliptical area and a mesa area corresponding to billiards in each of the plurality of frames;

Dividing the set of elliptical regions into a plurality of connected regions;

Obtaining location information of the connected area, and using position information of each of the plurality of connected areas as position information of billiards corresponding to the respective elliptical areas.

Optionally, the location information of the connected area is obtained, and the location information of each of the plurality of connected areas is used as the location information of the billiard corresponding to each of the elliptical areas.

Dividing the connected area into independent areas, acquiring location information of each of the independent areas, and using the location information of the independent area as location information of billiards corresponding to the independent area.

Obtain the area size of the connected area;

Matching the area size with a preset threshold to obtain a matching result;

Extracting, from the connected region, a plurality of circles that do not overlap each other based on the matching result, each circle corresponding to a circumscribed ellipse conforming to the projection model and circumscribed to the circle, the circumscribed ellipse occupying the region The set is the connected area.

A second aspect of the present invention provides an image processing apparatus in a billiard game, including:

An acquisition module, configured to collect video information of a billboard including a billiard table and a billiard on the counter by a photographing device;

The analysis module is configured to analyze the video information based on the constructed projection model including the photographing device and the billiard position to obtain position information of the billiard; the video information includes an image in which the billiard shape is an ellipse.

The analysis module includes:

a detecting unit, configured to detect, from the distribution information, an elliptical region that conforms to the projection model;

a calculating unit, configured to calculate, according to the spatial geometric position relationship of the elliptical region corresponding to the billiard in the shooting device, the billiard, and the distribution information in the projection model, based on the position information of the elliptical region that conforms to the projection model The location information of the billiard to which the ellipse area belongs is obtained.

Optionally, the analyzing module includes:

a first dividing unit, configured to divide the video information into multiple frames;

a segmentation unit, configured to segment an elliptical region and a mesa region corresponding to billiards in each of the plurality of frames based on the projection model;

a second dividing unit, configured to divide the set of the elliptical regions into a plurality of connected regions;

And an acquiring unit, configured to acquire location information of the connected area, and use location information of each of the plurality of connected areas as position information of billiards corresponding to the respective elliptical areas.

Optionally, the obtaining unit includes:

The sub-unit is configured to divide the connected area into independent areas, obtain location information of each of the independent areas, and use location information of the independent area as location information of billiards corresponding to the independent area.

Optionally, the obtaining unit includes:

Obtaining a subunit for obtaining an area size of the connected area;

a matching subunit, configured to match the area size with a preset threshold to obtain a matching result;

Extracting a subunit, configured to extract, from the connected region, a plurality of circles that do not overlap each other based on the matching result, each circle corresponding to a circumscribed ellipse that conforms to the projection model and is circumscribed to the circle, the outer The merged area of the cut ellipse occupying area is the connected area; the position information of the plurality of circles not overlapping each other is converted into position information of the billiard.

A third aspect of an embodiment of the present invention provides a terminal device including a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein the processor executes the The steps of the method of the first aspect are implemented when the computer program is described.

A fourth aspect of the embodiments of the present invention provides a computer readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the method of the first aspect step.

Beneficial effect

Implementation of the embodiments of the present invention will have the following beneficial effects:

In the embodiment of the present invention, the video information of the billiard table and the billiard on the countertop is collected by the photographing device; the video information is analyzed based on the constructed projection model including the photographing device and the billiard position, and the billiard is obtained. Position information, wherein the video information includes an image in which the billiard shape is an ellipse. In the image included in the video information of the embodiment of the present invention, the billiard shape is an ellipse, and the position information of the billiard in the image of the video information is obtained based on the projection model, thereby improving the accuracy of the position information. In addition, the implementation process of the embodiment of the present invention is simple, and has strong practicability and ease of use.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

among them:

1 is a schematic flow chart showing an implementation of an image processing method in a billiard game in an embodiment;

2 is a schematic diagram of a projection model of an image processing method in a billiard game in an embodiment;

FIG. 3 is a schematic diagram of a specific implementation process of step S102 in an embodiment;

4 is a schematic diagram of another specific implementation process of step S102 in an embodiment;

Figure 5-A is a schematic view of a connected region formed by overlapping three elliptical regions in one embodiment;

Figure 5-B is a schematic view of a connected region formed by an elliptical region in an embodiment;

FIG. 5-C is a schematic diagram showing an extraction result of a connected region formed by overlapping three elliptical regions in one embodiment; FIG.

Figure 5-D is a schematic diagram showing an intermediate process of extracting a connected region formed by overlapping three elliptical regions in one embodiment;

6 is a schematic diagram of a specific implementation process of step S304 in an embodiment;

7 is a structural block diagram of a terminal device in an embodiment;

Figure 8 is a schematic illustration of an image processing apparatus in a billiard game in one embodiment.

Embodiments of the invention

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

In the following description, for purposes of illustration and description However, it will be apparent to those skilled in the art that the present invention may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the invention.

The term "comprising", when used in the specification and the claims of the claims The existence or addition of , whole, steps, operations, elements, components, and/or collections thereof.

It is also to be understood that the terminology of the present invention is to be construed as a The singular forms "", ",",,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

It is further understood that the term "and/or" used in the description of the invention and the appended claims means any combination and all possible combinations of one or more of the associated listed items, .

As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "on" or "in response to determining" or "in response to detecting" depending on the context. Similarly, the phrase "if determined" or "if detected [condition or event described]" may be interpreted in context to mean "once determined" or "in response to determining" or "once detected [condition or event described] ] or "in response to detecting [conditions or events described]".

In order to explain the technical solution described in the present invention, the following description will be made by way of specific embodiments. It should be noted that the following embodiments are applied to a system including a photographing device.

Embodiment 1

1 is a schematic flow chart showing an implementation of an image processing method in a billiard game provided by Embodiment 1 of the present invention. As shown in FIG. 1 , the image processing method in the billiard game may specifically include the following steps:

Step S101: Collecting video information of the billiard table including the billiard table and the billiard on the countertop by the photographing device.

The camera device may be a camera, and the camera refers to a device that can collect video or image sequences, and may be an industrial camera, a web camera, a surveillance camera, a camera equipped with the computer itself, and the like.

Step S102: analyzing the video information based on the constructed projection model including the photographing device and the billiard position to obtain position information of the billiard; the video information includes an image in which the billiard shape is an ellipse.

The projection model is shown in Fig. 2. The cone with the camera's optical center as the apex and tangent to the ball is constructed. The section cut by the plane of the table (the projection of the billiard on the plane) is an ellipse, which is the image of the ball. The shape presented in . The obvious premise is that the physical size of the billiards is fixed, and since the ball is always tangent to the plane of the table, the position of the billiards and the vertical projection point of the center of the sphere are mutually determined. At this time, in the case where the billiard position is known, the elliptical position (ie, the elliptical center position) and the elliptical shape (including the long axis length, the short axis length, and the long axis direction) can be calculated; conversely, at the known elliptical position In this case, the position information and ellipse shape of the billiards can be derived. The above position and length may be based on the physical coordinates of the table, or may be based on image coordinates, or normalized coordinates, and the like. It should be noted that the ideal situation in which the main optical axis of the camera is perpendicular to the mesa is shown in FIG. 2. In fact, even if the main optical axis is not perpendicular to the mesa, the ball is still elliptical in the image, and the above parameters can still be derived from each other.

As mentioned above, the elliptical position (i.e., the position of the elliptical center point) is known, and the billiard position and the elliptical shape (including the long axis length, the short axis length, and the long axis direction) can be derived. One implementation is:

Taking the center of the mesa as the origin, the mesa is the Z=0 plane, the long side of the mesa is the X-axis direction, and the wide side of the mesa is the Y-axis. If the optical center of the camera is located directly above the center of the table and the distance from the table h, the coordinates are (0, 0, h). Set the billiard position to (x, y), its radius is known as r, and by default placed on the table, its spherical coordinates are (x, y, r). Let the vertices be (0,0,h) and make a cone tangent to the sphere whose sphere is (x,y,r) radius r, intersect with the Z=0 plane, and the obtained ellipse is the projection ellipse. Its center is (x', y'), the length of the major axis is a, the length of the minor axis is b, and the direction of the major axis is θ.

The forward process of billiard projection is: know h, x, y, r, find x', y', a, b, θ. This is easily done by establishing a cone equation and solving the joint equation of the cone and the plane. In turn, the actual need is to know h, x', y', r, find x, y, a, b, θ. This requires x, y as the quantity to be quantified, and also establishes the cone equation and solves the joint equation of the cone and the plane, which can be used to find x, y. The above is an implementation of comparative specifications, there are actually many alternatives, not enumerated.

As a preferred embodiment of the present embodiment, the video information includes distribution information of an elliptical area corresponding to each billiard on a table surface;

As shown in FIG. 3, analyzing the video information based on the constructed projection model including the shooting device and the billiard position, and obtaining the position information of the billiard includes the following steps:

Step S201: detecting an elliptical region that conforms to the projection model from the distribution information.

Wherein, the distribution information may be a distribution of elliptical regions on the mesa, and may be: there is no overlapping region between all elliptical regions, that is, all elliptical regions are independent; or: at least one elliptical region is independent There are overlaps between two or more elliptical regions; it may also be that all elliptical regions are not independent, that is, for any ellipse, at least overlap with its adjacent elliptical region. Wherein, the overlapping regions generally refer to partial overlap. Detecting an elliptical region conforming to the projection model from the distribution information, and also detecting an elliptical contour conforming to the projection model, for example, directly applying a Hough transform (Hough) Transform) or the random sample consensus (RANSAC) method, which directly detects all ellipse that conforms to the (x', y', a, b, θ) constraint from the distribution information.

It should be noted that the elliptical region is solid (the region surrounded by the curve), the elliptical contour is hollow (closed curve), and if the "ellipse" is mentioned, the elliptical region or the elliptical contour is included, which can be understood according to the context. . It can be understood that the elliptical region includes an elliptical contour of the elliptical region. Therefore, the detection may be performed by first detecting an elliptical region and further detecting an elliptical contour conforming to the projection model; or, first detecting an ellipse of the elliptical region. The contour, which further detects the elliptical region that conforms to the projection model, does not limit the scope of protection of the embodiments of the present invention.

Step S202: Calculate the spatial geometric position relationship of the elliptical region corresponding to the billiard in the shooting model according to the shooting device, the billiards, and the position information of the ellipse region that matches the projection model. The location information of the billiards to which the ellipse area belongs.

As another preferred embodiment of the present embodiment, as shown in FIG. 4, analyzing the video information based on the constructed projection model including the photographing device and the billiard position, and obtaining the position information of the billiard includes the following steps:

Step S301: dividing the video information into a plurality of frames.

A frame is a single image frame of the smallest unit of video information. One frame is a still picture, and successive frames form an animation. The video information is divided into a plurality of frames, that is, divided into a plurality of pictures, each of which constitutes one picture.

Step S302: Segment the elliptical area and the mesa area corresponding to the billiard in each of the plurality of frames based on the projection model.

It can be understood that the elliptical area corresponding to the billiard is projected on the plane where the table top is located, wherein since the mesa is substantially unchanged, the frame may be used in each of the plurality of frames based on the projection model. The ellipse area and the mesa area corresponding to the billiards are divided to obtain all the elliptical areas.

Step S303: Divide the set of the elliptical regions into a plurality of connected regions.

The area shown in FIG. 5-A is a connected area formed by overlapping three elliptical areas. It can be understood that the area shown in FIG. 5-B is a connected area formed by an elliptical area.

Step S304: Acquire location information of the connected area, and use position information of each of the plurality of connected areas as position information of billiards corresponding to the respective elliptical areas.

Step S304 includes two situations:

In the first case, it is necessary to divide the overlapping areas in the connected area to make them separate areas;

In the second case, it is not necessary to divide the overlapping areas in the connected area, and the blurring process can be performed.

Among them, the first case can be implemented as follows. Obtaining the location information of the connected area, and the location information of each of the plurality of connected areas as the location information of the billiard corresponding to each of the elliptical areas respectively includes:

The elliptical area is divided into non-overlapping areas. Illustratively, the result of extracting the connected area shown in FIG. 5-A is as shown in FIG. 5-C. For example, the following implementation manner: converting the image in the video information into a grayscale image to fix a threshold (such as 200) or an adaptive threshold (such as using the previous tracking result to know that there are n balls on the mesa, then the gray level of all pixels is high The image is binarized to the lower 20th nth gray value as a threshold value, and is divided into an elliptical region and a mesa region, and each connected region of the elliptical region corresponds to one billiard. Here, the billiards of whatever color are used have the characteristics of a highlight area at the center position, and the highlight areas of adjacent billiards do not overlap.

In the second case, based on the above-mentioned connected area, there may be a connected area formed by overlapping two elliptical areas, or a connected area formed by overlapping three elliptical areas or even a connected area formed by overlapping three or more elliptical areas. . In other words, each connected area is either an elliptical area of a single billiard or an adjoining number of elliptical areas. The shape parameter of the elliptical region is related to the elliptical position, but is approximately unchanged in a connected region. The projection model is established by taking the central position of the connected region as the elliptical position, and the elliptical shape thus obtained is pixelated, and the morphological corrosion is performed on the connected region by using it as a template. After etching, several small connected regions are obtained, and each small connected region corresponds to one. Billiards, the position information of each small connected area is used as the position information of the corresponding billiards. It should be noted that, therefore, the present embodiment can implement the blurring processing on the connected area, that is, it is not necessary to divide and connect the connected areas in which the elliptical areas overlap, and the processing efficiency is high.

As another embodiment of the second scenario, further, as shown in FIG. 6, acquiring location information of the connected area, and using location information of each of the plurality of connected areas as The location information of the billiard corresponding to each ellipse area may include:

Step S401: Acquire an area size of the connected area.

Step S402: Matching the area size with a preset threshold to obtain a matching result.

For example, the elliptical model is established as the elliptical position of the connected region, that is, the shape parameter is determined. First, the number of ellipse in the connected region is calculated, and then m elliptical center positions are calculated for the connected region, thereby determining m ellipse of the shape parameter, the union of the m elliptical coverage areas is required to be the entire connected area, and the inscribed circles of the m ellipse do not overlap each other. If the number m and m center positions above cannot be calculated, all the possibilities can be exhausted, and then the matching result that meets the requirements can be selected.

Step S403: extracting, from the connected region, a plurality of circles that do not overlap each other based on the matching result, and each circle corresponds to a circumscribed ellipse that conforms to the projection model and is circumscribed to the circle, and the circumscribed ellipse occupies The union of the regions is the connected region; the position information of the plurality of circles that do not overlap each other is converted into position information of the billiards.

Illustratively, the result of extracting the connected regions shown in FIG. 5-A is as shown in FIG. 5-D.

In the preferred embodiment, the positional information of each of the independent regions is obtained by dividing the connected region in which the overlapping region exists into a plurality of circles that do not overlap each other, that is, the coordinates obtained by performing coordinate transformation on the center of the inscribed circle The coordinates of the vertical projection point of the billiard. It should be noted that, in this embodiment, the relative position before the billiards is not the absolute position of each billiard, so the approximation process does not affect the accuracy of the billiard position information, but improves the processing efficiency. The algorithm was optimized.

It should be understood that the size of the sequence of the steps in the above embodiments does not imply a sequence of executions, and the order of execution of the processes should be determined by its function and internal logic, and should not be construed as limiting the implementation of the embodiments of the present invention.

Embodiment 2

Please refer to FIG. 7, which is a structural block diagram of an image processing apparatus in a billiard game provided by Embodiment 2 of the present invention. The image processing device 70 in the billiard game includes an acquisition module 71 and an analysis module 72. Among them, the specific functions of each module are as follows:

The collecting module 71 is configured to collect video information of a billboard including a billiard table and a billiard on the counter by the photographing device;

The analysis module 72 is configured to analyze the video information based on the constructed projection model including the photographing device and the billiard position to obtain position information of the billiard; the video information includes an image in which the billiard shape is an ellipse.

The analysis module 72 includes:

Optionally, the analyzing module 72 includes:

Optionally, the obtaining unit includes:

Optionally, the dividing subunit includes:

Obtaining a subunit for obtaining an area size of the connected area;

Embodiment 3

FIG. 8 is a schematic diagram of a terminal device according to Embodiment 3 of the present invention. As shown in FIG. 8, the terminal device 8 of this embodiment includes a processor 80, a memory 81, and a computer program 82 stored in the memory 81 and operable on the processor 80, such as an image in a billiard game. Processing method. When the processor 80 executes the computer program 82, the steps in the embodiment of the image processing method in each of the above billiard games are implemented, for example, steps S101 to S102 shown in FIG. Alternatively, when the processor 80 executes the computer program 82, the functions of the modules in the above various device embodiments are implemented, such as the functions of the modules 81 to 82 shown in FIG.

Illustratively, the computer program 82 can be partitioned into one or more modules/units that are stored in the memory 81 and executed by the processor 80 to complete this invention. The one or more modules/units may be a series of computer program instruction segments capable of performing a particular function, the instruction segments being used to describe the execution of the computer program 82 in the terminal device 8. For example, the computer program 82 can be divided into an acquisition module and an analysis module, and the specific functions of each module are as follows:

The terminal device 8 may be a computing device such as a desktop computer, a notebook, a palmtop computer, or a cloud server. The terminal device may include, but is not limited to, a processor 80 and a memory 81. It will be understood by those skilled in the art that FIG. 8 is merely an example of a terminal device, and does not constitute a limitation of the terminal device, and may include more or less components than those illustrated, or combine some components, or different components, such as The terminal device may further include an input/output device, a network access device, a bus, and the like.

The so-called processor 80 can be a central processing unit (Central Processing Unit, CPU), can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

The memory 81 may be an internal storage unit of the terminal device 8, such as a hard disk or a memory of the terminal device 8. The memory 81 may also be an external storage device of the terminal device 8, for example, a plug-in hard disk provided on the terminal device 8, a smart memory card (SMC), and a secure digital (SD). Card, flash card (Flash Card) and so on. Further, the memory 81 may also include both an internal storage unit of the terminal device 8 and an external storage device. The memory 81 is used to store the computer program and other programs and data required by the terminal device. The memory 81 can also be used to temporarily store data that has been output or is about to be output.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the division of each functional unit and module described above is exemplified. In practical applications, the above functions may be assigned to different functional units as needed. The module is completed by dividing the internal structure of the device into different functional units or modules to perform all or part of the functions described above. Each functional unit and module in the embodiment may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit, and the integrated unit may be hardware. Formal implementation can also be implemented in the form of software functional units. In addition, the specific names of the respective functional units and modules are only for the purpose of facilitating mutual differentiation, and are not intended to limit the scope of protection of the present application. For the specific working process of the unit and the module in the foregoing system, reference may be made to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the above embodiments, the descriptions of the various embodiments are different, and the parts that are not detailed or described in a certain embodiment can be referred to the related descriptions of other embodiments.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

In the embodiments provided by the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the device/terminal device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units. Or components may be combined or integrated into another system, or some features may be omitted or not performed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in electrical, mechanical or other form.

The units described as being separated into separate components may or may not be physically separated, and the components converted to the unit display may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. on. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated modules/units, if implemented in the form of software functional units and converted to separate products for sale or use, may be stored in a computer readable storage medium. Based on such understanding, the present invention implements all or part of the processes in the foregoing embodiments, and may also be completed by a computer program to instruct related hardware. The computer program may be stored in a computer readable storage medium. The steps of the various method embodiments described above may be implemented when the program is executed by the processor. Wherein, the computer program comprises computer program code, which may be in the form of source code, object code form, executable file or some intermediate form. The computer readable medium can include any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a removable hard drive, a magnetic disk, an optical disk, a computer memory, a read only memory (ROM, Read-Only) Memory), random access memory (RAM, Random) Access Memory), electrical carrier signals, telecommunications signals, and software distribution media. It should be noted that the content contained in the computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in a jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, computer readable media Does not include electrical carrier signals and telecommunication signals.

The embodiments described above are only for explaining the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that The technical solutions described in the examples are modified, or some of the technical features are equivalently replaced; and the modifications or substitutions do not deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in Within the scope of protection of the present invention.

Claims

An image processing method in a billiard game, which is characterized in that it is applied to a system including a photographing device, and the image processing method includes:

Collecting, by the photographing device, video information of a billboard including a billiard table and a billiard on the countertop;

The video information is analyzed based on the constructed projection model including the photographing device and the billiard position to obtain position information of the billiard; the video information includes an image in which the billiard shape is an ellipse.
The image processing method of the billiard game according to claim 1, wherein the video information comprises distribution information of an elliptical area corresponding to each billiard on the table surface;

The video information is analyzed based on the constructed projection model including the shooting device and the billiard position, and the position information of the billiard is obtained:

An elliptical region conforming to the projection model is detected from the distribution information;

Determining, according to the spatial geometric position relationship of the elliptical region corresponding to the billiard in the shooting model, the positional information of the elliptical region conforming to the projection model, and calculating the elliptical region The location information of the billiards.
The image processing method in a billiard game according to claim 1, wherein the position information of the billiards is obtained based on the constructed projection model including the shooting device and the billiard position, and the position information of the billiards is:

Dividing the video information into a plurality of frames;

And dividing, according to the projection model, an elliptical area and a mesa area corresponding to billiards in each of the plurality of frames;

Dividing the set of elliptical regions into a plurality of connected regions;

Obtaining location information of the connected area, and using position information of each of the plurality of connected areas as position information of billiards corresponding to the respective elliptical areas.
The image processing method in a billiard game according to claim 3, wherein position information of the connected area is acquired, and position information of each of the plurality of connected areas is respectively used as the The position information of the billiard corresponding to the ellipse area includes:

Dividing the connected area into independent areas, acquiring location information of each of the independent areas, and using the location information of the independent area as location information of billiards corresponding to the independent area.
The image processing method in a billiard game according to claim 3, wherein position information of the connected area is acquired, and position information of each of the plurality of connected areas is respectively used as the The position information of the billiard corresponding to the ellipse area includes:

Obtain the area size of the connected area;

Matching the area size with a preset threshold to obtain a matching result;

Extracting, from the connected region, a plurality of circles that do not overlap each other based on the matching result, each circle corresponding to a circumscribed ellipse conforming to the projection model and circumscribed to the circle, the circumscribed ellipse occupying the region The set is the connected area; the position information of the plurality of circles that do not overlap each other is converted into position information of the billiard.
An image processing device in a billiard game, comprising:

An acquisition module, configured to collect video information of a billboard including a billiard table and a billiard on the counter by a photographing device;

The analysis module is configured to analyze the video information based on the constructed projection model including the photographing device and the billiard position to obtain position information of the billiard; the video information includes an image in which the billiard shape is an ellipse.
The image processing device of the billiard game according to claim 6, wherein the video information comprises distribution information of an elliptical area corresponding to each billiard on the table surface;

The analysis module includes:

a detecting unit, configured to detect, from the distribution information, an elliptical region that conforms to the projection model;

a calculating unit, configured to calculate, according to the spatial geometric position relationship of the elliptical region corresponding to the billiard in the shooting device, the billiard, and the distribution information in the projection model, based on the position information of the elliptical region that conforms to the projection model The location information of the billiard to which the ellipse area belongs is obtained.
The image processing apparatus of the billiard game according to claim 6, wherein the analysis module comprises:

a first dividing unit, configured to divide the video information into multiple frames;

a segmentation unit, configured to segment an elliptical region and a mesa region corresponding to billiards in each of the plurality of frames based on the projection model;

a second dividing unit, configured to divide the set of the elliptical regions into a plurality of connected regions;

And an acquiring unit, configured to acquire location information of the connected area, and use location information of each of the plurality of connected areas as position information of billiards corresponding to the respective elliptical areas.
A terminal device comprising a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein the processor executes the computer program as claimed in claim 1 5 The steps of any of the methods described.
A computer readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the method of any one of claims 1 to 5.