WO2023037157A1 - Procédés, appareils, dispositifs, systèmes et supports d'enregistrement pour détecter des éléments de jeu - Google Patents

Procédés, appareils, dispositifs, systèmes et supports d'enregistrement pour détecter des éléments de jeu Download PDF

Info

Publication number
WO2023037157A1
WO2023037157A1 PCT/IB2021/058727 IB2021058727W WO2023037157A1 WO 2023037157 A1 WO2023037157 A1 WO 2023037157A1 IB 2021058727 W IB2021058727 W IB 2021058727W WO 2023037157 A1 WO2023037157 A1 WO 2023037157A1
Authority
WO
WIPO (PCT)
Prior art keywords
game
game item
operation object
position information
item
Prior art date
Application number
PCT/IB2021/058727
Other languages
English (en)
Inventor
Xinxin Wang
Fei Xie
Naiwei XIE
Original Assignee
Sensetime International Pte. Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sensetime International Pte. Ltd. filed Critical Sensetime International Pte. Ltd.
Priority to CN202180002748.3A priority Critical patent/CN114008673A/zh
Priority to AU2021240274A priority patent/AU2021240274A1/en
Publication of WO2023037157A1 publication Critical patent/WO2023037157A1/fr

Links

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
    • G07F17/32—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
    • G07F17/3202—Hardware aspects of a gaming system, e.g. components, construction, architecture thereof
    • G07F17/3216—Construction aspects of a gaming system, e.g. housing, seats, ergonomic aspects
    • G07F17/322—Casino tables, e.g. tables having integrated screens, chip detection means
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
    • G07F17/32—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
    • G07F17/3225—Data transfer within a gaming system, e.g. data sent between gaming machines and users
    • G07F17/3232—Data transfer within a gaming system, e.g. data sent between gaming machines and users wherein the operator is informed
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
    • G07F17/32—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
    • G07F17/3244—Payment aspects of a gaming system, e.g. payment schemes, setting payout ratio, bonus or consolation prizes
    • G07F17/3248—Payment aspects of a gaming system, e.g. payment schemes, setting payout ratio, bonus or consolation prizes involving non-monetary media of fixed value, e.g. casino chips of fixed value
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
    • G07F17/32—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
    • G07F17/3286—Type of games
    • G07F17/3293—Card games, e.g. poker, canasta, black jack

Definitions

  • the present disclosure relates to the field of computer vision technology, in particular to a method, an apparatus, a device, a system and a storage medium for detecting a game item.
  • scene action detection based on computer vision is widely used in various scenes.
  • scenes such as tabletop games
  • a vision detection system is often used to detect and recognize information of game props.
  • an embodiment of the present disclosure provides a method of detecting a game item, which includes detecting, based on an acquired video stream of a game playing in a game area, first position information of a game item within the game area and second position information of an operation object for the game item; and determining, in response to determining that a positional relationship between the game item and the operation object is changed from overlapping with each other to separating from each other based on the first position information and the second position information, that the game item is in an operation completed state.
  • detecting the first position information of the game item within the game area and the second position information of the operation object for the game item includes: obtaining a first boundary box of the game item within the game area and a second boundary box of the operation object by performing a detection on the video stream.
  • the method provided in the present disclosure further includes at least one of: determining, in response to that there is no overlapping area between the first boundary box and the second boundary box, that the positional relationship between the game item and the operation object is separating from each other; or determining, in response to that there is an overlapping area between the first boundary box and the second boundary box, that the positional relationship between the game item and the operation object is overlapping with each other.
  • determining, in response to determining that the positional relationship between the game item and the operation object is changed from overlapping with each other to separating from each other based on the first position information and the second position information, that the game item is in the operation completed state includes: for each game item involved in the video stream of the game area, determining that the game item is in the operation completed state at a time corresponding to a first video frame in the video stream, in response to that the game item and the operation object are detected as separating from each other in the first video frame, and the game item and the operation object are detected as overlapping with each other in a preceding frame of the first video frame in the video stream.
  • determining that the game item is in the operation completed state at the time corresponding to the first video frame in the video stream, in response to that the game item and the operation object are detected as separating from each other in the first video frame, and the game item and the operation object are detected as overlapping with each other in the preceding frame of the first video frame in the video stream includes: obtaining third position information of the game item in the preceding frame, in response to that the game item and the operation object are detected as separating from each other in the first video frame, and the game item and the operation object are detected as overlapping with each other in the preceding frame of the first video frame in the video stream; and determining, in response to that the first position information and the third position information meet a predetermined position condition, that the game item is in the operation completed state at the time corresponding to the first video frame.
  • detecting the first position information of the game item within the game area and the second position information of the operation object for the game item includes: determining, based on the video stream, whether the operation object for the game item is a target operation object; and detecting, in response to that the operation object for the game item is the target operation object, the first position information of the game item and the second position information of the target operation object.
  • determining, based on the video stream, whether the operation object for the game item is the target operation object includes: determining, based on the video stream, a direction of operating the game item by the operation object; and determining, in response to that the direction of operating is a predetermined direction, that the operation object is the target operation object.
  • determining, based on the video stream, whether the operation object for the game item is the target operation object includes: detecting, based on the video stream, an operation object correlated with the game item; detecting, based on the video stream, a face object correlated with the operation object; and determining, in response to that the face object is a predetermined face object, that the operation object for the game item is the target operation object.
  • the method provided in the present disclosure further includes: obtaining, by performing a detection on each video frame in the video stream sequentially, a current detection result of each game item that is in the operation completed state in the video frame; updating a historical detection result stored in a cache based on a comparison between the current detection result and the historical detection result in the cache; and switching, in a case that one or more detection results in the cache meet a predetermined condition, the game to a result processing state.
  • the detection result includes position information of a game item
  • updating the historical detection result in the cache based on the comparison between the current detection result and the historical detection result in the cache includes: determining, according to a comparison between position information of the game item in the current detection result and each position information in the historical detection result, whether the game item is a newly-appearing game item; and storing, in response to that the game item is a newly-appearing game item, the detection result of the newly-appearing game item into the cache.
  • updating the historical detection result in the cache based on the comparison between the current detection result and the historical detection result stored in the cache further includes: storing, in response to that there is no historical detection result in the cache, the current detection result into the cache and switching the current game to a game item distributing state.
  • storing, in response to that the game item is a newly-appearing game item, the detection result of the newly-appearing game item into the cache includes: storing, in response to that the game item is a newly-appearing game item and the current game is in the game item distributing state, the detection result of the newly-appearing game item into the cache.
  • the detection result includes identification information of a game item; the determining that the one or more detection results in the cache meet the predetermined condition includes: obtaining, for each of the one or more detection results in the cache, identification information of a game item involved in the detection result in the cache; determining whether a game processing result can be derived from the identification information obtained for each of the one or more detection results; and determining, in response to that a game processing result can be derived from the identification information obtained for each of the one or more detection results, that the one or more detection results meet the predetermined condition.
  • the method before determining whether a game processing result can be derived from the identification information obtained for each of the one or more detection results, the method further includes: executing, in response to that a number of the one or more detection results stored in the cache reaches a predetermined number, the step of determining whether a game processing result can be derived from the identification information obtained for each of the one or more detection results.
  • the detection result includes position information of a game item
  • the method further includes: acquiring sequential information of the cache storing each detection result in the cache; determining a target sub-area corresponding to the detection result based on the sequential information and a pre-established correspondence between sequential information of game items and a plurality of sub-areas within the game area; and switching the current game to a halt state, in response to determining that the game item is not in the target sub-area according to the position information of the game item.
  • the game area includes a game item operating area
  • detecting the first position information of the game item within the game area and the second position information of the operation object for the game item includes: detecting, in response to that the game item is moved to the game item operating area, the first position information of the game item and the second position information of the operation object for the game item.
  • an apparatus for detecting a game item which includes: a first detecting module, configured to detect, based on an acquired video stream of a game playing in a game area, first position information of a game item within the game area, and second position information of an operation object for the game item; and a first determining module, configured to determine, in response to determining that a positional relationship between the game item and the operation object is changed from overlapping with each other to separating from each other based on the first position information and the second position information, that the game item is in an operation completed state.
  • the first detecting module is specifically configured to obtain a first boundary box of the game item within the game area and a second boundary box of the operation object by performing a detection on the video stream.
  • the first determining module is specifically configured to: determine, in response to that there is no overlapping area between the first boundary box and the second boundary box, that the positional relationship between the game item and the operation object is separating from each other; and/or determine, in response to that there is an overlapping area between the first boundary box and the second boundary box, that the positional relationship between the game item and the operation object is overlapping with each other.
  • the first determining module is specifically configured to: for each game item involved in the video stream of the game area, determine that the game item is in the operation completed state at a time corresponding to a first video frame in the video stream, in response to that the game item and the operation object are detected as separating from each other in the first video frame , and the game item and the operation object are detected as overlapping with each other in a preceding frame of the first video frame in the video stream.
  • the first determining module is specifically configured to obtain third position information of the game item in the preceding frame, in response to that the game item and the operation object are detected as separating from each other in the first video frame, and the game item and the operation object are detected as overlapping with each other in a preceding frame of the first video frame in the video stream; and determine, in response to that the first position information and the third position information meet a predetermined position condition, that the game item is in the operation completed state at the time corresponding to the first video frame.
  • the first detecting module is specifically configured to determine whether the operation object for the game item is a target operation object based on the video stream; and detect, in response to that the operation object for the game item is the target operation object, the first position information of the game item and the second position information of the target operation object.
  • the first detecting module is specifically configured to determine, based on the video stream, a direction of operating the game item by the operation object; and determine, in response to that the direction of operating is a predetermined direction, that the operation object is the target operation object.
  • the first detecting module is specifically configured to detect an operation object correlated with the game item based on the video stream; detect a face object correlated with the operation object based on the video stream; and determine, in response to that the face object is a predetermined face object, that the operation object for the game item is the target operation object.
  • the detection apparatus provided in the present disclosure further includes a second detecting module, which is configured to obtain, by performing a detection on each video frame in the video stream sequentially, a current detection result of each game item that is in the operation completed state in the video frame; a cache updating module, which is configured to update a historical detection result stored in a cache based on a comparison between the current detection result and the historical detection result in the cache; and a game state switching module, which is configured to switch the game to a result processing state in a case that one or more detection results in the cache meet a predetermined condition.
  • a second detecting module which is configured to obtain, by performing a detection on each video frame in the video stream sequentially, a current detection result of each game item that is in the operation completed state in the video frame
  • a cache updating module which is configured to update a historical detection result stored in a cache based on a comparison between the current detection result and the historical detection result in the cache
  • a game state switching module which is configured to switch the game to a result processing state
  • the cache updating module is specifically configured to determine, according to a comparison between position information of the game item in the current detection result and each position information in the historical detection result, whether the game item is a newly-appearing game item; and store, in response to that the game item is a newly-appearing game item, the detection result of the newly-appearing game item into the cache.
  • the cache updating module is specifically configured to store, in response to that there is no historical detection result in the cache, the current detection result into the cache and switching the current game to a game item distributing state.
  • the cache updating module is specifically configured to store, in response to that the game item is a newly-appearing game item and the current game is in the game item distributing state, the detection result of the newly-appearing game item into the cache.
  • the detection result includes identification information of a game item
  • the game state switching module is specifically configured to obtain, for each of the one or more detection results in the cache, identification information of a game item involved in the detection result in the cache; determine whether a game processing result can be derived from the identification information obtained for each of the one or more detection results; and determine, in response to that a game processing result can be derived from the identification information obtained for each of the one or more detection results, that the one or more detection results meet the predetermined condition.
  • the game state switching module is specifically configured to before determining whether a game processing result can be derived from the identification information obtained for each of the one or more detection results, execute, in response to that a number of the one or more detection results stored in the cache reaches a predetermined number, the step of determining whether a game processing result can be derived from the identification information obtained for each of the one or more detection results.
  • the detection result includes position information of a game item
  • the detection apparatus provided in the present disclosure further includes an acquiring module, configured to acquire sequential information of the cache storing each detection result; a second determining module, configured to determine a target sub-area corresponding to the detection result based on the sequential information and a pre-established correspondence between sequential information of game items and a plurality of sub-areas within the game area; and the game state switching module is configured to switch the current game to a halt state, in response to determining that the game item is not in the target sub-area according to the position information of the game item.
  • the game area includes a game item operating area
  • the first detecting module is specifically configured to detect, in response to that the game item is moved to the game item operating area, the first position information of the game item and the second position information of the operation object for the game item.
  • a device for detecting a game item includes a memory and a processor storing computer instructions that can be read by the processor, and the processor, when reading the computer instructions, is caused to execute the method according to any embodiment of the first aspect.
  • a system for detecting a game item includes an image capture device, configured to acquire video stream of a game playing in a game area; a processor, connected with the image capture device to obtain the video stream of the game; and a processor storing computer instructions that can be read by the processor.
  • the processor when reading the computer instructions, is caused to execute the method according to any embodiment of the first aspect.
  • a non-transitory computer readable storage medium which stores computer readable instructions for causing the computer to execute the method according to any embodiment of the first aspect.
  • first position information of a game item within a game area and second position information of an operation object for the game item are detected based on an acquired video stream of a game playing in the game area, and in response to determining that a positional relationship between the game item and the operation object is changed from overlapping with each other to separating from each other based on the first position information and the second position information, the game item is determined as in an operation completed state.
  • FIG. 1 is a schematic structure diagram illustrating a system for detecting a game item according to some embodiments of the present disclosure.
  • FIG. 2 is a schematic diagram illustrating a game area according to some embodiments of the present disclosure.
  • FIG. 3 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 4 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 5 is a schematic diagram illustrating an image in a video stream of a game area according to some embodiments of the present disclosure.
  • FIG. 6 is a schematic diagram illustrating an image in a video stream of a game area according to some embodiments of the present disclosure.
  • FIG. 7 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 8 is a schematic diagram illustrating an image in a video stream of a game area according to some embodiments of the present disclosure.
  • FIG. 9 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 10 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 11 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 12 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 13 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 14 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 15 is a flow chart illustrating a method of detecting a game item according to some embodiments of the present disclosure.
  • FIG. 16 is a block diagram illustrating an apparatus for detecting a game item according to some embodiments of the present disclosure.
  • FIG. 17 is a block diagram illustrating an apparatus for detecting a game item according to some embodiments of the present disclosure.
  • FIG. 18 is a structural block diagram illustrating an apparatus for detecting a game item according to some embodiments of the present disclosure.
  • FIG. 19 is a structural block diagram illustrating a system that is applicable for implementing the detection method of the present disclosure.
  • a complete game can often be divided into a plurality of different phases according to different player actions.
  • the game process can include players placing game coins, a dealer dealing cards, and collecting the game coins according to card results, and so on.
  • the game phase often has a certain game rule. For example, in a phase of dealing cards, a certain requirement is generally provided on the order of dealing cards.
  • a detection system based on computer vision can divide the entire game process into a plurality of different game states according to the different game phases.
  • the cards dealing phase can correspond to a "game item distributing state”
  • the game coins collecting phase can correspond to a "result processing state”.
  • the detection system can set corresponding detection logic based on different game phases, so as to determine whether a player or a dealer is performing a game action according to a proper game rule when the game is in the current state.
  • determining of the detection system on one or more actions of a player and switching of game states need to rely on information such as coordinates of a player's hand, the number of cards, a position of a card, a points number of a card and the like on a game table.
  • information such as coordinates of a player's hand, the number of cards, a position of a card, a points number of a card and the like on a game table.
  • a video stream of a real game scenario acquired by a camera taking the dealer dealing cards phase as an example, where a card is in a high-speed moving state, and the dealer's hand and the card will be sheltered.
  • the detection system uses these images with high-speed motion and being sheltered for detection and recognition, the accuracy of a recognition result is relatively low, which in turn results in lower accuracy of subsequent business logic judgment.
  • the determining of switching game states is realized based on an image involving a card with high-speed motion and being sheltered, the accuracy of recognizing a game state
  • the implementations of the present disclosure provide a method, an apparatus, an electronic device and a storage medium for detecting a game item, with an objective of recognizing a stable state of a game item based on visual information during the game, which is beneficial to improving the accuracy of subsequent business processing.
  • examples of the present disclosure provide a method of detecting a game item, which can be applied to a game detection system to realize visual detection on game scenarios.
  • FIG. 1 shows some implementations of the detection system of the present disclosure, which will be described below in conjunction with FIG. 1.
  • the game of the present disclosure can be a tabletop game as an example.
  • at least one game table 100 can be provided.
  • the number of game tables 100 is not limited.
  • two game tables 100 are shown in FIG. 1. It can be understood that the game table 100 indicates a carrier for players to play games, and the table top of the game table 100 indicates a game area where the players play games.
  • the detection system includes an image capture device 200 arranged above or on the sides of the game table 100, and the image capture device 200 is configured to obtain video stream data of the game area.
  • the image capture device 200 includes at least one camera located directly above the game table 100, so that the video stream of the game area can be collected in a top view.
  • the image capture device 200 in addition to the camera directly above, can also include at least one camera located on the sides of the game table 100, so that video stream data of the game from other angles can be collected. It surely can be understood by those skilled in the art, and will not be detailed herein.
  • the detection system further includes a vision unit 300 provided on each game table 100.
  • the vision unit 300 can perform corresponding image processing operations, such as image detection and the like, based on the video stream data collected by the image capture device 200.
  • the vision unit 300 can be a unit module that is pre-trained based on a learnable machine learning model or a neural network model and can be used to identify and detect a target object in image data.
  • the vision unit 300 can be an end-side processing device deployed on the side of the game table.
  • the detection system also includes a processing unit 400, which is respectively connected to the vision units 300 of a plurality of game tables 100, so that the processing unit 400 can obtain a processing result of each of the vision units 300, and perform corresponding steps according to the received processing results, for example, issuing control instructions to the vision unit 300 and so on.
  • the processing unit may be deployed in a central control device of a game place, or in a remote server for performing data analysis for a plurality of game tables in the game place.
  • a vision unit 300 of a game table 100 detects that a player is not playing the game according to the rule of the game based on the video stream data collected by the image capture device 200
  • the vision unit 300 can send warning information to the processing unit 400.
  • the vision unit 300 can switch the current game to the halt state.
  • the processing unit 400 in the background can issue a warning to a dealer to give a risk alarm.
  • a vision unit 300 is correspondingly provided for each game table, thereby facilitating the distributed management of the detection system.
  • the detection system of the implementation of the present disclosure is not limited to the example in FIG. 1, and other implementations are also possible based on the example in FIG. 1.
  • the vision unit 300 and the processing unit 400 can be integrated in the same processing module, that is, the vision unit 300 is not set on the game table 100 at the front end, but is integrated with the processing unit 400 in the background, and performs image data processing operations in the background. It surely can be understood by those skilled in the art, and will not be detailed herein.
  • FIG. 2 shows a schematic diagram illustrating a game area of a game table in some implementations of the present disclosure, which will be described below in conjunction with FIG. 2.
  • the entire tabletop area of the game table 100 indicates the game area, and the video stream for the game table during the game can be captured by an image capture device set above the game table 100.
  • the game area can be divided into a game item operating area 110 and a currency token operating area 120.
  • the game item operating area 110 can be used for distributing and placing a game item
  • the currency token operating area 120 can be used for a player to place a currency token.
  • the game item operating area 110 may include a plurality of sub-areas.
  • the game item operating area 110 may include two sub-areas, namely a sub-area 111 and a sub-area 112 shown in the FIG. 2. It surely can be understood by those skilled in the art that the number of sub-areas can be set according to a specific game scenario, which will not be detailed herein.
  • the method of detecting a game item of the implementation of the present disclosure will be described below.
  • the method exemplified in the present disclosure can be executed by the above-mentioned vision unit 300, can also be executed by the processing unit 400, or jointly executed by the vision unit 300 and the processing unit 400, which is not limited in the present disclosure.
  • the method of detecting a game item of the example of the present disclosure includes the following step.
  • first position information of a game item within a game area, and second position information of an operation object for the game item are detected based on an acquired video stream of a game playing in the game area.
  • video stream data of the game process can be acquired with the image capture device set in the game area, and transmitted to the visual unit 300 described above, or to the visual unit 300 and the processing unit 400 described above.
  • the visual unit 300, or the visual unit 300 and the processing unit 400 can perform analysis on the video stream to recognize information of an object on the game table and/or information of an event that occurs on the game table.
  • a game item can be considered as a game prop, which is necessary for proceeding the game.
  • each game item is further provided with respective identification information which represents a prop attribute of the game item.
  • identification information For the purpose of distinguishing game props of the same kind, a plurality of different kinds of attribute information can be provided for the game items of one kind.
  • the identification information described in the present disclosure refers to the attribute information of the game item.
  • the game item can be a card
  • the suit and points number on the card is the identification information of the card, such as ace of hearts, 2 of spades, and so on.
  • the game item can be a mahjong block, and card face information of the mahjong block is the identification information, such as one character, nine bamboo, and so on.
  • the operation object for the game item refers to a target object for operating the game item.
  • a dealer is to deal cards and, when dealing cards, his/her hand is the operation object.
  • a dealer can hold a tool for dealing cards, and, when dealing cards, the tool he/she holds is the operation object.
  • a game item is taken out from game item depository and distributed to the game item operating area 110 by a dealer.
  • the game item On the tabletop, the game item is driven to move from the game item depository to the game item operating area 110 by the dealer's hand, and then the dealer's hand leaves the game item, and the game item stays still in the game item operating area.
  • the accuracy of detection result is relatively low.
  • the game item is finally motionless in the game item operating area 110, that is, it is not moving and not being sheltered if an image captured at this time is used for detecting and recognizing the identification information, the accuracy of recognizing the identification information will be improved.
  • a state in which the game item is motionless in the game area after being operated by the operation object is defined as an operation completed state.
  • the accuracy of the detection system can be improved.
  • step 310 based on the video stream of the game process, for example, with image detection technology, the first position information of the game item within the game area and the second position information of the operation object for the game item are obtained.
  • a hand of a dealer who distributes the game item is the operation object.
  • first position information of the game item in each image can be obtained, and second position information of the dealer's hand can be obtained at the same time.
  • the first position information indicates a position of the game item in an image of the video stream
  • the second position information indicates a position of the operation object for the game item in an image of the video stream.
  • the first position information may indicate as a boundary box of the game item
  • the second position information may indicate a boundary box of the operation object.
  • the first position information may indicate position information of a key point of the game item
  • the second position information may indicate position information of a key point of the operation object.
  • first position information and the second position information can also be any other position information suitable to represent a position, which is not limited to the above examples and will not be detailed herein.
  • step 320 in response to determining that a positional relationship between the game item and the operation object is changed from overlapping with each other to separating from each other based on the first position information and the second position information, it is determined that the game item is in an operation completed state.
  • the game item being in the operation completed state indicates that the operation object such as the hand of a dealer or the handheld tool has left from the game item, i.e., the operation object no longer overlaps with the game item. Therefore, based on the first position information of the game item and the second position information of the operation object, it can be determined whether the positional relationship between the game item and the operation object is changed from overlapping with each other to separating from each other, and further determined whether the game item is in the operation completed state.
  • a first boundary box of the game item within the game area and a second boundary box of the operation object for the game item can be obtained.
  • the first boundary box and the second boundary box are used as the above-mentioned first position information and second position information respectively.
  • the first boundary box and the second boundary box may be rectangular boxes containing vertices, length information and width information of the boundary boxes.
  • the position relationship of overlapping with each other and separating from each other between the game item and the operation object thereof may be determined by an overlapping and separating state of the corresponding first boundary box and second boundary box.
  • first boundary box and the second boundary box at least partially overlap, it indicates that the game item and the operation object thereof overlap, i.e., the game item is being distributed and is not in the operation completed state.
  • first boundary box and the second boundary box do not overlap, it indicates that the operation object has left the game item, i.e., the game item has been distributed and is in the operation completed state.
  • first key point can include one or more key points of the game item, such as at least one of a center point, a corner point of the game item.
  • the second key point can include one or more key points of the operation object, such as at least one of a center point, an edge contour point of the operation object.
  • the position relationship of overlapping with each other and separating from each other between the game item and the operation object thereof may be determined by a distance between the first key point and the corresponding second key point.
  • a distance threshold can be predetermined based on priori knowledge or limited trials, and when the distance between the first key point and the second key point is less than the distance threshold, it represents that the game item and operation object thereof are overlapping with each other. Conversely, when the distance between the first key point and the second key point is equal to or greater than the distance threshold, it represents that the game item and operation object thereof are separating from each other.
  • first position information and the second position information can also be any other position information suitable to represent a position and, accordingly, those skilled in the art can determine the positional relationship between the game item and the operation object based on a specific implementation of the position information, which will not be detailed herein.
  • a first image in which the positional relationship between the game item and the operation object thereof is changed from overlapping with each other to separating from each other can be detected form the video stream and taken as a critical frame.
  • An image prior to the critical frame represents that the game item is in a moving or being sheltered state
  • an image after the critical frame represents that the game item is in an operation completed state. Therefore, the image after the critical frame can be used to perform relevant detection and recognition on the game item, thus improving the accuracy of detecting.
  • the method of the present disclosure can effectively decrease the interference of motion or being sheltered on the recognition for the game item, which is beneficial to improve the accuracy of subsequent recognition task(s).
  • FIG. 4 and FIG. 6 Some specific implementations of the detection method provided in the present disclosure are illustrated in FIG. 4 and FIG. 6. The detection method of the present disclosure is described in detail below in conjunction with FIG. 4 and FIG. 6.
  • the method of detecting a game item includes the following steps.
  • a first boundary box of the game item within the game area and a second boundary box of the operation object are obtained by performing a detection on the video stream.
  • step 420 in response to that there is no overlapping area between the first boundary box and the second boundary box, it is determined that the positional relationship between the game item and the operation object is separating from each other.
  • step 430 in response to that there is an overlapping area between the first boundary box and the second boundary box, it is determined that the positional relationship between the game item and the operation object is overlapping with each other.
  • FIG. 5 and FIG. 6 respectively show one image included in the video stream, and specific description of which will be given below in conjunction with FIG. 5 and FIG. 6.
  • FIG. 5 and FIG. 6 are top views of a game table, and a game area of the game table can refer to FIG. 2.
  • a dealer 700 performs an operation of distributing game items in the game area, that is, taking out a game item 710 from a game item depository box 720 and moving the game item 710 to the game item operating area 110 for stationary placement.
  • a first boundary box 711 of the game item 710 on the game table and a second boundary box 731 of the operation object 730 for the game item can be obtained.
  • the operation object 730 for the game item is the hand of the dealer 700.
  • the game item 710 is in the process of moving, that is, the operation object 730 is driving the game item 710 to move on the game table, so there is an overlapping area between the first boundary box 711 and the second boundary box 731. At this time, the positional relationship between the game item 710 and the operation object 730 is overlapping with each other.
  • FIG. 6 While in FIG. 6, there is no overlapping area between the first boundary box 711 of the game item 710 and the second boundary box 731 of the operation object 730, indicating that the operation object 730 has left the game item 710 and the game item 710 has been distributed, at this time the positional relationship between the game item 710 and the operation object 730 is separating from each other.
  • images included in the video stream are a plurality of images in a temporally sequence, which represent dynamic changes in the positional relationship between the game item and the operation object.
  • the detection system performs detection on each image in turn based on the above-mentioned detection method to obtain the positional relationship between the game item and the operation object in the corresponding image.
  • an image in which the positional relationship between the game item and the operation object are separating from each other is defined as the first video frame.
  • the game item and the operation object are detected as separating from each other by the detection system, and the image shown in FIG. 6 can be determined as a first video frame.
  • the positional relationship between the game item and the operation object in a preceding frame of the image can be obtained by the detection system.
  • a preceding frame of the first video frame is shown in FIG. 8, and in the preceding frame shown in FIG. 8, the game item and the operation object are overlapping with each other.
  • preceding frame of the first video frame may be a previous image immediately before the first video frame in the video stream, or may be an image before the first video frame and apart from the first video frame by at least one frame in the video stream, which is not limited in the present disclosure.
  • the position information in the preceding frame of the first video frame can be combined to determine whether the game item is in the operation completed state, which will be described in detail below in conjunction with FIG. 7.
  • the method of detecting a game item provided in the examples of the present disclosure includes the following steps.
  • step 701 in response to detecting that the game item and the operation object are separating from each other in the first video frame in the video stream, and are overlapping with each other in the preceding frame of the first video frame in the video stream, third position information of the game item in the preceding frame is obtained.
  • step 702 in response to that the first position information and the third position information meet a predetermined position condition, it is determined that the game item is in the operation completed state at the time corresponding to the first video frame.
  • the third position information of the game item in the preceding frame is further obtained rather than directly determining the time corresponding to the first video frame as the time when the game item is in the operation completed state.
  • the third position information indicates a position of the game item in the preceding frame. Similar to the above-mentioned first position information, the detection system can obtain the third position information of the game item in the preceding frame by performing a detection on the preceding frame. In some implementations, the third position information may indicate a boundary box of the game item, or position information of a key point of the game item.
  • the first video frame is shown in FIG. 6 and the preceding frame of the first video frame is shown in FIG. 8.
  • the detection system determines that the game item and the operation object are separating from each other.
  • the detection system determines that the game item and the operation object are overlapping with each other.
  • the detection system can obtain the third position information of the game item from the detection on the preceding frame shown in FIG. 8.
  • the third position information of the game item 710 obtained from the detection indicates a third boundary box 711'.
  • the position of the game item in the preceding frame should be almost the same as the position of the game item in the first video frame when the game item in the first video frame is in the operation completed state, therefore, after the third boundary box 711' is obtained, whether the game item 710 in the first video frame is in the operation completed state can be determined based on the positions of the first boundary box 711 and the third boundary box 711'.
  • the first boundary box 711 represents the position information of the game item 710 in the first video frame (FIG. 6), and the third boundary box 711' represents the position information of the game item 710 in the preceding frame (FIG. 8).
  • a distance between the first boundary box 711 and the third boundary box 711' is less than a predetermined distance threshold, it indicates that the position of the game item 710 remains almost unchanged in the two images, thus determining that the first position information and the third position information meet the predetermined position condition, and the game item 710 in the first video frame is in the operation completed state. If the distance between the first boundary box 711 and the third boundary box 711' is greater than the predetermined distance threshold, it indicates that the position of the game item 710 has changed significantly, and the game item 710 in the first video frame is not in the operation completed state.
  • the position information of the game item in the preceding frame is further combined to determine whether the game item is in a stable state, so as to improve the accuracy and reliability of detecting the stable state of the game item.
  • game participants in a real game scenario, game participants often include a dealer and a player, and operations on a game item can only be performed by the dealer.
  • an operation of distributing game items can only be performed by the dealer, and a player can only receive one or more game items distributed to them by the dealer.
  • the detection system in order to determine whether a violation action occurs in the distributing process, it is necessary for the detection system to perform a detection on the operation object currently operating the game item. Specific description will be given below in conjunction with FIG. 9.
  • the method of detecting a game item provided in the examples of the present disclosure includes the following steps.
  • step 910 whether the operation object for the game item is a target operation object is determined based on the video stream.
  • the target operation object is an object that is allowed to perform one or more operations on the game item, such as a hand-held prop or a hand of a dealer who deals cards in a card game or the like.
  • the step 910 can include the following steps.
  • a direction of operating the game item by the operation object is determined based on the video stream.
  • step 911-2 in response to that the direction of operating is a predetermined direction, it is determined that the operation object is the target operation object.
  • a dealer and a player sit face to face on two sides of the game table, that is, for an image capture device set above the table, the dealer operates a game item in a different direction from that of the player.
  • the direction of operating the game item by the current operation object can be obtained by performing image detection on the video stream, where the direction of operating can represent a moving direction or angle of the game item.
  • the predetermined direction is a predetermined moving direction or angle range for the game item. In a case that the detected direction of operating matches the predetermined direction, it represents that the hand currently operating the game item is the hand of the dealer, that is, the target operation object. On the contrary, in a case that the detected direction of operating does not match the predetermined direction, it represents that the hand currently operating the game item is not the hand of the dealer, that is, not the target operation object.
  • the step 910 can include the following steps.
  • step 912-1 an operation object correlated with the game item is detected based on the video stream.
  • a face object correlated with the operation object is detected based on the video stream.
  • step 912-3 in response to that the face object is a predetermined face object, it is determined that the operation object for the game item is the target operation object.
  • the operation object correlated with the current game item such as a hand or a hand-held prop and the like
  • the detection system can detect a face object correlated with the operation object, for example, a face correlated with the hand operating the game item.
  • a face object correlated with the operation object for example, a face correlated with the hand operating the game item, can be further detected by the detection system with the correlation algorithm based on the video stream.
  • the predetermined face object can be a face image of a predetermined target operation object.
  • the detected face object matches the predetermined face object, it represents that the operation object currently operating the game item is the dealer’s hand or hand-held prop, that is, the target operation object.
  • the detected face object does not match the predetermined face object, it represents that the object currently operating the game item is not the dealer’s hand or hand-held prop, that is, not the target operation object.
  • step 920 in response to that the operation object for the game item is the target operation object, the first position information of the game item and the second position information of the target operation object are detected.
  • the above-mentioned detection on a stable state of the game item can be performed. For example, in the above-mentioned example, when determining that the operation object currently operating the game item to move is the dealer's hand, whether a card is in the operation completed state can be determined according to the video stream.
  • a dealer In a tabletop game scenario, a dealer is often needs to distribute a plurality of game items in sequence. For example, in one implementation, as shown in FIG. 5 and FIG. 2, the dealer needs to distribute four game items and a specific order of distributing is as follows: the first game item is taken out from a game item depository box and moved to the sub-area 111, the second game item is taken out from the game item depository box and moved to the sub-area 112, the third game item is taken out from the game item depository box and moved to the sub-area 111, the fourth game item is taken out from the game item depository box and moved to the sub-area 112.
  • the method of detecting a game item provided in the examples of the present disclosure includes the following steps.
  • a current detection result of each game item that is in the operation completed state in a video frame is obtained by performing a detection on each video frame of the video stream sequentially.
  • a historical detection result in a cache is updated based on a comparison between the current detection result and the historical detection result stored in the cache.
  • step 1230 in a case that one or more detection results in the cache meet a predetermined condition, the game is switched to a result processing state.
  • the game process is divided into a plurality of different game states by the detection system, such as a game item distributing state corresponding to a phase of distributing game items by a dealer, a result processing state corresponding to a phase of collecting game coins, etc.
  • the number of game items in the operation completed state may vary from image to image when the game is in the game item distributing state.
  • the detection result can include identification information and position information or the like of a game item.
  • the identification information can include the points number and suit of a card
  • the position information can include coordinates of a card.
  • the dealer since the dealer just starts distributing the first game item, there are no historical detection results in a system cache at this time.
  • the detection result of the first game item is obtained, in response to that there are no historical detection results in the cache, the current detection result of the first game item can be saved into the cache.
  • the game enters a phase of distributing game items from other phases (e.g. a phase of a player placing game coins), so that the detection system can switch the current game to the game item distributing state.
  • the current detection results can be compared with the historical detection result stored in the cache, and in some implementations, whether the game item corresponding to the current detection result is newly appearing or has been stored in the cache can be determined based on position information of the game item. The following is illustrated in conjunction with the implementation shown in FIG. 13.
  • the process of updating the historical detection result stored in the cache includes the following steps.
  • step 1310 whether the game item is a newly-appearing game item is determined according to a comparison between position information of the game item in the current detection result and each position information in the historical detection result.
  • step 1320 in response to that the game item is a newly-appearing game item, the detection result of the newly-appearing game item is stored into the cache.
  • the current detection result of the first game item should be the same as or similar to the historical detection result, thereby determining that the first game item is not a newly-appearing game item.
  • the position of the second game item is different from the position of the first game item, so the current detection result of the second game item is quite different from the historical detection result, such that the second game item can be determined as a newly-appearing game item.
  • the detection result of the second game item can be stored into the cache.
  • the detection result includes the identification information and position information of the second game item.
  • whether the current game is in the game item distributing state can be further determined, and only when the game is in the game item distributing state can the distributing of game items be allowed.
  • the game is switched to the game item distributing state by the system when the detection result of the first game item is stored into the cache, so that when storing the detection result of the second game item into the cache, the system determines that the current game is in the game item distributing state, and then the detection result of the second game item can be stored into the cache.
  • the current game is not in the game item distributing state, it indicates that an abnormal game operation occurs.
  • the system can switch the game to a halt state and send an alert message to the background at the same time.
  • one or more historical detection results stored in the cache are iteratively updated by continuously performing the above process until the one or more detection results in the cache meet a predetermined condition, which indicates that the game items distributing phase of the game is ended and the game enters into a game coins settlement phase, so that the game can be switched to the result processing state.
  • a predetermined condition which indicates that the game items distributing phase of the game is ended and the game enters into a game coins settlement phase, so that the game can be switched to the result processing state.
  • the process of determining that the one or more detection results meet the predetermined condition includes the following steps.
  • step 1410 for each of the one or more detection results in the cache, identification information of a game item involved in the detection result in the cache is obtained.
  • step 1420 whether a game processing result can be derived from the identification information obtained for each of the one or more detection results is determined.
  • step 1430 in response to that a game processing result can be derived from the identification information obtained for each of the one or more detection results, it is determined that the one or more detection results meet the predetermined condition.
  • the detection system can obtain identification information of a game item involved in the detection result from the cache.
  • one or more detection results in the cache include identification information of each game item, such as the points number, suit and other information of a card. Then, according to the identification information of each game item, it is determined that whether a game processing result can be obtained.
  • a business-level rule corresponding to a game processing result of the card game includes: the number of cards within the game area is 4, and from a sum of points number of two cards within the sub-area 111 and a sum of points number of two cards within the sub-area 112, the party closest to 9 wins. Therefore, the sum of points number of the two cards in the sub-area 111 and the sum of points number of the two cards in the sub-area 112 are determined based on the obtained identification information of each card. Whether there is a party who received cards with a sum of points number closer to 9 can be determined by comparing the two sums of points number. If the determination result is yes, it is determined that a game processing result can be obtained; and if the two sums of points number are the same, it is determined that a game processing result cannot be obtained.
  • the detection system determines that a game processing result can be obtained, it indicates that the real game scenario has entered the game coins settlement phase, such that the detection system can switch the current game from the game item distributing state to a result processing state.
  • a video frame involving the game item in the operation completed state is used for detecting the identification information of the game item, which reduces the interference of being sheltered or motion on the image detection and recognition, improves the accuracy of detection, and at the same time realizes automatic switching of game states based on the detected identification information and improves the reliability and stability of the detection system.
  • the number of game items is usually limited.
  • a business-level rule corresponding to a predetermined condition includes: the number of cards within the game area is 4 and the party who received cards with a sum of points number closest to 9 wins.
  • a dealer is expected to deal 4 cards during the game items distributing phase. Therefore, in the implementations of the present disclosure, the step of determining whether a game processing result can be derived from the identification information obtained for each of the one or more detection results can be performed when the number of detection results stored in the cache reaches a predetermined number.
  • the detection system sequentially stores detection results of game items in the operation completed state into the cache until the number of one or more detection results in the cache reaches the predetermined number. For example, in the above example scenario, the number of the one or more detection results in the cache reaching 4, indicating that the number of game items in the operation completed state is 4, and corresponding to the real game scenario, it indicates that a dealer has distributed and is to calculate a game processing result based on identification information of the game items.
  • the process of determining whether a game processing result can be derived from the identification information obtained for each of the one or more detection results stored in the cache is started, which is not described in detail in the present disclosure.
  • a dealer in the game items distributing phase, a dealer is often expected to distribute game items according to a predetermined distributing order. For example, in the game scenario in the above example, a dealer distributes four game items in an order of: sub-area 111 - sub-area 112 - sub-area 111 - sub-area 112.
  • the detection system needs to determine whether the distributing order of the dealer is correct, and when it is determined that the distributing order is incorrect, the detection system can promptly alarm or interrupt the game to avoid causing losses. The following is illustrated in conjunction with the implementation shown in FIG. 15.
  • the method of detecting a game item provided in the examples of the present disclosure further includes the following steps.
  • step 1510 sequential information of the cache storing each detection result is acquired.
  • a sequence corresponding to the detection result of the game item can be recorded while storing the detection result of the game item in the cache, and the sequence can be taken as a distributing sequence of each game item. Therefore, when the detection system stores one or more detection results in sequence, sequential information of a certain detection result can be obtained.
  • a target sub-area corresponding to the detection result is determined based on the sequential information and a pre-established correspondence between sequential information of game items and a plurality of sub-areas within the game area.
  • the game item operating area 110 within the game area includes a sub-area 111 and a sub-area 112.
  • a dealer needs to distribute four game items to a corresponding sub-area in an order of "sub-area 111 - sub-area 112 - sub-area 111 - sub-area 112".
  • the correspondence between sequential information of game items and sub-areas can be established in advance.
  • the pre-established correspondence can includes: a sub-area corresponding to the first game item is the sub-area 111, a sub-area corresponding to the second game item is the sub-area 112, and a sub-area corresponding to the third game item is the sub-area 111, and a sub-area corresponding to the fourth game item is the sub-area 112.
  • the detection system can determine sequential information corresponding to the game item according to the sequential information of storing the detection result in the cache. For example, the detection system determines that sequential information of the currently stored detection result is 2, that is, representing that the game item corresponding to the current detection result is the second game item. Therefore, according to the above-mentioned correspondence, it can be determined that the target sub-area corresponding to the second game item is the sub-area 112.
  • step 1530 in response to determining that the game item is not in the target sub-area according to the position information of the game item, the current game is switched to a halt state.
  • the target sub-area corresponding to a current detection result of the second game item is the sub-area 112.
  • Whether the second game item is located within the sub-area 112 is determined based on the position information in the detection result by the detection system. If the determination result is yes, it represents that no errors occur in the distributing order of the second game item. If the determination result is no, it represents that the distributing order of the second game item is abnormal, and then the detection system can switch the current game to the halt state, and send an alarm message to the background at the same time.
  • the distributing order of a game item is determined through the pre-established correspondence between sequential information and sub-areas, so as to improve the reliability of the system.
  • determining whether the game item is in the operation completed state further includes: in response to that the game item is moved to the game item operating area, the first position information of the game item and the second position information of the operation object for the game item are detected.
  • the game area includes the game item operating area 110, during the game, both a dealer and a player perform relevant operations on one or more game items within the game item operating area 110. Therefore, in the implementations of the present disclosure, the detection system can only perform detection and recognition on game items within the game item operating area 110.
  • the detection system does not execute steps of the above-mentioned implementation until the game item is moved into the game item operating area 110, which avoids interference brought by a game item outside the game item operating area 110, and improves the stability of the system.
  • the detection on game scenes can be realized based on computer vision, and automatic switching of game states can be realized based on a video stream involving the game process, which improves the stability and reliability of the system.
  • switching between states is realized based on data regarding the game item in a stable state, thereby improving the accuracy of the detection.
  • the implementations of the present disclosure provide an apparatus for detecting a game item.
  • the detection apparatus exemplified in the present disclosure includes: a first detecting module 10, configured to detect, based on an acquired video stream of a game playing in a game area, first position information of a game item within the game area, and second position information of an operation object for the game item; and a first determining module 20, configured to determine, in response to determining that a positional relationship between the game item and the operation object is changed from overlapping with each other to separating from each other based on the first position information and the second position information, that the game item is in an operation completed state.
  • the apparatus of the present disclosure can effectively decrease the interference of motion or being sheltered on the recognition for the game item, which is beneficial to improve the accuracy of subsequent recognition task(s).
  • the first detecting module 10 is specifically configured to obtain a first boundary box of the game item within the game area and a second boundary box of the operation object by performing a detection on the video stream.
  • the first determining module 20 is specifically configured to: determine, in response to that there is no overlapping area between the first boundary box and the second boundary box, that the positional relationship between the game item and the operation object is separating from each other; and/or determine, in response to that there is an overlapping area between the first boundary box and the second boundary box, that the positional relationship between the game item and the operation object is overlapping with each other.
  • the first determining module 20 is specifically configured to: for each game item involved in the video stream of the game area, determine that the game item is in the operation completed state at a time corresponding to a first video frame in the video stream, in response to that the game item and the operation object are detected as separating from each other in the first video frame, and the game item and the operation object are detected as overlapping with each other in a preceding frame of the first video frame in the video stream.
  • the first determining module 20 is specifically configured to obtain third position information of the game item in the preceding frame, in response to that the game item and the operation object are detected as separating from each other in the first video frame , and the game item and the operation object are detected as overlapping with each other in a preceding frame of the first video frame in the video stream; and determine, in response to that the first position information and the third position information meet a predetermined position condition, that the game item is in the operation completed state at the time corresponding to the first video frame.
  • the first detecting module 10 is specifically configured to determine whether the operation object for the game item is a target operation object based on the video stream; and detect, in response to that the operation object for the game item is the target operation object, the first position information of the game item and the second position information of the target operation object.
  • the first detecting module 10 is specifically configured to determine, based on the video stream, a direction of operating the game item by the operation object; and determine, in response to that the direction of operating is a predetermined direction, that the operation object is the target operation object.
  • the first detecting module 10 is specifically configured to detect an operation object correlated with the game item based on the video stream; detect a face object correlated with the operation object based on the video stream; and determine, in response to that the face object is a predetermined face object, that the operation object for the game item is the target operation object.
  • the detection apparatus provided in the present disclosure further includes a second detecting module 30, which is configured to obtain, by performing a detection on each video frame in the video stream sequentially, a current detection result of each game item that is in the operation completed state in the video frame; a cache updating module 40, which is configured to update a historical detection result stored in a cache based on a comparison between the current detection result and the historical detection result in the cache; and a game state switching module 50, which is configured to switch the game to a result processing state in a case that one or more detection results in the cache meet a predetermined condition.
  • a second detecting module 30 which is configured to obtain, by performing a detection on each video frame in the video stream sequentially, a current detection result of each game item that is in the operation completed state in the video frame
  • a cache updating module 40 which is configured to update a historical detection result stored in a cache based on a comparison between the current detection result and the historical detection result in the cache
  • a game state switching module 50 which is configured to switch the game to
  • the detection result includes position information of a game item
  • the cache updating module is specifically configured to determine, according to a comparison between position information of the game item in the current detection result and each position information in the historical detection result, whether the game item is a newly-appearing game item; and store, in response to that the game item is a newly-appearing game item, the detection result of the newly-appearing game item into the cache.
  • the cache updating module 40 is specifically configured to store, in response to that there is no historical detection result in the cache, the current detection result into the cache and switching the current game to a game item distributing state.
  • the cache updating module 40 is specifically configured to store, in response to that the game item is a newly-appearing game item and the current game is in the game item distributing state, the detection result of the newly-appearing game item into the cache.
  • the detection result includes identification information of a game item
  • the game state switching module is specifically configured to obtain, for each of the one or more detection results in the cache, identification information of a game item involved in the detection result in the cache; determine whether a game processing result can be derived from the identification information obtained for each of the one or more detection results; and determine, in response to that a game processing result can be derived from the identification information obtained for each of the one or more detection results, that the one or more detection results meet the predetermined condition.
  • the game state switching module 50 is specifically configured to before determining whether a game processing result can be derived from the identification information obtained for each of the one or more detection results, execute, in response to that a number of the one or more detection results stored in the cache reaches a predetermined number, the step of determining whether a game processing result can be derived from the identification information obtained for each of the one or more detection results .
  • the detection result includes position information of a game item
  • the detection apparatus provided in the present disclosure further includes an acquiring module 60, configured to acquire sequential information of the cache storing each detection result in the cache; a second determining module 70, configured to determine a target sub-area corresponding to the detection result based on the sequential information and a pre-established correspondence between sequential information of game items and a plurality of sub-areas within the game area; and the game state switching module is configured to switch the current game to a halt state, in response to determining that the game item is not in the target sub-area according to the position information of the game item.
  • the game area includes a game item operating area
  • the first detecting module 10 is specifically configured to detect, in response to that the game item is moved to the game item operating area, the first position information of the game item and the second position information of the operation object for the game item.
  • the detection on game scenes can be realized based on computer vision, and automatic switching of game states can be realized based on a video stream involving the game process, which improves the stability and reliability of the system.
  • switching between states is realized based on data regarding the game item in a stable state, thereby improving the accuracy of the detection.
  • the present disclosure provides a device for detecting a game item.
  • the device for detecting the game item includes a memory and a processor storing computer instructions that can be read by the processor, and the processor, when reading the computer instructions, is caused to execute the method according to any one of the above-mentioned implementations.
  • the above-mentioned detection device can be a computing device with data processing capability deployed in a game place, and the processor therein can run the above-mentioned detection method to realize the detection of the state of the game item in the game place.
  • the present disclosure provides a system for detecting a game item.
  • the system includes an image capture device, configured to acquire video stream of a game playing in a game area; a processor, connected with the image capture device to obtain the video stream of the game; and a processor storing computer instructions that can be read by the processor.
  • the processor when reading the computer instructions, is caused to execute the method according to any one of the above-mentioned implementations.
  • the present disclosure provides a non-transitory computer readable storage medium, which stores computer readable instructions for causing the computer to execute the method according to any one of the above-mentioned implementations.
  • FIG. 19 shows a schematic structural diagram of a computer system 600 applicable to perform the method of the present disclosure. Through the system shown in FIG. 19, the corresponding functions of the processor and storage medium can be realized.
  • the computer system 600 includes a processor 601, which can perform various appropriate actions and processes according to a program stored in the memory 602 or a program loaded into the memory 602 from a storage section 608. In the memory 602, various programs and data required for the operation of the system 600 are also stored.
  • the processor 601 and the memory 602 are connected to each other via a bus 604.
  • An input/output (I/O) interface 605 is also connected to the bus 604.
  • the following components are connected to the I/O interface 605: an input section 606 including a keyboard, a mouse, or the like; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker, or the like; a storage section 608 including a hard disk, or the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like.
  • the communication section 609 performs communication processing via a network such as the Internet.
  • the driver 610 is also connected to the I/O interface 605 as required.
  • a removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is installed on the drive 610 as required, so that the computer program read from it is installed into the storage section 608 as required.
  • the above method process can be implemented as a computer software program.
  • the implementations of the present disclosure include a computer program product, which includes a computer program tangibly embodied on a machine-readable medium, and the computer program includes program code for executing the above method.
  • the computer program can be downloaded and installed from the network through the communication section 609, and/or installed from the removable medium 611.
  • each block in the flowchart or block diagram can represent a module, program segment, or part of a code
  • the module, program segment, or part of the code contains one or more executable instructions for realizing the specified logic function.
  • the functions marked in the block can also take place in a different order from the order marked in the drawings. For example, two blocks shown in succession can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved.
  • each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or it can be implemented by a combination of dedicated hardware and computer instructions.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Analysis (AREA)

Abstract

La présente divulgation concerne le domaine de la technologie de la vision artificielle, et en particulier un procédé, un appareil, un dispositif et un support d'enregistrement pour détecter un élément de jeu. Le procédé de détection d'un élément de jeu comprend les étapes consistant : à détecter, sur la base d'un flux vidéo acquis d'un jeu dans une zone de jeu, des premières informations de position d'un élément de jeu à l'intérieur de la zone de jeu et des secondes informations de position d'un objet d'opération pour l'élément de jeu ; à déterminer, en réponse à la détermination du fait qu'une relation de position entre l'élément de jeu et l'objet d'opération est passée d'un chevauchement réciproque à une séparation réciproque sur la base des premières informations de position et des secondes informations de position, que l'élément de jeu est dans un état d'opération terminée. Le procédé de détection de la présente divulgation peut réduire l'interférence du mouvement ou le fait que l'élément de jeu soit protégé lors de la reconnaissance, ce qui est bénéfique pour l'amélioration de la précision de la ou des tâches de reconnaissance ultérieures.
PCT/IB2021/058727 2021-09-13 2021-09-24 Procédés, appareils, dispositifs, systèmes et supports d'enregistrement pour détecter des éléments de jeu WO2023037157A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202180002748.3A CN114008673A (zh) 2021-09-13 2021-09-24 游戏标识物的检测方法、装置、设备、系统及存储介质
AU2021240274A AU2021240274A1 (en) 2021-09-13 2021-09-24 Methods, apparatuses, devices, systems and storage media for detecting game items

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
SG10202110070U 2021-09-13
SG10202110070U 2021-09-13

Publications (1)

Publication Number Publication Date
WO2023037157A1 true WO2023037157A1 (fr) 2023-03-16

Family

ID=85507427

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2021/058727 WO2023037157A1 (fr) 2021-09-13 2021-09-24 Procédés, appareils, dispositifs, systèmes et supports d'enregistrement pour détecter des éléments de jeu

Country Status (1)

Country Link
WO (1) WO2023037157A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018227294A1 (fr) * 2017-06-14 2018-12-20 Arb Labs Inc. Systèmes, procédés et dispositifs de surveillance de tables de jeu
US20200211326A1 (en) * 2015-09-14 2020-07-02 Angel Playing Cards Co., Ltd. Card-centered abnormality detection system using camera and shoe
US20210201478A1 (en) * 2019-12-30 2021-07-01 Sensetime International Pte. Ltd. Image processing methods, electronic devices, and storage media
SG10201913152SA (en) * 2019-12-24 2021-07-29 Sensetime Int Pte Ltd Method And Apparatus For Detecting Dealing Sequence, Storage Medium And Electronic Device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200211326A1 (en) * 2015-09-14 2020-07-02 Angel Playing Cards Co., Ltd. Card-centered abnormality detection system using camera and shoe
WO2018227294A1 (fr) * 2017-06-14 2018-12-20 Arb Labs Inc. Systèmes, procédés et dispositifs de surveillance de tables de jeu
SG10201913152SA (en) * 2019-12-24 2021-07-29 Sensetime Int Pte Ltd Method And Apparatus For Detecting Dealing Sequence, Storage Medium And Electronic Device
US20210201478A1 (en) * 2019-12-30 2021-07-01 Sensetime International Pte. Ltd. Image processing methods, electronic devices, and storage media

Similar Documents

Publication Publication Date Title
CN111145214A (zh) 目标跟踪方法、装置、终端设备及介质
JP7416782B2 (ja) 画像処理方法、電子機器、記憶媒体及びコンピュータプログラム
US20210319250A1 (en) Matching method and apparatus, electronic device, computer-readable storage medium, and computer program
US20230326256A1 (en) Identity recognition method, computer apparatus, non-transitory computer-readable storage medium
CN111553234A (zh) 融合人脸特征与Re-ID特征排序的行人跟踪方法及装置
WO2023273344A1 (fr) Procédé et appareil de reconnaissance de traversée de ligne de véhicule, dispositif électronique et support de stockage
AU2021240274A1 (en) Methods, apparatuses, devices, systems and storage media for detecting game items
AU2021204586A1 (en) Methods, apparatuses, devices and storage media for switching states of tabletop games
CN112489450B (zh) 交通路口处的车辆流量控制方法、路侧设备及云控平台
CN111986229A (zh) 视频目标检测方法、装置及计算机系统
KR20220169466A (ko) 게임 상태들을 제어하기 위한 방법들 및 장치들
WO2023037157A1 (fr) Procédés, appareils, dispositifs, systèmes et supports d'enregistrement pour détecter des éléments de jeu
CN115222778A (zh) 基于光流的移动物体检测方法、装置、电子设备及介质
AU2021240276A1 (en) Methods, apparatuses, devices and storage media for switching states of card games
WO2022263903A1 (fr) Procédés et appareils pour commander des états de jeu
WO2022096953A1 (fr) Procédé et appareil d'association d'information d'objet, dispositif et support de stockage
CN113728326A (zh) 游戏监控
AU2021204562A1 (en) Object information association method and apparatus, device and storage medium
CN113420279A (zh) 一种密码输入方法及装置
CN114820409A (zh) 图像异常检测方法、装置、电子设备及存储介质
CN113508392B (zh) 异常事件的处理方法、装置、系统、设备及存储介质
JP6753223B2 (ja) 顔照合システム、遊技者管理システム、顔照合方法、及びプログラム
US20220415118A1 (en) Methods of detecting game prop operation event and devices and systems thereof
CN114727147B (zh) 视频录制方法及其装置
JP2018036894A (ja) 画像抽出装置、顔照合システム、遊技者管理システム、画像抽出方法、及びプログラム

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2022519823

Country of ref document: JP

ENP Entry into the national phase

Ref document number: 2021240274

Country of ref document: AU

Date of ref document: 20210924

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21956693

Country of ref document: EP

Kind code of ref document: A1