JP7455855B2 - Detection method, device, electronic device and storage medium of target exchange act - Google Patents

Description

(Cross reference to related applications)
This application claims priority from the Singapore patent application with application number 10202106719W filed with the Intellectual Property Office of Singapore on 21 June 2021, the entire contents of which are incorporated herein by reference. It will be done.

TECHNICAL FIELD The present application relates to the field of computer vision technology, and in particular to a method, apparatus, electronic device, and storage medium for detecting object exchange behavior.

Currently, in some specific scenes that require the exchange of goods, corresponding exchange processes and rules are generally provided. Those who exchange must conduct the exchange in accordance with the exchange process and rules.

However, due to subjective factors such as human misunderstanding, tension, and fatigue, there is a possibility that an exchange error may occur during the exchange process, causing an exchange failure and requiring re-exchange.

Embodiments of the present application preferably provide a method, apparatus, electronic device, and storage medium for detecting an object exchange activity.

The technical solution of the embodiment of the present application is realized as follows.

Embodiments of the present application provide a method for detecting object exchange activity. The method includes:
Obtaining a video stream of the target scene;
If it is detected from the current image in the video stream that the first person has placed the object to be exchanged in the first predetermined area, validity detection is performed for the type of the object to be exchanged based on the current image. , obtaining a first detection result;
If the first detection result is invalid, the method includes outputting warning alert information indicating that the type of the object to be exchanged is incorrect.

In some embodiments, performing validity detection for the type of object to be exchanged based on the current image and obtaining a first detection result comprises:
acquiring person information of a second person associated with the exchange waiting object and predetermined exchangeable type information corresponding to the target scene;
If the type of the object waiting for exchange matches the object type corresponding to the person information and the predetermined exchangeable type information, determining that the first detection result is valid; and/or
The method includes determining that the first detection result is invalid if the type of the object waiting for exchange does not match the object type corresponding to the person information or the predetermined exchangeable type information.

In some embodiments,
Performing validity detection on the type of the object to be exchanged based on the current image, and performing validity detection on at least one frame of the image of the first person in the video stream before obtaining a first detection result. a taking-out operation and sequentially detecting the object waiting for exchange in the first predetermined area, the predetermined taking-out operation including an operation of taking out the object waiting for exchange from a predetermined object storage area;
The method further includes determining, as the current image, at least one frame image in which a predetermined take-out motion of the first person is detected and the exchange waiting object appears in the first predetermined area.

In some embodiments,
After detecting from the current image that the first person has placed the exchange target object in the first predetermined area, the first person places the exchange target object in the second predetermined area based on the video stream. continuing to acquire the placed first image, and the exchange target object is an object for exchanging the exchange waiting object;
When the first image is acquired, performing validity detection on the type of exchange target object based on the first image and obtaining a second detection result;
The method further includes, if the second detection result is invalid, outputting warning alert information indicating that the type of the replacement target object is incorrect.

In some embodiments, performing a validity detection for the exchange target object type based on the first image and obtaining a second detection result comprises:
obtaining predetermined type configuration information;
If it is determined that the type of the exchange waiting object matches the type of the exchange target object based on the predetermined type configuration information, determining that the second detection result is valid; and/or
The method includes determining that the second detection result is invalid when it is determined that the type of the exchange waiting object does not match the type of the exchange target object based on the predetermined type configuration information.

In some embodiments, performing a validity detection for the exchange target object type based on the first image and obtaining a second detection result comprises:
acquiring person information of a second person associated with the exchange waiting object and predetermined exchangeable type information corresponding to the target scene;
If the type of the exchange target object matches the object type corresponding to the person information and the predetermined exchangeable type information, determining that the second detection result is valid; and/or
The method includes determining that the second detection result is invalid if the type of the exchange target object does not match the object type corresponding to the person information or the predetermined exchangeable type information.

In some embodiments,
performing a validity detection on the exchange target object type and obtaining a second detection result, for at least one frame of images after the current image in the video stream, a first image of the first person; a predetermined placing operation and sequentially detecting the exchange target object in the second predetermined area, the first predetermined placing operation including an operation of placing the exchange target object in the second predetermined area;
The method further includes determining, as the first image, at least one frame image in which the first predetermined positioning motion of the first person is detected and the exchange target object appears in the second predetermined area.

In some embodiments,
After acquiring the first image, subsequently acquiring a second image of the first person pushing the replacement target out of the second predetermined area based on the video stream;
When the second image is acquired, detecting the value of the exchange target object and the value of the exchange waiting object, respectively, based on the first image and the current image;
The method further includes outputting warning alert information indicating that the value of the exchange target object is incorrect if the value of the exchange target object is not equal to the value of the exchange waiting object.

In some embodiments,
for at least one frame of images after the first image in the video stream, before detecting the value of the exchange target object and the value of the exchange waiting object, respectively, based on the first image and the current image. and sequentially detecting a second predetermined placing action of the first person and the replacement target object in a predetermined object placing area outside the second predetermined area, wherein the second predetermined placing action including an act of placing an exchange target object in the region;
The method further includes determining, as the second image, at least one frame image in which the second predetermined placement motion of the first person is detected and the replacement target object appears in the predetermined object placement area.

In some embodiments,
After acquiring the second image, continuing to acquire a third image in which the exchange waiting target is not included in the first predetermined area based on the video stream;
The method further includes outputting warning alert information indicating that the object to be exchanged has not been collected when the length of time during which the third image has not been acquired reaches a predetermined length of time.

In some embodiments,
acquiring personal information of a second person associated with the exchange waiting target;
When the second image is acquired, the method further includes: canceling the association between the exchange waiting object and the personal information, and associating the exchange target object with the personal information.

In some embodiments, the target scene includes a game table scene, the object to be exchanged includes a token, and the first predetermined area and the second predetermined area include a token of the first person at the game table. Contains a predetermined operation area.

Embodiments of the present application provide an apparatus for detecting object exchange activity. The device includes:
an acquisition module configured to acquire a video stream of a target scene;
If it is detected from the current image in the video stream that the first person has placed the object to be exchanged in the first predetermined area, validity detection is performed for the type of the object to be exchanged based on the current image. , a detection module configured to obtain a first detection result;
A warning module configured to output warning alert information indicating that the type of the object to be replaced is incorrect if the first detection result is invalid.

In some embodiments, the detection module specifically obtains person information of a second person associated with the object to be exchanged and predetermined exchangeable type information corresponding to the target scene, and determines the type of the object to be exchanged. matches the object type corresponding to the person information and the predetermined exchangeable type information, it is determined that the first detection result is valid, and/or the type of the object waiting for exchange corresponds to the person information. The first detection result is determined to be invalid if the first detection result does not match the target type or the predetermined exchangeable type information.

The detection module further performs validity detection on the type of the object to be exchanged based on the current image, and before obtaining the first detection result, on at least one frame of image in the video stream. Detecting a predetermined take-out operation of the first person and the object waiting for exchange in the first predetermined area in order, the predetermined take-out operation including an operation of taking out the object waiting for exchange from a predetermined object storage area. and determining, as the current image, at least one frame image in which a predetermined take-out action of the first person is detected and the exchange waiting object appears in the first predetermined area. .

In some embodiments, the detection module further adds to the video stream after the detection module detects from the current image that the first person has placed the object to be exchanged in the first predetermined area. based on the method, the first person continues to acquire a first image in which the exchange target object is placed in a second predetermined area, the exchange target object being an object for exchanging the exchange waiting object; and, when the first image is acquired, perform validity detection on the type of exchange target object based on the first image and obtain a second detection result. be done.

The warning module is further configured to output warning alert information indicating that the exchange target object type is incorrect if the second detection result is invalid.

In some embodiments, the detection module specifically obtains predetermined type configuration information and determines that the type of the replacement target matches the type of the replacement target based on the predetermined type configuration information. If it is determined that the second detection result is valid and/or it is determined that the type of the exchange waiting object does not match the type of the exchange target object based on the predetermined type configuration information, It is configured to determine that the second detection result is invalid.

In some embodiments, the detection module specifically obtains person information of a second person associated with the exchange target and predetermined exchangeable type information corresponding to the target scene, and determines the type of the exchange target. matches the object type corresponding to the person information and the predetermined exchangeable type information, it is determined that the second detection result is valid, and/or the type of the exchange target object corresponds to the person information. If the second detection result does not match the target type or the predetermined exchangeable type information, the second detection result is determined to be invalid.

In some embodiments, the detection module further performs validity detection on the replacement target object type and detects at least one frame after the current image in the video stream before obtaining a second detection result. sequentially detecting a first predetermined motion of the first person and the exchange target object in the second predetermined area with respect to an image of including an action of placing the replacement target object; and at least one frame of an image in which the first placing action of the first person is detected and the replacement target object appears in the second predetermined area. and determining the image as an image.

In some embodiments, the detection module further, after acquiring the first image, generates a second image of the first person pushing the replacement target object out of the second predetermined area based on the video stream. configured to detect the value of the exchange target object and the value of the exchange waiting object, respectively, based on the first image and the current image when the second image is subsequently acquired;
The warning module is further configured to output warning alert information indicating that the value of the exchange target object is incorrect if the value of the exchange target object is not equal to the value of the exchange pending object.

In some embodiments, the detection module further comprises determining the value of the exchange target object and the exchange pending object value based on the first image and the current image, respectively, in the video stream. sequentially detecting a second predetermined placement motion of the first person and the replacement target object in a predetermined object placement area outside the second predetermined area for at least one frame of images after the first image; , the second predetermined placement action includes an action of placing an exchange target object in the predetermined object placement area, and the second predetermined placement movement of the first person is detected, and the second predetermined placement movement of the first person is detected and the replacement target object is placed in the predetermined object placement area. determining as the second image at least one frame of images in which a replacement target object appears;

In some embodiments, after acquiring the second image, the detection module further continues to acquire a third image in which the first predetermined area does not include the object to be exchanged based on the video stream. configured to
The warning module is further configured to output warning alert information indicating that the object to be exchanged has not been collected when the detection module does not acquire the third image for a predetermined period of time. Ru.

In some embodiments, the detection module further obtains person information of a second person associated with the object to be exchanged, and when acquiring the second image, associates the object to be exchanged with the person information. and associate the exchange target with the personal information.

In some embodiments, the target scene includes a game table scene, the object to be exchanged includes a token, and the first predetermined area and the second predetermined area include a token of the first person at the game table. Contains a predetermined operation area.

Embodiments of the present application provide electronic devices. The electronic device includes a processor, a memory, and a communication bus,
The communication bus is configured to realize connection communication between the processor and the memory,
The processor is configured to execute one or more programs stored in the memory to implement the target exchange activity detection method.

Embodiments of the present application provide a computer readable storage medium. One or more programs are stored on the computer-readable storage medium, and the one or more programs are executed by one or more processors to implement the target exchange activity detection method.

The present application provides a method, apparatus, electronic device, and storage medium for detecting object exchange behavior. The method includes obtaining a video stream of a target scene, and when detecting from a current image in the video stream that a first person has placed an object to be exchanged in a first predetermined area, a target scene is detected based on the current image. Perform validity detection on the target type to obtain a first detection result, and if the first detection result is invalid, output warning alert information indicating that the type to be exchanged is incorrect. and, including. The technical solution provided in the embodiments of the present application, in the process of determining exchange, determines whether the type of object waiting for exchange in the scene is legal, and if it is invalid, corrects the incorrect operation in the scene. Immediately outputs information that reminds you to make corrections, improving the accuracy rate of target exchange.

2 is a first flowchart illustrating a method for detecting an object exchange action according to an embodiment of the present application. FIG. 7 is a second flowchart illustrating a method for detecting an object exchange act according to an embodiment of the present application. FIG. FIG. 7 is a third flowchart illustrating a method for detecting an object exchange act according to an embodiment of the present application; FIG. 12 is a fourth flowchart showing a method for detecting an object exchange action according to an embodiment of the present application. 3 is a flowchart illustrating an exemplary object exchange process detection according to embodiments of the present application. 1 is a schematic diagram showing the structure of an object exchange act detection device according to an embodiment of the present application; FIG. 1 is a schematic diagram showing the structure of an electronic device according to an embodiment of the present application.

Hereinafter, the technical solution in the embodiments of the present application will be clearly and completely explained with reference to the drawings in the embodiments of the present application.

Embodiments of the present application provide a method for detecting object exchange activity. The execution entity may be a detection device for the object exchange act. For example, the method for detecting an object exchange activity may be performed by a terminal device, a server, or other electronic device. Here, the terminal equipment includes user equipment (UE), mobile equipment, user terminal, cellular phone, cordless phone, personal digital assistant (PDA), handheld device, computing device, in-vehicle equipment, and wearable device. It may also be a device or the like. In some possible implementations, the method of detecting an object exchange activity may be implemented by a processor invoking computer readable instructions stored in memory.

FIG. 1 is a first flowchart illustrating a method for detecting a target exchange action according to an embodiment of the present application. As shown in FIG. 1, in the embodiment of the present application, the method for detecting target exchange behavior mainly includes the following steps.

In S101, a video stream of a target scene is obtained.

In embodiments of the present application, the detection device may acquire a video stream of the target scene.

Note that in embodiments of the present application, the target scene may be any scene in which an object needs to be replaced with another object, such as a particular game table scene. The embodiments of the present application do not limit specific target scenes.

Note that in the embodiments of the present application, the detection device may include an imaging module, and the detection device is arranged around the target scene and collects images of the target scene. Furthermore, the camera that collects images of the target scene may be an independent camera placed around the target scene. The camera collects a video stream of the target scene and transmits it to the detection device. The specific method of acquiring the video stream of the target scene may be determined according to the actual demand and device arrangement, and the embodiments of the present application are not limited thereto.

In S102, if it is detected from the current image in the video stream that the first person has placed the object to be exchanged in the first predetermined area, validity detection is performed for the type of the object to be exchanged based on the current image. , obtain a first detection result.

In an embodiment of the present application, when the detection device detects from the current image in the video stream that the first person has placed the object to be exchanged in the first predetermined area, the detection device is configured to determine the type of the object to be exchanged based on the current image. Detection of validity is performed on the data, and a first detection result is obtained.

In addition, in the embodiment of the present application, the target scene may be a game table scene, and in the game table scene, different types of game players try to use different types of tokens, so it is necessary to perform token exchange. Here, the token to be exchanged provided by the player may be the object waiting for exchange, and a person who provides a token exchange service for the player may be the first person, and the first predetermined area is the game table. includes a predetermined operation area of the first person. The specific first person, the object to be exchanged, and the first predetermined area may be determined according to the actual target scene, and the embodiments of the present application are not limited thereto.

Specifically, in the embodiment of the present application, the detection device performs validity detection on the type of the object waiting for exchange based on the current image, and obtaining the first detection result means that the detection device performs validity detection on the type of object waiting for exchange based on the current image. acquiring person information of the person and predetermined exchangeable type information corresponding to the target scene, and determining that the first detection result is valid if the type of the object waiting for exchange matches the object type corresponding to the person information and the predetermined exchangeable type information; and/or determining that the first detection result is invalid if the type of the object waiting for exchange does not match the object type corresponding to the person information or the predetermined exchangeable type information. include.

In the embodiment of the present application, the person who provides the object to be exchanged is a second person associated with the object to be exchanged, and the detection device is capable of acquiring person information of the second person, and the person information is It should be understood that the embodiments of the present application do not limit the specific second person and personal information of the second person. The type of the object waiting for exchange may or may not match the object type corresponding to the person information. The object type corresponding to the person information represents the type of the object waiting for exchange that is allowed to be used by the second person. For example, the person information includes that the second person is a member, and the corresponding target type is a target type that can only be exchanged by a member, in which case the type of target waiting for exchange is a member-only target type. Sometimes, the type of the object waiting for exchange matches the object type corresponding to the person information.

In addition, in the embodiment of the present application, the second person associated with the object to be exchanged and the personal information of the second person may be stored in advance in the detection device, and of course, the detection device may acquire them from another management device. I can do it. Further, if the second person's personal information is not stored locally in the detection device or in another management device, the first person can directly select the second person and input the personal information to the detection device. The embodiments of the present application do not limit the specific method for acquiring personal information.

In the embodiment of the present application, the types of exchangeable objects are limited in the target scene, and the detection device directly obtains the predetermined exchangeable type information corresponding to the target scene, and the information is exchangeable in the target scene. It should be understood that this includes target types. Since the type to be exchanged is not necessarily a type that can be exchanged in the target scene, it is necessary to match the type to be exchanged with predetermined exchangeable type information.

In the embodiment of the present application, if the type of the object waiting for exchange coincides with the object type corresponding to the person information and the predetermined exchangeable type information at the same time, the first detection result is valid; otherwise, the first detection result is valid. The detection result is invalid.

Note that in the embodiment of the present application, the detection device performs validity detection on the type to be exchanged based on the current image, and before obtaining the first detection result, the detection device performs validity detection on the type of the object to be exchanged based on the current image, and before obtaining the first detection result, a step of sequentially detecting a predetermined take-out operation of the first person and an object waiting for exchange in the first predetermined area, the predetermined take-out operation including an operation of taking out the object waiting for exchange from the predetermined object storage area; A step of determining at least one frame of an image in which a predetermined take-out motion of one person is detected and an object to be exchanged appears in the first predetermined area as the current image may be performed.

It is understood that in the present embodiment, the detection device first determines the current image from the video stream of the target scene, and then performs validity detection for the type of object to be exchanged based on the current image. It should be. Specifically, the detection device detecting the predetermined take-out motion of the first person based on at least one frame of images in the video stream means detecting the motion of the first person based on a plurality of consecutive frames of images. Alternatively, it may be realized by using a video stream to detect the position of the object to be exchanged and whether or not the person who operates the object to be exchanged belongs to the first person. The specific current image may be an image of one frame or an image of multiple frames, and the embodiments of the present application are not limited thereto.

In S103, if the first detection result is invalid, warning alert information indicating that the type of the object to be replaced is incorrect is output.

In the embodiment of the present application, after obtaining the first detection result, the detection device outputs warning alert information indicating that the type of the object to be replaced is incorrect if the first detection result is invalid.

It should be understood that in the embodiment of the present application, if the first detection result is invalid, the object to be exchanged is invalid and cannot be exchanged in the target scene. Therefore, the detection device can immediately output warning alert information indicating that the type of the object to be replaced is incorrect. The first person who placed the object to be exchanged in the first predetermined area immediately knows that the object cannot be exchanged, and can return the object to be exchanged to the associated second person. This improves the accuracy rate of target exchange.

FIG. 2 is a second flowchart illustrating a method for detecting an object exchange action according to an embodiment of the present application. As shown in FIG. 2, in the embodiment of the present application, the detection device may further execute the following steps after executing step S101.

In S201, after detecting from the current image that the first person has placed the exchange target object in the first predetermined area, it is determined based on the video stream that the first person has placed the exchange target object in the second predetermined area. One image is continuously acquired, and the exchange target object is an object for exchanging the exchange waiting object.

In an embodiment of the present application, the detection device detects from the current image that the first person places the object to be exchanged in the first predetermined area, and then the first person replaces the object to be exchanged based on the video stream. The first image with the exchange target object placed in the second predetermined area for the purpose of the exchange can be subsequently acquired.

In the embodiment of the present application, the target scene includes a game table scene, the second predetermined area includes a predetermined operation area of the first person on the game table, and the embodiment of the present application includes a specific second predetermined area. Not limited.

Specifically, in embodiments of the present application, the detection device detects a first predetermined positioning motion of the first person and a replacement target object in a second predetermined area for at least one frame of images after the current image in the video stream. The first predetermined placement operation includes an operation of placing the exchange target object in a second predetermined area. At least one frame image in which the first predetermined positioning motion of the first person is detected and the exchange target object appears in the second predetermined area is determined as the first image.

In an embodiment of the present application, the current image is an image in the video stream in which a first person has placed an object to be exchanged in a first predetermined area. Subsequently, the first person needs to actually place the exchange target object in the second predetermined area for exchanging the exchange waiting object. Accordingly, the detecting device detecting the first predetermined motion of the first person for at least one frame of images subsequent to the current image in the video stream may be performed based on a plurality of consecutive frames of images. This may be realized by detecting the movement of the first person, and by detecting, through a video stream, the position of the exchange target object and whether the person who operates the exchange target object belongs to the first person. You may. The specific first image may be an image of one frame or an image of multiple frames, and the embodiments of the present application are not limited to this.

In S202, when the first image is acquired, validity detection is performed for the type of exchange target object based on the first image, and a second detection result is obtained.

In an embodiment of the present application, when the detection device acquires the first image, the replacement target object is placed in the second predetermined area. Therefore, based on the first image, validity detection can be performed for the type of exchange target object, and a second detection result can be obtained.

Specifically, in the embodiment of the present application, the detection device performs validity detection on the replacement target object based on the first image and obtains the second detection result, which includes obtaining predetermined type configuration information; If it is determined that the type of the exchange waiting object matches the type of the exchange target object based on the predetermined type configuration information, determining that the second detection result is valid, and/or based on the predetermined type configuration information. , including determining that the second detection result is invalid if it is determined that the type of the exchange waiting object does not match the type of the exchange target object.

In the embodiment of the present application, the predetermined type configuration information is an object type that can be exchanged with objects of different types. The specific predetermined type configuration information may be determined according to actual needs and application scenes, and the embodiments of the present application are not limited thereto.

Illustratively, in the embodiments of the present application, the predetermined type configuration information includes that the exchange objects that match the object whose type is A are the objects whose types are B and C, and that the objects whose type is B match. The exchange objects to be exchanged are objects of types A and B. When the type of the object waiting for exchange is A and the type of the exchange target object is D, the type A object does not match the type D object in the predetermined type configuration information, so the detection device detects the second detection result. can be determined to be invalid. If the type of the target to be exchanged is A and the type of the target exchange target is B, the type A target matches the type B target in the predetermined type configuration information, so the detection device detects the second detection result. can be determined to be valid.

In addition, in the embodiment of the present application, when the detection device performs validity detection on the type of exchange target object, it is not only possible to detect whether or not it matches the type of the exchange waiting target, but also to detect whether or not it matches the type of the exchange target object. Detection can also be performed based on, and the embodiments of the present application do not limit this.

Specifically, in the embodiment of the present application, the detection device performs validity detection on the type of exchange target object based on the first image and obtains the second detection result, which means that the detection device performs validity detection on the type of exchange target object based on the first image and obtains the second detection result. acquiring the person information of the two people and predetermined exchangeable type information corresponding to the target scene, and when the type of the exchange target matches the object type corresponding to the person information and the predetermined exchangeable type information, the second detection result is obtained; determining that the second detection result is valid; and/or determining that the second detection result is invalid if the type of the exchange target object does not match the target type corresponding to the person information or the predetermined exchangeable type information; It may further include.

It should be understood that in embodiments of the present application, the detection device may obtain personal information of the second person, and the personal information may include information such as whether the person is a member. be. The type of exchange target object may match the object type corresponding to the person information. For example, the person information is that the second person is a member, and that only members can exchange objects of the exchange target type, that is, it is allowed to exchange the exchange target object with the second person. do. Of course, the type of the exchange target object may not match the object type corresponding to the personal information. For example, the person information is that the second person is a non-member, and that only members can exchange objects of the exchange target type, that is, that the exchange target object can be exchanged with the second person. Not allowed.

In the embodiment of the present application, the exchangeable object types are limited for the target scene, and the detection device can directly obtain predetermined exchangeable type information corresponding to the target scene, and add the information to the target scene. It should be understood that this includes interchangeable object types. Since the type of the exchange target object is not necessarily exchangeable in the target scene, it is necessary to match the type of the exchange target object with predetermined exchangeable type information.

In S203, if the second detection result is invalid, warning alert information indicating that the type of replacement target object is incorrect is output.

In an embodiment of the present application, after obtaining the second detection result, the detection device may output warning alert information indicating that the type of exchange target object is incorrect if the second detection result is invalid. .

It should be understood that in the present embodiment, if the second detection result is invalid, the type of exchange target object is invalid and cannot be exchanged in the target scene. Therefore, the detection device can immediately output warning alert information indicating that the type of replacement target object is incorrect. Thereby, the first person can immediately know that the exchange target object cannot be exchanged and can take back the exchange target object, improving the accuracy rate of object exchange.

FIG. 3 is a third flowchart illustrating a method for detecting a target exchange action according to an embodiment of the present application. As shown in FIG. 3, in the embodiment of the present application, the detection device may further execute the following steps after executing step S201.

In S301, after acquiring the first image, a second image of the first person pushing the replacement target out of the second predetermined area is subsequently acquired based on the video stream.

In embodiments of the present application, after acquiring the first image, the detection device may subsequently acquire a second image of the first person pushing the replacement target out of the second predetermined area based on the video stream.

Specifically, in an embodiment of the present application, the detection device detects a second predetermined movement of the first person and a predetermined object outside the second predetermined area with respect to at least one frame of images after the first image in the video stream. The exchange target objects in the placement area are sequentially detected, and the second predetermined placing operation includes an operation of placing the exchange target object in the predetermined object placement area. At least one frame image in which the second predetermined placement motion of the first person is detected and in which the exchange target object appears in the predetermined object placement area is determined as the second image.

In embodiments of the present application, the detecting device detecting the first predetermined motion of the first person for at least one frame of images subsequent to the current image in the video stream may specifically include This may be realized by detecting the movement of the first person based on the video stream, and continuously detecting the position of the replacement target object and whether the hand that manipulates the replacement target object belongs to the first person. It should be understood that this may be accomplished by detecting The specific second image may be an image of one frame or an image of multiple frames, and the embodiments of the present application are not limited to this.

In S302, when the second image is acquired, the value of the exchange target object and the value of the exchange waiting object are respectively detected based on the first image and the current image.

In an embodiment of the present application, when the detection device acquires the second image, the first person pushes the exchange target object out of the second predetermined area. In this case, the first person indicates that the first person has confirmed that the selected exchange target can exchange the exchange waiting target. The detection device further detects an exchange target object and an exchange waiting object based on the first image and the current image, respectively.

It should be understood that in the embodiments of the present application, the exchange target object is for exchanging the exchange pending object. The principle of exchange is that the two parties exchanged are of equal value. Due to a misunderstanding by the first person, the value represented by the selected exchange target object may not be equal to the value of the exchange waiting object. Therefore, the detection device needs to further detect the value of both.

In S303, if the value of the exchange target object is not equal to the value of the exchange waiting object, warning alert information indicating that the value of the exchange target object is incorrect is output.

In the embodiment of the present application, after detecting the value of the exchange target object and the value of the exchange waiting object respectively, if the value of the exchange target object is not equal to the value of the exchange waiting object, the value of the exchange waiting object is incorrectly determined. Outputs warning alert information indicating that something has happened.

In the embodiment of the present application, if the value of the exchange target object is not equal to the value of the exchange waiting object, it cannot be exchanged in the target scene, and the detection device sends a warning alert information indicating that the value of the exchange waiting object is incorrect. can be output immediately, remind the first person to adjust the number of exchange target objects, make its value equal to the exchange waiting object, realize target exchange, and improve the accuracy rate of target exchange. , should be understood.

FIG. 4 is a fourth flowchart showing a detection method according to an embodiment of the present application. As shown in FIG. 4, in the embodiment of the present application, the detection device may further execute the following steps after executing step S301.

In S401, after acquiring the second image, a third image in which the target to be exchanged is not included in the first predetermined area is subsequently acquired based on the video stream.

In an embodiment of the present application, after acquiring the second image, the detection device may subsequently acquire a third image in which the first predetermined area does not include the object to be exchanged, based on the video stream.

In an embodiment of the present application, the detection device detects whether or not the first predetermined area includes an object to be exchanged for at least one frame of images after the second image in the video stream; It should be understood that at least one frame of image in which no object to be exchanged is included within one predetermined area is determined as the third image.

In S402, when the length of time during which the third image cannot be acquired reaches a predetermined length of time, warning alert information indicating that the object to be exchanged has not been collected is output.

In the embodiment of the present application, when the length of time during which the third image cannot be acquired reaches a predetermined length of time, the detection device outputs warning alert information indicating that the object to be replaced has not been collected.

In addition, in the embodiment of the present application, the predetermined time length is stored in the detection device, and the specific predetermined time length may be determined according to the actual demand and application scene, and the embodiment of the present application stores this predetermined time length. Not limited.

In an embodiment of the present application, the detection device begins to acquire the third image when the value of the exchange target object is equal to the value of the exchange target object, and at that time, performs timing. If the third image has not been acquired for a predetermined period of time, it means that the object waiting for exchange has been located in the first predetermined area, that is, after the exchange of the exchange target object is completed, the first person It is possible that you forgot to collect the item that was waiting for exchange. Therefore, the detection device can output warning alert information indicating that the object waiting for replacement has not been collected. After confirming the warning alert information, the first person can immediately collect the object to be exchanged.

In embodiments of the present application, the detection device may further perform the following steps after the replacement is completed. Personal information of a second person associated with the exchange waiting target is acquired. When the second image is acquired, the association between the exchange waiting object and the personal information is canceled, and the exchange target object is associated with the personal information.

In the embodiment of the present application, after the exchange is completed, the object held by the second person has actually changed, so the detection device cancels the association between the object waiting for exchange and the second person's personal information, and By adding an association with the person information of the second person, it is easy to track and know the relevant information of the person associated with it in the subsequent process of applying the exchange target object, and can perform the corresponding processing. , to ensure accuracy in usage. It is also possible to provide the exchange waiting target to another person to improve the utilization rate of the target.

FIG. 5 is a flowchart illustrating an exemplary target exchange process detection according to embodiments of the present application. As shown in FIG. 5, in the embodiment of the present application, when the second person associated with the object to be exchanged needs to exchange the object to be exchanged, the detection device detects that the first person associates the object to be exchanged with a first predetermined You can get the current image placed in the area. Subsequently, a first image is obtained in which an exchange target object for exchanging the exchange waiting object is placed in a second predetermined area by the first person, and it is detected whether the types of the exchange waiting object and the exchange target object are valid. and, if it is invalid, outputs the corresponding warning alert information. Thereby, the first person can make an adjustment, and if it is valid, the first person obtains a second image in which the exchange target object is pushed out of the second predetermined area, and the value of the exchange waiting object and the exchange target object are obtained. Detect whether the values match, and if they do not match, output the corresponding warning alert information.

In the embodiment of the present application, the detection device detects whether the types of the exchange waiting object and the exchange target object are valid, and if they are invalid, output the corresponding warning alert information; if they are valid, the detection device outputs the corresponding warning alert information; It is also possible to transmit the personal information of the exchange waiting target, the exchange target target, and the second person to another management device and store it in the other management device.

Embodiments of the present application provide a method for detecting object exchange activity. The method includes obtaining a video stream of a target scene, and when detecting from a current image in the video stream that a first person has placed an object to be exchanged in a first predetermined area, a target scene is detected based on the current image. Perform validity detection on the target type to obtain a first detection result, and if the first detection result is invalid, output warning alert information indicating that the type to be exchanged is incorrect. and, including. The object exchange act detection method provided in the embodiments of the present application determines whether the type of object waiting for exchange in the scene is legitimate in the process of determining exchange, and if it is invalid, the type of object waiting for exchange in the scene is Immediately outputs information to remind you to correct the operation, improving the accuracy rate of object exchange.

Embodiments of the present application provide an apparatus for detecting object exchange activity. FIG. 6 is a schematic diagram showing the structure of a device for detecting object exchange behavior according to an embodiment of the present application. As shown in FIG. 6, the detection device is
an acquisition module 601 configured to acquire a video stream of a target scene;
If it is detected from the current image in the video stream that the first person has placed the object to be exchanged in the first predetermined area, validity detection is performed for the type of the object to be exchanged based on the current image. , a detection module 602 configured to obtain a first detection result;
A warning module 603 configured to output warning alert information indicating that the type of the object to be replaced is incorrect if the first detection result is invalid.

In one embodiment of the present application, the detection module 602 specifically obtains person information of a second person associated with the exchange waiting object and predetermined exchangeable type information corresponding to the target scene, and obtains predetermined exchangeable type information of the second person associated with the exchange waiting object. If the type matches the object type corresponding to the person information and the predetermined exchangeable type information, it is determined that the first detection result is valid, and/or the type of the object waiting for exchange matches the person information. It is configured to determine that the first detection result is invalid if it does not match the corresponding target type or the predetermined exchangeable type information.

In one embodiment of the present application, the detection module 602 further performs a validity detection on the type of subject to be exchanged based on the current image, and before obtaining the first detection result, detects at least one of the The method includes sequentially detecting a predetermined take-out operation of the first person and the object waiting for exchange in the first predetermined area with respect to an image of one frame, and the predetermined take-out operation includes detecting the object waiting for exchange from the predetermined object placement area. determining, as the current image, at least one frame image in which the predetermined take-out action of the first person is detected and the exchange waiting object appears in the first predetermined area; configured to run.

In one embodiment of the present application, the detection module 602 further comprises: after the detection module detects from the current image that the first person has placed the object to be exchanged in the first predetermined area; further acquiring a first image in which the first person places an exchange target object in a second predetermined area based on the exchange target object, wherein the exchange target object is an object for exchanging the exchange waiting object. , and when the first image is acquired, perform validity detection on the type of exchange target object based on the first image and obtain a second detection result. configured,
The warning module 603 is further configured to output warning alert information indicating that the replacement target object type is incorrect if the second detection result is invalid.

In one embodiment of the present application, the detection module 602 specifically obtains predetermined type configuration information, and determines that the type of the replacement target matches the replacement target type based on the predetermined type configuration information. If it is determined that the second detection result is valid, and/or if it is determined that the type of the exchange waiting object does not match the type of the exchange target object based on the predetermined type configuration information, The second detection result is determined to be invalid.

In one embodiment of the present application, the detection module 602 specifically obtains the person information of the second person associated with the exchange waiting object and the predetermined exchangeable type information corresponding to the target scene, and acquires the predetermined exchangeable type information corresponding to the target scene, If the type matches the object type corresponding to the person information and the predetermined exchangeable type information, it is determined that the second detection result is valid, and/or the type of the exchange target object matches the person information. The second detection result is determined to be invalid if it does not match the corresponding target type or the predetermined exchangeable type information.

In one embodiment of the present application, the detection module 602 further performs validity detection on the type of replacement target object, and at least one image after the current image in the video stream before obtaining a second detection result. sequentially detecting a first predetermined motion of the first person and the exchange target object in the second predetermined area with respect to an image of a frame, wherein the first predetermined motion is detected in the second predetermined area; including a motion of placing the replacement target object in the second predetermined region, and at least one frame of an image in which the first placing motion of the first person is detected and the replacement target object appears in the second predetermined area. and determining the image as one image.

In one embodiment of the present application, after acquiring the first image, the detection module 602 further comprises, based on the video stream, a second image of the first person pushing the replacement target object out of the second predetermined area. and when the second image is acquired, the value of the exchange target object and the value of the exchange waiting object are respectively detected based on the first image and the current image;
The warning module 603 is further configured to output warning alert information indicating that the value of the exchange target object is incorrect if the value of the exchange target object is not equal to the value of the exchange waiting object.

In one embodiment of the present application, the detection module 602 further comprises detecting the value of the exchange target object and the exchange pending object value based on the first image and the current image, respectively, in the video stream. detecting, in order, a second predetermined placement motion of the first person and the replacement target object in a predetermined object placement area outside the second predetermined area for at least one frame of images after the first image; The second predetermined placement action includes an action of placing an exchange target object in the predetermined object placement area, and the second predetermined placement movement of the first person is detected and the replacement target object is placed in the predetermined object placement area. determining as the second image at least one frame of images in which the exchange target object appears;

In one embodiment of the present application, after acquiring the second image, the detection module 602 further generates a third image in which the object to be exchanged is not included in the first predetermined area based on the video stream. configured to obtain,
The warning module 603 is further configured to output warning alert information indicating that the object to be exchanged has not been collected when the detection module 602 does not acquire the third image for a predetermined period of time. configured.

In one embodiment of the present application, the detection module 602 further acquires person information of a second person associated with the object waiting for exchange, and when acquiring the second image, the detection module 602 further acquires person information of a second person associated with the object waiting for exchange, and when the second image is acquired, the detection module 602 The exchange target object is configured to be disassociated and associated with the personal information.

In some embodiments, the target scene includes a game table scene, the object to be exchanged includes a token, and the first predetermined area and the second predetermined area include a token of the first person at the game table. Contains a predetermined operation area.

Embodiments of the present application provide electronic devices. FIG. 7 is a schematic diagram showing the structure of an electronic device according to an embodiment of the present application. As shown in FIG. 7, the electronic device includes a processor 701, a memory 702, a communication bus 703,
The communication bus 703 is configured to realize connection communication between the processor 701 and the memory 702,
The processor 701 is configured to execute one or more programs stored in the memory 702 to implement the target exchange activity detection method described above.

Embodiments of the present application further provide a computer readable storage medium. One or more programs are stored on the computer-readable storage medium, and the one or more programs are executed by one or more processors to implement the target exchange activity detection method. The computer-readable storage medium may be volatile memory, such as, for example, Random-Access Memory (RAM), or, for example, Read-Only Memory (ROM). , flash memory, hard disk drive (HDD), or solid-state drive (SSD); for example, a mobile phone. , a computer, a tablet, a personal digital assistant, etc., including one or any combination of the above memories.

Those skilled in the art should understand that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware. This application also describes a computer program product that is executed on one or more computer usable storage media (including, but not limited to, magnetic disk memory and optical memory) containing computer usable program code. The format can be used.

The present application is described with reference to flowchart illustrations and/or block diagrams of example methods, apparatus (systems), and computer program products of the present application. It should be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device, thereby producing an apparatus, such that these instructions may be executed by the processor of the computer or other programmable data processing device. The instructions herein have produced an apparatus that implements the functionality specified in one or more flows in a flowchart and/or one or more blocks in a block diagram.

These computer readable program instructions may be stored on a computer readable storage medium. These instructions cause a computer or other programmable signal processing device to operate in a particular manner. Accordingly, the instructions stored on the computer-readable storage medium produce a product that includes the instruction device. The instruction device implements the functionality specified in one or more flows in a flowchart and/or one or more blocks in a block diagram.

These computer program instructions may be loaded into a computer or other programmable signal processing device. This involves performing a sequence of operational steps on a computer or other programmable processing device to produce a computer-implemented process. Thus, instructions executed by a computer or other programmable processing device provide steps for implementing the functions specified in one or more flows in the flowcharts and/or in one or more blocks in the block diagrams. .

The above are only preferred embodiments of the present application, and do not limit the protection scope of the present application.

Claims (15)

A method for detecting an object exchange act, the method comprising:
Obtaining a video stream of the target scene;
If it is detected from the current image in the video stream that the first person has placed the object to be exchanged in the first predetermined area, validity detection is performed for the type of the object to be exchanged based on the current image. , obtaining a first detection result;
If the first detection result is invalid, outputting warning alert information indicating that the type of the object to be exchanged is incorrect ;
Performing validity detection on the type of the object to be exchanged based on the current image and obtaining a first detection result,
acquiring person information of a second person associated with the exchange waiting object and predetermined exchangeable type information corresponding to the target scene;
If the type of the object waiting for exchange matches the object type corresponding to the person information and the predetermined exchangeable type information, determining that the first detection result is valid; and/or
If the type of the object waiting for exchange does not match the object type corresponding to the person information or the predetermined exchangeable type information, the first detection result is determined to be invalid.
A method for detecting target exchange behavior. The method includes:
Performing validity detection on the type of the object to be exchanged based on the current image, and performing validity detection on at least one frame of the image of the first person in the video stream before obtaining a first detection result. a taking-out operation and sequentially detecting the object waiting for exchange in the first predetermined area, the predetermined taking-out operation including an operation of taking out the object waiting for exchange from a predetermined object storage area;
The method further comprises determining, as the current image, at least one frame image in which a predetermined take-out motion of the first person is detected and in which the exchange waiting object appears in the first predetermined area. The method described in 1 . The method includes:
After detecting from the current image that the first person has placed the exchange target object in the first predetermined area, the first person places the exchange target object in the second predetermined area based on the video stream. continuing to acquire the placed first image, and the exchange target object is an object for exchanging the exchange waiting object;
When the first image is acquired, performing validity detection on the type of exchange target object based on the first image and obtaining a second detection result;
The method according to claim 1, further comprising: if the second detection result is invalid, outputting warning alert information indicating that the type of exchange target object is incorrect. Performing validity detection for the type of exchange target object based on the first image and obtaining a second detection result,
obtaining predetermined type configuration information;
If it is determined that the type of the exchange waiting object matches the type of the exchange target object based on the predetermined type configuration information, determining that the second detection result is valid; and/or
If it is determined based on the predetermined type configuration information that the type of the exchange waiting object does not match the type of the exchange target object, determining that the second detection result is invalid. The method according to claim 3 . Performing validity detection for the type of exchange target object based on the first image and obtaining a second detection result,
acquiring person information of a second person associated with the exchange waiting object and predetermined exchangeable type information corresponding to the target scene;
If the type of the exchange target object matches the object type corresponding to the person information and the predetermined exchangeable type information, determining that the second detection result is valid; and/or
If the type of the exchange target object does not match the object type corresponding to the person information or the predetermined exchangeable type information, the second detection result is determined to be invalid.Claim. The method described in Section 3 . The method includes:
performing a validity detection on the exchange target object type and obtaining a second detection result, for at least one frame of images after the current image in the video stream, a first image of the first person; a predetermined placing operation and sequentially detecting the exchange target object in the second predetermined area, the first predetermined placing operation including an operation of placing the exchange target object in the second predetermined area;
The method further comprises determining, as the first image, at least one frame image in which the first predetermined positioning motion of the first person is detected and the exchange target object appears in the second predetermined area. The method according to claim 3 . The method includes:
After acquiring the first image, subsequently acquiring a second image of the first person pushing the replacement target out of the second predetermined area based on the video stream;
When the second image is acquired, detecting the value of the exchange target object and the value of the exchange waiting object, respectively, based on the first image and the current image;
3. The method further comprises: if the value of the exchange target object is not equal to the value of the exchange waiting object, outputting warning alert information indicating that the value of the exchange target object is incorrect. The method described in. The method includes:
for at least one frame of images after the first image in the video stream, before detecting the value of the exchange target object and the value of the exchange waiting object, respectively, based on the first image and the current image. and sequentially detecting a second predetermined placing action of the first person and the replacement target object in a predetermined object placing area outside the second predetermined area, wherein the second predetermined placing action including an act of placing an exchange target object in the region;
The method further comprises determining, as the second image, at least one frame image in which the second predetermined placement motion of the first person is detected and the replacement target object appears in the predetermined object placement area. The method according to claim 7 . The method includes:
After acquiring the second image, continuing to acquire a third image in which the exchange waiting target is not included in the first predetermined area based on the video stream;
The method further comprises: outputting warning alert information indicating that the object to be exchanged has not been collected when the length of time during which the third image has not been acquired reaches a predetermined length of time.Claim. The method described in Section 7 . The method includes:
acquiring personal information of a second person associated with the exchange waiting target;
8. When the second image is acquired, the method further comprises: canceling the association between the exchange waiting object and the personal information, and associating the exchange target object with the personal information. the method of. The target scene includes a game table scene, the object to be exchanged includes a token, and the first predetermined area and the second predetermined area include a predetermined operation area of the first person at the game table. The method according to any one of claims 7 to 10 . A device for detecting an act of object exchange,
an acquisition module configured to acquire a video stream of a target scene;
If it is detected from the current image in the video stream that the first person has placed the object to be exchanged in the first predetermined area, validity detection is performed for the type of the object to be exchanged based on the current image. , a detection module configured to obtain a first detection result;
a warning module configured to output warning alert information indicating that the type of the object to be replaced is incorrect if the first detection result is invalid ;
The detection module includes:
acquiring person information of a second person associated with the exchange waiting object and predetermined exchangeable type information corresponding to the target scene;
If the type of the object waiting for exchange matches the object type corresponding to the person information and the predetermined exchangeable type information, determining that the first detection result is valid; and/or
determining that the first detection result is invalid if the type of the object waiting for exchange does not match the object type corresponding to the person information or the predetermined exchangeable type information;
configured to do
Detection device for target exchange act. An electronic device comprising a processor, a memory, and a communication bus,
The communication bus is configured to realize connection communication between the processor and the memory,
The processor is configured to execute one or more programs stored in the memory and implement the method for detecting a target exchange act according to any one of claims 1-11 . Electronics. 11. A computer-readable storage medium, wherein one or more programs are stored on the computer-readable storage medium, and the one or more programs are executed by one or more processors. A computer-readable storage medium that implements the method for detecting an object exchange act according to any one of the items. A computer program for causing a processor to execute the method for detecting an object exchange act according to any one of claims 1 to 11 .