KR102632435B1 - Methods, devices, electronic devices and storage media for detection of object exchange behavior - Google Patents

Abstract

A method, device, electronic device, and storage medium for detecting object exchange behavior is provided, the method comprising: acquiring a video stream of a target scene; From the current image in the video stream, when it is detected that the first person has placed the object to be exchanged in the first preset area, suitability detection is performed on the type of object to be exchanged based on the current image to produce a first detection result. acquiring; and, if the first detection result is inadequate, outputting warning prompt information characterizing that the object type to be exchanged is in error.

Description

Methods, devices, electronic devices and storage media for detection of object exchange behavior

Cross-reference to related applications

This invention claims priority of the Singapore patent application with application number 10202106719W filed with the Intellectual Property Office of Singapore on June 21, 2021, the entire contents of which are incorporated herein by reference.

The present invention relates to the field of computer vision technology, and in particular to methods, devices, electronic devices and storage media for detecting object exchange behavior.

Currently, in some specific scenes where item exchange is required, the corresponding exchange procedures and rules are generally established, and the person in charge of the exchange must exchange according to the exchange procedures and rules.

However, people may exchange incorrectly during the exchange process due to subjective reasons such as misunderstanding, tension, fatigue, etc., causing the exchange to fail, so the exchange must be re-exchanged.

Embodiments of the present invention seek to provide a method, device, electronic device, and storage medium for detecting object exchange behavior.

The technical solutions of the embodiments of the present invention are implemented as follows.

Embodiments of the present invention include:

Obtaining a video stream of a target scene;

From the current image in the video stream, when it is detected that the first person has placed the object to be exchanged in the first preset area, suitability detection is performed on the type of the object to be exchanged based on the current image and the first Obtaining a detection result; and

If the first detection result is inadequate, outputting warning prompt information characterizing that the object type to be exchanged is in error.

In some embodiments, the step of performing suitability detection for the type of object to be exchanged based on the current image to obtain a first detection result includes:

acquiring character information of a second person associated with the object to be exchanged and preset exchangeable type information corresponding to the target scene;

If the type of the object to be exchanged matches the object type corresponding to the person information and the preset exchangeable type information, determining that the first detection result is appropriate; and/or

When the type of the object to be exchanged does not match the object type corresponding to the person information or the preset exchangeable type information, determining that the first detection result is inappropriate.

In some embodiments,

Before obtaining a first detection result by performing suitability detection for the type of object to be exchanged based on the current image, a preset take operation of the first person for at least one frame image of the video stream and sequentially detecting the object to be exchanged in the first preset area, wherein the preset take operation includes taking the object to be exchanged from a preset object placement area. and

The method further includes determining, as the current image, at least one frame image in which a preset take motion of the first person is detected and the object to be exchanged appears in the first preset area.

In some embodiments,

From the current image, after it is detected that the first person places the object to be exchanged in the first preset area, based on the video stream, the first person places the target exchange object in the second preset area. Continuing to acquire the first image placed in - the target exchange object is an object for exchanging the object to be exchanged -;

When the first image is acquired, performing suitability detection on the type of the target exchange object based on the first image to obtain a second detection result; and

If the second detection result is inadequate, the method further includes outputting warning prompt information characterizing that the target exchange object type is in error.

In some embodiments, the step of performing suitability detection for the type of the target exchange object based on the first image to obtain a second detection result includes,

Obtaining preset type configuration information;

When it is determined that the type of the object to be exchanged matches the type of the target exchange object according to the preset type configuration information, determining that the second detection result is appropriate; and/or

When it is determined that the type of the object to be exchanged and the type of the target exchange object do not match according to the preset type configuration information, determining that the second detection result is inappropriate.

In some embodiments, the step of performing suitability detection for the type of the target exchange object based on the first image to obtain a second detection result includes,

acquiring character information of a second person associated with the object to be exchanged and preset exchangeable type information corresponding to the target scene;

If the type of the target exchange object matches the object type corresponding to the person information and the preset exchangeable type information, determining that the second detection result is appropriate; and/or

If the type of the target exchange object does not match the object type corresponding to the person information or the preset exchangeable type information, determining that the second detection result is inappropriate.

In some embodiments,

Before performing suitability detection on the type of the target exchange object to obtain a second detection result, a first preset arrangement of the first person for at least one frame image after the current image in the video stream an operation and sequentially detecting the target exchange object in the second preset area, wherein the first preset placement operation includes an operation of placing the target exchange object in the second preset area; and

The method further includes determining at least one frame image in which the first preset arrangement motion of the first person is detected and the target exchange object appears in the second preset area as the first image.

In some embodiments,

After acquiring the first image, continuing to obtain a second image of the first person pushing the target exchange object from the second preset area based on the video stream;

When the second image is acquired, detecting values of the target exchange object and the object to be exchanged based on the first image and the current image, respectively; and

If the value of the target exchange object and the object to be exchanged are not equal, outputting warning prompt information characterizing that the target exchange object value is in error.

In some embodiments,

Before detecting the value of the target exchange object and the object to be exchanged based on the first image and the current image, for at least one frame image after the first image in the video stream, the first A second preset arrangement operation of a person and sequentially detecting the target exchange object in a preset object arrangement area other than the second preset area, wherein the second preset arrangement operation includes a target exchange object in the preset object arrangement area. Contains operations for placing exchange objects - ; and

The method further includes determining at least one frame image in which the second preset arrangement motion of the first person is detected and the target exchange object appears in the second preset area as the second image.

In some embodiments,

After acquiring the second image, continuing to acquire a third image that does not include the object to be exchanged in the first preset area based on the video stream; and

If the period during which the third image was not acquired reaches a preset period, the method further includes outputting warning prompt information characterizing that the object to be exchanged has not been recovered.

In some embodiments,

Obtaining person information of a second person associated with the object to be exchanged; and

When the second image is acquired, the method further includes disassociating the object to be exchanged from the person information and associating the target exchange object with the person information.

In some embodiments, the target scene includes a gaming table scene; The object to be exchanged includes a game coin, and the first preset area and the second preset area include a preset operation area of the first person on the game table.

Embodiments of the present invention include:

An acquisition module that acquires a video stream of the target scene;

From the current image in the video stream, when it is detected that the first person has placed the object to be exchanged in the first preset area, suitability detection is performed on the type of the object to be exchanged based on the current image and the first a detection module that obtains a detection result; and

and a warning module that outputs warning prompt information characterizing that the object type to be exchanged is in error when the first detection result is inadequate.

In some embodiments, the detection module specifically acquires character information of a second person associated with the object to be exchanged and preset exchangeable type information corresponding to the target scene; If the type of the object to be exchanged matches the object type corresponding to the person information and the preset exchangeable type information, determining that the first detection result is appropriate; And/or, when the type of the object to be exchanged does not match the object type corresponding to the person information or the preset exchangeable type information, the first detection result is determined to be inappropriate.

The detection module also performs suitability detection on the type of object to be exchanged based on the current image, and before obtaining a first detection result, for at least one frame image of the video stream, the first sequentially detecting a preset take operation of a person and the object to be exchanged in the first preset area, wherein the preset take operation includes taking the object to be exchanged from a preset object arrangement area; At least one frame image in which a preset take motion of the first person is detected and the object to be exchanged appears in the first preset area is determined as the current image.

In some embodiments, the detection module may also be configured to detect, from the current image, that the first person has placed the object to be exchanged in the first preset area, based on the video stream. , the first person continues to obtain a first image in which a target exchange object is placed in a second preset area, wherein the target exchange object is an object for exchanging the object to be exchanged; When the first image is acquired, compatibility detection is performed on the type of the target exchange object based on the first image to obtain a second detection result;

The warning module also outputs warning prompt information characterizing that the target exchange object type is in error when the second detection result is inadequate.

In some embodiments, the detection module specifically acquires preset type configuration information; If it is determined that the type of the object to be exchanged matches the type of the target exchange object according to the preset type configuration information, determining that the second detection result is appropriate; And/or, when it is determined that the type of the object to be exchanged and the type of the target exchange object do not match according to the preset type configuration information, the second detection result is determined to be inappropriate.

In some embodiments, the detection module specifically acquires character information of a second person associated with the object to be exchanged and preset exchangeable type information corresponding to the target scene; If the type of the target exchange object matches the object type corresponding to the person information and the preset exchangeable type information, determining that the second detection result is appropriate; And/or, when the type of the target exchange object does not match the object type corresponding to the person information or the preset exchangeable type information, the second detection result is determined to be inappropriate.

In some embodiments, the detection module further performs conformance detection on the type of the target exchange object to obtain a second detection result, for at least one frame image after the current image in the video stream. , sequentially detecting a first preset placement operation of the first person and the target exchange object in the second preset area, wherein the first preset placement operation is performed on the target exchange object in the second preset area. Including the operation of placing; The first preset arrangement motion of the first person is detected, and at least one frame image in which the target exchange object appears in the second preset area is determined as the first image.

In some embodiments, the detection module may also, after acquiring the first image, generate a second image in which the first person pushes the target exchange object out of the second preset area, based on the video stream. continue to acquire; When the second image is acquired, the values of the target exchange object and the object to be exchanged are respectively detected based on the first image and the current image;

The warning module also outputs warning prompt information characterizing that the target exchange object value is in error if the values of the target exchange object and the object to be exchanged are not equal.

In some embodiments, the detection module may also be configured to detect values of the target exchange object and the object to be exchanged based on the first image and the current image, respectively, after the first image in the video stream. For at least one frame image, sequentially detecting a second preset arrangement operation of the first person and the target exchange object in a preset object arrangement area other than the second preset area, wherein the second preset The placement operation includes placing a target exchange object in the preset object placement area; The second preset arrangement motion of the first person is detected, and at least one frame image in which the target exchange object appears in the second preset area is determined as the second image.

In some embodiments, after acquiring the second image, the detection module continues to obtain a third image that does not include the object to be exchanged in the first preset area, based on the video stream; ;

The warning module also outputs warning prompt information characterizing that the object to be exchanged has not been recovered when the period during which the detection module fails to acquire the third image reaches a preset period.

In some embodiments, the detection module further acquires person information of a second person associated with the object to be exchanged; When the second image is acquired, the association between the object to be exchanged and the person information is released, and the target exchange object is associated with the person information.

In some embodiments, the target scene includes a gaming table scene; The object to be exchanged includes a game coin, and the first preset area and the second preset area include a preset operation area of the first person on the game table.

Embodiments of the present invention provide an electronic device including a processor, memory, and communication bus; here,

the communication bus implements connectivity and communication between the processor and the memory;

The processor executes one or more programs stored in the memory to implement the method for detecting the object exchange behavior.

An embodiment of the present invention provides a computer-readable storage medium, wherein one or more programs are stored in the computer-readable storage medium, and the one or more programs are executable by one or more processors, Implement a method for detecting the object exchange behavior.

The present invention provides a method, device, electronic device and storage medium for detecting object exchange behavior, the method comprising: acquiring a video stream of a target scene; From the current image in the video stream, when it is detected that the first person has placed the object to be exchanged in the first preset area, suitability detection is performed on the type of object to be exchanged based on the current image to produce a first detection result. acquiring; If the first detection result is inadequate, outputting warning prompt information characterizing that the object type to be exchanged is in error. The technical solution provided by the embodiment of the present invention detects the suitability of the type of object to be exchanged in the scene in the process of determining exchange performance, and if it is unsuitable, immediately outputs notification information to correct the error operation in the scene. By doing so, the accuracy of object exchange is improved.

Figure 1 is a flow diagram 1 of a method for detecting object exchange behavior provided by an embodiment of the present invention.
Figure 2 is a flow diagram 2 of a method for detecting object exchange behavior provided by an embodiment of the present invention.
Figure 3 is a flow diagram 3 of a method for detecting object exchange behavior provided by an embodiment of the present invention.
Figure 4 is a flow diagram 4 of a method for detecting object exchange behavior provided by an embodiment of the present invention.
Figure 5 is a schematic diagram of the detection flow of an exemplary object exchange process provided by an embodiment of the present invention.
Figure 6 is a structural schematic diagram of a device for detecting object exchange behavior provided by an embodiment of the present invention.
Figure 7 is a structural schematic diagram of an electronic device provided in an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS Below, the technical solutions in the embodiments of the present invention are clearly and completely explained with reference to the accompanying drawings of the embodiments of the present invention.

An embodiment of the present invention provides a method for detecting object exchange behavior, and the performing entity is a detection device for object exchange behavior, for example, the method for detecting object exchange behavior is performed by a terminal device or a server or other electronic device. However, here, terminal devices include user equipment (UE), mobile devices, user terminals, cellular phones, wireless phones, personal digital assistants (PDAs), handheld devices, computing devices, automotive devices, and wearable devices. It may be, etc. In some possible implementations, the method for detecting object exchange behavior may be implemented by invoking computer-readable instructions stored in memory via a processor.

Figure 1 is a flow diagram 1 of a method for detecting object exchange behavior provided by an embodiment of the present invention. As shown in Figure 1, in an embodiment of the present invention, the method for detecting object exchange behavior mainly includes the following steps.

In step S101, the video stream of the target scene is acquired.

In an embodiment of the present invention, the detection device may acquire a video stream of the target scene.

It should be noted that, in embodiments of the present invention, the target scene may be any scene that needs to implement exchanging an object for another object. For example, it could be a specific gaming table scene. Embodiments of the present invention are not limited to specific target scenes.

It should be noted that, in embodiments of the present invention, the detection device may include a camera module, and the detection device may be disposed around the target scene to collect images of the target scene. In addition, image collection of the target scene may also involve collecting a video stream of the target scene with a separate camera placed around the target scene and transmitting it to the detection device. The method of acquiring the video stream of a specific target scene may be determined according to actual demand and device configuration, and the embodiment of the present invention is not limited.

In step S102, when it is detected from the current image in the video stream that the first person has placed the object to be exchanged in the first preset area, suitability detection is performed on the type of object to be exchanged based on the current image to determine the first 1 Obtain the detection result.

In an embodiment of the present invention, when it is detected from the current image in the video stream that the first person has placed the object to be exchanged in the first preset area, the detection device determines the type of object to be exchanged based on the current image. Conformance detection is performed to obtain a first detection result.

It should be noted that, in the embodiment of the present invention, the target scene may be a game table scene, and in the game table scene, the types of game coins that different types of game players need to use are different, so game coin exchange must be performed; , where the game coin to be exchanged provided by the player can be used as an object to be exchanged, the person who provides the game coin exchange service to the player can be used as the first person, and the first preset area is on the game table. It includes a preset operation area of the first person. The specific first person, object to be exchanged, and first preset area may be determined according to the actual target scene, and the embodiment of the present invention is not limited.

Specifically, in an embodiment of the present invention, the step of obtaining a first detection result by the detection device performing suitability detection for the type of object to be exchanged based on the current image includes the person of the second person associated with the object to be exchanged. Obtaining information and preset exchangeable type information corresponding to the target scene; If the type of the object to be exchanged matches the object type corresponding to the person information and the preset exchangeable type information, determining that the first detection result is appropriate; And/or, if the type of the object to be exchanged does not match the object type corresponding to the person information or the preset exchangeable type information, determining that the first detection result is inappropriate.

What can be understood is that, in an embodiment of the present invention, for a person providing an object to be exchanged, that is, a second person associated with the object to be exchanged, the detection device may obtain person information of the second person, and the person information may include information such as whether the person is a member, and the embodiment of the present invention is not limited to the specific second person and the person information of the second person. The type of object to be exchanged may or may not match the object type corresponding to the person information, and the object type corresponding to the person information characterizes the type of object to be exchanged that the second person is allowed to use. For example, if the person information includes that the second person is a member, and the corresponding object type is an object type that can only be exchanged by members, if the type of object to be exchanged is an object type provided for use only by members, The type of object to be exchanged matches the object type corresponding to the person information.

It should be explained that, in the embodiment of the present invention, the second person and the person information of the second person associated with the object to be exchanged may be stored in advance in the detection device, and of course the detection device may be obtained from another management device. . In addition, if the person information of the second person is not stored in the detection device local or other management devices, the second person may be directly selected by the first person and the person information may be input to the detection device. The embodiment of the present invention is not limited to the method of acquiring specific person information.

What can be understood is that in the embodiment of the present invention, for the target scene, the interchangeable object types are limited, and the detection device can directly obtain the preset interchangeable type information corresponding to the target scene, which is Included in interchangeable object types. The type of object to be exchanged cannot necessarily be exchanged in the target scene, and therefore the type of the object to be exchanged must be matched with the preset exchangeable type information.

It should be noted that in the embodiments of the present invention, the type of object to be exchanged must match the object type corresponding to the person information and the preset exchangeable type information at the same time, so that the first detection result is suitable, otherwise the first detection result The results are inadequate.

What should be explained is that, in an embodiment of the present invention, before the detection device performs suitability detection for the type of object to be exchanged based on the current image and obtains the first detection result, the following steps may be performed: You can. For at least one frame image in the video stream, sequentially detect a preset take motion of a first person and an object to be exchanged in a first preset area, wherein the preset take motion is an object to be exchanged from a preset object placement area. Including the action of taking; At least one frame image in which the preset take motion of the first person is detected and the object to be exchanged in the first preset area appears is determined as the current image.

Understandably, in an embodiment of the present invention, the detection device must first determine the current image from the video stream of the target scene before performing suitability detection for the type of object to be exchanged based on the current image. The detection device sequentially detects the preset take motion of the first person for at least one frame image in the video stream, and specifically, detects the motion of the first person based on continuous multi-frame images. It can be implemented by continuously detecting the location of the object to be exchanged and whether the person whose hand is manipulating the object to be exchanged is the first person through a video stream. The specific current image may be a single frame image or a multi-frame image, but the embodiment of the present invention is not limited.

In step S103, if the first detection result is inadequate, warning prompt information characterizing that the object type to be exchanged is in error is output.

In an embodiment of the present invention, after obtaining the first detection result, the detection device outputs warning prompt information characterizing that the object type to be exchanged is in error if the first detection result is inadequate.

What can be understood is that, in an embodiment of the present invention, if the first detection result is inappropriate, that is, if the type of object to be exchanged is inappropriate, exchange is not possible in the target scene, and therefore the detection device determines that the object type to be exchanged is an error. Characterizing warning prompt information can be output immediately, allowing the first person who places the object to be exchanged in the first preset area to immediately know the situation in which exchange is not possible, and return the object to be exchanged to the associated second person. This improves the accuracy of object exchange.

Figure 2 is a flow diagram 2 of a method for detecting object exchange behavior provided by an embodiment of the present invention. As shown in FIG. 2, in an embodiment of the present invention, the detection device may further perform the following steps after performing step S101.

In step S201, after it is detected from the current image that the first person has placed the object to be exchanged in the first preset area, based on the video stream, the first person places the target exchange object in the second preset area. Continue to acquire the first image; The target exchange object is an object for exchanging the object to be exchanged.

In an embodiment of the present invention, when it is detected from the current image that the object to be exchanged by the first person is placed in the first preset area, the detection device exchanges the object to be exchanged by the first person based on the video stream. The first image for placing the target exchange object in the second preset area may be continuously acquired.

It should be explained that, in the embodiment of the present invention, the target scene includes a game table scene, the second preset area includes a preset operation area of the first person on the game table, and the specific second preset area The embodiments of the present invention are not limited.

Specifically, in an embodiment of the present invention, the detection device sequentially detects the first preset arrangement motion of the first person and the target exchange object in the second preset area for at least one frame image after the current image in the video stream. , wherein the first preset placement operation includes the operation of placing the target exchange object in the second preset area; The first preset arrangement motion of the first person is detected, and at least one frame image of the target exchange object appearing in the second preset area is determined as the first image.

What can be understood is that, in an embodiment of the present invention, the current image is an image in which the object to be exchanged by the first person is placed in the first preset area in the video stream, and then the first person actually exchanges the object to be exchanged. Since the target exchange object must be placed in the second preset area, the detection device performs the first preset arrangement operation and the second preset operation of the first person for at least one frame image after the current image in the video stream. Target exchange objects in the area are sequentially detected. The detection device sequentially detects the first preset arrangement motion of the first person for at least one frame image after the current image in the video stream, and specifically, the motion of the first person based on the consecutive multi-frame images. It can be implemented by detecting, and can also be implemented by continuously detecting the location of the target exchange object and whether the person whose hand is manipulating the target exchange object is the first person through a video stream. The specific first image may be a single frame image or a multi-frame image, but the embodiment of the present invention is not limited.

In step S202, when the first image is acquired, suitability detection is performed on the type of the target exchange object based on the first image to obtain a second detection result.

In an embodiment of the present invention, when the detection device acquires the first image, that is, when the target exchange object is already placed in the second preset area, the detection device performs suitability detection for the type of the target exchange object based on the first image. Thus, a second detection result can be obtained.

Specifically, in an embodiment of the present invention, the step of the detection device performing suitability detection on the target exchange object based on the first image to obtain a second detection result includes: acquiring preset type configuration information; When it is determined that the type of the object to be exchanged matches the type of the target exchange object according to the preset type configuration information, determining that the second detection result is appropriate; and/or determining that the second detection result is inappropriate when it is determined that the type of the object to be exchanged and the type of the target exchange object do not match according to the preset type configuration information.

It should be noted that, in the embodiment of the present invention, the preset type configuration information is an object type that can be exchanged with objects of different set types. Specific preset type configuration information can be set according to actual demand and application scenes, and the embodiment of the present invention is not limited.

Illustratively, in an embodiment of the present invention, the preset type configuration information indicates that exchange objects matching objects of type A are objects of type B and C, and exchange objects matching objects of type B are types A and It is an object of type D. If the type of the object to be exchanged is A and the type of the target exchange object is D, in the preset type configuration information, the object of type A and the object of type D do not match, so the detection device determines that the second detection result is inappropriate. You can decide. If the type of the object to be exchanged is A and the type of the target exchange object is B, in the preset type configuration information, the object of type A and the object of type B do not match, so the detection device determines that the second detection result is appropriate. You can decide.

What should be explained is that, in the embodiment of the present invention, the detection device can not only perform conformity detection on the type of the target exchange object to detect whether it matches the type of the object to be exchanged, but also set rules for different types. Detection may also be based on, and the embodiments of the present invention are not limited.

Specifically, in an embodiment of the present invention, the step of the detection device performing suitability detection for the type of the target exchange object based on the first image to obtain a second detection result includes identifying the second person associated with the object to be exchanged. Obtaining preset exchangeable type information corresponding to person information and target scene; If the type of the target exchange object matches the object type corresponding to the person information and the preset exchangeable type information, determining that the second detection result is appropriate; And/or, if the type of the target exchange object does not match the object type corresponding to the person information or the preset exchangeable type information, it may further include determining that the second detection result is inappropriate.

Understandably, in embodiments of the present invention, the detection device may obtain person information of the second person, and the person information may include information such as whether the person is a member. The type of the target exchange object may be matched with the object type corresponding to the person information. For example, if the person information is a member of the second person, only the member can exchange an object of the target exchange object type, that is, the target Allows the exchange object to be exchanged with a second person. Of course, the type of the target exchange object may not match the object type corresponding to the person information. For example, if the person information is a second person and is a non-member, only members can exchange objects of the target exchange object type. That is, it does not allow the target exchange object to be exchanged with a second person.

What can be understood is that in the embodiment of the present invention, for the target scene, the interchangeable object types are limited, and the detection device can directly obtain the preset interchangeable type information corresponding to the target scene, which is Included in interchangeable object types. The type of the target exchange object cannot necessarily be exchanged in the target scene, so the type of the target exchange object must be matched with the preset exchangeable type information.

In step S203, if the second detection result is inadequate, warning prompt information characterizing that the target exchange object type is in error is output.

In an embodiment of the present invention, after obtaining the second detection result, the detection device may output route prompt information characterizing that the target exchange object type is in error if the second detection result is inadequate.

What can be understood is that, in an embodiment of the present invention, if the second detection result is inappropriate, that is, if the type of the target exchange object is inappropriate, exchange is not possible in the target scene, and therefore the detection device detects that the type of the target exchange object is an error. Warning prompt information characterizing the object can be immediately output, allowing the first person to immediately know the non-exchangeable situation of the target exchange object, and retrieve the target exchange object to improve the accuracy of object exchange.

Figure 3 is a flow diagram 3 of a method for detecting object exchange behavior provided by an embodiment of the present invention. As shown in Figure 3, in the embodiment of the present invention, after performing step S201, the detection device may also perform the following steps.

In step S301, after acquiring the first image, a second image of the first person pushing the target exchange object from the second preset area is continuously acquired based on the video stream.

In an embodiment of the present invention, after acquiring the first image, the detection device may continue to acquire a second image of the first person pushing the target exchange object from the second preset area based on the video stream. .

Specifically, in an embodiment of the present invention, the detection device detects a second preset arrangement motion of the first person and a preset object other than the second preset area for at least one frame image after the first image in the video stream. sequentially detecting the target exchange object in the placement area, wherein the second preset placement operation includes the operation of placing the target exchange object in the preset object placement area; The second preset arrangement motion of the first person is detected, and at least one frame image in which the target exchange object appears in the second preset area is determined as the second image.

It can be understood that, in an embodiment of the present invention, the detection device sequentially detects the first preset arrangement motion of the first person for at least one frame image after the current image in the video stream, specifically, sequentially. It can be implemented by detecting the motion of the first person based on a multi-frame image, and also detects the location of the target exchange object and whether the person whose hand is manipulating the target exchange object is the first person through a video stream. It can be implemented using continuous detection. The specific second image may be a single frame image or a multi-frame image, but the embodiment of the present invention is not limited.

In step S302, when the second image is acquired, the values of the target exchange object and the object to be exchanged are respectively detected based on the first image and the current image.

In an embodiment of the present invention, when the detection device acquires the second image, that is, when the first person pushes the target exchange object out of the second preset area, the detection device exchanges the target exchange object with the selected target exchange object because the first person has already been identified. The object to be exchanged may be characterized to be exchanged, and the detection device further detects the value of the target exchange object and the object to be exchanged based on the first image and the current image, respectively.

What can be understood is that, in an embodiment of the present invention, the target exchange object is for exchanging the object to be exchanged, and the exchange principle is that the value of the two being exchanged is equal, but the target exchange object selected by the first person in error is characterized by Since the value of the exchange is not the same as the value of the object to be exchanged, the detection device must additionally detect the value of both.

In step S303, if the values of the target exchange object and the object to be exchanged are not the same, warning prompt information characterizing that the target exchange object value is in error is output.

In an embodiment of the present invention, after the detection device detects the values of the target exchange object and the object to be exchanged, respectively, if the values of the target exchange object and the object to be exchanged are not the same, characterizing that the value of the object to be exchanged is an error. Prints warning prompt information.

Understandably, in an embodiment of the present invention, if the values of the target exchange object and the object to be exchanged are not the same, they cannot be exchanged in the target scene, so the detection device issues a warning prompt characterizing that the object to be exchanged value is in error. Information can be output immediately, informing the first person to adjust the number of target exchange objects so that their value is equal to the value of the object to be exchanged, implementing object exchange and improving the accuracy of object exchange.

Figure 4 is a flow diagram 4 of a method for detecting object exchange behavior provided by an embodiment of the present invention. As shown in Figure 4, in the embodiment of the present invention, after performing step S301, the detection device may also perform the following steps.

In step S401, after acquiring the second image, a third image that does not include the object to be exchanged in the first preset area is continuously acquired based on the video stream.

In an embodiment of the present invention, after acquiring the second image, the detection device may continue to acquire a third image that does not include the object to be exchanged in the first preset area based on the video stream.

It can be understood that, in an embodiment of the present invention, the detection device sequentially detects whether an object to be exchanged is included in the first preset area for at least one frame image after the second image in the video stream, At least one frame image in which it is detected that no object to be exchanged is included in the first preset area may be determined as the third image.

In step S402, when the period during which the third image is not acquired reaches a preset period, warning prompt information characterizing that the object to be exchanged has not been recovered is output.

In an embodiment of the present invention, when the period during which the third image is not acquired reaches a preset period, the detection device outputs warning prompt information characterizing that the object to be exchanged has not been recovered.

It should be noted that, in the embodiments of the present invention, a preset period is stored in the detection device, and the specific preset period can be set according to actual demand and application scenes, and the embodiments of the present invention are not limited.

What can be understood is that, in an embodiment of the present invention, the detection device starts acquiring the third image and counting after the value of the target exchange object and the object to be exchanged are equal, and if the third image is not continuously acquired within the preset period, In other words, if the object to be exchanged continues to be in the first preset area, that is, the first person may forget to retrieve the object to be exchanged after exchanging the target exchange object, therefore, the detection device may Warning prompt information characterizing that the object has not been retrieved may be output, and the first person, after viewing the warning prompt information, may immediately retrieve the object to be exchanged.

It should be noted that, in an embodiment of the present invention, the detection device may also perform the following steps after the exchange is completed. That is, obtaining person information of a second person associated with the object to be exchanged; When the second image is acquired, the association between the object to be exchanged and the person information is released, and the target exchange object is associated with the person information.

Understandably, in an embodiment of the present invention, after the exchange is completed, the object actually owned by the second person has already changed, so the detection device releases the association between the object to be exchanged and the person information of the second person. Add the correlation between the target exchange object and the person information of the second person, and in this way, in the subsequent target exchange object application process, easily track it and obtain the related information of the person associated with it, and perform corresponding processing for use. Ensures accuracy. In addition, objects to be exchanged can also be provided to other people for use, improving object utilization.

Figure 5 is a schematic diagram of the detection flow of an exemplary object exchange process provided by an embodiment of the present invention. As shown in FIG. 5, in an embodiment of the present invention, when a second person associated with an object to be exchanged wants to exchange the object to be exchanged, the detection device places the object to be exchanged by the first person in the first preset area. A current image to be placed may be acquired, and then a first image may be acquired for arranging a target exchange object for exchanging an object to be exchanged by the first person in a second preset area, and the object to be exchanged and the target exchanged may be acquired. It detects whether the object type is suitable, and if it is inappropriate, corresponding warning prompt information is output, and the first person can adjust it. If appropriate, obtain a second image of the first person pushing the target exchange object out of the second preset area, detect again whether the values of the object to be exchanged and the target exchange object match, and issue a corresponding warning if they do not match. Prints prompt information.

It should be explained that, in the embodiment of the present invention, the detection device detects whether the type of the object to be exchanged and the target exchange object are suitable, and then, if not, outputs corresponding warning prompt information, and if suitable, also First, the person information of the object to be exchanged, the target exchange object, and the second person may be transmitted to another management device and stored in the other management device.

Embodiments of the present invention include obtaining a video stream of a target scene; From the current image in the video stream, when it is detected that the first person has placed the object to be exchanged in the first preset area, suitability detection is performed on the type of object to be exchanged based on the current image to produce a first detection result. acquiring; Provided is a method for detecting object exchange behavior, including outputting warning prompt information characterizing that the object type to be exchanged is in error when the first detection result is inadequate. The method for detecting object exchange behavior provided in an embodiment of the present invention detects whether the type of object to be exchanged in a scene is appropriate in the process of determining exchange performance, and if unsuitable, provides notification information to correct an error operation in the scene. By immediately outputting, the accuracy of object exchange is improved.

Embodiments of the present invention provide a device for detecting object exchange behavior. Figure 6 is a structural schematic diagram of a device for detecting object exchange behavior provided by an embodiment of the present invention. As shown in Figure 6, the detection device,

An acquisition module 601 that acquires a video stream of the target scene;

From the current image in the video stream, when it is detected that the first person has placed the object to be exchanged in the first preset area, suitability detection is performed on the type of the object to be exchanged based on the current image to perform first detection. a detection module 602 that obtains a result; and

and a warning module 603 that, when the first detection result is inadequate, outputs warning prompt information characterizing that the object type to be exchanged is an error.

In one embodiment of the present invention, the detection module 602 specifically acquires character information of a second person associated with the object to be exchanged and preset exchangeable type information corresponding to the target scene; If the type of the object to be exchanged matches the object type corresponding to the person information and the preset exchangeable type information, determining that the first detection result is appropriate; And/or, when the type of the object to be exchanged does not match the object type corresponding to the person information or the preset exchangeable type information, the first detection result is determined to be inappropriate.

In one embodiment of the present invention, the detection module 602 also performs suitability detection for the type of the object to be exchanged based on the current image to obtain a first detection result, among the video streams. For at least one frame image, sequentially detecting a preset take operation of the first person and the object to be exchanged in the first preset area, wherein the preset take operation is the exchange from a preset object placement area. Includes the action of taking an object to be done; At least one frame image in which a preset take motion of the first person is detected and the object to be exchanged appears in the first preset area is determined as the current image.

In one embodiment of the present invention, the detection module 602 is further configured to: After the detection module detects from the current image that the first person has placed the object to be exchanged in the first preset area, Based on the video stream, the first person continues to obtain a first image in which a target exchange object is placed in a second preset area, wherein the target exchange object is an object for exchanging the object to be exchanged; When the first image is acquired, compatibility detection is performed on the type of the target exchange object based on the first image to obtain a second detection result;

The warning module 603 also outputs warning prompt information characterizing that the target exchange object type is in error when the second detection result is inadequate.

In one embodiment of the present invention, the detection module 602 specifically acquires preset type configuration information; If it is determined that the type of the object to be exchanged matches the type of the target exchange object according to the preset type configuration information, determining that the second detection result is appropriate; And/or, when it is determined that the type of the object to be exchanged and the type of the target exchange object do not match according to the preset type configuration information, the second detection result is determined to be inappropriate.

In one embodiment of the present invention, the detection module 602 specifically acquires character information of a second person associated with the object to be exchanged and preset exchangeable type information corresponding to the target scene; If the type of the target exchange object matches the object type corresponding to the person information and the preset exchangeable type information, determining that the second detection result is appropriate; And/or, when the type of the target exchange object does not match the object type corresponding to the person information or the preset exchangeable type information, the second detection result is determined to be inappropriate.

In one embodiment of the present invention, the detection module 602 may also perform conformance detection on the type of the target exchange object to obtain a second detection result, at least after the current image in the video stream. For one frame image, sequentially detecting a first preset arrangement operation of the first person and the target exchange object in the second preset area, wherein the first preset arrangement operation is the second preset operation. and placing the target exchange object in an area; The first preset arrangement motion of the first person is detected, and at least one frame image in which the target exchange object appears in the second preset area is determined as the first image.

In one embodiment of the present invention, after acquiring the first image, the detection module 602 further determines, based on the video stream, that the first person detects the target exchange object in the second preset area. Continue acquiring a second image of pushing; When the second image is acquired, the values of the target exchange object and the object to be exchanged are respectively detected based on the first image and the current image;

The warning module 603 also outputs warning prompt information characterizing that the target exchange object value is in error when the values of the target exchange object and the object to be exchanged are not equal.

In one embodiment of the present invention, the detection module 602 may also be used in the video stream before detecting the value of the target exchange object and the object to be exchanged based on the first image and the current image, respectively. For at least one frame image after the first image, sequentially detecting a second preset arrangement motion of the first person and the target exchange object in a preset object arrangement area other than the second preset area, Here, the second preset placement operation includes placing a target exchange object in the preset object placement area; The second preset arrangement motion of the first person is detected, and at least one frame image in which the target exchange object appears in the second preset area is determined as the second image.

In one embodiment of the present invention, after acquiring the second image, the detection module 602 may also detect a third image that does not include the object to be exchanged in the first preset area, based on the video stream. Continue acquiring images;

The warning module 603 also provides warning prompt information characterizing that the object to be exchanged has not been recovered when the period during which the detection module 602 fails to acquire the third image reaches a preset period. Print out.

In one embodiment of the present invention, the detection module 602 further acquires person information of a second person associated with the object to be exchanged; When the second image is acquired, the association between the object to be exchanged and the person information is released, and the target exchange object is associated with the person information.

In some embodiments, the target scene includes a gaming table scene; The object to be exchanged includes a game coin, and the first preset area and the second preset area include a preset operation area of the first person on the game table.

Embodiments of the present invention provide electronic devices. Figure 7 is a structural schematic diagram of an electronic device provided in an embodiment of the present invention. As shown in Figure 7, the electronic device includes a processor 701, a memory 702, and a communication bus 703; here,

The communication bus 703 implements connection and communication between the processor 701 and the memory 702;

The processor 701 executes one or more programs stored in the memory 702 to implement the detection method of the object exchange behavior.

An embodiment of the present invention further provides a computer-readable storage medium, wherein one or more programs are stored in the computer-readable storage medium, and the one or more programs are executable by one or more processors. Implement a method for detecting the object exchange behavior. Computer-readable storage media include volatile memory such as random-access memory (RAM); or non-volatile memory, such as Read-Only Memory (ROM), flash memory, Hard Disk Drive (HDD), or Solid-State Drive (SSD). It can be volatile memory); It may be a variety of devices including one or any combination of the above memories, such as a mobile phone, computer, tablet device, or personal digital assistant.

Those skilled in the art will appreciate that embodiments of the invention may be provided as a method, system, or computer program product. Accordingly, the present invention can be used in the form of a hardware embodiment, a software embodiment, or an embodiment combining hardware and software aspects. The present invention may also be used in the form of a computer program product running on a computer-executable storage medium (including, but not limited to, diskette memory and optical memory) containing one or more computer-executable program codes.

The present invention has been described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. Each flow and/or block in the flowchart and/or block diagram and a combination of flows and/or blocks in the flowchart and/or block diagram may be implemented by computer program instructions. Providing these computer program instructions to processors of general-purpose computers, special-purpose computers, embedded processors, and other programmable signal processing devices to create a machine, with instructions to be executed by the processor of a computer or other programmable signal processing device, as shown in the flowchart. A device that implements a function specified by one flow or multiple flows and/or one block or multiple blocks of a block diagram can be created.

Such computer program instructions are stored in a computer-readable memory capable of guiding a computer or other programmable signal processing device to execute in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device; The command device enables implementation of functions specified by one flow or multiple flows of the flowchart and/or one block or multiple blocks of the block diagram.

These computer program instructions may be mounted on a computer or other programmable signal processing device to cause the computer or other programmable signal processing device to perform a series of operational steps to produce a computer-implementable process that can be executed by the computer or other programmable signal processing device. The command provides steps for implementing a function specified by one flow or multiple flows of the flowchart and/or one block or multiple blocks of the block diagram.

The above description is only a preferred embodiment of the present invention and is not intended to limit the scope of protection of the present invention.

Claims (21)

A method for detecting object exchange behavior, comprising:
The method is:
Obtaining a video stream of a target scene;
From the current image in the video stream, when it is detected that the first person has placed the object to be exchanged in the first preset area, suitability detection is performed on the type of the object to be exchanged based on the current image and the first Obtaining a detection result, wherein the first person is a person providing an exchange service; and
If the first detection result is inadequate, outputting warning prompt information characterizing that the object type to be exchanged is in error,
The step of obtaining a first detection result by performing suitability detection for the type of object to be exchanged based on the current image,
Obtaining character information of a second person associated with the object to be exchanged and preset exchangeable type information corresponding to the target scene, wherein the second person is a person who owns the object to be exchanged;
If the type of the object to be exchanged matches the object type corresponding to the person information and the preset exchangeable type information, determining that the first detection result is suitable - the object type corresponding to the person information is Is the type of object to be exchanged that allows the second person to use - ; and
Object exchange behavior comprising determining that the first detection result is inappropriate when the type of the object to be exchanged does not match the object type corresponding to the person information or the preset exchangeable type information. Detection method. delete According to paragraph 1,
The above method is,
Before obtaining a first detection result by performing suitability detection for the type of object to be exchanged based on the current image, a preset take operation of the first person for at least one frame image of the video stream and sequentially detecting the object to be exchanged in the first preset area, wherein the preset take operation includes taking the object to be exchanged from a preset object placement area. and
Object exchange behavior, characterized in that it further comprises the step of determining at least one frame image in which the preset take motion of the first person is detected and the object to be exchanged appears in the first preset area as the current image. Detection method. According to paragraph 1,
The above method is,
From the current image, after it is detected that the first person places the object to be exchanged in the first preset area, based on the video stream, the first person places the target exchange object in the second preset area. Continuing to acquire the first image placed in - the target exchange object is an object for exchanging the object to be exchanged -;
When the first image is acquired, performing suitability detection on the type of the target exchange object based on the first image to obtain a second detection result; and
If the second detection result is inadequate, outputting warning prompt information characterizing that the target exchange object type is in error. According to paragraph 4,
The step of performing suitability detection for the type of the target exchange object based on the first image to obtain a second detection result,
Obtaining preset type configuration information;
When it is determined that the type of the object to be exchanged matches the type of the target exchange object according to the preset type configuration information, determining that the second detection result is appropriate; and
If it is determined that the type of the object to be exchanged and the type of the target exchange object do not match according to the preset type configuration information, determining that the second detection result is inappropriate; A method for detecting object exchange behavior, comprising at least one of the following. According to clause 4,
The step of performing suitability detection for the type of the target exchange object based on the first image to obtain a second detection result,
acquiring character information of a second person associated with the object to be exchanged and preset exchangeable type information corresponding to the target scene;
If the type of the target exchange object matches the object type corresponding to the person information and the preset exchangeable type information, determining that the second detection result is appropriate; and
Object exchange behavior comprising determining that the second detection result is inappropriate when the type of the target exchange object does not match the object type corresponding to the person information or the preset exchangeable type information. Detection method. According to paragraph 4,
The above method is,
Before performing suitability detection on the type of the target exchange object to obtain a second detection result, a first preset arrangement of the first person for at least one frame image after the current image in the video stream an operation and sequentially detecting the target exchange object in the second preset area, wherein the first preset placement operation includes an operation of placing the target exchange object in the second preset area; and
The method further includes determining at least one frame image in which the first preset arrangement motion of the first person is detected and the target exchange object appears in the second preset area as the first image. Method for detecting object exchange behavior. According to clause 4,
The method is:
After acquiring the first image, continuing to obtain a second image of the first person pushing the target exchange object from the second preset area based on the video stream;
When the second image is acquired, detecting values of the target exchange object and the object to be exchanged based on the first image and the current image, respectively; and
If the value of the target exchange object and the object to be exchanged are not equal, outputting warning prompt information characterizing that the target exchange object value is in error. According to clause 8,
The above method is,
Before detecting the value of the target exchange object and the object to be exchanged based on the first image and the current image, for at least one frame image after the first image in the video stream, the first A second preset arrangement operation of a person and sequentially detecting the target exchange object in a preset object arrangement area other than the second preset area, wherein the second preset arrangement operation includes a target exchange object in the preset object arrangement area. Contains operations for placing exchange objects - ; and
Characterized by further comprising determining at least one frame image in which the second preset arrangement motion of the first person is detected and the target exchange object appears in the second preset area as the second image. Method for detecting object exchange behavior. According to clause 8,
The method is:
After acquiring the second image, continuing to acquire a third image that does not include the object to be exchanged in the first preset area based on the video stream; and
Detecting object exchange behavior, further comprising outputting warning prompt information characterizing that the object to be exchanged has not been retrieved when the period during which the third image is not acquired reaches a preset period. method. According to clause 8,
The above method is,
Obtaining person information of a second person associated with the object to be exchanged; and
When the second image is acquired, the method further comprises disassociating the object to be exchanged from the person information and associating the target exchange object with the person information. According to clause 8,
The target scene includes a gaming table scene; Detection of object exchange behavior, wherein the object to be exchanged includes a game coin, and the first preset area and the second preset area include a preset operation area of the first person on the game table. method. A detection device for object exchange behavior, comprising:
An acquisition module that acquires a video stream of the target scene;
From the current image in the video stream, when it is detected that the first person has placed the object to be exchanged in the first preset area, suitability detection is performed on the type of the object to be exchanged based on the current image and the first a detection module that obtains a detection result, wherein the first person is a person providing an exchange service; and
a warning module that outputs warning prompt information characterizing that the object type to be exchanged is an error when the first detection result is inadequate;
The detection module also acquires person information of a second person associated with the object to be exchanged and preset exchangeable type information corresponding to the target scene, where the second person is a person who owns the object to be exchanged; If the type of the object to be exchanged matches the object type corresponding to the person information and the preset exchangeable type information, the first detection result is determined to be suitable, and the object type corresponding to the person information is the first 2 is the type of object to be exchanged that the person is allowed to use; and, if the type of the object to be exchanged does not match the object type corresponding to the person information or the preset exchangeable type information, determine that the first detection result is inappropriate. Detection device. As an electronic device,
includes a processor, memory, and communication bus;
the communication bus implements connectivity and communication between the processor and the memory;
The processor executes one or more programs stored in the memory to implement the method for detecting object exchange behavior according to claim 1. A computer-readable storage medium, comprising:
One or more programs are stored in the computer-readable storage medium, and the one or more programs are executable by one or more processors to implement the method for detecting object exchange behavior according to claim 1. A computer-readable storage medium. A computer program stored in memory,
A computer program that, when executed by a processor, implements the method for detecting object exchange behavior according to claim 1. delete delete delete delete delete