TW202121250A - Method and apparatus for controlling a display object, electronic device and storage medium - Google Patents

Abstract

The present disclosure provides a method and an apparatus for controlling a display object, an electronic device, and a storage medium. The method includes: an obtained video image is displayed on a display screen; when it is detected that the video image includes a target object, a display object associated with the target object is displayed on the display screen; and the display object on the display screen is controlled to change a display state based on an accumulated detection result of the target object on the display screen.

Description

Display object control method and device, electronic equipment and recording medium

The present invention relates to the field of computer technology, and in particular to a method and device for controlling display objects, electronic equipment and recording media. [Cross references to related applications]

The present invention claims the priority of the Chinese patent application filed on November 28, 2019, the application number is 201911190043.X, and the invention title is "a control method, device, equipment, and storage medium for display objects". The Chinese patent application The entire contents of the disclosure are incorporated herein by reference.

When events are held in some venues or areas, statistics are usually made on the information of the attendees. The information statistics of the attendees are often done manually by specialized staff, such as signing the sign-in form, entering identity information, etc. The operation is cumbersome and the operation process is simplistic, which is not conducive to the interaction with the attendees.

In view of this, the present invention provides at least a solution for controlling the display object.

In a first aspect, the present invention provides a method for controlling a display object, including: displaying the acquired video frame on a display screen; in the case of detecting that the video frame includes a target object, displaying the video frame on the display screen and The display object associated with the target object; based on the cumulative detection result of the target object in the movie screen, controlling the display object in the display screen to change the display state.

The above provides an automatic detection scheme for the target object, which can detect whether the target object is included in the movie screen based on the movie screen displayed on the display screen, and display the association with the target object when the target object is detected in the movie screen The display object of the display object, and based on the cumulative detection result of the target object in the movie screen, the display object is controlled to change the display state. As the target object changes state information (such as gestures, smiles, etc.), the cumulative detection result can also be changed accordingly, and the display object can be controlled to change the display state, thereby enriching the display effect and enhancing the interaction with the target object.

In a second aspect, the present invention provides a display object control device, including: a first display module for displaying the acquired video frame on a display screen; a second display module for displaying the video frame when the video frame is detected If the target object is included in the display screen, the display object associated with the target object is displayed on the display screen; the control module is configured to control the target object based on the cumulative detection result of the target object in the movie screen. The display object on the display screen changes its display state.

In a third aspect, the present invention provides an electronic device including: a processor; and a memory, wherein the memory stores computer-readable instructions executable by the processor, and the computer-readable instructions are used by the processor During execution, the processor is enabled to implement the method for controlling the display object described in the first aspect.

In a fourth aspect, the present invention provides a computer-readable recording medium having a computer program stored on the computer-readable recording medium, wherein when the computer program is run by a processor, the processor realizes the above-mentioned first aspect The control method of the display object described.

In order to make the above-mentioned objects, features and advantages of the present invention more obvious and understandable, preferred embodiments are described below in detail with accompanying drawings.

In order to make the purpose and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. The components of the embodiments of the present invention generally described and shown in the drawings herein may be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work shall fall within the protection scope of the present invention.

The terms used in the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms such as "a", "said", "the", etc. used in the present invention are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and/or" as used herein refers to and includes any one or all possible combinations of one or more associated listed items.

It should be understood that although the present invention may use the terms first, second, third, etc. to describe various information, these information should not be limited by these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present invention, the first information can also be referred to as second information, and similarly, the second information can also be referred to as first information. Depending on the context, the word "if" as used herein can be interpreted as "when" or "when" or "in response to".

First, the application scenarios applicable to the embodiments of the present invention are introduced. The present invention can be applied to electronic equipment with data processing capabilities. The electronic equipment can be equipped with a display device for displaying data processing results, or an external display device for displaying data processing results. The connection method is not limited to wired connection, and/ Or wireless connection. The electronic device may also be connected to at least one camera device, and the connection mode is not limited to wired connection and/or wireless connection. The electronic equipment and the camera device connected to it can be deployed in the same location area. After the camera device shoots the film, it is transmitted to the electronic equipment for processing. After the processing is completed, the electronic equipment can be externally connected through the display device configured by the electronic equipment or the electronic equipment. Displayed on the display device (such as a display screen). Among them, the electronic device may be, for example, a mobile phone, a tablet computer, a smart TV, a computer, and the like.

In some embodiments, the target object may be all or part of the users appearing in the movie screen, or may be users appearing in the movie screen that meet a certain set attribute, or a specific object set in advance. Different target objects can be determined according to different application scenarios.

In some embodiments, the cumulative detection result is the cumulative value of the detection results of a certain attribute of the target object or a certain posture of the target object at different times. Specific attributes or postures can be set according to different application scenarios, and the detection results are not limited to the above two cases.

In order to facilitate the understanding of the embodiments of the present invention, the method for controlling display objects provided by the present invention is first introduced in detail.

Referring to FIG. 1, a method for controlling a display object provided by an embodiment of the present invention includes steps S101 to S103.

Step S101: Display the acquired video frame on the display screen.

Wherein, the video picture displayed on the display screen may be obtained by real-time shooting by a camera device. The camera device may be a built-in camera of the electronic device or an external camera device. If the camera device is an external device of the electronic device, the camera device and the display screen can be deployed in the same location area, for example, can be deployed in the same exhibition or in the same room. Considering that the display screen shows the video images taken by the camera device, in order to make it easier for users to watch their posture (such as facial posture and/or body posture), the camera device can be placed on the same vertical plane as the display screen . Alternatively, the position where the user can capture the complete posture of the user when the user is watching the display screen can be used as the deployment position of the camera device.

Step S102: In a case where it is detected that the target object is included in the movie screen, display the display object associated with the target object on the display screen.

There can be multiple display objects associated with a target object, and different target objects can be associated with different display objects. The specifics will be described in detail in the following embodiments, and the description will not be expanded here.

Step S103, based on the cumulative detection result of the target object in the movie screen, control the display object in the display screen to change the display state.

In the embodiment of the present invention, it is possible to detect whether the target object is included in the movie screen based on the video screen displayed on the display screen, and to display the display object associated with the target object in the case where the target object is detected in the movie screen, and based on the comparison The cumulative detection results of the target object in the movie screen, and control the display object to change the display state. As the target object changes state information (such as gestures, smiles, etc.), the cumulative detection result can also be changed accordingly, and the display object can be controlled to change the display state, thereby enriching the display effect and enhancing the interaction with the target object.

The target object in step S102 may be all the objects that appear in the image capturing range, or it may be a part of the object that can obtain a complete face in the image capturing range, or it may be in the image capturing range that meets the pre-determined Set the object of attribute characteristics. Among them, the preset attribute characteristics can be, for example, gender, hair length, clothes color, and so on. If the target object is an object that meets the preset attribute characteristics, after obtaining the movie screen, the attribute characteristics of each object in the movie screen can be identified first, and then the object that meets the preset attribute characteristics is determined as the target object.

In another possible implementation manner, the target object may also be a specific object (may be one or more), where the specific object may be, for example, a person who is scheduled to participate in an exhibition. In the case that the target object is a specific object, the biological characteristics of the specific object may be stored in advance, for example, facial characteristics, gait characteristics, pedestrian re-identification (Person Re-identification, REID) characteristics, and so on. Detecting whether the target object is included in the movie frame may include: detecting the biological characteristics of each object in the movie frame, matching the detected biological characteristics with the biological characteristics of the specific object stored in advance, and determining the successfully matched object as the target object.

In a possible implementation manner, in a case where it is detected that the target object is included in the movie screen, displaying the display object associated with the target object may include one or more of the following six situations.

Case 1: When it is detected that the target object is included in the movie frame, the first display object in the initial display state may be displayed in the first display area of the display screen, where the initial display state is used to prompt the target object to make a target gesture.

Target gestures include but are not limited to postures and facial expressions, such as hand gestures, smiling expressions, etc.

Among them, the first display area of the display screen can also display the acquired video frame. When displaying the first display object in the initial display state, the key points of each target object in the video frame can be detected first, and then based on the key points The first display object in the initial display state is displayed in the first display area.

Exemplarily, FIG. 2 is a schematic diagram of the interface of the first display area. As shown in FIG. 2, the first display area displays a video screen shot by the camera. The video screen includes a plurality of target objects, and the head of each target object Special effects of flowers are displayed in this position. The displayed flower is the first display object in the initial display state. There is a prompt “smile becomes VIP” around the flower to remind the user to smile (smile is the target posture); in another example, the prompts around the flower are displayed After that, the prompt language can also be voice broadcast to give voice prompts to the target object.

In some embodiments of the present invention, it can also be applied to classroom scenes. The first display area can display the classroom screen shot by the camera immediately, and each student in the shot classroom screen is a target object. In each student's head position, there can be a palm special effect, and the palm special effect is the first display object. The palm special effect in the initial display state can be a palm with a dashed border, with a prompt "raise hand to ask questions" around the palm to remind students to raise their hands for interaction. In a possible example, after the prompt words are displayed around the palm of the hand, the displayed prompt words can also be voice-broadcasted to give voice prompts to the students.

In specific implementation, based on the cumulative detection results of the target object in the movie screen, controlling the display object in the display screen to change the display state may include: detecting the target posture made by the target object in the movie screen, and making the accumulation of the target posture based on the target object The duration or cumulative number of times controls the change of the display state of the first display object in the first display area.

In a possible implementation, the controlling the first display object in the first display area to change the display state based on the cumulative duration or cumulative number of times the target object makes the target gesture may include: When the set value is reached, the first display object is controlled to change the display state to the intermediate display state; wherein the intermediate display state changes with the cumulative value of the cumulative duration or cumulative times to indicate the cumulative value.

As shown in Figure 2, if the first display object in the initial display state is a flower special effect, when the first display object in the first display area is controlled to change the display state, the color of the flower can be changed according to the smile duration of the target user. Or light up the square in the progress bar below the flower. For example, if a square in the progress bar means a smile for 2 seconds, when the target object smiles for 10 seconds, light up 5 squares in the progress bar under the flower from bottom to top. In addition, the color of the squares can be changed according to the number of illuminated squares. For example, when only 5 squares are lighted, the color of the squares can be blue; as the number of lighted squares increases, the color of the squares can be gradually changed; when all the squares are lighted, the squares can be red.

As shown in Figure 3, in the classroom application scenario, the number of hands raised by the student (ie the target object) can be detected, and the displayed palm special effects can be changed according to the number of hands raised by the student. If the student raises their hands 4 times, they can light up the palm special effect and add the "x4" logo behind the palm special effect. If the student raises his hand for the first time, he can show only one palm special effect at the top of his head, and add the "x1" logo behind the displayed palm special effect.

In another possible implementation manner, the controlling the first display object in the first display area to change the display state based on the cumulative duration or cumulative number of the target gesture made by the target object may include: When the cumulative number of times reaches the set value, the first display object is controlled to change the display state to the target display state to indicate that the target posture made by the target object meets the set condition.

In the above-mentioned classroom application scenario, when it is detected that the number of times the student raises their hands reaches the set number of times, the first display object can include not only the palm special effects, but also the star special effects; the target display state of the first display object can be, for example, the star special effects The five stars will light up in turn to indicate that the number of times the students have raised their hands has reached the set number of times; at the same time, a sign indicating the number of times the hands have been raised is added after the palm special effect.

In case 1, by displaying the first display object in the initial display state, the target object can be prompted to make a target posture, thereby increasing the interaction with the target object, and by controlling the first display object to change the display state, it becomes the first display object Provides more ways to display.

Case 2: When it is detected that the target object is included in the movie screen, the attribute feature of the target object in the movie frame can be detected, and the second display object corresponding to the attribute feature is displayed in the first display area of the display screen.

Wherein, the second display object includes at least one of the following information: the identity of the target object, age value, smile value, charm value, viewing time, duration of different emotions, and attention duration. In different application scenarios, the type of the second display object corresponding to the attribute feature may be different, which can be specifically set according to actual conditions.

Exemplarily, when some embodiments of the present invention are applied in a classroom scene, the target object may be a student in the classroom, and the corresponding second display object may include at least one of the following information: length of class, time of interest Long, positive emotion time, negative emotion time. Among them, positive emotions can be, for example, happiness, excitement, excitement, etc., and negative emotions can be, for example, fear, sadness, etc.; class duration can be the time between when the electronic device starts to obtain the video image captured by the camera and the current moment. Long; the attention time may be the time that the camera device can capture the complete facial features of the student. In some embodiments, the length of attention can be determined in the following manner: by detecting the head position of the student in each frame of the movie picture, the offset angle between the head position of the student and the preset position (for example, a blackboard) is determined ; When the offset angle is within the preset angle range, it is determined that the student is paying attention to the blackboard at the moment; the attention duration is determined by counting the number of movie frames in which the student is paying attention to the blackboard.

In some embodiments, the duration of positive emotions and the duration of negative emotions of students can be detected in the following manner: inputting the captured video images into a pre-trained emotion recognition model to predict each student in the video images. Corresponding emotions; determine whether the emotion is a positive emotion or a negative emotion based on the predicted emotion; statistics up to the current moment, the length of the video screen where the student's emotion belongs to the positive emotion, and the student's emotion belongs to the negative emotion The duration of the video screen; the duration of the positive emotion and the duration of the negative emotion corresponding to each student are determined based on the duration of the video screen in which each emotion appears.

Some embodiments of the present invention may also be applied to public places such as exhibitions or shopping malls. In this case, the second display object may include one or more of identity, age, charm value, viewing time, expression, and smile value.

Among them, the attribute characteristics of the target object may be the biological characteristics of the target object (such as facial characteristics, gait characteristics, REID characteristics, etc.). Exemplarily, the biological characteristics of the target object in the movie screen can be extracted first, and then the extracted biological characteristics can be matched with the biological characteristics of the known identities stored in the database in advance, and the biological characteristics in the database can be matched successfully. The identity of is determined as the identity of the target object; if the matching is unsuccessful, an identity is assigned to the target object, and the identity assigned to the target object and its corresponding biological characteristics are stored in the database.

When determining the age of the target object, the video image can be input into a pre-trained neural network model to predict the age of the corresponding target object in the video image. The detection method of the target object’s charm value, expression, smile value and other attribute characteristics can be similar to the detection method of the target object’s age, which will not be repeated here, but it needs to be explained that the neural network used to predict different attribute characteristics Different models have different training processes for different neural network models.

When the attribute characteristics of the target object include multiple characteristics of age, charm value, expression, and smile value, it is also possible to predict multiple characteristics of the target user in the video screen based on the same neural network model, but it needs to be explained Yes, when training the neural network model, the labels of the supervision data need to be multiple feature labels.

The method for determining the viewing time of the target object may be the same as the method for determining the student's attention time in the classroom scene, which will not be repeated here.

Considering that the state of the target object (such as posture, facial expression, etc.) may change all the time, therefore, the attribute characteristics of the target object may also change. For example, if the target object changes facial expression, the expression, smile value, charm value, etc. of the detected target object may change.

In a possible implementation manner, in the case of detecting that the attribute characteristic of the target object changes, it is also possible to control the second display object in the first display area to change the display state according to the change of the attribute characteristic. Exemplarily, the second display object may be as shown in FIG. 4, and a display frame may be displayed around each target object. The display frame may display at least one of the identity, age, charm value, expression, viewing time, and smile value of the target object, and the display position of the display frame may be a fixed position around the target object. For example, the key points of the body of the target object can be detected, and then the display position can be determined according to the key points of the body, and then the display frame corresponding to the target object can be displayed.

In the above solution, by displaying the second display object corresponding to the attribute characteristics of the target object, personalized display of different target objects can be realized, and the display needs of different target objects can be met.

Case 3: When it is detected that the target object is included in the video screen, the check-in information of the target object may be displayed in the second display area of the display screen.

In related technologies, when it is necessary to count the information of the attendees when holding an event, it is often necessary to perform manual statistics by specialized staff, such as signing a sign-in form, entering identity information, etc., which is cumbersome and has low sign-in efficiency.

In some embodiments, the target object may be a predetermined attendee. For example, if the application scenario is a meeting, the target object is a predetermined participant.

In a possible implementation manner, the biological characteristics of the target object (such as facial characteristics, gait characteristics, REID characteristics, etc.) may be input in advance. After the movie frame is acquired, the biological characteristics of each object in the movie frame are detected, the detected biological characteristics are compared with the biological characteristics input in advance, and the target object whose comparison result is successful is determined as the target object.

The check-in information of the target object may be displayed in the second display area, and the check-in information may include, for example, the photo of the target object and/or the identity information of the target object. After detecting that the target object is included in the video screen, the display state of the sign-in information of the target object in the second display area can be changed.

In some embodiments, the check-in information may be displayed in the form of information cards in the second display area, and each information card displays the target object's photo and/or the target object's identity information. The background color of the information card can be changed when the display status of the sign-in information is changed, or the color of the information card can be gray before the display status of the sign-in information is changed, and the display state of the sign-in information can be changed by lighting the information card, etc.

In another possible implementation manner, when the display object in the first display area is controlled to change its display state, and it is detected that the changed display state is the target display state, the target displayed in the second display area may also be marked The sign-in information of the object.

Exemplarily, if the display object in the first display area is a flower special effect, there may be a prompt "Smile becomes VIP" beside the flower special effect. When the target object is detected to smile, the color of the flower special effect is controlled to change, that is, the display state of the display object is the target display state. At this time, a mark can be added to the sign-in information of the corresponding target object in the second display area, for example, a "VIP" mark can be added to the sign-in information of the target object in the second display area.

Wherein, before the display state of the check-in information of the target object is changed, the photos included in the check-in information may be pictures stored in the database in advance. When marking the check-in information, you can also capture a photo of the target object from the video screen, and replace the photo of the target object in the check-in information with the captured photo. The intercepted photos can be taken randomly, or taken from a frame of film image with the highest definition.

In a possible implementation manner, the position in the second display area is limited, and the number of target objects is multiple. In this case, the check-in information of the target object may be displayed scrolling, or, after a period of time after adding a mark to the check-in information of the target object, the check-in information of the target object may not be displayed in the second display area.

Based on the above solution, automatic sign-in of the target object can be realized, the sign-in steps are simplified, and the sign-in efficiency is improved; by marking the sign-in information of the target object, the display method of the sign-in information can be enriched, and the target object whose display state is the target display state can be distinguished , And display status are not the target audience of the target display status.

Case 4: When it is detected that the target object is included in the video screen, the description information of the target object may be displayed in the third display area of the display screen.

The description information of the target object may be the attribute information of the target object and the face image of the target object intercepted from the video screen.

In different scenarios, the attribute information of the target object can be different. For example, in a classroom scenario, the attribute information of the target object can include student ID, gender, age, number of classes, etc.; while in public places such as exhibitions and shopping malls, the attribute information of the target object Information can include identification, gender, number of visits, length of stay, etc.

The description information of the target object that can be displayed in the third display area is limited. For example, the third display area can only display the description information of N target objects. When the number of target objects included in the video screen is less than or equal to N, the third display area can display the description information of all target objects; When the number of target objects included in the screen is greater than N, for example, the movie screen includes N+1 target objects, the description information of the target object displayed first can be deleted, and the latest N+1th target object can be displayed Descriptive information of the target object that appears in the video screen, N is a positive integer.

In a possible implementation of the present application, the third display area may also only display the description information of the first M target objects appearing in the movie screen, and the description information of the target objects appearing after the Mth position in the movie screen is not displayed. , M is a positive integer, M and N can be equal or unequal. Or, display the description information of the first M target objects that meet the characteristics of a specific attribute.

In the case that the display object in the first display area is controlled to change the display state, and it is detected that the changed display state is the target display state, the description information of the target object displayed in the third display area can also be marked.

Exemplarily, after detecting that the target object is included in the movie screen, the flower special effect and the prompt “smile becomes a VIP” can be displayed in the corresponding position. After detecting the smile of the target object, you can change the color of the flower special effect (that is, the display state of the display object in the first display area becomes the target display state), and then add the description information of the target object displayed in the third display area. VIP" mark, you can also change the background color of the description information from the initial color to the target color.

In the above solution, the description information of the target object can be displayed, and after the display state of the display object is changed to the target display state, a mark is added to the description information, which enriches the display method of the description information and increases the interaction with the user.

Case 5: In the case where it is detected that the target object is included in the movie screen, the business content can be displayed in the fourth display area of the display screen.

Among them, the business content displayed in the fourth display area may be, for example, advertisements, promotional videos, or venue introduction information, etc. The form of the business content is not limited to pictures, text, audio, videos, etc.

Based on the cumulative detection results of the target object in the video screen, controlling the display state of the display object on the display screen may include: in the case of detecting that the posture of the target object in the video screen is switched from the first posture to the second posture, controlling the change The business content displayed in the fourth display area is switched from the first business content to the second business content.

Among them, the current posture of the target object is the first posture, and the preset posture is the second posture; the business content currently displayed in the fourth display area is the first business content, and the business content other than the first business content is the second Business content.

An indicator may be displayed in the fourth display area for instructing the target object to make a second gesture to switch the business content. For example, the indicator may be "please wave your hand to switch the display content". The current posture of the target object is the first posture. When it is detected that the target object makes a wave motion, that is, when it is detected that the target object is switched from the first posture to the second posture, control the display in the fourth display area. The business content is switched.

In the above solution, when a change in the posture of the target object is detected, the business content displayed in the fourth display area can be controlled to switch. In this way, the interaction with the target object is increased, and the switching method of business content is enriched.

Case 6: In the case where it is detected that the video frame includes at least one target object, the feature distribution information of the at least one target object is displayed in the fifth display area of the display screen.

Among them, the characteristic distribution information may include, but is not limited to: age distribution, gender distribution, attendance distribution, popular route distribution, regional population density distribution, etc.

Among them, when the feature distribution information includes the distribution of popular routes, the electronic device can be connected to multiple camera devices (the connection method can be wired connection or wireless connection); the moving route of each target object can be determined first, and then the moving route of each target object can be determined. Routes filter out popular routes and display them.

Wherein, as shown in FIG. 5, the method for determining the movement route of the target object may include steps S501 to S504.

Step S501: Acquire captured data of the first camera device. The captured data includes the captured face image and identification information of the first camera device.

Step S502: Obtain location description information corresponding to the identification information of the first camera device.

Step S503: Determine the movement data of the target object identified by the face image based on the position description information of the first camera device.

Step S504: Use the movement data to determine the movement route of the target object.

Specifically, the first camera device may be a camera device that currently captures the target object, and the captured data of the first camera device also includes the capture time of the face image; within a set time period before the capture time is detected In the case where the historical movement data of the target object has been obtained, the historical movement data may be updated based on the position description information of the first camera device to obtain the movement data; before the acquisition time is detected If the historical movement data of the target user is not obtained within the set time period, the position description information of the first camera device is used as the movement data. The historical movement data includes position description information of at least one second camera device, where the second camera device is a camera device that captures the face image of the target object within a set time period before the capture time.

In a possible implementation manner, the controlling the display object in the display screen to change the display state based on the cumulative detection result of the target object in the movie screen may include: based on the cumulative detection result of the at least one target object To control the update of the feature distribution information displayed in the fifth display area.

Exemplarily, if the feature distribution information includes gender distribution, and the current video screen includes 5 male target objects and 2 female target objects, the displayed feature distribution information may show that the ratio of male to female is 5:2; or the gender distribution is displayed At the same time, the display can be performed in the form of a pie chart, and the display mode is not limited in the embodiment of the present invention.

In the above manner, by displaying and updating the feature distribution information in the fifth display area, statistics and analysis of the target objects in the movie screen can be realized.

Exemplarily, in the case of detecting that the target object is included in the video screen, if the display object associated with the target object is displayed and includes the above cases 1 to 6, the distribution of each display area on the display screen can be as shown in FIG. 6 Wherein, the first display area and the fourth display area may be the same area, that is, displaying the acquired movie picture, the first display object, and the display service content are different display modes.

In the case that the first display area and the fourth display area are different areas, that is, when the video screen and business content are displayed on the display screen at the same time, the distribution of each display area on the display screen can also be exemplified as shown in FIG. 7 .

Those skilled in the art can understand that in the above-mentioned methods of the specific implementation, the writing order of the steps does not mean a strict execution order but constitutes any limitation on the implementation process. The specific execution order of each step should be based on its function and possibility. The inner logic is determined.

Based on the same concept, the embodiment of the present invention also provides a display object control device. As shown in FIG. 8, it is a schematic diagram of the structure of the display object control device provided by the embodiment of the present invention, including a first display module 801, The second display module 802 and the control module 803, specifically:

The first display module 801 is used to display the acquired video frame on the display screen;

The second display module 802 is configured to display a display object associated with the target object on the display screen when it is detected that the movie screen includes a target object;

The control module 803 is configured to control the display object in the display screen to change the display state based on the cumulative detection result of the target object in the movie screen.

In a possible implementation manner, the second display module 802 may be used to display the initial display in the first display area of the display screen in the case where it is detected that the target object is included in the movie frame. The first display object in the state; wherein the initial display state is used to prompt the target object to make a target gesture.

In a possible implementation manner, the control module 803 may be used to: detect the target pose made by the target object in the movie frame; and based on the accumulated time for the target object to make the target pose Or the cumulative number of times, controlling the first display object in the first display area to change the display state.

In a possible implementation manner, the control module 803 may be used to control the first display object to change the display state to the intermediate display state when the cumulative duration or cumulative number of times does not reach a set value; Wherein, the intermediate display state changes with the cumulative value of the cumulative duration or the cumulative number of times to indicate the cumulative value.

In a possible implementation manner, the control module 803 may be used to control the first display object to change the display state to the first target display state when the cumulative duration or cumulative number of times reaches a set value. , To indicate that the target posture made by the target object has met the set conditions.

In a possible implementation manner, the second display module 802 may be used to: detect the attribute characteristics of the target object in the movie frame; display the attribute characteristics in the first display area of the display screen The corresponding second display object.

In a possible implementation manner, the control module 803 may be used to control the second display object in the first display area to follow the change of the target attribute characteristics of the target object when it is detected that the target attribute feature of the target object changes. The change of the attribute characteristics changes the display state.

In a possible implementation manner, the second display object includes at least one of the following information: the identity of the target object, age value, smile value, charm value, viewing time, duration of different emotions, attention duration.

In a possible implementation manner, the second display module 802 may be used to display the target object in the second display area of the display screen in the case where it is detected that the target object is included in the video screen. The sign-in information of the target audience.

In a possible implementation manner, the control module 803 may be further configured to: control the display object in the first display area of the display screen to change the display state, and detect that the changed display state is the target display In the case of the status, mark the sign-in information of the target object displayed in the second display area.

In a possible implementation manner, the second display module 802 may be used to display the target object in the third display area of the display screen in the case where it is detected that the target object is included in the video screen. Descriptive information of the target audience.

In a possible implementation manner, the control module 803 may be further configured to: control the display object in the first display area of the display screen to change the display state, and detect that the changed display state is the target display In the case of the state, marking the description information of the target object displayed in the third display area is performed.

In a possible implementation manner, the second display module 802 may be used to display business content in the fourth display area of the display screen in the case of detecting that the target object is included in the movie screen .

In a possible implementation manner, the control module 803 may be configured to: in the case of detecting that the posture of the target object in the movie screen is switched from the first posture to the second posture, control the fourth posture The business content displayed in the display area is switched from the first business content to the second business content.

In a possible implementation manner, the second display module 802 may be used to display in the fifth display area of the display screen when it is detected that the movie frame includes at least one of the target objects At least one feature distribution information of the target object.

In a possible implementation manner, the control module 803 may be used to control and update the feature distribution information displayed in the fifth display area based on the cumulative detection result of at least one of the target objects.

In some embodiments, the functions or templates contained in the device provided in the embodiments of the present invention can be used to execute the methods described in the above method embodiments. For specific implementation, refer to the description of the above method embodiments. For brevity, here No longer.

Based on the same technical concept, the embodiment of the present invention also provides an electronic device. Referring to FIG. 9, the electronic device may include: a processor 901, a memory 902, and a bus 903. The memory 902 includes a memory 9021 and an external memory 9022. The memory 9021 here is also called the main memory, which is used to temporarily store the calculation data in the processor 901 and the data exchanged with an external memory 9022 such as a hard disk. The processor 901 exchanges data with the external memory 9022 through the memory 9021. When the electronic device 900 is running, the processor 901 and the memory 902 communicate through the bus 903. The memory 902 stores computer-readable instructions executable by the processor 901. When the computer-readable instructions are executed by the processor 901, the processor 901 can implement any of the above-mentioned methods for displaying movement status information.

For the specific processing performed by the processor 901, reference may be made to the description in the foregoing method embodiment, and the description is not repeated here.

In addition, an embodiment of the present invention also provides a computer-readable recording medium having a computer program stored on the computer-readable recording medium, wherein when the computer program is executed by a processor, the processor can implement any of the above Display the control method of the object.

The computer program product of the display object control method provided by the embodiment of the present invention includes a computer-readable recording medium storing a program code, and the program code includes instructions that can be used to execute the display object described in the above method embodiment For the steps of the control method, please refer to the above method embodiment for details, which will not be repeated here.

Those skilled in the art can clearly understand that, for the convenience and conciseness of the description, the specific working process of the system and device described above can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here. In the several embodiments provided by the present invention, it should be understood that the disclosed system, device, and method may be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there may be other division methods in actual implementation. For another example, multiple units or components may be combined or integrated into another system, or some features may be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some communication interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. . Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.

In addition, the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a non-transitory computer-readable recording medium executable by a processor. Based on this understanding, the embodiment of the present invention can be embodied in the form of a software product in essence or a part that contributes to the prior art or a part of the embodiment. The computer software product is stored in a recording medium and includes a number of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present invention . The aforementioned recording media include: flash drives, flash drives, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks or optical disks, etc., which can store program codes Medium.

The above are only some embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art based on the present invention shall fall within the scope of the present invention. Therefore, the scope of the present invention is determined by the claims.

S101~S103, S501~S504: steps 801: The first display module 802: The second display module 803: Control Module 900: electronic equipment 901: processor 902: memory 9021: RAM 9022: External memory 903: Bus

In order to explain the embodiments of the present invention more clearly, the following will briefly introduce the drawings that need to be used in the embodiments. The drawings here are incorporated into the specification and constitute a part of the specification. These drawings show The embodiments conforming to the present invention are presented, and together with the description are used to illustrate the embodiments of the present invention. It should be understood that the following drawings only show some embodiments of the present invention, and therefore should not be regarded as limiting the scope. For those skilled in the art, they can also Obtain other related drawings based on these drawings. Fig. 1 shows a schematic flowchart of a method for controlling a display object provided by an embodiment of the present invention. Fig. 2 shows a schematic diagram of an interface of a first display area provided by an embodiment of the present invention. FIG. 3 shows a schematic diagram of a special effect display provided by an embodiment of the present invention. FIG. 4 shows a schematic diagram of a second display object display provided by an embodiment of the present invention. Fig. 5 shows a schematic diagram of a method for determining a moving route of a target object provided by an embodiment of the present invention. FIG. 6 shows a schematic diagram of the distribution of various display areas on a display screen provided by an embodiment of the present invention. FIG. 7 shows a schematic diagram of the distribution of various display areas in another display screen provided by an embodiment of the present invention. Fig. 8 shows a schematic structural diagram of a display object control apparatus provided by an embodiment of the present invention. FIG. 9 shows a schematic structural diagram of an electronic device provided by an embodiment of the present invention.

S101~S103: steps

Claims (19)

A control method for display objects, including: Display the acquired video screen on the display screen; In a case where it is detected that the movie screen includes a target object, display the display object associated with the target object on the display screen; Based on the cumulative detection result of the target object in the movie screen, controlling the display object in the display screen to change the display state. The method according to claim 1, wherein, in a case where it is detected that the target object is included in the movie screen, displaying the display object associated with the target object on the display screen includes: In a case where it is detected that the target object is included in the movie screen, displaying the first display object in the initial display state in the first display area of the display screen, Wherein, the initial display state is used to prompt the target object to make a target gesture. The method according to claim 2, wherein, based on the cumulative detection result of the target object in the movie screen, controlling the display object in the display screen to change the display state includes: Detecting the target gesture made by the target object in the movie frame; Controlling the first display object in the first display area to change its display state based on the cumulative duration or cumulative number of times the target object makes the target gesture. The method according to claim 3, wherein the first display object in the first display area is controlled to change its display state based on the cumulative duration or cumulative number of times the target object makes the target gesture ,include: In the case that the cumulative duration or cumulative number of times has not reached the set value, controlling the first display object to change the display state to the intermediate display state, Wherein, the intermediate display state changes with the cumulative value of the cumulative duration or the cumulative number of times to indicate the cumulative value. The method according to claim 3, wherein the first display object in the first display area is controlled to change its display state based on the cumulative duration or cumulative number of times the target object makes the target gesture ,include: When the cumulative duration or cumulative number of times reaches a set value, the first display object is controlled to change the display state to the first target display state, so as to indicate that the target posture made by the target object has met the setting condition. The method according to claim 1, wherein, in a case where it is detected that the target object is included in the movie screen, displaying the display object associated with the target object on the display screen includes: In a case where it is detected that the target object is included in the movie screen, detecting the attribute characteristics of the target object in the movie screen; The second display object corresponding to the attribute feature is displayed in the first display area of the display screen. The method according to claim 6, wherein, based on a cumulative detection result of the target object in the movie screen, controlling the display object in the display screen to change the display state includes: When it is detected that the attribute characteristic of the target object changes, the second display object in the first display area is controlled to change the display state according to the change of the attribute characteristic. The method according to claim 6 or 7, wherein the second display object includes at least one of the following information: The identity, age value, smile value, charm value, viewing time length, time length of different emotions, and attention time length of the target object. The method according to claim 1, wherein, in a case where it is detected that the target object is included in the movie screen, displaying the display object associated with the target object on the display screen includes: In a case where it is detected that the target object is included in the video screen, the check-in information of the target object is displayed in the second display area of the display screen. The method according to claim 9, the method further includes: In the case that the display object in the first display area of the display screen is controlled to change its display state, and it is detected that the changed display state is the target display state, mark the target displayed in the second display area The sign-in information of the object. The method according to claim 1, wherein, in a case where it is detected that a target object is included in the movie screen, displaying the display object associated with the target object on the display screen includes: In the case where it is detected that the target object is included in the video screen, the description information of the target object is displayed in the third display area of the display screen. The method according to claim 11, the method further includes: In the case that the display object in the first display area of the display screen is controlled to change its display state, and it is detected that the changed display state is the target display state, mark the target displayed in the third display area Descriptive information of the object. The method according to claim 1, wherein, in a case where it is detected that the target object is included in the movie screen, displaying the display object associated with the target object on the display screen includes: In a case where it is detected that the target object is included in the movie screen, the business content is displayed in the fourth display area of the display screen. The method according to claim 13, wherein, based on a cumulative detection result of the target object in the movie screen, controlling the display object in the display screen to change the display state includes: In the case of detecting that the posture of the target object in the movie screen is switched from the first posture to the second posture, control to switch the business content displayed in the fourth display area from the first business content to the second posture 2. Business content. The method according to claim 1, wherein, in a case where it is detected that the target object is included in the movie screen, displaying the display object associated with the target object on the display screen includes: In a case where it is detected that the movie frame includes at least one of the target objects, the feature distribution information of at least one of the target objects is displayed in the fifth display area of the display screen. The method according to claim 15, wherein, based on a cumulative detection result of the target object in the movie screen, controlling the display object in the display screen to change the display state includes: Based on the cumulative detection result of at least one of the target objects, control to update the feature distribution information displayed in the fifth display area. A display object control device, including: The first display module is used to display the acquired video picture on the display screen; The second display module is configured to display the display object associated with the target object on the display screen when it is detected that the target object is included in the video screen; The control module is configured to control the display object in the display screen to change the display state based on the cumulative detection result of the target object in the movie screen. An electronic device including: Processor; and Memory, Wherein, the memory stores computer-readable instructions executable by the processor, and when the computer-readable instructions are executed by the processor, the processor realizes any of claims 1 to 16 The control method of the display object. A computer-readable recording medium having a computer program stored on the computer-readable recording medium, wherein when the computer program is executed by a processor, the processor realizes the display as described in any one of claim items 1 to 16 The control method of the object.

Images