KR20210075188A - Exhibit object control method, apparatus, electronic device and recording medium - Google Patents

Abstract

The present invention provides a method, an apparatus, an electronic device, and a recording medium for controlling an exhibition object. The method includes displaying the acquired video screen on a display screen; displaying a display object related to the target object on the display screen when it is detected that the target object is included in the video screen; and controlling the display object in the display screen to change a display state based on the cumulative detection result of the target object in the video screen.

Description

Exhibit object control method, apparatus, electronic device and recording medium

[Citation of cross-references to related applications]

The present invention claims priority to a Chinese patent application whose filing date is November 28, 2019, the application number is 201911(1900)43.X, and the title of the invention is "Exhibition object control method, apparatus, device and recording medium" Accordingly, all contents of the Chinese patent application are incorporated into the present application in a manner of citing.

[Technology]

The present invention relates to the field of computer technology, and more particularly, to a method, an apparatus, an electronic device, and a recording medium for controlling an exhibition object.

When an event is held in some place or area, information about attendees is generally collected. Information statistics for attendees are manually statistically performed by professional personnel such as signing a login form and inputting identification information, and the operation is cumbersome and the work process is simple, which is disadvantageous for interaction with the attendees.

In view of this, the present invention at least provides a solution of the display object control.

According to a first aspect, the present invention provides a method for controlling a display object, the method comprising: displaying an acquired video screen on a display screen; displaying a display object related to the target object on the display screen when it is detected that the target object is included in the video screen; and controlling the display object in the display screen to change a display state based on the cumulative detection result of the target object in the video screen.

As described above, the automatic detection method for the target object is provided, and based on the video screen displayed on the display screen, whether the target object is included in the video screen can be detected, and the target object is included in the video screen. When it is detected, an exhibition object related to the target object is displayed, and based on the cumulative detection result of the target object in the video screen, it is possible to control the display object to change the display state. As the target object changes the state information (eg, gesture, smile, etc.), the cumulative detection result also changes accordingly, and it is possible to further control the display object to change the display state, thereby enriching the display effect, , can improve the interaction between target objects.

According to a second aspect, the present invention provides a display object control device, comprising: a first display module for displaying an acquired video screen on a display screen; a second display module configured to display an exhibition object related to the target object on the display screen when it is detected that the target object is included in the video screen; and a control module configured to control the display object in the display screen to change a display state based on a result of the cumulative detection of the target object in the video screen.

According to a third aspect, the present invention provides an electronic device, wherein the electronic device includes a processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, the machine-readable instructions When executed by the processor, it causes the processor to realize the display object control method described in the first aspect above.

According to a fourth aspect, the present invention provides a computer readable recording medium having a computer program recorded thereon, wherein when the computer program is operated by a processor, the processor causes the display object control described in the first aspect above to make the method come true.

Hereinafter, in order to make the above objects, features and advantages of the present invention clearer and easier to understand, preferred embodiments will be described in detail with reference to the drawings.

Hereinafter, in order to more clearly describe the embodiments of the present invention, drawings necessary for the embodiments are briefly introduced. BRIEF DESCRIPTION OF THE DRAWINGS The drawings of the present specification are incorporated in and constitute a part of this specification, and are used to illustrate embodiments of the present invention and, as in this specification, to describe the embodiments of the present invention. It is to be understood that the following drawings only present specific embodiments of the present invention and are therefore not to be regarded as limiting the scope. Other relevant drawings may be obtained from these drawings without any inventive effort to those skilled in the art.
1 is a schematic diagram showing a flow of an exhibition object control method provided by an embodiment of the present invention.
2 is a schematic diagram illustrating an interface of a first display area provided by an embodiment of the present invention.
3 is a schematic diagram showing a special effect display provided by an embodiment of the present invention.
4 is a schematic diagram illustrating an exhibition of a second exhibition object provided by an embodiment of the present invention.
5 is a schematic diagram illustrating a method for determining a movement path of a target object provided by an embodiment of the present invention.
Fig. 6 is a schematic diagram showing the distribution of each display area in the display screen provided by the embodiment of the present invention.
Fig. 7 is a schematic diagram showing the distribution of each display area in another display screen provided by the embodiment of the present invention.
8 is a schematic diagram showing the configuration of a display object control device provided by an embodiment of the present invention.
9 is a schematic diagram showing the configuration of an electronic device provided by an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be clearly and completely described with reference to the drawings in order to make the objects and advantages of the embodiments of the present invention more clear. Naturally, the described embodiments are merely some and not all embodiments of the present invention. In general, the components of the embodiments of the present invention described or shown in the drawings herein may be arranged and designed in other configurations. Accordingly, the following detailed description of embodiments of the invention provided in the drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the invention. All other embodiments that can be obtained by those skilled in the art based on the embodiments of the present invention without making an inventive effort are included in the protection scope of the present invention.

The terminology used in the present invention is for the purpose of describing specific embodiments only, and is not intended to limit the present invention. As used herein, the singular forms such as "a kind", "the", "there", etc. are intended to include the plural, unless the context clearly indicates otherwise. The term "and/or" as used herein It is to be understood that one or more indicates including any one or all possible combinations of the items listed as being related.

In the present invention, various information is described using terms such as first, second, third, etc., but it should be understood that such information is not limited by these terms. These terms are only used to distinguish the same kind of information from each other. For example, the first information may be referred to as second information, and likewise second information may be referred to as first information, without departing from the scope of the present invention. As used herein, depending on the context, the word "if" means "... If”, “…if”, or “… in response to”.

First, application scenarios applicable to this solution are introduced. The present invention can be applied to an electronic device having data processing capability. The electronic device may be equipped with a display device for displaying the data processing result, and a display device for displaying the data processing result may be connected, and the connection method is not limited to a wired connection and/or a wireless connection . At least one external photographing apparatus may be further connected to the electronic device, and the connection method is not limited to a wired connection and/or a wireless connection. The photographing apparatus collects the face image, sends it to an electronic device to perform processing, and after processing by the electronic device, displays the face image using a display device mounted on the electronic device or an external display device connected to the electronic device. can Here, the electronic device may be, for example, a mobile phone, a tablet computer, a smart television, a computer, and the like, but the present invention is not limited thereto.

In some embodiments, the target object may be some or all users appearing in the video screen, or it may be a user or a preset specific object that meets certain attributes appearing in the video screen. Different target targets can be determined according to application scenarios.

In some embodiments, the cumulative detection result is a cumulative value of detection results for a certain attribute of the target object or a posture taken by the target object at different time points. A specific attribute or state may be set according to an application scenario, and the detection result is not limited to the above two situations.

In order to facilitate understanding of the embodiments of the present invention, first, a method for controlling an exhibition object provided by the present invention will be described in detail.

As shown in Fig. 1, the display object control method provided by the embodiment of the present invention includes steps S101 to S103.

In S101, the acquired video screen is displayed on a display screen.

Here, the video screen displayed on the display screen may be acquired by photographing in real time using a photographing apparatus, and the photographing apparatus may be a camera built into the electronic device or a connected external photographing apparatus. When the photographing apparatus is an external device connected to the electronic device, the photographing apparatus may be disposed in the same location area as the display screen, for example, may be disposed in the same exhibition or in the same room. Considering that what is displayed in the display screen is a video screen shot by the photographing device, in order for the user to easily see his/her own posture (for example, the posture of the face and/or the body), the photographing device may include the display screen It can be placed on a vertical plane such as Alternatively, when the user is looking at the display screen, a position at which the user can take a complete image may be used as the arrangement position of the photographing device.

In S102, when it is detected that the target object is included in the video screen, the display object related to the target object is displayed on the display screen.

There may be a plurality of exhibition objects related to the target object, and different target objects may be related to different exhibition objects, which will be described in detail in the following embodiments, which will not be described in detail herein.

In S103, control is made to change the display state of the display object in the display screen based on the cumulative detection result of the target object in the video screen.

In an embodiment of the present invention, based on the video screen displayed in the display screen, it may be detected whether the target object is included in the video screen, and when it is detected that the target object is included in the video screen, the target An exhibition object related to the object may be displayed, and based on the accumulated detection result of the target object in the video screen, it is possible to control the exhibition object to change the display state. As the target object changes state information (eg, gesture, smile, etc.), the cumulative detection result also changes accordingly, so that the display object can be controlled to change the display state, thereby enriching the display effect, , can improve the interaction between target objects.

In step 102, the target object may be all objects appearing within the image collection range, some objects capable of acquiring a complete face within the image collection range, or a predetermined attribute characteristic within the image collection range. It may be a target to be satisfied. Here, the predetermined attribute characteristic may be, for example, a gender, a length of hair, a color of clothes, and the like. If the target object satisfies the predetermined attribute characteristic, after acquiring the video screen, the attribute characteristic of each object in the video screen is recognized first, and then the object satisfying the predetermined attribute characteristic can be determined as the target object .

In another possible embodiment, the target object may be a specific object (may be one or more), wherein the specific object may be, for example, a person who is scheduled to participate in an exhibition. When the target target is a specific target, the biological characteristics of the specific target can be preserved in advance, for example, facial features, gait characteristics, and personal re-identification (REID) characteristics of the pedestrian can be preserved in advance. have. Detecting whether the target object is included in the video screen is to detect a biological characteristic of each object in the video screen, match the detected biological characteristic with the biological characteristic of a specific object preserved in advance, and determine the matching target. This includes determining the target target.

In one possible embodiment, when it is detected that the target object is included in the video screen, displaying the display object related to the target object may include one or more of the following six situations.

In Situation 1, when it is detected that the target object is included in the video screen, the first display object in the initial display state is displayed in the first display area of the display screen, wherein the target object takes the target posture in the initial display state It can be used to prompt to do so.

The target posture includes, but is not limited to, postures and expressions such as, for example, a raising hand posture, a smiling expression, and the like.

Here, the acquired video screen may also be displayed in the first display area of the display screen, and when the first exhibition object in the initial display state is displayed, the key point of each target object in the video screen is first detected, and the key point The first display object in the initial display state may be displayed in the first display area based on the position of the .

Illustratively, FIG. 2 is a schematic diagram illustrating an interface of a first display area, and as shown in FIG. 2 , a video screen captured by a photographing device is displayed in the first display area, and a plurality of targets are displayed in the video screen. The target is included, and the special effect of the flower is displayed at the position of the head of each target. The displayed flower is the first exhibition object in the initial exhibition state, and around the flower there is a prompt sentence "Smile and become a VIP", prompting the user to smile (smile is the target posture). Another example In , after displaying the prompt sentence around the flower, the voice prompt can be provided to the target object by also broadcasting the prompt sentence by voice.

Some embodiments of the present invention are also applied to a classroom scenario, in which a classroom screen captured in real time through a photographing device is displayed in the first display area, and each student in the captured classroom screen is a target target. . The special effect of the palm is displayed at the position of the head of each student, and the special effect of the palm may be the first display object. The special effect of the palm in the initial display state may be in the palm of the broken line frame. Around the palm of the hand is a prompt sentence "Raise your hand to ask a question", prompting the student to raise the hand to interact. In one possible example, after displaying the prompt sentence around the palm, the prompt is also displayed By voice broadcasting the sentence, it is possible to voice prompt to the student.

In a specific implementation, the controlling to change the display state of the display object in the display screen based on the cumulative detection result of the target object in the video screen includes detecting a target posture taken by the target object in the video screen, and The method may include controlling the first exhibition object in the first display area to change the display state based on the accumulated time or the accumulated number of times the target posture is taken.

In one possible embodiment, the controlling of the first exhibition object in the first display area to change the display state based on the accumulated time or the accumulated number of times that the target object has taken the target posture includes: the accumulated time or the accumulated number of times is predetermined may include controlling the first exhibition object to change the exhibition state to the intermediate exhibition state when the value of is not reached, wherein the intermediate exhibition state changes according to the cumulative value of the cumulative time or the cumulative number of times, so that the accumulated represents a value.

As shown in FIG. 2 , when the first display object in the initial display state is a special effect of a flower, when controlling the first display object in the first display area to change the display state, based on the duration of the target user's smile to change the color of the flower, or to light the block in the progress bar below the flower. For example, if one block in the progress bar shows a smile for 2 seconds, if the target's smile lasts 10 seconds, 5 blocks in the progress bar at the bottom of the flower can be lit from bottom to top. Also, based on the number of blocks to be lit, the color of the blocks can be changed. For example, if only 5 blocks are lit, the color of the block is made blue, the color of the blocks is gradually changed when the number of lit blocks increases, and when all blocks are lit, the block can be made red.

As shown in FIG. 3 , in the classroom application scenario, the number of times a student (ie, a target) raises a hand may be detected, and a special effect of the displayed palm may be changed based on the number of times the student raised a hand. If the number of times the student raises his/her hand is 4, the special effect of the palm may be turned on, and the mark "Х4" may be added after the special effect of the palm. When the student raises his hand for the first time, he can display the special effect of one palm at the position of the head, and add an indication of "Х1" after the special effect of the displayed palm.

In another possible embodiment, the controlling of the first exhibition object in the first display area to change the display state based on the accumulated time or the accumulated number of times that the target object has taken the target pose comprises: the accumulated time or the accumulated number of times when a predetermined value is reached, controlling the first exhibition object to change the exhibition state to the target exhibition state to indicate that the target posture taken by the target object has already satisfied the predetermined condition.

In the classroom application scenario, when it is detected that the number of times the student raises their hand reaches a predetermined number, the first display object may further include a special effect of stars in addition to the special effect of the palm. The target display state of the first exhibition object may be, for example, in the case of a special effect of a star, five stars may be lit in order, and may be used to indicate that the number of times the student raises a hand reaches a predetermined number. At the same time, you can add a mark to indicate the number of times the hand is raised after the special effect of the palm.

In Situation 1, by displaying the first exhibition object in the initial exhibition state, prompting the target object to assume the target posture, thereby improving the interaction between the target objects, and controlling the first exhibition object to change the display state, the first Relatively many exhibition methods were provided for the subject of the exhibition.

In situation 2, when it is detected that the target object is included in the video screen, an attribute characteristic of the target object in the video screen is detected, and a second display object corresponding to the attribute characteristic is displayed in the first display area of the display screen. can do.

Here, the second exhibition object may include at least one of the target object's identification identifier, age value, smile value, attractive value, viewing duration, each type of emotion duration, and attention duration. In different application scenarios, it is possible that the type of the second exhibition object corresponding to the attribute characteristic is different from each other, and specifically, it may be set according to an actual situation.

Illustratively, when some embodiments of the present invention are applied to a classroom scenario, the target object may be a student in the classroom, and the corresponding second display object is the class duration, attention duration, positive emotion duration, negative emotion duration It may include at least one of time. Here, the positive emotion may be, for example, happiness, excitement, or emotion, and the negative emotion may be, for example, fear or sadness. The class duration may be a period from when the electronic device starts to acquire a video screen captured by the photographing apparatus to the current time point. The attention duration may be a duration for which the student's complete facial features are collected by the imaging device. In some embodiments, the attention duration can be determined in the following manner, that is, by detecting the position of the student's head in the video screen of each frame, the position of the student's head and a predetermined position (eg, for example, it may be a blackboard), and if the offset angle is within a predetermined angle range, it is determined that the student is currently paying attention to the blackboard, and the number of video frames in which the student is paying attention to the blackboard is statistic By doing so, the attention duration is determined.

In some embodiments, the positive emotion duration and negative emotion duration of the student can be detected through the following method, that is, by inputting the captured video screen into a pre-trained emotion recognition model, the video screen Predict the emotion corresponding to each student in the school, determine whether the emotion belongs to a positive emotion or a negative emotion based on the predicted emotion, and the continuation of the video screen in which the student's emotion belongs to the positive emotion up to the present time The time and duration of the video screen in which the student's emotion belongs to the negative emotion are statistic, and the duration of the positive emotion and the duration of the negative emotion corresponding to each student are calculated based on the time of the video screen in which each kind of emotion appeared, respectively. confirm

Some embodiments of the present invention are also applied to public places such as exhibitions or shopping malls, in which case, the second display object includes one or more of identity identifier, age, attractive value, viewing duration, facial expression, and smile value. can do.

Here, the attribute characteristic of the target object may be a biological characteristic (eg, a facial characteristic, a gait characteristic, a REID characteristic, etc.) of the target object. Illustratively, first, the biological feature of the target object in the video screen is extracted, the extracted biological feature is matched with the biological feature known in advance of the identification identifier stored in the database, and the identification identifier of the biological feature in the database that has succeeded in matching is targeted. It is determined as the identification identifier of the target, and if the matching is not successful, the identification identifier is allocated to the target object, and the identification identifier assigned to the target object and the corresponding biological characteristics are stored in the database.

When the age of the target object is determined, the video screen may be input to a previously trained neural network model, and the age of the corresponding target object in the video screen may be predicted. A method of detecting attribute features such as attractiveness value, facial expression, and smile value of a target object may be the same as a method of detecting age of a target object. Although not repeatedly described here, a neural network model applied when predicting different attribute features is different, and it is necessary to explain that the training process of different neural network models is also different.

When the attribute characteristic of the target object includes multiple characteristics among age, attractiveness value, facial expression, and smile value, multiple characteristics of the target user in the video screen can be predicted using one neural network model, and when the neural network model is trained , it is necessary to explain that the supervised data label needs to be a plurality of feature labels.

The method for determining the duration of viewing of the target may be the same as the method for determining the duration of the student's attention in a classroom scenario, and this will not be repeated here.

Considering that the state of the target object (eg, posture, facial expression, etc.) may constantly change, the attribute characteristics of the target object may also change. For example, when the target object changes the facial expression, the detected facial expression, smile value, attractiveness value, etc. of the detected target object are also changed.

In one possible embodiment, when it is detected that a change has occurred in the attribute characteristic of the target object, it is also possible to control the second display object in the first display area to change the display state according to the change in the attribute characteristic. Exemplarily, as shown in FIG. 4 , as for the second exhibition object, an exhibition frame may be displayed around each target object. At least one of identity, age, attractiveness value, facial expression, viewing duration, and smile value of the target object may be displayed in the display frame, and the display position of the display frame may be a fixed position around the target object. For example, it is possible to detect a body key point of the target object, determine an exhibition position based on the body key point, and display an exhibition frame corresponding to the target target.

In the above solution, by displaying the second display object corresponding to the target object attribute characteristic, individualized display of different target objects can be realized, and the exhibition requirements of different target objects can be satisfied.

In situation 3, when it is detected that the target object is included in the video screen, check-in information of the target object may be displayed in the second display area of the display screen.

In the related technology, when it is necessary to statisticize attendees' information when holding an event, professional personnel such as sign-in form signatures and input of identification information are often manually statistic, complicated operation, and poor check-in efficiency. relatively low.

In some embodiments, the target audience may be a scheduled attendee. For example, if the application scenario is a meeting, the target may be a predetermined participant.

In one possible embodiment, biological characteristics of the target object (eg, facial characteristics, gait characteristics, REID characteristics, etc.) may be input in advance. After acquiring the video screen, the biological characteristics of each object in the video screen are detected, the detected biological characteristics and the previously input biological characteristics are compared, and the target having a successful comparison result is determined as the target object.

Check-in information of the target may be displayed in the second display area, and the check-in information may include, for example, a photo of the target and/or identification information of the target. After it is detected that the target object is included in the video screen, the display state of check-in information of the target object in the second display area may be changed.

In some embodiments, the check-in information may be displayed in the form of information cards in the second display area, and within each information card, a photo of the target subject and/or identification information of the target subject may be displayed. When changing the display status of check-in information, the background color of the information card may be changed. Alternatively, the color of the information card before changing the display state of the check-in information may be set to gray. A method of changing the display state of check-in information may be to turn on an information card or the like.

In another possible embodiment, when the display object in the first display area is controlled to change the display state, and it is detected that the display state after the transformation is the target display state, the target object displayed in the second display area is also of check-in information can be marked.

Illustratively, if the display object in the first display area is a special effect of a flower, a prompt sentence “Smile and become a VIP” may be displayed next to the special effect of the flower. After detecting the smile of the target object, The color of the special effect of the flower is controlled to change, that is, the display state of the display object is changed to the target display state, In this case, a mark may be added to the check-in information of the corresponding target object in the second display area and, for example, a "VIP" indication may be added in check-in information of the target in the second display area.

Here, before changing the display state of the check-in information of the target object, the photo included in the check-in information may be a photo previously stored in the database. When the check-in information is marked, one picture of the target target is cut out in the video screen, and the picture of the target target in the check-in information can be replaced by using the cut picture. The cut photo may be randomly cut or cut from a video image of one frame with the highest resolution.

In one possible embodiment, the positions within the second display area are limited, but the number of target objects is plural. In this case, check-in information of the target object may be scrolled or displayed, or check-in information of the target object may not be displayed in the second display area after a predetermined time elapses after a mark is added to the check-in information of the target object.

Based on the above solution, it is possible to realize automatic check-in of the target object, simplify the check-in procedure, and improve check-in efficiency. By marking the check-in information of the target object, the display method of the check-in information can be enriched, and the target object whose exhibition state is the target exhibition state and the target object whose exhibition state is not the target display state can be distinguished.

In the situation 4, when it is detected that the target object is included in the video screen, the technical information of the target object can be displayed in the third display area of the display screen.

The technical information of the target may be attribute information of the target and a face image of the target cut from the video screen.

In other scenarios, the attribute information of the target object may be different. For example, in the classroom scenario, the attribute information of the target object may include student ID, gender, age, number of classes, etc., but may include public information such as exhibitions, shopping malls, etc. The attribute information of the target in the location of the target object may include an identification identifier, gender, number of visits, duration of stay, and the like.

The technical information of the target object that can be displayed in the third display area is limited. For example, only the technical information of N target objects may be displayed in the third display area, and when the number of target objects included in the video screen is N or less, the technical information of all target objects may be displayed in the third display area, , when the number of target targets included in the video screen is greater than N, for example, if N+1 target targets are included in the video screen, the technical information of the target target displayed first is deleted, and the latest N+ first target target is deleted. can display technical information of the target object that appears in the video screen, where N is a positive integer.

In one possible embodiment of the present invention, in the third display area, only the technical information of the preceding M target objects appearing in the video screen is displayed, and the technical information of the target objects appearing after the Mth in the video screen is not displayed. may not be, where M is a positive integer, and M and N may or may not be the same. Alternatively, descriptive information of the preceding M target objects that satisfy specific attribute characteristics may be displayed.

When the display object in the first display area is controlled to change the display state, and it is detected that the display state after conversion is the target display state, the technical information of the target object displayed in the third display area may be marked.

For example, after it is detected that the target object is included in the video screen, a special effect of flowers and a prompt sentence of “Smile and become a VIP” may be displayed at a corresponding position. Afterwards, the color of the special effect of the flower is changed (that is, the display state of the display object in the first display area is changed to the target display state), and "VIP" is added to the technical information of the target object displayed in the third display area. ", and also change the background color of the technical information from the initial color to the target color.

In the above solution, the display method of technical information is enriched by displaying the technical information of the target object, converting the display state of the display object to the target display state, and adding a mark to the technical information, and Interaction improved.

In Situation 5, when it is detected that the target object is included in the video screen, the business content may be displayed in a fourth display area of the display screen.

Here, the business content displayed in the fourth display area may be, for example, an advertisement, a promotional video, or place introduction information, and the form of the business content is not limited to a photo, text, audio, video, or the like.

Controlling the display object in the display screen to change the display state based on the cumulative detection result of the target object in the video screen is when it is detected that the posture of the target object in the video screen is changed from the first posture to the second posture , controlling the business content displayed in the fourth display area to be switched from the first business content to the second business content.

Here, the current posture of the target object is the first posture, and the preset posture is the second posture. The business content currently displayed in the fourth display area is the first business content, and other business content other than the first business content is the second business content.

In the fourth display area, a prompt sentence for instructing the target object to change the business content to taking the second posture may be displayed. For example, the prompt sentence may be “shake your hand to change the display content”. The current posture of the target object is the first posture, and when a waving motion of the target object is detected, that is, when it is detected that the target object changes from the first posture to the second posture, it is within the fourth display area. Control to switch the displayed business content.

In the above solution, when a change in the posture of the target object is detected, the business content displayed in the fourth display area may be controlled to be switched. By doing so, we improved the interaction between our target audiences and enriched the way business content changes.

In situation 6, when it is detected that at least one target object is included in the video screen, feature distribution information of the at least one target object may be displayed in a fifth display area of the display screen.

Here, the feature distribution information may include, but is not limited to, an age distribution, a gender distribution, a distribution of the number of visits, a popular route distribution, a regional crowd density distribution, and the like.

Here, when the feature distribution information includes a popular route distribution, the electronic device may be connected to a plurality of photographing apparatuses (the connection method may be a wired connection or a wireless connection), and first determine the movement path of each target object Then, it is possible to continuously select and display popular routes from a plurality of moving routes.

Here, as shown in FIG. 5 , the method of determining the movement path of the target may include steps S501 to S504.

In S501, the collected data of the first photographing device is acquired, and the collected data includes the collected face image and identifier information of the first photographing device.

In S502, position description information corresponding to the identifier information of the first imaging device is acquired.

In S503, the movement data of the target object of the face image identifier is determined based on the position description information of the first photographing device.

In S504, the movement path of the target object is determined using the movement data.

Specifically, the first photographing device may be a photographing device that has captured the current target, and the collection data of the first photographing device may further include a collection time of the face image. If it is detected that the past movement data of the target object has already been obtained within a predetermined time period before the collection time, the movement data may be obtained by updating the past movement data based on the location description information of the first photographing device. . When it is detected that the past movement data of the target user has not been obtained within a predetermined time period before the collection time, the location description information of the first photographing device may be used as the movement data. The past movement data includes location description information of at least one second photographing device, wherein the second photographing device is a photographing device that collected a face image of the target within a predetermined time period before the collection time.

In one possible embodiment, the controlling to change the display state of the display object in the display screen based on the cumulative detection result of the target object in the video screen is based on the cumulative detection result of the at least one target object. , controlling to update feature distribution information displayed in the fifth display area.

Exemplarily, if the feature distribution information includes a gender distribution, and 5 male target subjects and 2 female target targets are included in the current video screen, the ratio of male and female to the displayed feature distribution information is 5:2 It can be displayed in the form of a pie graph when displaying the data or displaying the gender distribution, and the embodiment of the present invention does not limit the display method.

In the above manner, by displaying and updating the feature distribution information in the fifth display area, statistics and analysis of the target object in the video screen can be realized.

Illustratively, when it is detected that a target object is included in the video screen, if the above situations 1 to 6 are simultaneously included when displaying an exhibition object related to the target object, the distribution status of each display area in the display screen is as shown in FIG. 6 . Here, the first display area and the fourth display area may be the same area, that is, the display of the acquired video screen, the display of the first display object, and the display of the business content are different display modes.

When the first display area and the fourth display area are different areas, that is, when a video screen and business content are simultaneously displayed on the display screen, an exemplary distribution situation of each display area within the display screen is as shown in FIG. 7 . same.

Those skilled in the art will know that the description order of each step in the above method of specific embodiments means a strict execution order and does not constitute a limitation on the implementation process, the specific execution order of each step is determined by its function and possible internal logic You have to understand that it should be

An embodiment of the present invention further provides an apparatus for controlling an exhibition object based on the same concept. 8 is a schematic diagram showing the configuration of a display object control device provided by an embodiment of the present invention. The apparatus includes a first display module 801; a second display module 802; and a control module 803 .

The first display module 801 displays the acquired video screen on the display screen.

When it is detected that the target object is included in the video screen, the second display module 802 displays the display object related to the target object on the display screen.

The control module 803 controls the display object in the display screen to change the display state based on the cumulative detection result of the target object in the video screen.

In one possible embodiment, when it is detected that the target object is included in the video screen, the second display module 802 displays the first display object in the initial display state in the first display area of the display screen. display, wherein the initial display state may be used to prompt the target object to assume the target pose.

In one possible embodiment, the control module 803 detects the target posture taken by the target object in the video screen, and based on the accumulated time or the accumulated number of times the target posture taken by the target object, the second It is possible to control the display state of the first exhibition object in one display area to change.

In one possible embodiment, when the accumulated time or the accumulated number of times does not reach a predetermined value, the control module 803 may control the first exhibition object to convert the exhibition state into an intermediate exhibition state, The intermediate display state changes according to the cumulative value of the cumulative time or the cumulative number of times, thereby indicating the cumulative value.

In one possible embodiment, the control module 803 controls the first exhibition object to change the exhibition state to the first target exhibition state when the accumulated time or the accumulated number of times reaches a predetermined value. It may indicate that the target posture taken by the target object has already met a predetermined condition.

In one possible embodiment, the second display module 802 detects an attribute characteristic of the target object in the video screen, and displays a second display object corresponding to the attribute characteristic in a first display area of the display screen. can be exhibited.

In one possible embodiment, when it is detected that a change has occurred in the target attribute characteristic of the target object, the control module 803 is configured to display the second display object in the first display area according to the change in the attribute characteristic. It can be controlled to change the display state.

In one possible embodiment, the second display object includes at least one of an identification identifier, an age value, a smile value, an attractive value, a viewing duration, a duration of each kind of emotion, and a duration of attention of the target object.

In one possible embodiment, when it is detected that the target object is included in the video screen, the second display module 802 is configured to display check-in information of the target object in a second display area of the display screen. can

In one possible embodiment, when the control module 803 is also controlling the display object in the first display area of the display screen to change the display state, it is detected that the display state after transformation is the target display state. In this case, check-in information of the target displayed in the second display area may be marked.

In one possible embodiment, when it is detected that the target object is included in the video screen, the second display module 802 is configured to display technical information of the target object in a third display area of the display screen. can

In one possible embodiment, when the control module 803 is also controlling the display object in the first display area of the display screen to change the display state, it is detected that the display state after transformation is the target display state. In this case, the technical information of the target object displayed in the third display area may be marked.

In one possible embodiment, when it is detected that the target object is included in the video screen, the second display module 803 may display the business content in a fourth display area of the display screen.

In one possible embodiment, when it is detected that the posture of the target object in the video screen is changed from the first posture to the second posture, the control module 803 is configured to control the business content displayed in the fourth display area. may be controlled to switch from the first business content to the second business content.

In one possible embodiment, when it is detected that the at least one target object is included in the video screen, the second display module 802 is configured to: at least one target object in a fifth display area of the display screen of feature distribution information can be displayed.

In one possible embodiment, the control module 803 may control to update the feature distribution information displayed in the fifth display area based on the cumulative detection result of the at least one target object.

In some embodiments, a function or template included in an apparatus provided by an embodiment of the present invention may be used to execute the method described in the embodiment of the method, the specific implementation of which is the method of the above method. Reference may be made to the description of the embodiment, which will not be repeated here for the sake of brevity.

An embodiment of the present invention further provides an electronic device based on the same technical concept. As shown in FIG. 9 , the electronic device includes a processor 901 ; memory 902; and a bus 903 . Here, the memory 902 includes an internal memory 9021 and an external memory 9022 . Here, the internal memory 9021 is also called a memory, and temporarily stores the calculation data in the processor 901 and data to be exchanged with the external memory 9022 such as a hard disk, and the processor 901 includes the internal memory 9021 data exchange with the external memory 9022 is performed through When the electronic device 900 is running, the processor 901 and the memory 902 communicate via a bus 903 . Machine-readable instructions executable by the processor 901 are stored in the memory 902 , and when the machine-readable instructions are executed by the processor 901 , the processor 901 causes the processor 901 to Realize the movement state information display method.

Here, the specific processing process executed by the processor 901 may refer to the description of the embodiment of the above method, which is not described herein again.

On the other hand, an embodiment of the present invention further provides a computer readable recording medium having a computer program recorded thereon, so that when the computer program is executed by a processor, the processor realizes the above arbitrary exhibition object control method. do.

The computer program product of the display object control method provided by the embodiment of the present invention includes a computer readable recording medium having a program code recorded therein, and the instructions included in the program code are the display object described in the above method embodiment The steps of the control method may be executed, and specifically, reference may be made to the embodiments of the above method, which will not be repeatedly described herein.

A person skilled in the art can clearly understand that the specific working process of the above system and apparatus may refer to the process in the embodiment of the method, and for the sake of convenience and conciseness of the description, it will not be repeatedly described herein. It should be understood that the systems, apparatuses, and methods disclosed in the embodiments provided by the present invention may be implemented in other ways. The embodiment of the above device is only schematic. For example, the division of the unit is merely division of the logical function, and other division methods may be used in actual implementation. Also, for example, a plurality of units or components may be combined, integrated into separate systems, or some features may be omitted or not implemented. The couplings, direct couplings, or communication connections between each other, also indicated or discussed, may employ some communication interface, indirect coupling or communication connection of a device or unit, and may be in an electrical, mechanical, or other form.

The unit described as the separated part may be physically separated or not physically separated, and the part indicated as a unit may or may not be a physical unit. It may be arranged in one place, or it may be distributed in a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.

In addition, each functional unit of each embodiment of the present invention may be integrated into one processing unit, each unit may exist alone physically, or two or more units may be integrated into one unit.

When the above function is implemented in the form of a software function unit and sold or used as an independent product, it may be recorded in a nonvolatile computer-readable recording medium executable by one processor. Based on this understanding, the embodiment of the present invention may be essentially implemented in the form of a software product, or a part contributing to the prior art or a part of the embodiment may be implemented in the form of a software product. The computer software product is recorded on a recording medium, and includes some instructions for causing a computer device such as a computer, server, or network device to execute all or part of the steps of the method described in various embodiments below. The above-described recording medium includes a variety of programs capable of recording program codes, such as a U disk, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk. includes media.

The above are only some embodiments of the present invention, and the protection scope of the present invention is not limited thereto. Changes or substitutions that can be readily devised by those skilled in the art based on the present invention are included within the scope of the present invention. Accordingly, the scope of the present invention is determined by the claims.

Claims (34)

A method for controlling an exhibition object, the method comprising:
displaying the acquired video screen on a display screen;
displaying a display object related to the target object on the display screen when it is detected that the target object is included in the video screen;
based on the cumulative detection result of the target object in the video screen, controlling the display object in the display screen to change the display state
An exhibition object control method, characterized in that. According to claim 1,
When it is detected that the target object is included in the video screen, displaying the display object related to the target object on the display screen includes:
displaying a first display object in an initial display state in a first display area of the display screen when it is detected that the target object is included in the video screen;
The initial display state is used to prompt the target object to assume a target pose.
An exhibition object control method, characterized in that. 3. The method of claim 2,
Controlling the display object in the display screen to change the display state based on the cumulative detection result of the target object in the video screen,
detecting the target posture taken by the target object in the video screen; and
and controlling the first display object in the first display area to change the display state based on the accumulated time or the accumulated number of times of the target posture taken by the target object.
An exhibition object control method, characterized in that. 4. The method of claim 3,
Controlling the first display object in the first display area to change the display state based on the accumulated time or the accumulated number of times of the target posture taken by the target object,
controlling the first exhibition object to convert the exhibition state to an intermediate exhibition state when the accumulated time or the accumulated number of times does not reach a predetermined value;
The intermediate display state changes according to the accumulated value of the accumulated time or accumulated number of times, thereby indicating the accumulated value.
An exhibition object control method, characterized in that. 4. The method of claim 3,
Controlling the first display object in the first display area to change the display state based on the accumulated time or the accumulated number of times of the target posture taken by the target object,
When the accumulated time or the accumulated number of times reaches a predetermined value, by controlling the first exhibition object to change the exhibition state to the first target exhibition state, the target posture taken by the target object already meets the predetermined condition including to indicate that
An exhibition object control method, characterized in that. According to claim 1,
When it is detected that the target object is included in the video screen, displaying the display object related to the target object on the display screen includes:
detecting an attribute characteristic of the target object in the video screen when it is detected that the target object is included in the video screen; and
displaying a second display object corresponding to the attribute characteristic in a first display area of the display screen;
An exhibition object control method, characterized in that. 7. The method of claim 6,
Controlling the display object in the display screen to change the display state based on the cumulative detection result of the target object in the video screen,
when it is detected that a change has occurred in the attribute characteristic of the target object, controlling the second display object in the first display area to change its display state according to the change in the attribute characteristic
An exhibition object control method, characterized in that. 8. The method of claim 6 or 7,
The second exhibition subject is,
At least one of the target object's identification identifier, age value, smile value, attractive value, viewing duration, each type of emotion duration, and attention duration
An exhibition object control method, characterized in that. 9. The method according to any one of claims 1 to 8,
When it is detected that the target object is included in the video screen, displaying the display object related to the target object on the display screen includes:
displaying check-in information of the target object in a second display area of the display screen when it is detected that the target object is included in the video screen
An exhibition object control method, characterized in that. 10. The method of claim 9,
Check-in of the target object displayed in the second display area when it is detected that the display state after conversion is the target display state when the display object in the first display area of the display screen is controlled to change the display state further comprising marking information
An exhibition object control method, characterized in that. 11. The method according to any one of claims 1 to 10,
When it is detected that the target object is included in the video screen, displaying the display object related to the target object on the display screen includes:
when it is detected that the target object is included in the video screen, displaying technical information of the target object in a third display area of the display screen
An exhibition object control method, characterized in that. 12. The method of claim 11,
The exhibition object control method,
When it is detected that the display state after conversion is the target display state when the display object in the first display area of the display screen is controlled to change the display state, the description of the target object displayed in the third display area further comprising marking information
An exhibition object control method, characterized in that. 13. The method according to any one of claims 1 to 12,
When it is detected that the target object is included in the video screen, displaying the display object related to the target object on the display screen includes:
When it is detected that the target object is included in the video screen, displaying business content in a fourth display area of the display screen
An exhibition object control method, characterized in that. 14. The method of claim 13,
Controlling the display object in the display screen to change the display state based on the cumulative detection result of the target object in the video screen,
Control to switch the business content displayed in the fourth display area from the first business content to the second business content when it is detected that the posture of the target object in the video screen has changed from the first posture to the second posture including doing
An exhibition object control method, characterized in that. 15. The method according to any one of claims 1 to 14,
When it is detected that the target object is included in the video screen, displaying the display object related to the target object on the display screen includes:
displaying feature distribution information of at least one target object in a fifth display area of the display screen when it is detected that the at least one target object is included in the video screen
The method for controlling the display object according to the first aspect, characterized in that. 16. The method of claim 15,
Controlling the display object in the display screen to change the display state based on the cumulative detection result of the target object in the video screen,
and controlling to update the feature distribution information displayed in the fifth display area based on the cumulative detection result of the at least one target object
An exhibition object control method, characterized in that. In the display object control device,
a first display module for displaying the acquired video screen on the display screen;
a second display module configured to display an exhibition object related to the target object on the display screen when it is detected that the target object is included in the video screen; and
and a control module configured to control the display object in the display screen to change a display state based on a cumulative detection result of the target object in the video screen.
Exhibit object control device, characterized in that. 18. The method of claim 17,
When it is detected that the target object is included in the video screen, the second exhibition module displays the first exhibition object in the initial display state in the first display area of the display screen,
The initial display state is used to prompt the target object to assume a target pose.
Exhibit object control device, characterized in that. 19. The method of claim 18,
The control module is
detecting the target posture taken by the target object in the video screen,
controlling the first exhibition object in the first display area to change the display state based on the accumulated time or the accumulated number of times of the target posture taken by the target object
Exhibit object control device, characterized in that. 20. The method of claim 19,
The control module is
When the accumulated time or the accumulated number of times does not reach a predetermined value, controlling the first exhibition object to convert the exhibition state to an intermediate exhibition state,
The intermediate display state changes according to the accumulated value of the accumulated time or accumulated number of times, thereby indicating the accumulated value.
Exhibit object control device, characterized in that. 20. The method of claim 19,
The control module is
When the accumulated time or the accumulated number of times reaches a predetermined value, by controlling the first exhibition object to change the exhibition state to the first target exhibition state, the target posture taken by the target object already meets the predetermined condition indicating that
Exhibit object control device, characterized in that. 18. The method of claim 17,
The second exhibition module,
when it is detected that the target object is included in the video screen, detecting an attribute characteristic of the target object in the video screen;
displaying a second display object corresponding to the attribute characteristic in a first display area of the display screen;
Exhibit object control device, characterized in that. 23. The method of claim 22,
The control module is
when it is detected that a change has occurred in the target attribute characteristic of the target object, controlling the second display object in the first display area to change the display state according to the change in the attribute characteristic
Exhibit object control device, characterized in that. 24. The method of claim 22 or 23,
The second exhibition subject is,
At least one of an identification identifier of the target object, an age value, a smile value, an attractive value, a viewing duration, each type of emotion duration, and an attention duration
Exhibit object control device, characterized in that. 25. The method according to any one of claims 17 to 24,
The second exhibition module,
displaying check-in information of the target object in a second display area of the display screen when it is detected that the target object is included in the video screen
Exhibit object control device, characterized in that. 26. The method of claim 25,
The control module is also
Check-in of the target object displayed in the second display area when it is detected that the display state after conversion is the target display state when the display object in the first display area of the display screen is controlled to change the display state to mark information
Exhibit object control device, characterized in that. 27. The method according to any one of claims 17 to 26,
The second exhibition module,
displaying technical information of the target object in a third display area of the display screen when it is detected that the target object is included in the video screen
Exhibit object control device, characterized in that. 28. The method of claim 27,
The control module is also
When it is detected that the display state after conversion is the target display state when the display object in the first display area of the display screen is controlled to change the display state, the description of the target object displayed in the third display area to mark information
Exhibit object control device, characterized in that. 29. The method according to any one of claims 17 to 28,
The second exhibition module,
displaying business content in a fourth display area of the display screen when it is detected that the target object is included in the video screen
Exhibit object control device, characterized in that. 30. The method of claim 29,
The control module is
Control to switch the business content displayed in the fourth display area from the first business content to the second business content when it is detected that the posture of the target object in the video screen has changed from the first posture to the second posture doing
Exhibit object control device, characterized in that. 31. The method according to any one of claims 17 to 30,
The second exhibition module,
displaying feature distribution information of at least one target object in a fifth display area of the display screen when it is detected that the at least one target object is included in the video screen
Exhibit object control device, characterized in that. 32. The method of claim 31,
The control module is
controlling to update the feature distribution information displayed in the fifth display area based on a cumulative detection result of at least one target object
Exhibit object control device, characterized in that. In an electronic device,
processor; and
have memory,
In the memory, machine readable instructions executable by the processor are recorded, and when the machine readable instructions are executed by the processor, the processor causes the display object according to any one of claims 1 to 16. to realize the control method
Electronic device, characterized in that. In a computer-readable recording medium on which a computer program is recorded,
17. When the computer program is executed by the processor, causing the processor to realize the display object control method according to any one of claims 1 to 16.
A computer-readable recording medium, characterized in that.

Images