CN113296861B - Method and device for determining information display effect - Google Patents

Method and device for determining information display effect Download PDF

Info

Publication number
CN113296861B
CN113296861B CN202110545324.3A CN202110545324A CN113296861B CN 113296861 B CN113296861 B CN 113296861B CN 202110545324 A CN202110545324 A CN 202110545324A CN 113296861 B CN113296861 B CN 113296861B
Authority
CN
China
Prior art keywords
target information
audience
display
determining
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110545324.3A
Other languages
Chinese (zh)
Other versions
CN113296861A (en
Inventor
姚经纬
杨文玉
李书博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alipay Hangzhou Information Technology Co Ltd
Original Assignee
Alipay Hangzhou Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alipay Hangzhou Information Technology Co Ltd filed Critical Alipay Hangzhou Information Technology Co Ltd
Priority to CN202110545324.3A priority Critical patent/CN113296861B/en
Publication of CN113296861A publication Critical patent/CN113296861A/en
Application granted granted Critical
Publication of CN113296861B publication Critical patent/CN113296861B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The specification discloses a method and a device for determining information display effect. A method for determining information display effect, wherein the information is displayed by a plurality of display devices, the display devices are connected with a server, and the method is applied to the server and comprises the following steps: receiving an environment image stream uploaded by the display equipment in the target information display process; for the environment image stream uploaded by each display device, the following operations are performed: determining the audience of the target information and the watching duration of each audience based on the environment image stream; carrying out crowd classification on the audiences to obtain crowd classification results of the audiences; determining the display effect of the target information on the audiences based on the crowd classification result and the watching duration of each audience; and integrating the display effect of the target information on each audience under each display device to obtain the integrated display effect of the target information.

Description

Method and device for determining information display effect
Technical Field
The present disclosure relates to the field of internet, and in particular, to a method and an apparatus for determining an information display effect.
Background
With the development of technology, scenes of information presentation are increasing in life, and for example, advertisements, news, recruitment information and the like can be presented for a user. Based on this, how to determine the display effect of the information, so as to optimize the information display method based on the effect and improve the user experience, which becomes the key point of business attention.
Disclosure of Invention
In view of this, the present specification provides a method and an apparatus for determining an information display effect.
Specifically, the description is realized by the following technical scheme:
a method for determining information display effect, wherein the information is displayed by a plurality of display devices, the display devices are connected with a server, and the method is applied to the server and comprises the following steps:
receiving an environment image stream uploaded by the display equipment in the target information display process;
for the environment image stream uploaded by each display device, the following operations are performed:
determining audiences of the target information and watching time lengths of the audiences based on the environment image stream;
carrying out crowd classification on the audiences to obtain crowd classification results of the audiences;
determining the display effect of the target information on the audiences based on the crowd classification result and the watching duration of each audience;
and integrating the display effect of the target information on each audience under each display device to obtain the integrated display effect of the target information.
An apparatus for determining information display effect, wherein the information is displayed by a plurality of display devices, the display devices are connected with a server, and the apparatus is applied to the server and comprises:
the receiving unit is used for receiving the environment image stream uploaded by the display equipment in the target information display process;
the execution unit is used for executing the following operations aiming at the environment image stream uploaded by each display device:
determining audiences of the target information and watching time lengths of the audiences based on the environment image stream;
carrying out crowd classification on the audiences to obtain crowd classification results of the audiences;
determining the display effect of the target information on the audiences based on the crowd classification result and the watching duration of each audience;
and the determining unit integrates the display effect of the target information on each audience under each display device to obtain the integrated display effect of the target information.
An apparatus for determining an effect of information presentation, comprising:
a processor;
a memory for storing machine executable instructions;
wherein, by reading and executing machine-executable instructions stored by the memory corresponding to the determination logic of the information presentation effect, the processor is caused to:
receiving an environment image stream uploaded by the display equipment in the target information display process;
for the environment image stream uploaded by each display device, the following operations are performed:
determining audiences of the target information and watching time lengths of the audiences based on the environment image stream;
carrying out crowd classification on the audiences to obtain crowd classification results of the audiences;
determining the display effect of the target information on the audiences based on the crowd classification result and the watching duration of each audience;
and integrating the display effect of the target information on each audience under each display device to obtain the integrated display effect of the target information.
One embodiment of the specification realizes that the server can receive the environment image stream uploaded by each display device in the target information display process, determine the audience of the target information and the watching duration of each audience based on the environment image stream aiming at the environment image stream uploaded by each display device, classify the audience into people to obtain the people classification result of each audience, determine the display effect of the target information on the audience based on the people classification result and the watching duration of each audience, and then synthesize the display effect of the target information on each audience under each display device to obtain the comprehensive display effect of the target information. By adopting the method, the accuracy of determining the information display effect can be greatly improved, so that the optimization of the information display method and the information content based on the information display effect is facilitated, and the user experience is improved.
Drawings
FIG. 1 is a schematic diagram of an information presentation scenario shown in an exemplary embodiment of the present description;
fig. 2 is a flowchart illustrating a method for determining an information presentation effect according to an exemplary embodiment of the present disclosure;
fig. 3 is a flowchart illustrating another method for determining an information presentation effect according to an exemplary embodiment of the present disclosure;
fig. 4 is a hardware configuration diagram of a server in which an information presentation effect determination apparatus according to an exemplary embodiment of the present specification is located;
fig. 5 is a block diagram of an information presentation effect determination apparatus according to an exemplary embodiment of the present specification.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present specification. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the specification, as detailed in the appended claims.
The terminology used in the description herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the description. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, the first information may also be referred to as second information, and similarly, the second information may also be referred to as first information, without departing from the scope of the present specification. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
With the development of technology, scenes of information display are more and more common in life, and information display modes are more and more. In the case of advertisement, advertisement is a means of publicizing and widely delivering information to the public through a certain form of media for a specific need. Conventional advertisement display media are usually tv, newspaper, radio. With the development of internet technology, advertisements can be displayed through various intelligent devices, for example, the advertisements can be displayed to a user when the user watches videos by using a mobile phone, the advertisements can be displayed through advertisement display devices in a cell elevator room, and the advertisements can be displayed at bus stops by using devices for displaying stop information.
In the related art, an information display party expects to know the actual effect of the displayed information, for example, whether the information is valuable to a user or not and whether the propagation range of the information is wide enough, so that the information display method or the information content can be optimized based on the actual effect, and the user experience is improved.
However, no matter advertisement, news, notification or other information, the practically-oriented people are likely to be uncertain, for example, the information displayed at a bus stop is likely to be watched by people of different ages and professions, such as the old, children, students, white-collar workers, and the like, and the uncertainty is large, so that the determination of the information display effect is challenged.
The specification provides a method for determining an information display effect, which can determine audiences watching information in an information display process and actual watching time of the audiences, so that an accurate information display effect is determined according to the actual watching time.
An exemplary information presentation scenario is first described.
Referring to fig. 1, fig. 1 is a schematic diagram of an information presentation scenario according to an exemplary embodiment of the present disclosure.
The information display scene in fig. 1 includes 3 exemplary information display devices and a server, where the server may be a server or a server cluster, and the information display device may be an information display device in an elevator car, a bus stop information display device, and an outdoor large-screen information display device, and of course, the information display device shown in fig. 1 is only an exemplary description, and the method shown in this specification may also be applied to other devices except the example shown in fig. 1.
The display equipment can communicate with the server through the network, the server can issue information to be displayed to each display equipment, the display equipment can display the information to be displayed after receiving the information, and the information to be displayed can be advertisements, news, broadcasts, notifications and the like, and can also be other information. The present embodiment does not specially limit the number of the display devices, the geographical locations, the types of the devices, and the manner of displaying the information.
Moreover, each display device may be further configured with a camera module, which may be a camera mounted on the device. In the process of displaying the target information, the display equipment can call a camera of the equipment to acquire an environment image stream and upload the environment image stream to the server.
Certainly, if the display device is not equipped with a camera, the camera in the surrounding environment of the display device can be used for collecting the environment image stream, and the environment image stream collected by the camera can be sent to the display device and uploaded to the server side by the display device; or directly sending the collected environment image stream and the corresponding display device identifier to the server, and the server can determine the display device to which the environment image stream belongs according to the identifier. Or the server side can also query the mapping relation between the locally bound display equipment and the camera, and then determine the display equipment to which the environment image stream belongs based on the mapping relation.
After receiving the environment image stream, the server may determine a display effect of the target information based on the environment image stream, which will be described in the following embodiments.
An embodiment of a method for determining an information presentation effect provided in this specification is described below.
Referring to fig. 2, fig. 2 is a flowchart illustrating a method for determining an information presentation effect according to an exemplary embodiment of the present disclosure.
The method for determining the information presentation effect may be applied to an electronic device with a memory and a processor, such as a server or a server cluster, and may include the following steps:
step 202, receiving an environment image stream uploaded by a display device in the process of displaying the target information.
Step 204, executing the following operations for the environment image stream uploaded by each display device: determining audiences of the target information and watching time lengths of the audiences based on the environment image stream; carrying out crowd classification on the audiences to obtain crowd classification results of the audiences; and determining the display effect of the target information on the audiences based on the crowd classification result and the watching duration of each audience.
And step 206, integrating the display effect of the target information on each audience by each display device to obtain the integrated display effect of the target information.
The above steps are explained in detail below.
In this embodiment, the target information may be displayed through a plurality of display devices. The targeted information may be advertisements, news, broadcasts, notifications, etc. Taking target information as an advertisement as an example, the display device can be an outdoor advertisement screen, an elevator room advertisement display device, a bus stop advertisement display device and the like, and the embodiment does not make special restrictions on the type of the display device, the display place and the number of the display device. Each display device may display only one piece of information, which is the target information, or may display a plurality of pieces of information.
The cameras can be configured on the display devices, the cameras can be called to collect environment image streams in the process of displaying target information, and then the collected environment image streams are uploaded to the server side. The display device may upload the acquired environmental image stream to the server in real time, or may cache the acquired environmental image stream locally, and then periodically send the cached environmental image stream to the server, which is not limited specifically.
In this embodiment, after receiving the environment image stream uploaded by each display device, the server may determine, for each display device, a display effect of the target information under the display device. The following description will take an example of processing an environment image stream uploaded by a display device.
The server can determine a plurality of audiences of the target information and the watching duration of each audience from the environment image stream.
For example, the server may analyze whether a pedestrian exists in the environmental image stream, and if so, may further analyze whether the pedestrian views the target information, for example, may analyze whether the pedestrian views the target information according to a face orientation feature of the pedestrian, and if it is determined that the pedestrian views the target information, it indicates that the pedestrian is a viewer; otherwise, it is stated that the pedestrian is not a spectator. And may also determine a viewing start image frame and a viewing end image frame of the pedestrian from the ambient image stream according to the face orientation features thereof, and determine the viewing duration of the pedestrian based on the time stamps of the two image frames. The details will be described in the following examples.
It should be noted that the pedestrian is not necessarily a walking (moving) person, but may be a stationary person, for example, a stationary person in an elevator car when the elevator car displays information.
In this embodiment, the server may further perform crowd classification on each audience. The people classification can be made from only one dimension, such as whether only the audience's profession is white collar, take out, courier, or student. People may also be categorized from multiple dimensions, such as age, gender, residence, income level, etc. of the audience in addition to categorizing the audience's profession.
In one example, the server may analyze the wearing characteristics and appearance characteristics of the audience from the image frames, so as to analyze the age, gender, occupation, and the like of the audience, thereby implementing the crowd classification. Of course, the server may also use other methods to classify the crowd, and refer to the related art specifically, which is not limited specifically.
In this embodiment, the server may determine the display effect of the target information on each audience according to the crowd classification result and the watching duration of each audience.
For example, the interest level of each type of crowd in the target information may be preset. Assuming that the target information is an advertisement for students but not for white-collar workers, the target information is likely to be more interested by people of the type of "age 10-25 years" and "students", and the target information is likely to be less interested by people of the type of "age 25-50 years" and "white-collar workers", the degree of interest of the audience in the target information can be determined according to the crowd classification result of the audience, the display effect of the target information to the audience is determined according to the degree of interest, and if the determined audience with high interest is more, the effect is better; conversely, the less viewers of high interest, the less effective the result.
In this embodiment, the display effect of the target information on each audience under the display device may be determined by the method, and then the display effect of each audience is integrated to obtain the display effect of the target information under the display device.
And then, the display effect of the target information under each display device can be integrated to obtain the integrated display effect of the target information.
As can be seen from the above description, in an embodiment of the present specification, the server may receive an environmental image stream uploaded by each display device in a target information display process, determine, for the environmental image stream uploaded by each display device, audiences of the target information and watching durations of the audiences based on the environmental image stream, classify the audiences by groups to obtain group classification results of the audiences, determine a display effect of the target information on the audiences based on the group classification results and the watching durations of the audiences, and then synthesize the display effect of the target information on the audiences under each display device to obtain a comprehensive display effect of the target information.
By adopting the method, the information display equipment can collect the environment image stream in the process of displaying the information and upload the environment image stream to the server, the server can determine the audience of the target information and the watching duration of each audience based on the environment image stream, and then determine the display effect of the target information according to the audiences and the watching durations thereof, so that the accuracy of determining the information display effect can be greatly improved, the information display method and the information content can be optimized based on the information display effect, and the user experience can be improved.
An embodiment of another method for determining an information presentation effect provided in the present specification is described below.
Referring to fig. 3, fig. 3 is a schematic flow chart of another method for determining an information presentation effect according to an exemplary embodiment of the present disclosure. The method for determining the information presentation effect can be applied to electronic equipment with a memory and a processor, such as a server or a server cluster.
The method for determining the information display effect may include the steps of:
step 302, receiving an environment image stream uploaded by a display device in the process of displaying the target information.
In this embodiment, the display device may be configured with a camera module, such as a camera, and the image stream of the environment around the display device may be collected by the camera module.
In one example, the display device may continuously invoke the camera module to capture the environmental image stream, and then send the captured environmental image stream to the server. Moreover, the display device may also send a timestamp corresponding to the environmental image stream and the actual playing time of each piece of information to the server, so that the server may determine the environmental image stream corresponding to each piece of information according to the timestamp and the actual playing time. Of course, the server may also determine the environment image stream corresponding to each piece of information in other manners, which is not limited to this.
In another example, when monitoring the playing target information, the display device may also invoke the camera module to collect an environment image stream, and then send the environment image stream and the identifier of the target information to the server. Or the target information may be monitored to be played for a period of time (for example, after 1 second or 2 seconds, the setting may be specifically made in advance), and then the camera module is called to acquire the environmental image stream, which is not particularly limited.
Step 304, determining the audience of the target information and the watching time length of each audience.
In this embodiment, the server receives the environment image stream uploaded by the display device, and may determine the viewers of the target information and the watching durations of the viewers based on the environment image stream.
For example, the server may extract image frames from the environmental image stream and then identify the image frames to identify whether there is a pedestrian in the image frames. Such as whether a pedestrian is present or not, according to whether the shape of a human body is present or not, and whether a human face is present or not in the image frame.
Of course, in other embodiments, besides the pedestrian may be identified through the environmental image stream, the pedestrian may also be identified by combining other methods, for example, an infrared sensor, a voice sensor, and the like may also be used to assist in determining whether there is a pedestrian in the environment around the display device.
In this example, if a pedestrian is present, it may be further determined whether the pedestrian is a spectator. Taking the advertisement displayed by the elevator car as the target information as an example, the advertisement display device may shoot all pedestrians in the elevator car, but does not represent that all pedestrians are watching the advertisement, and it is meaningless to analyze pedestrians who do not watch the advertisement when analyzing the advertisement display effect, so that it is necessary to distinguish the audience who really watch the advertisement.
For example, the face orientation feature of the pedestrian may be further analyzed based on the image frames to determine the audience for the target information based on the face orientation feature. If the face direction of the pedestrian is opposite to the camera, the pedestrian really watches the target information and is determined as the audience; if the face is oriented to face the camera sideways and away from the camera, it is likely that the pedestrian does not view the target information and is not determined to be a viewer. Of course, besides the face orientation feature of the pedestrian, the eye gazing direction of the pedestrian can also be analyzed, and if the pedestrian gazes at the camera, the pedestrian is determined to be the audience; otherwise, the pedestrian is determined not to be a viewer. The method of analyzing the face direction and the method of analyzing the eye gaze direction may refer to related art, and the present embodiment is not particularly limited thereto.
In this embodiment, after determining the audience of the target information, the viewing duration of the audience may be determined based on the environmental image stream.
For example, an image frame in which the front face of the viewer appears for the first time (viewing start image frame) and an image frame in which the front face of the viewer appears for the last time (viewing end image frame) may be extracted from the environment image stream, and then a time period formed by the two image frames corresponding to the time stamps may be used as the viewing duration of the viewer.
By adopting the method, the audience who really watches the target information and the actual watching time of the audience can be determined, so that the display effect of the target information is analyzed, the relevant data of pedestrians who do not watch the target information does not need to be analyzed, and the accuracy of determining the display effect is improved.
Step 306, performing crowd classification on the audience.
In this embodiment, for each viewer, the image frame where the viewer is located may be extracted from the environmental image stream, and the viewer may be classified into groups based on the image frame.
For example, if the image frame may include many viewers, an image including only the viewers may be cut out from the image frame and then input into the crowd classification model to obtain the crowd classification result of the viewers. The crowd classification result can be multidimensional, for example, the crowd classification can be carried out according to three dimensions of gender, age and occupation, and the crowd classification model can give a prediction score of the audience under each crowd classification type. See table 1 below, where table 1 below illustrates one example of a crowd classification result:
Figure BDA0003073406210000071
TABLE 1
The crowd classification model may be a neural network model or other models, and is not particularly limited. The method may be obtained by training a large number of images as training samples and crowd classification results as sample labels, and reference may be made to related technologies.
In this embodiment, the crowd classification result of each audience can be expressed in a vector form, and for the audience a in table 1 above, the vector of the crowd classification result can be S a 0.9, {0.1, 0.1,0.1,0.7,0.1,0.1,0.7,0.2 }; for viewer B of Table 1 above, the crowd classification result vector may be S b 0.1,0.9,0.6,0.2,0.1,0.1,0.8,0.1,0.1 }. The presentation effect of the target information may then be calculated based on the vector.
Of course, the above table 1 is only an exemplary illustration, and in practical applications, people may also be classified from other dimensions, and other methods may also be used for people classification, for example, people may also be subjected to face recognition to identify the identity of the audience, and then the relevant information of the identity is obtained through big data to perform people classification.
And 308, determining the value of the target information to the audience according to the value factor corresponding to the target information.
In this embodiment, the information may be classified according to types, for example, the information is taken as an advertisement, and may be classified into a marketing advertisement, a recruitment advertisement, a house property advertisement, and the like, and a value factor corresponding to each type of information may be set, where the value factor is generally a preset interest level of the user in the type of information, that is, a value of the type of information to the user.
The presentation form of the value factor may be a vector, each element in the vector may correspond to each crowd classification type one to one, and the element value may represent the value of the corresponding type of information to the crowd classification.
Still by taking the crowd classification method shown in table 1 as an example, the crowd classification result includes: "male", "female", "5-10 years", "10-20 years", "20-40 years", "above 40 years", "student", "white collar", "courier", assuming that the target information is courier-oriented recruitment information, a corresponding value factor score may be set for each of the above-mentioned category types of people, a higher value factor may be set for a category type matching the target information of "courier-oriented recruitment information", and a lower value factor may be set for a category type not matching the target information of "courier-oriented recruitment information", as shown in table 2 below:
Figure BDA0003073406210000081
TABLE 2
Of course, the scores of the figure of merit shown in Table 2 above are merely illustrative and are not intended to limit the present disclosure.
The cost factor vector for the example shown in Table 2 above may be W 1 ={1,0,0,0.1,0.7,0.4,-0.6,0.5,0.8}。
In this embodiment, the value of the target information to the audience may be determined according to the value factor corresponding to the target information.
For example, the value can be calculated using the following equation (1):
v i =S i ·W j (1)
wherein v is i Is the value of the target information j to the viewer i, S i Vector of results of classification of the population of viewer i, W j Is a value factor vector of the target information j.
Still by way of example in tables 1 and 2 above, assuming that the viewer is viewer a, substituting the above equation yields:
v a =S a ·W={0.9,0.1,0.1,0.1,0.7,0.1,0.1,0.7,0.2}·{1,0,0,0.1,0.7,0.4,-0.6,0.5,0.8}
of course, the above method for calculating the value of the target information to the audience is only an exemplary embodiment of the present specification, and other methods may be adopted to calculate the value of the target information to the audience in practical applications.
For example, in other embodiments, a plurality of corresponding value factors may be set for each information type, each value factor may correspond to one crowd classification type, and when determining the display effect of the target information on the audience, the corresponding value factor may be found according to the crowd classification type to which the audience belongs, where the value factor may be a numerical value or in another form, and then the value of the target information on the audience is determined based on the value factor and the watching duration of the audience.
Still taking the crowd classification results shown in table 1 above as an example, the crowd classification results of viewer a may also be "male", "20-40 years old", or "white-collar". The value factor corresponding to the target information may be determined, for example, if the value factor corresponding to "male" is 0.8, the value factor corresponding to "female" is 0.2, the value factor corresponding to "0-20 years" is 0.3, the value factor corresponding to "20-40 years" is 0.7, the value factor corresponding to "student" is 0.1, the value factor corresponding to "white collar" is 0.9, then the value factor corresponding to viewer a may be found as: 0.8, 0.7, 0.9, which may then be summed, averaged, etc. to derive the value of the target information to the viewer.
And 310, determining the display effect of the target information on the audiences based on the corresponding value and the watching duration of each audience.
In this embodiment, the following formula (2) may be used to calculate the display effect of the target information on the audience:
r i =f(v i ,t i ) (2)
wherein r is i Is the effect of the presentation of the target information j to the viewer i, t i The viewing duration of the viewer i. f may be of various forms, for example a first order linear equation, where r i And t i 、v i Respectively, are in positive correlation.
Still by taking the example described in tables 1 and 2 as an example, assuming that the viewer is viewer a and the viewing time of the viewer is 30 seconds, the following formula is substituted to obtain:
r a =f(v a ,30)
of course, the above examples are merely exemplary, and other methods may be used to obtain the display effect of the target information in practical applications. In this embodiment, for each display device, the method may be used to calculate the display effect of the target information on each audience under the display device, and then integrate the display effects of the audiences, for example, sum and average to obtain the display effect of the target information under the display device. For example, the display effect of the target information can be obtained by the following formula (3):
Figure BDA0003073406210000091
and R is the display effect of the target information under the equipment.
And 312, integrating the display effect of the target information on each audience by each display device to obtain the integrated display effect of the target information.
In this embodiment, after the display effect of the target information under each display device is obtained, the display effects of the target information under each display device may be integrated, for example, summing, averaging, and the like, so as to obtain the integrated display effect of the target information. The comprehensive display effect may be in the form of a score or in the form of a grade, such as excellent, good, medium, or poor effect, and is not particularly limited.
By adopting the method, the geographical positions of different display devices may be different, and the facing crowds may also be different, so that the display effect of the target information under different display devices can be integrated, the display effect of the target information on different geographical positions and different types of crowds can be comprehensively and comprehensively analyzed, and the accuracy of determining the display effect is improved.
Step 314, determining whether the comprehensive display effect meets the display expectation. If not, go to step 316.
And step 316, outputting a display adjustment prompt of the target information.
In this embodiment, an expected effect of the target information may also be preset, for example, the expected effect may be determined according to the display cost of the target information, and the expected effect is positively correlated with the display cost. After the comprehensive display effect of the target information is determined, the comprehensive display effect can be compared with the expected effect to judge whether the comprehensive display effect achieves the expected effect.
If the display expectation is not met, a display adjustment prompt of the target information can be output. The display adjustment prompt may prompt the relevant person to adjust the display of the target information, such as adjusting the display time, adjusting the display device of the target information, and so on. And moreover, the number of audiences, the crowd classification result of the audiences, the watching duration of the audiences and the like corresponding to the target information obtained by analysis in the step can be obtained, and the information is also output in the display adjustment, so that related personnel can conveniently formulate a more reasonable information display method, and the user experience is improved.
As can be seen from the above description, in an embodiment of the present specification, each display device may invoke a camera module to collect an environmental image stream in a process of displaying target information and upload the environmental image stream to a server, after receiving the environmental image stream, the server may determine, for the environmental image stream uploaded by each display device, a viewer of the target information and a viewing duration of each viewer based on the environmental image stream, perform crowd classification on the viewer to obtain a crowd classification result of each viewer, obtain a value factor corresponding to each viewer according to the crowd classification result, determine a display effect of the target information on the viewer based on the crowd classification result, the value factor and the viewing duration of each viewer, and then integrate the display of the target information on each viewer under each display device to obtain a comprehensive display effect of the target information.
By adopting the method, the display effect of the target information can be determined according to the real audience and the actual watching duration of the target information, and the influence of pedestrians who do not watch the target information is avoided. In addition, the value factors corresponding to different types of crowds can be determined in advance, so that the influence of the target information on the audience is determined according to the value factors corresponding to the types of the crowds to which the audience belongs, the accuracy of determining the target information display effect can be greatly improved, the information display method and the information content can be optimized based on the information display effect, and the user experience is improved.
Corresponding to the embodiment of the method for determining the information display effect, the specification also provides an embodiment of a device for determining the information display effect.
The embodiment of the device for determining the information display effect in the specification can be applied to a server. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. Taking a software implementation as an example, as a logical device, the device is formed by reading corresponding computer program instructions in the nonvolatile memory into the memory for operation through the processor of the server where the device is located. From a hardware aspect, as shown in fig. 4, a hardware structure diagram of a server where a device for determining an information presentation effect is located is shown, except for the processor, the memory, the network interface, and the nonvolatile memory shown in fig. 4, a server where the device is located in the embodiment may also include other hardware according to an actual function of the server, which is not described again.
Fig. 5 is a block diagram of an information presentation effect determination apparatus according to an exemplary embodiment of the present specification.
Referring to fig. 5, the apparatus for determining the information display effect may be applied to the server shown in fig. 4, and includes: receiving unit 510, executing unit 520, determining unit 530, judging unit 540, and presenting unit 550.
The receiving unit 510 receives an environment image stream in a target information display process uploaded by the display device;
the execution unit 520, for the environment image stream uploaded by each display device, performs the following operations:
determining audiences of the target information and watching time lengths of the audiences based on the environment image stream;
carrying out crowd classification on the audiences to obtain crowd classification results of the audiences;
determining the display effect of the target information on the audiences based on the crowd classification result and the watching duration of each audience;
the determining unit 530 integrates the displaying effect of the target information on each audience by each displaying device, to obtain an integrated displaying effect of the target information.
Optionally, when determining the audience of the target information based on the environmental image stream, the executing unit 520:
identifying a pedestrian from the stream of ambient images;
determining whether a pedestrian is a spectator of the target information based on a face orientation feature of the pedestrian.
Optionally, the determining of the viewing duration of each viewer includes:
extracting, for each viewer, a viewing start image frame and a viewing end image frame in which the viewer is located from the ambient image stream based on facial orientation features of the viewer;
determining a viewing duration of the target information by the viewer based on the time stamp of the viewing start image frame and the time stamp of the viewing end image frame.
Optionally, when the executing unit 520 performs crowd classification on the audiences to obtain a crowd classification result of each audience:
for each audience, extracting an image frame where the audience is located from the environment image stream;
and inputting the image frame into a crowd classification model to obtain a crowd classification result of the audience.
Optionally, the crowd classification result includes one or more of the following: gender, age, occupation.
Optionally, value factors corresponding to each type of information are preset, and when determining the display effect of the target information on the audience based on the crowd classification result and the watching duration of each audience, the execution unit 520:
determining a value factor corresponding to the target information;
and aiming at each audience, determining the display effect of the target information on the audience according to the crowd classification result of the audience, the value factor and the watching duration of the audience.
Optionally, when determining the display effect of the target information on the audience according to the crowd classification result of the audience, the value factor, and the watching duration of the audience, the executing unit 520:
determining the value of the target information to the audience according to the crowd classification result of the audience and the value factor;
and determining the display effect of the target information on the audience based on the value and the watching duration of the audience.
Optionally, the method further includes:
a judging unit 540, configured to judge whether the comprehensive display effect meets an expected display effect;
and if not, the prompt unit 550 outputs a display adjustment prompt of the target information.
Optionally, the expected display effect is positively correlated with the display cost of the target information.
Optionally, the information is an advertisement, and the display device includes one or more of the following: outdoor advertisement display equipment, elevator room advertisement display equipment, bus stop advertisement display equipment.
The specific details of the implementation process of the functions and actions of each unit in the above device are the implementation processes of the corresponding steps in the above method, and are not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution in the present specification. One of ordinary skill in the art can understand and implement it without inventive effort.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. A typical implementation device is a computer, which may take the form of a personal computer, laptop computer, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email messaging device, game console, tablet computer, wearable device, or a combination of any of these devices.
Corresponding to the embodiment of the foregoing method for determining an information presentation effect, the present specification further provides an apparatus for determining an information presentation effect, including: a processor and a memory for storing machine executable instructions. Wherein the processor and the memory are typically interconnected by means of an internal bus. In other possible implementations, the device may also include an external interface to enable communication with other devices or components.
In this embodiment, the processor is caused to:
receiving an environment image stream uploaded by the display equipment in the target information display process;
for the environment image stream uploaded by each display device, the following operations are performed:
determining audiences of the target information and watching time lengths of the audiences based on the environment image stream;
carrying out crowd classification on the audiences to obtain crowd classification results of the audiences;
determining the display effect of the target information on the audiences based on the crowd classification result and the watching duration of each audience;
and synthesizing the display effect of the target information on each audience under each display device to obtain the comprehensive display effect of the target information.
Optionally, in determining the audience for the target information based on the ambient image stream, the processor is caused to:
identifying a pedestrian from the stream of ambient images;
determining whether a pedestrian is a spectator of the target information based on a face orientation feature of the pedestrian.
Optionally, in the determining of the viewing duration of each viewer, the processor is caused to:
extracting, for each viewer, a viewing start image frame and a viewing end image frame in which the viewer is located from the ambient image stream based on facial orientation features of the viewer;
determining a viewing duration of the target information by the viewer based on the time stamp of the viewing start image frame and the time stamp of the viewing end image frame.
Optionally, when performing crowd classification on the audiences to obtain a crowd classification result of each audience, the processor is caused to:
for each audience, extracting an image frame where the audience is located from the environment image stream;
and inputting the image frame into a crowd classification model to obtain a crowd classification result of the audience.
Optionally, the crowd classification result includes one or more of the following: gender, age, occupation.
Optionally, a value factor corresponding to each type of information is preset, and when the display effect of the target information on the audience is determined based on the crowd classification result and the watching duration of each audience, the processor is prompted to:
determining a value factor corresponding to the target information;
and aiming at each audience, determining the display effect of the target information on the audience according to the crowd classification result of the audience, the value factor and the watching duration of the audience.
Optionally, when determining the display effect of the target information on the audience according to the crowd classification result of the audience, the value factor and the watching duration of the audience, the processor is caused to:
determining the value of the target information to the audience according to the crowd classification result of the audience and the value factor;
and determining the display effect of the target information on the audience based on the value and the watching duration of the audience.
Optionally, after obtaining the comprehensive exhibition effect of the target information, the processor is further caused to:
judging whether the comprehensive display effect meets the expected display effect or not;
if not, outputting a display adjustment prompt of the target information.
Optionally, the expected display effect is positively correlated with the display cost of the target information.
Optionally, the information is an advertisement, and the display device includes one or more of the following: outdoor advertisement display equipment, elevator room advertisement display equipment, bus stop advertisement display equipment.
In correspondence with the foregoing embodiment of the method for determining an information presentation effect, the present specification also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of:
receiving an environment image stream uploaded by the display equipment in the target information display process;
for the environment image stream uploaded by each display device, the following operations are performed:
determining audiences of the target information and watching time lengths of the audiences based on the environment image stream;
carrying out crowd classification on the audiences to obtain crowd classification results of the audiences;
determining the display effect of the target information on the audiences based on the crowd classification result and the watching duration of each audience;
and synthesizing the display effect of the target information on each audience under each display device to obtain the comprehensive display effect of the target information.
Optionally, the determining the audience of the target information based on the environmental image stream includes:
identifying a pedestrian from the stream of ambient images;
determining whether a pedestrian is a spectator of the target information based on a face orientation feature of the pedestrian.
Optionally, the determining of the viewing duration of each viewer includes:
extracting, for each viewer, a viewing start image frame and a viewing end image frame in which the viewer is located from the ambient image stream based on facial orientation features of the viewer;
determining a viewing duration of the target information by the viewer based on the time stamp of the viewing start image frame and the time stamp of the viewing end image frame.
Optionally, the performing crowd classification on the audiences to obtain a crowd classification result of each audience includes:
for each audience, extracting an image frame where the audience is located from the environment image stream;
and inputting the image frame into a crowd classification model to obtain a crowd classification result of the audience.
Optionally, the crowd classification result includes one or more of the following: gender, age, occupation.
Optionally, a value factor corresponding to each type of information is preset, and the display effect of the target information on the audience is determined based on the crowd classification result and the watching duration of each audience, including:
determining a value factor corresponding to the target information;
and aiming at each audience, determining the display effect of the target information on the audience according to the crowd classification result of the audience, the value factor and the watching duration of the audience.
Optionally, the determining, according to the crowd classification result of the audience, the value factor, and the watching duration of the audience, a display effect of the target information on the audience includes:
determining the value of the target information to the audience according to the crowd classification result of the audience and the value factor;
and determining the display effect of the target information on the audience based on the value and the watching duration of the audience.
Optionally, after obtaining the comprehensive display effect of the target information, the method further includes:
judging whether the comprehensive display effect meets the expected display effect or not;
and if not, outputting a display adjustment prompt of the target information.
Optionally, the expected display effect is positively correlated with the display cost of the target information.
Optionally, the information is an advertisement, and the display device includes one or more of the following: outdoor advertisement display equipment, elevator room advertisement display equipment, bus stop advertisement display equipment.
The foregoing description of specific embodiments has been presented for purposes of illustration and description. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The above description is only a preferred embodiment of the present disclosure, and should not be taken as limiting the present disclosure, and any modifications, equivalents, improvements, etc. made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.

Claims (17)

1. A method for determining information display effect, wherein the information is displayed by a plurality of display devices, the display devices are connected with a server, and the method is applied to the server and comprises the following steps:
receiving an environment image stream uploaded by the display equipment in the target information display process;
for the environment image stream uploaded by each display device, the following operations are performed:
determining audiences of the target information and watching time lengths of the audiences based on the environment image stream;
carrying out crowd classification on the audiences to obtain crowd classification results of the audiences;
under the condition that the corresponding relation between value factor values related to target information and the crowd classification results is preset, determining the value of the target information to the audience according to the crowd classification results of the audience and the corresponding relation;
determining the display effect of the target information on the audience based on the value score and the watching duration of the audience, wherein the display effect of the target information on the audience is in positive correlation with the value score and the watching duration of the audience respectively;
and integrating the display effect of the target information on each audience under each display device to obtain the integrated display effect of the target information.
2. The method of claim 1, the determining a viewer of the target information based on the stream of ambient images, comprising:
identifying a pedestrian from the stream of ambient images;
determining whether a pedestrian is a spectator of the target information based on a face orientation feature of the pedestrian.
3. The method of claim 1, wherein the determining of the viewing duration of each viewer comprises:
extracting, for each viewer, a viewing start image frame and a viewing end image frame in which the viewer is located from the ambient image stream based on facial orientation features of the viewer;
determining a viewing duration of the target information by the viewer based on the time stamp of the viewing start image frame and the time stamp of the viewing end image frame.
4. The method of claim 1, wherein the crowd classification of the viewers comprises:
for each audience, extracting an image frame where the audience is located from the environment image stream;
and inputting the image frame into a crowd classification model to obtain a crowd classification result of the audience.
5. The method of claim 1 or 4, wherein the population classification result comprises one or more of: gender, age, occupation.
6. The method of claim 1, after obtaining the comprehensive display effect of the target information, further comprising:
judging whether the comprehensive display effect meets the expected display effect or not;
and if not, outputting a display adjustment prompt of the target information.
7. The method of claim 6, wherein the expected display effect is positively correlated with the display cost of the target information.
8. The method of claim 1, wherein the information is an advertisement, and the display device comprises one or more of the following: outdoor advertisement display equipment, elevator room advertisement display equipment, bus stop advertisement display equipment.
9. An apparatus for determining information display effect, wherein the information is displayed by a plurality of display devices, the display devices are connected with a server, and the apparatus is applied to the server and comprises:
the receiving unit is used for receiving the environment image stream uploaded by the display equipment in the target information display process;
the execution unit is used for executing the following operations aiming at the environment image stream uploaded by each display device:
determining audiences of the target information and watching time lengths of the audiences based on the environment image stream;
carrying out crowd classification on the audiences to obtain crowd classification results of the audiences;
under the condition that the corresponding relation between value factor values related to target information and the crowd classification results is preset, determining the value of the target information to the audience according to the crowd classification results of the audience and the corresponding relation;
determining the display effect of the target information on the audience based on the value score and the watching duration of the audience, wherein the display effect of the target information on the audience is in positive correlation with the value score and the watching duration of the audience respectively;
and the determining unit integrates the display effect of the target information on each audience under each display device to obtain the integrated display effect of the target information.
10. The apparatus of claim 9, the execution unit, when determining the audience for the target information based on the stream of ambient images:
identifying a pedestrian from the stream of ambient images;
determining whether a pedestrian is a spectator of the target information based on a face orientation feature of the pedestrian.
11. The apparatus of claim 9, wherein the determining of the viewing duration of each viewer comprises:
extracting, for each viewer, a viewing start image frame and a viewing end image frame in which the viewer is located from the ambient image stream based on a face orientation feature of the viewer;
determining a viewing duration of the target information by the viewer based on the time stamp of the viewing start image frame and the time stamp of the viewing end image frame.
12. The apparatus of claim 9, wherein the execution unit, when performing the crowd classification on the viewers to obtain the crowd classification result of each viewer:
for each audience, extracting an image frame where the audience is located from the environment image stream;
and inputting the image frame into a crowd classification model to obtain a crowd classification result of the audience.
13. The apparatus of claim 9 or 12, the crowd classification result comprising one or more of: gender, age, occupation.
14. The apparatus of claim 9, further comprising:
the judging unit is used for judging whether the comprehensive display effect meets the expected display effect;
and if not, outputting a display adjustment prompt of the target information.
15. The device of claim 14, wherein the expected display effect is positively correlated with the display cost of the target information.
16. The apparatus of claim 9, wherein the information is an advertisement, and the display device comprises one or more of the following: outdoor advertisement display equipment, elevator room advertisement display equipment, bus stop advertisement display equipment.
17. An apparatus for determining an effect of information presentation, comprising:
a processor;
a memory for storing machine executable instructions;
wherein, by reading and executing machine-executable instructions stored by the memory corresponding to the determination logic of the information presentation effect, the processor is caused to:
receiving an environment image stream uploaded by the display equipment in the target information display process;
for the environment image stream uploaded by each display device, the following operations are performed:
determining audiences of the target information and watching time lengths of the audiences based on the environment image stream;
carrying out crowd classification on the audiences to obtain crowd classification results of the audiences;
under the condition that the corresponding relation between value factor values related to target information and the crowd classification results is preset, determining the value of the target information to the audiences according to the crowd classification results of the audiences and the corresponding relation;
determining the display effect of the target information on the audience based on the value score and the watching duration of the audience, wherein the display effect of the target information on the audience is in positive correlation with the value score and the watching duration of the audience respectively;
and synthesizing the display effect of the target information on each audience under each display device to obtain the comprehensive display effect of the target information.
CN202110545324.3A 2021-05-19 2021-05-19 Method and device for determining information display effect Active CN113296861B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110545324.3A CN113296861B (en) 2021-05-19 2021-05-19 Method and device for determining information display effect

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110545324.3A CN113296861B (en) 2021-05-19 2021-05-19 Method and device for determining information display effect

Publications (2)

Publication Number Publication Date
CN113296861A CN113296861A (en) 2021-08-24
CN113296861B true CN113296861B (en) 2022-09-16

Family

ID=77322764

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110545324.3A Active CN113296861B (en) 2021-05-19 2021-05-19 Method and device for determining information display effect

Country Status (1)

Country Link
CN (1) CN113296861B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106557937A (en) * 2015-09-24 2017-04-05 杭州海康威视数字技术股份有限公司 Advertisement sending method and device
CN106779814A (en) * 2016-11-28 2017-05-31 加和(北京)信息科技有限公司 A kind of advertisement placement method, business platform and media platform
CN110288395A (en) * 2019-06-20 2019-09-27 卓尔智联(武汉)研究院有限公司 Outdoor advertising position Valuation Method, electronic equipment and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106971317A (en) * 2017-03-09 2017-07-21 杨伊迪 The advertisement delivery effect evaluation analyzed based on recognition of face and big data and intelligently pushing decision-making technique
CN108764986A (en) * 2018-05-18 2018-11-06 汕头市智美科技有限公司 A kind of commercial audience information processing method, apparatus and system
US20190378171A1 (en) * 2018-06-06 2019-12-12 Walmart Apollo, Llc Targeted advertisement system
CN108985845A (en) * 2018-07-18 2018-12-11 北京旷视科技有限公司 Broadcast monitoring method, apparatus and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106557937A (en) * 2015-09-24 2017-04-05 杭州海康威视数字技术股份有限公司 Advertisement sending method and device
CN106779814A (en) * 2016-11-28 2017-05-31 加和(北京)信息科技有限公司 A kind of advertisement placement method, business platform and media platform
CN110288395A (en) * 2019-06-20 2019-09-27 卓尔智联(武汉)研究院有限公司 Outdoor advertising position Valuation Method, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN113296861A (en) 2021-08-24

Similar Documents

Publication Publication Date Title
JP7207836B2 (en) A system for evaluating audience engagement
US10346860B2 (en) Audience attendance monitoring through facial recognition
JP6260979B1 (en) Event evaluation support system, event evaluation support device, and event evaluation support program
US9466068B2 (en) System and method for determining a pupillary response to a multimedia data element
CN109635680B (en) Multitask attribute identification method and device, electronic equipment and storage medium
WO2018017836A1 (en) Live video streaming services with machine-learning based highlight replays
US11533536B2 (en) Audience attendance monitoring through facial recognition
TW201033908A (en) System and method for counting people flow
CN107851324B (en) Information processing system, information processing method, and recording medium
US10210257B2 (en) Apparatus and method for determining user attention using a deep-content-classification (DCC) system
CN111639702A (en) Multimedia data analysis method, equipment, server and readable storage medium
CN112685596B (en) Video recommendation method and device, terminal and storage medium
CN113850627A (en) Elevator advertisement display method and device and electronic equipment
CN113296861B (en) Method and device for determining information display effect
Miniakhmetova et al. An approach to personalized video summarization based on user preferences analysis
CN109151599B (en) Video processing method and device
KR102428955B1 (en) Method and System for Providing 3D Displayed Commercial Video based on Artificial Intellingence using Deep Learning
Gautam et al. Perceptive advertising using standardised facial features
CN113221002B (en) Information display method and device
CA2983339C (en) Display systems using facial recognition for viewership monitoring purposes
US11983309B2 (en) Device and method to acquire timing of blink motion performed by a dialogue device
JP7185892B2 (en) DATA PROCESSING APPARATUS, DATA PROCESSING SYSTEM, DATA PROCESSING METHOD, AND PROGRAM
CN112668384A (en) Knowledge graph construction method and system, electronic equipment and storage medium
Xia et al. Multimodal Video Saliency Analysis With User-Biased Information
CN116962750A (en) Advertisement pushing method, device, equipment and storage medium based on panoramic video

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant