CN104254019B - information push result detection method and system - Google Patents

information push result detection method and system Download PDF

Info

Publication number
CN104254019B
CN104254019B CN201310269467.1A CN201310269467A CN104254019B CN 104254019 B CN104254019 B CN 104254019B CN 201310269467 A CN201310269467 A CN 201310269467A CN 104254019 B CN104254019 B CN 104254019B
Authority
CN
China
Prior art keywords
information
face
video
display information
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310269467.1A
Other languages
Chinese (zh)
Other versions
CN104254019A (en
Inventor
苗广艺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huaduo Network Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN201310269467.1A priority Critical patent/CN104254019B/en
Publication of CN104254019A publication Critical patent/CN104254019A/en
Application granted granted Critical
Publication of CN104254019B publication Critical patent/CN104254019B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

an information push result detection method comprises the following steps: determining time information played by the tested display information in each time within the detection time period; acquiring video clips corresponding to the playing processes of the tested display information from the acquired video data according to the time information; respectively identifying the face information for watching the tested display information from each video clip; and clustering the face information to obtain the information of the viewer who actually views the measured display information. The invention also provides an information push result detection system, and by adopting the technology of the invention, the influence of repeated viewers on the detection process is avoided, the detection precision of the displayed information push result is improved, and the receiving condition of the viewers can be reflected more objectively and truly.

Description

Information push result detection method and system
Technical Field
The present invention relates to the field of information push technologies, and in particular, to a method and a system for detecting an information push result.
Background
The display information pushing is a process of pushing to a recipient through various technical means, and in the pushing process, in order to obtain an actual receiving situation of the pushed recipient, a pushing result is often required to be detected through related technical means, so that a related reference can be provided for later pushing, or an application related to the pushed display information is executed, and the like.
For example, in advertisement display information pushing, for building screen advertisements, a camera is installed on a screen, video data in front of the screen is collected, then a face is detected from a video, the number of people passing by when the advertisement display information is played can be known, and the number of people counted is used as a pushing result.
Based on the technical analysis, for the pushed display information, the pushed display information is often repeatedly played in a circulating manner for a period of time to be pushed to a viewer, the viewer watching the display information may be repeated, the detection of the pushing result is seriously influenced by the repeated viewer, the accuracy of the detected pushing result is low, and the acceptance condition of the viewer cannot be objectively and truly reflected.
Disclosure of Invention
Based on this, it is necessary to provide an information push result detection method and system for solving the problem of low accuracy of the detected push result.
An information push result detection method comprises the following steps:
Determining time information played by the tested display information in each time within the detection time period;
Acquiring video clips corresponding to the playing processes of the tested display information from the acquired video data according to the time information;
respectively identifying the face information for watching the tested display information from each video clip;
and clustering the face information to obtain the information of the viewer who actually views the measured display information.
An information push result detection system, comprising:
the time information acquisition module is used for determining the time information played by the tested display information in each time within the detection time period;
The video clip intercepting module is used for acquiring video clips corresponding to the playing processes of the tested display information from the acquired video data according to the time information;
the face information identification module is used for identifying the face information for watching the tested display information from each video clip;
And the viewer information acquisition module is used for clustering the face information to acquire viewer information for actually watching the tested display information.
according to the information push result detection method and system, for the detected display information, video segments corresponding to each playing process are intercepted from collected video data in a detection time period, face information for watching the detected display information is identified from each video segment, faces actually watched by each video segment are determined, and then clustering processing is carried out according to the obtained face information to obtain information of viewers who actually watch the detected display information. The influence of repeated viewers on the detection process is avoided, the detection precision of the displayed information pushing result is improved, and the receiving condition of the viewers can be reflected more objectively and truly.
Drawings
FIG. 1 is a flow chart of a method for detecting an information push result according to an embodiment;
fig. 2 is a schematic structural diagram of an information push result detection system according to an embodiment.
Detailed Description
The following describes in detail a specific embodiment of the information push result detection method according to the present invention with reference to the accompanying drawings.
As shown in fig. 1, fig. 1 is a flowchart of an information push result detection method according to an embodiment, and includes the following steps:
step S10, determining the time information of each playing of the detected display information in the detection time period.
In this step, the number of times a certain segment of the tested display information is played and the time information of each playing are determined within a selected period of the testing time required to be tested.
for example, in the process of circularly pushing a plurality of advertisement display information segments, within the time of selecting and detecting, a certain segment of advertisement display information is repeatedly played for a plurality of times, and the start and end time of each playing of the segment of advertisement display information is obtained, that is, the played times and the time information of each playing can be obtained.
And step S20, acquiring video clips corresponding to each playing process of the tested display information from the acquired video data according to the time information.
in the step, the collected video data in front of the playing screen is utilized, and the video clip is intercepted from the video data according to the time information corresponding to the tested display information, so that the video clip in front of the playing screen is obtained when the tested display information is played each time.
In one embodiment, the method specifically comprises the following steps:
firstly, according to the starting and stopping time in the required detection time period, intercepting the detection video data from the collected video data.
And then, video interception is carried out on the detected video message data according to the playing start and stop time of the detected display information, and video clips corresponding to each playing process of the detected display information are obtained.
For example, for building screen advertisement display information, a camera is installed on a screen, video data before the screen is played is collected, a section of detection video data for detection is intercepted from all the collected video data according to a detection time period, then a video clip is intercepted from the video data according to time information of playing the detected advertisement display information every time and with the same time value, and a video clip synchronous with the playing of the detected display information every time is obtained.
and step S30, respectively identifying the face information for watching the tested display information from each video clip.
In this step, the face information that watches the tested display information is respectively identified from the intercepted video segments by using the face identification correlation technique, so as to determine which different faces watch the tested display information in each playing process.
In one embodiment, the identification process of step S30 may include the steps of:
Step S301, detecting a face frame picture containing a face from the video clip by a face detection technology.
Specifically, the video segments are decoded to obtain frame pictures, a face detection algorithm is used for carrying out face detection on images of each decoded frame picture, a face tracking algorithm is used for tracking the detected face, the face frame pictures containing the face are detected, and the face frame picture where each face is located and time information of the face frame picture are recorded.
step S302, detecting eye information in the face frame picture through an eye detection technology; specifically, in each frame of face frame picture, eye information is found by using a five sense organs positioning algorithm.
And step S303, acquiring a face image for watching the detected display information in each frame of face frame picture according to the eye information.
specifically, the eye information in the face frame picture is filtered, the eyes for watching the tested display information are screened out by judging the eyeball direction, and the face images and the time information thereof corresponding to the eyes are reserved.
and step S304, acquiring the face information for watching the tested display information from the watching face in the video clip.
specifically, for each section of the detected display information, based on the obtained face image, in each playing time range of the section of the detected display information, face images with overlapped time and overlapped time information are screened from the face images, and all face information for watching the detected display information and the watching time of each face are obtained.
For example, in the push result detection of the building screen advertisement display information, the collected video is decoded, and a human face detection algorithm is used for performing human face detection on each decoded frame of image. And tracking the detected face by using a face tracking algorithm, and recording all face frame pictures and time information of the face. For each tracked face, eye information is found in each frame of face frame picture by using a five sense organs positioning algorithm, and then whether eyes watch a screen or not is judged according to the direction of eyeballs. And filtering out frame pictures of which eyes do not watch the screen to obtain all the faces watching the screen and the time information of each face watching the screen.
And step S40, clustering the face information to obtain the information of the viewer who actually views the tested display information.
in this step, the face information obtained in the process of playing the detected display information each time is obtained in the above steps, all the face information in the detection time period is subjected to clustering processing, and the face information in the detection time period which has watched the detected display information is obtained, so that the character information of the viewer who actually watches the detected display information can be determined.
in one embodiment, the clustering process of step S40 may include the following steps;
Step S401, extracting a plurality of frames of face images from face frame pictures corresponding to each piece of face information; the extraction interval can be set according to actual conditions.
And step S402, marking the same ID number on the face image of the same face in the same video clip.
specifically, in the same video segment, the face images of the same face in each frame of face picture are labeled with the same ID number, so that different face images have different ID numbers, and the face images of the same face also have different ID numbers in different video segments.
step S403, clustering the face images extracted from all the video segments, combining the faces with the same ID number in different categories to obtain the categories of all the faces, and then determining the information of the viewers who actually view the tested display information according to the categories of the faces.
Specifically, all face images are clustered, because faces of the same viewer may appear in different video segments, a plurality of personal face image categories are obtained after clustering, each category corresponds to a face of the viewer, and in the clustering process, face images of the same viewer may also appear in different categories, so that the face images recorded by the ID numbers are merged if the face images of different categories have the same ID, and the categories are considered as the face images of the same viewer. The categories of all the faces are obtained after combination, each category corresponds to one viewer, and therefore the viewer information of the actually viewed display information can be determined, preferably, the viewer information comprises the number of the viewers, the viewing times of each viewer, the time length of each viewing and the like.
For example, in the above-mentioned pushing result detection of the building screen advertisement display information, all faces are clustered by using a clustering algorithm based on the face information of a specific one of the advertisement display information. Because the advertisement display information can be watched by the same person for multiple times, through clustering processing, the number of different persons who actually watch the advertisement display information can be known, and the times of watching the advertisement display information by each person and the time of watching each time are known.
In order to achieve a better clustering effect, each face extracts a plurality of face images for clustering, one face is selected every M frames in a time range for watching the face for one time of advertisement display information playing, if the time length for watching the advertisement display information is T, the extracted face images have N = T/M total number, the N faces are labeled with the same ID number, and the face images selected by different faces are labeled with different ID numbers. Clustering all the labeled face images to obtain a plurality of categories, if the face images in different categories of faces have the same ID number, indicating that the face images belong to the same face, combining the categories, and after combination, obtaining n categories, thereby determining that n viewers actually watch the advertisement display information in the detection time period, knowing the times of watching the advertisement display information by each viewer in the detection time period according to the times of the faces of each category appearing in the video segment, and obtaining the time of watching each time according to the time information recorded in the face images.
the technology of the invention can accurately detect the push result of the display information, including face information, watching times, watching time length and the like of a viewer, and can execute the application related to the display information by using the detected push result. For example, the method is used for counting the advertisement effect, and further providing reference and modulation strategy support for advertisement display information pushing, and in addition, the method can also be applied to occasions such as conferences and training, and the like, and is used for detecting the display information pushing result, and acquiring information such as the attention of participants to the display information and the acceptance degree of trainees to the display information in training.
the following describes in detail a specific embodiment of the information push result detection system according to the present invention with reference to the drawings.
As shown in fig. 2, fig. 2 is a schematic structural diagram of an information push result detection system according to an embodiment, and the schematic structural diagram includes:
The time information acquisition module is used for determining the time information played by the tested display information in each time within the detection time period;
the video clip intercepting module is used for acquiring video clips corresponding to the playing processes of the tested display information from the acquired video data according to the time information;
the face information identification module is used for identifying the face information for watching the tested display information from each video clip;
And the viewer information acquisition module is used for clustering the face information to acquire viewer information for actually watching the tested display information.
In one embodiment, the viewer information includes: the number of viewers, the number of views per viewer and the length of time of each view.
In one embodiment, the video clip intercepting module comprises:
the detection video data intercepting unit is used for intercepting the detection video data from the collected video data according to the starting and stopping moments in the required detection time period;
And the video clip intercepting unit is used for carrying out video interception on the detection video message data according to the playing starting and ending time of the detected display information to obtain video clips corresponding to each playing process of the detected display information.
In one embodiment, the face information recognition module includes:
The face detection unit is used for detecting a face frame picture containing a face from the video clip by a face detection technology;
The eye information detection unit is used for detecting the eye information in the face frame picture through an eye detection technology;
the face image acquisition unit is used for acquiring a face image for watching the detected display information in each frame of face frame picture according to the eye information;
And the face information acquisition unit is used for acquiring the face information for watching the tested display information from the face image in the video clip.
in one embodiment, the viewer information acquiring module includes:
The image extraction unit is used for extracting a plurality of frames of face images from the face frame images corresponding to each piece of face information;
the ID number labeling unit is used for labeling the same ID number of the face images of the same face in the same video clip;
the clustering processing unit is used for clustering the face images extracted from all the video segments and combining the faces with the same ID number in different classes to obtain the classes of all the faces;
And the viewer information determining unit is used for determining the viewer information for actually watching the tested display information according to the type of the human face.
the information push result detection system and the information push result detection method of the present invention correspond to each other one to one, and technical features and advantageous effects thereof described in the embodiments of the information push result detection method are applicable to the embodiments of the information push result detection system, which is described here.
it will be understood by those skilled in the art that all or part of the processes of the above embodiments and the corresponding systems may be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the above embodiments. The storage medium may be a magnetic disk, an optical disk, a Read-only Memory (ROM), a Random Access Memory (RAM), or the like.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1. An information push result detection method is characterized by comprising the following steps:
determining time information played by the tested display information in each time within the detection time period;
Acquiring video clips corresponding to the playing processes of the tested display information from the acquired video data according to the time information; the step of acquiring the video clip corresponding to each playing process of the tested display information from the collected video data according to the time information comprises the following steps: intercepting detection video data from the collected video data according to the starting and stopping time within the required detection time period; video interception is carried out on the detection video data according to the playing starting and ending time of the tested display information, and video clips corresponding to each playing process of the tested display information are obtained; the video clips are intercepted from the video data at the same time value, and the video clips which are synchronous with the playing of the tested display information each time are obtained;
Respectively identifying the face information for watching the tested display information from each video clip;
clustering the face information to obtain the information of a viewer who actually views the measured display information;
the step of clustering the face information to obtain the information of the viewer who actually views the measured display information includes:
Extracting a plurality of frames of face images from face frame pictures corresponding to each piece of face information; selecting a face image every M frames within the watching time range;
in the same video segment, the face images of the same face are marked with the same ID number, and different face images correspond to different ID numbers; the face images of the same face appear in different video clips and have different ID numbers;
clustering the face images extracted from all the video segments, and combining the faces with the same ID number in different classes to obtain the classes of all the faces;
And determining the information of the viewer who actually views the tested display information according to the type of the face.
2. The information push result detection method according to claim 1, wherein the viewer information includes: the number of viewers, the number of views per viewer and the length of time of each view.
3. The method for detecting the information push result according to claim 1, wherein the step of obtaining the video segment corresponding to each playing process of the to-be-detected presentation information from the collected video data according to the time information comprises:
intercepting detection video data from the collected video data according to the starting and stopping time within the required detection time period;
and carrying out video interception on the detected video message data according to the playing start-stop time of the detected display information to obtain video clips corresponding to each playing process of the detected display information.
4. the information push result detection method according to claim 1, wherein the step of identifying the face information for viewing the detected presentation information from the video clip comprises:
Detecting a face frame picture containing a face from the video clip by a face detection technology;
detecting eye information in the face frame picture by an eye detection technology;
acquiring a face image for watching the detected display information in each frame of face frame picture according to the eye information;
and acquiring the face information for watching the tested display information from the face image in the video clip.
5. An information push result detection system, comprising:
The time information acquisition module is used for determining the time information played by the tested display information in each time within the detection time period;
The video clip intercepting module is used for acquiring video clips corresponding to the playing processes of the tested display information from the acquired video data according to the time information; the step of acquiring the video clip corresponding to each playing process of the tested display information from the collected video data according to the time information comprises the following steps: intercepting detection video data from the collected video data according to the starting and stopping time within the required detection time period; video interception is carried out on the detection video data according to the playing starting and ending time of the tested display information, and video clips corresponding to each playing process of the tested display information are obtained; the video clips are intercepted from the video data at the same time value, and the video clips which are synchronous with the playing of the tested display information each time are obtained;
the face information identification module is used for identifying the face information for watching the tested display information from each video clip;
The viewer information acquisition module is used for clustering the face information to acquire viewer information for actually watching the tested display information;
Wherein the viewer information acquiring module includes:
the image extraction unit is used for extracting a plurality of frames of face images from the face frame images corresponding to each piece of face information; selecting a face image every M frames within the watching time range;
The ID number labeling unit is used for labeling the same ID number on the face image of the same face in the same video segment, and different face images correspond to different ID numbers; the face images of the same face appear in different video clips and have different ID numbers;
the clustering processing unit is used for clustering the face images extracted from all the video segments and combining the faces with the same ID number in different classes to obtain the classes of all the faces;
And the viewer information determining unit is used for determining the viewer information for actually watching the tested display information according to the type of the human face.
6. the information push result detection system according to claim 5, wherein the viewer information includes: the number of viewers, the number of views per viewer and the length of time of each view.
7. the information push result detection system of claim 5, wherein the video clip intercepting module comprises:
the detection video data intercepting unit is used for intercepting the detection video data from the collected video data according to the starting and stopping moments in the required detection time period;
and the video clip intercepting unit is used for carrying out video interception on the detection video message data according to the playing starting and ending time of the detected display information to obtain video clips corresponding to each playing process of the detected display information.
8. The information push result detection system according to claim 5, wherein the face information recognition module includes:
the face detection unit is used for detecting a face frame picture containing a face from the video clip by a face detection technology;
the eye information detection unit is used for detecting the eye information in the face frame picture through an eye detection technology;
The face image acquisition unit is used for acquiring a face image for watching the detected display information in each frame of face frame picture according to the eye information;
and the face information acquisition unit is used for acquiring the face information for watching the tested display information from the face image in the video clip.
9. A computer device, comprising: a memory having one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to perform the information push result detection method of any of claims 1-4.
10. a storage medium containing computer-executable instructions for performing the information push result detection method according to any one of claims 1 to 4 when executed by a computer processor.
CN201310269467.1A 2013-06-28 2013-06-28 information push result detection method and system Active CN104254019B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310269467.1A CN104254019B (en) 2013-06-28 2013-06-28 information push result detection method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310269467.1A CN104254019B (en) 2013-06-28 2013-06-28 information push result detection method and system

Publications (2)

Publication Number Publication Date
CN104254019A CN104254019A (en) 2014-12-31
CN104254019B true CN104254019B (en) 2019-12-13

Family

ID=52188493

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310269467.1A Active CN104254019B (en) 2013-06-28 2013-06-28 information push result detection method and system

Country Status (1)

Country Link
CN (1) CN104254019B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108074126A (en) * 2017-03-30 2018-05-25 北京市商汤科技开发有限公司 A kind of business statistical method, device and electronic equipment
CN107316011B (en) * 2017-05-24 2021-04-06 杭州励飞软件技术有限公司 Data processing method, device and storage medium
CN108509611B (en) * 2018-03-30 2021-11-12 百度在线网络技术(北京)有限公司 Method and device for pushing information
CN109842805B (en) * 2019-01-04 2022-10-21 平安科技(深圳)有限公司 Video viewpoint generation method and device, computer equipment and storage medium
CN111538897B (en) * 2020-03-16 2023-06-02 北京三快在线科技有限公司 Recommended abnormality detection method, recommended abnormality detection device, electronic equipment and readable storage medium
CN113965772B (en) * 2021-10-29 2024-05-10 北京百度网讯科技有限公司 Live video processing method and device, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101114339A (en) * 2007-07-17 2008-01-30 李东亚 Visual medium audiences information feedback system and method thereof
CN101237563A (en) * 2007-01-31 2008-08-06 华为技术有限公司 Method and device for getting program watcher information and program playing system
US8170269B2 (en) * 2006-03-07 2012-05-01 Sony Corporation Image processing apparatus, image processing method, and program

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101335864A (en) * 2007-06-28 2008-12-31 当代天启技术(北京)有限公司 Method and system for number of outdoor video receiving people statistic

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8170269B2 (en) * 2006-03-07 2012-05-01 Sony Corporation Image processing apparatus, image processing method, and program
CN101237563A (en) * 2007-01-31 2008-08-06 华为技术有限公司 Method and device for getting program watcher information and program playing system
CN101114339A (en) * 2007-07-17 2008-01-30 李东亚 Visual medium audiences information feedback system and method thereof

Also Published As

Publication number Publication date
CN104254019A (en) 2014-12-31

Similar Documents

Publication Publication Date Title
CN104254019B (en) information push result detection method and system
CN109670860B (en) Advertisement putting method and device, electronic equipment and computer readable storage medium
JP4934861B2 (en) Display system, display method, display effect measurement system, and display effect measurement method
US20150006281A1 (en) Information processor, information processing method, and computer-readable medium
JP2008112401A (en) Advertisement effect measurement apparatus
RU2016123130A (en) TRACKING AND ACCESS RESTRICTION
CN110047513B (en) Video monitoring method and device, electronic equipment and storage medium
CN106934650A (en) A kind of advertisement machine business diagnosis method and device
JP2007219161A (en) Presentation evaluation device and presentation evaluation method
CN107239503B (en) Video display method and device
EP3573327A1 (en) Method and device for displaying target object
US9361705B2 (en) Methods and systems for measuring group behavior
JP2010211485A (en) Gaze degree measurement device, gaze degree measurement method, gaze degree measurement program and recording medium with the same program recorded
JP2010204823A (en) Line-of-sight recognition device
CN110244923B (en) Image display method and device
KR20150033173A (en) Satisfaction reporting system using face recognition
JP5115763B2 (en) Image processing apparatus, content distribution system, image processing method, and program
CN113850627A (en) Elevator advertisement display method and device and electronic equipment
CN111669479A (en) Method and system for verifying synchronous exposure of camera and electronic equipment
US20100150447A1 (en) Description based video searching system and method
CN107135421A (en) Video features detection method and device
Josephs et al. Artifact magnification on deepfake videos increases human detection and subjective confidence
JP4879456B2 (en) Public display management system
CN102385716A (en) Reader counting system and method and advertising board with system
KR20220039871A (en) Apparatus for providing smart interactive advertisement

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 511449 Guangzhou City, Guangdong Province, Panyu District, South Village, Huambo Business District Wanda Plaza, block B1, floor 28

Applicant after: Guangzhou Huaduo Network Technology Co., Ltd.

Address before: 510655, Guangzhou, Tianhe District, Whampoa Avenue, No. 309, creative park, building 3-08

Applicant before: Guangzhou Huaduo Network Technology Co., Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant