CN108694384A - A kind of viewer satisfaction investigation apparatus and method based on image and sound - Google Patents
A kind of viewer satisfaction investigation apparatus and method based on image and sound Download PDFInfo
- Publication number
- CN108694384A CN108694384A CN201810456382.7A CN201810456382A CN108694384A CN 108694384 A CN108694384 A CN 108694384A CN 201810456382 A CN201810456382 A CN 201810456382A CN 108694384 A CN108694384 A CN 108694384A
- Authority
- CN
- China
- Prior art keywords
- volume
- module
- spectators
- program category
- facial expression
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H17/00—Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves, not provided for in the preceding groups
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
Abstract
The present invention provides a kind of viewer satisfaction investigation apparatus and method based on image and sound, including CCD camera, human facial expression recognition statistical module, speaker volume feedback module, live volume acquisition module, spectators' wave volume metering module, program category recording module, central processing module and the human facial expression recognition statistical module, speaker volume feedback module, live volume acquisition module, program category recording module connects, central processing module reads the data of modules according to the program category of program category recording module typing, and viewer satisfaction is evaluated.
Description
Technical field
The invention belongs to technical field intelligent identification technology field more particularly to a kind of spectators based on image and sound are full
Meaning degree investigation apparatus and method.
Background technology
It is current in the prior art, when performer performs before the lights, in order to obtain satisfaction of the spectators to performance, and on the scene
In setting camera shoot the facial expression of spectators, the quantity by counting spectators smile expression determines spectators to performance
Satisfaction.
However, the program performed on stage is of all kinds, if what is performed on stage is the comedies class program such as cross-talk essay
When, determine that spectators are desirable to the satisfaction of performance by counting the quantity of spectators' smile expression, however, working as stage upper table
When what is drilled is the programs such as singing, dancing, tragedy class modern drama, determine spectators to performance by counting the quantity of spectators' smile expression
Satisfaction be worthless.
Invention content
In order to solve the above technical problems, the present invention provide a kind of viewer satisfaction investigation apparatus based on image and sound and
Method.
A kind of viewer satisfaction investigation apparatus based on image and sound, including:
Camera is used for floor spectators' facial expression.
Human facial expression recognition statistical module, the spectators' facial expression taken for reading camera, and to spectators' face
Classification is identified in expression, judges that spectators' facial expression is happy, sad, angry, frightened and without this five classes face of apparent expression
One kind in portion's emotional state, and spectator attendance of the statistics under the five classes facial expression state respectively.
Speaker volume feedback module, the volume for playing loud speaker feed back to spectators' wave volume metering module.
Live volume acquisition module is arranged in speaker housings, is used for collection site volume.
Spectators' wave volume metering module, the sound for receiving speaker volume feedback module and live volume acquisition module
Data are measured, and calculate spectators' wave volume:
LPS=10lg (100.1L P-100.1L PB)
Wherein, the speaker volume L of speaker volume feedback modulePBFor ambient noise, live volume acquisition module acquisition
Live volume LpFor total volume, spectators' wave volume LPSFor measurement object volume.
Program category recording module is used for typing program category, and program category is divided into comedy, tragedy, singing, dancing, and
Program category type information is passed into central processing module.
Central processing module is adopted with the human facial expression recognition statistical module, speaker volume feedback module, live volume
Collect module, the connection of program category recording module.
Preferably, the camera is CCD camera.
A kind of viewer satisfaction investigation method of the viewer satisfaction investigation apparatus based on image and sound, including following step
Suddenly:
Camera floor spectators' facial expression.
Human facial expression recognition statistical module reads spectators' facial expression for taking of camera, and to spectators' facial expression into
Identification of going is classified, and judges that spectators' facial expression is happy, sad, angry, frightened and without this five classes facial expression of apparent expression
One kind in state, and spectator attendance of the statistics under the five classes facial expression state respectively.
The volume that loud speaker plays is fed back to spectators' wave volume metering module by speaker volume feedback module.
Live volume acquisition module collection site volume.
Spectators' wave volume metering module receives the volume number of speaker volume feedback module and live volume acquisition module
According to, and calculate spectators' wave volume:
LPS=10lg (100.1L P-100.1L PB)
Wherein, the speaker volume L of speaker volume feedback modulePBFor ambient noise, live volume acquisition module acquisition
Live volume LpFor total volume, spectators' wave volume LPSFor measurement object volume.
Program category recording module typing program category, program category are divided into comedy, tragedy, singing, dancing, and by program
Type information delivery is to central processing module.
Central processing module reads the program category of program category recording module.
If program category is comedy, central processing module reads the table of spectators' happiness of human facial expression recognition statistical module
The volume data of feelings quantity and spectators' wave volume metering module, the expression number of the quality and spectators' happiness of comedy class program
Measure positive correlation, the volume data positive correlation with spectators' wave volume metering module.
If program category is tragedy, central processing module reads spectators' sad expression of human facial expression recognition statistical module
The volume data of quantity and spectators' wave volume metering module, the table of the quality and spectators' sadness and indignation of tragedy class program
Feelings quantity positive correlation, it is negatively correlated with the volume data of spectators' wave volume metering module.
If program category is to sing, central processing module reads the volume data of spectators' wave volume metering module, song
Sing the volume data positive correlation of the quality and spectators' wave volume metering module of class program.
If program category is dancing, central processing module reads the volume data of spectators' wave volume metering module, dance
Step the volume data positive correlation of the quality and spectators' wave volume metering module of class program.
Description of the drawings
Fig. 1 is a kind of work flow diagram of the viewer satisfaction investigation apparatus based on image and sound.
Specific implementation mode
Below in conjunction with the accompanying drawings, it elaborates to embodiment.
A kind of operation principle of viewer satisfaction investigation apparatus based on image and sound of the present invention is as shown in Figure 1.
The present invention a kind of viewer satisfaction investigation apparatus based on image and sound include:
CCD camera is used for floor spectators' facial expression.
Human facial expression recognition statistical module, the spectators' facial expression taken for reading CCD camera, and to spectators face
Classification is identified in portion's expression, judges that spectators' facial expression is happy, sad, angry, frightened and without this five class of apparent expression
Facial expression which kind of, and spectator attendance of the statistics under the five class facial expression states respectively, and feed back to centre
Manage module.
Speaker volume feedback module, the volume for playing loud speaker feed back to spectators' wave volume metering module.
Live volume acquisition module is arranged in speaker housings, for collection site volume and feeds back to central processing
Module.Live sound includes the sound that loud speaker plays and the sound that spectators send out, so live volume is by spectators' wave volume
The wave volume played with loud speaker is formed by stacking.
Spectators' wave volume metering module, the sound for receiving speaker volume feedback module and live volume acquisition module
Data are measured, and calculate spectators' wave volume.
LPS=10lg (100.1L P-100.1L PB)
Wherein, the speaker volume L of speaker volume feedback modulePBFor ambient noise, live volume acquisition module acquisition
Live volume LpFor total volume, spectators' wave volume LPSFor measurement object volume.
Program category recording module is used for typing program category.Program category is comedy, tragedy, singing, dancing, and is incited somebody to action
Program category type information passes to central processing module.
Central processing module acquires mould with human facial expression recognition statistical module, speaker volume feedback module, live volume
Block, the connection of program category recording module.
A kind of viewer satisfaction investigation apparatus workflow based on image and sound of the present invention is as follows.
When work, central processing module reads the program category of program category recording module first.
For good comedy class program, spectators can be made happy expression occur, and send out laugh, applause and cheer
Sound.So if program category is comedy, central processing module reads the table of spectators' happiness of human facial expression recognition statistical module
The volume data of feelings quantity and spectators' wave volume metering module.The expression number of the quality and spectators' happiness of comedy class program
Measure positive correlation, the volume data positive correlation with spectators' wave volume metering module.
For good tragedy class program, spectators can be made the expression of sad indignation occur, when spectators are in sad state,
On-the-spot meeting becomes quiet.So if program category is tragedy, central processing module reads human facial expression recognition statistical module
The volume data of spectators' sad expression quantity and spectators' wave volume metering module.The quality of tragedy class program is sad with spectators
The expression quantity positive correlation of wound and indignation, it is negatively correlated with the volume data of spectators' wave volume metering module.
Class program is sung for good, can so that spectators send out applause, sound of cheer and and then singer sings together, and spectators
Expression it is relative complex, as the difference of types of songs will appear different expressions.So if program category is to sing, in
Processing module is entreated to read the volume data of spectators' wave volume metering module.Sing the quality and spectators' sound sound of class program
Measure the volume data positive correlation of metering module.
For good dancing class program, spectators can be made to send out applause, sound of cheer, and the expression of spectators is relative complex, with
The difference for types of songs will appear different expressions.So if program category is dancing, central processing module reads spectators
The volume data of wave volume metering module.The volume number of the quality and spectators' wave volume metering module of dancing class program
According to positive correlation.
Above-described embodiment is merely preferred embodiments of the present invention, but protection scope of the present invention is not limited to
This, any one skilled in the art in the technical scope disclosed by the present invention, the variation that can readily occur in or replaces
It changes, should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with the protection model of claim
Subject to enclosing.
Claims (4)
1. a kind of viewer satisfaction investigation apparatus based on image and sound, which is characterized in that including:
Camera is used for floor spectators' facial expression;
Human facial expression recognition statistical module, the spectators' facial expression taken for reading the camera, and to spectators' face
Classification is identified in expression, judges that spectators' facial expression is happy, sad, angry, frightened and without this five classes face of apparent expression
One kind in portion's emotional state, and spectator attendance of the statistics under the five classes facial expression state respectively;
Speaker volume feedback module, the volume for playing loud speaker feed back to spectators' wave volume metering module;
Live volume acquisition module is arranged on the shell described in loud speaker, is used for collection site volume;
Spectators' wave volume metering module, the volume number for receiving speaker volume feedback module and live volume acquisition module
According to, and calculate spectators' wave volume:
LPS=10lg (100.1L P-100.1L PB)
Wherein, the speaker volume L of speaker volume feedback modulePBFor ambient noise, live volume acquisition module acquisition shows
Field volume LpFor total volume, spectators' wave volume LPSFor measurement object volume;
Program category recording module is used for typing program category, and program category is divided into comedy, tragedy, singing, dancing, and will section
Mesh type information delivery is to central processing module;
Central processing module acquires mould with the human facial expression recognition statistical module, speaker volume feedback module, live volume
Block, the connection of program category recording module, central processing module read each according to the program category of program category recording module typing
The data of a module, and viewer satisfaction is evaluated.
2. according to a kind of viewer satisfaction investigation apparatus based on image and sound described in claim 1, which is characterized in that
The camera is CCD camera.
3. a kind of viewer satisfaction investigation method of the viewer satisfaction investigation apparatus based on image and sound, which is characterized in that
Include the following steps:
Camera floor spectators' facial expression;
Human facial expression recognition statistical module reads spectators' facial expression that camera takes, and knows to spectators' facial expression
Do not classify, judges that spectators' facial expression is happy, sad, angry, frightened and without this five classes facial expression state of apparent expression
In one kind, and spectator attendance of the statistics under the five classes facial expression state respectively;
The volume that loud speaker plays is fed back to spectators' wave volume metering module by speaker volume feedback module;
Live volume acquisition module collection site volume;
Spectators' wave volume metering module receives the volume data of speaker volume feedback module and live volume acquisition module, and
Calculate spectators' wave volume:
LPS=10lg (100.1L P-100.1L PB)
Wherein, the speaker volume L of speaker volume feedback modulePBFor ambient noise, live volume acquisition module acquisition shows
Field volume LpFor total volume, spectators' wave volume LPSFor measurement object volume;
Program category recording module typing program category, program category are divided into comedy, tragedy, singing, dancing, and by program category
Information passes to central processing module;
Central processing module reads the program category of program category recording module;
If program category is comedy, central processing module reads the expression number of spectators' happiness of human facial expression recognition statistical module
The volume data of amount and spectators' wave volume metering module, the quality of comedy class program and the expression quantity of spectators' happiness are just
Correlation, the volume data positive correlation with spectators' wave volume metering module;
If program category is tragedy, central processing module reads spectators' sad expression quantity of human facial expression recognition statistical module
With the volume data of spectators' wave volume metering module, the expression number of the quality and spectators' sadness and indignation of tragedy class program
Positive correlation is measured, it is negatively correlated with the volume data of spectators' wave volume metering module;
If program category is to sing, central processing module reads the volume data of spectators' wave volume metering module, sings class
The volume data positive correlation of the quality and spectators' wave volume metering module of program;
If program category is dancing, central processing module reads the volume data of spectators' wave volume metering module, dancing class
The volume data positive correlation of the quality and spectators' wave volume metering module of program.
4. according to a kind of viewer satisfaction investigation method based on image and sound described in claim 3, which is characterized in that
The camera is CCD camera.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810456382.7A CN108694384A (en) | 2018-05-14 | 2018-05-14 | A kind of viewer satisfaction investigation apparatus and method based on image and sound |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810456382.7A CN108694384A (en) | 2018-05-14 | 2018-05-14 | A kind of viewer satisfaction investigation apparatus and method based on image and sound |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108694384A true CN108694384A (en) | 2018-10-23 |
Family
ID=63846439
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810456382.7A Withdrawn CN108694384A (en) | 2018-05-14 | 2018-05-14 | A kind of viewer satisfaction investigation apparatus and method based on image and sound |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108694384A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111639511A (en) * | 2019-09-26 | 2020-09-08 | 窦翠云 | Stage effect field recognition system and method |
| CN114630238A (en) * | 2022-03-15 | 2022-06-14 | 广州康盛网络科技有限公司 | Stage loudspeaker box volume control method and device, electronic equipment and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1662922A (en) * | 2002-06-27 | 2005-08-31 | 皇家飞利浦电子股份有限公司 | Measurement of content ratings through vision and speech recognition |
| CN103258194A (en) * | 2013-05-30 | 2013-08-21 | 苏州福丰科技有限公司 | Satisfaction survey method and device |
| CN103425755A (en) * | 2013-07-31 | 2013-12-04 | 王永恒 | Method based on microblogs for analyzing audience rating situations of television programs |
| CN104123579A (en) * | 2014-08-12 | 2014-10-29 | 中国电影科学技术研究所 | System for evaluating showing effect of theatrical film and intelligently counting number of film watching people |
| CN104170006A (en) * | 2012-04-18 | 2014-11-26 | 雅马哈株式会社 | Performance evaluation device, karaoke device, and server device |
| CN105959737A (en) * | 2016-06-30 | 2016-09-21 | 乐视控股（北京）有限公司 | Video evaluation method and device based on user emotion recognition |
| CN106447155A (en) * | 2016-08-22 | 2017-02-22 | 北京网智天元科技股份有限公司 | Movie evaluation method based on on-site voice recognition |
-
2018
- 2018-05-14 CN CN201810456382.7A patent/CN108694384A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1662922A (en) * | 2002-06-27 | 2005-08-31 | 皇家飞利浦电子股份有限公司 | Measurement of content ratings through vision and speech recognition |
| CN104170006A (en) * | 2012-04-18 | 2014-11-26 | 雅马哈株式会社 | Performance evaluation device, karaoke device, and server device |
| CN103258194A (en) * | 2013-05-30 | 2013-08-21 | 苏州福丰科技有限公司 | Satisfaction survey method and device |
| CN103425755A (en) * | 2013-07-31 | 2013-12-04 | 王永恒 | Method based on microblogs for analyzing audience rating situations of television programs |
| CN104123579A (en) * | 2014-08-12 | 2014-10-29 | 中国电影科学技术研究所 | System for evaluating showing effect of theatrical film and intelligently counting number of film watching people |
| CN105959737A (en) * | 2016-06-30 | 2016-09-21 | 乐视控股（北京）有限公司 | Video evaluation method and device based on user emotion recognition |
| CN106447155A (en) * | 2016-08-22 | 2017-02-22 | 北京网智天元科技股份有限公司 | Movie evaluation method based on on-site voice recognition |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111639511A (en) * | 2019-09-26 | 2020-09-08 | 窦翠云 | Stage effect field recognition system and method |
| CN114630238A (en) * | 2022-03-15 | 2022-06-14 | 广州康盛网络科技有限公司 | Stage loudspeaker box volume control method and device, electronic equipment and medium |
| CN114630238B (en) * | 2022-03-15 | 2024-05-17 | 广州宏牌音响有限公司 | Stage sound box volume control method and device, electronic equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200286521A1 (en) | Event Reel Generator for Video Content | |
| US7889073B2 (en) | Laugh detector and system and method for tracking an emotional response to a media presentation | |
| Aran et al. | Broadcasting oneself: Visual discovery of vlogging styles | |
| US8418193B2 (en) | Information processing terminal, information processing method, and program | |
| CN105022795B (en) | A kind of new media cloud distribution platform and its implementation towards big data | |
| EP2132624B1 (en) | Automatically generating audiovisual works | |
| JP4580925B2 (en) | Imaging apparatus and imaging system | |
| JP4655047B2 (en) | Voice evaluation device and karaoke device | |
| CN109788345A (en) | Live-broadcast control method, device, live streaming equipment and readable storage medium storing program for executing | |
| US20100014840A1 (en) | Information processing apparatus and information processing method | |
| CN109819325A (en) | Hot video marks processing method, device, computer equipment and storage medium | |
| CN107615766A (en) | System and method for creating and distributing content of multimedia | |
| WO2006129496A1 (en) | Video delivery device, video delivery method, video delivery program, and recording medium | |
| CN103839540A (en) | Method for selecting and recommending content, server, content playback apparatus, content recording apparatus | |
| WO2019058209A1 (en) | Calibration system for audience response capture and analysis of media content | |
| CN102103877A (en) | Image/video data editing apparatus and method for editing image/video data | |
| JP2007097047A (en) | Contents editing apparatus, contents editing method and contents editing program | |
| CN108694384A (en) | A kind of viewer satisfaction investigation apparatus and method based on image and sound | |
| JP2011237970A (en) | Facial expression variation measurement device, program thereof and broadcast interest level measurement device | |
| CN102473409B (en) | Reference model adaptation device, integrated circuit, AV (audio video) device | |
| CN106802913A (en) | One kind plays content recommendation method and its device | |
| CN109565618A (en) | The content distribution platform of media environment driving | |
| Korzeniowski et al. | Artist similarity with graph neural networks | |
| Liu et al. | Major cast detection in video using both speaker and face information | |
| CN116261009B (en) | Video detection method, device, equipment and medium for intelligently converting video audience |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20181023 |
|
| WW01 | Invention patent application withdrawn after publication |