CN108966002A - A kind of device and method using micro- expression adjustment volume - Google Patents

A kind of device and method using micro- expression adjustment volume Download PDF

Info

Publication number
CN108966002A
CN108966002A CN201810946430.0A CN201810946430A CN108966002A CN 108966002 A CN108966002 A CN 108966002A CN 201810946430 A CN201810946430 A CN 201810946430A CN 108966002 A CN108966002 A CN 108966002A
Authority
CN
China
Prior art keywords
video
decibel
time point
expression
supercilium
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810946430.0A
Other languages
Chinese (zh)
Other versions
CN108966002B (en
Inventor
程莞鑫
李丕丁
周祥宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Shanghai for Science and Technology
Original Assignee
University of Shanghai for Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Shanghai for Science and Technology filed Critical University of Shanghai for Science and Technology
Priority to CN201810946430.0A priority Critical patent/CN108966002B/en
Publication of CN108966002A publication Critical patent/CN108966002A/en
Application granted granted Critical
Publication of CN108966002B publication Critical patent/CN108966002B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Television Receiver Circuits (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The present invention provides a kind of device and method using micro- expression adjustment volume, and the outer playback amount of video is adjusted when the video switching in the playback terminal with playback unit and camera, for playing in playback terminal is arranged in.For device using micro- expression adjustment volume of the invention based on the method using micro- expression adjustment volume, the operating procedure of this method is as follows: step 101, having video being played on when monitoring playback terminal, starts this method;Step 102, detection terminates volume peak;Step 103, the micro- expression of the first supercilium is captured;Step 104, detection starts volume peak;Step 105, judge whether volume has and significantly increase feature;Step 106, judging result is no, is not adjusted;Step 107, judging result is yes, captures the micro- expression of the second supercilium;Step 108, judge supercilium with the presence or absence of shrinkage characteristic;Step 109, judging result is no, is not adjusted;Step 110, judging result is yes, turns volume down;Step 111, this method terminates.

Description

A kind of device and method using micro- expression adjustment volume
Technical field
The present invention relates to a kind of device using micro- expression adjustment volume and the methods using micro- expression adjustment volume.
Background technique
With video jukebox software, the prevalence of video web-pages, APP, user uses the equipment such as mobile phone, plate viewing video Behavior has incorporated daily gradually.
But these video jukebox softwares might have the unexpected increase of volume when switching plays video and cause user Discomfort, reason is difference of the audio due to respective treatment process of video itself, causes under same device voice volume, The final volume of each audio output still may be different.
The equipment of adjustment volume on the market is all external equipment, such as earphone, speaker mostly at present, and is only intended to Audio result of broadcast is improved, there is no to the processing scheme for causing volume to increase suddenly due to audio self reason.
Summary of the invention
To solve the above problems, providing a kind of device and method for adjusting playback terminal volume, present invention employs as follows Technical solution:
The present invention provides a kind of devices using micro- expression adjustment volume, are arranged in playback unit and camera In playback terminal, the video for playing in playback terminal is adjusted the outer playback amount of video when switching, which is characterized in that It include: default decibel storage unit, preset time storage unit, default volume adjustment ratio storage unit, adjustment control unit, the first video Playback action monitoring unit, the first video length acquisition unit, ending period judging part, the first video progress test section, the first video Volume storage unit, the first record time point configuration part, the first detection slot setup portion, the first comparison decibel acquisition unit, the second view Frequency playback action monitoring unit, the second video length acquisition unit, the second video progress test section, the second video volume storage unit, Two record time point configuration parts, first micro- expression acquisition unit, the second detection slot setup portion, the second comparison decibel acquisition unit, right Than decibel judging part, second micro- expression acquisition unit, supercilium comparison judging part and volume control section, the storage of decibel storage unit is preset There is preset detection decibel value, preset time storage unit is stored with the first predetermined time period and the second predetermined time period, The value range of first predetermined time period and the second predetermined time period preset volume adjustment ratio between 5~10 seconds Storage unit is stored with preset volume adjustment ratio, wherein the first video playing movement monitoring unit, which monitors playback unit, to be had The current video of broadcasting, adjustment control unit the first video length acquisition unit of control carry out detection to the playback progress of current video and obtain The first video footage is taken, and controls the broadcasting situation of the first video progress test section detection current video to obtain in real time Currently playing progress, further control ending period judging part is obtained according to the first video footage by ending judgement ratio calculating The predetermined detection time point that certain time distance is differed with the video end time is obtained, the first video volume storage unit is currently playing Progress starts multiple broadcastings that current video is successively stored by scheduled video acquisition time point when reaching predetermined detection time point Volume is less than or equal to detection point as concluding paragraph decibel value, the first record time point configuration part since concluding paragraph decibel value by Video acquisition time point corresponding to the broadcast sound volume of shellfish value was set as the first record time point, when above-mentioned currently playing progress arrives Up to above-mentioned decision condition is not met yet at the end of current video, using the time point that current video terminates as the first record time Point, the first detection slot setup portion will be set using the first record time point as the time section of the first predetermined time period of terminal It is set to the ending detection period, the first comparison decibel acquisition unit detects in the period at the end of, obtains highest concluding paragraph decibel value and make For the first comparison decibel, the second video playing movement monitoring unit has the second video of broadcasting, adjusts after monitoring current video Whole control unit controls the second video length acquisition unit and carries out detection the second video footage of acquisition to the playback progress of the second video, And control the second video progress test section and detect the broadcasting situation of the second video to obtain the second playback progress in real time, second Video volume storage unit playback unit play the second video start successively store the more of current video by video acquisition time point As beginning section decibel value, the second record time point configuration part will be greater than detection decibel in section decibel value from the beginning for a broadcast sound volume The broadcast sound volume of value corresponding video acquisition time point was set as the second record time point, first micro- expression acquisition unit, second When playback progress reached for the second record time point, the expression of the supercilium of user is obtained as the micro- table of the first supercilium by camera Feelings, the second detection slot setup portion will be set using the second record time point as the time section of the second predetermined time period of starting point It is set to the beginning detection period, the second comparison decibel acquisition unit obtains highest beginning decibel value conduct within the beginning detection period Second comparison decibel, comparison decibel judging part judge whether the first comparison decibel and the second comparison decibel have and significantly increase spy Sign, when the judging result for comparing decibel judging part is no, adjustment control unit interrupts the operation in each portion, controls the first video length Each portion that acquisition unit is successively run using the second video footage as the first video footage and after restarting, works as comparison The judging result of decibel judging part is when being, second micro- expression acquisition unit reaches the second preset time section in the second playback progress When 0.3~0.5 second after the time point of end, the expression of the supercilium of user is obtained as the micro- table of the second supercilium by camera Feelings, supercilium comparison judging part judge whether the micro- expression of the first supercilium and the micro- expression of the second supercilium have supercilium shrinkage characteristic, volume Control unit, if supercilium comparison judging part judging result be it is yes, the volume of controlling terminal is turned down in volume adjustment ratio.
Device provided by the invention using micro- expression adjustment volume, can also have such technical characteristic, wherein institute It states last 1 minute when ending judgement ratio is greater than 10 minutes with video length or last when video length was no more than 10 minutes 10% is used as video trailer duration.
Device provided by the invention using micro- expression adjustment volume, can also have such technical characteristic, wherein institute Stating and significantly increasing feature is the decibel value that the second comparison decibel the first comparison decibel increases 20dB or more.
Device provided by the invention using micro- expression adjustment volume, can also have such technical characteristic, wherein institute State supercilium shrinkage characteristic be the micro- expression of the second supercilium micro- expression of the first supercilium supercilium spacing reduce 10% with On.
Device provided by the invention using micro- expression adjustment volume, can also have such technical characteristic, wherein institute Stating video acquisition time point is the various time points for carrying out one acquisition to volume every 0.1 second.
The present invention also provides a kind of methods using micro- expression adjustment volume, are arranged with playback unit and camera Playback terminal in, the outer playback amount of the video is adjusted in when video for playing in playback terminal switching, It is characterized by comprising the following steps: step S1, monitoring the playback unit has current video being played on;Step S2 is right The playback progress of the current video carries out detection and obtains the first video footage, and detects the broadcasting situation of the current video To obtain currently playing progress in real time, further obtained according to first video footage by ending judgement ratio calculating Obtain the predetermined detection time point that certain time distance is differed with the video end time;Step S3 described works as forward sight playing Frequency starts successively to store the multiple of the current video by scheduled video acquisition time point when reaching predetermined detection time point to be broadcast Playback amount is as concluding paragraph decibel value;Step S4 is less than or equal to preset detection point since the concluding paragraph decibel value by The video acquisition time point corresponding to the broadcast sound volume of shellfish value was set as the first record time point, when it is described it is currently playing into Degree does not meet above-mentioned decision condition at the end of reaching current video yet, using the time point that the current video terminates as described the One record time point;Step S5 is set using the first record time point as the time section of the first predetermined time period of terminal It is set to the ending detection period;Step S6 obtains the highest concluding paragraph decibel value as the within the ending detection period A pair compares decibel;Step S7 has the second video of broadcasting after monitoring the current video;Step S8, to described second The playback progress of video carries out detection and obtains the second video footage, and detects the broadcasting situation of second video in real time Ground obtains the second playback progress;Step S9 starts successively to deposit by the video acquisition time point in broadcasting second video Multiple broadcast sound volumes of the current video are stored up as beginning section decibel value;Step S10, will be big from the beginning section decibel value It was set as the second record time point in the broadcast sound volume corresponding video acquisition time point of the detection decibel value;Step S11 obtains the expression of the supercilium of user by the camera when second playback progress reached for the second record time point As the micro- expression of the first supercilium;Step S12, using the second record time point as the time of the second predetermined time period of starting point Section is set as the beginning detection period;Step S13 obtains the highest beginning decibel value within the beginning detection period As the second comparison decibel;Step S14, judges whether the first comparison decibel and the second comparison decibel have significant increasing Strong feature;Step S15 interrupts the operation of each step when the judgment result is no, using the second video footage as the first video Total length simultaneously restarts step S2 and each step successively run later;Step S16, when the judgment result is yes, in institute When stating 0.3~0.5 second after the second playback progress reaches the time point that second preset time section terminates, taken the photograph by described As head obtains the expression of the supercilium of user as the micro- expression of the second supercilium;Step S17 judges the micro- expression of first supercilium and institute State whether the micro- expression of the second supercilium has supercilium shrinkage characteristic, step S18 if the determination result is YES then controls the terminal Volume is turned down in preset volume adjustment ratio.
Invention action and effect
Device according to the present invention using micro- expression adjustment volume, it is whole to be mounted on the broadcasting with camera and playback unit In end, when device enables, the volume of next video of playback terminal video being played on and switching is acquired, is led to It crosses the volume comparison of two videos, judges whether the volume of front and back has apparent enhancing, to micro- table of user if having Feelings are acquired, and the image by handling micro- expression analyzes the subconscious feeling of user with this, are finally completed and are turned down volume Movement.Cause volume to be uprushed so as to avoid video switching and cause the situation of user's discomfort, certain protection can also be played and used The effect of family ear.
Detailed description of the invention
Fig. 1 is the structural block diagram of the device of the invention using micro- expression adjustment volume;And
Fig. 2 is the flow chart of the method for the invention using micro- expression adjustment volume.
Specific embodiment
Illustrate a specific embodiment of the invention below in conjunction with attached drawing.
<embodiment>
Based on the method using micro- expression adjustment volume, setting exists the device using micro- expression adjustment volume of the present embodiment In playback terminal with camera and playback unit, place is adjusted for uprushing to volume caused by playback unit Switch Video Reason.
As shown in Figure 1, the device 1 using micro- expression adjustment volume of the present embodiment includes:
Default decibel storage unit 11, preset time storage unit 12, default volume adjustment ratio storage unit 13, adjustment control unit 14, when the first video playing movement monitoring unit 15, the first video length acquisition unit 16, the first video progress test section 17, ending Section judging part 18, the first video volume storage unit 19, first record time point configuration part 20, first detect slot setup portion 21, First comparison decibel acquisition unit 22, the second video playing movement monitoring unit 23, the second video length acquisition unit 24, the second video into Spend test section 25, the second video volume storage unit 26, second record time point configuration part 27, first micro- expression acquisition unit 28, the Two detection slot setup portions 29, second compare decibel acquisition units 30, comparison decibel judging part 31, second micro- expression acquisition unit 32, Supercilium compares the systems control division 35 of judging part 33, volume control section 34 and the above-mentioned each portion's operation of control.
Default decibel storage unit 11 is stored with preset detection decibel value, which plays for detecting in terminal Video whether no longer generate volume, which generally can obtain due effect in 35dB or less.
Preset time storage unit 12 is stored with the first predetermined time period and the second predetermined time period, first it is default when Between length and the value range of the second predetermined time period between 5~10 seconds, predetermined time period is for confining video sound The judgement section of the decibel value of amount.
Default volume adjustment ratio storage unit 13 is stored with preset volume adjustment ratio, the volume adjustment ratio can by with Family is preset, for adjusting the amplitude size of each volume adjustment.
First video playing movement monitoring unit 14 has monitored whether current video being played on.
After having monitored video playing, adjustment control unit 15 will control the first video length acquisition unit 16 to working as forward sight The playback progress of frequency carries out detection and obtains the first video footage, and controls the first video progress test section 17 and detect current video Broadcasting situation to obtaining currently playing progress in real time, further control ending period judging part 18 is total according to the first video Length is calculated by ending judgement ratio and obtains the predetermined detection time point for differing certain time distance with the video end time.
First video volume storage unit 19 starts when currently playing progress reaches predetermined detection time point by scheduled view Frequency acquisition time successively stores multiple broadcast sound volumes of current video as concluding paragraph decibel value, which is The various time points of one acquisition were carried out to video every 0.1 second.
First record time point configuration part 20 is less than or equal to the broadcasting of detection decibel value since concluding paragraph decibel value by Video acquisition time point corresponding to volume was set as the first record time point, at the end of playback progress reaches current video still Above-mentioned decision condition is not met, using the time point that current video terminates as the first record time point.First record time Point setting whether start silence for detecting the broadcast sound volume of current video, evade the video trailer issuable noise elimination phase or It declines the sound phase.
First detection slot setup portion 21, will be using the first record time point as the time of the first predetermined time period of terminal Section is set as the ending detection period.
First comparison decibel acquisition unit 22, detects in the period at the end of, obtains highest concluding paragraph decibel value as first Compare decibel.
Second video playing movement monitoring unit 23 has the second video of broadcasting after monitoring current video, if not having If the present embodiment system can enter standby mode and start the first video playing act monitoring unit 14.
Adjustment control unit 14 controls the second video length acquisition unit 24 and carries out detection acquisition to the playback progress of the second video Second video footage, and control the second video progress test section 25 and detect the broadcasting situation of the second video to obtain in real time Second playback progress.
Second video volume storage unit 26 starts successively to deposit by video acquisition time point playback unit the second video of broadcasting Multiple broadcast sound volumes of current video are stored up as beginning section decibel value.
The broadcast sound volume that second record time point configuration part 27 will be greater than detection decibel value in section decibel value from the beginning is corresponding Video acquisition time point be set as the second record time point.The setting at the second record time point is for evading the no volume of beginning The video of output.
First micro- expression acquisition unit 28 obtains the supercilium of user when the second playback progress reached for the second record time point Expression as the micro- expression of the first supercilium.
Second detection slot setup portion 29, will be using the second record time point as the time of the second predetermined time period of starting point Section is set as the beginning detection period.
Second comparison decibel acquisition unit 30 obtains highest beginning decibel value as second pair within the beginning detection period Than decibel.
Comparison decibel judging part 31 judges whether the first comparison decibel and the second comparison decibel have and significantly increases feature.It should Significantly increasing feature is the decibel value that the first comparison decibel increases 20dB or more compared with the first comparison decibel.
When the judging result for comparing decibel judging part 31 is no, adjustment control unit 14 interrupts the operation in each portion, control the One video length acquisition unit 16 is successively run using the second video footage as the first video footage and after restarting Each portion.
When the judging result for comparing decibel judging part 31 is to be, second micro- expression acquisition unit 32 is arrived in the second playback progress When 0.3~0.5 second after the time point terminated up to the second preset time section, the expression of the supercilium of user is obtained as the second eyebrow The micro- expression in portion.
It is special that supercilium comparison judging part judges whether the 33 first micro- expressions of supercilium and the micro- expression of the second supercilium there is supercilium to shrink Sign.Especially by acquired image and carried out binary conversion treatment, canny algorithm extraction boundary, according to two eyebrow of supercilium The distance on boundary calculate the brows spacing of two brows in the micro- expression of the second supercilium relative to it in the micro- expression of the first supercilium In tighten degree.
Volume control section 34, if supercilium comparison judging part judging result be it is yes, the volume of controlling terminal is by volume adjustment Ratio is turned down.
Systems control division 35 is for controlling the operation in above-mentioned each portion.
Fig. 2 is the flow chart of the method for the invention using micro- expression adjustment volume.
As shown in Fig. 2, the method 100 using micro- expression adjustment volume of the present embodiment includes the following steps:
Step 101, when monitoring playback terminal has video being played on, bring into operation this method.
Step 102, detection terminates volume peak, specifically:
Detection is carried out to the playback progress of current video and obtains the first video footage, and detects the broadcasting feelings of current video Condition is further calculated by ending judgement ratio according to the first video footage and is obtained to obtain currently playing progress in real time The predetermined detection time point of certain time distance is differed with the video end time;
Start successively to store by scheduled video acquisition time point when playing current video and reaching predetermined detection time point Multiple broadcast sound volumes of current video are as concluding paragraph decibel value;
It is less than or equal to video corresponding to the broadcast sound volume of preset detection decibel value by since concluding paragraph decibel value Acquisition time was set as the first record time point, does not meet yet at the end of currently playing progress reaches current video and above-mentioned sentences Fixed condition, using the time point that current video terminates as the first record time point;
It is set as the ending detection period by the time section of the first predetermined time period of terminal of the first record time point;
It detects in the period at the end of, obtains highest concluding paragraph decibel value as the first comparison decibel, first pair of score Shellfish terminates volume peak.
Step 103, the micro- expression of the first supercilium is captured, specifically:
There is the second video of broadcasting after monitoring current video;
Detection is carried out to the playback progress of the second video and obtains the second video footage, and detects the broadcasting feelings of the second video Condition so that obtain the second playback progress in real time;
Make in the multiple broadcast sound volumes for starting successively to store current video by video acquisition time point for playing the second video To start section decibel value;
The broadcast sound volume corresponding video acquisition time point that will be greater than detection decibel value in section decibel value from the beginning is set as Second record time point;
When the second playback progress reached for the second record time point, the expression conduct of the supercilium of user is obtained by camera The micro- expression of first supercilium.
Step 104, detection starts volume peak, specifically:
It is set as the beginning detection period by the time section of the second predetermined time period of starting point of the second record time point;
Within the beginning detection period, highest beginning decibel value is obtained as the second comparison decibel, the second comparison decibel Start volume peak.
Step 105, judge whether volume has the feature dramatically increased, specially judge the first comparison decibel and second pair Feature is significantly increased than whether decibel has.
Step 106, it when the judging result of step 105 is no, does not adjust, and terminate the fortune of each step in this method Row, using the second video footage as the first video footage and each step for restarting step 102 and successively running later Suddenly.
Step 107, when the judging result of step 105, which is, is, the micro- expression of the second supercilium is captured, specifically:
At 0.3~0.5 second after the second playback progress reaches the time point that the second preset time section terminates, by taking the photograph As head obtains the expression of the supercilium of user as the micro- expression of the second supercilium.
Step 108, judge that the micro- expression of supercilium with the presence or absence of shrinkage characteristic, specially judges the micro- expression of the first supercilium and second Whether the micro- expression of supercilium has supercilium shrinkage characteristic.
Step 109, it when the judging result of step 108 is no, does not adjust, and terminate the fortune of each step in this method Row, using the second video footage as the first video footage and each step for restarting step 102 and successively running later Suddenly.
Step 110, when the judging result of step 108, which is, is, volume is turned down according to user preset ratio.
Step 111, this method end of run, the second video footage as the first video footage and is restarted Step 102 and each step successively run later.
Embodiment action and effect
According to the device provided in this embodiment using micro- expression adjustment volume, it is arranged in camera and playback unit In playback terminal, when device enables, the volume of next video of playback terminal video being played on and switching is carried out Acquisition judges whether the volume of front and back has apparent enhancing, to user if having by comparing the volume of two videos Micro- expression be acquired, the image by handling micro- expression analyzes the subconscious feeling of user with this, finally completes and turns down The movement of volume.Cause volume to be uprushed so as to avoid video switching to cause the situation of user's discomfort, can also play certain Protect the effect of user's ear.
Judge that ratio is set according to the ending of the present embodiment, last 1 minute when being greater than 10 minutes for video length or view Last 10% when frequency duration is not more than 10 minutes, since video seldom is terminating to be left white one minute or more, before terminating with video One minute section as volume monitoring can satisfy the demand that system detects volume.
Significantly increase feature-set according to the present embodiment, for second comparison decibel compared with first comparison decibel increase 20dB with On decibel value, for the broadcast sound volume of generally suitable ear intensity, the decibel increment of 20dB will cause a little discomfort of user.
It is set according to the supercilium shrinkage characteristic of the present embodiment, is supercilium of the micro- expression of the second supercilium compared with the micro- expression of the first supercilium Spacing reduces 10% or more, and the ratio that brows spacing tightens is greater than 10% can accurately judge user under normal circumstances The case where in the presence of frowning.
It is set according to the video acquisition time point of the present embodiment, to carry out each of one acquisition to volume every 0.1 second The running that system occupies playback terminal to the excessive acquisition of volume sample can be effectively avoided in time point.
Above-described embodiment is only used for the specific embodiment illustrated the present invention, and the present invention is not limited to the above embodiments Description range.
For example, the setting main body playback terminal using the device of micro- expression adjustment volume is with camera in embodiment And the playback equipment of playback unit.But in the present invention, the playback equipment without camera can also pass through external connection Photographic device runs the device of the present embodiment.

Claims (6)

1. a kind of device using micro- expression adjustment volume, is arranged in the playback terminal with playback unit and camera, uses The outer playback amount of the video is adjusted when the video switching played in the playback terminal characterized by comprising
Default decibel storage unit, preset time storage unit, default volume adjustment ratio storage unit, adjustment control unit, the first video Playback action monitoring unit, the first video length acquisition unit, ending period judging part, the first video progress test section, the first video Volume storage unit, the first record time point configuration part, the first detection slot setup portion, the first comparison decibel acquisition unit, the second view Frequency playback action monitoring unit, the second video length acquisition unit, the second video progress test section, the second video volume storage unit, Two record time point configuration parts, first micro- expression acquisition unit, the second detection slot setup portion, the second comparison decibel acquisition unit, right Judging part and volume control section are compared than decibel judging part, second micro- expression acquisition unit, supercilium,
The default decibel storage unit is stored with preset detection decibel value,
The preset time storage unit is stored with the first predetermined time period and the second predetermined time period, and described first is default Time span and the value range of second predetermined time period between 5~10 seconds,
Default volume adjustment ratio storage unit is stored with preset volume adjustment ratio,
Wherein, the first video playing movement monitoring unit, which monitors the playback unit, current video being played on,
The adjustment control unit controls the first video length acquisition unit and detects to the playback progress of the current video Obtain the first video footage, and control the first video progress test section detect the broadcasting situation of the current video to Currently playing progress is obtained in real time, is further controlled the ending period judging part and is passed through according to first video footage Ending judgement ratio calculates the predetermined detection time point for obtaining and differing certain time distance with the video end time,
The first video volume storage unit starts when the currently playing progress reaches predetermined detection time point by scheduled Video acquisition time point successively stores multiple broadcast sound volumes of the current video as concluding paragraph decibel value,
First record time point configuration part is less than or equal to the detection decibel value since the concluding paragraph decibel value by Broadcast sound volume corresponding to the video acquisition time point be set as the first record time point, when the currently playing progress arrives Up to above-mentioned decision condition is not met yet at the end of current video, using the time point that the current video terminates as first note Time point is recorded,
First detection slot setup portion, will be using the first record time point as first predetermined time period of terminal Time section be set as ending detection the period,
The first comparison decibel acquisition unit obtains the highest concluding paragraph decibel value and makees within the ending detection period Decibel is compared for first,
The second video playing movement monitoring unit has the second video of broadcasting after monitoring the current video,
The adjustment control unit controls the second video length acquisition unit and detects to the playback progress of second video Obtain the second video footage, and control the second video progress test section detect the broadcasting situation of second video to The second playback progress is obtained in real time,
The second video volume storage unit plays when starting by the video acquisition of second video in the playback unit Between put and successively store multiple broadcast sound volumes of the current video as beginning section decibel value,
The second record time point configuration part will be greater than the broadcasting sound of the detection decibel value from the beginning section decibel value Measuring the corresponding video acquisition time point was set as the second record time point,
First micro- expression acquisition unit passes through the camera shooting when second playback progress reached for the second record time point Head obtains the expression of the supercilium of user as the micro- expression of the first supercilium,
Second detection slot setup portion, will be using the second record time point as second predetermined time period of starting point Time section be set as beginning detection the period,
The second comparison decibel acquisition unit obtains the highest beginning decibel value conduct within the beginning detection period Second comparison decibel,
The comparison decibel judging part judges that the first comparison decibel is significantly increased with whether the second comparison decibel has Feature,
When the judging result of the comparison decibel judging part is no, the adjustment control unit interrupts the operation in each portion, controls institute The first video length acquisition unit is stated successively to transport using the second video footage as the first video footage and after restarting Capable each portion,
When it is described comparison decibel judging part judging result be when, second micro- expression acquisition unit described second play into When spending 0.3~0.5 second after reaching the time point that second preset time section terminates, passes through the camera and obtain user Supercilium expression as the micro- expression of the second supercilium,
The supercilium comparison judging part judges whether the micro- expression of the first supercilium and the micro- expression of the second supercilium have supercilium Shrinkage characteristic,
The volume control section, if the supercilium comparison judging part judging result be it is yes, control the volume of the terminal by institute Volume adjustment ratio is stated to turn down.
2. according to claim 1, it is characterised in that:
Wherein, it is described ending judgement ratio with video length be greater than 10 minutes when last 1 minute or video length be not more than 10 Last 10% when minute is used as video trailer duration.
3. according to claim 1, it is characterised in that:
Wherein, the feature that significantly increases is that the second comparison decibel the first comparison decibel increases 20dB's or more Decibel value.
4. according to claim 1, it is characterised in that:
Wherein, the supercilium shrinkage characteristic is that the supercilium spacing of the micro- expression of the second supercilium micro- expression of the first supercilium contracts It is small by 10% or more.
5. according to claim 1, it is characterised in that:
Wherein, the video acquisition time point is the various time points for carrying out one acquisition to volume every 0.1 second.
6. a kind of method using micro- expression adjustment volume, is arranged in the playback terminal with playback unit and camera, uses The outer playback amount of the video is adjusted when the video switching played in the playback terminal, which is characterized in that including Following steps:
Step S1, monitoring the playback unit has current video being played on;
Step S2 carries out detection to the playback progress of the current video and obtains the first video footage, and detects described current The broadcasting situation of video further passes through ending according to first video footage to obtain currently playing progress in real time Judgement ratio calculates the predetermined detection time point for obtaining and differing certain time distance with the video end time;
Step S3, start when playing the current video and reaching predetermined detection time point by scheduled video acquisition time point according to Multiple broadcast sound volumes of the secondary storage current video are as concluding paragraph decibel value;
Step S4 is less than or equal to corresponding to the preset broadcast sound volume for detecting decibel value since the concluding paragraph decibel value by The video acquisition time point be set as the first record time point, at the end of the currently playing progress reaches current video Above-mentioned decision condition is not met yet, using the time point that the current video terminates as the first record time point;
Step S5 is set as ending inspection using the first record time point as the time section of the first predetermined time period of terminal Survey the period;
Step S6 obtains the highest concluding paragraph decibel value as the first comparison decibel within the ending detection period;
Step S7 has the second video of broadcasting after monitoring the current video;
Step S8 carries out detection to the playback progress of second video and obtains the second video footage, and detects described second The broadcasting situation of video so that obtain the second playback progress in real time;
Step S9, play second video start successively store the current video by the video acquisition time point Multiple broadcast sound volumes are as beginning section decibel value;
Step S10 will be greater than the corresponding video of broadcast sound volume of the detection decibel value from the beginning section decibel value Acquisition time was set as the second record time point;
Step S11 obtains the eyebrow of user by the camera when second playback progress reached for the second record time point The expression in portion is as the micro- expression of the first supercilium;
Step S12 is set as starting using the second record time point as the time section of the second predetermined time period of starting point Detect the period;
Step S13 obtains the highest beginning decibel value as the second comparison decibel within the beginning detection period;
Step S14 judges whether the first comparison decibel and the second comparison decibel have and significantly increases feature;
Step S15 interrupts the operation of each step when the judgment result is no, and the second video footage is total as the first video Length simultaneously restarts step S2 and each step successively run later;
Step S16 reaches what second preset time section terminated in second playback progress when the judgment result is yes When 0.3~0.5 second after time point, the expression of the supercilium of user is obtained as the micro- expression of the second supercilium by the camera;
Step S17, judges whether the micro- expression of the first supercilium and the micro- expression of the second supercilium have supercilium shrinkage characteristic;
Step S18, if the determination result is YES, the then volume for controlling the terminal are turned down in preset volume adjustment ratio.
CN201810946430.0A 2018-08-20 2018-08-20 Device and method for adjusting volume by using micro expression Active CN108966002B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810946430.0A CN108966002B (en) 2018-08-20 2018-08-20 Device and method for adjusting volume by using micro expression

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810946430.0A CN108966002B (en) 2018-08-20 2018-08-20 Device and method for adjusting volume by using micro expression

Publications (2)

Publication Number Publication Date
CN108966002A true CN108966002A (en) 2018-12-07
CN108966002B CN108966002B (en) 2020-11-03

Family

ID=64469684

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810946430.0A Active CN108966002B (en) 2018-08-20 2018-08-20 Device and method for adjusting volume by using micro expression

Country Status (1)

Country Link
CN (1) CN108966002B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112019929A (en) * 2019-05-31 2020-12-01 腾讯科技(深圳)有限公司 Volume adjusting method and device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160073153A1 (en) * 2013-06-27 2016-03-10 Verizon Patent And Licensing Inc. Automated audio adjustment
CN105812581A (en) * 2016-05-12 2016-07-27 乐视控股(北京)有限公司 Volume automatic adjustment method and device
CN105828100A (en) * 2016-03-21 2016-08-03 乐视网信息技术(北京)股份有限公司 Audio and video files simultaneous playing method, device and system
CN106331338A (en) * 2016-08-22 2017-01-11 北京小米移动软件有限公司 Volume adjusting method and device
CN106961522A (en) * 2017-03-29 2017-07-18 深圳市九洲电器有限公司 Set top box dynamic regulation method and system
CN107493501A (en) * 2017-08-10 2017-12-19 上海斐讯数据通信技术有限公司 A kind of audio-video frequency content filtration system and method
CN107509021A (en) * 2017-07-18 2017-12-22 咪咕文化科技有限公司 Shooting method, shooting device and storage medium
CN107820122A (en) * 2017-10-09 2018-03-20 惠州Tcl移动通信有限公司 A kind of video volume adjusting method, storage medium and mobile terminal

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160073153A1 (en) * 2013-06-27 2016-03-10 Verizon Patent And Licensing Inc. Automated audio adjustment
CN105828100A (en) * 2016-03-21 2016-08-03 乐视网信息技术(北京)股份有限公司 Audio and video files simultaneous playing method, device and system
CN105812581A (en) * 2016-05-12 2016-07-27 乐视控股(北京)有限公司 Volume automatic adjustment method and device
CN106331338A (en) * 2016-08-22 2017-01-11 北京小米移动软件有限公司 Volume adjusting method and device
CN106961522A (en) * 2017-03-29 2017-07-18 深圳市九洲电器有限公司 Set top box dynamic regulation method and system
CN107509021A (en) * 2017-07-18 2017-12-22 咪咕文化科技有限公司 Shooting method, shooting device and storage medium
CN107493501A (en) * 2017-08-10 2017-12-19 上海斐讯数据通信技术有限公司 A kind of audio-video frequency content filtration system and method
CN107820122A (en) * 2017-10-09 2018-03-20 惠州Tcl移动通信有限公司 A kind of video volume adjusting method, storage medium and mobile terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李丕丁,周祥宇: "《基于IP网络视频会议技术的社区监护系统研究》", 《微计算机信息》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112019929A (en) * 2019-05-31 2020-12-01 腾讯科技(深圳)有限公司 Volume adjusting method and device

Also Published As

Publication number Publication date
CN108966002B (en) 2020-11-03

Similar Documents

Publication Publication Date Title
US9591354B2 (en) Television volume control method and system
US8139165B2 (en) Television receiver
US8645985B2 (en) System and method for detecting user attention
CN109167877B (en) Terminal screen control method and device, terminal equipment and storage medium
US20030016945A1 (en) Apparatus and method for summarizing video information, and processing program for summarizing video information
KR20070088773A (en) Intelligent pause button
US20140078404A1 (en) Method and system for automatically adjusting television volume, television set and television remote controller
WO2010021373A1 (en) Image display device, control method and computer program
CN106507168A (en) A kind of video broadcasting method and device
CN106020510A (en) Control method and device of terminal
US20190306563A1 (en) Automatic activation of closed captioning for low volume periods
CN108965831B (en) Video processing method and device and intelligent visual doorbell
CN110868609B (en) Method for monitoring and standardizing live video
CN108307238A (en) A kind of video playing control method, system and equipment
CN106534879A (en) Live broadcasting switching method and system based on attention
WO2021120675A1 (en) Video playback method and device, and storage medium
CN107645630B (en) Image pickup processing method and device
CN108966002A (en) A kind of device and method using micro- expression adjustment volume
CN106101434A (en) Screen brightness regulation method, device and terminal
EP2509333A1 (en) Information processing apparatus, information processing method, and program for synchronized playback on multiple devices
US20210203295A1 (en) Apparatus and method for automatic volume control with ambient noise compensation
US20170374463A1 (en) Audio signal processing device, audio signal processing method, and storage medium
CN108769799B (en) Information processing method and electronic equipment
CN108366297B (en) Method and device for following terminal information and smart television
CN104469250B (en) A kind of information processing method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant