CN109743630A - Video control method, device, electronic equipment and medium based on recognition of face - Google Patents
Video control method, device, electronic equipment and medium based on recognition of face Download PDFInfo
- Publication number
- CN109743630A CN109743630A CN201811537779.5A CN201811537779A CN109743630A CN 109743630 A CN109743630 A CN 109743630A CN 201811537779 A CN201811537779 A CN 201811537779A CN 109743630 A CN109743630 A CN 109743630A
- Authority
- CN
- China
- Prior art keywords
- video
- state
- control mode
- current
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000001815 facial effect Effects 0.000 claims abstract description 55
- 230000007958 sleep Effects 0.000 claims description 13
- 230000002085 persistent effect Effects 0.000 claims description 12
- 230000004044 response Effects 0.000 abstract description 7
- 238000004590 computer program Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 238000009434 installation Methods 0.000 description 3
- 239000002699 waste material Substances 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 235000012054 meals Nutrition 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Abstract
The present invention provides a kind of video control method based on recognition of face, device, electronic equipment and medium.The video control method based on recognition of face includes: to obtain the facial image of user in real time when playing video；The facial image is identified, the current state of the facial image is obtained；Preconfigured video domination set is obtained, the state of face images and the corresponding relationship of corresponding video control mode are store in the video domination set；According to the current state, current video control mode is obtained from the video domination set；The video is controlled with the current video control mode.The present invention can realize the automation control to video playing, response quickly, and the manual operation without complexity, video viewing experience is more preferably in conjunction with face recognition technology.
Description
Technical field
The present invention relates to field of artificial intelligence more particularly to a kind of video control methods based on recognition of face, dress
It sets, electronic equipment and medium.
Background technique
In prior art, all application programs when playing video, be all by user by touch operation or by
Press-fitting sets button to control, and when user sleeps or is away from keyboard, for inertia, it is most likely that forget to suspend or close
Video causes due to not closing video in time, and video also will continue to play, and in this case, can not only waste a large amount of view
Frequency flow also causes the unnecessary loss of terminal power, meanwhile, user is also due to leave and missed portion video, to user's
Viewing brings inconvenience, and influences user experience.
Summary of the invention
In view of the foregoing, it is necessary to provide a kind of video control method based on recognition of face, device, electronic equipment and
Medium is able to achieve the automation control to video playing, response quickly, and the manual operation without complexity, video viewing experience
More preferably.
A kind of video control method based on recognition of face, which comprises
When playing video, the facial image of user is obtained in real time；
The facial image is identified, the current state of the facial image is obtained；
Preconfigured video domination set is obtained, the state and phase of face images are store in the video domination set
Answer the corresponding relationship of video control mode；
According to the current state, current video control mode is obtained from the video domination set；
The video is controlled with the current video control mode.
Preferred embodiment according to the present invention, it is described according to the current state, it is obtained from the video domination set current
Video control mode includes:
The current state is controlled centrally stored state with the video to match, obtains dbjective state:
From the video domination set, video control mode corresponding with the dbjective state is obtained as described and works as forward sight
Frequency control mode.
Preferred embodiment according to the present invention, it is described that control packet is carried out to the video with the current video control mode
It includes:
Obtain the duration of the current state；
When the duration being more than or equal to preset duration, with the current video control mode to the video
It is controlled.
Preferred embodiment according to the present invention, described controlled with the current video control mode the video are also wrapped
It includes:
When the current state is user's leave state, pause plays the video.
Preferred embodiment according to the present invention, described controlled with the current video control mode the video are also wrapped
It includes:
When the current state is user's persistent state, start to play the video.
Preferred embodiment according to the present invention, described controlled with the current video control mode the video are also wrapped
It includes:
When the current state is sleep state, pause plays the video.
Preferred embodiment according to the present invention, after being controlled with the current video control mode the video, institute
State method further include:
At the beginning of obtaining the current state；
Determine the time started corresponding video playing progress；
When receiving the signal for continuing to play the video, the video is played according to the video playing progress.
A kind of video control device based on recognition of face, described device include:
Acquiring unit, for obtaining the facial image of user in real time when playing video；
Recognition unit obtains the current state of the facial image for identifying to the facial image；
The acquiring unit is also used to obtain preconfigured video domination set, stores institute in the video domination set
There are the state of facial image and the corresponding relationship of corresponding video control mode；
The acquiring unit is also used to according to the current state, and current video control is obtained from the video domination set
Mode processed；
Control unit, for being controlled with the current video control mode the video.
Preferred embodiment according to the present invention, the acquiring unit is according to the current state, from the video domination set
Obtaining current video control mode includes:
The current state is controlled centrally stored state with the video to match, obtains dbjective state:
From the video domination set, video control mode corresponding with the dbjective state is obtained as described and works as forward sight
Frequency control mode.
Preferred embodiment according to the present invention, described control unit are specifically used for:
Obtain the duration of the current state；
When the duration being more than or equal to preset duration, with the current video control mode to the video
It is controlled.
Preferred embodiment according to the present invention, described control unit are specifically also used to:
When the current state is user's leave state, pause plays the video.
Preferred embodiment according to the present invention, described controlled with the current video control mode the video are also wrapped
It includes:
When the current state is user's persistent state, start to play the video.
Preferred embodiment according to the present invention, described control unit are specifically also used to:
When the current state is sleep state, pause plays the video.
Preferred embodiment according to the present invention, the acquiring unit, be also used to the current video control mode to institute
It states after video controlled, at the beginning of obtaining the current state；
Described device further include:
Determination unit, for determining the time started corresponding video playing progress；
Broadcast unit, for being broadcast according to the video playing progress when receiving the signal for continuing to play the video
Put the video.
A kind of electronic equipment, the electronic equipment include:
Memory stores at least one instruction；And
Processor executes the instruction stored in the memory to realize the video controlling party based on recognition of face
Method.
A kind of computer readable storage medium is stored at least one instruction, institute in the computer readable storage medium
At least one instruction is stated to be executed by the processor in electronic equipment to realize the video control method based on recognition of face.
As can be seen from the above technical solutions, the present invention can obtain in real time the facial image of user when playing video,
To realize the real-time control to the video, using face recognition technology, further the facial image is identified, is obtained
To the current state of the facial image, according to the current state, is obtained from preconfigured video domination set and work as forward sight
Frequency control mode, and the video being controlled with the current video control mode, thus realize to video playing from
Dynamicization control, response quickly, and without complicated manual operation, video viewing experience is more preferably.
Detailed description of the invention
Fig. 1 is the flow chart of the preferred embodiment of the video control method the present invention is based on recognition of face.
Fig. 2 is the functional block diagram of the preferred embodiment of the video control device the present invention is based on recognition of face.
Fig. 3 is the structure of the electronic equipment for the preferred embodiment that the present invention realizes the video control method based on recognition of face
Schematic diagram.
Main element symbol description
| Electronic equipment | 1 |
| Memory | 12 |
| Processor | 13 |
| Video control device based on recognition of face | 11 |
| Acquiring unit | 110 |
| Recognition unit | 111 |
| Control unit | 112 |
| Determination unit | 113 |
| Broadcast unit | 114 |
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, right in the following with reference to the drawings and specific embodiments
The present invention is described in detail.
As shown in Figure 1, being the flow chart of the preferred embodiment of the video control method the present invention is based on recognition of face.According to
Different demands, the sequence of step can change in the flow chart, and certain steps can be omitted.
The video control method based on recognition of face is applied in one or more electronic equipment, and the electronics is set
Standby is that one kind can be according to the instruction for being previously set or storing, and the automatic equipment for carrying out numerical value calculating and/or information processing is hard
Part include but is not limited to microprocessor, specific integrated circuit (Application Specific Integrated Circuit,
ASIC), programmable gate array (Field-Programmable Gate Array, FPGA), digital processing unit (Digital
Signal Processor, DSP), embedded device etc..
The electronic equipment can be any electronic product that human-computer interaction can be carried out with user, for example, personal meter
Calculation machine, tablet computer, smart phone, personal digital assistant (PersonalDigital Assistant, PDA), game machine, friendship
Mutual formula Web TV (Internet Protocol Television, IPTV), intellectual wearable device etc..
The electronic equipment can also include the network equipment and/or user equipment.Wherein, the network equipment includes, but
It is not limited to single network server, the server group of multiple network servers composition or based on cloud computing (Cloud
Computing the cloud being made of a large amount of hosts or network server).
Network locating for the electronic equipment include but is not limited to internet, wide area network, Metropolitan Area Network (MAN), local area network, it is virtual specially
With network (Virtual Private Network, VPN) etc..
S10, the electronic equipment obtain the facial image of user when playing video in real time.
In prior art, all application programs when playing video, be all by user by touch operation or by
Press-fitting sets button to control, and when user sleeps or is away from keyboard, for inertia, it is most likely that forget to suspend or close
Video causes due to not closing video in time, and video also will continue to play, and in this case, can not only waste a large amount of view
Frequency flow also causes the unnecessary loss of terminal power, meanwhile, user is also due to leave and missed portion video, to user's
Viewing brings inconvenience, and influences user experience.
Therefore, in order to bring better video viewing experience to user, in the present embodiment, using recognition of face
Mode assist executing the broadcasting control of video, to realize automatic control to video playing.
In at least one embodiment of the present invention, the video may include the video that any application plays, this
Invention does not limit.
In at least one embodiment of the present invention, the electronic equipment obtains the facial image of user in real time and includes:
(1) electronic equipment opens the photographic device of the electronic equipment when playing video, with the photographic device
The facial image of the user is obtained in real time.
Such as: when the video software that user is installed in using the electronic equipment watches video, institute can be opened simultaneously
The photographic device (such as: the front camera etc. of the electronic equipment) on electronic equipment is stated, and real using the photographic device
When obtain the facial image of the user.
(2) electronic equipment is obtained when playing video by the photographic device communicated with the electronic equipment in real time
Take the facial image of the user.
Such as: many users can be the external camera shooting of the electronic equipment to get better shooting effect
Device (such as: sitting formula external camera etc.), and photographic device pendulum is had into best shooting what the user thought
The position of angle, therefore, the electronic equipment can synchronize when playing video and open external photographic device, the electronics
External photographic device described in equipment utilization obtains the facial image of the user in real time.
Specifically, the photographic device communicated with the electronic equipment may include external camera etc., the present invention
It does not limit.
S11, the electronic equipment identify the facial image, obtain the current state of the facial image.
In at least one embodiment of the present invention, the electronic equipment identifies the facial image and can adopt
With, but it is not limited to any one following mode:
Face identification method based on geometrical characteristic, the face identification method based on eigenface, people neural network based
Face recognition method, the face identification method based on elastic graph matching, the face identification method based on line segment distance, support vector machines
Face identification method etc..
Since recognition of face has been the technology of relative maturity, as long as can satisfy the need of recognition of face in this case
It asks, the present invention is with no restriction.
Specifically, the current state refers to real-time status when carrying out recognition of face, and the electronic equipment is being got
After the current state, subsequent operation can be executed according to the current state.
S12, the electronic equipment obtain preconfigured video domination set.
In at least one embodiment of the present invention, store in the video domination set states of face images with
The corresponding relationship of corresponding video control mode.
In at least one embodiment of the present invention, before obtaining the video domination set, the method also includes:
The electronic equipment configures the video domination set.
Specifically, the electronic equipment configuration video domination set includes:
The electronic equipment receives the state of the facial image of user configuration and the corresponding relationship of corresponding video control mode,
To configure the video domination set.
By above embodiment, the electronic equipment is using the configuration wish of the user as foundation, and then according to user
Use habit, the video domination set is configured, to meet the practical operation needs of user.
Specifically, the state of the facial image stored in the video domination set include, but are not limited to it is following a kind of or
The a variety of combination of person:
Leave state, persistent state, sleep state etc..
Further, the video control mode includes, but are not limited to the combination of following one or more kinds of modes:
Suspend broadcast state, start broadcast state etc..
Certainly, in other embodiments, the electronic equipment can also take other modes to configure the video domination set,
The present invention does not limit.
For example, the electronic equipment can configure the video domination set according to history configuration mode, alternatively, the electronics
Equipment obtains historical operation record, and the use habit data of the user are determined according to the historical operation record, further
Ground, electronic equipment video domination set according to the use habit data configuration of the user.
S13, according to the current state, the electronic equipment obtains current video controlling party from the video domination set
Formula.
In at least one embodiment of the present invention, due to store face images in the video domination set
The corresponding relationship of state and corresponding video control mode, therefore, the electronic equipment can be matched with the current state,
Current video control mode corresponding with the current state is got from the video domination set.
Specifically, the electronic equipment obtains current video control according to the current state from the video domination set
Mode processed includes:
The current state is controlled centrally stored state with the video and matched by the electronic equipment, obtains mesh
Mark state, and from the video domination set, video control mode corresponding with the dbjective state is obtained as described current
Video control mode.
Such as: after the electronic equipment is matched the current state A with the state in the video domination set, obtain
Getting the corresponding vision operation mode of the current state A is B, then mode of operation B is determined as described work as by the electronic equipment
Preceding video control mode.
S14, the electronic equipment control the video with the current video control mode.
In at least one embodiment of the present invention, the current video control mode is got in the electronic equipment
Afterwards, the electronic equipment can directly control the video with the current video control mode.
In other embodiments, the electronic equipment can also execute delay response.
Specifically, the electronic equipment control to the video with the current video control mode includes:
The electronic equipment obtains the duration of the current state, and when the duration is more than or equal to
When preset duration, the electronic equipment controls the video with the current video control mode.
Further, the preset duration may include, but be not limited to: 1 minute, 30 seconds etc..The preset duration can
To carry out customized setting according to personal habits by the user, with the operation being more close to the users, alternatively, the preset duration
It can also be configured by the electronic equipment, the present invention does not limit.
It is understood that the user is during watching video, in fact it could happen that many instantaneous or of short duration shapes
State, such as: when the user leans to one side to take thing or the user is due to tired, when changing a posture viewing video, this
A little situations are likely to cause the variation of user's facial image state, it is clear that the electronic equipment in these cases, is
It does not need to carry out corresponding operating to the video.
Therefore, by above embodiment, only when the duration of the current state reaching the preset duration,
The electronic equipment can just control the video with the current video control mode, exist to avoid the electronic equipment
Meaningless operation is still carried out when without responding, and is made troubles to user.
In at least one embodiment of the present invention, corresponding to different current states, the electronic equipment will take as
Under several video control modes.
Specifically, the electronic equipment controls the video with the current video control mode further include:
When the current state is user's leave state, then the electronic equipment pause plays the video.
By above embodiment, the user during watching video, if break away (such as: the use
Family is gone to take take-away, or goes to take express delivery etc.), then the electronic equipment pause plays the video, and otherwise the user will be unable to
It realizes the continuous viewing of plot in video, and missed portion video, influences viewing experience.
Preferably, the electronic equipment controls the video with the current video control mode further include:
When the current state is user's persistent state, then the electronic equipment starts to play the video.
By above embodiment, if the user is constantly in leave state, video pause is played, at this point, working as institute
When stating electronic equipment and detecting that the user is in persistent state again, then the electronic equipment starts to play the video, makes institute
User is stated without manual operation, so that it may which direct viewing video is brought convenience to user.
Such as: when the user goes to take take-away, the user is in leave state, and video pause plays, at this point, working as institute
When stating electronic equipment and detecting that the user is in persistent state again, i.e., when described user's pick-up is returned, then the electronic equipment
Start to play the video, carry out the operation such as clicking without the user, the user can have meal on one side, on one side described in viewing
Video.
Preferably, the electronic equipment controls the video with the current video control mode further include:
When the current state is sleep state, the electronic equipment pause plays the video.
By above embodiment, when the user is when watching the video, if fallen asleep or portion due to too tired
Divide the elderly to fall asleep during seeing video, and do not obtain and close the video, the electronic equipment detects the use
Family is in sleep state, then the electronic equipment pause plays the video, and the broadcasting of video is missed to avoid the user.
Preferably, described after the electronic equipment controls the video with the current video control mode
Method further include:
At the beginning of the electronic equipment obtains the current state, and determine that the time started corresponding video is broadcast
Degree of putting into, when receiving the signal for continuing to play the video, the electronic equipment is played according to the video playing progress
The video.
By above embodiment, the electronic equipment can continue to play the view at the content that the user misses
Frequently, so that the user be made to continue to watch at interruption, without refunding manually, cumbersome behaviour is not only effectively prevented
Make, while being also avoided that the loss of time caused by maloperation, user experience is more preferably.
In at least one embodiment of the present invention, the electronic equipment can also carry out the video content of specified type
Customized setting.
Such as: when the electronic equipment detects that the type of the video is song class video, and according to getting
The user is accustomed to data for the viewing of song class video, and the user will not see before the screen of the electronic equipment always
It sees, even if then the electronic equipment detects that the current state is leave state, the electronic equipment can not also control institute
It states video and enters halted state.
In conclusion the present invention can obtain in real time the facial image of user when playing video；To the facial image into
Row identification, obtains the current state of the facial image；Preconfigured video domination set is obtained, is deposited in the video domination set
Store up the state of face images and the corresponding relationship of corresponding video control mode；According to the current state, from the view
Current video control mode is obtained in frequency domination set；The video is controlled with the current video control mode.Therefore,
The present invention is able to achieve the automation control to video playing, response quickly, and the manual operation without complexity, video viewing experience
More preferably.
As shown in Fig. 2, being the functional block diagram of the preferred embodiment of the video control device the present invention is based on recognition of face.
The video control device 11 based on recognition of face includes acquiring unit 110, recognition unit 111, control unit 112, determines
Unit 113 and broadcast unit 114.So-called module/the unit of the present invention refers to that one kind can be performed by processor 13, and energy
The series of computation machine program segment of fixed function is enough completed, storage is in memory 12.In the present embodiment, about each mould
Block/unit function will be described in detail in subsequent embodiment.
Acquiring unit 110 obtains the facial image of user when playing video in real time.
In prior art, all application programs when playing video, be all by user by touch operation or by
Press-fitting sets button to control, and when user sleeps or is away from keyboard, for inertia, it is most likely that forget to suspend or close
Video causes due to not closing video in time, and video also will continue to play, and in this case, can not only waste a large amount of view
Frequency flow also causes the unnecessary loss of terminal power, meanwhile, user is also due to leave and missed portion video, to user's
Viewing brings inconvenience, and influences user experience.
Therefore, in order to bring better video viewing experience to user, in the present embodiment, using recognition of face
Mode assist executing the broadcasting control of video, to realize automatic control to video playing.
In at least one embodiment of the present invention, the video may include the video that any application plays, this
Invention does not limit.
In at least one embodiment of the present invention, the real-time facial image for obtaining user of the acquiring unit 110 includes:
(1) acquiring unit 110 opens the photographic device of the electronic equipment when playing video, with the camera shooting
Device obtains the facial image of the user in real time.
Such as: when the video software that user is installed in using the electronic equipment watches video, the acquiring unit 110
The photographic device (such as: the front camera etc. of the electronic equipment) on the electronic equipment can be opened simultaneously, it is described to obtain
Unit 110 is taken to obtain the facial image of the user in real time using the photographic device.
(2) acquiring unit 110 is real-time by the photographic device communicated with the electronic equipment when playing video
Obtain the facial image of the user.
Such as: many users can be the external camera shooting of the electronic equipment to get better shooting effect
Device (such as: sitting formula external camera etc.), and photographic device pendulum is had into best shooting what the user thought
The position of angle, therefore, the electronic equipment can synchronize when playing video and open external photographic device, the acquisition
Unit 110 obtains the facial image of the user using the external photographic device in real time.
Specifically, the photographic device communicated with the electronic equipment may include external camera etc., the present invention
It does not limit.
Recognition unit 111 identifies the facial image, and obtains the current state of the facial image.
In at least one embodiment of the present invention, identify to the facial image can be with for the recognition unit 111
Using, but it is not limited to any one following mode:
Face identification method based on geometrical characteristic, the face identification method based on eigenface, people neural network based
Face recognition method, the face identification method based on elastic graph matching, the face identification method based on line segment distance, support vector machines
Face identification method etc..
Since recognition of face has been the technology of relative maturity, as long as can satisfy the need of recognition of face in this case
It asks, the present invention is with no restriction.
Specifically, the current state refers to real-time status when carrying out recognition of face, and the recognition unit 111 is obtaining
To after the current state, subsequent operation can be executed according to the current state.
The acquiring unit 110 obtains preconfigured video domination set.
In at least one embodiment of the present invention, store in the video domination set states of face images with
The corresponding relationship of corresponding video control mode.
In at least one embodiment of the present invention, before obtaining the video domination set, the method also includes:
The electronic equipment configures the video domination set.
Specifically, the electronic equipment configuration video domination set includes:
The electronic equipment receives the state of the facial image of user configuration and the corresponding relationship of corresponding video control mode,
To configure the video domination set.
By above embodiment, the electronic equipment is using the configuration wish of the user as foundation, and then according to user
Use habit, the video domination set is configured, to meet the practical operation needs of user.
Specifically, the state of the facial image stored in the video domination set include, but are not limited to it is following a kind of or
The a variety of combination of person:
Leave state, persistent state, sleep state etc..
Further, the video control mode includes, but are not limited to the combination of following one or more kinds of modes:
Suspend broadcast state, start broadcast state etc..
Certainly, in other embodiments, the electronic equipment can also take other modes to configure the video domination set,
The present invention does not limit.
For example, the electronic equipment can configure the video domination set according to history configuration mode, alternatively, the electronics
Equipment obtains historical operation record, and the use habit data of the user are determined according to the historical operation record, further
Ground, electronic equipment video domination set according to the use habit data configuration of the user.
According to the current state, the acquiring unit 110 obtains current video controlling party from the video domination set
Formula.
In at least one embodiment of the present invention, due to store face images in the video domination set
The corresponding relationship of state and corresponding video control mode, therefore, the acquiring unit 110 can be with current state progress
Match, current video control mode corresponding with the current state is got from the video domination set.
Specifically, the acquiring unit 110 obtains current video from the video domination set according to the current state
Control mode includes:
The current state is controlled centrally stored state with the video and matched by the acquiring unit 110, into
And dbjective state is got, further, the acquiring unit 110 obtains and the target-like from the video domination set
The corresponding video control mode of state, and as the current video control mode.
Such as: the acquiring unit 110 matches the current state A with the state in the video domination set
Afterwards, getting the corresponding vision operation mode of the current state A is B, then the acquiring unit 110 is by the mode of operation B
It is determined as the current video control mode.
Control unit 112 controls the video with the current video control mode.
In at least one embodiment of the present invention, the current video controlling party is got in the acquiring unit 110
After formula, described control unit 112 can directly be controlled the video with the current video control mode.
In other embodiments, described control unit 112 can also execute delay response.
Specifically, described control unit 112 control to the video with the current video control mode includes:
Described control unit 112 obtains the duration of the current state, and be greater than when the duration or
When equal to preset duration, described control unit 112 controls the video with the current video control mode.
Further, the preset duration may include, but be not limited to: 1 minute, 30 seconds etc..The preset duration can
To carry out customized setting according to personal habits by the user, with the operation being more close to the users, alternatively, the preset duration
It can also be configured by the electronic equipment, the present invention does not limit.
It is understood that the user is during watching video, in fact it could happen that many instantaneous or of short duration shapes
State, such as: when the user leans to one side to take thing or the user is due to tired, when changing a posture viewing video, this
A little situations are likely to cause the variation of user's facial image state, it is clear that the electronic equipment in these cases, is
It does not need to carry out corresponding operating to the video.
Therefore, by above embodiment, only when the duration of the current state reaching the preset duration,
Described control unit 112 can just control the video with the current video control mode, single to avoid the control
Member 112 carries out meaningless operation when being not necessarily to and responding, and makes troubles to user.
In at least one embodiment of the present invention, corresponding to different current states, described control unit 112 will be taken
Following several video control modes.
Specifically, described control unit 112 controls the video with the current video control mode further include:
When the current state is user's leave state, then the pause of described control unit 112 plays the video.
By above embodiment, the user during watching video, if break away (such as: the use
Family is gone to take take-away, or goes to take express delivery etc.), then the pause of described control unit 112 plays the video, and otherwise the user is by nothing
Method realizes the continuous viewing of plot in video, and missed portion video, influences viewing experience.
Preferably, described control unit 112 controls the video with the current video control mode further include:
When the current state is user's persistent state, then described control unit 112 starts to play the video.
By above embodiment, if the user is constantly in leave state, video pause is played, at this point, working as institute
When stating control unit 112 and detecting that the user is in persistent state, then described control unit 112 starts to play the view
Frequently, make the user without manual operation, so that it may which direct viewing video is brought convenience to user.
Such as: when the user goes to take take-away, the user is in leave state, and video pause plays, at this point, working as institute
When stating control unit 112 and detecting that the user is in persistent state, i.e., when described user's pick-up is returned, then the control is single
Member 112 starts to play the video, carries out the operation such as clicking without the user, the user can have meal on one side, see on one side
See the video.
Preferably, described control unit 112 controls the video with the current video control mode further include:
When the current state is sleep state, then the pause of described control unit 112 plays the video.
By above embodiment, when the user is when watching the video, if fallen asleep or portion due to too tired
Divide the elderly to fall asleep during seeing video, and do not obtain and close the video, described control unit 112 detects described
User is in sleep state, then the pause of described control unit 112 plays the video, misses broadcasting for video to avoid the user
It puts.
Preferably, after described control unit 112 controls the video with the current video control mode, institute
State method further include:
At the beginning of the acquiring unit 110 obtains the current state, determination unit 113 determines the time started
Corresponding video playing progress, when receiving the signal for continuing to play the video, broadcast unit 114 is broadcast according to the video
Degree of putting into plays the video.
By above embodiment, the electronic equipment can continue to play the view at the content that the user misses
Frequently, so that the user be made to continue to watch at interruption, without refunding manually, cumbersome behaviour is not only effectively prevented
Make, while being also avoided that the loss of time caused by maloperation, user experience is more preferably.
In at least one embodiment of the present invention, the electronic equipment can also carry out the video content of specified type
Customized setting.
Such as: when the electronic equipment detects that the type of the video is song class video, and according to getting
The user is accustomed to data for the viewing of song class video, and the user will not see before the screen of the electronic equipment always
It sees, even if then the electronic equipment detects that the current state is leave state, the electronic equipment can not also control institute
It states video and enters halted state.
In conclusion the present invention can obtain in real time the facial image of user when playing video；To the facial image into
Row identification, obtains the current state of the facial image；Preconfigured video domination set is obtained, is deposited in the video domination set
Store up the state of face images and the corresponding relationship of corresponding video control mode；According to the current state, from the view
Current video control mode is obtained in frequency domination set；The video is controlled with the current video control mode.Therefore,
The present invention is able to achieve the automation control to video playing, response quickly, and the manual operation without complexity, video viewing experience
More preferably.
As shown in figure 3, being that the present invention realizes that the electronics of the preferred embodiment of the video control method based on recognition of face is set
Standby structural schematic diagram.
The electronic equipment 1 be it is a kind of can according to the instruction for being previously set or store, automatic progress numerical value calculating and/or
The equipment of information processing, hardware include but is not limited to microprocessor, specific integrated circuit (Application Specific
Integrated Circuit, ASIC), programmable gate array (Field-Programmable Gate Array, FPGA), number
Word processing device (Digital Signal Processor, DSP), embedded device etc..
The electronic equipment 1, which can also be but not limited to any one, to pass through keyboard, mouse, remote controler, touching with user
The modes such as template or voice-operated device carry out the electronic product of human-computer interaction, for example, personal computer, tablet computer, smart phone,
Personal digital assistant (Personal Digital Assistant, PDA), game machine, Interactive Internet TV (Internet
Protocol Television, IPTV), intellectual wearable device etc..
The electronic equipment 1 can also be that the calculating such as desktop PC, notebook, palm PC and cloud server are set
It is standby.
Network locating for the electronic equipment 1 include but is not limited to internet, wide area network, Metropolitan Area Network (MAN), local area network, it is virtual specially
With network (Virtual Private Network, VPN) etc..
In one embodiment of the invention, the electronic equipment 1 includes, but are not limited to memory 12, processor 13,
And it is stored in the computer program that can be run in the memory 12 and on the processor 13, such as video controls journey
Sequence.
It will be understood by those skilled in the art that the schematic diagram is only the example of electronic equipment 1, not structure paired electrons
The restriction of equipment 1 may include perhaps combining certain components or different components, example than illustrating more or fewer components
Such as described electronic equipment 1 can also include input-output equipment, network access equipment, bus.
Alleged processor 13 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor
Deng the processor 13 is arithmetic core and the control centre of the electronic equipment 1, entire using various interfaces and connection
The various pieces of electronic equipment 1, and execute the operating system of the electronic equipment 1 and types of applications program, the program of installation
Code etc..
The processor 13 executes the operating system of the electronic equipment 1 and the types of applications program of installation.The place
Reason device 13 executes the application program to realize the step in above-mentioned each video control method embodiment based on recognition of face,
Such as step S10, S11, S12, S13, S14 shown in FIG. 1.
Alternatively, the processor 13 realizes each module in above-mentioned each Installation practice/mono- when executing the computer program
The function of member, such as: when playing video, the facial image of user is obtained in real time；The facial image is identified, is obtained
The current state of the facial image；Preconfigured video domination set is obtained, stores owner in the video domination set
The state of face image and the corresponding relationship of corresponding video control mode；According to the current state, from the video domination set
Obtain current video control mode；The video is controlled with the current video control mode.
Illustratively, the computer program can be divided into one or more module/units, one or more
A module/unit is stored in the memory 12, and is executed by the processor 13, to complete the present invention.It is one
Or multiple module/units can be the series of computation machine program instruction section that can complete specific function, the instruction segment is for retouching
State implementation procedure of the computer program in the electronic equipment 1.It is obtained for example, the computer program can be divided into
Take unit 110, recognition unit 111, control unit 112, determination unit 113 and broadcast unit 114.
The memory 12 can be used for storing the computer program and/or module, the processor 13 by operation or
The computer program and/or module being stored in the memory 12 are executed, and calls the data being stored in memory 12,
Realize the various functions of the electronic equipment 1.The memory 12 can mainly include storing program area and storage data area,
In, storing program area can application program needed for storage program area, at least one function (such as sound-playing function, image
Playing function etc.) etc.；Storage data area, which can be stored, uses created data (such as audio data, phone directory according to mobile phone
Deng) etc..In addition, memory 12 may include high-speed random access memory, it can also include nonvolatile memory, such as firmly
Disk, memory, plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital,
SD) block, flash card (Flash Card), at least one disk memory, flush memory device or other volatile solid-states
Part.
The memory 12 can be the external memory and/or internal storage of electronic equipment 1.Further, described
Memory 12 can be the circuit with store function for not having physical form in integrated circuit, such as RAM (Random-Access
Memory, random access memory), FIFO (First In First Out) etc..Alternatively, the memory 12 is also possible to
Memory with physical form, such as memory bar, TF card (Trans-flash Card).
If the integrated module/unit of the electronic equipment 1 is realized in the form of SFU software functional unit and as independent
Product when selling or using, can store in a computer readable storage medium.Based on this understanding, the present invention is real
All or part of the process in existing above-described embodiment method, can also instruct relevant hardware come complete by computer program
At the computer program can be stored in a computer readable storage medium, which is being executed by processor
When, it can be achieved that the step of above-mentioned each embodiment of the method.
Wherein, the computer program includes computer program code, and the computer program code can be source code
Form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium may include: can
Carry any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic disk, CD, computer of the computer program code
Memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access
Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that the computer-readable medium
The content for including can carry out increase and decrease appropriate according to the requirement made laws in jurisdiction with patent practice, such as in certain departments
Method administrative area does not include electric carrier signal and telecommunication signal according to legislation and patent practice, computer-readable medium.
In conjunction with Fig. 1, it is a kind of based on face knowledge to realize that the memory 12 in the electronic equipment 1 stores multiple instruction
The multiple instruction can be performed to realize in other video control method, the processor 13: when playing video, obtaining in real time
The facial image of user；The facial image is identified, the current state of the facial image is obtained；Acquisition is pre-configured with
Video domination set, the state that face images are store in the video domination set is corresponding with corresponding video control mode
Relationship；According to the current state, current video control mode is obtained from the video domination set；With the current video control
Mode processed controls the video.
Preferred embodiment according to the present invention, the processor 13 also execute multiple instruction and include:
The current state is controlled centrally stored state with the video to match, obtains dbjective state:
From the video domination set, video control mode corresponding with the dbjective state is obtained as described and works as forward sight
Frequency control mode.
Preferred embodiment according to the present invention, the processor 13 also execute multiple instruction and include:
Obtain the duration of the current state；
When the duration being more than or equal to preset duration, with the current video control mode to the video
It is controlled.
Preferred embodiment according to the present invention, the processor 13 also execute multiple instruction and include:
When the current state is user's leave state, pause plays the video.
Preferred embodiment according to the present invention, the processor 13 also execute multiple instruction and include:
When the current state is user's persistent state, start to play the video.
Preferred embodiment according to the present invention, the processor 13 also execute multiple instruction and include:
When the current state is sleep state, pause plays the video.
Preferred embodiment according to the present invention, the processor 13 also execute multiple instruction and include:
At the beginning of obtaining the current state；
Determine the time started corresponding video playing progress；
When receiving the signal for continuing to play the video, the video is played according to the video playing progress.
Specifically, the processor 13 can refer to the concrete methods of realizing of above-metioned instruction related in Fig. 1 corresponding embodiment
The description of step, this will not be repeated here.
In several embodiments provided by the present invention, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the module
It divides, only a kind of logical function partition, there may be another division manner in actual implementation.
The module as illustrated by the separation member may or may not be physically separated, aobvious as module
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.Some or all of the modules therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
It, can also be in addition, each functional module in each embodiment of the present invention can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of hardware adds software function module.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie
In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.
Therefore, in all respects, the present embodiments are to be considered as illustrative and not restrictive, this
The range of invention is indicated by the appended claims rather than the foregoing description, it is intended that the equivalent requirements of the claims will be fallen in
All changes in meaning and scope are included in the present invention.Any attached associated diagram label in claim should not be considered as limit
Claim involved in making.
Furthermore, it is to be understood that one word of " comprising " does not exclude other units or steps, odd number is not excluded for plural number.In system claims
The multiple units or device of statement can also be implemented through software or hardware by a unit or device.Second equal words are used
It indicates title, and does not indicate any particular order.
Finally it should be noted that the above examples are only used to illustrate the technical scheme of the present invention and are not limiting, although reference
Preferred embodiment describes the invention in detail, those skilled in the art should understand that, it can be to of the invention
Technical solution is modified or equivalent replacement, without departing from the spirit and scope of the technical solution of the present invention.
Claims (10)
1. a kind of video control method based on recognition of face, which is characterized in that the described method includes:
When playing video, the facial image of user is obtained in real time；
The facial image is identified, the current state of the facial image is obtained；
Preconfigured video domination set is obtained, the state and corresponding view of face images are store in the video domination set
The corresponding relationship of frequency control mode；
According to the current state, current video control mode is obtained from the video domination set；
The video is controlled with the current video control mode.
2. as described in claim 1 based on the video control method of recognition of face, which is characterized in that described according to described current
State, obtaining current video control mode from the video domination set includes:
The current state is controlled centrally stored state with the video to match, obtains dbjective state:
From the video domination set, video control mode corresponding with the dbjective state is obtained as the current video control
Mode processed.
3. as described in claim 1 based on the video control method of recognition of face, which is characterized in that described to work as forward sight with described
Frequency control mode carries out control to the video
Obtain the duration of the current state；
When the duration being more than or equal to preset duration, the video is carried out with the current video control mode
Control.
4. as described in claim 1 based on the video control method of recognition of face, which is characterized in that described to work as forward sight with described
Frequency control mode controls the video further include:
When the current state is user's leave state, pause plays the video.
5. as described in claim 1 based on the video control method of recognition of face, which is characterized in that described to work as forward sight with described
Frequency control mode controls the video further include:
When the current state is user's persistent state, start to play the video.
6. as described in claim 1 based on the video control method of recognition of face, which is characterized in that described to work as forward sight with described
Frequency control mode controls the video further include:
When the current state is sleep state, pause plays the video.
7. as described in claim 1 based on the video control method of recognition of face, which is characterized in that with the current video
After control mode controls the video, the method also includes:
At the beginning of obtaining the current state；
Determine the time started corresponding video playing progress；
When receiving the signal for continuing to play the video, the video is played according to the video playing progress.
8. a kind of video control device based on recognition of face, which is characterized in that described device includes:
Acquiring unit, for obtaining the facial image of user in real time when playing video；
Recognition unit obtains the current state of the facial image for identifying to the facial image；
The acquiring unit is also used to obtain preconfigured video domination set, stores owner in the video domination set
The state of face image and the corresponding relationship of corresponding video control mode；
The acquiring unit is also used to according to the current state, and current video controlling party is obtained from the video domination set
Formula；
Control unit, for being controlled with the current video control mode the video.
9. a kind of electronic equipment, which is characterized in that the electronic equipment includes:
Memory stores at least one instruction；And
Processor executes the instruction stored in the memory and is based on as claimed in any of claims 1 to 7 in one of claims with realizing
The video control method of recognition of face.
10. a kind of computer readable storage medium, it is characterised in that: be stored at least one in the computer readable storage medium
A instruction, at least one described instruction are executed by the processor in electronic equipment to realize such as any one of claim 1 to 7
The video control method based on recognition of face.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811537779.5A CN109743630A (en) | 2018-12-15 | 2018-12-15 | Video control method, device, electronic equipment and medium based on recognition of face |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811537779.5A CN109743630A (en) | 2018-12-15 | 2018-12-15 | Video control method, device, electronic equipment and medium based on recognition of face |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109743630A true CN109743630A (en) | 2019-05-10 |
Family
ID=66360353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811537779.5A Pending CN109743630A (en) | 2018-12-15 | 2018-12-15 | Video control method, device, electronic equipment and medium based on recognition of face |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109743630A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111078183A (en) * | 2019-12-16 | 2020-04-28 | 北京明略软件系统有限公司 | Audio and video information control method and device, intelligent equipment and computer readable storage medium |
| CN113099305A (en) * | 2021-04-15 | 2021-07-09 | 上海哔哩哔哩科技有限公司 | Play control method and device |
| CN113825023A (en) * | 2021-11-02 | 2021-12-21 | 户龙辉 | Video file processing method, device, equipment and storage medium |
| CN114866693A (en) * | 2022-04-15 | 2022-08-05 | 苏州清睿智能科技股份有限公司 | Information interaction method and device based on intelligent terminal |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104994154A (en) * | 2015-06-30 | 2015-10-21 | 北京奇艺世纪科技有限公司 | Media device control method and device |
| CN105142021A (en) * | 2015-08-11 | 2015-12-09 | 京东方科技集团股份有限公司 | Display control system, display control method and display device |
| CN107145288A (en) * | 2017-06-05 | 2017-09-08 | 努比亚技术有限公司 | Audio and video playing control method, mobile terminal and computer-readable recording medium |
| CN107613368A (en) * | 2017-09-26 | 2018-01-19 | 珠海市魅族科技有限公司 | Video pause method and apparatus, computer installation and computer-readable recording medium |
| CN107750012A (en) * | 2017-10-27 | 2018-03-02 | 珠海市魅族科技有限公司 | A kind of video broadcasting method and device |
| CN108966015A (en) * | 2018-08-27 | 2018-12-07 | 惠州Tcl移动通信有限公司 | A kind of video broadcasting condition control method, mobile terminal and storage medium |
-
2018
- 2018-12-15 CN CN201811537779.5A patent/CN109743630A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104994154A (en) * | 2015-06-30 | 2015-10-21 | 北京奇艺世纪科技有限公司 | Media device control method and device |
| CN105142021A (en) * | 2015-08-11 | 2015-12-09 | 京东方科技集团股份有限公司 | Display control system, display control method and display device |
| CN107145288A (en) * | 2017-06-05 | 2017-09-08 | 努比亚技术有限公司 | Audio and video playing control method, mobile terminal and computer-readable recording medium |
| CN107613368A (en) * | 2017-09-26 | 2018-01-19 | 珠海市魅族科技有限公司 | Video pause method and apparatus, computer installation and computer-readable recording medium |
| CN107750012A (en) * | 2017-10-27 | 2018-03-02 | 珠海市魅族科技有限公司 | A kind of video broadcasting method and device |
| CN108966015A (en) * | 2018-08-27 | 2018-12-07 | 惠州Tcl移动通信有限公司 | A kind of video broadcasting condition control method, mobile terminal and storage medium |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111078183A (en) * | 2019-12-16 | 2020-04-28 | 北京明略软件系统有限公司 | Audio and video information control method and device, intelligent equipment and computer readable storage medium |
| CN113099305A (en) * | 2021-04-15 | 2021-07-09 | 上海哔哩哔哩科技有限公司 | Play control method and device |
| CN113825023A (en) * | 2021-11-02 | 2021-12-21 | 户龙辉 | Video file processing method, device, equipment and storage medium |
| CN113825023B (en) * | 2021-11-02 | 2023-12-05 | 户龙辉 | Video file processing method, device, equipment and storage medium |
| CN114866693A (en) * | 2022-04-15 | 2022-08-05 | 苏州清睿智能科技股份有限公司 | Information interaction method and device based on intelligent terminal |
| CN114866693B (en) * | 2022-04-15 | 2024-01-05 | 苏州清睿智能科技股份有限公司 | Information interaction method and device based on intelligent terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109743630A (en) | Video control method, device, electronic equipment and medium based on recognition of face | |
| CN108304441B (en) | Network resource recommendation method and device, electronic equipment, server and storage medium | |
| CN107566907A (en) | video clipping method, device, storage medium and terminal | |
| WO2019109976A1 (en) | Multimedia file play record saving method, terminal and storage medium | |
| CN104168303A (en) | Method and device for displaying network studio | |
| CN111783001A (en) | Page display method and device, electronic equipment and storage medium | |
| US20220021939A1 (en) | System, method, and computer-readable medium including program for distributing live video | |
| CN109086742A (en) | scene recognition method, scene recognition device and mobile terminal | |
| WO2022198934A1 (en) | Method and apparatus for generating video synchronized to beat of music | |
| CN113422977A (en) | Live broadcast method and device, computer equipment and storage medium | |
| CN108965981A (en) | Video broadcasting method, device, storage medium and electronic equipment | |
| CN111901633B (en) | Video playing processing method and device, electronic equipment and storage medium | |
| WO2023109037A1 (en) | Interaction method based on live-streaming room, and electronic device | |
| CN111741370A (en) | Multimedia interaction method, related device, equipment and storage medium | |
| CN108228715A (en) | A kind of method, terminal and computer readable storage medium for showing image | |
| CN111596760A (en) | Operation control method and device, electronic equipment and readable storage medium | |
| CN112004117A (en) | Video playing method and device | |
| CN112532885A (en) | Anti-shake method and device and electronic equipment | |
| CN112235635A (en) | Animation display method, animation display device, electronic equipment and storage medium | |
| CN114257824A (en) | Live broadcast display method and device, storage medium and computer equipment | |
| CN111182317B (en) | Live broadcast information prompting method and device, electronic equipment and storage medium | |
| US20230362429A1 (en) | Element display method and apparatus, element selection method and apparatus, device, and storage medium | |
| CN107509088A (en) | A kind of collection of drama renewal reminding method, terminal and computer-readable recording medium | |
| CN106919460A (en) | A kind of method for controlling broadcast transmission, device and mobile terminal | |
| AU2019371154A1 (en) | Computer-implemented communications by social media application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190510 |