CN109725727A - There are the gestural control method and device of screen equipment - Google Patents

Abstract

The embodiment of the present application discloses the gestural control method and device of screen equipment.One specific embodiment of this method includes: detection to the gesture operation for having screen equipment to be controlled, in response to detecting that gesture operation is the default gesture operation indicated to there is screen equipment to carry out controlling media play, controlling media play instruction corresponding with default gesture operation is generated.The embodiment realizes the more flexible media control for having screen equipment.

Description

There are the gestural control method and device of screen equipment

Technical field

The invention relates to field of computer technology, and in particular to field of human-computer interaction, more particularly to have screen equipment Gestural control method and device.

Background technique

Non-contact type human-machine interaction is a kind of convenience, the manipulation stronger man-machine interaction mode of flexibility.In contactless people In machine interaction, since the relative position between user and electronic equipment is limited smaller, more meet the convenient manipulation demand of user, quilt It applies in every field such as wisdom life, Intelligent offices.

The man-machine interaction mode for having screen equipment include by the interaction of additional wireless launcher (such as remote controler) and Interactive voice.Key (including virtual key) is more in interactive mode based on attachment device, dependent on there is screen equipment interface Design, operation step-length is longer, and needs attention when operation from there is screen equipment to be transferred to remote controler, and operating efficiency needs to be mentioned It rises.Interactive voice can be parsed out user and be intended to and directly provide user's content for wishing acquisition.But interactive voice is in some fields It is not suitable in scape, such as ambient sound is noisy or has the biggish scene of multimedia audio of screen equipment broadcasting.

Summary of the invention

The embodiment of the present application proposes the gestural control method and device of screen equipment.

In a first aspect, the embodiment of the present application provides a kind of gestural control method for having screen equipment, comprising: detection is to there is screen The gesture operation that equipment is controlled；In response to detect gesture operation indicate to have screen equipment carry out controlling media play Default gesture operation generates controlling media play instruction corresponding with default gesture operation.

In some embodiments, it is above-mentioned in response to detect gesture operation be instruction to have screen equipment carry out media play control The default gesture operation of system generates controlling media play instruction corresponding with default gesture operation, comprising: in one's hands in response to detecting Gesture operation is the first default gesture operation indicated to there is screen equipment to play out sound control, generates and grasps with the first default gesture Make corresponding broadcasting sound control instruction.

In some embodiments, above-mentioned in response to detecting that gesture operation is instruction to there is screen equipment to play out sound control The default gesture operation of system generates broadcasting sound control instruction corresponding with default gesture operation, comprising: in one's hands in response to detecting Gesture operation is the first default gesture operation indicated to there is screen equipment to carry out mute state switching, generates and grasps with the first default gesture Make corresponding mute state switching control instruction；In response to detect gesture operation be instruction to have screen equipment carry out volume adjustment The first default gesture operation, based on the first default gesture operation hand position variation track determine volume adjustment direction and/ Or volume adjustment amount, corresponding volume adjustment instruction is generated according to volume adjustment direction and volume adjustment amount.

In some embodiments, above-mentioned instruction includes hand to there is screen equipment to carry out the first default gesture operation of volume adjustment Portion's posture is identical, the direction of motion corresponds respectively to two gesture operations in two different volume adjustment directions.

In some embodiments, it is above-mentioned in response to detect gesture operation be instruction to have screen equipment carry out media play control The default gesture operation of system generates controlling media play instruction corresponding with default gesture operation, further includes: in response to detecting Gesture operation is to indicate to the second default gesture operation for having screen equipment to play out object switching, determines mesh according to gesture operation Mark, which plays object and generates, switches to the instruction that target broadcasting object plays out.

In some embodiments, the above-mentioned second default gesture operation includes that hand gestures are identical, the direction of motion respectively corresponds In two gesture operations of two different switching directions.

In some embodiments, it is above-mentioned in response to detect gesture operation be instruction to have screen equipment carry out media play control The default gesture operation of system generates controlling media play instruction corresponding with default gesture operation, further includes: in response to detecting Gesture operation is to indicate to preset gesture operation to the third for having the broadcast window of screen equipment to be adjusted, and is determined based on gesture operation Window adjustment parameter generates corresponding broadcast window regulating command according to window adjustment parameter.

In some embodiments, it is above-mentioned in response to detect gesture operation be instruction to have screen equipment carry out media play control The default gesture operation of system generates controlling media play instruction corresponding with default gesture operation, further includes: in response to detecting Gesture operation is the 4th default gesture operation for indicating to switch over media play state, generates switching media broadcast state Control instruction.

In some embodiments, above-mentioned in response to detecting that gesture operation indicates to switch over media play state 4th default gesture operation generates the control instruction of switching media broadcast state, comprising: in response to detecting that gesture operation refers to Show the 4th default gesture operation that media play state is switched to broadcast state or halted state, according to current media play State generates the control instruction of media play state switching；In response to detecting that gesture operation is that instruction exits the of media play Four default gesture operations generate the control instruction for exiting and playing media content.

In some embodiments, above-mentioned in response to detecting that gesture operation is the 4th default hand that media play is exited in instruction Gesture operation, generates the control instruction for exiting and playing media, comprising: in response to detecting that gesture operation is that media play is exited in instruction The 4th default gesture operation, and the duration of gesture operation be no more than preset time threshold, generation be back to play boundary The control instruction of the upper level page in face；In response to detecting that gesture operation is the 4th default gesture that media play is exited in instruction Operation, and the duration of gesture operation is more than preset time threshold, generates the control for being back to the homepage of screen equipment Instruction.

In some embodiments, the above method further include: determine whether the page for having screen equipment currently to present is that media are broadcast Put the page；It is above-mentioned in response to detect gesture operation be indicate to have screen equipment carry out controlling media play default gesture behaviour Make, generates controlling media play instruction corresponding with default gesture operation, comprising: there is screen equipment currently to present in response to determination The page is the media play page, and detects that gesture operation is the default gesture indicated to there is screen equipment to carry out controlling media play Operation generates controlling media play instruction corresponding with default gesture operation.

In some embodiments, the above method further include: in response to detecting the gesture for being used to indicate and waking up and having screen equipment The default gesture operation of identifying system wakes up the gesture recognition system for having screen equipment.

Second aspect, the embodiment of the present application provide a kind of gesture control device for having screen equipment, comprising: detection unit, It is configured as detecting the gesture operation to there is screen equipment to be controlled；Generation unit is configured to respond to detect that gesture is grasped Work is the default gesture operation indicated to there is screen equipment to carry out controlling media play, generates media corresponding with default gesture operation Play control instruction.

In some embodiments, above-mentioned generation unit is configured to: in response to detecting that gesture operation is instruction To the first default gesture operation for thering is screen equipment to play out sound control, broadcasting corresponding with the first default gesture operation is generated Sound control instruction.

In some embodiments, above-mentioned generation unit is configured to: in response to detecting that gesture operation is instruction To the first default gesture operation for thering is screen equipment to carry out mute state switching, generate corresponding mute with the first default gesture operation State switching control instruction；In response to detecting that gesture operation is the first default hand indicated to there is screen equipment to carry out volume adjustment Gesture operation, determines volume adjustment direction and/or volume adjustment amount based on the hand position variation track of the first default gesture operation, Corresponding volume adjustment instruction is generated according to volume adjustment direction and volume adjustment amount.

In some embodiments, above-mentioned instruction includes hand to there is screen equipment to carry out the first default gesture operation of volume adjustment Portion's posture is identical, the direction of motion corresponds respectively to two gesture operations in two different volume adjustment directions.

In some embodiments, above-mentioned generation unit is also configured in response to detecting that gesture operation is instruction to having Screen equipment plays out the second default gesture operation of object switching, determines that target plays object and generates according to gesture operation and cuts It shifts to target and plays the instruction that object plays out.

In some embodiments, the above-mentioned second default gesture operation includes that hand gestures are identical, the direction of motion respectively corresponds In two gesture operations of two different switching directions.

In some embodiments, above-mentioned generation unit is also configured in response to detecting that gesture operation is instruction to having The third that the broadcast window of screen equipment is adjusted presets gesture operation, determines window adjustment parameter based on gesture operation, according to Window adjustment parameter generates corresponding broadcast window regulating command.

In some embodiments, above-mentioned generation unit is also configured in response to detecting that gesture operation is instruction to matchmaker The 4th default gesture operation that body broadcast state switches over generates the control instruction of switching media broadcast state.

In some embodiments, above-mentioned generation unit is configured to: in response to detecting that gesture operation is instruction Media play state is switched to the 4th default gesture operation of broadcast state or halted state, according to current media play shape State generates the control instruction of media play state switching；In response to detecting that gesture operation is that instruction exits the 4th of media play Default gesture operation, generates the control instruction for exiting and playing media content.

In some embodiments, above-mentioned generation unit is configured to: in response to detecting that gesture operation is instruction The 4th default gesture operation of media play is exited, and the duration of gesture operation is no more than preset time threshold, generated It is back to the control instruction of the upper level page of broadcast interface；In response to detecting that gesture operation is that media play is exited in instruction 4th default gesture operation, and the duration of gesture operation is more than preset time threshold, generation is back to screen equipment The control instruction of homepage.

In some embodiments, above-mentioned apparatus further include: determination unit is configured to determine that screen equipment was currently presented Whether the page is the media play page；Generation unit is configured to: in response to determining the page for having screen equipment currently to present Face is the media play page, and detects that gesture operation is the default gesture behaviour indicated to there is screen equipment to carry out controlling media play Make, generates controlling media play instruction corresponding with default gesture operation.

In some embodiments, above-mentioned apparatus further include: wakeup unit is configured to respond to detect to be used to indicate and call out Waking up has the default gesture operation of the gesture recognition system of screen equipment, wakes up the gesture recognition system for having screen equipment.

The third aspect, the embodiment of the present application provide a kind of electronic equipment, comprising: one or more processors；Display dress It sets；Storage device when one or more programs are executed by one or more processors, makes for storing one or more programs It obtains one or more processors and the gestural control method for having screen equipment provided such as first aspect is provided.

Fourth aspect, the embodiment of the present application provide a kind of computer-readable medium, are stored thereon with computer program, In, the gestural control method for having screen equipment that first aspect provides is realized when program is executed by processor.

The gestural control method and device for having screen equipment of the above embodiments of the present application, by detection to there is screen equipment progress The gesture operation of control, in response to detecting that gesture operation is the default gesture indicated to there is screen equipment to carry out controlling media play Operation generates controlling media play instruction corresponding with default gesture operation, independent of optional equipment and more wheel interactions, realizes More flexible has screen equipment browsing control.

Detailed description of the invention

By reading a detailed description of non-restrictive embodiments in the light of the attached drawings below, the application's is other Feature, objects and advantages will become more apparent upon:

Fig. 1 is that the embodiment of the present application can be applied to exemplary system architecture figure therein；

Fig. 2 is the flow chart according to one embodiment of the gestural control method for having screen equipment of the application；

Fig. 3 is the flow chart according to another embodiment of the gestural control method for having screen equipment of the application；

Fig. 4 A-4B is the schematic diagram of one of the gestural control method of the be shown with screen equipment of Fig. 3 gesture operation；

Fig. 4 C-4D is the schematic diagram of another gesture operation in the gestural control method of the be shown with screen equipment of Fig. 3；

Fig. 5 is the flow chart according to the further embodiment of the gestural control method for having screen equipment of the application；

Fig. 6 A-6C is the schematic diagram of one of the gestural control method of the be shown with screen equipment of Fig. 5 gesture operation；

Fig. 6 D-6E is the schematic diagram of another gesture operation in the gestural control method of the be shown with screen equipment of Fig. 5；

Fig. 7 is the flow chart according to another embodiment of the gestural control method for having screen equipment of the application；

Fig. 8 is the schematic diagram of one of the gestural control method of the be shown with screen equipment of Fig. 7 gesture operation；

Fig. 9 is the flow chart according to another embodiment of the gestural control method for having screen equipment of the application；

Figure 10 A-10B is the schematic diagram of one of the gestural control method of the be shown with screen equipment of Fig. 9 gesture operation；

Figure 10 C-10D is the schematic diagram of another gesture operation in the gestural control method of the be shown with screen equipment of Fig. 9；

Figure 11 is the structural schematic diagram of one embodiment of the gesture control device for having screen equipment of the application；

Figure 12 is adapted for the structural schematic diagram for the computer system for realizing the electronic equipment of the embodiment of the present application.

Specific embodiment

The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order to Convenient for description, part relevant to related invention is illustrated only in attached drawing.

It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase Mutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.

Fig. 1 is shown can be using the gestural control method for having screen equipment of the application or the gesture control for having screen equipment dress The exemplary system architecture set.

As shown in Figure 1, system architecture 100 may include having screen equipment 110 and server 120.There is screen equipment 110 can be with It is interacted by network and server 120, to receive or send message etc..There is screen equipment 110 to can be with display screen Electronic equipment, such as smart television, intelligent display screen, band screen intelligent sound box etc..Have can be equipped on screen equipment it is various man-machine Interactive application, such as browser application, search application, multimedia resource broadcasting application, etc..

User 130 can be used screen equipment 110 and interact with server 120, to obtain the service of the offer of server 120. User 130 can have screen equipment 110 to initiate service request, such as non-contacting hand to server 120 using various ways control Gesture interactive mode, interactive voice mode, ancillary equipment (such as remote controler) interactive mode etc..

Having can be set human body sense of movement and knows equipment 111, such as the figure based on visible or infrared light on screen equipment 110 As acquisition equipment, the distance-measuring equipment based on information such as laser, sound waves or the equipment for three-dimensional modeling.Human action awareness apparatus 111 can acquire human action information, by human action information be transmitted to screen equipment 110 processor or with have screen equipment The server 120 of 110 connections is handled.

Server 120, which can be, provides the server of content server for the content for having screen equipment 110 to show, is also possible to To there is screen equipment 110 to provide the server of function services.Server 120 can receive the request of the transmission of screen equipment 110, to asking It asks and is parsed, response message is generated according to parsing result, and the response message of generation has been returned into screen equipment 110.There is screen Equipment 110 can be with output response information.

It should be noted that there is the gestural control method of screen equipment can be by there is screen equipment provided by the embodiment of the present application 110 execute, and correspondingly, have the gesture control device of screen equipment to can be set in having in screen equipment 110.In these scenes, on Server 120 can not included by stating system architecture.

In some scenes, the gestural control method provided by the embodiments of the present application for having screen equipment can by with have screen equipment The server 120 of 110 communication connections executes, and correspondingly, has the gesture control device of screen equipment that Yu Yuyou screen equipment can be set In the server 120 of 110 connections.

It should be understood that the number for having screen equipment, server, user in Fig. 1 is only schematical.According to realization need It wants, can have any number of has screen equipment, server, user.

With continued reference to Fig. 2, it illustrates according to one embodiment of the gestural control method for having screen equipment of the application Process 200.This has the gestural control method of screen equipment, comprising the following steps:

Step 201, detection is to the gesture operation for having screen equipment to be controlled.

In the present embodiment, having the executing subject of the gestural control method of screen equipment (such as shown in FIG. 1 has screen equipment 110) gesture operation in its control range can be detected.It specifically can be dynamic based on the human body being set on screen equipment The gesture perception information for making awareness apparatus acquisition determines gesture operation.Human body movement awareness apparatus can be Image Acquisition and set Standby, Laser Distance Measuring Equipment, ultrasonic distance measurement equipment etc., gesture perception information can be visible images, infrared image, three-dimensional and swash The information such as luminous point cloud.

By taking image information as an example, images of gestures in the above-mentioned available control range of executing subject, and to images of gestures Gesture identification is carried out, the testing result of gesture operation is obtained.Optionally, it may include its in addition to gesture in acquired image His information, such as face information.Can to the image carry out image segmentation, isolate the part comprising images of gestures information come into Row gesture identification impacts gesture recognition result to avoid other human bodies (such as face).

It is above-mentioned to have screen equipment that at least one camera can be set.At least one camera can be to there is screen equipment A region in front of display screen is imaged.When user initiates gesture operation in the area, camera can acquire hand The image or image sequence of gesture operation, may then based on image or image sequence to identify the gesture-type of user.Specifically may be used The gesture identification model trained of the image of gesture operation input is carried out gesture identification, or can will it is preset respectively The motion characteristic of type gesture operation is compared as template with the feature of the gesture operation extracted from image, thus Determine the type of gesture operation.

It should be noted that the quantity of above-mentioned camera can be two or more.More than two cameras can with It is arranged side by side in the plane for having the display screen of screen equipment parallel.In this way, can also be according to the collected gesture of different camera institutes The image of operation carries out three-dimensional modeling to the gesture of user, obtain gesture operation along with the display screen vertical direction that has screen equipment Depth information.Wherein it is possible to demarcate to more than two cameras, the position conversion between two or more camera is determined Parameter, to be registrated the image of the above gesture operation of two width in three-dimensional modeling.

Can detect in the following way to the gesture operation for having screen equipment to be controlled: the image for being primarily based on acquisition is adopted User's hand raising action is detected with algorithm of target detection, determines initial hand initial position and initial hand gestures, then according to even The multiple image of continuous acquisition determines hand position variation track i.e. hand gestures variation characteristic, and determines hand position and/or appearance The state changed duration, and then determine the gesture operation of user.

In some optional implementations of the present embodiment, it can detect as follows to there is screen equipment to control The gesture operation of system: being primarily based on the features such as the colour of skin, specifically can be according to skin using the position of edge detection scheduling algorithm detection hand Color characteristic and organization of human body feature extract hand region from image.The position for being then based on the video tracking hand of acquisition becomes Change, can specifically use SIFT (Scale-invariant feature transform, scale invariant feature based on the colour of skin Transformation) feature extraction algorithm, in conjunction with HOG (Histogram of Oriented Gradient, histograms of oriented gradients), use MeanShift (mean shift) carries out hand position detection and tracking to the picture frame in video, show that hand position changes rail Mark.Key point position of the detection hand at each position later, such as the relative position of finger-joint, and to gesture shape Classify, identifies gesture operation.

It further, can be by the characteristic parameter of gesture to be identified and pre-stored hand when identifying gesture operation The characteristic parameter of gesture template is matched, and is identified by calculating similarity.Or it can be using based on statistical analysis Method identifies gesture, specifically can using the methods of such as SVM (Support Vector Machine, support vector machines), Statistical sample feature vector determines gesture classifier.Hand can also be extracted using the method for such as neural network, deep learning Portion region, positioning hand key point position, and classify to gesture.When identifying dynamic gesture operation, can be combined with Image procossing, feature extraction and the sorting technique of timing, such as DTW (Dynamic Time Warping, dynamic time warping), CRF (conditional random field algorithm, condition random field algorithm), HMM (Hidden Markov Model, Hidden Markov Model) etc. matched and identified.

In some embodiments, it detection gesture can be operated in the effective gesture control region for having screen equipment.Wherein, have Effect gesture control region can be a preset region having in front of screen equipment display screen.Effective gesture control region It can be the viewing areas of screen display device, or the human action awareness apparatus that is set on screen equipment perceives Region.For example, effectively gesture control region can be in front of screen display device along perpendicular to the display screen for having screen display device The 3D region of direction radially.Effective gesture control region can be according to have screen equipment screen size and/or What the areas imaging of camera determined.

Above-mentioned gesture operation may include static gesture operation and dynamic gesture operation.Wherein, static gesture operation can be with It is the not changed gesture operation in hand gestures and position, such as the gesture of state of clenching fist, both hands are than gesture of the heart, etc.. Dynamic gesture, which operates, can be the changed gesture operation of hand gestures and/or position, such as singlehanded index finger push action Gesture, the gestures such as wave, clap one's hands.

Step 202, in response to detecting that gesture operation is the default hand indicated to there is screen equipment to carry out controlling media play Gesture operation generates controlling media play instruction corresponding with default gesture operation.

Above-mentioned executing subject can prestore gesture template library.The gesture template library includes preset multiple is used to indicate to having The gesture operation of screen equipment progress controlling media play.Gesture operation can be identified, it specifically can be to collected hand The image information or other information of gesture operation carry out feature extraction, by the hand in the feature extracted and the gesture template library prestored The feature of gesture operation is matched, and the matched default gesture operation of the gesture operation detected with step 201 is obtained.

Then, the corresponding controlling media play operation of default gesture operation can be found out, is generated and the default gesture behaviour Make corresponding controlling media play instruction.Herein, controlling media play operation can be to there is screen equipment to play media content The operation control that behavior carries out.Wherein, media content may include the content of the forms such as audio, video, picture, text.As Example, to have screen equipment play media content carry out operation control may is that pause play, continue play, terminate play, Exit broadcasting, F.F., rewind, volume adjustment, mute, brightness regulation, broadcast window adjustment, play mode (such as single circulation, List circulation) selection, etc..

The gesture template in gesture template library that above-mentioned executing subject prestores can serve to indicate that executing preset media broadcasts Control operation is put, gesture template can be operated with corresponding controlling media play and is associated with, such as palm is every the empty hand for touching screen Gesture operation can be corresponding with the pause broadcasting operation of media content and be associated with.Then identifying the current gesture operation of user Afterwards, the indicated controlling media play operation executed of the available gesture operation, and generate instruction and execute the media play control Make the instruction of operation.In this way, can trigger generation has the controlling media play of screen equipment to refer to by detecting and identifying gesture operation It enables.There is screen equipment that can be operated according to the corresponding controlling media play of the controlling media play instruction execution, such as plays media Content, adjusting broadcast sound volume, the brightness for adjusting broadcast interface etc..

One exemplary application scene of the above embodiments of the present application can be, in the media content that viewing plays, use Wish to adjust volume, at this moment can initiate to be used to indicate the gesture operation for adjusting volume, there is the image collecting device of screen equipment in family Etc. equipment can acquire the images of gestures of user, then carry out gestures detection, tracking and identification, which generated according to recognition result The volume adjustment instruction of gesture operation triggering.

The gestural control method for having screen equipment of the above embodiments of the present application, by detection to there is screen equipment to be controlled Gesture operation, in response to detecting that gesture operation is the default gesture operation indicated to there is screen equipment to carry out controlling media play, Controlling media play instruction corresponding with default gesture operation is generated, is realized based on gesture to the browsing for having screen equipment to be presented Content is controlled every sky, independent of optional equipment and is suitable for the biggish scene of ambient sound, has been improved screen equipment media The flexibility of control mode and operating efficiency.

With continued reference to Fig. 3, it illustrates another embodiments according to the gestural control method for having screen equipment of the application Flow chart.As shown in figure 3, the process 300 of the gestural control method for having screen equipment of the present embodiment, comprising the following steps:

Step 301, detection is to the gesture operation for having screen equipment to be controlled.

In the present embodiment, having the executing subject of the gestural control method of screen equipment (such as shown in FIG. 1 has screen equipment 110) gesture operation in its control range can be detected.It specifically can be dynamic based on the human body being set on screen equipment The gesture perception information for making awareness apparatus acquisition determines gesture operation.Human body movement awareness apparatus can be Image Acquisition and set Standby, Laser Distance Measuring Equipment, ultrasonic distance measurement equipment etc..

By taking image information as an example, images of gestures in the above-mentioned available control range of executing subject, and to images of gestures Gesture identification is carried out, the testing result of gesture operation is obtained.

It is above-mentioned to have screen equipment that at least one camera can be set.At least one camera can be to there is screen equipment A region in front of display screen is imaged.When user initiates gesture operation in the area, camera can acquire hand The image or image sequence of gesture operation, may then based on image or image sequence to identify the gesture-type of user.Specifically may be used The gesture identification model trained of the image of gesture operation input is carried out gesture identification, or can will it is preset respectively The motion characteristic of type gesture operation is compared as template with the feature of the gesture operation extracted from image, thus Determine the type of gesture operation.

The step 201 of above-mentioned steps 301 and previous embodiment is consistent, and the specific implementation of step 301 can also refer to The aforementioned description to step 201, details are not described herein again.

Step 302, in response to detecting that gesture operation is to indicate to there is screen equipment to play out the first pre- of sound control If gesture operation, broadcasting sound control instruction corresponding with the first default gesture operation is generated.

In the present embodiment, it can be stored in advance for the first default gesture for thering is screen equipment to play out sound control Operation, and whether the gesture operation that judgment step 301 detects is consistent with the first default gesture operation.It can specifically extract and obtain The feature for the gesture operation got, and matched with the feature templates of the first default gesture, the hand trained can also be utilized Whether the gesture operation that gesture identification model judgment step 301 detects matches with the first default gesture operation.

If the gesture operation that step 301 detects and the above-mentioned first default gesture operation successful match, can be generated with The corresponding broadcasting sound control instruction of first default gesture operation.Herein, playing sound control instruction can be to audio, view The instruction that there is frequency etc. the media content of voice attribute to carry out volume adjustment, sound quality selection or mute switching.It is generating and issuing After the broadcasting sound control instruction, there is screen equipment that can execute corresponding sound control operation.

By identification gesture operation whether be to the first default gesture operation for thering is screen equipment to play out sound control, and It is generated when gesture operation is the first default gesture operation and plays sound control instruction, broadcasting can be easily controlled by gesture Sound improves the flexibility of screen equipment sound control mode without optional equipments such as remote controlers.

It is above-mentioned in response to detecting that gesture operation is instruction to there is screen in some optional implementations of the present embodiment Equipment plays out the default gesture operation of sound control, generates broadcasting sound control corresponding with the first default gesture operation and refers to The step 302 of order may include step 3021 and step 3022.

In step 3021, in response to detecting that gesture operation is indicated to have screen equipment to carry out mute state switching the One default gesture operation generates mute state switching control instruction corresponding with the first default gesture operation.

Above-mentioned first default gesture operation may include indicating to preset to have screen equipment progress mute state switching first Gesture operation.Above-mentioned executing subject is available prestore comprising instruction to there is screen equipment to carry out the first pre- of mute state switching If the gesture template library of gesture operation, and gesture operation that step 301 detects and the instruction is mute to there is screen equipment to carry out First default gesture operation of state switching is matched.If successful match, mute state switching control instruction can be generated.

Herein, mute state switching control instruction can be closing/recovery media sound control instruction.Executing pass After closing the control instruction of media sound, there is screen equipment to be switched to mute state from non-mute state；Restore media sound executing Control instruction after, there is screen equipment to be switched to non-mute state from mute state.

Fig. 4 A and Fig. 4 B show above-mentioned instruction to the first default gesture operation for having screen equipment to carry out mute state switching A kind of implementation.Above-mentioned first default gesture operation may be, for example, the gesture operation that index finger is placed in front of mouth.In the index finger In gesture operation before being placed in mouth, thumb, middle finger, the third finger and little finger are collapsed, and index finger stretches out, before being placed in mouth.Figure 4A is the front schematic view of the gesture operation, and Fig. 4 B is the side schematic view of the gesture operation.As shown in Figure 4 A and 4 B shown in FIG., index finger (region a) shown in Fig. 4 B, can there is a certain distance b between finger and mouth in region below eyes, more than chin.It can Selection of land can be defined the range of the distance b in the first default gesture operation, such as 0 15 centimetres of < b <.

In an illustrative scene, user has been used screen equipment and has played film, hears that someone knocks at the door.At this time by In there is screen equipment media volume larger, it cannot quick and precisely make have screen equipment mute by voice mode.It can be in gesture identification It is stretched out under system wake-up state before index finger is put in mouth and closes media volume.It, can be with if gesture recognition system is in a dormant state Index finger mouth is put in again after waking up gesture recognition system by wake-up gesture (preset, such as gesture of clapping one's hands) to come to close Close media sound.Index finger can be stretched out again after closing media volume be put in mouth come to open media volume.Similarly, if Gesture recognition system in a dormant state, can be waken up gesture recognition system by waking up gesture under media volume closed state Index finger is put in mouth again afterwards and comes to open media sound.

Optionally, above-mentioned instruction to have screen equipment carry out mute state switching the first default gesture operation can also be with Any one in lower: both hands seal that ear, both hands arm intersect at forearm, the centre of the palm is drawn a circle outward, finger or palm are outwardly every sky Click, palm open outwardly and to glide, both hands palm be vertically in T-shape, pronation is incited, one hand is placed in by ear, is eaten Refer to and thumb from pinching unclamping and other three fingers close up, thumb and other four fingers from pinching to unclamping, finger mark check mark " √ " shape, etc..

It should be noted that the first default gesture operation of media sound is closed in instruction and instruction opens the of media sound One default gesture can be identical, can not also be identical.For example, both hands are sealed, ear, both hands arm intersect at forearm, the centre of the palm is drawn outward Circle, finger or palm are hit every null point outwardly, palm open outwardly and to glide, both hands palm is vertically in that T-shape, pronation are incited Can be the first default gesture operation that media sound is closed in instruction, one hand is placed in by ear, index finger and thumb from pinch to Unclamp and other three refer to close up, thumb and other four fingers from pinching to unclamping, finger marks check mark " √ " shape and can be instruction and open Open the first default gesture operation of media sound.

The media mute state switching mode based on gesture operation that above-mentioned steps 3021 provide in ambient sound or can have Mute state switching command is quickly and accurately generated in the biggish scene of the broadcast sound volume of screen equipment and is executed, and is improved non-touch Touch the scope of application and operating efficiency of manipulation.

In step 3022, in response to detecting that gesture operation is to indicate to have screen equipment progress volume adjustment first in advance If gesture operation, volume adjustment direction and/or volume tune are determined based on the hand position variation track of the first default gesture operation Section amount generates corresponding volume adjustment instruction according to volume adjustment direction and volume adjustment amount.

Herein, the first default gesture operation can also include that instruction is default to have screen equipment progress volume adjustment first Gesture operation.Above-mentioned executing subject is available prestore comprising instruction to the first default hand for thering is screen equipment to carry out volume adjustment The gesture template library of gesture operation, and by gesture operation that step 301 detects and the instruction to there is screen equipment to carry out volume adjustment The first default gesture operation matched.If successful match, volume adjustment control instruction can be generated.

Herein, volume adjustment control instruction may include indicating the control in volume adjustment direction and/or volume adjustment amount Instruction.Volume adjustment direction includes tuning up or turning down, and volume adjustment amount is characterized in current volume and increases or reduces response Volume value.Above-mentioned executing subject can be raw to the first default gesture operation for having screen equipment to carry out volume adjustment according to being used to indicate At the volume adjustment instruction comprising volume adjustment direction and/or volume adjustment amount.Then the volume adjustment instruction can be executed.

In the present embodiment, the first default gesture operation for having screen equipment to carry out volume adjustment can also be referred to by being used to indicate Show volume adjustment direction and/or volume adjustment amount.It, can be by the gesture operation when presetting the first default gesture operation Feature associate with volume adjustment direction and/or volume adjustment amount.For example, volume adjustment direction can be with hand track side To association, volume adjustment amount can be associated with hand moving distance.It then can be according to the instruction detected to there is screen equipment progress In the default gesture operation of the first of volume adjustment hand course bearing and/or hand moving distance determine volume adjustment direction and/ Or volume adjustment amount, and then generate the volume adjustment instruction comprising volume adjustment direction and/or volume adjustment amount.

Optionally, above-mentioned instruction includes hand gestures phase to there is screen equipment to carry out the first default gesture operation of volume adjustment The same, direction of motion corresponds respectively to two gesture operations in two different volume adjustment directions, namely not including the direction of motion Same gesture pair.Two gesture operations being moved by the same hand motion along different directions realize different adjustment direction Volume adjustment reduces the difficulty of gesture control volume, can promote manipulation efficiency.

Fig. 4 C and Fig. 4 D show above-mentioned instruction to the one of the first default gesture operation for having screen equipment to carry out volume adjustment Kind specific implementation.Wherein the corresponding volume adjustment of gesture operation shown in Fig. 4 C and Fig. 4 D is contrary.Fig. 4 C is volume The gesture operation tuned up, Fig. 4 D are the gesture operations that volume is turned down.As depicted in figs. 4 c and 4d, in this example, index finger stretches out, Other four fingers close up, and index finger edge is drawn a circle clockwise or counterclockwise.It wherein tunes up along corresponding volume of drawing a circle clockwise, is drawn along counterclockwise Corresponding volume is enclosed to turn down.The mobile unit distance of the speed or finger drawn a circle can correspond to a sound volume regulation unit.Such as edge A circle correspondence is drawn clockwise and tunes up a sound volume regulation unit, turns a sound volume regulation unit down along a circle correspondence counterclockwise of drawing. With the increase of index finger rotation amplitude or distance, the size of volume can be continuously enlarged or be continuously reduced therewith.

Optionally, above-mentioned instruction is to there is screen equipment to carry out the gesture of volume adjustment to can also be following any one: hand The palm stretch out outwardly slide up stretched out outwardly with palm to glide, one hand is placed in by ear and both hands cover ear, is incited on palm With incited under palm, index finger with thumb from pinching to separating and other three refer to close up with index finger and thumb from unclamping to pinching and other Three refer to close up, thumb and other four refer to from pinching to separating and thumb and other four fingers from unclamping to pinching, index finger and thumb it is suitable The twisted button of hour hands and index finger and thumb twisted button, singlehanded twisted button clockwise and singlehanded twisted button, thumb counterclockwise counterclockwise Hold up with thumb stand upside down, etc..

It should be noted that being above only the exemplary illustration of the first default gesture.It is above-mentioned to be used to indicate to there is screen to set Standby the first default gesture operation for carrying out mute state switching and instruction are to the first default hand for having screen equipment to carry out volume adjustment Gesture operation can also be that other preset gestures, the application are not particularly limited.

By being indicated when detecting gesture operation to there is screen equipment to carry out mute state switching or volume adjustment first Corresponding control instruction is generated when default gesture operation, can be realized diversification and accurately plays sound control, can adapt to Broadcasting sound control demand under different scenes.

With continued reference to Fig. 5, it illustrates another embodiments according to the gestural control method for having screen equipment of the application Flow chart.As shown in figure 5, the process 500 of the gestural control method for having screen equipment of the present embodiment, comprising the following steps:

Step 501, detection is to the gesture operation for having screen equipment to be controlled.

In the present embodiment, having the executing subject of the gestural control method of screen equipment (such as shown in FIG. 1 has screen equipment 110) gesture operation in its control range can be detected.It specifically can be dynamic based on the human body being set on screen equipment The gesture perception information for making awareness apparatus acquisition determines gesture operation.Human body movement awareness apparatus can be Image Acquisition and set Standby, Laser Distance Measuring Equipment, ultrasonic distance measurement equipment etc..

By taking image information as an example, images of gestures in the above-mentioned available control range of executing subject, and to images of gestures Gesture identification is carried out, the testing result of gesture operation is obtained.

It is above-mentioned to have screen equipment that at least one camera can be set.At least one camera can be to there is screen equipment A region in front of display screen is imaged.When user initiates gesture operation in the area, camera can acquire hand The image or image sequence of gesture operation, may then based on image or image sequence to identify the gesture-type of user.Specifically may be used The gesture identification model trained of the image of gesture operation input is carried out gesture identification, or can will it is preset respectively The motion characteristic of type gesture operation is compared as template with the feature of the gesture operation extracted from image, thus Determine the type of gesture operation.

The step 201 of above-mentioned steps 501 and previous embodiment is consistent, and the specific implementation of step 501 can also refer to The aforementioned description to step 501, details are not described herein again.

Step 502, in response to detecting that gesture operation is to indicate to there is screen equipment to play out the second pre- of object switching If gesture operation, determine that target plays object and generation switches to target and plays the finger that object plays out according to gesture operation It enables.

In the present embodiment, it can be stored in advance and be used to indicate to there is screen equipment to play out the second default of object switching Gesture operation, and whether the gesture operation that judgment step 501 detects is consistent with the second default gesture operation.It can specifically mention The feature of the gesture operation got is taken, and is matched with the feature templates of the second default gesture, can also utilize and train The gesture operation that detects of gesture identification model judgment step 501 whether matched with the second default gesture operation.

If the default gesture operation successful match of the gesture operation and second that step 501 detects, can be generated and second The default corresponding broadcasting object switching command of gesture operation.Wherein playing object may include in currently playing media content Segment and/or other media contents in addition to currently playing media content.Its in addition to currently playing media content His media content may, for example, be a complete film video, the segment in currently playing media content can be one it is complete A segment in segment in whole media content, such as currently playing film video.

If playing object is the segment in currently playing media content, the broadcasting object switching command generated be can be Play position jump instruction, can also determine the position of target fragment that wish to jump to according to the gesture operation, such as can be with The mobile distance of play position is determined according to hand moving distance or speed.Herein, play position jump instruction can be control It is formed with the instruction that current play position is jumped to other play position by screen equipment.Finger is jumped generating and issuing the play position After order, there is screen equipment that can jump to the corresponding segment of new play position and continue to play media content.As an example, playing position Setting jump instruction can be " F.F. ", " rewind " instruction.

If playing object is other media contents in addition to currently playing media content, the broadcasting object generated is cut Changing instruction can be the instruction for the media content that switching plays.As an example, the instruction for the media content that switching plays can be The instruction of " playing next video ", " playing a upper video ".

In practice, if be playing media content, the gesture recognition system of screen equipment currently is currently at wake-up State, and the gesture operation for detecting that user issues is the above-mentioned second default gesture operation, and broadcasting object switching can be generated and refer to Enable with controlled screen equipment switch to target play object play out.If currently thering is the gesture recognition system of screen equipment to be in stop Dormancy state then can wake up gesture recognition system after detecting wake-up gesture or other wake up instructions, then in gesture identification The gesture operation for detecting that user issues under system wake-up state is the above-mentioned second default gesture operation, generates and plays object switching Instruction switches to the target play position of currently playing media content or switches to other media contents to control screen equipment It plays out.

As an example, if user wishes to watch next section of content of currently playing content, can be initiated in actual scene Before second default gesture operation jumps to next section of content having controlled screen equipment or user wishes to review and played Content, the second default gesture operation can be initiated to control the content that screen equipment jumps to front.

It whether is the second default gesture behaviour indicated to there is screen equipment to play out object switching by identification gesture operation Make, and the hand position variation track when gesture operation is the second default gesture operation based on the second default gesture operation generates Object switching command is played, realize has screen equipment to play Object Selection independent of optional equipment, has improved screen equipment Play the flexibility of Object Selection manipulation.

Optionally, the above-mentioned second default gesture operation includes that hand gestures are identical, the direction of motion corresponds respectively to two not It with two gesture operations of switching direction, that is, include the gesture that hand exercise direction corresponds respectively to two different switching directions It is right.Herein, switching direction includes switching forward and switches backward.Switching is " rewind ", " playing a upper video " forward, is Refer to the play position before jumping to currently playing object or switches to a upper media content for Current Content in playlist； Switching is " F.F. ", " playing next video " backward, refers to the play position or switching after jumping to current play position Summarize next media content of Current Content to playlist.

Fig. 6 A-6C is please referred to, it illustrates being used to indicate current in the gestural control method of the be shown with screen equipment of Fig. 5 Switching plays a kind of schematic diagram of gesture operation of object in the media content of broadcasting, and object will be played by, which having been shown in particular, is switched to Other segments of currently playing content play out the gesture operation schematic diagram of (i.e. " F.F. " and " rewind ").Such as Fig. 6 A, Fig. 6 B With the operation that shown in Fig. 6 C, the second default gesture operation can be palm grip and slide.As shown in Figure 6A, the five fingers articulations digitorum manus is curved Song is to the centre of the palm in gesture is grasped, and wherein arrow direction refers to arthrogryposis direction.In Fig. 6 B, arm and the hand in grasping gesture The palm moves horizontally to the right, and every one master output of movement correspondence jumps a play position adjustment unit (such as 30 seconds) backward.Such as In Fig. 6 C, arm and the palm in grasping gesture move horizontally to the left, and every one standards service of movement correspondence jumps forward one and broadcasts Put position adjustment unit.In this way, moving the gesture of formation in different directions to controlling to not by identical hand gesture It is equidirectional to jump.The hand gestures and motion track that can will test when detecting the gesture operation and the preset gesture are grasped The gesture template of work is matched.Optionally, the mobile speed of hand can also be included in the gesture template of the second default gesture operation The restriction of range is spent, such as no more than 0.5 meter per second.If user's hand movement speed is more than the velocity interval, do not generate corresponding Jump instruction.

Indicate that the second default gesture operation of redirect broadcasting position is easier to complete, and is easy memory shown in Fig. 6 A-6C. And user is not easy to fatigue when executing the gesture operation, to help to promote manipulation efficiency.

Optionally, in the operation of above-mentioned second gesture, be used to indicate in currently playing media content respectively along two not Equidirectional switching plays the gesture of object to can also be following any one: thumb and other four refer at least one finger pinches Sliding to the right and thumb and other four refer at least one refer to pinch slide to the left, palm stretches out cunning and palm to the right outwardly and stretches out outwardly To the left sliding, palm perpendicular to have screen equipment display screen to after incision to right cunning and palm perpendicular to having screen equipment display screen to incision It slides to the left afterwards, a left side is incited incites, etc. with the right side.

Fig. 6 D and Fig. 6 E show being used to indicate currently playing in the gestural control method of the be shown with screen equipment of Fig. 5 Switching plays the schematic diagram of another gesture operation of object in media content, and instruction has been shown in particular and is switched to broadcasting content The gesture operation schematic diagram of other media contents.As shown in Fig. 6 D and Fig. 6 E, broadcasting content is switched to other media contents Gesture operation can be the left gesture operation incited and the right side is incited, wherein the gesture operation that a left side is incited can correspond to " play next matchmaker Appearance in vivo ", " playing next collection "；The gesture operation that the right side is incited can correspond to " playing a upper media content ", " play upper one Collection ".In the gesture operation that a left side is incited, palm is towards there is screen equipment display screen, and using wrist as origin, wrist drives palm to left-handed Turn.In the gesture operation that the right side is incited, palm is towards there is screen equipment display screen, and using wrist as origin, wrist drives palm to rotate to the right. Optionally, rotation speed rotates 0 ° of 120 ° of < α < of angle less than 0.5 revolutions per second.

Optionally, it in above-mentioned second gesture operation, is used to indicate to play object along two different directions and be switched to remove and work as The gesture of other media contents except the media content of preceding broadcasting is to can also be following any one: palm stretches out the right side outwardly Sliding and palm stretches out left cunning outwardly, index finger is directed toward the left side and index finger be directed toward the right, on incite and under incite, etc..

It should be noted that being above only the exemplary illustration of the second default gesture.It is above-mentioned to be used to indicate to there is screen to set Standby the second default gesture operation for playing out object switching can also be that other preset gestures, the application do not make spy It is different to limit.

Optionally, the process 500 of the above-mentioned gestural control method for having screen equipment can also include the step in above-mentioned process 300 Rapid 302.I.e. after detecting gesture operation, it can be determined that gesture operation instruction adjusts volume or plays object switching, then Corresponding volume adjustment instruction is generated according to judging result or plays object switching command.

With continued reference to Fig. 7, it illustrates the further embodiments according to the gestural control method for having screen equipment of the application Flow chart.As shown in fig. 7, the process 700 of the gestural control method for having screen equipment of the present embodiment, comprising the following steps:

Step 701, detection is to the gesture operation for having screen equipment to be controlled.

The step 201 of above-mentioned steps 701 and previous embodiment is consistent, and the specific implementation of step 701 can also refer to The aforementioned description to step 201, details are not described herein again.

Step 702, in response to detecting that gesture operation is the third indicated to there is the broadcast window of screen equipment to be adjusted Default gesture operation, determines window adjustment parameter based on gesture operation, generates corresponding broadcast window according to window adjustment parameter Regulating command.

In the present embodiment, can be stored in advance be used to indicate it is pre- to the third for thering is the broadcast window of screen equipment to be adjusted If gesture operation, wherein being used to indicate can be the default gesture operation of the third for having the broadcast window of screen equipment to be adjusted Indicate the gesture operation that the size of broadcast window, position are adjusted.The gesture operation that may determine that step 701 detects is It is no consistent with the default gesture operation of the third.The feature of the gesture operation detected can be specifically extracted, and presets hand with third The feature templates of gesture are matched, and the gesture that can also be detected using the gesture identification model judgment step 701 trained is grasped Whether work, which presets gesture operation with third, matches.

In media play process, if the user desired that adjusting size or the position of broadcast window, instruction pair can be initiated The third for having the broadcast window of screen equipment to be adjusted presets gesture operation to adjust size or the position of broadcast window.Such as it can Gesture is preset to initiate third and is amplified to broadcast window full frame, is contracted to wicket, or mobile broadcast window is to gesture operation Specified position, etc..In this way, realize the control that broadcast window is adjusted with can be convenient.

Above-mentioned gesture operation may include the relevant parameter that broadcast window is adjusted in instruction, such as may include instruction The sized adjusting direction of broadcast window, adjustable range, etc..Herein, adjusting direction may include tuning up or turning down, adjust Adjusting range can be according to the adjusting step-length of hand moving distance in gesture operation or speed and unit distance or unit speed What product determined.

Optionally, above-mentioned instruction to the third for thering is the broadcast window of screen equipment to be adjusted preset gesture operation may include Broadcast window is switched to full frame gesture operation by instruction, and Fig. 8 shows above-mentioned instruction and broadcast window is switched to full frame one The schematic diagram of kind gesture operation.As shown in figure 8, singlehanded thumb and index finger stretch out in the gesture operation, other three fingers are closed Hold together, thumb and index finger are operated by the dynamic gesture for pinching release.Wherein, arrow direction is the direction of motion of index finger and thumb. In the gesture operation, index finger and thumb are slid in and out by relatively close location and are separated.Optionally, thumb and index finger slide Speed is not more than 0.3 meter per second.

Broadcast window is switched to full frame gesture operation by above-mentioned instruction can also be one of following gesture operation: double Hand is at frame shape, and right-hand man's separated dynamic gesture operation outward, i.e., the index finger of both hands and thumb are stretched out and separated, other three fingers conjunctions Hold together, the proficiency palm of the hand inwardly, the other hand palm of the hand outwardly, right-hand man's separated gesture operation round about；Hand forward extends out, hand The palm is by the gesture operation to spread one's fingers to stretching, extension of clenching fist；The gesture operation that both hands palm is separated from centre to both sides；The both hands centre of the palm Outward, the gesture operation that both hands palm is pushed aside in parallel from inside to outside；The gesture operation that the palm centre of the palm is outside, the five fingers close up and hover； Or the gesture operation that the palm centre of the palm is outside, the five fingers are opened and hovered.

It should be noted that being used to indicate for the present embodiment is default to the third for having the broadcast window of screen equipment to be adjusted Gesture operation can also be other gesture operations, be not particularly limited herein.

Optionally, the process 700 of the above-mentioned gestural control method for having screen equipment can also include the step in above-mentioned process 300 Rapid 302 and above-mentioned process 500 in step 502.I.e. after detecting gesture operation, it can be determined that gesture operation instruction It adjusts volume, switching broadcasting object or adjusts broadcast window, corresponding volume adjustment instruction is then generated according to judging result, is broadcast Put object switching command or broadcast window regulating command.

With continued reference to Fig. 9, it illustrates another embodiments according to the gestural control method for having screen equipment of the application Flow chart.As shown in figure 9, the process 900 of the gestural control method for having screen equipment of the present embodiment, may include following step It is rapid:

Step 901, detection is to the gesture operation for having screen equipment to be controlled.

The step 201 of above-mentioned steps 901 and previous embodiment is consistent, and the specific implementation of step 901 can also refer to The aforementioned description to step 201, details are not described herein again.

Step 902, in response to detecting that gesture operation is the 4th default hand for indicating to switch over media play state Gesture operation, generates the control instruction of switching media broadcast state.

Media play state may include playing, suspending, terminating, exiting, accelerating to play, slow down broadcasting, etc..In this reality It applies in example, the 4th default gesture operation for being used to indicate and switching over to media play state can be stored in advance.It may determine that Whether the gesture operation that step 901 detects is consistent with the 4th default gesture operation.The gesture detected can specifically be extracted The feature of operation, and matched with the feature templates of the 4th default gesture, the gesture identification model trained can also be utilized Whether the gesture operation that judgment step 901 detects matches with the 4th default gesture operation.

In media play process, if the user desired that switching broadcast state, can initiate above-mentioned 4th gesture operation with Switch broadcast state.Above-mentioned executing subject can detecte the gesture operation of user and generate corresponding switching media broadcast state Control instruction.Optionally, before the control instruction for generating switching media broadcast state, it is current that screen equipment can also be obtained Media play state, and generate the control that will there is screen equipment to switch to other broadcast states different from current media play state System instruction.

In some optional implementations of the present embodiment, above-mentioned steps 902 may include: step 9021, in response to Detect that gesture operation is the 4th default gesture operation for indicating for media play state to be switched to broadcast state or halted state, The control instruction of media play state switching is generated according to current media play state.

Above-mentioned 4th default gesture operation may include that media play state is switched to broadcast state or suspends shape by instruction The gesture operation of state.It can detecte whether gesture operation is switched to broadcast state for media play state with the instruction or suspends shape 4th gesture operation of state is consistent, if so, available current media play state.If current media play state is The control instruction for being switched to broadcast state then can be generated in halted state；If current media play state is broadcast state, The control instruction for being switched to halted state can be generated.

Figure 10 A and Figure 10 B show a kind of hand that media play state is switched to broadcast state or halted state by instruction The schematic diagram of gesture operation.As shown in figs. 10 a and 10b, media play state is switched to broadcast state or halted state by instruction Gesture operation can be the operation that index finger hits screen every null point.As shown in figs. 10 a and 10b, singlehanded index finger direction has screen to set Standby display screen stretches out, other four fingers close up.Optionally, the distance a of stretching is within the scope of a certain distance, such as 5 lis of a > Rice, the angle α after stretching with index finger before stretching is within the scope of certain angle, such as 0 ° of 120 ° of < α <.

Optionally, the 4th default gesture that media play state is switched to broadcast state or halted state is grasped in above-mentioned instruction It can also be following any one: " OK " hand that finger is single clickd on every sky, index finger and thumb rings lopping, other three fingers stretch out Gesture, gesture of clapping one's hands, finger or palm direction have screen equipment display screen to draw the gesture of triangle, fire finger, hand forward and by holding Fist to open, both hands in T-shape, the centre of the palm be pushed outwardly, index finger every empty adopting consecutive click chemical reaction more than twice, etc..Wherein, it indicates matchmaker Body broadcast state is switched to the gesture operation of broadcast state and the gesture that media play state is switched to halted state is grasped in instruction Work can be identical, can not also be identical.For example, finger is single clickd on every sky, index finger and thumb rings lopping, other three fingers stretch out " OK " gesture, gesture of clapping one's hands, finger or palm direction have screen equipment display screen to draw the gesture of triangle, fire finger, hand forward And the gesture operation by clenching fist to opening can indicate for media play state to be switched to broadcast state, both hands are in T-shape, the centre of the palm Be pushed outwardly, index finger every empty adopting consecutive click chemical reaction more than twice, the gesture clapped one's hands can indicate media play state being switched to pause State.

Above-mentioned steps 902 can also include: step 9022, in response to detecting that gesture operation is that media play is exited in instruction The 4th default gesture operation, generate exit play media content control instruction.

Above-mentioned 4th gesture operation can also include the gesture operation that media play is exited in instruction.It can detecte gesture operation Whether exit that the 4th gesture operation of media play is consistent with the instruction, plays media content if so, can be generated and exit Control instruction is so that the broadcasting for having screen equipment to exit current media content.

Optionally, it includes hand position on having screen equipment display screen that the gesture operation of media play is exited in above-mentioned instruction Projected position be located in predeterminable area every empty touch operation.

Still optionally further, above-mentioned steps 9022 can be realized as follows: in response to detecting that gesture operation is The 4th default gesture operation of media play is exited in instruction, and the duration of gesture operation is no more than preset time threshold, Generate the control instruction for being back to the upper level page of broadcast interface；In response to detecting that gesture operation is to indicate that exiting media broadcasts The 4th default gesture operation put, and the duration of gesture operation is more than preset time threshold, generation has been back to screen and has set The control instruction of standby homepage.

Specifically, it can detecte the duration that the gesture operation of media play is exited in Client-initiated instruction, according to The duration difference of the gesture come judge user be intended that return broadcast interface the upper level page or be back to screen The homepage of equipment.

Optionally, above-mentioned 4th gesture operation can be palm every the empty operation for touching screen predeterminable area.If detecting Palm is more than preset time threshold every the empty gesture duration for touching screen predeterminable area, can determine being intended that for user Homepage (the first screen page for having screen equipment) is returned to, generation, which is exited to homepage, exits control instruction；If detecting palm It is more than preset time threshold every the empty gesture duration for touching screen predeterminable area, can determines that being intended that for user is exited To the upper level page for playing the page, generates to exit to play the page and being back to and play the upper level page of the page and exit control Instruction.

Above-mentioned screen predeterminable area can be close to the region of screen edge, such as the screen upper left corner.Usual screen edge Be no icon etc. can operation object white space.The corresponding region of the 4th gesture operation is used the regions as, it can be with Avoid on screen other can operation object gesture operation control detection and identification interfere with each other and cause misidentify and accidentally Operation.

Figure 10 C and Figure 10 D show that indicate to exit the 4th default gesture operation of media play be palm every empty touch screen For the operation of curtain predeterminable area, another gesture operation schematic diagram in embodiment illustrated in fig. 9 is shown.Wherein, Figure 10 C shows Palm is gone out every palm in the empty operation for touching screen and the relative position schematic diagram for having screen equipment.As illustrated in figure 10 c, it is playing In the process, user can make gesture control and exit broadcast interface.After the hand of user lifts finger stretching, there is screen equipment that can know Other palm position is simultaneously projected on a display screen, as the initial position of gesture operation, can also provide position in initial position Prompt is set, such as position indicating is carried out with cursor or hand icon etc..At this moment, it can be determined that the initial position of gesture operation is It is no in the preset corresponding manipulation region of the 4th default gesture operation for indicating to exit media play.If so, user can be with Screen completion, which is hit, every null point exits operation.If there is screen equipment to detect hand dynamic trajectory shown in Figure 10 D, detection can be determined The gesture operation arrived is the 4th default gesture operation.User's palm can be further detected to stop every the gesture operation that null point hits screen The control for exiting and playing the page and returning to homepage can be generated if being more than preset time threshold (such as 3 seconds) in the time stayed System instruction, has screen equipment that can switch to homepage according to the return control instruction；It, can if being less than preset time threshold To generate the control instruction for exiting broadcast interface and returning to the upper level page, there is screen equipment that can be back to according to the control instruction The upper level page of broadcast interface.If the initial position of gesture operation is not located at that media play is exited in preset corresponding instruction In the manipulation region of four default gesture operations, user can accord with mobile hand according to the position indicating of cursor, hand icon makes it Projected position be moved to it is above-mentioned correspond to instruction exit in the manipulation region of the 4th default gesture operation of media play, in hand Position indicating symbol is having the projected position movement on screen equipment display screen to draw to provide a user with hand position in moving process It leads.The control area that the 4th default gesture operation of media play is exited in instruction is moved in the projected position of the hand position of user After in domain, if detecting hand dynamic trajectory shown in Figure 10 D, the gesture operation that can be confirmly detected is the 4th default gesture Operation.It is further determined to generate according to the duration of user's palm clicking operation and exits broadcast interface and be back to upper level page Face (such as broadcasting content selection page) or be back to homepage exit control instruction.

Optionally, the 4th default gesture operation that the broadcasting of current media content is exited in above-mentioned instruction can also be following Meaning one: parabola is drawn from left to right, the right side is incited, finger stretching is drawn a circle, it is aerial, etc. to catch past post-tensioning, the centre of the palm to hover outward. Wherein, parabola is drawn from left to right, the right gesture operation incited can indicate that the upper level page exited to the page is played, finger are stretched It draws a circle out, catch toward post-tensioning, the centre of the palm aerial gesture operation that hovers outward and can indicate to exit to homepage.

It should be noted that the embodiment of the present application is used to indicate the 4th default hand switched over to media play state Gesture operation can also be other gesture operations, be not particularly limited herein.

In some optional implementations of the embodiment of above-mentioned combination Fig. 2, Fig. 3, Fig. 5, Fig. 7, Fig. 9 description, there is screen The process of the gestural control method of equipment can also comprise determining that whether the page that screen equipment is currently presented is media play page Face；In response to determining that the page for having screen equipment currently to present is the media play page, and it is instruction to having that gesture operation is stated in detection Screen equipment carries out the default gesture operation of controlling media play, generates controlling media play corresponding with default gesture operation and refers to It enables.

That is, whether being the default gesture indicated to there is screen equipment to carry out controlling media play in detection gesture operation It is available to have the page properties that screen equipment is currently presented before operation.Determine that the page currently presented is according to page properties No is the media play page.If so, detection gesture operation whether be indicate to have screen equipment carry out controlling media play it is pre- If gesture operation, specifically can detecte whether gesture operation is to indicate to there is screen equipment to play out the first default of sound control Gesture operation, instruction are to there is screen equipment to play out the second default gesture operation of object switching, instruction to there is screen equipment to broadcast It puts the third that window is adjusted and presets the 4th default gesture behaviour that gesture operation or instruction switch over media play state Make.Otherwise can determine the gesture operation of user is not intended to progress controlling media play.

Optionally, the process 900 of the above-mentioned gestural control method for having screen equipment can also include the step in above-mentioned process 300 Rapid 302, the step 502 in above-mentioned process 500 and the step 702 in above-mentioned process 700.I.e. detect gesture operation it Afterwards, it can be determined that gesture operation instruction adjusts volume, switching plays object, adjusts broadcast window or broadcast state switching, then Corresponding volume adjustment instruction is generated, object switching command, broadcast window regulating command are played or plays shape according to judging result State switching command.

It should be noted that it is pre- that instruction executes different browsing control operates first in the application the various embodiments described above If gesture operation, the second default gesture operation, third preset gesture operation and the 4th default gesture operation can be different, When can correspond to multiple media control operations to avoid same gesture in this way, the operation that system is difficult to accurately identify user is intended to, from And it can guarantee the reliability of gesture manipulation.

In some optional implementations of the embodiment of above-mentioned combination Fig. 2, Fig. 3, Fig. 5, Fig. 7, Fig. 9 description, there is screen The process of the gestural control method of equipment can also include: in response to detecting the gesture identification for being used to indicate and waking up and having screen equipment The default gesture operation of system wakes up the gesture recognition system for having screen equipment.It can obtain in advance and be used to indicate wake-up and have screen The default gesture operation of the gesture recognition system of equipment, such as operation of clapping one's hands can when gesture recognition system is non-wake-up states There is the default gesture operation of gesture recognition system of screen equipment first to wake up gesture recognition system to be used to indicate to wake up by this, so It whether is afterwards the default gesture indicated to there is screen equipment to carry out controlling media play based on the operation of gesture recognition system detection gesture Operation.When the gesture recognition system long period gesture operation being not detected, dormant state can be entered.It is executed after waking up again Gestures detection operation, can save system resource.

With further reference to Figure 11, as the realization to method shown in above-mentioned each figure, this application provides one kind screen equipment Gesture control device one embodiment, the Installation practice and Fig. 2, Fig. 3, Fig. 5, Fig. 7 and embodiment of the method shown in Fig. 9 Corresponding, which specifically can be applied in various electronic equipments.

As shown in figure 11, the gesture control device 1100 for having screen equipment of the present embodiment includes detection unit 1101 and generates Unit 1102.Wherein, detection unit 1101 is configured as detecting the gesture operation to there is screen equipment to be controlled；Generation unit 1102 be configured in response to detect gesture operation be indicate to have screen equipment carry out controlling media play it is pre- If gesture operation, controlling media play instruction corresponding with default gesture operation is generated.

In some embodiments, above-mentioned generation unit 1102 can be configured to: in response to detecting that gesture is grasped Work is the first default gesture operation indicated to there is screen equipment to play out sound control, is generated and the first default gesture operation pair The broadcasting sound control instruction answered.

In some embodiments, above-mentioned generation unit 1102 can be configured to: in response to detecting that gesture is grasped Work is the first default gesture operation indicated to there is screen equipment to carry out mute state switching, is generated and the first default gesture operation pair The mute state switching control instruction answered；In response to detecting that gesture operation is indicated to have screen equipment to carry out volume adjustment the One default gesture operation determines volume adjustment direction and/or sound based on the hand position variation track of the first default gesture operation Regulated quantity is measured, corresponding volume adjustment instruction is generated according to volume adjustment direction and volume adjustment amount.

In some embodiments, above-mentioned instruction includes hand to there is screen equipment to carry out the first default gesture operation of volume adjustment Portion's posture is identical, the direction of motion corresponds respectively to two gesture operations in two different volume adjustment directions.

In some embodiments, above-mentioned generation unit 1102 can be additionally configured to: in response to detecting that gesture operation is It indicates to the second default gesture operation for thering is screen equipment to play out object switching, determines that target plays object according to gesture operation And it generates and switches to the instruction that target broadcasting object plays out.

In some embodiments, the above-mentioned second default gesture operation includes that hand gestures are identical, the direction of motion respectively corresponds In two gesture operations of two different switching directions.

In some embodiments, above-mentioned generation unit 1102 can be additionally configured to: in response to detecting that gesture operation is Instruction presets gesture operation to the third for having the broadcast window of screen equipment to be adjusted, and determines that window adjusts ginseng based on gesture operation Number generates corresponding broadcast window regulating command according to window adjustment parameter.

In some embodiments, above-mentioned generation unit 1102 can be additionally configured to: in response to detecting that gesture operation is It indicates the 4th default gesture operation switched over to media play state, generates the control instruction of switching media broadcast state.

In some embodiments, above-mentioned generation unit 1102 can be configured to: in response to detecting that gesture is grasped Work is the 4th default gesture operation for indicating for media play state to be switched to broadcast state or halted state, according to current matchmaker Body broadcast state generates the control instruction of media play state switching；In response to detecting that gesture operation is to indicate that exiting media broadcasts The 4th default gesture operation put generates the control instruction for exiting and playing media content.

In some embodiments, above-mentioned generation unit 1102 can be configured to: in response to detecting that gesture is grasped Work is the 4th default gesture operation that media play is exited in instruction, and the duration of gesture operation is no more than preset time threshold Value generates the control instruction for being back to the upper level page of broadcast interface；In response to detecting that gesture operation is that matchmaker is exited in instruction The 4th default gesture operation that body plays, and the duration of gesture operation is more than preset time threshold, generation has been back to The control instruction of the homepage of screen equipment.

In some embodiments, above-mentioned apparatus 1100 can also comprise determining that unit, be configured to determine that screen equipment is worked as Whether the page of preceding presentation is the media play page；Generation unit is configured to: having screen equipment current in response to determination The page of presentation is the media play page, and detect gesture operation be indicate to have screen equipment carry out controlling media play it is pre- If gesture operation, controlling media play instruction corresponding with default gesture operation is generated.

In some embodiments, above-mentioned apparatus 1100 can also include: wakeup unit, be configured to respond to detect use The default gesture operation for having the gesture recognition system of screen equipment is waken up in instruction, wakes up the gesture recognition system for having screen equipment.

It should be appreciated that in all units recorded in device 1100 and the method for reference Fig. 2, Fig. 3, Fig. 5, Fig. 7, Fig. 9 description Each step it is corresponding.Device 1100 is equally applicable to above with respect to the operation and feature of method description as a result, and is wherein wrapped The unit contained, details are not described herein.

The gesture control device 1100 for having screen equipment of the above embodiments of the present application, by detection to there is screen equipment to control The gesture operation of system, in response to detecting that gesture operation is the default gesture behaviour indicated to there is screen equipment to carry out controlling media play Make, generate controlling media play instruction corresponding with default gesture operation, independent of optional equipment and more wheel interactions, realizes More flexible has screen equipment browsing control.

The embodiment of the present application also provides a kind of electronic equipment, comprising: one or more processors；Display device；Storage Device, for storing one or more programs, when one or more programs are executed by one or more processors so that one or Multiple processors realize the gestural control method for having screen equipment of above-described embodiment.

Below with reference to Figure 12, it illustrates the computer systems for the electronic equipment for being suitable for being used to realize the embodiment of the present application 1200 structural schematic diagram.Electronic equipment shown in Figure 12 is only an example, should not function to the embodiment of the present application and Use scope brings any restrictions.

As shown in figure 12, computer system 1200 include central processing unit (CPU) 1201, can according to be stored in only It reads the program in memory (ROM) 1202 or is loaded into random access storage device (RAM) 1203 from storage section 1208 Program and execute various movements appropriate and processing.In RAM 1203, also it is stored with system 1200 and operates required various journeys Sequence and data.CPU 1201, ROM 1202 and RAM 1203 are connected with each other by bus 1204.Input/output (I/O) interface 1205 are also connected to bus 1204.

I/O interface 1205 is connected to lower component: the importation 1206 including keyboard, mouse etc.；Including such as cathode The output par, c 1207 of ray tube (CRT), liquid crystal display (LCD) etc. and loudspeaker etc.；Storage section including hard disk etc. 1208；And the communications portion 1209 of the network interface card including LAN card, modem etc..Communications portion 1209 passes through Communication process is executed by the network of such as internet.Driver 1210 is also connected to I/O interface 1205 as needed.It is detachable to be situated between Matter 1211, such as disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on as needed on driver 1210, so as to In being mounted into storage section 1208 as needed from the computer program read thereon.

Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium On computer program, which includes the program code for method shown in execution flow chart.In such reality It applies in example, which can be downloaded and installed from network by communications portion 1209, and/or from detachable media 1211 are mounted.When the computer program is executed by central processing unit (CPU) 1201, executes and limited in the present processes Above-mentioned function.It should be noted that the computer-readable medium of the application can be computer-readable signal media or meter Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device, Or above-mentioned any appropriate combination.In this application, computer readable storage medium can be it is any include or storage journey The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this In application, computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal, Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium Program code can transmit with any suitable medium, including but not limited to: wireless, electric wire, optical cable, RF etc. are above-mentioned Any appropriate combination.

The calculating of the operation for executing the application can be write with one or more programming languages or combinations thereof Machine program code, programming language include object oriented program language-such as Java, Smalltalk, C++, also Including conventional procedural programming language-such as " C " language or similar programming language.Program code can be complete It executes, partly executed on the user computer on the user computer entirely, being executed as an independent software package, part Part executes on the remote computer or executes on a remote computer or server completely on the user computer.It is relating to And in the situation of remote computer, remote computer can pass through the network of any kind --- including local area network (LAN) or extensively Domain net (WAN)-be connected to subscriber computer, or, it may be connected to outer computer (such as provided using Internet service Quotient is connected by internet).

Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the application, method and computer journey The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation A part of one module, program segment or code of table, a part of the module, program segment or code include one or more use The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box The function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actually It can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it to infuse Meaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holding The dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instruction Combination realize.

Being described in unit involved in the embodiment of the present application can be realized by way of software, can also be by hard The mode of part is realized.Described unit also can be set in the processor, for example, can be described as: a kind of processor packet Include detection unit and generation unit.Wherein, the title of these units does not constitute the limit to the unit itself under certain conditions It is fixed, for example, detection unit is also described as " unit of the detection to the gesture operation for having screen equipment to be controlled ".

As on the other hand, present invention also provides a kind of computer-readable medium, which be can be Included in device described in above-described embodiment；It is also possible to individualism, and without in the supplying device.Above-mentioned calculating Machine readable medium carries one or more program, when said one or multiple programs are executed by the device, so that should Device: detection to the gesture operation for thering is screen equipment to be controlled, in response to detect gesture operation be instruction to have screen equipment into The default gesture operation of row controlling media play generates controlling media play instruction corresponding with default gesture operation.

Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.Those skilled in the art Member is it should be appreciated that invention scope involved in the application, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic Scheme, while should also cover in the case where not departing from foregoing invention design, it is carried out by above-mentioned technical characteristic or its equivalent feature Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed herein Can technical characteristic replaced mutually and the technical solution that is formed.

Claims (15)

1. a kind of gestural control method for having screen equipment, comprising:

Detection is to the gesture operation for having screen equipment to be controlled；

In response to detecting that the gesture operation is indicated to the default gesture behaviour for having screen equipment to carry out controlling media play Make, generates controlling media play instruction corresponding with the default gesture operation.

2. described in response to detecting that the gesture operation is that instruction has to described according to the method described in claim 1, wherein Screen equipment carries out the default gesture operation of controlling media play, generates controlling media play corresponding with the default gesture operation Instruction, comprising:

In response to detecting that the gesture operation is indicated to the first default hand for having screen equipment to play out sound control Gesture operation generates broadcasting sound control instruction corresponding with the described first default gesture operation.

3. described in response to detecting that the gesture operation is that instruction has to described according to the method described in claim 2, wherein Screen equipment plays out the default gesture operation of sound control, generates broadcasting sound control corresponding with the default gesture operation Instruction, comprising:

In response to detecting that the gesture operation is indicated to the first default hand for having screen equipment to carry out mute state switching Gesture operation generates mute state switching control instruction corresponding with the described first default gesture operation；

In response to detecting that the gesture operation is indicated to the first default gesture behaviour for having screen equipment to carry out volume adjustment Make, volume adjustment direction and/or volume adjustment amount determined based on the hand position variation track of the described first default gesture operation, Corresponding volume adjustment instruction is generated according to the volume adjustment direction and volume adjustment amount.

4. according to the method described in claim 3, wherein, the instruction has screen equipment to carry out the first pre- of volume adjustment to described If gesture operation includes two gestures that hand gestures are identical, the direction of motion corresponds respectively to two different volume adjustment directions Operation.

5. method according to claim 1-4, wherein described in response to detecting that the gesture operation is instruction To the default gesture operation for thering is screen equipment to carry out controlling media play, media corresponding with the default gesture operation are generated Play control instruction, further includes:

In response to detecting that the gesture operation is indicated to the second default hand for having screen equipment to play out object switching Gesture operation determines that target plays object and generation switches to target and plays the finger that object plays out according to the gesture operation It enables.

6. according to the method described in claim 5, wherein, the second default gesture operation includes that hand gestures are identical, moves Direction corresponds respectively to two gesture operations of two different switching directions.

7. method according to claim 1-4, wherein described in response to detecting that the gesture operation is instruction To the default gesture operation for thering is screen equipment to carry out controlling media play, media corresponding with the default gesture operation are generated Play control instruction, further includes:

In response to detecting that the gesture operation is that the third for indicating that the broadcast window for having screen equipment is adjusted is preset Gesture operation determines window adjustment parameter based on the gesture operation, generates corresponding broadcasting according to the window adjustment parameter Window regulating command.

8. method according to claim 1-4, wherein described in response to detecting that the gesture operation is instruction To the default gesture operation for thering is screen equipment to carry out controlling media play, media corresponding with the default gesture operation are generated Play control instruction, further includes:

It is raw in response to detecting that the gesture operation is the 4th default gesture operation for indicating to switch over media play state At the control instruction for switching the media play state.

9. described in response to detecting that the gesture operation is that media are broadcast in instruction according to the method described in claim 8, wherein The 4th default gesture operation that the state of putting switches over generates the control instruction for switching the media play state, comprising:

In response to detecting that the gesture operation is indicate for media play state to be switched to broadcast state or halted state Four default gesture operations generate the control instruction of media play state switching according to current media play state；

In response to detecting that the gesture operation is the 4th default gesture operation that media play is exited in instruction, broadcasting is exited in generation The control instruction of media content.

10. described in response to detecting that the gesture operation is that matchmaker is exited in instruction according to the method described in claim 9, wherein The 4th default gesture operation that body plays generates the control instruction for exiting and playing media, comprising:

In response to detecting that the gesture operation is the 4th default gesture operation that media play is exited in instruction, and the gesture is grasped The duration of work is no more than preset time threshold, generates the control instruction for being back to the upper level page of broadcast interface；

In response to detecting that the gesture operation is the 4th default gesture operation that media play is exited in instruction, and the gesture is grasped The duration of work is more than preset time threshold, generates the control instruction for being back to the homepage for having screen equipment.

11. method according to claim 1-4, wherein the method also includes:

Whether the page for having screen equipment currently to present described in determination is the media play page；

It is described in response to detect the gesture operation be indicate to it is described have screen equipment carry out controlling media play default hand Gesture operation generates controlling media play instruction corresponding with the default gesture operation, comprising:

It is the media play page in response to the page for having screen equipment currently to present described in determination, and detects that the gesture operation is It indicates to generate corresponding with the default gesture operation the default gesture operation for thering is screen equipment to carry out controlling media play Controlling media play instruction.

12. method according to claim 1-4, wherein the method also includes:

In response to detect be used to indicate wake up described in have screen equipment gesture recognition system default gesture operation, described in wake-up There is the gesture recognition system of screen equipment.

13. a kind of gesture control device for having screen equipment, comprising:

Detection unit is configured as detecting the gesture operation to there is screen equipment to be controlled；

Generation unit is configured to respond to detect that the gesture operation is that instruction has screen equipment to carry out media play to described The default gesture operation of control generates controlling media play instruction corresponding with the default gesture operation.

14. a kind of electronic equipment, comprising:

One or more processors；

Display device；

Storage device, for storing one or more programs,

When one or more programs are executed by one or more processors, so that one or more processors realize such as claim Any method in 1-12.

15. a kind of computer-readable medium, is stored thereon with computer program, wherein realized such as when program is executed by processor Any method in claim 1-12.