CN109240551A - Use the method and Related product of gesture control electronic device - Google Patents

Use the method and Related product of gesture control electronic device Download PDF

Info

Publication number
CN109240551A
CN109240551A CN201810943209.XA CN201810943209A CN109240551A CN 109240551 A CN109240551 A CN 109240551A CN 201810943209 A CN201810943209 A CN 201810943209A CN 109240551 A CN109240551 A CN 109240551A
Authority
CN
China
Prior art keywords
gesture
ultrasonic
signal
ultrasonic signal
change
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810943209.XA
Other languages
Chinese (zh)
Other versions
CN109240551B (en
Inventor
米岚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oppo Chongqing Intelligent Technology Co Ltd
Original Assignee
Oppo Chongqing Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo Chongqing Intelligent Technology Co Ltd filed Critical Oppo Chongqing Intelligent Technology Co Ltd
Priority to CN201810943209.XA priority Critical patent/CN109240551B/en
Publication of CN109240551A publication Critical patent/CN109240551A/en
Application granted granted Critical
Publication of CN109240551B publication Critical patent/CN109240551B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/043Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
    • G06F3/0433Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves in which the acoustic waves are either generated by a movable member and propagated within a surface layer or propagated within a surface layer and captured by a movable member
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04108Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

This application provides a kind of methods and Related product using gesture control electronic device, and described method includes following steps: emitting the first ultrasonic signal by the ultrasonic sensor to form sound field;The second ultrasonic signal is obtained by the ultrasonic sensor, second ultrasonic signal is all or part of echo-signal of first ultrasonic signal;The situation of change that the sound field is determined according to second ultrasonic signal determines gesture according to the situation of change, generates control command corresponding with the gesture and controls the electronic device emission time time of reception emission time time of reception.Technical solution provided by the present application has the advantages that user experience is high.

Description

Use the method and Related product of gesture control electronic device
Technical field
This application involves communication and field of terminal, and in particular to a kind of method and phase using gesture control electronic device Close product.
Background technique
In the prior art, mobile terminal (such as mobile phone, tablet computer) has become user's first choice and frequency of use highest Electronic device.Existing mobile terminal is based on touching display screen and controls application, and such mode is based on touching display screen Touch parameter control application, this control is controlled based on the way of contact, existing mobile terminal can not be based on cordless Control application, influences user experience.
Summary of the invention
The embodiment of the present application provides a kind of method and Related product using gesture control electronic device, can be by non- The way of contact controls electronic device, improves user experience.
In a first aspect, the embodiment of the present application provides a kind of method applied using gesture control, the method is applied to electricity Sub-device, the electronic device include: ultrasonic sensor, and the ultrasonic sensor is the biography with transmitting-receiving ultrasonic signal Sensor, described method includes following steps:
Emit the first ultrasonic signal by the ultrasonic sensor to form sound field;
The second ultrasonic signal is obtained by the ultrasonic sensor, second ultrasonic signal the first surpasses to be described All or part of echo-signal of acoustic signals;
The situation of change that the sound field is determined according to second ultrasonic signal determines hand according to the situation of change Gesture, when generating control command control corresponding with gesture electronic device emission time time of reception emission time reception It carves.
Second aspect, provides a kind of electronic device, and the electronic device includes: processor and ultrasonic sensor, described Ultrasonic sensor is the sensor with transmitting-receiving ultrasonic signal, wherein;
The ultrasonic sensor, for emitting the first ultrasonic signal to form sound field;
The ultrasonic sensor, is also used to obtain the second ultrasonic signal, and second ultrasonic signal is described the All or part of echo-signal of one ultrasonic signal;
The processor, for determining the situation of change of the sound field according to second ultrasonic signal, according to described in Situation of change determines gesture, generates control command corresponding with the gesture and controls the electronic device emission time time of reception The emission time time of reception.
The third aspect, provides a kind of computer readable storage medium, and storage is used for the computer journey of electronic data interchange Sequence, wherein the computer program makes computer execute the method that first aspect provides.
Fourth aspect, provides a kind of computer program product, and the computer program product includes storing computer journey The non-transient computer readable storage medium of sequence, the computer program are operable to that computer is made to execute first aspect offer Method.
Implement the embodiment of the present application, has the following beneficial effects:
As can be seen that ultrasonic wave emission time time of reception sensor emission the first surpasses in electronic device provided by the present application Acoustic signals obtain the second ultrasonic signal to form sound field, and the situation of change of sound field is determined according to the second ultrasonic signal, according to Gesture is determined according to the situation of change, electronic device is controlled according to gesture, since the gesture is the sound field by non-touch-control mode Situation of change determine, so the technical solution realizes cordless control electronic device, improve user experience Degree.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is some embodiments of the present application, for ability For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.
Fig. 1 is a kind of structural schematic diagram of electronic device provided by the embodiments of the present application.
Fig. 2 is a kind of schematic diagram of electronic device disclosed in the embodiment of the present application.
Fig. 3 is a kind of structural block diagram of electronic device provided by the embodiments of the present application.
Fig. 4 a is a kind of ultrasonic wave transmitting reflection schematic diagram provided by the embodiments of the present application.
Fig. 4 b is a kind of ultrasonic wave transmitting reflection position schematic diagram provided by the embodiments of the present application.
Fig. 5 is a kind of flow diagram of method applied using gesture control provided by the embodiments of the present application.
Fig. 6 is a kind of structural schematic diagram of mobile phone disclosed in the embodiment of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiment is some embodiments of the present application, instead of all the embodiments.Based on this Shen Please in embodiment, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall in the protection scope of this application.
The description and claims of this application and term " first ", " second ", " third " and " in the attached drawing Four " etc. are not use to describe a particular order for distinguishing different objects.In addition, term " includes " and " having " and it Any deformation, it is intended that cover and non-exclusive include.Such as it contains the process, method of a series of steps or units, be System, product or equipment are not limited to listed step or unit, but optionally further comprising the step of not listing or list Member, or optionally further comprising other step or units intrinsic for these process, methods, product or equipment.
Referenced herein " embodiment " is it is meant that a particular feature, structure, or characteristic described can wrap in conjunction with the embodiments It is contained at least one embodiment of the application.Each position in the description occur the phrase might not each mean it is identical Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and Implicitly understand, embodiment described herein can be combined with other embodiments.
In the method that first aspect provides, the variation feelings that the sound field is determined according to second ultrasonic signal Condition specifically includes:
The matched third ultrasonic signal of display screen with electronic device, foundation are extracted from second ultrasonic signal The third ultrasonic signal determines the situation of change of the sound field in front of the display screen.
In the method that first aspect provides, the display extracted from second ultrasonic signal with electronic device Shield matched third ultrasonic signal to specifically include:
Second ultrasonic signal is received by least two ultrasonic sensors, obtains at least two ultrasonic waves First signal strength indication of the second ultrasonic signal that the first ultrasonic sensor in sensor receives and it is described at least The second signal intensity value for the second ultrasonic signal that the second ultrasonic sensor in two ultrasonic sensors receives, really It is the third that the first signal strength indication, which is greater than the ultrasonic signal of second signal intensity value, in fixed second ultrasonic signal Ultrasonic signal;
First ultrasonic sensor and horizontal angle are more than or equal to 90 ° less than 180 °, second ultrasonic wave Sensor and horizontal angle are more than or equal to 180 ° and are less than or equal to 270 °
It is described to determine gesture according to the situation of change in the method that first aspect provides, it generates and the gesture pair The control command answered controls the electronic device and specifically includes:
It such as determines that gesture is left sliding according to the situation of change, controls the display content page turning to the left of the display screen;
It such as determines that gesture is right sliding according to the situation of change, controls the display content page turning to the right of the display screen;
Such as determine that gesture is upper sliding according to the situation of change, the display content for controlling the display screen moves up;
Such as determine that gesture is lower slider according to the situation of change, the display content for controlling the display screen moves down.
It is described to determine gesture according to the situation of change in the method that first aspect provides, it generates and the gesture pair The control command answered controls the electronic device and specifically includes:
When determining first gesture according to the situation of change, first gesture pair is determined according to gesture and the mapping relations of order When answering return command, controls the electronic device and be back to the setting page.
It is described that first ultrasonic signal packet is emitted by the ultrasonic sensor in the method that first aspect provides It includes: by the ultrasonic sensor, the first ultrasonic wave being emitted with the corresponding frequency of the emission time in multiple emission times Signal, the situation of change that the sound field is determined according to second ultrasonic signal, determines hand according to the situation of change Gesture specifically includes:
When calculating the transmitting of the first ultrasonic signal of the corresponding first frequency of the first emission time of multiple emission times The time difference between the time of reception of the second ultrasonic signal corresponding with the first frequency is carved, all emission times pair are traversed The tranmitting frequency answered obtains multiple time differences, and emission time obtains the variation tendency of the multiple time difference and described the second surpasses The variation tendency of multiple signal strengths of acoustic signals, variation tendency and the multiple signal according to the multiple time difference The variation tendency of intensity determines gesture.
In the method that first aspect provides, the variation tendency according to the multiple time difference and the multiple letter The variation tendency of number intensity determines that gesture specifically includes:
If the variation tendency of the multiple time difference is and the multiple signal strength from becoming from small to large from big to small Variation tendency be from big to small, determine the gesture be slide to the right.
In the method that first aspect provides, the variation tendency according to the multiple time difference and the multiple letter The variation tendency of number intensity determines that gesture specifically includes:
When the variation tendency of the multiple time difference is from becoming from small to large from big to small, and the multiple signal is strong The variation tendency of degree is from small to large, to determine that institute's gesture is to slide to the left.
In the electronic device that second aspect provides, the processor is specifically used for from second ultrasonic signal It extracts across the third ultrasonic signal in front of the display screen of electronic device, is determined according to the third ultrasonic signal described aobvious The situation of change of sound field in front of display screen.
In the electronic device that second aspect provides, the processor is specifically used for determining when according to the situation of change Gesture is left sliding, controls the display content page turning to the left of the display screen;When according to the situation of change determine gesture for the right side Sliding, controls the display content page turning to the right of the display screen;When determining that gesture is upper sliding according to the situation of change, control The display content of the display screen moves up;When determining that gesture is lower slider according to the situation of change, the display is controlled The display content of screen moves down.
In the electronic device that second aspect provides, the processor is specifically used for such as determining according to the situation of change First gesture controls the electronic device when determining the corresponding return command of first gesture according to gesture and the mapping relations of order It is back to the setting page.
Referring to Fig. 1, Fig. 1 is that the embodiment of the present application provides a kind of electronic device, referring to Fig. 1, Fig. 1 is of the invention real Apply example and provide a kind of structural schematic diagram of electronic device 100, above-mentioned electronic device 100 include: shell 110, circuit board 120, Battery 130 (optional), cover board 140, touching display screen 150, ultrasonic sensor 160 and transceiver 180, the shell 110 The upper circuit board 120, ultrasonic sensor 160, battery 130 and the cover board 140, the circuit board 120 of being arranged is also set up There is the circuit for connecting the touching display screen 150;The circuit board 120 can also include: application processor AP190.It is above-mentioned.
Above-mentioned transceiver 180 can be different transceivers according to the form of different electronic devices, for example, the electronics fills It is set to mobile phone, which can be smart television with wireless antenna, such as electronic device, which can be the network port.
Above-mentioned touching display screen is specifically as follows Thin Film Transistor-LCD (Thin Film Transistor- Liquid Crystal Display, TFT-LCD), light emitting diode (Light Emitting Diode, LED) display screen, have Machine light emitting diode (Organic Light-Emitting Diode, OLED) display screen etc..
Referring to Fig. 2, Fig. 2 is the structural schematic diagram of another kind electronic equipment 100 disclosed in the embodiment of the present application, electronics is set Standby 200 include storage and processing circuit 210, and the telecommunication circuit 220 and audio that connect with the storage and processing circuit 210 Component 240, wherein in some specific electronic equipments 200, display component 230 or touch control component can also be set.
Electronic equipment 200 may include control circuit, which may include storage and processing circuit 210.This is deposited Storage and processing circuit 210 can store device, such as hard drive memory, nonvolatile memory (such as flash memory or it is used for shape At other electrically programmable read only memories etc. of solid state drive), volatile memory (such as either statically or dynamically arbitrary access Memory etc.) etc., the embodiment of the present application is with no restriction.Processing circuit in storage and processing circuit 210 can be used for controlling electricity The operating of sub- equipment 200.The processing circuit can microprocessor based on one or more, microcontroller, digital signal processor, Baseband processor, power management unit, audio codec chip, specific integrated circuit, display-driver Ics etc. come It realizes.
Storage and processing circuit 210 can be used for running the software in electronic equipment 200, such as voice over internet protocol (Voice over Internet Protocol, VOIP) call application program, simultaneous interpretation function, media play application Program, operation system function etc..These softwares can be used for executing some control operations, for example, the image based on camera is adopted Collection, the ambient light measurement based on ambient light sensor, the proximity sensor measurement based on proximity sensor, based on such as luminous two The information display function that the positioning indicators such as the status indicator lamp of pole pipe are realized, the touch event detection based on touch sensor, Operation associated with wireless communication function is executed, operation associated with collecting and generating audio signal, with collection and processing Other functions etc. in the associated control operation of button press event data and electronic equipment 200, the embodiment of the present application is not It is restricted.
Electronic equipment 200 can also include input-output circuit 250.Input-output circuit 250 can be used for setting electronics Standby 200 realization data are output and input, i.e. permission electronic equipment 200 allows electronic equipment from outer equipment receiving data and also 200 export data to external equipment from electronic equipment 200.Input-output circuit 250 may further include sensor 270. Sensor 270 may include ambient light sensor, the proximity sensor based on light and capacitor, and touch sensor is (for example, be based on light Touch sensor and/or capacitive touch sensors, wherein touch sensor can be a part of touching display screen, can also Independently to be used as a touch sensor arrangement), acceleration transducer and other sensors etc..
Input-output circuit 250 can also include that touch sensor array (is shown that is, display 230 can be touch-control Screen).Touch sensor can be the electricity formed by transparent touch sensor electrode (such as tin indium oxide (ITO) electrode) array Appearance formula touch sensor, or can be the touch sensor formed using other touching techniques, such as sound wave touch-control, pressure-sensitive touching It touches, resistive touch, optical touch etc., the embodiment of the present application is with no restriction.
Electronic equipment 200 can also include audio component 240.Audio component 240 can be used for providing for electronic equipment 200 Audio input and output function.Audio component 240 in electronic equipment 200 may include loudspeaker, microphone, buzzer, sound Adjust generator and other for generating and detecting the component of sound.
Telecommunication circuit 220 can be used for providing the ability with external device communication for electronic equipment 200.Telecommunication circuit 220 It may include analog- and digital- input-output interface circuit, and the radio communication circuit based on radiofrequency signal and/or optical signal. Radio communication circuit in telecommunication circuit 220 may include radio-frequency transceiver circuitry, power amplifier circuit, low noise amplification Device, switch, filter and antenna.For example, the radio communication circuit in telecommunication circuit 220 may include for passing through transmitting The circuit of near-field communication (Near Field Communication, NFC) is supported with near-field coupling electromagnetic signal is received.Example Such as, telecommunication circuit 220 may include near-field communication aerial and near-field communication transceiver.Telecommunication circuit 220 can also include honeycomb Telephone transceiver and antenna, wireless lan transceiver circuit and antenna etc..
Electronic equipment 200 can further include battery, power management circuitry and other input-output units 260.It is defeated Enter-output unit 260 may include button, control stick, click wheel, scroll wheel, touch tablet, keypad, keyboard, camera, hair Optical diode or other positioning indicators etc..
User can input a command for the operation of controlling electronic devices 200 by input-output circuit 250, and can be with Status information and other outputs from electronic equipment 200 are received using the output data of input-output circuit 250 to realize.
Electronic equipment 200 can further include ultrasonic sensor, which can be with audio component 240 is integrated, specifically, the microphone can integrate ultrasonic echography wave sensor receipts if the audio component 240 includes microphone Send out the function of ultrasonic wave.
A kind of electronic device 300 is provided refering to Fig. 3, Fig. 3, the electronic device is as shown in Figure 3, comprising: processor 301 surpasses Sonic sensor 302 and display screen 304, the processor 301 are separately connected with ultrasonic sensor 302 and display screen, connection Mode includes but is not limited to bus mode, it can also use other modes, such as single line connection type certainly.
Ultrasonic sensor 302, for emitting the first ultrasonic signal to form sound field;
Ultrasonic sensor 302, is also used to obtain the second ultrasonic signal, and second ultrasonic signal is described first All or part of echo-signal of ultrasonic signal;
Processor 301, for determining the situation of change of the sound field according to second ultrasonic signal, according to the change Change situation and determine gesture, generates control command corresponding with the gesture and control the electronic device.
Ultrasonic sensor emits the first ultrasonic signal to form sound field in electronic device provided by the present application, obtains the Two ultrasonic signals determine the situation of change of sound field according to the second ultrasonic signal, determine gesture, foundation according to the situation of change Gesture controls electronic device, since the gesture is determined by the situation of change of the sound field of non-touch-control mode, so should Technical solution realizes cordless control electronic device, improves user experience.
Optionally, above-mentioned to determine that the situation of change of the sound field can specifically include according to second ultrasonic signal:
Processor 301 is super across the third in front of display screen 304 specifically for extracting from second ultrasonic signal Acoustic signals determine the situation of change of the sound field in front of the display screen according to the third ultrasonic signal.
This technical solution is in order to avoid the interference of the gesture at the electronic device back side, for gesture identification, especially Gesture identification based on ultrasonic signal, since ultrasonic signal is the signal of a sound wave, display screen front and Rear can have ultrasonic signal, but for a user, the gesture identification significant to user is generally present in display Shield the gesture in front, therefore the technical program determines gesture according to the situation of change of the sound field in front of display screen.
Optionally, above-mentioned to be extracted from second ultrasonic signal and the matched third ultrasound of the display screen of electronic device Wave signal specifically includes:
Processor 301 is specifically used for receiving second ultrasonic signal by least two ultrasonic sensors, obtain First signal of the second ultrasonic signal that the first ultrasonic sensor at least two ultrasonic sensors receives The second ultrasonic signal that the second ultrasonic sensor in intensity value and at least two ultrasonic sensors receives Second signal intensity value, determine that the first signal strength indication in second ultrasonic signal is greater than the super of second signal intensity value Acoustic signals are the third ultrasonic signal;
First ultrasonic sensor and horizontal angle are more than or equal to 90 ° less than 180 °, second ultrasonic wave Sensor and horizontal angle are more than or equal to 180 ° and are less than or equal to 270 °.
Optionally, above-mentioned to determine gesture according to the situation of change, generate control command control corresponding with the gesture The electronic device can specifically include:
Processor 301 controls the display screen specifically for such as determining that gesture is left sliding according to the situation of change Show content page turning to the left;It such as determines that gesture is right sliding according to the situation of change, controls the display content of the display screen Page turning to the right;Such as determine that gesture is upper sliding according to the situation of change, the display content for controlling the display screen moves up; Such as determine that gesture is lower slider according to the situation of change, the display content for controlling the display screen moves down.
Optionally, above-mentioned to determine gesture according to the situation of change, generate control command control corresponding with the gesture The electronic device can specifically include:
Processor 301, specifically for such as determining first gesture according to the situation of change, the mapping according to gesture and order When relationship determines that first gesture corresponds to return command, controls the electronic device and be back to the setting page.
Optionally, above-mentioned first ultrasonic signal can also include the ultrasonic signal of multiple frequencies.Emission time
Above-mentioned multiple frequencies can specifically include, the acoustic signals more than 20KHz, and the application is not intended to limit above-mentioned multiple frequencies The particular number of rate does not limit the specific frequency values of above-mentioned multiple frequencies yet.Specifically, in an alternative embodiment, on Stating multiple frequencies can be for 10 frequency, and 10 frequencies can be respectively, 21KHz, 22KHz, 23KHz, 24KHz, 25KHz, 26KHz、27KHz、28KHz、29KHz、30KHz。
The above-mentioned situation of change that the sound field is determined according to second ultrasonic signal is determined according to the situation of change Gesture can specifically include:
Processor 301, first of the corresponding first frequency of the first emission time specifically for calculating multiple emission times Time difference between the time of reception of the emission time of ultrasonic signal the second ultrasonic signal corresponding with the first frequency, It traverses the corresponding tranmitting frequency of all emission times and obtains multiple time differences, emission time obtains the variation of the multiple time difference The variation tendency of trend and multiple signal strengths of second ultrasonic signal, the variation according to the multiple time difference become The variation tendency of gesture and the multiple signal strength determines gesture, generates the corresponding control command of the gesture, applies journey to this Sequence executes the control command.
The emission time emission time time of reception is a kind of ultrasonic wave transmitting reflection schematic diagram refering to Fig. 4 a, Fig. 4 a, is such as schemed Shown in 4a, electronic device shown in Fig. 4 a is by taking smart phone as an example, and the ultrasonic sensor of the smart phone is mounted on two sides, i.e., It is located at the left side and right side of smart phone, it is assumed here that the ultrasonic sensor of left side emits the first ultrasonic wave letter Number, the ultrasonic sensor of right side receives the second ultrasonic signal.
It is the schematic diagram of reverberation (hand) in position a, position b and position c refering to Fig. 4 b, Fig. 4 b, ultrasonic wave also belongs to A kind of sound wave, some features with sound wave, such as speed have in 340m/s or so, such as the frequency of ultrasonic wave with occurring source It closes, will not change because of reflection to frequency.Refering to Fig. 4 b, for convenience of description, the first ultrasonic wave will be emitted here The ultrasonic sensor of signal is known as ultrasonic transmitter, and the ultrasonic sensor that will acquire the second ultrasonic signal is known as ultrasound Wave receiver, is found through experiments that, when being in position b, the sum of transmitting range+reflective distance is most short, passes through multiple reality Analysis is tested, if the distance between reverberation and smart phone are constant, the position where the reverberation is located at ultrasonic wave hair When emitter and the center position of the ultrasonic receiver line, the sum of transmitting range+reflective distance is most short.Such as the hair of position b It penetrates that the sum of distance+transmitting range is most short, is embodied in the parameter of ultrasonic wave, i.e. the difference of emission time and the time of reception is minimum, As shown in Figure 4 b, closer with position b, the difference of corresponding emission time and the time of reception are closer to shortest time poor (i.e. position b Emission time and the difference of the time of reception), conversely, corresponding emission time and the difference of the time of reception and shortest time difference are bigger, It is remoter with position b, based on the principle that, brandishing for emitting substance (hand) can be determined, then according to multiple Reflected intensity determines the direction waved, and then confirms to motion profile.
For example, refering to Fig. 4 b, for position a, corresponding path is L1, and path L1 points are La-1, La-2;It is right In position c, corresponding path is Lc, and path Lc points are Lc-1, Lc-2;It makes discovery from observation, the distance of La-1 is less than Lc-1, it is assumed that the ultrasonic transmitter is located at the left side of Fig. 4 b, then being transmission path for La-1, La-2 is reflection path, It is transmission path for position c, Lc-1, Lc-2 is reflection path, the principle of foundation ultrasonic reflections, the signal strength of reflection Will be far below the signal strength of transmitting, the attenuation ratio of unit distance is identical, then assuming transmitting ultrasonic wave for position a Frequency be fa, position c assume transmitting ultrasonic wave frequency be fc, to position a path La-1 it is smaller, then ultrasonic wave send out Intensity a when being mapped to position a is greater than the intensity c when c of position, and due to being a same reverberation (hand), and reflection angle is also basic It is constant, so its reflection loss coefficient is also consistent, then the initial intensity of the La-2 after reflection is greater than the Lc-2 after transmitting Initial intensity, although the distance of Lc-2 be greater than La-2 distance, since the difference of initial intensity is larger, so frequency fa Reflected signal strength value be less than the reflected signal strength value of frequency fc.
In order to better illustrate, determine that the reflected signal strength value of frequency fa is less than frequency below by mathematical way The reason of reflected signal strength value of fc.
It is symmetrical relative to position b for position a and position c, so for La-1+La-2=Lc-1+Lc-2;That is, Lc-1-La-1=Lc-2-La-2;Since the attenuation coefficient of unit distance is consistent, so for Lc-1-La-1 and Lc- The ratio of the decaying of 2-La-2 is consistent, then determining the decaying of the big still Lc-2-La-2 of the pad value of Lc-1-La-1 Value is greatly based on initial signal strength, for ultrasonic wave, after the initial signal intensity of Lc-1-La-1 is greater than reflection certainly Ultrasonic wave initial signal intensity, so for Lc-1-La-1 decaying signal strength indication it is big, Lc-2-La-2 decaying letter Number intensity value is small, so the reflected signal strength value of frequency fa is less than the reflected signal strength value of frequency fc.
Processor 301, first of the corresponding first frequency of the first emission time specifically for calculating multiple emission times Time difference between the time of reception of the emission time of ultrasonic signal the second ultrasonic signal corresponding with the first frequency, Traverse the corresponding tranmitting frequency of all emission times and obtain multiple time differences, obtain multiple time differences variation tendency and this The variation tendency of multiple signal strengths of two ultrasonic signals is strong according to the variation tendency of multiple time difference and multiple signals The variation tendency of degree determines gesture.
Specifically, the processor 301, specifically can be used for when the variation tendency of multiple time differences being from becoming from big to small From small to large, the variation tendency of multiple signal strength is from big to small, to determine that the gesture is from ultrasonic transmitter to ultrasound Wave receiver is mobile (sliding to the right).
The processor 301, specifically can be used for when multiple time differences variation tendency be from become from big to small from it is small to Greatly, the variation tendency of multiple signal strength is from small to large, to determine that the gesture is to emit from ultrasonic receiver to ultrasonic wave Device is mobile (sliding to the left).
Specifically, the processor 301 then generates application page towards the right side when specifically for being right sliding such as the gesture The order of sliding.
Specifically, the processor 301, being specifically used for the gesture such as is left sliding, then generates application page towards left cunning Dynamic order.
Refering to Fig. 5, Fig. 5 is a kind of method using gesture control electronic device provided by the present application, and this method is applied to Electronic device, the electronic device may include ultrasonic sensor, which can be structure as shown in Figure 2 or Figure 3, This method comprises the following steps:
Step S501, the first ultrasonic signal is emitted to form sound field by the ultrasonic sensor;
Step S502, the second ultrasonic signal is obtained by the ultrasonic sensor, second ultrasonic signal is All or part of echo-signal emission time of first ultrasonic signal;
Step S503, the situation of change that the sound field is determined according to second ultrasonic signal, according to the variation feelings Condition determines gesture, generates control command corresponding with the gesture and controls the electronic device.Technical solution provided by the present application Ultrasonic sensor emits the first ultrasonic signal to form sound field, obtains the second ultrasonic signal, believes according to the second ultrasonic wave The situation of change for number determining sound field, determines gesture according to the situation of change, controls according to gesture electronic device, due to the gesture It is to be determined by the situation of change of the sound field of non-touch-control mode, so the technical solution realizes cordless control electricity Sub-device improves user experience.
Optionally, above-mentioned to determine that the situation of change of the sound field specifically includes according to second ultrasonic signal:
From being extracted in second ultrasonic signal across the third ultrasonic signal in front of the display screen of electronic device, according to The situation of change of the sound field in front of the display screen is determined according to the third ultrasonic signal.
Optionally, above-mentioned to determine gesture according to the situation of change, generate control command control corresponding with the gesture The electronic device specifically includes:
It such as determines that gesture is left sliding according to the situation of change, controls the display content page turning to the left of the display screen;
It such as determines that gesture is right sliding according to the situation of change, controls the display content page turning to the right of the display screen;
Such as determine that gesture is upper sliding according to the situation of change, the display content for controlling the display screen moves up;
Such as determine that gesture is lower slider according to the situation of change, the display content for controlling the display screen moves down.
Optionally, above-mentioned to determine gesture according to the situation of change, generate control command control corresponding with the gesture The electronic device specifically includes:
First gesture such as is determined according to the situation of change, determines first gesture pair according to gesture and the mapping relations of order When answering return command, controls the electronic device and be back to the setting page.
It is described according to second ultrasonic signal when such as first ultrasonic signal includes the ultrasonic wave of multiple frequencies The situation of change for determining the sound field determines that gesture specifically includes according to the situation of change:
Above-mentioned multiple frequencies can specifically include, the acoustic signals more than 20KHz, and the application is not intended to limit above-mentioned multiple frequencies The particular number of rate does not limit the specific frequency values of above-mentioned multiple frequencies yet.Specifically, in an alternative embodiment, on Stating multiple frequencies can be for 10 frequency, and 10 frequencies can be respectively, 21KHz, 22KHz, 23KHz, 24KHz, 25KHz, 26KHz、27KHz、28KHz、29KHz、30KHz。
Obtain the first ultrasonic signal of the multiple frequency multiple emission times and the second ultrasonic signal it is more A time of reception obtains multiple signal strengths of the second ultrasonic signal, according to the multiple emission time, the multiple reception Moment and the multiple signal strength determine gesture, generate the corresponding control command of the gesture, hold to the application program The row control command.
The emission time time of reception is optional, the above-mentioned variation feelings that the sound field is determined according to second ultrasonic signal Condition determines that gesture specifically includes the emission time time of reception and specifically includes according to the situation of change:
When calculating the transmitting of the first ultrasonic signal of the corresponding first frequency of the first emission time of multiple emission times The time difference between the time of reception of the second ultrasonic signal corresponding with the first frequency is carved, all emission times pair are traversed The tranmitting frequency answered obtains multiple time differences, obtains the variation tendency and the multiple signal strength of the multiple time difference Variation tendency determines gesture according to the variation tendency of the multiple time difference and the variation tendency of the multiple signal strength.
Optionally, above-mentioned according to the variation tendency of the multiple time difference and the variation tendency of the multiple signal strength Determine that gesture specifically includes:
If the variation tendency of the multiple time difference is and the multiple signal strength from becoming from small to large from big to small Variation tendency be from big to small, determine the gesture be slide to the right.
Optionally, above-mentioned according to the variation tendency of the multiple time difference and the variation tendency of the multiple signal strength Determine that gesture specifically includes:
If the variation tendency of the multiple time difference is and the multiple signal strength from becoming from small to large from big to small Variation tendency be from small to large, determine the gesture be slide to the left.
Fig. 6 shows the block diagram of the part-structure of mobile phone relevant to mobile terminal provided by the embodiments of the present application.Ginseng Fig. 6 is examined, mobile phone includes: radio frequency (Radio Frequency, RF) circuit 910, memory 920, input-output unit 930, sensing Device 950, audio collection device 960, Wireless Fidelity (Wireless Fidelity, WiFi) module 970, application processor AP980, The components such as touching display screen 933, power supply 990.It will be understood by those skilled in the art that handset structure shown in Fig. 6 not structure The restriction of pairs of mobile phone may include perhaps combining certain components or different components than illustrating more or fewer components Arrangement.
It is specifically introduced below with reference to each component parts of the Fig. 6 to mobile phone:
Input-output unit 930 can be used for receiving the number or character information of input, and generates and set with the user of mobile phone It sets and the related key signals of function control inputs.Specifically, input unit 930 may include fingerprint identification device 931, face knowledge Other device 936, iris identification device 937 and other input equipments 932.Input unit 930 can also include that other inputs are set Standby 932.Specifically, other input equipments 932 can include but is not limited to physical button, function key (such as volume control button, Switch key etc.), trace ball, mouse, one of operating stick etc. or a variety of.Wherein,
Application processor AP980 is the control centre of mobile phone, utilizes each of various interfaces and connection whole mobile phone Part by running or execute the software program and/or module that are stored in memory 920, and calls and is stored in memory Data in 920 execute the various functions and processing data of mobile phone, to carry out integral monitoring to mobile phone.Optionally, AP980 It may include one or more processing units;Optionally, AP980 can integrate application processor and modem processor, wherein answer With the main processing operation system of processor, user interface and application program etc., modem processor mainly handles wireless communication. It is understood that above-mentioned modem processor can not also be integrated into AP980.
In addition, memory 920 may include high-speed random access memory, it can also include nonvolatile memory, example Such as at least one disk memory, flush memory device or other volatile solid-state parts.
RF circuit 910 can be used for sending and receiving for information.In general, RF circuit 910 includes but is not limited to antenna, at least one A amplifier, transceiver, coupler, low-noise amplifier (Low Noise Amplifier, LNA), duplexer etc..In addition, RF circuit 910 can also be communicated with network and other equipment by wireless communication.Any communication can be used in above-mentioned wireless communication Standard or agreement, including but not limited to global system for mobile communications (Global System of Mobile Communication, GSM), general packet radio service (General Packet Radio Service, GPRS), code it is point more Location (Code Division Multiple Access, CDMA), wideband code division multiple access (Wideband Code Division Multiple Access, WCDMA), long term evolution (Long Term Evolution, LTE), Email, short message service (Short Messaging Service, SMS) etc..
Mobile phone may also include at least one sensor 950, such as optical sensor, motion sensor and other sensors. Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ambient light Light and shade adjust the brightness of touching display screen, proximity sensor can when mobile phone is moved in one's ear, close touching display screen and/ Or backlight.As a kind of motion sensor, accelerometer sensor can detect (generally three axis) acceleration in all directions Size can detect that size and the direction of gravity when static, can be used to identify mobile phone posture application (such as horizontal/vertical screen switching, Dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.;It can also configure as mobile phone The other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, details are not described herein.
Audio collection device 960, loudspeaker 961, microphone 962 can provide the audio interface between user and mobile phone.Audio Electric signal after the audio data received conversion can be transferred to loudspeaker 961, be converted to by loudspeaker 961 by collector 960 Voice signal plays;On the other hand, the voice signal of collection is converted to electric signal by microphone 962, is connect by audio collection device 960 Audio data is converted to after receipts, then after audio data is played AP980 processing, through RF circuit 910 to be sent to such as the other hand Machine, or audio data is played to memory 920 to be further processed.
Above-mentioned mobile phone can also include: ultrasonic sensor, which can be integrated with audio collection device 960 Setting.
Audio collection device 960, for emitting the first ultrasonic signal to form sound field emission time;
Audio collection device 960, is also used to obtain the second ultrasonic signal, and second ultrasonic signal the first surpasses to be described All or part of echo-signal of acoustic signals;
Application processor AP980, for determining the situation of change of the sound field, foundation according to second ultrasonic signal The situation of change determines gesture, generates control command corresponding with the gesture and controls the electronic device.
Application processor AP980, specifically for extracting the display screen with electronic device from second ultrasonic signal Matched third ultrasonic signal determines the variation feelings of the sound field in front of the display screen according to the third ultrasonic signal Condition.
Application processor AP980 is controlled described aobvious specifically for such as determining that gesture is left sliding according to the situation of change The display content page turning to the left of display screen;It such as determines that gesture is right sliding according to the situation of change, controls the aobvious of the display screen Show content page turning to the right;Such as determine that gesture is upper sliding according to the situation of change, control the display content of the display screen to Upper movement;Such as determine that gesture is lower slider according to the situation of change, the display content for controlling the display screen moves down.
Application processor AP980, specifically for such as determining first gesture according to the situation of change, according to gesture and order Mapping relations when determining that first gesture corresponds to return command, control the electronic device and be back to the setting page.
If first ultrasonic signal includes multiple frequencies, application processor AP980 is specifically used for calculating multiple transmittings The emission time of first ultrasonic signal of the corresponding first frequency of the first emission time at moment is corresponding with the first frequency The second ultrasonic signal the time of reception between time difference, traverse the corresponding tranmitting frequency of all emission times obtain it is multiple Time difference obtains the variation of the variation tendency of the multiple time difference and multiple signal strengths of second ultrasonic signal Trend determines gesture according to the variation tendency of the multiple time difference and the variation tendency of the multiple signal strength.
Application processor AP980, specifically for such as the multiple time difference variation tendency be from become from big to small from It is small to arrive greatly, and the variation tendency of the multiple signal strength is from big to small, to determine that the gesture is to slide to the right.
Application processor AP980, specifically for such as the multiple time difference variation tendency be from become from big to small from It is small to arrive greatly, and the variation tendency of the multiple signal strength is from small to large, to determine that institute's gesture is to slide to the left.
WiFi belongs to short range wireless transmission technology, and mobile phone can help user's transceiver electronics postal by WiFi module 970 Part, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 6 is shown WiFi module 970, but it is understood that, and it is not belonging to must be configured into for mobile phone, it can according to need do not changing completely Become in the range of the essence of application and omits.
Mobile phone further includes the power supply 990 (such as battery) powered to all parts, and optionally, power supply can pass through power supply pipe Reason system and AP980 are logically contiguous, to realize the function such as management charging, electric discharge and power managed by power-supply management system Energy.
Although being not shown, mobile phone can also be including camera, bluetooth module, light compensating apparatus, light sensor etc., herein not It repeats again.
As can be seen that ultrasonic sensor emits the first ultrasonic signal to form sound in electronic device provided by the present application , the second ultrasonic signal is obtained, the situation of change of sound field is determined according to the second ultrasonic signal, is determined according to the situation of change Gesture controls electronic device according to gesture, since the gesture is determined by the situation of change of the sound field of non-touch-control mode , so the technical solution realizes cordless control electronic device, improve user experience.
The embodiment of the present application also provides a kind of computer storage medium, wherein computer storage medium storage is for electricity The computer program of subdata exchange, it is as any in recorded in above method embodiment which execute computer It is a kind of to use some or all of the method for gesture control electronic device step.
The embodiment of the present application also provides a kind of computer program product, and the computer program product includes storing calculating The non-transient computer readable storage medium of machine program, the computer program are operable to that computer is made to execute such as above-mentioned side Any one recorded in method embodiment uses some or all of the method for gesture control electronic device step.
It should be noted that for the various method embodiments described above, for simple description, therefore, it is stated as a series of Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because According to the application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know It knows, embodiment described in this description belongs to alternative embodiment, related actions and modules not necessarily the application It is necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, reference can be made to the related descriptions of other embodiments.
In several embodiments provided herein, it should be understood that disclosed device, it can be by another way It realizes.For example, the apparatus embodiments described above are merely exemplary, such as the division of the unit, it is only a kind of Logical function partition, there may be another division manner in actual implementation, such as multiple units or components can combine or can To be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual Coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit, It can be electrical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also be realized in the form of software program module.
If the integrated unit is realized in the form of software program module and sells or use as independent product When, it can store in a computer-readable access to memory.Based on this understanding, the technical solution of the application substantially or Person says that all or part of the part that contributes to existing technology or the technical solution can body in the form of software products Reveal and, which is stored in a memory, including some instructions are used so that a computer equipment (can be personal computer, server or network equipment etc.) executes all or part of each embodiment the method for the application Step.And memory above-mentioned includes: USB flash disk, read-only memory (ROM, Read-Only Memory), random access memory The various media that can store program code such as (RAM, Random Access Memory), mobile hard disk, magnetic or disk.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can It is completed with instructing relevant hardware by program, which can store in a computer-readable memory, memory May include: flash disk, read-only memory (English: Read-Only Memory, referred to as: ROM), random access device (English: Random Access Memory, referred to as: RAM), disk or CD etc..
The embodiment of the present application is described in detail above, specific case used herein to the principle of the application and Embodiment is expounded, the description of the example is only used to help understand the method for the present application and its core ideas; At the same time, for those skilled in the art can in specific embodiments and applications according to the thought of the application There is change place, in conclusion the contents of this specification should not be construed as limiting the present application.

Claims (15)

1. a kind of method using gesture control electronic device, which is characterized in that the method is applied to electronic device, the electricity Sub-device includes: ultrasonic sensor, and the ultrasonic sensor is the sensor with transmitting-receiving ultrasonic signal, the method Include the following steps:
Emit the first ultrasonic signal by the ultrasonic sensor to form sound field;
The second ultrasonic signal is obtained by the ultrasonic sensor, second ultrasonic signal is first ultrasonic wave All or part of echo-signal of signal;
The situation of change that the sound field is determined according to second ultrasonic signal determines gesture according to the situation of change, raw The electronic device is controlled at control command corresponding with the gesture.
2. the method according to claim 1, wherein described determine the sound according to second ultrasonic signal The situation of change of field specifically includes:
The matched third ultrasonic signal of display screen with electronic device is extracted from second ultrasonic signal, according to described in Third ultrasonic signal determines the situation of change of the sound field in front of the display screen.
3. according to the method described in claim 2, it is characterized in that, extraction and the electronics from second ultrasonic signal The matched third ultrasonic signal of the display screen of device specifically includes:
Second ultrasonic signal is received by least two ultrasonic sensors, obtains at least two supersonic sensings First signal strength indication of the second ultrasonic signal that the first ultrasonic sensor in device receives and at least two described The second signal intensity value for the second ultrasonic signal that the second ultrasonic sensor in ultrasonic sensor receives, determines institute Stating the first signal strength indication in the second ultrasonic signal to be greater than the ultrasonic signal of second signal intensity value is the third ultrasound Wave signal;
First ultrasonic sensor and horizontal angle are more than or equal to 90 ° less than 180 °, second supersonic sensing Device and horizontal angle are more than or equal to 180 ° and are less than or equal to 270 °.
4. the method according to claim 1, wherein described determine gesture according to the situation of change, generate with The gesture corresponding control command control electronic device specifically includes:
When according to the situation of change determine gesture be left sliding, when controlling the display content page turning to the left of the display screen;
When according to the situation of change determine gesture be right sliding, when controlling the display content page turning to the right of the display screen;
When determining that gesture is upper sliding according to the situation of change, when controlling the display content of the display screen and moving up;
When determining that gesture is lower slider according to the situation of change, when controlling the display content of the display screen and moving down.
5. the method according to claim 1, wherein described determine gesture according to the situation of change, generate with The gesture corresponding control command control electronic device specifically includes:
First gesture is determined according to the situation of change, is determined that first gesture is corresponding with the mapping relations of order according to gesture and is returned When order, controls the electronic device and be back to the setting page.
6. the method according to claim 1, wherein described pass through the first ultrasound of ultrasonic sensor transmitting Wave signal includes: by the ultrasonic sensor, in multiple emission times with the emission time corresponding frequency transmitting the One ultrasonic signal, the situation of change that the sound field is determined according to second ultrasonic signal, according to the variation feelings Condition determines that gesture specifically includes:
Calculate the emission time of the first ultrasonic signal of the corresponding first frequency of the first emission time of multiple emission times with Time difference between the time of reception of corresponding second ultrasonic signal of the first frequency, it is corresponding to traverse all emission times Tranmitting frequency obtains multiple time differences, emission time obtain the multiple time difference variation tendency and second ultrasonic wave The variation tendency of multiple signal strengths of signal, variation tendency and the multiple signal strength according to the multiple time difference Variation tendency determine gesture.
7. according to the method described in claim 6, it is characterized in that, the variation tendency according to the multiple time difference and The variation tendency of the multiple signal strength determines that gesture specifically includes:
When the variation tendency of the multiple time difference is and the change of the multiple signal strength from becoming from small to large from big to small Change trend is from big to small, to determine that the gesture is to slide to the right.
8. according to the method described in claim 6, it is characterized in that, the variation tendency according to the multiple time difference and The variation tendency of the multiple signal strength determines that gesture specifically includes:
When the variation tendency of the multiple time difference is and the change of the multiple signal strength from becoming from small to large from big to small Change trend is from small to large, to determine that institute's gesture is to slide to the left.
9. a kind of electronic device, which is characterized in that the electronic device includes: processor and ultrasonic sensor, the ultrasound Wave sensor is the sensor with transmitting-receiving ultrasonic signal, wherein;
The ultrasonic sensor, for emitting the first ultrasonic signal to form sound field;
The ultrasonic sensor, is also used to obtain the second ultrasonic signal, and second ultrasonic signal the first surpasses to be described All or part of echo-signal of acoustic signals;
The processor, for determining the situation of change of the sound field according to second ultrasonic signal, according to the variation Situation determines gesture, generates control command corresponding with the gesture and controls the electronic device.
10. electronic device according to claim 9, which is characterized in that
The processor, specifically for extracting the matched third of display screen with electronic device from second ultrasonic signal Ultrasonic signal determines the situation of change of the sound field in front of the display screen according to the third ultrasonic signal.
11. electronic device according to claim 10, which is characterized in that the ultrasonic sensor is at least two ultrasounds Wave sensor, at least two ultrasonic sensors are using the display screen as image line mirror settings;Described at least two super The first ultrasonic sensor in sonic sensor and horizontal angle are more than or equal to 90 ° less than 180 °, and described at least two The second ultrasonic sensor and horizontal angle in ultrasonic sensor are more than or equal to 180 ° and are less than or equal to 270 °;
The processor is received specifically for obtaining the first ultrasonic sensor at least two ultrasonic sensors The second ultrasonic signal the first signal strength indication and the second ultrasonic wave at least two ultrasonic sensors pass The second signal intensity value for the second ultrasonic signal that sensor receives determines that the first signal is strong in second ultrasonic signal The ultrasonic signal that angle value is greater than second signal intensity value is the third ultrasonic signal.
12. electronic device according to claim 9, which is characterized in that
The processor, specifically for controlling the display screen when determining that gesture is left sliding according to the situation of change Show content page turning to the left;When determining that gesture is right sliding according to the situation of change, in the display that controls the display screen Hold page turning to the right;When determining that gesture is upper sliding according to the situation of change, the display content for controlling the display screen is upward It is mobile;When determining that gesture is lower slider according to the situation of change, the display content for controlling the display screen is moved down.
13. electronic device according to claim 9, which is characterized in that
The processor, specifically for being closed according to the mapping of gesture and order when determining first gesture according to the situation of change It is when determining that first gesture corresponds to return command, to control the electronic device and be back to the setting page.
14. a kind of computer readable storage medium, which is characterized in that it stores the computer program for being used for electronic data interchange, Wherein, the computer program makes computer execute the method according to claim 1.
15. a kind of computer program product, which is characterized in that the computer program product includes storing computer program Non-transient computer readable storage medium, the computer program are operable to that computer is made to execute such as claim 1-8 Method described in one.
CN201810943209.XA 2018-08-17 2018-08-17 Method for controlling electronic device by using gestures and related product Active CN109240551B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810943209.XA CN109240551B (en) 2018-08-17 2018-08-17 Method for controlling electronic device by using gestures and related product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810943209.XA CN109240551B (en) 2018-08-17 2018-08-17 Method for controlling electronic device by using gestures and related product

Publications (2)

Publication Number Publication Date
CN109240551A true CN109240551A (en) 2019-01-18
CN109240551B CN109240551B (en) 2021-06-15

Family

ID=65069978

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810943209.XA Active CN109240551B (en) 2018-08-17 2018-08-17 Method for controlling electronic device by using gestures and related product

Country Status (1)

Country Link
CN (1) CN109240551B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110032276A (en) * 2019-03-07 2019-07-19 永德利硅橡胶科技(深圳)有限公司 Quick start voice translation method and Related product
CN110297542A (en) * 2019-06-28 2019-10-01 Oppo广东移动通信有限公司 Parameter regulation means and relevant device
CN110764612A (en) * 2019-10-08 2020-02-07 Oppo(重庆)智能科技有限公司 Ultrasonic processing method, ultrasonic processing device, electronic device, and computer-readable medium
CN111722715A (en) * 2020-06-17 2020-09-29 上海思立微电子科技有限公司 Gesture control system and electronic equipment
CN113359139A (en) * 2020-03-03 2021-09-07 阿里巴巴集团控股有限公司 Intelligent device, switch device, electronic device and interaction device
CN114208216A (en) * 2020-07-15 2022-03-18 谷歌有限责任公司 Detecting contactless gestures using radio frequency

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150293599A1 (en) * 2014-04-10 2015-10-15 Mediatek Inc. Ultrasound-based methods for touchless gesture recognition, and apparatuses using the same
CN105204649A (en) * 2015-10-15 2015-12-30 广东欧珀移动通信有限公司 Method and device for unlocking mobile terminal
CN105242786A (en) * 2015-10-15 2016-01-13 广东欧珀移动通信有限公司 Ultrasonic wave-based application control method and device
CN105243316A (en) * 2015-10-15 2016-01-13 广东欧珀移动通信有限公司 Method and device for unlocking mobile terminal
US20160170491A1 (en) * 2014-12-12 2016-06-16 Alpine Electronics, Inc. Gesture assistive zoomable selector for screen
CN106462299A (en) * 2016-09-29 2017-02-22 北京小米移动软件有限公司 Terminal, touch identification method, touch identification device, and electronic device
CN108052352A (en) * 2017-11-30 2018-05-18 努比亚技术有限公司 Control method, terminal and the computer readable storage medium of screen on-off state

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150293599A1 (en) * 2014-04-10 2015-10-15 Mediatek Inc. Ultrasound-based methods for touchless gesture recognition, and apparatuses using the same
US20160170491A1 (en) * 2014-12-12 2016-06-16 Alpine Electronics, Inc. Gesture assistive zoomable selector for screen
CN105204649A (en) * 2015-10-15 2015-12-30 广东欧珀移动通信有限公司 Method and device for unlocking mobile terminal
CN105242786A (en) * 2015-10-15 2016-01-13 广东欧珀移动通信有限公司 Ultrasonic wave-based application control method and device
CN105243316A (en) * 2015-10-15 2016-01-13 广东欧珀移动通信有限公司 Method and device for unlocking mobile terminal
CN106462299A (en) * 2016-09-29 2017-02-22 北京小米移动软件有限公司 Terminal, touch identification method, touch identification device, and electronic device
CN108052352A (en) * 2017-11-30 2018-05-18 努比亚技术有限公司 Control method, terminal and the computer readable storage medium of screen on-off state

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110032276A (en) * 2019-03-07 2019-07-19 永德利硅橡胶科技(深圳)有限公司 Quick start voice translation method and Related product
CN110297542A (en) * 2019-06-28 2019-10-01 Oppo广东移动通信有限公司 Parameter regulation means and relevant device
CN110297542B (en) * 2019-06-28 2022-10-18 Oppo广东移动通信有限公司 Parameter adjusting method and related equipment
CN110764612A (en) * 2019-10-08 2020-02-07 Oppo(重庆)智能科技有限公司 Ultrasonic processing method, ultrasonic processing device, electronic device, and computer-readable medium
CN110764612B (en) * 2019-10-08 2023-09-08 Oppo(重庆)智能科技有限公司 Ultrasonic processing method, ultrasonic processing device, electronic equipment and computer readable medium
CN113359139A (en) * 2020-03-03 2021-09-07 阿里巴巴集团控股有限公司 Intelligent device, switch device, electronic device and interaction device
CN111722715A (en) * 2020-06-17 2020-09-29 上海思立微电子科技有限公司 Gesture control system and electronic equipment
CN114208216A (en) * 2020-07-15 2022-03-18 谷歌有限责任公司 Detecting contactless gestures using radio frequency

Also Published As

Publication number Publication date
CN109240551B (en) 2021-06-15

Similar Documents

Publication Publication Date Title
CN109240551A (en) Use the method and Related product of gesture control electronic device
TWI646472B (en) Mobile terminal, fingerprint identification area display method and device
CN103309673B (en) A kind of conversation processing method based on gesture, device
CN107194324A (en) Fingerprint recognition region display methods and Related product
WO2018196660A1 (en) Fingerprint recognition region display method and related products
CN108701043A (en) A kind of processing method and processing device of display
CN103634717B (en) A kind of method, device and the terminal device of the control of utilization earphone
TW201839594A (en) Mobile Terminal, Fingerprint Identification Control Method And Device
CN107135019A (en) Antenna-switching device and mobile terminal
CN109274833A (en) The method of adjustment and Related product of electromagnetic interference
CN108900231A (en) Dynamic antenna method of adjustment and Related product
CN108924417A (en) Filming control method and Related product
CN109274812A (en) The method and Related product of ultrasonic wave gesture control electronic device
CN108541080A (en) First electronic equipment and the second electronic equipment carry out the method and Related product of Hui Lian
CN107423601A (en) Method for controlling fingerprint identification and Related product
CN108833683A (en) Dynamic antenna adjusts implementation method and Related product
WO2018133664A1 (en) Fingerprint recognition module and electronic device
CN109104203A (en) Communication means, electronic device and computer readable storage medium
CN109085953A (en) It is a kind of to reduce the method interfered and terminal device
AU2016309822A1 (en) System and method for double knuckle touch screen control
CN109844702A (en) The control method and input equipment of a kind of pair of electronic equipment
CN107193474A (en) Solve lock control method and Related product
CN107194227A (en) Solve lock control method and Related product
CN105807908B (en) A kind of method and apparatus of switching working mode
CN108834013A (en) A kind of wearable device electric quantity balancing method and Related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant