CN109274812A - The method and Related product of ultrasonic wave gesture control electronic device - Google Patents

The method and Related product of ultrasonic wave gesture control electronic device Download PDF

Info

Publication number
CN109274812A
CN109274812A CN201810917635.6A CN201810917635A CN109274812A CN 109274812 A CN109274812 A CN 109274812A CN 201810917635 A CN201810917635 A CN 201810917635A CN 109274812 A CN109274812 A CN 109274812A
Authority
CN
China
Prior art keywords
electronic device
gesture
ultrasonic
signal
control command
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810917635.6A
Other languages
Chinese (zh)
Other versions
CN109274812B (en
Inventor
米岚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oppo Chongqing Intelligent Technology Co Ltd
Original Assignee
Oppo Chongqing Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo Chongqing Intelligent Technology Co Ltd filed Critical Oppo Chongqing Intelligent Technology Co Ltd
Priority to CN201810917635.6A priority Critical patent/CN109274812B/en
Publication of CN109274812A publication Critical patent/CN109274812A/en
Application granted granted Critical
Publication of CN109274812B publication Critical patent/CN109274812B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/12Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Environmental & Geological Engineering (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

This application provides a kind of method of ultrasonic wave gesture control electronic device, the electronic device includes: ultrasonic sensor, and the ultrasonic sensor is the sensor with signal transmitting and receiving function;Emit the first ultrasonic signal by the ultrasonic sensor to generate sound field;The second ultrasonic signal is obtained by the ultrasonic sensor, second ultrasonic signal is all or part of echo-signal of first ultrasonic signal;Gesture is determined according to second ultrasonic signal, according to electronic device described in the gesture control.Technical solution provided by the present application has the advantages that user experience is high.

Description

The method and Related product of ultrasonic wave gesture control electronic device
Technical field
This application involves communication and field of terminal, and in particular to a kind of method of ultrasonic wave gesture control electronic device and Related product.
Background technique
In the prior art, mobile terminal (such as mobile phone, tablet computer) has become user's first choice and frequency of use highest Electronic device.The frame of existing mobile terminal realizes the control to terminal based on physical button, the physical button cost Height, and the service life of physical button is limited, influences user experience.
Summary of the invention
The embodiment of the present application provides the method and Related product of a kind of ultrasonic wave gesture control electronic device, can pass through The cordless of ultrasonic wave gesture realizes frame keypress function, improves user experience.
In a first aspect, the embodiment of the present application provides a kind of electronic device, the electronic device includes: processor, ultrasonic wave Sensor, the processor are connect with the ultrasonic sensor, and the ultrasonic sensor is with signal transmitting and receiving function Sensor;
The ultrasonic sensor, for emitting the first ultrasonic signal to generate sound field;
The ultrasonic sensor, is also used to obtain the second ultrasonic signal, and second ultrasonic signal is described the All or part of echo-signal of one ultrasonic signal;
The processor, for determining gesture according to second ultrasonic signal, according to the dress of electronics described in gesture control It sets.
Second aspect, provides a kind of method of ultrasonic wave gesture control electronic device, and the electronic device includes: ultrasonic wave Sensor, the ultrasonic sensor are the sensor with signal transmitting and receiving function;
Emit the first ultrasonic signal by the ultrasonic sensor to generate sound field;
The second ultrasonic signal is obtained by the ultrasonic sensor, second ultrasonic signal the first surpasses to be described All or part of echo-signal of acoustic signals;
Gesture is determined according to second ultrasonic signal, according to electronic device described in the gesture control.
The third aspect, provides a kind of computer readable storage medium, and storage is used for the computer journey of electronic data interchange Sequence, wherein the computer program makes computer execute the method that second aspect provides.
Fourth aspect, provides a kind of computer program product, and the computer program product includes storing computer journey The non-transient computer readable storage medium of sequence, the computer program are operable to that computer is made to execute second aspect offer Method.
Implement the embodiment of the present application, has the following beneficial effects:
As can be seen that ultrasonic sensor emits the first ultrasonic signal to generate sound in electronic device provided by the present application , ultrasonic sensor also obtains the second ultrasonic signal, determines gesture according to the second ultrasonic signal, then generates the gesture Corresponding control command controls electronic device.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is some embodiments of the present application, for ability For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.
Fig. 1 is a kind of structural schematic diagram of electronic device provided by the embodiments of the present application.
Fig. 2 is a kind of schematic diagram of electronic device disclosed in the embodiment of the present application.
Fig. 3 is a kind of structural block diagram of electronic device provided by the embodiments of the present application.
Fig. 4 a is a kind of ultrasonic wave transmitting reflection schematic diagram provided by the embodiments of the present application.
Fig. 4 b is a kind of ultrasonic wave transmitting position view provided by the embodiments of the present application.
Fig. 5 a is the structural schematic diagram of the embodiment of the present application input matrix.
Fig. 5 b is the structural schematic diagram of the embodiment of the present application input three-dimensional data.
Fig. 6 is a kind of flow diagram of the method for ultrasonic wave gesture control electronic device provided by the embodiments of the present application.
Fig. 7 is a kind of structural schematic diagram of mobile phone disclosed in the embodiment of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiment is some embodiments of the present application, instead of all the embodiments.Based on this Shen Please in embodiment, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall in the protection scope of this application.
The description and claims of this application and term " first ", " second ", " third " and " in the attached drawing Four " etc. are not use to describe a particular order for distinguishing different objects.In addition, term " includes " and " having " and it Any deformation, it is intended that cover and non-exclusive include.Such as it contains the process, method of a series of steps or units, be System, product or equipment are not limited to listed step or unit, but optionally further comprising the step of not listing or list Member, or optionally further comprising other step or units intrinsic for these process, methods, product or equipment.
Referenced herein " embodiment " is it is meant that a particular feature, structure, or characteristic described can wrap in conjunction with the embodiments It is contained at least one embodiment of the application.Each position in the description occur the phrase might not each mean it is identical Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and Implicitly understand, embodiment described herein can be combined with other embodiments.
In the electronic device that first aspect provides, the processor is also used to obtain electronic device currently running the One application program generates control command of the gesture in first application program according to the gesture, to described first Application program executes the control command.
In the electronic device that first aspect provides, the processor is held specifically for determination first application program Corresponding first as a result, acquisition and at least one associated parameter of the first application program, judge institute after the row control command It states whether the first result conflicts at least one described parameter, such as determines that conflict, pause execute the control command, send prompt Message receives the response message of the prompting message, after executing the control command according to response message confirmation, executes institute State control command;If determination does not conflict, the control command is executed
In the electronic device that first aspect provides, the processor, when being also used to be in screen locking such as the electronic device, The electronic device is unlocked according to the gesture;
Or be also used to be in such as the electronic device screen locking and the gesture it is corresponding order be non-unlocking command when, by institute After stating electronic device unlock, according to electronic device described in the gesture control.
In the electronic device that first aspect provides, the processor is specifically used for according to electricity described in the gesture control Sub-device enters the login interface of the first game, acquires picture, carries out recognition of face to picture and determines the first identity, according to first Identity obtains the account and password of the first game, and the login of the first game is realized using the account and password.
It is described to be specifically included according to electronic device described in the gesture control in the method that second aspect provides:
Currently running first application program of the electronic device is obtained, generates the gesture described according to the gesture Control command in first application program executes the control command to first application program.
It is described that first application program execution control command is specifically wrapped in the method that second aspect provides It includes:
It determines after first application program executes the control command corresponding first as a result, acquisition and the first application At least one associated parameter of program, judges whether first result conflicts at least one described parameter, such as determines conflict, Pause executes the control command, sends prompting message, the response message of the prompting message is received, according to the response message After confirmation executes the control command, the control command is executed;If determination does not conflict, the control command is executed
It is described to be specifically included according to electronic device described in the gesture control in the method that second aspect provides:
When being in screen locking such as the electronic device, the electronic device is unlocked according to the gesture;
Or when such as the electronic device be in screen locking and the corresponding order of the gesture as non-unlocking command, by the electronics After device unlock, according to electronic device described in the gesture control.
It is described to be specifically included according to electronic device described in the gesture control in the method that second aspect provides:
According to electronic device described in the gesture control enter the first game login interface, acquire picture, to picture into Row recognition of face determines the first identity, and the account and password of the first game are obtained according to the first identity, uses the account and close Code realizes the login of the first game.
It is described that first ultrasonic signal packet is emitted by the ultrasonic sensor in the method that second aspect provides It includes: by the ultrasonic sensor, the first ultrasonic wave being emitted with the corresponding frequency of the emission time in multiple emission times Signal;It is described by the ultrasonic sensor obtain the second ultrasonic signal include: by the ultrasonic sensor, more A time of reception receives the second ultrasonic signal;It is described to determine that gesture specifically includes according to second ultrasonic signal:
When the multiple emission times and the corresponding multiple frequencies of multiple emission times for obtaining the first ultrasonic signal emit Quarter, multiple times of reception of the second ultrasonic signal and multiple received signal strengths, by the multiple emission time, Duo Gejie Time receiving carves, multiple received signal strengths form input data, and the input data is input to preset neural network model meter It calculates and determines gesture.
It is described to believe the multiple emission time, multiple times of reception, multiple receptions in the method that second aspect provides Number intensity composition input data specifically includes:
Obtain the type of sample input data and sample input data in the training sample of preset neural network model Queueing discipline, such as the type be matrix data, then by multiple emission times, multiple times of reception and multiple reception signals Intensity forms input matrix by the queueing discipline, and such as type is three-dimensional data block, then by multiple emission times, multiple receptions Moment and multiple reflected signal strengths are by queueing discipline composition input three-dimensional data block.
It is described to believe the multiple emission time, multiple times of reception, multiple receptions in the method that second aspect provides Number intensity composition input data specifically includes:
Obtain the type of sample input data and sample input data in the training sample of preset neural network model Queueing discipline, as the type be matrix data [H0】【W0], it determines multiple emission times, multiple times of reception and multiple connects The total quantity Y for receiving signal strength, such as Y < H0*W0;It calculatesExecute n value of insertion Processing obtains the data after insertion process, and the processing of n value of the insertion specifically includes: being inserted into n hair in multiple emission times The moment is penetrated, is inserted into the n time of reception in multiple times of reception, is inserted into n received signal strength in multiple received signal strengths;It will Data after insertion process form input matrix by the queueing discipline, and the size of the input matrix is [H0】【W0], the H0For The height value of matrix, the W0It can be the width value of matrix.
It is described that the input data is input to preset neural network model calculating in the method that second aspect provides Determine that gesture specifically includes:
The input data is input to preset neural network model execution multilayer forward operation and obtains forward operation knot Fruit determines the gesture according to the forward operation result.
Referring to Fig. 1, Fig. 1 is that the embodiment of the present application provides a kind of electronic device, referring to Fig. 1, Fig. 1 is of the invention real Apply example and provide a kind of structural schematic diagram of electronic device 100, above-mentioned electronic device 100 include: shell 110, circuit board 120, The electricity is arranged on the shell 110 in battery 130 (optional), cover board 140, touching display screen 150, ultrasonic sensor 170 Road plate 120, ultrasonic sensor 170, battery 130 and the cover board 140, the circuit board 120 are additionally provided with the connection touching Control the circuit of display screen 150;The circuit board 120 can also include: application processor AP190.It is above-mentioned.
Above-mentioned ultrasonic sensor has the transmitting and received function of ultrasonic signal.
Above-mentioned touching display screen is specifically as follows Thin Film Transistor-LCD (Thin Film Transistor- Liquid Crystal Display, TFT-LCD), light emitting diode (Light Emitting Diode, LED) display screen, have Machine light emitting diode (Organic Light-Emitting Diode, OLED) display screen etc..
Referring to Fig. 2, Fig. 2 is the structural schematic diagram of another kind electronic equipment 100 disclosed in the embodiment of the present application, electronics is set Standby 200 include storage and processing circuit 210, and the telecommunication circuit 220 and audio that connect with the storage and processing circuit 210 Component 240, wherein in some specific electronic equipments 200, display component 230 or touch control component can also be set.
Electronic equipment 200 may include control circuit, which may include storage and processing circuit 210.This is deposited Storage and processing circuit 210 can store device, such as hard drive memory, nonvolatile memory (such as flash memory or it is used for shape At other electrically programmable read only memories etc. of solid state drive), volatile memory (such as either statically or dynamically arbitrary access Memory etc.) etc., the embodiment of the present application is with no restriction.Processing circuit in storage and processing circuit 210 can be used for controlling electricity The operating of sub- equipment 200.The processing circuit can microprocessor based on one or more, microcontroller, digital signal processor, Baseband processor, power management unit, audio codec chip, specific integrated circuit, display-driver Ics etc. come It realizes.
Storage and processing circuit 210 can be used for running the software in electronic equipment 200, such as voice over internet protocol (Voice over Internet Protocol, VOIP) call application program, simultaneous interpretation function, media play application Program, operation system function etc..These softwares can be used for executing some control operations, for example, the image based on camera is adopted Collection, the ambient light measurement based on ambient light sensor, the proximity sensor measurement based on proximity sensor, based on such as luminous two The information display function that the positioning indicators such as the status indicator lamp of pole pipe are realized, the touch event detection based on touch sensor, Operation associated with wireless communication function is executed, operation associated with collecting and generating audio signal, with collection and processing Other functions etc. in the associated control operation of button press event data and electronic equipment 200, the embodiment of the present application is not It is restricted.
Electronic equipment 200 can also include input-output circuit 250.Input-output circuit 250 can be used for setting electronics Standby 200 realization data are output and input, i.e. permission electronic equipment 200 allows electronic equipment from outer equipment receiving data and also 200 export data to external equipment from electronic equipment 200.Input-output circuit 250 may further include sensor 270. Sensor 270 may include ambient light sensor, the proximity sensor based on light and capacitor, and touch sensor is (for example, be based on light Touch sensor and/or capacitive touch sensors, wherein touch sensor can be a part of touching display screen, can also Independently to be used as a touch sensor arrangement), acceleration transducer and other sensors etc..
Input-output circuit 250 can also include that touch sensor array (is shown that is, display 230 can be touch-control Screen).Touch sensor can be the electricity formed by transparent touch sensor electrode (such as tin indium oxide (ITO) electrode) array Appearance formula touch sensor, or can be the touch sensor formed using other touching techniques, such as sound wave touch-control, pressure-sensitive touching It touches, resistive touch, optical touch etc., the embodiment of the present application is with no restriction.
Electronic equipment 200 can also include audio component 240.Audio component 240 can be used for providing for electronic equipment 200 Audio input and output function.Audio component 240 in electronic equipment 200 may include loudspeaker, microphone, buzzer, sound Adjust generator and other for generating and detecting the component of sound, such as ultrasonic sensor.
Telecommunication circuit 220 can be used for providing the ability with external device communication for electronic equipment 200.Telecommunication circuit 220 It may include analog- and digital- input-output interface circuit, and the radio communication circuit based on radiofrequency signal and/or optical signal. Radio communication circuit in telecommunication circuit 220 may include radio-frequency transceiver circuitry, power amplifier circuit, low noise amplification Device, switch, filter and antenna.For example, the radio communication circuit in telecommunication circuit 220 may include for passing through transmitting The circuit of near-field communication (Near Field Communication, NFC) is supported with near-field coupling electromagnetic signal is received.Example Such as, telecommunication circuit 220 may include near-field communication aerial and near-field communication transceiver.Telecommunication circuit 220 can also include honeycomb Telephone transceiver and antenna, wireless lan transceiver circuit and antenna etc..
Electronic equipment 200 can further include battery, power management circuitry and other input-output units 260.It is defeated Enter-output unit 260 may include button, control stick, click wheel, scroll wheel, touch tablet, keypad, keyboard, camera, hair Optical diode or other positioning indicators etc..
User can input a command for the operation of controlling electronic devices 200 by input-output circuit 250, and can be with Status information and other outputs from electronic equipment 200 are received using the output data of input-output circuit 250 to realize.
Electronic equipment 200 can further include ultrasonic sensor, which can be with audio component 240 is integrated, specifically, the transmitting-receiving that the microphone can integrate ultrasonic sensor is super if the audio component 240 includes microphone The function of acoustic signals.
A kind of electronic device 300 is provided refering to Fig. 3, Fig. 3, the electronic device is as shown in Figure 3, comprising: processor 301 surpasses Sonic sensor 302, the processor 301 are connect with ultrasonic sensor 302, and connection type includes but is not limited to bus side Formula, it can also use other modes, such as single line connection type certainly.
Ultrasonic sensor 302, for emitting the first ultrasonic signal to generate sound field;
Ultrasonic sensor 302, is also used to obtain the second ultrasonic signal, and second ultrasonic signal is described first All or part of echo-signal of ultrasonic signal;
Processor 301, for determining gesture according to second ultrasonic signal, according to the dress of electronics described in gesture control It sets.
Ultrasonic sensor emits the first ultrasonic signal to generate sound field, ultrasonic wave in electronic device provided by the present application Sensor also obtains the second ultrasonic signal, determines gesture according to the second ultrasonic signal, then generates the corresponding control of the gesture System order is to control electronic device.
Optionally, above-mentioned processor 301 is also used to obtain currently running first application program of electronic device, according to institute It states gesture and generates control command of the gesture in first application program, the control is executed to first application program System order.
This setting is to be directed to same gesture to have different control commands in different application programs, such as the One gesture in audio application, corresponding control command can for upper one it is first or next, for another example first gesture is in video In application program, corresponding control command can be fast forward and fast reverse.Certainly in practical applications, the application is not intended to limit above-mentioned Gesture and application program are specific corresponding to relationship.
Optionally, above-mentioned that first application program execution control command is specifically included:
Processor is specifically used for determining that first application program executes corresponding first knot after the control command Fruit, acquisition and at least one associated parameter of the first application program, judge that first result is at least one described parameter No conflict such as determines that conflict, pause execute the control command, sends prompting message, the response for receiving the prompting message disappears Breath executes the control command after executing the control command according to response message confirmation;If determination does not conflict, execute The control command.
This technical solution can determine execute the control command after whether with corresponding outcome conflict, avoid because user mistake The gesture of operation influences the experience of user.For example, music application is used in user, the first control command is to close at this time At least one parameter of the music application, acquisition includes the wearing parameter of earphone, at this time if it is determined that earphone is still worn When, determine that the first result conflicts at least one parameter.
Optionally, above-mentioned processor 301, when being also used to be in screen locking such as the electronic device, according to the gesture to institute State electronic device unlock;
Or be also used to be in such as the electronic device screen locking and the gesture it is corresponding order be non-unlocking command when, by institute After stating electronic device unlock, according to electronic device described in the gesture control.
Processor is adopted specifically for entering the login interface of the first game according to electronic device described in the gesture control Collect picture, recognition of face is carried out to picture and determines corresponding first identity of picture, the account of the first game is obtained according to the first identity Number and password, use the account and password to realize the login of the first game.
This technical solution can realize the quick registration of game account by gesture, and this login also increases safety Property, avoid other users login.
Optionally, above-mentioned first ultrasonic signal can be the ultrasonic sensor, in multiple emission times with institute State the first ultrasonic signal of the corresponding frequency transmitting of emission time;Second ultrasonic signal includes: to be passed by the ultrasonic wave Sensor receives the second ultrasonic signal in multiple times of reception.
Above-mentioned multiple and different frequencies can specifically include, and the acoustic signals more than 20KHz, the application is not intended to limit above-mentioned more The particular number of a frequency does not limit the specific frequency values of above-mentioned multiple and different frequencies yet.Specifically, in an optional implementation In example, above-mentioned multiple frequencies can be 10 frequencies, and 10 frequencies can be respectively, 21KHz, 22KHz, 23KHz, 24KHz, 25KHz、26KHz、27KHz、28KHz、29KHz、30KHz。
Processor 301, multiple emission times of the first ultrasonic signal for obtaining multiple frequency, the second ultrasonic wave Multiple times of reception of signal and multiple received signal strengths, multiple emission time and the multiple of ultrasonic signal are connect Time receiving carves and multiple received signal strengths form input data, which is input to preset neural network model and is calculated It determines gesture, generates the corresponding control command of the gesture.
Ultrasonic wave of the ultrasonic transmitter in each emission time transmitting different frequency in electronic device provided by the present application Signal, it is also different frequency that such ultrasonic receiver received, which reflects ultrasonic wave signal, the ultrasonic wave of such different frequency The corresponding emission time of signal and the time of reception and reflected signal strength just can make up input data, then by the input number The gesture that can obtain ultrasonic wave is calculated in preset trained neural network model according to being input to, and then generates the gesture Corresponding control command controls electronic device.
Refering to Fig. 4 a, Fig. 4 a is a kind of schematic diagram of the second ultrasonic signal, as shown in fig. 4 a, electronic device shown in Fig. 4 a By taking smart phone as an example, the ultrasonic sensor of the smart phone can be it is multiple, may be mounted at two sides respectively, specifically, It is located at the left side and right side of smart phone.
The quantity of above-mentioned every side ultrasonic sensor may be it is multiple, each ultrasonic sensor emits a frequency First ultrasonic signal, the ultrasonic signal of different ultrasonic sensor transmitting different frequencies, above-mentioned ultrasonic echography wave pass Sensor can for a ultrasonic sensor receive multiple ultrasonic sensors transmitting the first ultrasonic signal whole or Part echo signal (i.e. the second ultrasonic signal).
It is the schematic diagram of reverberation (hand) in position a, position b and position c refering to Fig. 4 b, Fig. 4 b, ultrasonic wave also belongs to A kind of sound wave, some features with sound wave, such as speed are in 340m/s or so, since the position of different emitting substances can be right The time of reception and the intensity for emitting signal generate certain influence, so by above-mentioned multiple emission times, multiple times of reception And multiple reflected signal strengths form input datas, then according to forward operation is calculated in preset neural network model As a result, can realize the determination to gesture according to the forward operation result.It is illustrated how below by narration defeated to form Enter data and how according to the forward operation result to determine corresponding gesture.
Optionally, above-mentioned form multiple emission time, multiple times of reception and multiple reflected signal strengths inputs The implementation of data is specifically as follows:
Processor 301, specifically for the class of sample input data in the training sample of the preset neural network model of acquisition The queueing discipline of type and sample input data, if the type is matrix data, then by multiple emission times, multiple times of reception And multiple received signal strengths form input matrix by the queueing discipline, if the type is three-dimensional data block, then by multiple hairs It penetrates moment, multiple times of reception and multiple reflected signal strengths and forms input three-dimensional data block by the queueing discipline.
Determine the mode of above-mentioned input data below by an actual example, the type of input data here with For matrix data, queueing discipline can be the emission time-time of reception-received signal strength, when such as multiple transmittings The quantity at quarter, multiple times of reception and multiple received signal strengths not enough forms matrix, then is made by supplement neutral element more The quantity of a emission time, multiple times of reception and multiple received signal strengths forms matrix.Specific supplement schematic diagram is such as Shown in Fig. 5 a, as shown in Figure 5 a, the box of last black is the element for supplementing zero, and each box in Fig. 5 a represents a matrix Element.Certain above-mentioned queueing discipline can be with are as follows: the time of reception-received signal strength-emission time can also be certainly Other queueing disciplines.
Here for the type of input data by taking three-dimensional data block as an example, queueing discipline can be emission time-reception The quantity of moment-received signal strength, such as multiple emission times, multiple times of reception and multiple received signal strengths is inadequate Three-dimensional data block is formed, then makes multiple emission times, multiple times of reception and multiple reception signals by supplementing neutral element The quantity of intensity forms three-dimensional data block.Specific supplement schematic diagram is as shown in Figure 5 b, as shown in Figure 5 b, the box of last black For the element of supplement zero, each box in Fig. 5 b represents the element of a three-dimensional data block.
For preset neural network model, to have completed trained neural network model, the neural network model Training method in, sample input data each in multiple sample input datas is carried out according to being input in neural network model Training is updated the weight data in neural network model, by all multiple sample input datas training to weight data It updates, neural network model at this time is trained neural network model, the weight after neural network model trains Data will not change.Above-mentioned multiple sample input datas at least need to include: the corresponding sample input data of various gestures, often A gesture at least has an individual sample input data.Since the weight data in preset neural network model does not change Become, then the input data for inputting progress forward operation in default neural network model just needs the type with sample input data Unanimously, if Type-Inconsistencies, the result that neural network model may execute operation has many deviations.Specifically, number Learning the calculating between matrix and multiplication of matrices and three-dimensional data block and three-dimensional data block in calculating is the position according to element It sets to execute calculating, if its Type-Inconsistencies, corresponding position is varied certainly, such as shown in Figure 5 a Input matrix and input three-dimensional data as shown in Figure 5 b, though use identical multiple emission times, multiple times of reception with And multiple received signal strengths separately constitute input matrix and input three-dimensional data, due to Type-Inconsistencies, then largely The position in input matrix and input three-dimensional data of element is inconsistent, and the dislocation of these positions will lead to the knot of calculating certainly The deviation of fruit is very big, to forward direction output result inaccuracy occur, inaccurate positive output result will lead to foundation certainly should There is deviation in the gesture that forward direction output result determines.So using identical type and queueing discipline to form input data can be with Reduce the accuracy that positive output result is improved because position is inconsistent and Type-Inconsistencies.
Optionally, processor 301 input number specifically for sample in the training sample of the preset neural network model of acquisition According to type and sample input data queueing discipline, as the type be matrix data [H0】【W0], when determining multiple transmittings The total quantity Y at quarter, multiple times of reception and multiple received signal strengths, such as Y < H0*W0;It calculatesThe processing for executing n value of insertion obtains the data after insertion process, the insertion n value Processing specifically include: multiple emission times be inserted into n emission time, multiple times of reception insertion the n time of reception, Multiple received signal strengths are inserted into n received signal strength, by the data after insertion process by queueing discipline composition input square Battle array, the size of the input matrix are [H0】【W0], the H0For the height value of matrix, the W0It can be the width value of matrix.
The inserted mode of above-mentioned n emission time can there are many, for example, in a kind of optional mode, in multiple hairs It penetrates the moment and is inserted into n emission time later, two adjacent transmission moment of n emission time are a setting time interval, more It is inserted into after a time of reception the n time of reception, two adjacent reception moment of the n time of reception are a setting time interval, N received signal strength is inserted into after multiple received signal strengths, which can be multiple reception signals The average value of intensity can also be multiple received signal strengths that n received signal strength is discrete distribution, discrete distribution certainly Multiple received signal strength indications within the set range and the average value of multiple received signal strengths of discrete distribution connects with multiple The average value for receiving signal strength is identical.
The mode of such insertion is capable of the emission time of emulation acquired original as far as possible, the time of reception and to receive signal strong Angle value can be improved the authenticity of input matrix data in this way, and then improve the accuracy of forward operation result.
Optionally, it is above-mentioned the input data be input to preset neural network model calculate determine that gesture specifically can wrap Include: processor obtains just specifically for the input data is input to preset neural network model execution multilayer forward operation To operation result, the gesture is determined according to the forward operation result.
Optionally, determine that the gesture can specifically include according to the forward operation result: processor is specifically used for from forward direction X element and the corresponding X position of X element that element value is greater than given threshold are extracted in operation result, in X position The corresponding first gesture in X/2 position is had more than, determines that the forward operation result is first gesture.
Optionally, processor, X element for being greater than given threshold specifically for extracting element value from forward operation result And the corresponding X position of X element, it determines the corresponding multiple gestures in X position, X position is chosen at from multiple gestures In occupy the most second gesture of number of positions, determine the forward operation structure be second gesture.
It should be noted that determined when gesture corresponding for element value each in forward operation result can pass through trained, For training sample input data, since it is the sample data marked, i.e., the known training sample input data belongs to assorted The training sample is input in preset neural network model and obtains forward operation as a result, the forward operation result by gesture In to be greater than the gesture of the corresponding position of element of given threshold be the corresponding gesture in the position.Similarly, defeated by multiple samples The calculating for entering data can access the corresponding gesture of element in all forward operation results.
Refering to Fig. 6, Fig. 6 is a kind of method of ultrasonic wave gesture control electronic device provided by the present application, and this method is by electricity Sub-device executes, which can be structure as shown in Figure 2 or Figure 3, and this method comprises the following steps:
Step S601, the first ultrasonic signal is emitted to generate sound field by the ultrasonic sensor;
Step S602, the second ultrasonic signal is obtained by the ultrasonic sensor, second ultrasonic signal is All or part of echo-signal of first ultrasonic signal;
Step S603, gesture is determined according to second ultrasonic signal, according to electronic device described in the gesture control.
Ultrasonic sensor emits the first ultrasonic signal to generate sound field, ultrasonic wave in electronic device provided by the present application Sensor also obtains the second ultrasonic signal, determines gesture according to the second ultrasonic signal, then generates the corresponding control of the gesture System order is to control electronic device.
It is described that first application program execution control command is specifically included:
It determines after first application program executes the control command corresponding first as a result, acquisition and the first application At least one associated parameter of program, judges whether first result conflicts at least one described parameter, such as determines conflict, Pause executes the control command, sends prompting message, the response message of the prompting message is received, according to the response message After confirmation executes the control command, the control command is executed;If determination does not conflict, the control command is executed.
Optionally, above-mentioned to be specifically included according to electronic device described in the gesture control:
Currently running first application program of the electronic device is obtained, generates the gesture described according to the gesture Control command in first application program executes the control command to first application program.
Optionally, described to be specifically included according to electronic device described in the gesture control:
According to electronic device described in the gesture control enter the first game login interface, acquire picture, to picture into Row recognition of face determines corresponding first identity of picture, and the account and password of the first game are obtained according to the first identity, uses institute It states account and password realizes the login of the first game.
Optionally, described to be specifically included according to electronic device described in the gesture control:
When being in screen locking such as the electronic device, the electronic device is unlocked according to the gesture;
Or when such as the electronic device be in screen locking and the corresponding order of the gesture as non-unlocking command, by the electronics After device unlock, according to electronic device described in the gesture control.
Optionally, it is described by the ultrasonic sensor emit the first ultrasonic signal include: by the ultrasonic wave Sensor emits the first ultrasonic signal in multiple emission times with the corresponding frequency of the emission time;It is described by described It includes: to receive the in multiple times of reception by the ultrasonic sensor that ultrasonic sensor, which obtains the second ultrasonic signal, Two ultrasonic signals;It is described to determine that gesture specifically includes according to second ultrasonic signal:
It obtains multiple emission times of the first ultrasonic signal and the corresponding multiple frequencies of multiple emission times, the second surpasses Multiple times of reception of acoustic signals and multiple received signal strengths, by the multiple emission time, multiple times of reception, more A received signal strength forms input data, and the input data is input to preset neural network model and calculates determining hand Gesture.
Optionally, described by the multiple emission time, multiple times of reception, multiple received signal strengths composition input number According to specifically including:
Obtain the type of sample input data and sample input data in the training sample of preset neural network model Queueing discipline, such as the type be matrix data, then by multiple emission times, multiple times of reception and multiple reception signals Intensity forms input matrix by the queueing discipline, and such as type is three-dimensional data block, then by multiple emission times, multiple receptions Moment and multiple reflected signal strengths are by queueing discipline composition input three-dimensional data block.
Optionally, described by the multiple emission time, multiple times of reception, multiple received signal strengths composition input number According to specifically including:
Obtain the type of sample input data and sample input data in the training sample of preset neural network model Queueing discipline, as the type be matrix data [H0】【W0], it determines multiple emission times, multiple times of reception and multiple connects The total quantity Y for receiving signal strength, such as Y < H0*W0;It calculatesExecute n value of insertion Processing obtains the data after insertion process, and the processing of n value of the insertion specifically includes: being inserted into n hair in multiple emission times The moment is penetrated, is inserted into the n time of reception in multiple times of reception, is inserted into n received signal strength in multiple received signal strengths;It will Data after insertion process form input matrix by the queueing discipline, and the size of the input matrix is [H0】【W0], the H0For The height value of matrix, the W0It can be the width value of matrix.
Optionally, it is described the input data be input to preset neural network model calculate determine that gesture is specifically wrapped It includes:
The input data is input to preset neural network model execution multilayer forward operation and obtains forward operation knot Fruit determines the gesture according to the forward operation result.
Fig. 7 shows the block diagram of the part-structure of mobile phone relevant to mobile terminal provided by the embodiments of the present application.Ginseng Fig. 7 is examined, mobile phone includes: radio frequency (Radio Frequency, RF) circuit 910, memory 920, input-output unit 930, sensing Device 950, audio collection device 960, Wireless Fidelity (Wireless Fidelity, WiFi) module 970, application processor AP980, The components such as touching display screen 933, power supply 990.It will be understood by those skilled in the art that the not structure of handset structure shown in Fig. 7 The restriction of pairs of mobile phone may include perhaps combining certain components or different components than illustrating more or fewer components Arrangement.
It is specifically introduced below with reference to each component parts of the Fig. 7 to mobile phone:
Input-output unit 930 can be used for receiving the number or character information of input, and generates and set with the user of mobile phone It sets and the related key signals of function control inputs.Specifically, input unit 930 may include fingerprint identification device 931, face knowledge Other device 936, iris identification device 937 and other input equipments 932.Input unit 930 can also include that other inputs are set Standby 932.Specifically, other input equipments 932 can include but is not limited to physical button, function key (such as volume control button, Switch key etc.), trace ball, mouse, one of operating stick etc. or a variety of.Wherein,
Application processor AP980 is the control centre of mobile phone, utilizes each of various interfaces and connection whole mobile phone Part by running or execute the software program and/or module that are stored in memory 920, and calls and is stored in memory Data in 920 execute the various functions and processing data of mobile phone, to carry out integral monitoring to mobile phone.Optionally, AP980 It may include one or more processing units;Optionally, AP980 can integrate application processor and modem processor, wherein answer With the main processing operation system of processor, user interface and application program etc., modem processor mainly handles wireless communication. It is understood that above-mentioned modem processor can not also be integrated into AP980.
In addition, memory 920 may include high-speed random access memory, it can also include nonvolatile memory, example Such as at least one disk memory, flush memory device or other volatile solid-state parts.
RF circuit 910 can be used for sending and receiving for information.In general, RF circuit 910 includes but is not limited to antenna, at least one A amplifier, transceiver, coupler, low-noise amplifier (Low Noise Amplifier, LNA), duplexer etc..In addition, RF circuit 910 can also be communicated with network and other equipment by wireless communication.Any communication can be used in above-mentioned wireless communication Standard or agreement, including but not limited to global system for mobile communications (Global System of Mobile Communication, GSM), general packet radio service (General Packet Radio Service, GPRS), code it is point more Location (Code Division Multiple Access, CDMA), wideband code division multiple access (Wideband Code Division Multiple Access, WCDMA), long term evolution (Long Term Evolution, LTE), Email, short message service (Short Messaging Service, SMS) etc..
Mobile phone may also include at least one sensor 950, such as optical sensor, motion sensor and other sensors. Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ambient light Light and shade adjust the brightness of touching display screen, proximity sensor can when mobile phone is moved in one's ear, close touching display screen and/ Or backlight.As a kind of motion sensor, accelerometer sensor can detect (generally three axis) acceleration in all directions Size can detect that size and the direction of gravity when static, can be used to identify mobile phone posture application (such as horizontal/vertical screen switching, Dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.;It can also configure as mobile phone The other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, details are not described herein.
Audio collection device 960, loudspeaker 961, microphone 962 can provide the audio interface between user and mobile phone.Audio Electric signal after the audio data received conversion can be transferred to loudspeaker 961, be converted to by loudspeaker 961 by collector 960 Voice signal plays;On the other hand, the voice signal of collection is converted to electric signal by microphone 962, is connect by audio collection device 960 Audio data is converted to after receipts, then after audio data is played AP980 processing, through RF circuit 910 to be sent to such as the other hand Machine, or audio data is played to memory 920 to be further processed.
Above-mentioned mobile phone can also include: ultrasonic sensor, which can integrate with the loudspeaker 961 and set It sets.That is, the loudspeaker 961 can emit or received ultrasonic signal.
Loudspeaker 961, for emitting the first ultrasonic signal to generate sound field;
Microphone 962, for obtaining the second ultrasonic signal, second ultrasonic signal is first ultrasonic wave letter Number all or part of echo-signal;
Application processor AP980, for determining gesture according to second ultrasonic signal, according to electricity described in gesture control Sub-device.
Application processor AP980, when being also used to be in screen locking such as the electronic device, according to the gesture to the electronics Device unlock;
Or be also used to be in such as the electronic device screen locking and the gesture it is corresponding order be non-unlocking command when, by institute After stating electronic device unlock, according to electronic device described in the gesture control.
WiFi belongs to short range wireless transmission technology, and mobile phone can help user's transceiver electronics postal by WiFi module 970 Part, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 7 is shown WiFi module 970, but it is understood that, and it is not belonging to must be configured into for mobile phone, it can according to need do not changing completely Become in the range of the essence of application and omits.
Mobile phone further includes the power supply 990 (such as battery) powered to all parts, and optionally, power supply can pass through power supply pipe Reason system and AP980 are logically contiguous, to realize the function such as management charging, electric discharge and power managed by power-supply management system Energy.
Although being not shown, mobile phone can also be including camera, bluetooth module, light compensating apparatus, light sensor etc., herein not It repeats again.
As can be seen that technical solution provided by the present application is determined whether by obtaining position and time in sleep shape State is judged whether by the picture of acquisition comprising setting crowd as under sleep state, when comprising setting crowd, control The communication function of wireless transceiver, in this way influence of the radiation of reduction wireless transceiver to setting crowd, improves the experience of user Degree.
The embodiment of the present application also provides a kind of computer storage medium, wherein computer storage medium storage is for electricity The computer program of subdata exchange, it is as any in recorded in above method embodiment which execute computer A kind of some or all of the method for ultrasonic wave gesture control electronic device step.
The embodiment of the present application also provides a kind of computer program product, and the computer program product includes storing calculating The non-transient computer readable storage medium of machine program, the computer program are operable to that computer is made to execute such as above-mentioned side Some or all of the method for any ultrasonic wave gesture control electronic device recorded in method embodiment step.
It should be noted that for the various method embodiments described above, for simple description, therefore, it is stated as a series of Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because According to the application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know It knows, embodiment described in this description belongs to alternative embodiment, related actions and modules not necessarily the application It is necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, reference can be made to the related descriptions of other embodiments.
In several embodiments provided herein, it should be understood that disclosed device, it can be by another way It realizes.For example, the apparatus embodiments described above are merely exemplary, such as the division of the unit, it is only a kind of Logical function partition, there may be another division manner in actual implementation, such as multiple units or components can combine or can To be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual Coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit, It can be electrical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also be realized in the form of software program module.
If the integrated unit is realized in the form of software program module and sells or use as independent product When, it can store in a computer-readable access to memory.Based on this understanding, the technical solution of the application substantially or Person says that all or part of the part that contributes to existing technology or the technical solution can body in the form of software products Reveal and, which is stored in a memory, including some instructions are used so that a computer equipment (can be personal computer, server or network equipment etc.) executes all or part of each embodiment the method for the application Step.And memory above-mentioned includes: USB flash disk, read-only memory (ROM, Read-Only Memory), random access memory The various media that can store program code such as (RAM, Random Access Memory), mobile hard disk, magnetic or disk.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can It is completed with instructing relevant hardware by program, which can store in a computer-readable memory, memory May include: flash disk, read-only memory (English: Read-Only Memory, referred to as: ROM), random access device (English: Random Access Memory, referred to as: RAM), disk or CD etc..
The embodiment of the present application is described in detail above, specific case used herein to the principle of the application and Embodiment is expounded, the description of the example is only used to help understand the method for the present application and its core ideas; At the same time, for those skilled in the art can in specific embodiments and applications according to the thought of the application There is change place, in conclusion the contents of this specification should not be construed as limiting the present application.

Claims (16)

1. a kind of electronic device, which is characterized in that the electronic device includes: processor, ultrasonic sensor, the processor It is connect with the ultrasonic sensor, the ultrasonic sensor is the sensor with signal transmitting and receiving function;
The ultrasonic sensor, for emitting the first ultrasonic signal to generate sound field;
The ultrasonic sensor, is also used to obtain the second ultrasonic signal, and second ultrasonic signal the first surpasses to be described All or part of echo-signal of acoustic signals;
The processor, for determining gesture according to second ultrasonic signal, according to electronic device described in gesture control.
2. electronic device according to claim 1, which is characterized in that
The processor is also used to obtain currently running first application program of electronic device, according to described in gesture generation Control command of the gesture in first application program executes the control command to first application program.
3. electronic device according to claim 2, which is characterized in that
The processor is specifically used for determining that first application program executes corresponding first knot after the control command Fruit, acquisition and at least one associated parameter of the first application program, judge that first result is at least one described parameter No conflict such as determines that conflict, pause execute the control command, sends prompting message, the response for receiving the prompting message disappears Breath executes the control command after executing the control command according to response message confirmation;If determination does not conflict, execute The control command.
4. electronic device according to claim 1, which is characterized in that
The processor when being also used to be in screen locking such as the electronic device, unlocks the electronic device according to the gesture;
Or be also used to be in such as the electronic device screen locking and the gesture it is corresponding order be non-unlocking command when, by the electricity After sub-device unlock, according to electronic device described in the gesture control.
5. electronic device according to claim 4, which is characterized in that
The processor is adopted specifically for entering the login interface of the first game according to electronic device described in the gesture control Collect picture, recognition of face is carried out to picture and determines the first identity, the account and password of the first game are obtained according to the first identity, is made The login of the first game is realized with the account and password.
6. a kind of method of ultrasonic wave gesture control electronic device, which is characterized in that the electronic device includes: supersonic sensing Device, the ultrasonic sensor are the sensor with signal transmitting and receiving function;
Emit the first ultrasonic signal by the ultrasonic sensor to generate sound field;
The second ultrasonic signal is obtained by the ultrasonic sensor, second ultrasonic signal is first ultrasonic wave All or part of echo-signal of signal;
Gesture is determined according to second ultrasonic signal, according to electronic device described in the gesture control.
7. according to the method described in claim 6, it is characterized in that, described specific according to electronic device described in the gesture control Include:
Currently running first application program of the electronic device is obtained, generates the gesture described first according to the gesture Control command in application program executes the control command to first application program.
8. the method according to the description of claim 7 is characterized in that described execute the control life to first application program Order specifically includes:
It determines after first application program executes the control command corresponding first as a result, acquisition and the first application program At least one associated parameter, judges whether first result conflicts at least one described parameter, such as determines conflict, pause The control command is executed, prompting message is sent, receives the response message of the prompting message, is confirmed according to the response message After executing the control command, the control command is executed;If determination does not conflict, the control command is executed.
9. according to the method described in claim 6, it is characterized in that, described specific according to electronic device described in the gesture control Include:
When being in screen locking such as the electronic device, the electronic device is unlocked according to the gesture;
Or when such as the electronic device be in screen locking and the corresponding order of the gesture as non-unlocking command, by the electronic device After unlock, according to electronic device described in the gesture control.
10. according to the method described in claim 8, it is characterized in that, described have according to electronic device described in the gesture control Body includes:
Enter the login interface of the first game according to electronic device described in the gesture control, acquire picture, people is carried out to picture Face, which identifies, determines the first identity, and the account and password of the first game are obtained according to the first identity, real using the account and password The login of existing first game.
11. according to the method described in claim 6, it is characterized in that, described the first surpassed by ultrasonic sensor transmitting Acoustic signals include: by the ultrasonic sensor, in multiple emission times with the corresponding frequency transmitting of the emission time First ultrasonic signal;It is described by the ultrasonic sensor obtain the second ultrasonic signal include: by the ultrasonic wave Sensor receives the second ultrasonic signal in multiple times of reception;It is described to determine that gesture has according to second ultrasonic signal Body includes:
Obtain the multiple emission times and the corresponding multiple frequencies of multiple emission times, the second ultrasonic wave of the first ultrasonic signal Multiple times of reception of signal and multiple received signal strengths, by the multiple emission time, multiple times of reception, Duo Gejie Collection of letters intensity forms input data, and the input data is input to preset neural network model and calculates determining gesture.
12. according to the method described in claim 10, it is characterized in that, it is described by the multiple emission time, multiple receptions when It carves, multiple received signal strengths composition input data specifically includes:
Obtain the row of the type of sample input data and sample input data in the training sample of preset neural network model Column rule, such as type are matrix data, then by multiple emission times, multiple times of reception and multiple received signal strengths Input matrix is formed by the queueing discipline, such as type is three-dimensional data block, then by multiple emission times, multiple times of reception And multiple reflected signal strengths are by queueing discipline composition input three-dimensional data block.
13. according to the method described in claim 10, it is characterized in that, it is described by the multiple emission time, multiple receptions when It carves, multiple received signal strengths composition input data specifically includes:
Obtain the row of the type of sample input data and sample input data in the training sample of preset neural network model Column rule, if the type is matrix data [H0】【W0], determine multiple emission times, multiple times of reception and multiple receptions letter The total quantity Y of number intensity, such as Y < H0*W0;It calculatesExecute the processing of n value of insertion The processing of data after obtaining insertion process, n value of the insertion specifically includes: when multiple emission times are inserted into n transmitting It carves, is inserted into the n time of reception in multiple times of reception, be inserted into n received signal strength in multiple received signal strengths;It will insertion Data that treated form input matrix by the queueing discipline, and the size of the input matrix is [H0】【W0], the H0For matrix Height value, the W0It can be the width value of matrix.
14. according to the method described in claim 10, it is characterized in that, described be input to preset nerve for the input data Network model, which calculates, determines that gesture specifically includes:
By the input data be input to preset neural network model execute multilayer forward operation obtain forward operation as a result, according to The gesture is determined according to the forward operation result.
15. a kind of computer readable storage medium, which is characterized in that it stores the computer program for being used for electronic data interchange, Wherein, the computer program makes computer execute such as the described in any item methods of claim 6-14.
16. a kind of computer program product, which is characterized in that the computer program product includes storing computer program Non-transient computer readable storage medium, the computer program are operable to that computer is made to execute such as claim 6-14 Method described in one.
CN201810917635.6A 2018-08-13 2018-08-13 Method for controlling electronic device through ultrasonic gestures and related product Active CN109274812B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810917635.6A CN109274812B (en) 2018-08-13 2018-08-13 Method for controlling electronic device through ultrasonic gestures and related product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810917635.6A CN109274812B (en) 2018-08-13 2018-08-13 Method for controlling electronic device through ultrasonic gestures and related product

Publications (2)

Publication Number Publication Date
CN109274812A true CN109274812A (en) 2019-01-25
CN109274812B CN109274812B (en) 2021-02-02

Family

ID=65153520

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810917635.6A Active CN109274812B (en) 2018-08-13 2018-08-13 Method for controlling electronic device through ultrasonic gestures and related product

Country Status (1)

Country Link
CN (1) CN109274812B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110032276A (en) * 2019-03-07 2019-07-19 永德利硅橡胶科技(深圳)有限公司 Quick start voice translation method and Related product
CN110297542A (en) * 2019-06-28 2019-10-01 Oppo广东移动通信有限公司 Parameter regulation means and relevant device
CN110737387A (en) * 2019-10-09 2020-01-31 Oppo广东移动通信有限公司 Page display method and related equipment
CN112865826A (en) * 2019-11-28 2021-05-28 华为技术有限公司 Touch operation identification method and wearable device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103064606A (en) * 2012-12-24 2013-04-24 天津三星光电子有限公司 Screen unlocking method for mobile terminal
CN104898844A (en) * 2015-01-23 2015-09-09 瑞声光电科技(常州)有限公司 Gesture recognition and control device based on ultrasonic positioning and gesture recognition and control method based on ultrasonic positioning
CN106203380A (en) * 2016-07-20 2016-12-07 中国科学院计算技术研究所 Ultrasound wave gesture identification method and system
CN106303599A (en) * 2016-08-11 2017-01-04 腾讯科技(深圳)有限公司 A kind of information processing method, system and server
US20180143696A1 (en) * 2016-11-21 2018-05-24 Htc Corporation Body posture detection system, suit and method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103064606A (en) * 2012-12-24 2013-04-24 天津三星光电子有限公司 Screen unlocking method for mobile terminal
CN104898844A (en) * 2015-01-23 2015-09-09 瑞声光电科技(常州)有限公司 Gesture recognition and control device based on ultrasonic positioning and gesture recognition and control method based on ultrasonic positioning
CN106203380A (en) * 2016-07-20 2016-12-07 中国科学院计算技术研究所 Ultrasound wave gesture identification method and system
CN106303599A (en) * 2016-08-11 2017-01-04 腾讯科技(深圳)有限公司 A kind of information processing method, system and server
US20180143696A1 (en) * 2016-11-21 2018-05-24 Htc Corporation Body posture detection system, suit and method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110032276A (en) * 2019-03-07 2019-07-19 永德利硅橡胶科技(深圳)有限公司 Quick start voice translation method and Related product
CN110297542A (en) * 2019-06-28 2019-10-01 Oppo广东移动通信有限公司 Parameter regulation means and relevant device
CN110297542B (en) * 2019-06-28 2022-10-18 Oppo广东移动通信有限公司 Parameter adjusting method and related equipment
CN110737387A (en) * 2019-10-09 2020-01-31 Oppo广东移动通信有限公司 Page display method and related equipment
CN112865826A (en) * 2019-11-28 2021-05-28 华为技术有限公司 Touch operation identification method and wearable device

Also Published As

Publication number Publication date
CN109274812B (en) 2021-02-02

Similar Documents

Publication Publication Date Title
CN106055962B (en) A kind of solution lock control method and mobile terminal
CN103309673B (en) A kind of conversation processing method based on gesture, device
CN109274812A (en) The method and Related product of ultrasonic wave gesture control electronic device
CN109240551A (en) Use the method and Related product of gesture control electronic device
CN106874091A (en) A kind of application call method, device and mobile terminal
CN108541080A (en) First electronic equipment and the second electronic equipment carry out the method and Related product of Hui Lian
CN109144454A (en) double-sided screen display control method and related product
CN107566604A (en) The control method and user terminal of a kind of prompting message
CN108388340A (en) Control method of electronic device and Related product
CN107715449A (en) A kind of account login method and relevant device
CN107369017A (en) Quick payment implementation method and Related product
CN108958593A (en) A kind of method and mobile terminal of determining communication object
CN110475020A (en) Apparatus control method and Related product
CN108833683A (en) Dynamic antenna adjusts implementation method and Related product
CN108279842A (en) A kind of function controlling method, function controlling device and terminal device
CN108989546A (en) The proximity test method and Related product of electronic device
CN108196781A (en) The display methods and mobile terminal at interface
CN107728920A (en) A kind of clone method and mobile terminal
CN107480495A (en) The unlocking method and Related product of mobile terminal
CN108810261A (en) Antenna switching method and Related product in call
CN109472825A (en) A kind of object search method and terminal device
CN108874359A (en) Volume adjusting method and relevant device
CN108668018A (en) Mobile terminal, method for controlling volume and Related product
CN108446153A (en) A kind of method and terminal of control e-sourcing
CN110221696A (en) Eyeball tracking method and Related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant