WO2019023997A1 - Operation method and operation apparatus for dialog box in smart terminal - Google Patents

Operation method and operation apparatus for dialog box in smart terminal Download PDF

Info

Publication number
WO2019023997A1
WO2019023997A1 PCT/CN2017/095649 CN2017095649W WO2019023997A1 WO 2019023997 A1 WO2019023997 A1 WO 2019023997A1 CN 2017095649 W CN2017095649 W CN 2017095649W WO 2019023997 A1 WO2019023997 A1 WO 2019023997A1
Authority
WO
WIPO (PCT)
Prior art keywords
airflow
parameter data
smart terminal
dialog box
sample
Prior art date
Application number
PCT/CN2017/095649
Other languages
French (fr)
Chinese (zh)
Inventor
李钊
Original Assignee
深圳传音通讯有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳传音通讯有限公司 filed Critical 深圳传音通讯有限公司
Priority to PCT/CN2017/095649 priority Critical patent/WO2019023997A1/en
Publication of WO2019023997A1 publication Critical patent/WO2019023997A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Definitions

  • the present invention relates to the field of intelligent terminals, and in particular, to a method and an operation device for operating a dialog box in an intelligent terminal.
  • a smart terminal such as a mobile phone
  • manual operations such as when a user performs manual operations such as meals, ceramics, and the like, and needs to use an electronic device for inquiry or other operations.
  • a voice control scheme In order to achieve no manual operation, a voice control scheme is usually adopted.
  • the above voice control scheme can only perform linear control operations, and the user voice and other voices cannot be recognized in the voice environment where the electronic device is located, so that the user's electronic device may be controlled by other voices and perform some operation, so that the user is using the electronic The device is disturbed and reduces the user experience.
  • the manner in which the user selects the operation dialog box is mostly performed by means of touch, wherein the specific method includes touching the physical button and touching the screen, but in some cases due to When the hands are inconvenient for the touch operation selection, the effective operation cannot be performed, but when the hands are inconvenient to operate, the user needs to operate the options popped up by the smart terminal.
  • an object of the present invention is to provide an operation method and an operation device for a dialog box in an intelligent terminal.
  • the invention discloses a method for operating a dialog box in a smart terminal, characterized in that the operation method comprises:
  • the step of storing the first parameter data of the first airflow in the smart terminal comprises:
  • Parsing the first airflow sample to form the first parameter data wherein the first parameter data includes one or more of an intensity of a gas flow and a duration of a gas flow; or
  • the smart terminal is in communication connection with a cloud server
  • the first parameter data is downloaded and stored.
  • collecting a second airflow sample that is blown to the smart terminal includes:
  • the smart terminal When the smart terminal needs to prompt a dialog box during the execution of an operation, the smart terminal prompts a dialog box in the display area of the smart terminal;
  • a message prompting the user to perform an operation is displayed in the dialog box.
  • collecting a second airflow sample that is blown to the smart terminal includes:
  • an airflow detecting device When the dialog box is displayed in the display area of the smart terminal, an airflow detecting device is activated;
  • the second airflow sample blown to the smart terminal is monitored according to the airflow detecting device.
  • comparing the second parameter data with the first parameter data, when the second parameter data matches the first parameter data, performing the operation action on the dialog box comprises:
  • the dialog box is kept displayed in the display area of the smart terminal.
  • the invention also discloses a
  • the operation device of the dialog box in the smart terminal comprises: a storage module, an association module, an acquisition module, a detection module, and an execution module, wherein
  • the storage module is configured to store, in the smart terminal, first parameter data corresponding to the first airflow sample
  • the association module is communicatively coupled to the storage module for associating the first airflow sample with an operational action
  • the collecting module is connected to the storage module, and is configured to collect a second airflow sample that is blown to the smart terminal when the display area of the smart terminal displays a dialog box;
  • the detecting module is connected to the collecting module for analyzing the second airflow sample to form a second parameter data
  • the execution module is in communication with the detection module, configured to compare the second parameter data with the first parameter data, and when the second parameter data matches the first parameter data, the session is The box performs the operational action.
  • the storage module includes:
  • An acquisition unit configured to collect a first airflow sample
  • a parsing unit configured to communicate with the collecting unit, configured to parse the first airflow sample to form the first parameter data, wherein the first parameter data includes one of an intensity of a gas flow and a duration of a gas flow or Multiple
  • a communication unit configured to communicate with a cloud server, and upload the first parameter data to the cloud server;
  • a downloading unit configured to communicate with the cloud server, to download the first parameter data and store the data through the storage unit.
  • the collecting module comprises:
  • a prompting unit configured to prompt a dialog box in the display area of the smart terminal and start when the smart terminal needs to prompt a dialog box during the execution of an operation
  • a message prompting the user to perform an operation is displayed in the dialog box.
  • the collecting module further includes:
  • control unit configured to start an airflow detecting device when the dialog box is displayed in a display area of the smart terminal
  • a monitoring unit in communication with the control unit, configured to monitor the second airflow sample blown to the smart terminal according to the airflow detecting device.
  • the execution module includes:
  • An analyzing unit configured to calculate a difference between the second airflow parameter data and the first airflow parameter data
  • An execution unit configured to be in communication with the analysis unit, configured to cancel the dialog box and close a display interface of the display area of the smart terminal when the difference is a positive number;
  • the execution unit is further configured to keep the dialog box displayed in a display area of the smart terminal when the difference is a negative number.
  • FIG. 1 is a schematic flow chart of a method for operating a dialog box in a smart terminal according to a preferred embodiment of the present invention
  • step 101 of a method for operating a dialog box in a smart terminal according to a preferred embodiment of the present invention
  • step 103 is a schematic flowchart of step 103 of an operation method of a dialog box in a smart terminal according to a preferred embodiment of the present invention
  • step 103 is a schematic flow chart of step 103 of a method for operating a dialog box in a smart terminal according to a preferred embodiment of the present invention
  • step 105 is a schematic flowchart of step 105 of an operation method of a dialog box in a smart terminal according to a preferred embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of an operation device of a dialog box in a smart terminal according to a preferred embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of an operation device of a dialog box in a smart terminal according to a preferred embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of an operation device of a dialog box in a smart terminal according to a preferred embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of an operation device of a dialog box in a smart terminal according to a preferred embodiment of the present invention.
  • 10-Operation device 20-storage module, 30-association module, 40-acquisition module, 50-detection module, 60-execution module:
  • the smart terminal used herein includes a device of a wireless signal receiver, a device having only a wireless signal receiver without a transmitting capability, and a device for receiving and transmitting hardware. It has a device capable of receiving and transmitting hardware for two-way communication over a two-way communication link.
  • Such devices may include cellular or other communication devices having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data Processing, fax, and/or data communication capabilities; PDA (Personal Digital Assistant), which can include radio frequency receivers, pagers, Internet/Intranet access, web browsers, notepads, calendars, and/or GPS (Global Positioning System (Global Positioning System) receiver; conventional laptop and/or palmtop computer or other device having a conventional laptop and/or palmtop computer or other device that includes and/or includes a radio frequency receiver.
  • PCS Personal Communications Service
  • PDA Personal Digital Assistant
  • terminal may be portable, transportable, installed in a vehicle (aviation, sea and/or land), or adapted and/or configured to operate locally, and/or Run in any other location on the Earth and/or space in a distributed form.
  • the "device” and “smart terminal” used herein may also be a communication device, an internet device, a music/video playback device, such as a PDA, a MID (Mobile Internet Device), and/or have a music/video playback.
  • Functional mobile phones can also be smart TVs, set-top boxes and other devices.
  • a flow diagram consistent with a preferred embodiment of the present invention includes:
  • Step 101 Store, in the smart terminal, first parameter data corresponding to the first airflow sample.
  • Step 102 Associate the first airflow sample with an operation action
  • the parameter information of the first airflow is preset, for example, the generated airflow parameter data can be acquired through a microphone.
  • the microphone When the microphone is used to detect the airflow parameter, the microphone captures the sound generated by the airflow change.
  • the airflow parameter is the electric signal converted by the sound captured by the microphone, and the condition that the first airflow parameter needs to satisfy may be the amplitude of the electrical signal.
  • the preset size and/or the preset position of the sound source obtained from the electrical signal. It is also possible to further obtain a moving direction or a moving path of the airflow change according to the obtained first airflow parameter.
  • the preset first airflow parameter data can be obtained by comparing, the obtained relative temperature data is obtained by a sensor and sent to the smart terminal, and the smart terminal is further configured to: receive the airflow parameter data, the Relative temperature data.
  • the airflow parameter data is data formed by characteristics such as a human body and an environment having a variation, and includes: general noise data, heartbeat data, user air blowing data, and accidental noise data.
  • Relative temperature data is posted
  • the data formed by the temperature changes generated by the human body mainly include: the body surface temperature of the human body obtained by real-time detection; the difference of the body surface temperature has an influence on the detection of the air blowing, and therefore the algorithm used for the surface temperature correction filtering is required. Filter coefficient, perfect multi-level filtering algorithm.
  • the first noise filtering is the filtering of common noise data, and the series filtering method is adopted, and the air blowing vector data is obtained after filtering; the air blowing vector data is vector data with a relatively obvious direction (for example, air blowing and heartbeat are obvious). Amplitude and frequency).
  • the user-based data is data with specific directivity entered by the user; the specific directivity refers to the amplitude and frequency range of different user-based data corresponding to different set features (in the algorithm, the difference in filter coefficients).
  • Similar filtering is the filtering of heartbeat data, using theoretical, actual amplitude and frequency comparison; because the amplitude and frequency of heartbeat and insufflation are similar, the comparison method is used to determine which is the amplitude of the heartbeat and The frequency is filtered out in a targeted manner, and the remaining feature data necessarily includes the user's insufflation data.
  • the first airflow parameter data can be obtained by the cloud server or directly stored in the chip built in the smart terminal, that is, the information can be directly retrieved from the cloud server.
  • Step 103 When the display area of the smart terminal displays a dialog box, collect a second airflow sample that is blown to the smart terminal;
  • the pop-up mechanism of a dialog box prompts a dialog box in the display area of the smart terminal, and the dialog box displays a prompting user to perform the dialog box. operating.
  • the second inspiratory airflow data of the user is obtained through the sensor integrated device, in order to avoid interference of the environmental noise on the acquisition and detection process, so as to improve the accuracy of airflow detection and classification in the air blowing, the invention is implemented
  • the collected airflow data is first denoised by low-pass filtering to eliminate the influence of environmental noise on the original signal, and then, filtering.
  • the inspiratory data in the airflow data because the noise usually occurs in the inhalation phase, so it is necessary to accurately find the inspiratory sound source and the insufflation sound source from the airflow data to determine the start time and end time of the inhalation data. .
  • the flow curve of the inspiratory data of the preset time period is selected, and the characteristic parameters of the flow curve are analyzed and calculated to realize the detection and classification of the pair.
  • the sensor integrated device monitors the airflow of the smart terminal in real time while prompting the dialog box.
  • the sensor integrated device collects the airflow of the blow air and passes the detection and analysis. Storing the intensity of the airflow; the sensor integrated device includes more than one sensor, and the position of the sensor in the smart terminal and the number of sensors can be set or adjusted according to different internal or external structures of the smart terminal; for example, it can be set in The location of the smart terminal microphone.
  • the parameter data of the first airflow that can be stored in an embodiment of the present invention may include a strong airflow.
  • the data is as follows.
  • the method for obtaining the airflow intensity by the sensor integrated device is as follows: the sensor integrated device has a circular air hole, and the sensor integrated device further has a spherical circuit board and a suspended object inside, and the spherical circuit board covers the sensor.
  • the suspended object is suspended in the fixed position A inside the sensor when there is no airflow into the intelligent terminal, and the method for ensuring that the suspended object is suspended inside the sensor integrated device is to set a magnet on the suspended object, and the sensor integrated device A magnet is also arranged inside, and the suspended object can be suspended due to the repulsive force of the magnetic pole between the magnets; when there is airflow through the intelligent terminal, the airflow will enter the inside of the sensor through the circular air hole of the sensor integrated device, and the suspended object is subjected to the airflow. Pushing the movement inside the sensor will touch the spherical circuit board.
  • the position of the touch point is B. According to position B and position A, it can be judged that the direction of the air flow can be expressed as A to B, and at the same time, according to position B and position A. The time period between changes, while also calculating the strong airflow Duration and data flow.
  • the parameter data of the preset first airflow is acquired, and after the second airflow is collected, the parameter data of the second airflow generated due to the airflow change is acquired.
  • the sensor integrated device of the smart terminal monitors the airflow of the smart terminal in real time, and when the second airflow is detected, the sensor integrated device sends the second airflow parameter data generated by the second airflow change to the smart through the detection and analysis interface.
  • the operating system of the terminal and the operating system sends the second airflow parameter data to the storage device of the smart terminal through the detection and analysis interface and stores the data.
  • the first airflow parameter data refers to the first airflow parameter data preset in the smart terminal, and the first airflow parameter data can include the airflow intensity and the airflow duration At least one of the time.
  • the second airflow parameter data refers to a current airflow that is detected by the smart terminal in real time through the sensor integrated device of the smart terminal when displaying a dialog box, and the second airflow parameter data includes at least one of airflow intensity and airflow duration. .
  • the sensor integrated device of the smart terminal sets the first airflow parameter data and the second airflow parameter data when collecting There are measures to filter out the interference information.
  • a sound having a human vocal characteristic is emitted, and the sound generated when the natural wind flows is extremely small, and the sound color is different from the human vocalization (including mechanical sound), and is set in the smart terminal.
  • the sensor integrated device collects the sound closer to it and collects the sound when the natural wind flows, thereby shielding the current airflow pair by identifying the sound color type as the natural wind sound or the mechanical sound when the sound parameter is recognized.
  • the influence generated by the electronic device does not acquire and detect the current airflow; on the contrary, if the sound color type in the sound parameter is recognized as a human voice, it is determined that the current airflow directed to the smart terminal speaks or exhales for the user (blowing Produced by gas Airflow, at this time, the target airflow parameter data corresponding to the current airflow is collected and detected.
  • the present embodiment uses the airflow parameter data while the sensor integrated device acquires
  • the sensor integrated device simultaneously acquires sound parameters, and distinguishes the attribute of the target airflow by identifying the type of sound color in the sound parameter, which is generated by the user, or is it natural wind or other airflow type, and shields the airflow in the electronic device from the outside air such as natural wind. Controlled interference.
  • Step 104 Parsing the second airflow sample to form a second parameter data.
  • Step 105 Compare the second parameter data with the first parameter data, and when the second parameter data matches the first parameter data, perform the operation action on the dialog box;
  • the airflow entering the smart terminal includes two situations, one is a flow generated by a user's air blow, and the other is a flow generated by the air flow, and the smart terminal only generates airflow generated by the user.
  • the airflow generated by the air flow does not need to perform the canceling operation, and in step 102, although the sensor integrated device is provided to filter and remove the natural wind airflow, in order to ensure accuracy, if only the preset threshold is The comparison of the airflow parameter data determines whether to perform the cancel operation according to the comparison result, and it is impossible to distinguish the airflow generated by the user's air blow and the airflow generated by the air flow, thereby causing the error rate and uncertainty of canceling the operation, and easily causing misoperation.
  • the smart terminal When distinguishing the airflow generated by the user's air blow and the airflow generated by the air flow, it is necessary to determine whether the airflow is generated by blowing air toward the smart terminal according to the airflow parameter data, and when the airflow is generated toward the smart terminal, the smart terminal is located.
  • the air in the environment cannot be generated when the air flows, so the airflow generated by the user's air blow can be distinguished from the airflow generated by the air flow based on the principle, so that the smart terminal can accurately accurately when the user blows the air to the smart terminal in the blow-off unlocked position. Cancel the dialog.
  • the performing the canceling operation includes: after receiving the first airflow parameter data stored by the sensor integrated device and the second airflow parameter data stored and detected by the operating system of the smart terminal, calculating a difference between the first airflow parameter data and the second airflow parameter data, Comparing the calculated difference with the preset threshold, if the difference between the first airflow parameter data and the second airflow parameter data is greater than or equal to a preset threshold, performing a cancel operation; if the first airflow parameter data and the second The difference between the airflow parameter data is less than the preset threshold, and the cancel operation is not performed.
  • the difference between the first airflow parameter data and the second airflow parameter data is: the airflow intensity of the first airflow minus the airflow intensity of the second airflow, and/or the airflow duration of the first airflow minus the second airflow. Airflow duration.
  • first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other.
  • first information may also be referred to as second information without departing from the scope of the present disclosure.
  • second information may also be referred to as first information.
  • word "if” as used herein may be interpreted as "when” or "when” or "in response to determination.”
  • the operating device for the dialog box in the smart terminal may be implemented by an operating device 10, including: a storage module 20, an association module 30, an acquisition module 40, and a detection module. 50. Execution module 60.
  • the parameter information of the first airflow is preset, for example, the generated airflow parameter data can be acquired through a microphone.
  • the microphone When the microphone is used to detect the airflow parameter, the microphone captures the sound generated by the airflow change.
  • the airflow parameter is the electric signal converted by the sound captured by the microphone, and the condition that the first airflow parameter needs to satisfy may be the amplitude of the electrical signal.
  • the preset size and/or the preset position of the sound source obtained from the electrical signal. It is also possible to further obtain a moving direction or a moving path of the airflow change according to the obtained first airflow parameter.
  • the preset first airflow parameter data can be obtained by comparing, the acquisition unit obtains and sends the relative temperature data to the smart terminal by using a sensor, and the parsing unit further configures the smart terminal to: receive the Airflow parameter data, the relative temperature data.
  • the airflow parameter data is data formed by characteristics such as a human body and an environment having a variation, and includes: general noise data, heartbeat data, user air blowing data, and accidental noise data.
  • the relative temperature data is the data formed by the temperature change generated when close to the human body, mainly including: the body surface temperature of the human body obtained by real-time detection; the difference of the body surface temperature has an influence on the detection of the insufflation, so it is necessary to filter through the body surface temperature correction.
  • the filter coefficients of the algorithm used at the time to perfect the multi-level filtering algorithm are the filtering of common noise data, and the series filtering method is adopted, and the air blowing vector data is obtained after filtering; the air blowing vector data is vector data with a relatively obvious direction (for example, air blowing and heartbeat are obvious). Amplitude and frequency).
  • the user-based data is data with specific directivity entered by the user; the specific directivity refers to the amplitude and frequency range of different user-based data corresponding to different set features (in the algorithm, the difference in filter coefficients).
  • Similar filtering is the filtering of heartbeat data, using theory, The actual amplitude and frequency comparison method; because the amplitude and frequency of the heartbeat and insufflation are similar, use the comparison method to determine which is the amplitude and frequency of the heartbeat, and filter it out in a targeted manner.
  • the characteristic data of the user must include the user's insufflation data.
  • the communication unit enables the first airflow parameter data to be acquired by the cloud server or directly stored in the chip built in the smart terminal, that is, the download unit can directly retrieve the information from the cloud server.
  • the pop-up mechanism of a dialog box prompts a dialog box in the display area of the smart terminal, and the dialog box displays a prompting user to perform the dialog box. operating.
  • the prompting unit prompts the dialog box to obtain the second blowing airflow data of the user through the sensor integrated device, in order to avoid interference of the environmental noise on the collection and detection process, so as to improve the accuracy of airflow detection and classification in the air blowing,
  • the collected airflow data is first denoised by low-pass filtering to eliminate the influence of the environmental noise on the original signal, and then, Find the inspiratory data from the filtered airflow data, because the noise usually occurs in the inhalation phase, so it is necessary to accurately find the inspiratory sound source and the insufflation sound source from the airflow data to determine the start time of the inhalation data and End Time.
  • the flow curve of the inspiratory data of the preset time period is selected, and the characteristic parameters of the flow curve are analyzed and calculated to realize the detection and classification of the pair.
  • the control unit controls the sensor integrated device to monitor the airflow of the smart terminal in real time, and when it is detected that the airflow is blown toward the smart terminal and the second airflow is generated, the sensor integrated device collects the airflow of the blow air and passes the airflow.
  • the intensity of the airflow is stored after the analysis and analysis; the sensor integrated device includes more than one sensor, and the position of the sensor in the smart terminal and the number of sensors can be set or adjusted according to internal or external structures of different smart terminals; for example, It can be placed near the microphone position of the smart terminal.
  • the parameter data of the first airflow that can be stored in an embodiment of the present invention may include the intensity data of the airflow.
  • the method for obtaining the airflow intensity by the sensor integrated device is as follows: the monitoring unit makes the sensor integrated device have The circular air hole, the sensor integrated device also has a spherical circuit board and a suspended object inside.
  • the spherical circuit board covers the area of the inner surface of the sensor except the circular air hole, and the suspended object is suspended inside the sensor when no airflow enters the intelligent terminal.
  • the fixed position A ensures that the suspended object is suspended inside the sensor integrated device by placing a magnet on the suspended object, and a magnet is also arranged inside the sensor integrated device, and the suspended object can be suspended due to the repulsive force between the magnetic poles of the magnet;
  • the airflow passes through the intelligent terminal, the airflow will pass through the sensor integrated device
  • the circular air hole enters the inside of the sensor, and the suspended object moves inside the sensor due to the airflow, and will touch the spherical circuit board.
  • the position of the touch point is B. According to the position B and the position A, the direction of the airflow can be judged. It can be expressed as A to B, and at the same time, according to the time period between the position B and the position A, the intensity data of the airflow and the duration of the airflow can be calculated at the same time.
  • the parameter data of the preset first airflow is acquired, and after the second airflow is collected, the parameter data of the second airflow generated due to the airflow change is acquired.
  • the sensor integrated device of the smart terminal monitors the airflow of the smart terminal in real time, and when the second airflow is detected, the sensor integrated device sends the second airflow parameter data generated by the second airflow change to the smart through the detection and analysis interface.
  • the operating system of the terminal and the operating system sends the second airflow parameter data to the storage device of the smart terminal through the detection and analysis interface and stores the data.
  • the first airflow parameter data refers to the first airflow parameter data preset in the smart terminal, and the first airflow parameter data can include the airflow intensity and the airflow duration At least one of the time.
  • the second airflow parameter data refers to a current airflow that is detected by the smart terminal in real time through the sensor integrated device of the smart terminal when displaying a dialog box, and the second airflow parameter data includes at least one of airflow intensity and airflow duration. .
  • the sensor integrated device of the smart terminal sets the first airflow parameter data and the second airflow parameter data when collecting There are measures to filter out the interference information.
  • a sound having a human vocal characteristic is emitted, and the sound generated when the natural wind flows is extremely small, and the sound color is different from the human vocalization (including mechanical sound), and is set in the smart terminal.
  • the sensor integrated device collects the sound closer to it and collects the sound when the natural wind flows, thereby shielding the current airflow pair by identifying the sound color type as the natural wind sound or the mechanical sound when the sound parameter is recognized.
  • the influence generated by the electronic device does not acquire and detect the current airflow; on the contrary, if the sound color type in the sound parameter is recognized as a human voice, it is determined that the current airflow directed to the smart terminal speaks or exhales for the user (blowing The airflow generated by the gas is collected and detected at the target airflow parameter data corresponding to the current airflow.
  • the present embodiment uses the airflow parameter data while the sensor integrated device acquires
  • the sensor integrated device simultaneously acquires sound parameters, and distinguishes the attribute of the target airflow by identifying the type of sound color in the sound parameter, which is generated by the user, or is it natural wind or other airflow type, and shields the airflow in the electronic device from the outside air such as natural wind. Controlled interference.
  • the airflow entering the smart terminal includes two situations, one is a flow generated by a user's air blow, and the other is a flow generated by the air flow, and the smart terminal only generates airflow generated by the user.
  • cancel operation the airflow generated by the air flow does not need to be canceled.
  • the sensor integrated device is provided to filter out the natural wind airflow, in order to ensure accuracy, only the preset threshold and airflow parameter data are used. Comparison, according to the comparison result to decide whether to perform the cancel operation, it will be impossible to distinguish the airflow generated by the user's air blow and the airflow generated by the air flow, thereby causing the error rate and uncertainty of canceling the operation, and easily causing misoperation.
  • the analysis unit distinguishes the airflow generated by the user's air blow and the airflow generated by the air flow, it is necessary to determine whether the airflow is generated by blowing air toward the smart terminal according to the airflow parameter data, and is intelligent when blowing air toward the smart terminal to generate airflow.
  • the air in the environment in which the terminal is located cannot be generated when the air flows. Therefore, based on the principle, the airflow generated by the user's air blow can be distinguished from the airflow generated by the air flow, so that when the user blows the air to the smart terminal in the air blowing unlocking position, the smart terminal Can cancel the dialog accurately.
  • the performing unit performs the canceling operation, after receiving the first airflow parameter data stored by the sensor integrated device from the operating system of the smart terminal and detecting the second airflow parameter data analyzed, calculating a difference between the first airflow parameter data and the second airflow parameter data. a value, comparing the calculated difference with a preset threshold, if the difference between the first airflow parameter data and the second airflow parameter data is greater than or equal to a preset threshold, performing a cancel operation; if the first airflow parameter data and The difference between the second airflow parameter data is less than a preset threshold, and the cancel operation is not performed.
  • the difference between the first airflow parameter data and the second airflow parameter data is: the airflow intensity of the first airflow minus the airflow intensity of the second airflow, and/or the airflow duration of the first airflow minus the second airflow. Airflow duration.
  • an embodiment of the present invention further provides a computer readable storage medium having stored therein computer executable instructions, such as a non-volatile memory such as an optical disk, a hard disk, or a flash memory.
  • computer executable instructions are for causing a computer or the like to perform various operations in the above-described operation method of the dialog box.
  • the present invention includes apparatus related to performing one or more of the operations described herein. These devices may be specially designed and manufactured for the required purposes, or may also include known devices in a general purpose computer. These devices have computer programs stored therein that are selectively activated or reconfigured.
  • Such computer programs may be stored in a device (eg, computer) readable medium or in any type of medium suitable for storing electronic instructions and separately coupled to a bus, including but not limited to any Types of disks (including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable) Programmable Read-Only Memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card or light card.
  • a readable medium includes any medium that is stored or transmitted by a device (eg, a computer) in a readable form.

Abstract

An operation method and an operation apparatus for a dialog box in a smart terminal. The operation method is characterized by comprising: storing first parameter data corresponding to a first airflow sample into a smart terminal (101); associating the first airflow sample with an operation action (102); when a dialog box is displayed in a display region of the smart terminal, collecting a second airflow sample blowing to the smart terminal (103); parsing the second airflow sample to form second parameter data (104); and comparing the second parameter data with the first parameter data, and when the second parameter data matches the first parameter data, performing the operation action on the dialog box (105). An operation required on an electronic device is implemented when a user cannot directly and manually control the electronic device, and then, the objective for controlling the electronic device by using an airflow is achieved.

Description

一种智能终端内对话框的操作方法及操作装置Operation method and operation device of dialog box in intelligent terminal 技术领域Technical field
本发明涉及智能终端领域,尤其涉及一种智能终端内对话框的操作方法及操作装置。The present invention relates to the field of intelligent terminals, and in particular, to a method and an operation device for operating a dialog box in an intelligent terminal.
背景技术Background technique
在使用智能终端,如手机时,往往发生无法进行手动操作的情况,如用户在进行餐点、陶艺等手工操作且需要使用电子设备进行查询或其他操作的情况。When using a smart terminal, such as a mobile phone, it is often impossible to perform manual operations, such as when a user performs manual operations such as meals, ceramics, and the like, and needs to use an electronic device for inquiry or other operations.
为实现无手动操作,通常采用语音控制方案。但上述语音控制方案只能进行线性控制操作,且电子设备所处语音环境中无法识别用户语音与其他语音,导致用户的电子设备可能被其他语音进行控制并进行某种操作,使得用户在使用电子设备时被干扰,降低用户体验。In order to achieve no manual operation, a voice control scheme is usually adopted. However, the above voice control scheme can only perform linear control operations, and the user voice and other voices cannot be recognized in the voice environment where the electronic device is located, so that the user's electronic device may be controlled by other voices and perform some operation, so that the user is using the electronic The device is disturbed and reduces the user experience.
目前,智能终端市场上的设备,用户进行选择操作对话框的方式多为通过触摸的方式进行操作,其中具体的包括触摸物理按键的方式和触摸屏幕的方式进行操作,然而在某些情况下由于双手不方便进行触摸式操作选择时,则不能进行有效的操作,但是在双手不方便进行操作时用户又需要对智能终端弹出的选项进行操作。At present, in the device on the smart terminal market, the manner in which the user selects the operation dialog box is mostly performed by means of touch, wherein the specific method includes touching the physical button and touching the screen, but in some cases due to When the hands are inconvenient for the touch operation selection, the effective operation cannot be performed, but when the hands are inconvenient to operate, the user needs to operate the options popped up by the smart terminal.
发明内容Summary of the invention
为了克服上述技术缺陷,本发明的目的在于提供一种智能终端内对话框的操作方法及操作装置。In order to overcome the above technical deficiencies, an object of the present invention is to provide an operation method and an operation device for a dialog box in an intelligent terminal.
本发明公开了一种智能终端内对话框的操作方法,其特征在于,所述操作方法包括:The invention discloses a method for operating a dialog box in a smart terminal, characterized in that the operation method comprises:
于所述智能终端内存储一与第一气流样本对应的第一参数数据;And storing, in the smart terminal, first parameter data corresponding to the first airflow sample;
将所述第一气流样本与一操作动作关联;Associating the first airflow sample with an operational action;
当智能终端的显示区域显示一对话框时,采集一吹向所述智能终端的第二气流样本;When the display area of the smart terminal displays a dialog box, collecting a second airflow sample that is blown to the smart terminal;
解析所述第二气流样本,形成一第二参数数据;Parsing the second airflow sample to form a second parameter data;
比较所述第二参数数据与所述第一参数数据,当所述第二参数数据匹配所述第一参 数数据时,对所述对话框执行所述操作动作。Comparing the second parameter data with the first parameter data, when the second parameter data matches the first parameter When the data is counted, the operation action is performed on the dialog box.
优选地,于所述智能终端内存储一第一气流的第一参数数据的步骤包括,包括:Preferably, the step of storing the first parameter data of the first airflow in the smart terminal comprises:
采集一第一气流样本,Collecting a first airflow sample,
解析所述第一气流样本,形成所述第一参数数据,其中所述第一参数数据包含气流的强度和气流的持续时间中的一种或多种;或Parsing the first airflow sample to form the first parameter data, wherein the first parameter data includes one or more of an intensity of a gas flow and a duration of a gas flow; or
所述智能终端与一云端服务器通讯连接;The smart terminal is in communication connection with a cloud server;
下载所述第一参数数据并存储。The first parameter data is downloaded and stored.
优选地,当智能终端的显示区域显示一对话框时,采集一吹向所述智能终端的第二气流样本,包括:Preferably, when the display area of the smart terminal displays a dialog box, collecting a second airflow sample that is blown to the smart terminal includes:
所述智能终端在完成执行一操作过程中需要提示一对话框时,在所述智能终端的显示区域中提示一对话框;When the smart terminal needs to prompt a dialog box during the execution of an operation, the smart terminal prompts a dialog box in the display area of the smart terminal;
所述对话框中显示一提示用户进行操作的信息。A message prompting the user to perform an operation is displayed in the dialog box.
优选地,当智能终端的显示区域显示一对话框时,采集一吹向所述智能终端的第二气流样本,包括:Preferably, when the display area of the smart terminal displays a dialog box, collecting a second airflow sample that is blown to the smart terminal includes:
在所述智能终端的显示区域显示所述对话框时,启动一气流检测设备;When the dialog box is displayed in the display area of the smart terminal, an airflow detecting device is activated;
根据所述气流检测设备监测吹向所述智能终端的所述第二气流样本。The second airflow sample blown to the smart terminal is monitored according to the airflow detecting device.
优选地,比较所述第二参数数据与所述第一参数数据,当所述第二参数数据匹配所述第一参数数据时,对所述对话框执行所述操作动作的步骤包括:Preferably, comparing the second parameter data with the first parameter data, when the second parameter data matches the first parameter data, performing the operation action on the dialog box comprises:
计算所述第二气流参数数据与所述第一气流参数数据的差值;Calculating a difference between the second airflow parameter data and the first airflow parameter data;
当所述差值为正数时,取消所述对话框且关闭其在所述智能终端的显示区域的显示界面;When the difference is a positive number, cancel the dialog box and close its display interface in the display area of the smart terminal;
当所述差值为负数时,保持所述对话框在所述智能终端的显示区域显示。When the difference is a negative number, the dialog box is kept displayed in the display area of the smart terminal.
本发明还公开了一种The invention also discloses a
智能终端内对话框的操作装置,其特征在于,所述操作装置包括:存储模块、关联模块、采集模块、检测模块、执行模块,其中,The operation device of the dialog box in the smart terminal, wherein the operation device comprises: a storage module, an association module, an acquisition module, a detection module, and an execution module, wherein
所述存储模块,用于于所述智能终端内存储一与第一气流样本对应的第一参数数据;The storage module is configured to store, in the smart terminal, first parameter data corresponding to the first airflow sample;
所述关联模块,与所述存储模块通讯连接,用于将所述第一气流样本与一操作动作关联;The association module is communicatively coupled to the storage module for associating the first airflow sample with an operational action;
所述采集模块,与所述存储模块通讯连接,用于当所述智能终端的显示区域显示一对话框时,采集一吹向所述智能终端的第二气流样本; The collecting module is connected to the storage module, and is configured to collect a second airflow sample that is blown to the smart terminal when the display area of the smart terminal displays a dialog box;
所述检测模块,与所述采集模块通讯连接,用于解析所述第二气流样本,形成一第二参数数据;The detecting module is connected to the collecting module for analyzing the second airflow sample to form a second parameter data;
所述执行模块,与所述检测模块通讯连接,用于比较所述第二参数数据与所述第一参数数据,当所述第二参数数据匹配所述第一参数数据时,对所述对话框执行所述操作动作。The execution module is in communication with the detection module, configured to compare the second parameter data with the first parameter data, and when the second parameter data matches the first parameter data, the session is The box performs the operational action.
优选地,所述存储模块,包括:Preferably, the storage module includes:
采集单元,用于采集一第一气流样本;An acquisition unit, configured to collect a first airflow sample;
解析单元,与所述采集单元通讯连接,用于解析所述第一气流样本,形成所述第一参数数据,其中所述第一参数数据包含气流的强度和气流的持续时间中的一种或多种;a parsing unit, configured to communicate with the collecting unit, configured to parse the first airflow sample to form the first parameter data, wherein the first parameter data includes one of an intensity of a gas flow and a duration of a gas flow or Multiple
通讯单元,用于与一云端服务器通讯连接,将所述第一参数数据上传至所述云端服务器;a communication unit, configured to communicate with a cloud server, and upload the first parameter data to the cloud server;
下载单元,与所述云端服务器通讯连接,用于下载所述第一参数数据并通过所述存储单元存储。And a downloading unit, configured to communicate with the cloud server, to download the first parameter data and store the data through the storage unit.
优选地,所述采集模块,包括:Preferably, the collecting module comprises:
提示单元,用于当所述智能终端在完成执行一操作过程中需要提示一对话框时,在所述智能终端的显示区域中提示一对话框且启动;a prompting unit, configured to prompt a dialog box in the display area of the smart terminal and start when the smart terminal needs to prompt a dialog box during the execution of an operation;
所述对话框中显示一提示用户进行操作的信息。A message prompting the user to perform an operation is displayed in the dialog box.
优选地,所述采集模块,还包括:Preferably, the collecting module further includes:
控制单元,用于在所述智能终端的显示区域显示所述对话框时,启动一气流检测设备;a control unit, configured to start an airflow detecting device when the dialog box is displayed in a display area of the smart terminal;
监测单元,与所述控制单元通讯连接,用于根据所述气流检测设备监测吹向所述智能终端的所述第二气流样本。And a monitoring unit, in communication with the control unit, configured to monitor the second airflow sample blown to the smart terminal according to the airflow detecting device.
优选地,所述执行模块,包括:Preferably, the execution module includes:
分析单元,用于计算所述第二气流参数数据与所述第一气流参数数据的差值;An analyzing unit, configured to calculate a difference between the second airflow parameter data and the first airflow parameter data;
执行单元,与所述分析单元通讯连接,用于当所述差值为正数时,取消所述对话框且关闭其在所述智能终端的显示区域的显示界面;An execution unit, configured to be in communication with the analysis unit, configured to cancel the dialog box and close a display interface of the display area of the smart terminal when the difference is a positive number;
所述执行单元还用于当所述差值为负数时,保持所述对话框在所述智能终端的显示区域显示。The execution unit is further configured to keep the dialog box displayed in a display area of the smart terminal when the difference is a negative number.
采用了上述技术方案后,与现有技术相比,具有以下有益效果:After adopting the above technical solution, compared with the prior art, the following beneficial effects are obtained:
1.实现在用户无法直接进行手动控制电子设备时实现对电子设备进行所需的操作,避 免了现有技术中无法对用户声音信号与其他声音信号进行识别导致操作失误影响用于体验的情况,通过感应用户对电子设备说话或吹起时产生的气流,根据气流的参数确定对应的操作命令,既而实现气流控制电子设备的目的。1. Realize the required operation of the electronic device when the user cannot directly control the electronic device manually, avoiding It is possible to avoid the situation that the user's voice signal and other sound signals cannot be recognized in the prior art, and the operation error affects the experience for the experience. By sensing the airflow generated when the user speaks or blows the electronic device, the corresponding operation is determined according to the parameters of the airflow. Commands that achieve the goal of airflow control electronics.
附图说明DRAWINGS
图1为符合本发明一优选实施例中智能终端内对话框的操作方法的流程示意图;1 is a schematic flow chart of a method for operating a dialog box in a smart terminal according to a preferred embodiment of the present invention;
图2为符合本发明一优选实施例中,智能终端内对话框的操作方法的步骤101的流程示意图;2 is a schematic flow chart of step 101 of a method for operating a dialog box in a smart terminal according to a preferred embodiment of the present invention;
图3为符合本发明一优选实施例中,智能终端内对话框的操作方法的步骤103的流程示意图;3 is a schematic flowchart of step 103 of an operation method of a dialog box in a smart terminal according to a preferred embodiment of the present invention;
图4为符合本发明一优选实施例中,智能终端内对话框的操作方法的步骤103的流程示意图;4 is a schematic flow chart of step 103 of a method for operating a dialog box in a smart terminal according to a preferred embodiment of the present invention;
图5为符合本发明一优选实施例中,智能终端内对话框的操作方法的步骤105的流程示意图;5 is a schematic flowchart of step 105 of an operation method of a dialog box in a smart terminal according to a preferred embodiment of the present invention;
图6为符合本发明一优选实施例中智能终端内对话框的操作装置的结构示意图。FIG. 6 is a schematic structural diagram of an operation device of a dialog box in a smart terminal according to a preferred embodiment of the present invention.
图7为符合本发明一优选实施例中智能终端内对话框的操作装置的结构示意图FIG. 7 is a schematic structural diagram of an operation device of a dialog box in a smart terminal according to a preferred embodiment of the present invention;
图8为符合本发明一优选实施例中智能终端内对话框的操作装置的结构示意图FIG. 8 is a schematic structural diagram of an operation device of a dialog box in a smart terminal according to a preferred embodiment of the present invention;
图9为符合本发明一优选实施例中智能终端内对话框的操作装置的结构示意图FIG. 9 is a schematic structural diagram of an operation device of a dialog box in a smart terminal according to a preferred embodiment of the present invention;
附图标记:Reference mark:
10-操作装置、20-存储模块、30-关联模块、40-采集模块、50-检测模块、60-执行模块:10-Operation device, 20-storage module, 30-association module, 40-acquisition module, 50-detection module, 60-execution module:
具体实施方式Detailed ways
以下结合附图与具体实施例进一步阐述本发明的优点。Advantages of the present invention are further explained below in conjunction with the accompanying drawings and specific embodiments.
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. The following description refers to the same or similar elements in the different figures unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with aspects of the present disclosure as detailed in the appended claims.
本技术领域技术人员可以理解,这里所使用的智能终端,既包括无线信号接收器的设备,其仅具备无发射能力的无线信号接收器的设备,又包括接收和发射硬件的设备, 其具有能够在双向通信链路上,进行双向通信的接收和发射硬件的设备。这种设备可以包括:蜂窝或其他通信设备,其具有单线路显示器或多线路显示器或没有多线路显示器的蜂窝或其他通信设备;PCS(Personal Communications Service,个人通信系统),其可以组合语音、数据处理、传真和/或数据通信能力;PDA(Personal Digital Assistant,个人数字助理),其可以包括射频接收器、寻呼机、互联网/内联网访问、网络浏览器、记事本、日历和/或GPS(Global Positioning System,全球定位系统)接收器;常规膝上型和/或掌上型计算机或其他设备,其具有和/或包括射频接收器的常规膝上型和/或掌上型计算机或其他设备。这里所使用的“终端”、“智能终端”可以是便携式、可运输、安装在交通工具(航空、海运和/或陆地)中的,或者适合于和/或配置为在本地运行,和/或以分布形式,运行在地球和/或空间的任何其他位置运行。这里所使用的“设备”、“智能终端”还可以是通信设备、上网设备、音乐/视频播放设备,例如可以是PDA,MID(Mobile Internet Device,移动互联网设备)和/或具有音乐/视频播放功能的移动电话,也可以是智能电视、机顶盒等设备。Those skilled in the art can understand that the smart terminal used herein includes a device of a wireless signal receiver, a device having only a wireless signal receiver without a transmitting capability, and a device for receiving and transmitting hardware. It has a device capable of receiving and transmitting hardware for two-way communication over a two-way communication link. Such devices may include cellular or other communication devices having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data Processing, fax, and/or data communication capabilities; PDA (Personal Digital Assistant), which can include radio frequency receivers, pagers, Internet/Intranet access, web browsers, notepads, calendars, and/or GPS (Global Positioning System (Global Positioning System) receiver; conventional laptop and/or palmtop computer or other device having a conventional laptop and/or palmtop computer or other device that includes and/or includes a radio frequency receiver. As used herein, "terminal", "smart terminal" may be portable, transportable, installed in a vehicle (aviation, sea and/or land), or adapted and/or configured to operate locally, and/or Run in any other location on the Earth and/or space in a distributed form. The "device" and "smart terminal" used herein may also be a communication device, an internet device, a music/video playback device, such as a PDA, a MID (Mobile Internet Device), and/or have a music/video playback. Functional mobile phones can also be smart TVs, set-top boxes and other devices.
在本发明的描述中,需要理解的是,术语“纵向”、“横向”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。In the description of the present invention, it is to be understood that the terms "longitudinal", "transverse", "upper", "lower", "front", "rear", "left", "right", "vertical", The orientation or positional relationship of the indications of "horizontal", "top", "bottom", "inside", "outside", etc. is based on the orientation or positional relationship shown in the drawings, only for the convenience of describing the present invention and simplifying the description, rather than It is to be understood that the device or elements referred to have a particular orientation, are constructed and operated in a particular orientation and are therefore not to be construed as limiting.
参阅图1-5,为符合本发明一优选实施例中的流程示意图,该方法包括:Referring to Figures 1-5, a flow diagram consistent with a preferred embodiment of the present invention includes:
步骤101:于所述智能终端内存储一与第一气流样本对应的第一参数数据;Step 101: Store, in the smart terminal, first parameter data corresponding to the first airflow sample.
步骤102:将所述第一气流样本与一操作动作关联;Step 102: Associate the first airflow sample with an operation action;
本发明的一个实施例中,预设第一气流的参数信息,例如能够通过麦克风获取生成的气流参数数据即可。当利用麦克风来检测气流参数时,麦克风捕捉气流变化产生的声音,此时气流参数为麦克风将捕捉到的声音转换后的电信号,该第一气流参数需满足的条件可以为电信号的振幅的预设大小和/或根据电信号获得的声源的预设位置。还可以根据获得的第一气流参数进一步获得气流变化的移动方向或移动路径。In an embodiment of the present invention, the parameter information of the first airflow is preset, for example, the generated airflow parameter data can be acquired through a microphone. When the microphone is used to detect the airflow parameter, the microphone captures the sound generated by the airflow change. At this time, the airflow parameter is the electric signal converted by the sound captured by the microphone, and the condition that the first airflow parameter needs to satisfy may be the amplitude of the electrical signal. The preset size and/or the preset position of the sound source obtained from the electrical signal. It is also possible to further obtain a moving direction or a moving path of the airflow change according to the obtained first airflow parameter.
具体地,预设的第一气流参数数据能够通过如下方法比较后获得,将该相对温度数据通过一传感器获得并发送至该智能终端,该智能终端还被配置为:接收该气流参数数据、该相对温度数据。该气流参数数据为具有变化量的人体、环境等特征形成的数据,包括:普通噪声数据、心跳数据、用户吹气数据以及意外噪声数据。相对温度数据为贴 近人体时产生的温度变化形成的数据,主要包括:实时检测获得的人体的体表温度;体表温度的不同会对吹气的检测有影响,因此需要通过体表温度校正过滤时所用算法的滤波系数,完善多级过滤的算法。第一噪声过滤为对普通噪声数据的滤除,采用系列滤波的方式,过滤后得到吹气向量数据;吹气向量数据为具有较为明显方向的向量数据(如:吹气、心跳均具有明显的幅值以及频率)。用户基础数据为用户录入的具有特定指向性的数据;特定指向性是指不同的用户基础数据对应不同设定特征的幅值及频率范围(在算法中表现为滤波系数的不同)。相似过滤为对心跳数据的滤除,采用理论、实际的幅值及频率比对的方式;由于心跳以及吹气的幅值及频率较为近似,因此采用比对方式确定哪些是心跳的幅值及频率,并针对性的将其滤除,剩下的特征数据中必然包括用户吹气数据。Specifically, the preset first airflow parameter data can be obtained by comparing, the obtained relative temperature data is obtained by a sensor and sent to the smart terminal, and the smart terminal is further configured to: receive the airflow parameter data, the Relative temperature data. The airflow parameter data is data formed by characteristics such as a human body and an environment having a variation, and includes: general noise data, heartbeat data, user air blowing data, and accidental noise data. Relative temperature data is posted The data formed by the temperature changes generated by the human body mainly include: the body surface temperature of the human body obtained by real-time detection; the difference of the body surface temperature has an influence on the detection of the air blowing, and therefore the algorithm used for the surface temperature correction filtering is required. Filter coefficient, perfect multi-level filtering algorithm. The first noise filtering is the filtering of common noise data, and the series filtering method is adopted, and the air blowing vector data is obtained after filtering; the air blowing vector data is vector data with a relatively obvious direction (for example, air blowing and heartbeat are obvious). Amplitude and frequency). The user-based data is data with specific directivity entered by the user; the specific directivity refers to the amplitude and frequency range of different user-based data corresponding to different set features (in the algorithm, the difference in filter coefficients). Similar filtering is the filtering of heartbeat data, using theoretical, actual amplitude and frequency comparison; because the amplitude and frequency of heartbeat and insufflation are similar, the comparison method is used to determine which is the amplitude of the heartbeat and The frequency is filtered out in a targeted manner, and the remaining feature data necessarily includes the user's insufflation data.
该第一气流参数数据能够通过云端服务器获取或者直接存储于智能终端内置的芯片内,也就是说,能够从云端服务器或者直接调取该信息。The first airflow parameter data can be obtained by the cloud server or directly stored in the chip built in the smart terminal, that is, the information can be directly retrieved from the cloud server.
步骤103:当所述智能终端的显示区域显示一对话框时,采集一吹向所述智能终端的第二气流样本;Step 103: When the display area of the smart terminal displays a dialog box, collect a second airflow sample that is blown to the smart terminal;
本发明的一个实施例中,智能终端在应用程序中需要提示一对话框的时,通过一对话框的弹出机制在智能终端的显示区域中提示一对话框,该对话框中显示有一提示用户进行操作。In an embodiment of the present invention, when the smart terminal needs to prompt a dialog box in the application, the pop-up mechanism of a dialog box prompts a dialog box in the display area of the smart terminal, and the dialog box displays a prompting user to perform the dialog box. operating.
提示该对话框的同时,通过传感器集成设备获取用户的第二吹气气流数据,为了避免环境噪音对采集检测过程带来干扰,以提高吹气中的气流检测和分类的准确性,本发明实施例在使用传感器集成设备中的采集设备例如,(麦克风)采集用户的气流数据之后,首先通过低通滤波对采集的气流数据进行去噪处理,消除环境噪音对原始信号的影响,然后,从过滤后的气流数据中查找吸气数据,因为噪音通常发生在吸气阶段,因此需要准确地从气流数据中找出吸气声源和吹气声源,从而确定吸气数据的开始时间与结束时间。最后,选取预设时间段的吸气数据的流量曲线,对该流量曲线的特征参数进行分析计算,实现对的检测与分类。At the same time of prompting the dialog box, the second inspiratory airflow data of the user is obtained through the sensor integrated device, in order to avoid interference of the environmental noise on the acquisition and detection process, so as to improve the accuracy of airflow detection and classification in the air blowing, the invention is implemented For example, after collecting the user's airflow data by using the acquisition device in the sensor integrated device, for example, (microphone), the collected airflow data is first denoised by low-pass filtering to eliminate the influence of environmental noise on the original signal, and then, filtering. Find the inspiratory data in the airflow data, because the noise usually occurs in the inhalation phase, so it is necessary to accurately find the inspiratory sound source and the insufflation sound source from the airflow data to determine the start time and end time of the inhalation data. . Finally, the flow curve of the inspiratory data of the preset time period is selected, and the characteristic parameters of the flow curve are analyzed and calculated to realize the detection and classification of the pair.
具体地,在提示对话框的同时,传感器集成设备实时监测智能终端的气流,当监测到朝向智能终端有吹气并产生第二气流时,传感器集成设备采集该吹气的气流并通过检测分析后存储该气流的强度;该传感器集成设备中包括一个以上传感器,传感器在智能终端中的位置以及传感器的个数都可以根据不同的智能终端的内部或外部结构进行设置或调整;例如,可以设置在智能终端麦克风位置的附近。Specifically, the sensor integrated device monitors the airflow of the smart terminal in real time while prompting the dialog box. When it is detected that the airflow is blown toward the smart terminal and the second airflow is generated, the sensor integrated device collects the airflow of the blow air and passes the detection and analysis. Storing the intensity of the airflow; the sensor integrated device includes more than one sensor, and the position of the sensor in the smart terminal and the number of sensors can be set or adjusted according to different internal or external structures of the smart terminal; for example, it can be set in The location of the smart terminal microphone.
可选地,本发明的一个实施例可以存储的第一气流的参数数据可以包括一气流的强 度数据,如下是一种该传感器集成设备获取气流强度的方法为:该传感器集成设备有圆形气孔,传感器集成设备内部还设有一个球形电路板和一个悬浮物体,球形电路板覆盖在传感器内表面中除圆形气孔外的区域,悬浮物体在没有气流进入智能终端时悬浮在传感器内部的固定位置A,保证悬浮物体悬浮在传感器集成设备内部的方法为在悬浮物体上设置磁铁,传感器集成设备内部也设置一个磁铁,悬浮物体就可以由于磁铁间磁极的排斥力而悬浮起来;当有气流通过智能终端时,气流将通过传感器集成设备的圆形气孔进入到传感器内部,悬浮物体因为受到气流的推动在传感器内移动,将触碰到球形电路板上,触碰点的位置为B,根据位置B和位置A可以判断出气流的方向可以表示为A到B,同时,根据位置B和位置A之间变化的时间段,同时还能计算出气流的强度数据和气流的持续时间。Optionally, the parameter data of the first airflow that can be stored in an embodiment of the present invention may include a strong airflow. The data is as follows. The method for obtaining the airflow intensity by the sensor integrated device is as follows: the sensor integrated device has a circular air hole, and the sensor integrated device further has a spherical circuit board and a suspended object inside, and the spherical circuit board covers the sensor. In the area other than the circular air hole in the surface, the suspended object is suspended in the fixed position A inside the sensor when there is no airflow into the intelligent terminal, and the method for ensuring that the suspended object is suspended inside the sensor integrated device is to set a magnet on the suspended object, and the sensor integrated device A magnet is also arranged inside, and the suspended object can be suspended due to the repulsive force of the magnetic pole between the magnets; when there is airflow through the intelligent terminal, the airflow will enter the inside of the sensor through the circular air hole of the sensor integrated device, and the suspended object is subjected to the airflow. Pushing the movement inside the sensor will touch the spherical circuit board. The position of the touch point is B. According to position B and position A, it can be judged that the direction of the air flow can be expressed as A to B, and at the same time, according to position B and position A. The time period between changes, while also calculating the strong airflow Duration and data flow.
接着,获取预设的第一气流的参数数据,在采集第二气流完成后,获取因气流变化而生成的第二气流的参数数据。Then, the parameter data of the preset first airflow is acquired, and after the second airflow is collected, the parameter data of the second airflow generated due to the airflow change is acquired.
具体地,智能终端的传感器集成设备实时监测智能终端的气流,当监测到产生第二气流时,传感器集成设备通过检测和分析接口将因第二气流变化而生成的第二气流参数数据发送给智能终端的操作系统,再由该操作系统通过检测和分析接口将第二气流参数数据发送给智能终端的存储设备并存储。Specifically, the sensor integrated device of the smart terminal monitors the airflow of the smart terminal in real time, and when the second airflow is detected, the sensor integrated device sends the second airflow parameter data generated by the second airflow change to the smart through the detection and analysis interface. The operating system of the terminal, and the operating system sends the second airflow parameter data to the storage device of the smart terminal through the detection and analysis interface and stores the data.
读取第一气流参数数据和第二气流参数数据;其中,该第一气流参数数据指的是智能终端中预设的第一气气流参数数据,第一气流参数数据能够包括气流强度和气流持续时间中至少一个。该第二气流参数数据指的是指智能终端在显示一对话框时,通过智能终端的传感器集成设备实时监测到的一当前气流,该第二气流参数数据包括气流强度和气流持续时间中至少一个。Reading the first airflow parameter data and the second airflow parameter data; wherein the first airflow parameter data refers to the first airflow parameter data preset in the smart terminal, and the first airflow parameter data can include the airflow intensity and the airflow duration At least one of the time. The second airflow parameter data refers to a current airflow that is detected by the smart terminal in real time through the sensor integrated device of the smart terminal when displaying a dialog box, and the second airflow parameter data includes at least one of airflow intensity and airflow duration. .
在获取第一气流参数数据和第二气流参数数据的时,由于气流中时常夹杂着一些干扰信息,因此智能终端的传感器集成设备在采集第一气流参数数据和第二气流参数数据的时,设置有过滤除去该干扰信息的措施。When the first airflow parameter data and the second airflow parameter data are acquired, since the interference information is often mixed in the airflow, the sensor integrated device of the smart terminal sets the first airflow parameter data and the second airflow parameter data when collecting There are measures to filter out the interference information.
优选地,例如,用户在说话时,会发出具有人类发声特色的声音,而自然风流动时产生的声音极为微小,且其声色区别于人类发声(包括机械类声音),设置于该智能终端的传感器集成设备会采集到距离其较近的声音,并采集到自然风流动时的声音,由此,通过在识别出该声音参数中声色类型为自然风声音或机械类声音时,屏蔽当前气流对该电子设备产生的影响,不对当前气流进行获取及检测;相反的,若在识别出该声音参数中的声色类型为人类声音时,确定当前吹向智能终端的气流为用户说话或呼气(吹气)产生的 气流,此时对当前气流对应的目标气流参数数据进行采集和检测。Preferably, for example, when the user speaks, a sound having a human vocal characteristic is emitted, and the sound generated when the natural wind flows is extremely small, and the sound color is different from the human vocalization (including mechanical sound), and is set in the smart terminal. The sensor integrated device collects the sound closer to it and collects the sound when the natural wind flows, thereby shielding the current airflow pair by identifying the sound color type as the natural wind sound or the mechanical sound when the sound parameter is recognized. The influence generated by the electronic device does not acquire and detect the current airflow; on the contrary, if the sound color type in the sound parameter is recognized as a human voice, it is determined that the current airflow directed to the smart terminal speaks or exhales for the user (blowing Produced by gas Airflow, at this time, the target airflow parameter data corresponding to the current airflow is collected and detected.
由此,在实际生活中,自然风在流经该电子设备时的声音及机械类声音的音色均区别于人类发声,由此,本实施例在该传感器集成设备获取气流参数数据的同时,利用该传感器集成设备同时获取声音参数,通过识别声音参数中的声色类型区分出目标气流的属性,是用户产生的,还是自然风或其他气流类型,既而屏蔽外界如自然风等气流对电子设备中气流控制的干扰。Therefore, in actual life, the sound of the natural wind when flowing through the electronic device and the sound of the mechanical sound are different from the human voice, and thus, the present embodiment uses the airflow parameter data while the sensor integrated device acquires The sensor integrated device simultaneously acquires sound parameters, and distinguishes the attribute of the target airflow by identifying the type of sound color in the sound parameter, which is generated by the user, or is it natural wind or other airflow type, and shields the airflow in the electronic device from the outside air such as natural wind. Controlled interference.
步骤104:解析所述第二气流样本,形成一第二参数数据;Step 104: Parsing the second airflow sample to form a second parameter data.
步骤105:比较所述第二参数数据与所述第一参数数据,当所述第二参数数据匹配所述第一参数数据时,对所述对话框执行所述操作动作;Step 105: Compare the second parameter data with the first parameter data, and when the second parameter data matches the first parameter data, perform the operation action on the dialog box;
在本发明的一个实施例中,进入智能终端的气流包括两种情况,一种是用户吹气产生的气流,一种是空气流动产生的气流,而智能终端只在用户吹气产生的气流的情况下执行取消操作,对于空气流动产生的气流则不需要执行取消操作,步骤102中虽然设置有传感器集成设备能够过滤除去自然风的气流,但为了保证精确性,如果仅将预设的阈值与气流参数数据比较,根据比较结果决定是否执行取消操作,将无法区分用户吹气产生的气流和空气流动产生的气流,从而导致取消操作的错误率和不确定性,容易造成误操作。区别用户吹气产生的气流和空气流动产生的气流时,需要根据气流参数数据判断气流是否是因为在朝向智能终端吹气而产生的,在朝向智能终端吹气产生气流时,是智能终端所处环境中空气流动时无法产生的,因此可以基于该原理将用户吹气产生的气流和空气流动产生的气流区分开,实现当用户在吹气解锁位置向智能终端吹气时,智能终端能够准确地取消对话框。In an embodiment of the present invention, the airflow entering the smart terminal includes two situations, one is a flow generated by a user's air blow, and the other is a flow generated by the air flow, and the smart terminal only generates airflow generated by the user. In the case of performing the canceling operation, the airflow generated by the air flow does not need to perform the canceling operation, and in step 102, although the sensor integrated device is provided to filter and remove the natural wind airflow, in order to ensure accuracy, if only the preset threshold is The comparison of the airflow parameter data determines whether to perform the cancel operation according to the comparison result, and it is impossible to distinguish the airflow generated by the user's air blow and the airflow generated by the air flow, thereby causing the error rate and uncertainty of canceling the operation, and easily causing misoperation. When distinguishing the airflow generated by the user's air blow and the airflow generated by the air flow, it is necessary to determine whether the airflow is generated by blowing air toward the smart terminal according to the airflow parameter data, and when the airflow is generated toward the smart terminal, the smart terminal is located. The air in the environment cannot be generated when the air flows, so the airflow generated by the user's air blow can be distinguished from the airflow generated by the air flow based on the principle, so that the smart terminal can accurately accurately when the user blows the air to the smart terminal in the blow-off unlocked position. Cancel the dialog.
执行该取消操作包含从智能终端的操作系统接收到传感器集成设备存储的第一气流参数数据和检测分析的第二气流参数数据后,计算第一气流参数数据与第二气流参数数据的差值,将计算得到的差值与预设阈值进行比较,若该第一气流参数数据与该第二气流参数数据的差值大于或等于预设阈值,执行取消操作;若第一气流参数数据与第二气流参数数据的差值小于预设阈值,不执行取消操作。The performing the canceling operation includes: after receiving the first airflow parameter data stored by the sensor integrated device and the second airflow parameter data stored and detected by the operating system of the smart terminal, calculating a difference between the first airflow parameter data and the second airflow parameter data, Comparing the calculated difference with the preset threshold, if the difference between the first airflow parameter data and the second airflow parameter data is greater than or equal to a preset threshold, performing a cancel operation; if the first airflow parameter data and the second The difference between the airflow parameter data is less than the preset threshold, and the cancel operation is not performed.
其中,第一气流参数数据与第二气流参数数据的差值为:第一气流的气流强度减去第二气流的气流强度,和/或,第一气流的气流持续时间减去第二气流的气流持续时间。The difference between the first airflow parameter data and the second airflow parameter data is: the airflow intensity of the first airflow minus the airflow intensity of the second airflow, and/or the airflow duration of the first airflow minus the second airflow. Airflow duration.
现在将参考附图描述实现本发明各个实施例的智能终端。在后续的描述中,使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明的说明,其本身并没有特定的意义。因此,“模块”与“部件”可以混合地使用。 An intelligent terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.
在本发明的描述中,除非另有规定和限定,需要说明的是,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是机械连接或电连接,也可以是两个元件内部的连通,可以是直接相连,也可以通过中间媒介间接相连,对于本领域的普通技术人员而言,可以根据具体情况理解上述术语的具体含义。In the description of the present invention, unless otherwise specified and limited, it should be noted that the terms "mounted", "connected", and "connected" are to be understood broadly, and may be, for example, mechanical or electrical, or both. The internal communication of the components may be directly connected or indirectly connected through an intermediate medium. For those skilled in the art, the specific meanings of the above terms may be understood according to specific circumstances.
应当理解,尽管在本公开可能采用术语第一、第二、第三等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本公开范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。取决于语境,如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, the first information may also be referred to as second information without departing from the scope of the present disclosure. Similarly, the second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to determination."
参阅图6-9,为符合本发明智能终端内对话框的操作装置,可以通过一操作装置10实现,在该操作装置10内,包括:存储模块20、关联模块30、采集模块40、检测模块50、执行模块60。Referring to FIG. 6-9, the operating device for the dialog box in the smart terminal according to the present invention may be implemented by an operating device 10, including: a storage module 20, an association module 30, an acquisition module 40, and a detection module. 50. Execution module 60.
存储模块20:Storage module 20:
关联模块30:Association module 30:
本发明的一个实施例中,预设第一气流的参数信息,例如能够通过麦克风获取生成的气流参数数据即可。当利用麦克风来检测气流参数时,麦克风捕捉气流变化产生的声音,此时气流参数为麦克风将捕捉到的声音转换后的电信号,该第一气流参数需满足的条件可以为电信号的振幅的预设大小和/或根据电信号获得的声源的预设位置。还可以根据获得的第一气流参数进一步获得气流变化的移动方向或移动路径。In an embodiment of the present invention, the parameter information of the first airflow is preset, for example, the generated airflow parameter data can be acquired through a microphone. When the microphone is used to detect the airflow parameter, the microphone captures the sound generated by the airflow change. At this time, the airflow parameter is the electric signal converted by the sound captured by the microphone, and the condition that the first airflow parameter needs to satisfy may be the amplitude of the electrical signal. The preset size and/or the preset position of the sound source obtained from the electrical signal. It is also possible to further obtain a moving direction or a moving path of the airflow change according to the obtained first airflow parameter.
具体地,预设的第一气流参数数据能够通过如下方法比较后获得,采集单元将该相对温度数据通过一传感器获得并发送至该智能终端,解析单元将该智能终端还被配置为:接收该气流参数数据、该相对温度数据。该气流参数数据为具有变化量的人体、环境等特征形成的数据,包括:普通噪声数据、心跳数据、用户吹气数据以及意外噪声数据。相对温度数据为贴近人体时产生的温度变化形成的数据,主要包括:实时检测获得的人体的体表温度;体表温度的不同会对吹气的检测有影响,因此需要通过体表温度校正过滤时所用算法的滤波系数,完善多级过滤的算法。第一噪声过滤为对普通噪声数据的滤除,采用系列滤波的方式,过滤后得到吹气向量数据;吹气向量数据为具有较为明显方向的向量数据(如:吹气、心跳均具有明显的幅值以及频率)。用户基础数据为用户录入的具有特定指向性的数据;特定指向性是指不同的用户基础数据对应不同设定特征的幅值及频率范围(在算法中表现为滤波系数的不同)。相似过滤为对心跳数据的滤除,采用理论、 实际的幅值及频率比对的方式;由于心跳以及吹气的幅值及频率较为近似,因此采用比对方式确定哪些是心跳的幅值及频率,并针对性的将其滤除,剩下的特征数据中必然包括用户吹气数据。Specifically, the preset first airflow parameter data can be obtained by comparing, the acquisition unit obtains and sends the relative temperature data to the smart terminal by using a sensor, and the parsing unit further configures the smart terminal to: receive the Airflow parameter data, the relative temperature data. The airflow parameter data is data formed by characteristics such as a human body and an environment having a variation, and includes: general noise data, heartbeat data, user air blowing data, and accidental noise data. The relative temperature data is the data formed by the temperature change generated when close to the human body, mainly including: the body surface temperature of the human body obtained by real-time detection; the difference of the body surface temperature has an influence on the detection of the insufflation, so it is necessary to filter through the body surface temperature correction. The filter coefficients of the algorithm used at the time to perfect the multi-level filtering algorithm. The first noise filtering is the filtering of common noise data, and the series filtering method is adopted, and the air blowing vector data is obtained after filtering; the air blowing vector data is vector data with a relatively obvious direction (for example, air blowing and heartbeat are obvious). Amplitude and frequency). The user-based data is data with specific directivity entered by the user; the specific directivity refers to the amplitude and frequency range of different user-based data corresponding to different set features (in the algorithm, the difference in filter coefficients). Similar filtering is the filtering of heartbeat data, using theory, The actual amplitude and frequency comparison method; because the amplitude and frequency of the heartbeat and insufflation are similar, use the comparison method to determine which is the amplitude and frequency of the heartbeat, and filter it out in a targeted manner. The characteristic data of the user must include the user's insufflation data.
通讯单元使该第一气流参数数据能够通过云端服务器获取或者直接存储于智能终端内置的芯片内,也就是说,下载单元能够从云端服务器或者直接调取该信息。The communication unit enables the first airflow parameter data to be acquired by the cloud server or directly stored in the chip built in the smart terminal, that is, the download unit can directly retrieve the information from the cloud server.
采集模块40:Acquisition module 40:
检测模块50:Detection module 50:
本发明的一个实施例中,智能终端在应用程序中需要提示一对话框的时,通过一对话框的弹出机制在智能终端的显示区域中提示一对话框,该对话框中显示有一提示用户进行操作。In an embodiment of the present invention, when the smart terminal needs to prompt a dialog box in the application, the pop-up mechanism of a dialog box prompts a dialog box in the display area of the smart terminal, and the dialog box displays a prompting user to perform the dialog box. operating.
提示单元提示该对话框的同时,通过传感器集成设备获取用户的第二吹气气流数据,为了避免环境噪音对采集检测过程带来干扰,以提高吹气中的气流检测和分类的准确性,本发明实施例在使用传感器集成设备中的采集设备例如,(麦克风)采集用户的气流数据之后,首先通过低通滤波对采集的气流数据进行去噪处理,消除环境噪音对原始信号的影响,然后,从过滤后的气流数据中查找吸气数据,因为噪音通常发生在吸气阶段,因此需要准确地从气流数据中找出吸气声源和吹气声源,从而确定吸气数据的开始时间与结束时间。最后,选取预设时间段的吸气数据的流量曲线,对该流量曲线的特征参数进行分析计算,实现对的检测与分类。The prompting unit prompts the dialog box to obtain the second blowing airflow data of the user through the sensor integrated device, in order to avoid interference of the environmental noise on the collection and detection process, so as to improve the accuracy of airflow detection and classification in the air blowing, In the embodiment of the present invention, after collecting the airflow data of the user by using the acquisition device in the sensor integrated device, for example, (microphone), the collected airflow data is first denoised by low-pass filtering to eliminate the influence of the environmental noise on the original signal, and then, Find the inspiratory data from the filtered airflow data, because the noise usually occurs in the inhalation phase, so it is necessary to accurately find the inspiratory sound source and the insufflation sound source from the airflow data to determine the start time of the inhalation data and End Time. Finally, the flow curve of the inspiratory data of the preset time period is selected, and the characteristic parameters of the flow curve are analyzed and calculated to realize the detection and classification of the pair.
具体地,在提示对话框的同时,控制单元控制传感器集成设备实时监测智能终端的气流,当监测到朝向智能终端有吹气并产生第二气流时,传感器集成设备采集该吹气的气流并通过检测分析后存储该气流的强度;该传感器集成设备中包括一个以上传感器,传感器在智能终端中的位置以及传感器的个数都可以根据不同的智能终端的内部或外部结构进行设置或调整;例如,可以设置在智能终端麦克风位置的附近。Specifically, while the prompt dialog box is displayed, the control unit controls the sensor integrated device to monitor the airflow of the smart terminal in real time, and when it is detected that the airflow is blown toward the smart terminal and the second airflow is generated, the sensor integrated device collects the airflow of the blow air and passes the airflow. The intensity of the airflow is stored after the analysis and analysis; the sensor integrated device includes more than one sensor, and the position of the sensor in the smart terminal and the number of sensors can be set or adjusted according to internal or external structures of different smart terminals; for example, It can be placed near the microphone position of the smart terminal.
可选地,本发明的一个实施例可以存储的第一气流的参数数据可以包括一气流的强度数据,如下是一种该传感器集成设备获取气流强度的方法为:监测单元使该传感器集成设备有圆形气孔,传感器集成设备内部还设有一个球形电路板和一个悬浮物体,球形电路板覆盖在传感器内表面中除圆形气孔外的区域,悬浮物体在没有气流进入智能终端时悬浮在传感器内部的固定位置A,保证悬浮物体悬浮在传感器集成设备内部的方法为在悬浮物体上设置磁铁,传感器集成设备内部也设置一个磁铁,悬浮物体就可以由于磁铁间磁极的排斥力而悬浮起来;当有气流通过智能终端时,气流将通过传感器集成设备 的圆形气孔进入到传感器内部,悬浮物体因为受到气流的推动在传感器内移动,将触碰到球形电路板上,触碰点的位置为B,根据位置B和位置A可以判断出气流的方向可以表示为A到B,同时,根据位置B和位置A之间变化的时间段,同时还能计算出气流的强度数据和气流的持续时间。Optionally, the parameter data of the first airflow that can be stored in an embodiment of the present invention may include the intensity data of the airflow. The method for obtaining the airflow intensity by the sensor integrated device is as follows: the monitoring unit makes the sensor integrated device have The circular air hole, the sensor integrated device also has a spherical circuit board and a suspended object inside. The spherical circuit board covers the area of the inner surface of the sensor except the circular air hole, and the suspended object is suspended inside the sensor when no airflow enters the intelligent terminal. The fixed position A ensures that the suspended object is suspended inside the sensor integrated device by placing a magnet on the suspended object, and a magnet is also arranged inside the sensor integrated device, and the suspended object can be suspended due to the repulsive force between the magnetic poles of the magnet; When the airflow passes through the intelligent terminal, the airflow will pass through the sensor integrated device The circular air hole enters the inside of the sensor, and the suspended object moves inside the sensor due to the airflow, and will touch the spherical circuit board. The position of the touch point is B. According to the position B and the position A, the direction of the airflow can be judged. It can be expressed as A to B, and at the same time, according to the time period between the position B and the position A, the intensity data of the airflow and the duration of the airflow can be calculated at the same time.
接着,获取预设的第一气流的参数数据,在采集第二气流完成后,获取因气流变化而生成的第二气流的参数数据。Then, the parameter data of the preset first airflow is acquired, and after the second airflow is collected, the parameter data of the second airflow generated due to the airflow change is acquired.
具体地,智能终端的传感器集成设备实时监测智能终端的气流,当监测到产生第二气流时,传感器集成设备通过检测和分析接口将因第二气流变化而生成的第二气流参数数据发送给智能终端的操作系统,再由该操作系统通过检测和分析接口将第二气流参数数据发送给智能终端的存储设备并存储。Specifically, the sensor integrated device of the smart terminal monitors the airflow of the smart terminal in real time, and when the second airflow is detected, the sensor integrated device sends the second airflow parameter data generated by the second airflow change to the smart through the detection and analysis interface. The operating system of the terminal, and the operating system sends the second airflow parameter data to the storage device of the smart terminal through the detection and analysis interface and stores the data.
读取第一气流参数数据和第二气流参数数据;其中,该第一气流参数数据指的是智能终端中预设的第一气气流参数数据,第一气流参数数据能够包括气流强度和气流持续时间中至少一个。该第二气流参数数据指的是指智能终端在显示一对话框时,通过智能终端的传感器集成设备实时监测到的一当前气流,该第二气流参数数据包括气流强度和气流持续时间中至少一个。Reading the first airflow parameter data and the second airflow parameter data; wherein the first airflow parameter data refers to the first airflow parameter data preset in the smart terminal, and the first airflow parameter data can include the airflow intensity and the airflow duration At least one of the time. The second airflow parameter data refers to a current airflow that is detected by the smart terminal in real time through the sensor integrated device of the smart terminal when displaying a dialog box, and the second airflow parameter data includes at least one of airflow intensity and airflow duration. .
在获取第一气流参数数据和第二气流参数数据的时,由于气流中时常夹杂着一些干扰信息,因此智能终端的传感器集成设备在采集第一气流参数数据和第二气流参数数据的时,设置有过滤除去该干扰信息的措施。When the first airflow parameter data and the second airflow parameter data are acquired, since the interference information is often mixed in the airflow, the sensor integrated device of the smart terminal sets the first airflow parameter data and the second airflow parameter data when collecting There are measures to filter out the interference information.
优选地,例如,用户在说话时,会发出具有人类发声特色的声音,而自然风流动时产生的声音极为微小,且其声色区别于人类发声(包括机械类声音),设置于该智能终端的传感器集成设备会采集到距离其较近的声音,并采集到自然风流动时的声音,由此,通过在识别出该声音参数中声色类型为自然风声音或机械类声音时,屏蔽当前气流对该电子设备产生的影响,不对当前气流进行获取及检测;相反的,若在识别出该声音参数中的声色类型为人类声音时,确定当前吹向智能终端的气流为用户说话或呼气(吹气)产生的气流,此时对当前气流对应的目标气流参数数据进行采集和检测。Preferably, for example, when the user speaks, a sound having a human vocal characteristic is emitted, and the sound generated when the natural wind flows is extremely small, and the sound color is different from the human vocalization (including mechanical sound), and is set in the smart terminal. The sensor integrated device collects the sound closer to it and collects the sound when the natural wind flows, thereby shielding the current airflow pair by identifying the sound color type as the natural wind sound or the mechanical sound when the sound parameter is recognized. The influence generated by the electronic device does not acquire and detect the current airflow; on the contrary, if the sound color type in the sound parameter is recognized as a human voice, it is determined that the current airflow directed to the smart terminal speaks or exhales for the user (blowing The airflow generated by the gas is collected and detected at the target airflow parameter data corresponding to the current airflow.
由此,在实际生活中,自然风在流经该电子设备时的声音及机械类声音的音色均区别于人类发声,由此,本实施例在该传感器集成设备获取气流参数数据的同时,利用该传感器集成设备同时获取声音参数,通过识别声音参数中的声色类型区分出目标气流的属性,是用户产生的,还是自然风或其他气流类型,既而屏蔽外界如自然风等气流对电子设备中气流控制的干扰。 Therefore, in actual life, the sound of the natural wind when flowing through the electronic device and the sound of the mechanical sound are different from the human voice, and thus, the present embodiment uses the airflow parameter data while the sensor integrated device acquires The sensor integrated device simultaneously acquires sound parameters, and distinguishes the attribute of the target airflow by identifying the type of sound color in the sound parameter, which is generated by the user, or is it natural wind or other airflow type, and shields the airflow in the electronic device from the outside air such as natural wind. Controlled interference.
执行模块60:Execution module 60:
在本发明的一个实施例中,进入智能终端的气流包括两种情况,一种是用户吹气产生的气流,一种是空气流动产生的气流,而智能终端只在用户吹气产生的气流的情况下执行取消操作,对于空气流动产生的气流则不需要执行取消操作,虽然设置有传感器集成设备能够过滤除去自然风的气流,但为了保证精确性,如果仅将预设的阈值与气流参数数据比较,根据比较结果决定是否执行取消操作,将无法区分用户吹气产生的气流和空气流动产生的气流,从而导致取消操作的错误率和不确定性,容易造成误操作。分析单元在区别用户吹气产生的气流和空气流动产生的气流时,需要根据气流参数数据判断气流是否是因为在朝向智能终端吹气而产生的,在朝向智能终端吹气产生气流时,是智能终端所处环境中空气流动时无法产生的,因此可以基于该原理将用户吹气产生的气流和空气流动产生的气流区分开,实现当用户在吹气解锁位置向智能终端吹气时,智能终端能够准确地取消对话框。In an embodiment of the present invention, the airflow entering the smart terminal includes two situations, one is a flow generated by a user's air blow, and the other is a flow generated by the air flow, and the smart terminal only generates airflow generated by the user. In the case of cancel operation, the airflow generated by the air flow does not need to be canceled. Although the sensor integrated device is provided to filter out the natural wind airflow, in order to ensure accuracy, only the preset threshold and airflow parameter data are used. Comparison, according to the comparison result to decide whether to perform the cancel operation, it will be impossible to distinguish the airflow generated by the user's air blow and the airflow generated by the air flow, thereby causing the error rate and uncertainty of canceling the operation, and easily causing misoperation. When the analysis unit distinguishes the airflow generated by the user's air blow and the airflow generated by the air flow, it is necessary to determine whether the airflow is generated by blowing air toward the smart terminal according to the airflow parameter data, and is intelligent when blowing air toward the smart terminal to generate airflow. The air in the environment in which the terminal is located cannot be generated when the air flows. Therefore, based on the principle, the airflow generated by the user's air blow can be distinguished from the airflow generated by the air flow, so that when the user blows the air to the smart terminal in the air blowing unlocking position, the smart terminal Can cancel the dialog accurately.
执行单元执行该取消操作包含从智能终端的操作系统接收到传感器集成设备存储的第一气流参数数据和检测分析的第二气流参数数据后,计算第一气流参数数据与第二气流参数数据的差值,将计算得到的差值与预设阈值进行比较,若该第一气流参数数据与该第二气流参数数据的差值大于或等于预设阈值,执行取消操作;若第一气流参数数据与第二气流参数数据的差值小于预设阈值,不执行取消操作。The performing unit performs the canceling operation, after receiving the first airflow parameter data stored by the sensor integrated device from the operating system of the smart terminal and detecting the second airflow parameter data analyzed, calculating a difference between the first airflow parameter data and the second airflow parameter data. a value, comparing the calculated difference with a preset threshold, if the difference between the first airflow parameter data and the second airflow parameter data is greater than or equal to a preset threshold, performing a cancel operation; if the first airflow parameter data and The difference between the second airflow parameter data is less than a preset threshold, and the cancel operation is not performed.
其中,第一气流参数数据与第二气流参数数据的差值为:第一气流的气流强度减去第二气流的气流强度,和/或,第一气流的气流持续时间减去第二气流的气流持续时间。The difference between the first airflow parameter data and the second airflow parameter data is: the airflow intensity of the first airflow minus the airflow intensity of the second airflow, and/or the airflow duration of the first airflow minus the second airflow. Airflow duration.
此外,本发明实施例还提供一种计算机可读存储介质,其内存储有计算机可执行指令,上述的计算机可读存储介质例如为非易失性存储器例如光盘、硬盘、或者闪存。上述的计算机可执行指令用于让计算机或者类似的运算装置完成上述的对话框的操作方法中的各种操作。In addition, an embodiment of the present invention further provides a computer readable storage medium having stored therein computer executable instructions, such as a non-volatile memory such as an optical disk, a hard disk, or a flash memory. The above computer executable instructions are for causing a computer or the like to perform various operations in the above-described operation method of the dialog box.
本技术领域技术人员可以理解,本发明包括涉及用于执行本申请中所述操作中的一项或多项的设备。这些设备可以为所需的目的而专门设计和制造,或者也可以包括通用计算机中的己知设备。这些设备具有存储在其内的计算机程序,这些计算机程序选择性地激活或重构。这样的计算机程序可以被存储在设备(例如,计算机)可读介质中或者存储在适于存储电子指令并分别藕联到总线的任何类型的介质中,所述计算机可读介质包括但不限于任何类型的盘(包括软盘、硬盘、光盘、CD-ROM、和磁光盘),ROM(Read-Only Memory,只读存储器),RAM(Random Access Memory,随即存储器),EPROM(Erasable  Programmable Read-Only Memory,可擦写可编程只读存储器),EEPROM(Electrically Erasable Programmable Read-Only Memory,电可擦可编程只读存储器)、闪存、磁性卡片或光线卡片。也就是,可读介质包括由设备(例如,计算机)以能够读的形式存储或传输信息的任何介质。Those skilled in the art will appreciate that the present invention includes apparatus related to performing one or more of the operations described herein. These devices may be specially designed and manufactured for the required purposes, or may also include known devices in a general purpose computer. These devices have computer programs stored therein that are selectively activated or reconfigured. Such computer programs may be stored in a device (eg, computer) readable medium or in any type of medium suitable for storing electronic instructions and separately coupled to a bus, including but not limited to any Types of disks (including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable) Programmable Read-Only Memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card or light card. That is, a readable medium includes any medium that is stored or transmitted by a device (eg, a computer) in a readable form.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples.
应当注意的是,本发明的实施例有较佳的实施性,且并非对本发明作任何形式的限制,任何熟悉该领域的技术人员可能利用上述揭示的技术内容变更或修饰为等同的有效实施例,但凡未脱离本发明技术方案的内容,依据本发明的技术实质对以上实施例所作的任何修改或等同变化及修饰,均仍属于本发明技术方案的范围内。 It should be noted that the embodiments of the present invention are preferred embodiments, and are not intended to limit the scope of the present invention. Any one skilled in the art may use the above-disclosed technical contents to change or modify the equivalent embodiments. Any modification or equivalent changes and modifications of the above embodiments in accordance with the technical spirit of the present invention are still within the scope of the technical solutions of the present invention.

Claims (10)

  1. 一种智能终端内对话框的操作方法,其特征在于,所述操作方法包括:A method for operating a dialog box in a smart terminal, characterized in that the operation method comprises:
    于所述智能终端内存储一与一第一气流样本对应的第一参数数据;And storing, in the smart terminal, first parameter data corresponding to a first airflow sample;
    将所述第一气流样本与一操作动作关联;Associating the first airflow sample with an operational action;
    当所述智能终端的显示区域显示一对话框时,采集一吹向所述智能终端的第二气流样本;When the display area of the smart terminal displays a dialog box, collecting a second airflow sample that is blown to the smart terminal;
    解析所述第二气流样本,形成一第二参数数据;Parsing the second airflow sample to form a second parameter data;
    比较所述第二参数数据与所述第一参数数据,当所述第二参数数据匹配所述第一参数数据时,对所述对话框执行所述操作动作。Comparing the second parameter data with the first parameter data, and when the second parameter data matches the first parameter data, performing the operation action on the dialog box.
  2. 如权利要求1所述的操作方法,其特征在于,于所述智能终端内存储一第一气流的第一参数数据的步骤包括,包括:The operating method according to claim 1, wherein the step of storing the first parameter data of the first airflow in the smart terminal comprises:
    采集一第一气流样本;Collecting a first airflow sample;
    解析所述第一气流样本,形成所述第一参数数据,其中所述第一参数数据包含气流的强度和气流的持续时间中的一种或多种;或Parsing the first airflow sample to form the first parameter data, wherein the first parameter data includes one or more of an intensity of a gas flow and a duration of a gas flow; or
    所述智能终端与一云端服务器通讯连接;The smart terminal is in communication connection with a cloud server;
    下载所述第一参数数据并存储。The first parameter data is downloaded and stored.
  3. 如权利要求1所述的操作方法,其特征在于,当所述智能终端的显示区域显示一对话框时,采集一吹向所述智能终端的第二气流样本,包括:The operating method according to claim 1, wherein when the display area of the smart terminal displays a dialog box, collecting a second airflow sample that is blown to the smart terminal comprises:
    所述智能终端在完成执行一操作过程中需要提示一对话框时,在所述智能终端的显示区域中提示一对话框;When the smart terminal needs to prompt a dialog box during the execution of an operation, the smart terminal prompts a dialog box in the display area of the smart terminal;
    所述对话框中显示一提示用户进行操作的信息。A message prompting the user to perform an operation is displayed in the dialog box.
  4. 如权利要求1所述的操作方法,其特征在于,当所述智能终端的显示区域显示一对话框时,采集一吹向所述智能终端的第二气流样本,包括:The operating method according to claim 1, wherein when the display area of the smart terminal displays a dialog box, collecting a second airflow sample that is blown to the smart terminal comprises:
    在所述智能终端的显示区域显示所述对话框时,启动一气流检测设备;When the dialog box is displayed in the display area of the smart terminal, an airflow detecting device is activated;
    根据所述气流检测设备监测吹向所述智能终端的所述第二气流样本。The second airflow sample blown to the smart terminal is monitored according to the airflow detecting device.
  5. 如权利要求1所述的操作方法,其特征在于,比较所述第二参数数据与所述第一参数数据,当所述第二参数数据匹配所述第一参数数据时,对所述对话框执行所述操作动作的步骤包括: The operating method according to claim 1, wherein the second parameter data is compared with the first parameter data, and when the second parameter data matches the first parameter data, the dialog box is The steps of performing the operation actions include:
    计算所述第二气流参数数据与所述第一气流参数数据的差值;Calculating a difference between the second airflow parameter data and the first airflow parameter data;
    当所述差值为正数时,取消所述对话框且关闭其在所述智能终端的显示区域的显示界面;When the difference is a positive number, cancel the dialog box and close its display interface in the display area of the smart terminal;
    当所述差值为负数时,保持所述对话框在所述智能终端的显示区域显示。When the difference is a negative number, the dialog box is kept displayed in the display area of the smart terminal.
  6. 一种智能终端内对话框的操作装置,其特征在于,所述操作装置包括:存储模块、关联模块、采集模块、检测模块、执行模块,其中,An operation device for a dialog box in an intelligent terminal, wherein the operation device comprises: a storage module, an association module, an acquisition module, a detection module, and an execution module, wherein
    所述存储模块,用于于所述智能终端内存储一与第一气流样本对应的第一参数数据;The storage module is configured to store, in the smart terminal, first parameter data corresponding to the first airflow sample;
    所述关联模块,与所述存储模块通讯连接,用于将所述第一气流样本与一操作动作关联;The association module is communicatively coupled to the storage module for associating the first airflow sample with an operational action;
    所述采集模块,与所述存储模块通讯连接,用于当所述智能终端的显示区域显示一对话框时,采集一吹向所述智能终端的第二气流样本;The collecting module is connected to the storage module, and is configured to collect a second airflow sample that is blown to the smart terminal when the display area of the smart terminal displays a dialog box;
    所述检测模块,与所述采集模块通讯连接,用于解析所述第二气流样本,形成一第二参数数据;The detecting module is connected to the collecting module for analyzing the second airflow sample to form a second parameter data;
    所述执行模块,与所述检测模块通讯连接,用于比较所述第二参数数据与所述第一参数数据,当所述第二参数数据匹配所述第一参数数据时,对所述对话框执行所述操作动作。The execution module is in communication with the detection module, configured to compare the second parameter data with the first parameter data, and when the second parameter data matches the first parameter data, the session is The box performs the operational action.
  7. 如权利要求6所述的操作装置,其特征在于,所述存储模块,包括:The operating device according to claim 6, wherein the storage module comprises:
    采集单元,用于采集一第一气流样本;An acquisition unit, configured to collect a first airflow sample;
    解析单元,与所述采集单元通讯连接,用于解析所述第一气流样本,形成所述第一参数数据,其中所述第一参数数据包含气流的强度和气流的持续时间中的一种或多种;a parsing unit, configured to communicate with the collecting unit, configured to parse the first airflow sample to form the first parameter data, wherein the first parameter data includes one of an intensity of a gas flow and a duration of a gas flow or Multiple
    通讯单元,用于与一云端服务器通讯连接,将所述第一参数数据上传至所述云端服务器;a communication unit, configured to communicate with a cloud server, and upload the first parameter data to the cloud server;
    下载单元,与所述云端服务器通讯连接,用于下载所述第一参数数据并通过所述存储单元存储。And a downloading unit, configured to communicate with the cloud server, to download the first parameter data and store the data through the storage unit.
  8. 如权利要求6所述的操作装置,其特征在于,所述采集模块,包括:The operating device according to claim 6, wherein the acquisition module comprises:
    提示单元,用于当所述智能终端在完成执行一操作过程中需要提示一对话框时,在所述智能终端的显示区域中提示一对话框且启动;a prompting unit, configured to prompt a dialog box in the display area of the smart terminal and start when the smart terminal needs to prompt a dialog box during the execution of an operation;
    所述对话框中显示一提示用户进行操作的信息。A message prompting the user to perform an operation is displayed in the dialog box.
  9. 如权利要求6所述的操作装置,其特征在于,所述采集模块,还包括:The operating device according to claim 6, wherein the acquisition module further comprises:
    控制单元,用于在所述智能终端的显示区域显示所述对话框时,启动一气流检测设备; a control unit, configured to start an airflow detecting device when the dialog box is displayed in a display area of the smart terminal;
    监测单元,与所述控制单元通讯连接,用于根据所述气流检测设备监测吹向所述智能终端的所述第二气流样本。And a monitoring unit, in communication with the control unit, configured to monitor the second airflow sample blown to the smart terminal according to the airflow detecting device.
  10. 如权利要求6所述的操作装置,其特征在于,所述执行模块,包括:The operating device according to claim 6, wherein the execution module comprises:
    分析单元,用于计算所述第二气流参数数据与所述第一气流参数数据的差值;An analyzing unit, configured to calculate a difference between the second airflow parameter data and the first airflow parameter data;
    执行单元,与所述分析单元通讯连接,用于当所述差值为正数时,取消所述对话框且关闭其在所述智能终端的显示区域的显示界面;An execution unit, configured to be in communication with the analysis unit, configured to cancel the dialog box and close a display interface of the display area of the smart terminal when the difference is a positive number;
    所述执行单元还用于当所述差值为负数时,保持所述对话框在所述智能终端的显示区域显示。 The execution unit is further configured to keep the dialog box displayed in a display area of the smart terminal when the difference is a negative number.
PCT/CN2017/095649 2017-08-02 2017-08-02 Operation method and operation apparatus for dialog box in smart terminal WO2019023997A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/095649 WO2019023997A1 (en) 2017-08-02 2017-08-02 Operation method and operation apparatus for dialog box in smart terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/095649 WO2019023997A1 (en) 2017-08-02 2017-08-02 Operation method and operation apparatus for dialog box in smart terminal

Publications (1)

Publication Number Publication Date
WO2019023997A1 true WO2019023997A1 (en) 2019-02-07

Family

ID=65232191

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/095649 WO2019023997A1 (en) 2017-08-02 2017-08-02 Operation method and operation apparatus for dialog box in smart terminal

Country Status (1)

Country Link
WO (1) WO2019023997A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150043311A1 (en) * 2013-08-09 2015-02-12 Your Voice S.P.A. Execution of commands in an electronic device
CN105975062A (en) * 2016-04-27 2016-09-28 上海斐讯数据通信技术有限公司 Information viewing system and information viewing method for mobile terminal
CN106095293A (en) * 2016-06-03 2016-11-09 青岛海信移动通信技术股份有限公司 A kind of application operating method and apparatus of mobile device
CN106572252A (en) * 2016-10-28 2017-04-19 上海传英信息技术有限公司 Noncontact intelligent terminal and control method thereof
CN106681489A (en) * 2016-11-16 2017-05-17 珠海格力电器股份有限公司 Device control method, device and electronic device
CN106775355A (en) * 2016-12-28 2017-05-31 珠海市魅族科技有限公司 By gas come the method and system of control terminal equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150043311A1 (en) * 2013-08-09 2015-02-12 Your Voice S.P.A. Execution of commands in an electronic device
CN105975062A (en) * 2016-04-27 2016-09-28 上海斐讯数据通信技术有限公司 Information viewing system and information viewing method for mobile terminal
CN106095293A (en) * 2016-06-03 2016-11-09 青岛海信移动通信技术股份有限公司 A kind of application operating method and apparatus of mobile device
CN106572252A (en) * 2016-10-28 2017-04-19 上海传英信息技术有限公司 Noncontact intelligent terminal and control method thereof
CN106681489A (en) * 2016-11-16 2017-05-17 珠海格力电器股份有限公司 Device control method, device and electronic device
CN106775355A (en) * 2016-12-28 2017-05-31 珠海市魅族科技有限公司 By gas come the method and system of control terminal equipment

Similar Documents

Publication Publication Date Title
KR102576387B1 (en) Sensor devices and systems
US9661068B2 (en) Systems, methods, and computer readable media for sharing environment information
CN110892476A (en) Device with voice command input capability
US10460587B2 (en) Information processing apparatus, information processing method, and program
CN113015915A (en) Method for measuring electromagnetic signals radiated from a device and electronic device thereof
KR20200074445A (en) Method for changing audio signal path according to external electronic device transmitting em signal and electronic device therefor
KR20200086476A (en) Method for estimating electromagnatic signal and an electronic device thereof
CN106782544A (en) Interactive voice equipment and its output intent
CN108335687B (en) Method for detecting beat point of bass drum of audio signal and terminal
US9671300B2 (en) Electronic devices with low-noise pressure sensors
CN109065060B (en) Voice awakening method and terminal
CN110519699B (en) Navigation method and electronic equipment
CN109885162B (en) Vibration method and mobile terminal
US20210358323A1 (en) Musical performance support system and method, and musical instrument management system and method
EP4097992B1 (en) Use of a camera for hearing device algorithm training.
CN104134440B (en) Speech detection method and speech detection device for portable terminal
US20210358462A1 (en) Musical instrument tuner, musical performance support device and musical instrument management device
CN103902002A (en) Power supply managing method and device
WO2021000956A1 (en) Method and apparatus for upgrading intelligent model
CN107454245B (en) Mobile terminal and control method thereof
EP2763380B1 (en) Portable electronic device with improved chemical sampling
WO2019023997A1 (en) Operation method and operation apparatus for dialog box in smart terminal
EP3826009A1 (en) Electronic device and method for controlling the same, and storage medium
US10044506B2 (en) Method for controlling function and an electronic device thereof
WO2012147970A1 (en) Position context acquisition device, computer-readable recording medium on which position context acquisition program is recorded, and position context acquisition method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17919769

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17919769

Country of ref document: EP

Kind code of ref document: A1