CN106919295B - human-computer interaction device and display device - Google Patents
human-computer interaction device and display device Download PDFInfo
- Publication number
- CN106919295B CN106919295B CN201710031248.8A CN201710031248A CN106919295B CN 106919295 B CN106919295 B CN 106919295B CN 201710031248 A CN201710031248 A CN 201710031248A CN 106919295 B CN106919295 B CN 106919295B
- Authority
- CN
- China
- Prior art keywords
- electromagnetic wave
- human
- module
- ultrasonic wave
- wave
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/043—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/046—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by electromagnetic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Electromagnetism (AREA)
- Signal Processing (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
the invention provides a human-computer interaction device and a display device, wherein the human-computer interaction device comprises: the control module is used for controlling the sending module to send the first ultrasonic wave and identify the fingerprint according to the echo signal of the first ultrasonic wave in the fingerprint identification mode, controlling the sending module to send the first electromagnetic wave and identify the gesture according to the echo signal of the first electromagnetic wave in the gesture identification mode, and controlling the sending module to send the second ultrasonic wave carrying the audio data to be transmitted in the audio transmission mode; a transmission module for transmitting at least one of the first ultrasonic wave, the first electromagnetic wave and the second ultrasonic wave under the control of the control module; the receiving module is used for receiving at least one of the echo signal of the first ultrasonic wave and the echo signal of the first electromagnetic wave. This human-computer interaction device integrates high frequency electromagnetic wave touch-control, supersound fingerprint identification and the directional loudspeaker of audio frequency, has reduced the shared space of part, and the cost is reduced has promoted the integrated level, the intelligent degree and the user experience of device effectively.
Description
Technical Field
The invention relates to the field of human-computer interaction, circuits and signal processing, in particular to a human-computer interaction device and a display device.
Background
In the field of human-computer interaction, intelligent terminals are increasingly commonly used. Touch is one of the main input modes of the human-computer interface. The capacitive touch control is widely applied, and a high-frequency electromagnetic wave touch control technology capable of realizing touch control without touching a touch screen is developed aiming at the defects of the touch control mode. Similarly, the currently used capacitive or inductive fingerprint recognition sensors have certain limitations in application, and therefore, an ultrasonic fingerprint recognition technology capable of deeply analyzing fingerprints is developed. In addition, the audio directional loudspeaker produces audible sound with high directivity through the nonlinear interaction of ultrasonic waves in air, which is an improvement over the conventional loudspeaker.
However, in the prior art, the above various improvement schemes are designed separately, the system integration level of the terminal device is low, the space occupied by system components is large, the cost is high, the intelligent degree of the terminal device is not high, and the user experience needs to be improved urgently.
disclosure of Invention
in view of this, the present invention provides a human-computer interaction device and a display device, which can integrate high-frequency electromagnetic wave touch control, ultrasonic fingerprint identification and audio directional speaker, reduce the space occupied by components, effectively reduce the cost, and improve the integration level, the intelligent degree and the user experience of the device.
According to an aspect of the present invention, there is provided a human-computer interaction device, including: the control module is used for controlling the sending module to send the ultrasonic waves and/or the electromagnetic waves corresponding to the modes according to different modes, and identifying an echo reflection source according to echo signals of the ultrasonic waves and/or the electromagnetic waves in at least one mode; the transmitting module is used for transmitting ultrasonic waves and/or electromagnetic waves under the control of the control module; and the receiving module is used for receiving the echo signals of the ultrasonic waves and/or the electromagnetic waves.
Preferably, the modes include: a fingerprint identification mode, a gesture identification mode and an audio transmission mode; the control module controls a sending module to send a first ultrasonic wave and identifies a fingerprint according to an echo signal of the first ultrasonic wave in a fingerprint identification mode, controls the sending module to send a first electromagnetic wave and identifies a gesture according to the echo signal of the first electromagnetic wave in a gesture identification mode, and controls the sending module to send a second ultrasonic wave carrying audio data to be transmitted in an audio transmission mode; the transmitting module is used for transmitting at least one of the first ultrasonic wave, the first electromagnetic wave and the second ultrasonic wave under the control of the control module; the receiving module is used for receiving at least one of the echo signal of the first ultrasonic wave and the echo signal of the first electromagnetic wave.
Preferably, the control module comprises: the mode recognition unit is used for determining the distance between the human hand and the receiving module according to the echo signal of the first electromagnetic wave, enabling the man-machine interaction device to be in a gesture recognition mode under the condition that the distance is larger than a preset value, enabling the man-machine interaction device to be in a fingerprint recognition mode under the condition that the distance is smaller than or equal to the preset value, and enabling the man-machine interaction device to be in an audio transmission mode under the condition that an audio transmission command is received; the driving unit controls the sending module to send the first ultrasonic wave in a fingerprint identification mode, controls the sending module to send the first electromagnetic wave in a gesture identification mode, and controls the sending module to send the second ultrasonic wave according to audio data to be transmitted in an audio transmission mode; and the processing unit is used for identifying a fingerprint according to the echo signal of the first ultrasonic wave in a fingerprint identification mode and identifying a gesture according to the echo signal of the first electromagnetic wave in a gesture identification mode.
Preferably, the control module further comprises: and the instruction generating unit is used for generating a corresponding instruction according to the fingerprint identification result or the gesture identification result of the processing unit.
preferably, the sending module includes: the voltage-controlled oscillator is used for generating the first electromagnetic wave and a third electromagnetic wave for converting into a first ultrasonic wave under the control of the control module; an audio modulator for modulating the audio signal onto a high frequency carrier; a transducer for converting the third electromagnetic wave into the first ultrasonic wave and converting the high frequency carrier wave into the second ultrasonic wave.
Preferably, the receiving module includes: a receiving antenna array for receiving the first ultrasonic wave and the echo signal of the first electromagnetic wave; a transducer for converting an echo signal of the first ultrasonic wave into an electrical signal.
Preferably, the sending module is further configured to send a second electromagnetic wave; the receiving module is further used for receiving an echo signal of the second electromagnetic wave; the driving unit is also used for controlling the sending module to send second electromagnetic waves in an audio transmission mode, and controlling the sending module to send second ultrasonic waves carrying the audio data to be transmitted to the direction of the human ear according to the audio data to be transmitted; the processing unit is also used for determining the direction of the human ear according to the echo signal of the second electromagnetic wave.
Preferably, the sending module includes: a voltage controlled oscillator for generating the first electromagnetic wave, the second electromagnetic wave, and a third electromagnetic wave for conversion into a first ultrasonic wave under the control of the control module; an audio modulator for modulating the audio signal onto a high frequency carrier; a transducer for converting the third electromagnetic wave into the first ultrasonic wave and converting the high-frequency carrier wave into the second ultrasonic wave; and the direction regulator is used for regulating the direction of the transducer under the control of the control module so as to enable the second ultrasonic waves to be transmitted towards the direction of the human ear.
Preferably, the receiving module includes: a receiving antenna array for receiving echo signals of the first ultrasonic wave, the first electromagnetic wave and the second electromagnetic wave; a transducer for converting a reflected signal of the first ultrasonic wave into an electrical signal.
Preferably, a plurality of parallel signal channels are arranged among the control module, the sending module and the receiving module, so that the human-computer interaction device is simultaneously in at least two of the following modes: a fingerprint identification mode; a gesture recognition mode; and an audio transmission mode.
According to another aspect of the present invention, there is provided a display device including: a display panel; according to the human-computer interaction device provided by one aspect of the invention, the sending module and the receiving module are arranged in: two sides of a substrate in the display panel are opposite to each other.
In the embodiment of the invention, the high-frequency electromagnetic wave touch control, the ultrasonic fingerprint identification and the audio directional loudspeaker are integrated, so that the space occupied by components is reduced, the cost is effectively reduced, and the integration level, the intelligent degree and the user experience of the device are improved.
drawings
The above and other objects, features and advantages of the present invention will become more apparent by describing embodiments of the present invention with reference to the following drawings, in which:
FIG. 1 is a schematic diagram of a first structure of a human-computer interaction device according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a second structure of a human-computer interaction device according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a third structure of a human-computer interaction device according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a fourth structure of a human-computer interaction device provided in an embodiment of the invention;
Fig. 5 is a schematic structural diagram of a display device according to an embodiment of the present invention.
Detailed Description
The present invention will be described below based on examples, but the present invention is not limited to only these examples. In the following detailed description of the present invention, certain specific details are set forth. It will be apparent to one skilled in the art that the present invention may be practiced without these specific details. Well-known methods, procedures, and procedures have not been described in detail so as not to obscure the present invention.
fig. 1 is a schematic diagram of a first structure of a human-computer interaction device provided in an embodiment of the present invention, where the human-computer interaction device 100 includes: a control module 101, a sending module 102 and a receiving module 103.
The control module 101 controls the sending module 102 to send a first ultrasonic wave and identify a fingerprint according to an echo signal of the first ultrasonic wave in a fingerprint identification mode, controls the sending module 102 to send a first electromagnetic wave and identify a gesture according to the echo signal of the first electromagnetic wave in a gesture identification mode, and controls the sending module 102 to send a second ultrasonic wave carrying audio data to be transmitted in an audio transmission mode.
The default mode may be a gesture recognition mode, and the control module 101 detects a distance between the finger and the receiving module 103 through an echo signal of the first electromagnetic wave. Maintaining the gesture recognition mode when the distance is larger than a preset value, and entering the fingerprint recognition mode when the distance is smaller than or equal to the preset value. The preset value can be preset by a manufacturer or can be set by a user. The control module 101 may transmit a frequency control signal to the transmission module 102, and control the frequencies of the first ultrasonic wave, the first electromagnetic wave, and the second ultrasonic wave transmitted by the transmission module 102 through the frequency control signal. After receiving the echo signal of the first ultrasonic wave from the receiving module 103, the control module 101 obtains a corresponding fingerprint image according to the difference between the time and the intensity of the echo signal, and extracts feature information from the fingerprint image. The control module 101 compares the extracted feature information with preset feature information and outputs an identification result, thereby completing a fingerprint identification process. After receiving the echo signal of the first electromagnetic wave from the receiving module 103, the control module 101 obtains the shape information and the motion information of the human hand according to the change of the echo signal in the time sequence, and completes gesture recognition. When detecting audio data to be transmitted, the control module 101 controls the transmitting module 102 to generate a high-frequency carrier, modulates the audio data onto the high-frequency carrier, and finally converts the high-frequency carrier into a second ultrasonic wave by the transmitting module 102.
the transmitting module 102 is configured to transmit at least one of the first ultrasonic wave, the first electromagnetic wave, and the second ultrasonic wave under the control of the control module 101.
The transmitting module 102 includes a transducer, and converts the high-frequency electrical signal generated by the circuit into ultrasonic waves to be emitted. Thus, the transmission module 102 can integrate the ultrasonic wave transmission function and the high-frequency electromagnetic wave transmission function.
The receiving module 103 is configured to receive at least one of an echo signal of the first ultrasonic wave and an echo signal of the first electromagnetic wave.
The first ultrasonic wave and the first electromagnetic wave transmitted by the transmitting module 102 may generate an echo signal after reaching a target object, the echo signal may represent form information and/or motion information of the target object through a time sequence and a strength change, and the receiving module 103 may capture the echo signal through an antenna array and transmit the received echo signal to the control module 101.
A plurality of parallel signal channels may be provided between the control module 101, the sending module 102 and the receiving module 103, so that the human-computer interaction device 100 may be in at least two of a fingerprint recognition mode, a gesture recognition mode and an audio transmission mode at the same time.
Fig. 2 is a schematic diagram of a second structure of a human-computer interaction device 200 according to an embodiment of the present invention, where the human-computer interaction device 200 includes: a control module 101, a sending module 102 and a receiving module 103. The control module 101 includes a pattern recognition unit 1011, a driving unit 1012 and a processing unit 1013, the transmitting module 102 includes a voltage-controlled oscillator 1021, an audio modulator 1022 and a transducer 1023, and the receiving module 103 includes a receiving antenna array 1031 and a transducer 1032.
the pattern recognition unit 1011 is connected to the driving unit 1012, the processing unit 1013, and the receiving antenna array 1031, respectively. The mode identification unit 1011 receives the first electromagnetic wave from the receiving antenna array 1031, determines a distance between the human hand and the receiving module 103 according to an echo signal of the first electromagnetic wave, and makes the human-computer interaction device 200 in the gesture identification mode if the distance is greater than a predetermined value, makes the human-computer interaction device 200 in the fingerprint identification mode if the distance is less than or equal to the predetermined value, and makes the human-computer interaction device 200 in the audio transmission mode if an audio transmission command is received. The pattern recognition unit 1011 may transmit an instruction to enter a certain mode to the drive unit 1012 and the processing unit 1013 to set the drive unit 1012 and the processing unit 1013 in the corresponding mode, and the pattern recognition unit 1011 may transmit an instruction to exit a certain mode to the drive unit 1012 and the processing unit 1013 to exit the corresponding mode. The audio transfer command may be an external command, such as a command from an audio processor or a command from a communication module.
in some embodiments, the mode identification unit 1011 may further place the human-computer interaction device 200 in a dual mode of a gesture identification mode and a fingerprint identification mode if the distance is less than or equal to a predetermined value. In these embodiments, a plurality of parallel signal channels may be provided between the control module 101, the sending module 102, and the receiving module 103, so that the human-computer interaction device 200 may simultaneously implement a fingerprint recognition mode, a gesture recognition mode, and an audio transmission mode, or may implement any two of them. The specific mode recognition mode can be preset by a manufacturer for selection by a user, and can also be set by the user.
the driving unit 1012 is connected to a mode identifying unit 1011, a voltage controlled oscillator 1021, and an audio modulator 1022. The driving unit 1012 controls the transmission module 102 to transmit the first ultrasonic wave in the fingerprint recognition mode, the driving unit 1012 controls the transmission module 102 to transmit the first electromagnetic wave in the gesture recognition mode, and the driving unit 1012 controls the transmission module 102 to transmit the second ultrasonic wave according to the audio data to be transmitted in the audio transmission mode. In the fingerprint recognition mode, the driving unit 1012 first controls the voltage-controlled oscillator 1021 to generate a third electromagnetic wave for converting into the first ultrasonic wave, the voltage-controlled oscillator 1021 then transmits the third electromagnetic wave to the transducer 1023 under the control of the driving unit 1012, and finally the transducer 1023 converts the third electromagnetic wave into the first ultrasonic wave and transmits the first ultrasonic wave. The driving unit 1012 controls the voltage controlled oscillator 1021 to generate and transmit the first electromagnetic wave in the gesture recognition mode. In the audio transmission mode, the driving unit 1012 controls the audio modulator 1022 to generate a high-frequency carrier according to the audio data to be transmitted, the audio modulator 1022 loads the audio data to be transmitted onto the high-frequency carrier under the control of the driving unit 1012, transmits the high-frequency carrier loaded with the audio data to be transmitted to the transducer 1023, and finally converts the high-frequency carrier loaded with the audio data to be transmitted into a second ultrasonic wave by the transducer 1023 and transmits the second ultrasonic wave.
in some embodiments, the driving unit 1012 may be in a fingerprint recognition mode, a gesture recognition mode, and an audio transmission mode, or any two of them.
The processing unit 1013 is connected to the pattern recognition unit 1011, the receiving antenna array 1031 and the transducer 1032. The processing unit 1013 recognizes a fingerprint from the echo signal of the first ultrasonic wave in the fingerprint recognition mode, and recognizes a gesture from the echo signal of the first electromagnetic wave in the gesture recognition mode.
the processing unit 1013 obtains an echo signal of the first electromagnetic wave from the receiving antenna array 1031 in the receiving module 103, and an echo signal of the first ultrasonic wave from the transducer 1032 in the receiving module 103. The echo signal of the first ultrasonic wave from the transducer 1032 has been converted into an electrical signal by the transducer 1032, the echo signal of the first ultrasonic wave received by the receiving antenna array 1031 is a mechanical wave, and then the receiving antenna array 1031 transfers the echo signal of the first ultrasonic wave having the mechanical wave property to the transducer 1032, and the echo signal is converted into an electrical signal by the transducer 1032 and provided to the processing unit 1013.
The processing unit 1013 obtains the posture information and the motion information of the human hand according to the time domain information of the echo signal of the first electromagnetic wave, corresponding to the corresponding gesture semantics, where the time domain information may include, but is not limited to, amplitude, frequency, and phase. The processing unit 1013 obtains a fingerprint image according to time domain information of the echo signal of the first ultrasonic wave, where the time domain information may include, but is not limited to, amplitude, frequency, and phase, and then extracts feature information from the fingerprint image, and compares the feature information with feature information in a preset fingerprint library to obtain an identification result, thereby completing fingerprint identification.
The voltage-controlled oscillator 1021 is connected to the driving unit 1012, and generates a first electromagnetic wave and a third electromagnetic wave for conversion into a first ultrasonic wave under the control of the driving unit 1012.
An audio modulator 1022 is connected to the drive unit 1012 for modulating the audio signal onto a high frequency carrier.
The transducer 1023 is connected to the voltage-controlled oscillator 1021 and the audio modulator 1022, and is configured to convert the third electromagnetic wave from the voltage-controlled oscillator 1021 into a first ultrasonic wave, and convert the high-frequency carrier wave loaded with the audio data to be transmitted from the audio modulator 1022 into a second ultrasonic wave.
The receiving antenna array 1031 is connected to the pattern recognition unit 1011, the processing unit 1013, and the transducer 1032, and is configured to receive the first ultrasonic wave and the echo signal of the first electromagnetic wave. The receiving antenna array 1031 may be widely distributed, which is more favorable for collecting the echo signals of the first ultrasonic wave and the first electromagnetic wave, so that the processing unit 1013 can more accurately complete gesture recognition and fingerprint recognition. Furthermore, the receiving antenna array 1031 facilitates the processing unit 1013 to calculate the angle of the motion trajectory of the human hand according to the echo signal of the first electromagnetic wave provided by the processing unit.
The transducer 1032 is connected to the processing unit 1013 and the receiving antenna array 1031, and is configured to convert the echo signal of the first ultrasonic wave from the receiving antenna array 1031 into an electrical signal, and transfer the electrical signal to the processing unit 1013.
Fig. 3 is a third structural schematic diagram of the human-computer interaction device according to the embodiment of the invention, and the human-computer interaction device 300 is different from the human-computer interaction device 200 shown in fig. 2 in the control module 101, and for clarity, only the different parts will be described in detail below.
the control module 101 further comprises an instruction generation unit 1014, the instruction generation unit 1014 being connected with the processing unit 1013. The instruction generating unit 1014 is configured to generate a corresponding instruction according to the fingerprint recognition result or the gesture recognition result of the processing unit 1013. For example, after the processing unit 1013 completes gesture recognition, a corresponding gesture semantic is obtained, the processing unit 1013 provides the gesture semantic to the instruction generating unit 1014, and the instruction generating unit 1014 queries an instruction corresponding to the gesture semantic by a table lookup method according to the gesture semantic. Such a table may be stored in a memory, the contents of which may be set by a user. For fingerprint identification, corresponding instructions can also be generated by looking up a table according to a scene, such as encrypting a file, unlocking a screen locking mode, opening a certain application and the like. The table lookup is only one of the methods for querying the corresponding instruction according to the fingerprint recognition result or the gesture recognition result, and other methods for obtaining the corresponding instruction according to the fingerprint recognition result or the gesture recognition result are all feasible.
fig. 4 is a schematic diagram of a fourth structure of the human-computer interaction device according to the embodiment of the present invention, and the human-computer interaction device 400 is different from the human-computer interaction device 200 shown in fig. 2 in that the driving unit 1012 is further configured to control the sending module 102 to send a second electromagnetic wave in the audio transmission mode, and control the sending module 102 to send a second ultrasonic wave carrying the audio data to be transmitted to the human ear according to the audio data to be transmitted. For the sake of clarity, only the distinctive parts will be described in detail below.
the driving unit 1012 is also connected to a processing unit 1013 and a direction regulator 1024. The driving unit 1012 controls the voltage controlled oscillator 1021 to transmit the second electromagnetic wave. The receiving antenna array 1031 receives the echo signal of the second electromagnetic wave and supplies the echo signal of the second electromagnetic wave to the processing unit 1013. The processing unit 1013 is further configured to determine the direction of the human ear according to the echo signal of the second electromagnetic wave, the processing unit 1013 provides the direction information of the human ear to the driving unit 1012, and the driving unit 1012 controls the direction regulator 1024 to adjust the direction of the transducer 1023 according to the direction information of the human ear so that the second ultrasonic wave is transmitted in the direction of the human ear. There may be no signal transmission between direction controller 1024 and transducer 1023, and direction controller 1024 can adjust itself to drive transducer 1023 to change direction.
In some embodiments, the driving unit 1012 may further control the frequency of the high-frequency carrier generated by the audio modulator 1022 according to the direction information of the human ear, so as to change the frequency of the second ultrasonic wave, so that the self-demodulated second ultrasonic wave reaching the human ear is more comfortable for the human ear.
Fig. 5 is a schematic structural diagram of a display device according to an embodiment of the present invention, where the display device 500 includes: a control module 101, a transmission module 102, a reception module 103, and a substrate 501 in a display panel. The control module 101, the sending module 102 and the receiving module 103 have been described in detail above with reference to fig. 1 to 4, and are not described again here.
The transmitting module 102 and the receiving module 103 may be disposed on the substrate 501, for example, the transmitting module 102 and the receiving module 103 may be disposed on two sides of the substrate 501 opposite to each other. The transmitting module 102 may be disposed below the substrate 501, and the receiving module 103 may be disposed above the substrate 501. But not limited thereto, the transmitting module 102 may be disposed above the substrate 501, and the receiving module 103 may be disposed below the substrate 501. The substrate 501 may be a transparent substrate, the number of the substrates 501 may be set according to the requirement of the display device 500, and when the display device 500 has a plurality of substrates, the transmitting module 102 and the receiving module 103 may be disposed on two opposite sides of any substrate, or may be disposed on two opposite sides of different substrates. A plurality of receiving modules 103 may be provided on the substrate 501 so that echo signals can be received and transmitted better, or only one receiving module 103 may be provided.
the embodiment of the invention integrates high-frequency electromagnetic wave touch control, ultrasonic fingerprint identification and audio directional loudspeaker, reduces the space occupied by components, effectively reduces the cost, and improves the integration level, the intelligent degree and the user experience of the device.
in addition, the embodiment of the invention can switch different modes according to the distance between the human hand and the receiving module, thereby saving energy and being very convenient for users. The embodiment of the invention can also adjust the sending direction of the directional ultrasonic wave containing the audio information according to the position of the human ear, so that the human ear is more comfortable, and the user experience is improved. In display device, set up receiving module and sending module on display panel's base plate, not only promoted visual area and taken up a percentage, also enlarged gesture recognition and fingerprint identification's detection area, can bring better user experience.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. a human-computer interaction device, comprising:
The control module is used for controlling the sending module to send the ultrasonic waves and/or the electromagnetic waves corresponding to the modes according to different modes, and identifying an echo reflection source according to echo signals of the ultrasonic waves and/or the electromagnetic waves in at least one mode;
The transmitting module is used for transmitting ultrasonic waves and/or electromagnetic waves under the control of the control module;
A receiving module for receiving the echo signal of the ultrasonic wave and/or the electromagnetic wave,
Wherein the modes include: fingerprint identification mode, gesture recognition mode and audio transmission mode, the control module includes:
The mode recognition unit is used for determining the distance between the human hand and the receiving module according to the echo signal of the first electromagnetic wave, enabling the man-machine interaction device to be in a gesture recognition mode under the condition that the distance is larger than a preset value, enabling the man-machine interaction device to be in a fingerprint recognition mode under the condition that the distance is smaller than or equal to the preset value, and enabling the man-machine interaction device to be in an audio transmission mode under the condition that an audio transmission command is received;
The driving unit controls the sending module to send first ultrasonic waves in a fingerprint identification mode, controls the sending module to send first electromagnetic waves in a gesture identification mode, and controls the sending module to send second ultrasonic waves in an audio transmission mode according to audio data to be transmitted;
And the processing unit is used for identifying a fingerprint according to the echo signal of the first ultrasonic wave in a fingerprint identification mode and identifying a gesture according to the echo signal of the first electromagnetic wave in a gesture identification mode.
2. The human-computer interaction device of claim 1,
The transmitting module is used for transmitting at least one of the first ultrasonic wave, the first electromagnetic wave and the second ultrasonic wave under the control of the control module;
The receiving module is used for receiving at least one of the echo signal of the first ultrasonic wave and the echo signal of the first electromagnetic wave.
3. the human-computer interaction device of claim 1, wherein the control module further comprises:
And the instruction generating unit is used for generating a corresponding instruction according to the fingerprint identification result or the gesture identification result of the processing unit.
4. The human-computer interaction device of claim 2, wherein the sending module comprises:
the voltage-controlled oscillator is used for generating the first electromagnetic wave and a third electromagnetic wave for converting into a first ultrasonic wave under the control of the control module;
an audio modulator for modulating the audio data onto a high frequency carrier;
a transducer for converting the third electromagnetic wave into the first ultrasonic wave and converting the high frequency carrier wave into the second ultrasonic wave.
5. The human-computer interaction device of claim 2, wherein the receiving module comprises:
A receiving antenna array for receiving the first ultrasonic wave and the echo signal of the first electromagnetic wave;
A transducer for converting an echo signal of the first ultrasonic wave into an electrical signal.
6. The human-computer interaction device of claim 2,
The sending module is also used for sending a second electromagnetic wave;
The receiving module is further used for receiving an echo signal of the second electromagnetic wave;
The driving unit is also used for controlling the sending module to send second electromagnetic waves in an audio transmission mode, and controlling the sending module to send second ultrasonic waves carrying the audio data to be transmitted to the direction of the human ear according to the audio data to be transmitted;
The processing unit is also used for determining the direction of the human ear according to the echo signal of the second electromagnetic wave.
7. The human-computer interaction device of claim 6, wherein the sending module comprises:
a voltage controlled oscillator for generating the first electromagnetic wave, the second electromagnetic wave, and a third electromagnetic wave for conversion into a first ultrasonic wave under the control of the control module;
An audio modulator for modulating the audio data onto a high frequency carrier;
A transducer for converting the third electromagnetic wave into the first ultrasonic wave and converting the high-frequency carrier wave into the second ultrasonic wave; and
And the direction regulator is used for regulating the direction of the transducer under the control of the control module so as to enable the second ultrasonic waves to be transmitted towards the direction of the human ear.
8. The human-computer interaction device of claim 6, wherein the receiving module comprises:
a receiving antenna array for receiving echo signals of the first ultrasonic wave, the first electromagnetic wave and the second electromagnetic wave;
A transducer for converting a reflected signal of the first ultrasonic wave into an electrical signal.
9. The human-computer interaction device according to claim 2, wherein a plurality of parallel signal channels are provided among the control module, the sending module and the receiving module, so that the human-computer interaction device is simultaneously in at least two of the following modes:
a fingerprint identification mode;
a gesture recognition mode; and
Audio transmission mode.
10. a display device, comprising:
a display panel;
the human-computer interaction device of any one of claims 1 to 9,
Wherein the transmitting module and the receiving module are disposed at opposite sides of a substrate in the display panel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710031248.8A CN106919295B (en) | 2017-01-17 | 2017-01-17 | human-computer interaction device and display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710031248.8A CN106919295B (en) | 2017-01-17 | 2017-01-17 | human-computer interaction device and display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106919295A CN106919295A (en) | 2017-07-04 |
| CN106919295B true CN106919295B (en) | 2019-12-10 |
Family
ID=59453426
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710031248.8A Active CN106919295B (en) | 2017-01-17 | 2017-01-17 | human-computer interaction device and display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106919295B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109491552A (en) * | 2017-09-12 | 2019-03-19 | 南昌欧菲生物识别技术有限公司 | Electronic equipment |
| CN108173603B (en) * | 2017-12-26 | 2021-08-20 | 上海展扬通信技术有限公司 | Signal processing method and control terminal |
| CN110111651A (en) * | 2018-02-01 | 2019-08-09 | 周玮 | Intelligent language interactive system based on posture perception |
| CN109167873A (en) * | 2018-07-17 | 2019-01-08 | 珠海格力电器股份有限公司 | A kind of control method of terminal, device, storage medium and terminal |
| US11514777B2 (en) | 2018-10-02 | 2022-11-29 | Sonos, Inc. | Methods and devices for transferring data using sound signals |
| CN110309752B (en) * | 2019-06-24 | 2021-09-10 | Oppo广东移动通信有限公司 | Ultrasonic processing method, ultrasonic processing apparatus, storage medium, and electronic device |
| WO2021109121A1 (en) * | 2019-12-06 | 2021-06-10 | 京东方科技集团股份有限公司 | Ultrasonic fingerprint recognition unit, fingerprint recognition apparatus and fingerprint recognition driving method |
| CN112540717B (en) * | 2020-12-11 | 2022-05-31 | 维沃移动通信有限公司 | Touch method, device and storage medium |
| CN116363705A (en) * | 2021-12-28 | 2023-06-30 | 中兴通讯股份有限公司 | Fingerprint identification method, fingerprint identification device and computer readable medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101262712A (en) * | 2007-03-09 | 2008-09-10 | 付庆兴 | A voice directional spreading sound system |
| CN102535985A (en) * | 2012-03-04 | 2012-07-04 | 南京理工大学常熟研究院有限公司 | Electronic lock based on fingerprint image identification |
| CN106662913A (en) * | 2014-03-10 | 2017-05-10 | 埃尔瓦有限公司 | Systems and methods for a dual modality sensor system |
| CN103927009B (en) * | 2014-04-16 | 2017-12-05 | 北京智谷睿拓技术服务有限公司 | Exchange method and system |
| CN105046243B (en) * | 2015-08-25 | 2019-12-20 | 业成光电（深圳）有限公司 | Display device |
-
2017
- 2017-01-17 CN CN201710031248.8A patent/CN106919295B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN106919295A (en) | 2017-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106919295B (en) | human-computer interaction device and display device | |
| US9811168B2 (en) | Apparatus for performing gesture recognition and control based on ultrasonic positioning | |
| US11693086B2 (en) | Smart device with an integrated radar system | |
| US20190312465A1 (en) | Wireless power transmitter and control method therefor | |
| US20140321700A1 (en) | Light sensing module and system | |
| US9864452B2 (en) | Coordinates indication device and coordinates measurement device for measuring input position of the coordinates indication device | |
| CN108681726B (en) | 3D chip module, identity recognition device and electronic equipment | |
| US10430011B2 (en) | Method and apparatus for tracking input positions via electric field communication | |
| US9949107B2 (en) | Method and system for detecting an input to a device | |
| US20140035848A1 (en) | Electronic pen input recognition apparatus and method using c-type touch screen panel (tsp) | |
| CN113949409B (en) | Radio frequency circuit and electronic equipment | |
| US11959997B2 (en) | System and method for tracking a wearable device | |
| CN113852387B (en) | Antenna power adjusting method and device and electronic equipment | |
| CN109029252B (en) | Object detection method, object detection device, storage medium, and electronic apparatus | |
| US10248263B2 (en) | Acoustic wave touch device and electronic apparatus | |
| US20200110477A1 (en) | Electronic device including pen input device and method of operating the same | |
| US9285901B2 (en) | Electronic device for recognizing asynchronous digital pen and recognizing method thereof | |
| US6862018B2 (en) | Cordless pressure-sensitivity and electromagnetic-induction system with specific frequency producer and two-way transmission gate control circuit | |
| CN110753139B (en) | Input method and mobile terminal | |
| CN112259128A (en) | Audio device and voice recognition method | |
| CN111813272A (en) | Information input method and device and electronic equipment | |
| CN106775308B (en) | proximity sensor switching method and device and terminal | |
| CN104898939B (en) | Signal processing method and electronic equipment | |
| CN112098929A (en) | Method, device and system for determining relative angle between intelligent devices and intelligent devices | |
| WO2020000143A1 (en) | Touch device, touch chip, and object detection method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |