CN109032411B - Display panel, display device and control method thereof - Google Patents
Display panel, display device and control method thereof Download PDFInfo
- Publication number
- CN109032411B CN109032411B CN201810836786.9A CN201810836786A CN109032411B CN 109032411 B CN109032411 B CN 109032411B CN 201810836786 A CN201810836786 A CN 201810836786A CN 109032411 B CN109032411 B CN 109032411B
- Authority
- CN
- China
- Prior art keywords
- touch
- signal
- control module
- sensor assembly
- lower electrode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000005236 sound signal Effects 0.000 claims abstract description 73
- 239000000758 substrate Substances 0.000 claims abstract description 21
- 239000010408 film Substances 0.000 claims description 37
- 239000010409 thin film Substances 0.000 claims description 26
- 238000005538 encapsulation Methods 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 4
- 238000004519 manufacturing process Methods 0.000 abstract description 7
- 238000001514 detection method Methods 0.000 abstract description 3
- 238000005516 engineering process Methods 0.000 description 10
- 238000000151 deposition Methods 0.000 description 8
- 239000002184 metal Substances 0.000 description 8
- 238000000059 patterning Methods 0.000 description 7
- 239000011347 resin Substances 0.000 description 5
- 229920005989 resin Polymers 0.000 description 5
- BFKJFAAPBSQJPD-UHFFFAOYSA-N tetrafluoroethene Chemical compound FC(F)=C(F)F BFKJFAAPBSQJPD-UHFFFAOYSA-N 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 239000000853 adhesive Substances 0.000 description 3
- 230000001070 adhesive effect Effects 0.000 description 3
- 238000003825 pressing Methods 0.000 description 3
- 241000282326 Felis catus Species 0.000 description 2
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 239000002033 PVDF binder Substances 0.000 description 1
- 238000000137 annealing Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 229920001721 polyimide Polymers 0.000 description 1
- 229920002981 polyvinylidene fluoride Polymers 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000004080 punching Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
- Control Of El Displays (AREA)
Abstract
The invention provides a display panel, a display device and a control method thereof. The display panel comprises a substrate, a display module and a sensor assembly which are formed on the substrate, and a control module; the display module is configured to display a picture; the sensor assembly is configured to detect a touch signal generated when the display module is touched, send the touch signal to the control module, and output a sound wave according to an audio signal sent by the control module; the control module is configured to determine a touch position of the touch according to the touch signal, determine an audio signal corresponding to the touch position, and send the audio signal to a sensor component. In the embodiment of the invention, the sensor assembly has a sound production function and a touch detection function, and the display panel has an autonomous sound production function and a function of outputting sound waves corresponding to the touch position based on the arrangement of the sensor assembly.
Description
Technical Field
The invention relates to the technical field of display, in particular to a display panel, a display device and a control method thereof.
Background
With the rapid development of display technologies, technologies such as virtual reality technologies, tactile feedback technologies and the like are widely applied to the preparation of display equipment, so that the prepared display equipment has a strong human-computer interaction function.
However, in the prior art, the sound generating devices arranged inside the display device are all traditional sound generating devices, mainly include a sound circuit and a speaker, and are suitable for the display device.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a display panel to solve the problem of single type of sound generating device in the background art, which is suitable for being configured as a display device.
In one aspect, a display panel is provided, which includes a substrate, a display module and a sensor assembly formed on the substrate, and a control module;
the display module is configured to display a picture;
the sensor assembly is configured to detect a touch signal generated when the display module is touched, send the touch signal to the control module, and output a sound wave according to an audio signal sent by the control module;
the control module is configured to determine a touch position of the touch according to the touch signal, determine an audio signal corresponding to the touch position, and send the audio signal to a sensor component.
Further, the control module is configured to determine the picture content at the touch position and acquire an audio signal corresponding to the picture content.
Further, the control module is configured to process an audio signal corresponding to the touch position after determining the audio signal, and send the processed audio signal to the sensor component;
the sensor assembly is configured to output a directional sound wave according to the processed audio signal.
The sensor assembly comprises an upper electrode, a piezoelectric film, a lower electrode and a back plate which are arranged in a stacked mode, wherein the lower electrode comprises a plurality of lower electrode units which are arranged on the back plate in an array mode; the back plate is bonded on the light emitting surface of the display module.
Further, a display module and a sensor assembly formed on the substrate include:
a thin film transistor layer formed on the substrate, the thin film transistor layer including alternately arranged driving thin film transistors and sensor thin film transistors;
an insulating layer formed on the thin-film transistor layer;
a first electrode layer formed on the insulating layer, the first electrode layer including a first pixel electrode and a lower electrode which are independent of each other and alternately arranged; the first pixel electrode is electrically connected with the corresponding driving thin film transistor through a first through hole in the insulating layer, and the lower electrode is electrically connected with the corresponding sensor thin film transistor through a second through hole in the insulating layer;
the pixel defining layer is formed on the first electrode layer and divides a pixel area and a sensor area which are alternately arranged;
the organic light emitting structure is formed in the pixel area, and the piezoelectric film is formed in the sensor area, wherein the organic light emitting structure is electrically connected with the corresponding first pixel electrode, and the voltage film is electrically connected with the corresponding lower electrode;
a second electrode layer formed on the pixel defining layer, wherein the second electrode layer comprises second pixel electrodes and upper electrodes which are mutually independent and alternately arranged, the orthographic projection of the second pixel electrodes on the pixel defining layer covers the corresponding organic light-emitting structures, and the orthographic projection of the upper electrodes on the pixel defining layer covers the corresponding voltage films;
an encapsulation layer formed on the second electrode layer.
In another aspect, a display device is also provided, which includes the display panel.
In another aspect, a control method of a display panel is further provided, where the control method includes:
the sensor assembly detects a touch signal generated when the display module is touched and sends the touch signal to the control module;
the control module determines a touch position of the touch according to the touch signal;
the control module determines an audio signal corresponding to the touch position;
the control module sends the audio signal to the sensor assembly;
the sensor assembly outputs sound waves according to the audio signal.
Further, the sensor assembly comprises an upper electrode, a piezoelectric film, a lower electrode and a back plate which are stacked, wherein the lower electrode comprises a plurality of lower electrode units which are arranged in an array; the touch signal that produces when the sensor module detects the display module assembly and takes place the touch-control, will the touch signal takes place to control module, includes:
the sensor assembly sends out a first ultrasonic signal and generates an electric signal according to a second ultrasonic signal, and the second ultrasonic signal is a reflection signal generated when the first ultrasonic signal is reflected at the touch position of the touch;
the sensor component outputs the electric signal to the control module by using a lower electrode unit corresponding to the touch position;
the control module determines the touch position of the touch according to the touch signal, and the determining includes:
and the control module determines the touch position of the touch according to the position of the lower electrode unit which sends the electric signal.
Further, the control module sends the audio signal to the sensor assembly, including:
and loading the audio signals to each lower electrode unit respectively with preset phase delay so as to enable the sensor assembly to emit directional sound waves.
Further, after the control module determines an audio signal corresponding to the touch position, the method further includes:
the control module processes the audio signal to ultrasonic waves with different frequencies;
the control module sends the audio signal to the sensor assembly, including:
sending the ultrasonic waves with different frequencies to different areas of the lower electrode, wherein the ultrasonic waves received by the lower electrode units in the same area have the same frequency;
the sensor assembly outputs sound waves according to the audio signal, including:
the sensor assembly sends out ultrasonic waves with different frequencies through the lower electrode units positioned in different areas, and the ultrasonic waves with different frequencies can generate nonlinear interaction so as to demodulate directional sound waves.
Compared with the prior art, the invention has the following advantages:
the invention provides a display panel, a display device and a control method thereof. The display panel comprises a substrate, a display module, a sensor assembly and a control module, wherein the display module, the sensor assembly and the control module are formed on the substrate, the sensor assembly detects a touch signal generated when the display module is touched and sends the touch signal to the control module, the control module determines a touch position of touch according to the touch signal, determines an audio signal corresponding to the touch position and sends the audio signal to the sensor assembly, the sensor assembly outputs sound waves according to the audio signal sent by the control module, and the sensor assembly has a sound production function and a touch detection function.
Drawings
FIG. 1 is a schematic structural diagram of a sensor assembly provided by an embodiment of the present invention;
FIG. 2 is a schematic diagram of a first structure of a display panel according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a second structure of a display panel according to an embodiment of the invention;
FIG. 4 is a flowchart illustrating a method for controlling a display panel according to an embodiment of the present invention;
fig. 5 is a waveform diagram of an audio signal on a sensor assembly provided by an embodiment of the invention.
Description of the reference numerals
1. Upper electrode 2, piezoelectric film 3, lower electrode 31, lower electrode unit
4. Backboard 5, substrate 6, thin film transistor layer 61 and pixel TFT
62. Sensor TFT 7, insulating layer 8, first electrode layer
81. First pixel electrode 82, lower electrode 9, pixel defining layer
10. Organic light emitting structure 11, piezoelectric film 12, second electrode layer
121. Second pixel electrode 122, upper electrode 13, and encapsulation layer
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
In the description of the present invention, "a plurality" means two or more unless otherwise specified; the terms "upper", "lower", "left", "right", "inner", "outer", and the like, indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing and simplifying the description, but do not indicate or imply that the machine or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention.
In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; may be directly connected or indirectly connected through an intermediate. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
The following detailed description of embodiments of the invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
The embodiment of the invention provides a display panel, which comprises a substrate, a display module, a sensor assembly and a control module, wherein the display module and the sensor assembly are formed on the substrate; the display module is configured to display a picture; the sensor assembly is configured to detect a touch signal generated when the display module is touched, send the touch signal to the control module and output sound waves according to an audio signal sent by the control module; the control module is configured to determine a touch position of a touch according to the touch signal, determine an audio signal corresponding to the touch position, and send the audio signal to the sensor assembly.
In the structure, the sensor assembly has a sound production function and a touch detection function, and the display panel has an autonomous sound production function and a function of outputting sound waves corresponding to the touch position based on the sensor assembly. Therefore, the display panel provided by the embodiment of the invention is an intelligent touch sound feedback system for where to touch and sound.
The control module has functions of determining a touch position according to the touch signal, determining an audio signal corresponding to the touch position, and transmitting the audio signal to the sensor assembly. The control module can be a controller, a control chip and the like which integrate the functions.
The control module can be configured to determine the picture content at the touch position and acquire an audio signal corresponding to the picture content. Accordingly, the sensor assembly may be configured to output a sound wave corresponding to the picture content according to an audio signal corresponding to the picture content. For example, when the picture cat that shows on the touch-control display module assembly, the sound wave of cat cry sound is exported according to the audio signal that control module sent to the sensor subassembly.
The control module may be configured to process the audio signal after determining the audio signal corresponding to the touch position, and transmit the processed audio signal to the sensor assembly. Accordingly, the sensor assembly is configured to output directional sound waves according to the processed audio signal, thereby realizing directional sound production of the display panel.
The sensor assembly may be disposed at various positions, for example, the sensor assembly may be disposed on the light emitting surface of the display module in a whole layer, the sensor assembly may be integrated in the structural layer of the display module, and the like.
In the first mode, the sensor assembly is of a layered structure and is attached to the light emitting surface of the display module.
As shown in fig. 1, the sensor assembly includes an upper electrode 1, a piezoelectric film 2, a lower electrode 3 and a back plate 4, which are stacked, wherein the lower electrode 3 includes a plurality of lower electrode units 31 arranged in an array on the back plate 4; the back plate 4 is bonded on the light-emitting surface of the display module.
The sensor assembly may be referred to as a piezoelectric sensor, and the working principle of the piezoelectric sensor is as follows: the first process, a reverse piezoelectric effect is utilized, a voltage pulse signal is applied between electrodes to enable the piezoelectric film 2 to deform, and the deformation of the piezoelectric film 2 pushes surrounding media to vibrate to generate ultrasonic waves; in the second process, the piezoelectric film 2 receives the ultrasonic waves to deform by utilizing the positive piezoelectric effect, and generates high-frequency voltage and amplifies and outputs the high-frequency voltage.
The upper electrode 1 may be a surface electrode and may be made of a transparent metal such as ITO. The piezoelectric film 2 may be a full-face structure, and may be a PVDF piezoelectric film, a PET piezoelectric film, or the like. The lower electrode 3 includes a plurality of lower electrode units 31 arranged in an array, and the shapes of the lower electrode units 31 are various, for example, the orthographic projection of the lower electrode unit 31 on the back plate 4 is square, rectangular, circular, triangular, and the like, and may be set according to the actual setting.
The sensor assembly shown in fig. 1 can be made by a process comprising the following three steps: in the first step, a back plate 4 is obtained, and lower electrode units 31 arranged in an array are formed on the back plate 4. The back sheet 4 may be a transparent organic film such as a glass substrate or a transparent PI film (polyimide film). Specifically, a whole metal layer may be deposited on the back plate 4, and then the metal layer is etched through a patterning process to obtain a plurality of lower electrode units 31. In the second step, the entire piezoelectric thin film 2 is deposited on the plurality of lower electrode units 31, and the annealing crystal bloom treatment is performed on the piezoelectric thin film 2. Thirdly, depositing the whole upper electrode 1 on the piezoelectric film 2, and polarizing the piezoelectric film 2; or the piezoelectric film 2 is polarized first, and then the entire upper electrode 1 is attached to the piezoelectric film 2 by using an adhesive (e.g., OCA optical adhesive, AB adhesive, etc.). And partial driving circuits can be manufactured on the back plate 4, so that the signal sensitivity is improved, and the complexity of peripheral circuits is reduced, such as a TFT switch, a shift register row-column scanning circuit and the like are manufactured on the back plate 4.
In a second mode, the sensor assembly is integrated within a structural layer of the display module.
The display panel comprises a plurality of sensor assemblies arranged at intervals, each sensor assembly comprises an upper electrode, a piezoelectric film and a lower electrode, the upper electrodes are stacked, the plurality of sensor assemblies and a plurality of organic light-emitting structures in the display module are jointly formed in a pixel defining layer and are alternately arranged, meanwhile, each sensor assembly is electrically connected with a corresponding sensor Thin Film Transistor (TFT), the sensor TFT and a driving Thin Film Transistor (TFT) are jointly formed on a substrate of the display module and are alternately arranged, and the driving TFT is electrically connected with a corresponding organic light-emitting structure and is used for driving the corresponding organic light-emitting structure to emit light.
Specifically, as shown in fig. 2 and 3, the display module and the sensor assembly formed on the substrate 5 include a thin film transistor layer 6, an insulating layer 7, a first electrode layer 8, a pixel defining layer 9, an organic light emitting structure 10, a piezoelectric film 11, a second electrode layer 12, and an encapsulation layer 13; wherein,
a thin-film transistor layer 6 is formed on the substrate 5, and the thin-film transistor layer 6 includes driving TFTs 61 and sensor TFTs 62 alternately arranged. The driving TFTs 61 and the sensor TFTs 62 are alternately arranged in various ways, and may be regularly and alternately arranged according to a certain period, or randomly arranged randomly. For example, the thin-film transistor layer 6 includes a plurality of thin-film transistor cells each including one driving TFT 61 and one sensor TFT 62, and the like. An insulating layer 7 is formed on thin-film-transistor layer 6. The insulating layer 7 is provided with a via hole, and a metal layer is laid on the surface of the via hole and used for realizing the electric connection between different layers. The insulating layer 7 may be a resin layer or the like.
The first electrode layer 8 is formed on the insulating layer 7, and the first electrode layer 8 includes first pixel electrodes 81 and lower electrodes 82 that are independent of each other and alternately arranged, where the first pixel electrodes 81 are electrically connected to the corresponding driving TFTs 61 through first vias on the insulating layer 7, and the lower electrodes 82 are electrically connected to the corresponding sensor TFTs 62 through second vias on the insulating layer 7. There are various alternative arrangements of the first pixel electrodes 81 and the lower electrodes 82, and similar to the arrangement of the thin film transistors, the first pixel electrodes 81 and the lower electrodes 82 may be arranged alternately according to a certain period rule, or randomly.
A pixel defining layer 9 is formed on the first electrode layer 8, and the pixel defining layer 9 divides a pixel region and a sensor region which are alternately arranged. The organic light emitting structure 10 is formed in the pixel region of the pixel defining layer 9, the piezoelectric film 11 is formed in the sensor region of the pixel defining layer 9, the organic light emitting structure 10 is electrically connected to the corresponding first pixel electrode 81, and the voltage film 11 is electrically connected to the corresponding lower electrode 82.
The organic light emitting structure 10 is made of an organic light emitting material, and when a voltage is applied to both sides of the organic light emitting structure 10, the organic light emitting structure 10 emits light. Based on the light emitting principle of the organic light emitting structure 10, the orthographic projection of the organic light emitting structure 10 on the first electrode layer 8 at least partially overlaps with the first pixel electrode 81, and optionally, the orthographic projection of the organic light emitting structure 10 on the first electrode layer 8 is located in the region where the corresponding first pixel electrode 81 is located. Based on the sensor assembly and the operating principle of the sensor assembly, the orthographic projection of the voltage film 11 on the first electrode layer 8 at least partially overlaps the corresponding lower electrode 82, and optionally, the orthographic projection of the voltage film 11 on the first electrode layer 8 is located in the region of the corresponding lower electrode 82.
The second electrode layer 12 is formed on the pixel defining layer 9, the second electrode layer 12 includes second pixel electrodes 121 and upper electrodes 122 that are independent of each other and alternately arranged, an orthogonal projection of the second pixel electrodes 121 on the pixel defining layer 9 covers the corresponding organic light emitting structures 10, and an orthogonal projection of the upper electrodes 122 on the pixel defining layer 9 covers the corresponding voltage films 11. The second pixel electrode 121 and the upper electrode 122 are alternately arranged in the same manner as the sensor region and the pixel region. The encapsulation layer 13 is formed on the second electrode layer 12. The encapsulation layer 13 covers the second electrode layer 12 and protects the internal structure. The encapsulating layer 13 may be a TFE (tetrafluoroethylene) layer or the like.
The scheme shown in fig. 2 and 3 integrates the sensor assembly into the display module, and the size such as thickness of the display module and the display screen is not increased while the display panel independently sounds, so that the display module and the display screen are favorably thinned.
The display panel shown in fig. 2 and 3 may be manufactured by a process including the following steps: depositing a metal layer on the substrate 5, and forming pixel TFTs 61 and sensor TFTs 62 which are alternately arranged after patterning; depositing a resin layer, i.e., an insulating layer 7, which covers the pixel TFT 61, the sensor TFT 62, and the substrate 5; forming a via hole on the resin layer, depositing an ITO metal layer in the via hole, and depositing a first pixel electrode 81 and a lower electrode 82 which are independent from each other and are alternately arranged on the resin layer; depositing a pixel defining layer 9 on the resin layer, the first pixel electrode 81 and the lower electrode 82, punching a designated position of the pixel defining layer 9, forming a plurality of through holes on the pixel defining layer 9, depositing an organic light-emitting material in the first through holes on the first pixel electrode 81 and the second through holes on the lower electrode 82 to obtain an organic light-emitting structure 10, and forming a piezoelectric film 11 in the second through holes; forming a second pixel electrode 121 covering the organic light emitting structure 10 and forming an upper electrode 122 covering the piezoelectric thin film 11 by depositing a metal layer and patterning the metal layer, resulting in a plurality of pixel units and a plurality of sensor components; an encapsulation layer 13, specifically a TFE encapsulation layer, is formed.
The lower electrode 82 in the sensor assembly may be disposed in the same layer as the anode in the pixel unit, i.e., the first pixel electrode 81, through a single patterning process, or may be layered with the anode in the pixel unit through a different patterning process. Similarly, the upper electrode 122 in the sensor assembly may be disposed in the same layer as the cathode in the pixel unit, i.e., the second pixel electrode 121, through a single patterning process, or may be disposed in layers with the cathode in the pixel unit through different patterning processes.
Because the TFE packaging layer is thin, the sensor assembly is close to the light-emitting surface of the display panel, and the energy of transmitted ultrasonic waves can be well reserved by using the TFE packaging layer.
The embodiment of the invention also provides a display device which comprises the display panel provided by the embodiment of the invention. The display device has the advantages of the display panel, and the embodiment of the invention is not described herein again.
The embodiment of the invention also provides a control method of the display panel. Referring to fig. 4, a method for controlling a display panel according to an embodiment of the present invention includes the following steps:
And 102, determining a touch position of touch control by the control module according to the touch control signal.
Through the control to sensor subassembly and control module, control display panel passes through sensor subassembly and independently gives sound to the sound wave that output and touch position correspond.
When the sensor assembly includes an upper electrode, a piezoelectric film, a lower electrode and a back plate, which are stacked, and the lower electrode includes a plurality of lower electrode units arranged in an array, the step 101 may be implemented by: firstly, a sensor assembly sends out a first ultrasonic signal and generates an electric signal according to a second ultrasonic signal, wherein the second ultrasonic signal is a reflection signal generated when the first ultrasonic signal is reflected at a touch position of touch control; and secondly, the sensor assembly outputs an electric signal to the control module by using the lower electrode unit corresponding to the touch position. In this case, the step 102 can be implemented as follows: the control module determines a touch position of touch according to the position of the lower electrode unit which sends the electric signal.
The above process is exemplified below with reference to fig. 5.
Referring to fig. 5, a T1 time period is a touch time period of the display panel, and a T2 time period is a haptic (sound) feedback time period of the display panel. The upper electrode is provided with a T3 period, and the lower electrode is provided with a T4 period and a T5 period. In a time period T3, applying a voltage pulse signal to an upper electrode of the sensor assembly to deform the piezoelectric film and generate a first ultrasonic signal, and after the time period T3 is finished, stopping applying the voltage pulse signal; in the process that the upper electrode sends out the first ultrasonic signal, if a user presses the display module by a finger, the first ultrasonic signal is reflected when being transmitted to the finger to obtain a reflected signal, namely a second ultrasonic signal, the second ultrasonic signal is transmitted to the piezoelectric film, the piezoelectric film generates an electric signal according to the second ultrasonic signal, the electric signal is transmitted to the control module by using the lower electrode unit corresponding to the pressing position, and the process is completed within a time period T4; the control module determines the pressing position of a finger on the display module according to the position of the lower electrode unit for transmitting the electric signal, determines an audio signal corresponding to the pressing position and sends the audio signal to the sensor assembly; during the period T5, the sensor assembly outputs sound waves according to the audio signal sent by the control module.
Based on the above structure of sensor assembly, control module can be through handling the audio signal who confirms, and audio signal after will handling sends sensor assembly, realizes sensor assembly output directional sound wave, and then realizes display panel's directional sound production.
The control module processes the audio signal to realize that the sensor assembly outputs the directional sound wave in various ways, for example, an acoustic phased array technology is adopted to load the audio signal to each lower electrode unit respectively with preset phase delay, so as to control the deflection and focusing of the sound beam, and the sensor assembly emits the directional sound wave.
For another example, by using the parametric acoustic array technology, after determining the audio signal corresponding to the touch position, the control module processes the audio signal to the ultrasonic waves with different frequencies, and sends the ultrasonic waves with different frequencies to different areas of the lower electrode, and the ultrasonic waves received by the lower electrode units located in the same area have the same frequency. Compared with the acoustic phased array technology, the acoustic parametric array technology can realize directional acoustic wave transmission at a smaller angle and a longer distance.
Illustratively, the sensor assembly comprises a first sensor array and a second sensor array, and a parametric acoustic array technology is adopted, the control module processes the audio signals to obtain a first audio signal and a second audio signal, the control module sends the first audio signal to the first sensor array and sends the second audio signal to the second sensor array, accordingly, the first sensor array in the sensor assembly sends out a third ultrasonic signal according to the first audio signal, and the second sensor array sends out a fourth ultrasonic signal according to the second audio signal, wherein the third ultrasonic signal and the fourth ultrasonic signal can generate nonlinear interaction to demodulate a directional sound wave (difference frequency wave).
When the control module processes the audio signal by adopting the parametric acoustic array technology, the control module can comprise components such as a signal processing module, a power amplifier, an impedance matching circuit and the like, wherein the signal processing module is used for modulating the audio to form an ultrasonic signal, the power amplifier is used for amplifying the power of the ultrasonic signal, and the impedance matching circuit is used for performing impedance matching on the ultrasonic signal.
The display panel, the display device and the control method thereof provided by the present invention are described in detail above, and the principle and the embodiment of the present invention are explained in detail herein by applying specific examples, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (8)
1. The display panel is characterized by comprising a substrate, a display module and a sensor assembly which are formed on the substrate, and a control module;
the display module is configured to display a picture;
the sensor assembly is configured to detect a touch signal generated when the display module is touched, send the touch signal to the control module, and output a sound wave according to an audio signal sent by the control module;
the control module is configured to determine a touch position of the touch according to the touch signal, determine an audio signal corresponding to the touch position, and send the audio signal to a sensor component;
wherein the display module and the sensor assembly formed on the substrate include:
a thin film transistor layer formed on the substrate, the thin film transistor layer including alternately arranged driving thin film transistors and sensor thin film transistors;
an insulating layer formed on the thin-film transistor layer;
a first electrode layer formed on the insulating layer, the first electrode layer including a first pixel electrode and a lower electrode which are independent of each other and alternately arranged; the first pixel electrode is electrically connected with the corresponding driving thin film transistor through a first through hole in the insulating layer, and the lower electrode is electrically connected with the corresponding sensor thin film transistor through a second through hole in the insulating layer;
the pixel defining layer is formed on the first electrode layer and divides a pixel area and a sensor area which are alternately arranged;
the organic light emitting structure is formed in the pixel area, and the piezoelectric film is formed in the sensor area, wherein the organic light emitting structure is electrically connected with the corresponding first pixel electrode, and the piezoelectric film is electrically connected with the corresponding lower electrode;
a second electrode layer formed on the pixel defining layer, wherein the second electrode layer comprises second pixel electrodes and upper electrodes which are mutually independent and alternately arranged, the orthographic projection of the second pixel electrodes on the pixel defining layer covers the corresponding organic light-emitting structures, and the orthographic projection of the upper electrodes on the pixel defining layer covers the corresponding piezoelectric films;
an encapsulation layer formed on the second electrode layer;
the sensor assembly is specifically configured to: sending a first ultrasonic signal, and generating an electric signal according to a second ultrasonic signal, wherein the second ultrasonic signal is a reflection signal generated when the first ultrasonic signal is reflected at the touch position of the touch; the sensor component outputs the electric signal to the control module by using a lower electrode unit corresponding to the touch position;
determining the touch position of the touch according to the touch signal includes: and determining the touch position of the touch according to the position of the lower electrode unit sending the electric signal.
2. The display panel according to claim 1, wherein the control module is configured to determine a picture content at the touch position and acquire an audio signal corresponding to the picture content.
3. The display panel of claim 1, wherein the control module is configured to process an audio signal corresponding to the touch position after determining the audio signal, and send the processed audio signal to the sensor component;
the sensor assembly is configured to output a directional sound wave according to the processed audio signal.
4. The display panel according to claim 1, wherein the sensor assembly comprises an upper electrode, a piezoelectric film, a lower electrode and a back plate, which are stacked, wherein the lower electrode comprises a plurality of lower electrode units arranged in an array on the back plate; the back plate is bonded on the light emitting surface of the display module.
5. A display device characterized by comprising the display panel according to any one of claims 1 to 4.
6. A control method of a display panel, the control method comprising:
the sensor assembly detects a touch signal generated when the display module is touched and sends the touch signal to the control module;
the control module determines a touch position of the touch according to the touch signal;
the control module determines an audio signal corresponding to the touch position;
the control module sends the audio signal to the sensor assembly;
the sensor assembly outputs sound waves according to the audio signals;
the sensor assembly comprises an upper electrode, a piezoelectric film, a lower electrode and a back plate which are arranged in a stacked mode, wherein the lower electrode comprises a plurality of lower electrode units which are arranged in an array mode; the sensor module detects the touch signal that produces when the display module assembly takes place the touch-control, will touch signal sends control module, includes:
the sensor assembly sends out a first ultrasonic signal and generates an electric signal according to a second ultrasonic signal, and the second ultrasonic signal is a reflection signal generated when the first ultrasonic signal is reflected at the touch position of the touch;
the sensor component outputs the electric signal to the control module by using a lower electrode unit corresponding to the touch position;
the control module determines the touch position of the touch according to the touch signal, and the method comprises the following steps:
and the control module determines the touch position of the touch according to the position of the lower electrode unit which sends the electric signal.
7. The control method of claim 6, wherein the control module sends the audio signal to the sensor assembly, comprising:
and loading the audio signals to each lower electrode unit respectively with preset phase delay so as to enable the sensor assembly to emit directional sound waves.
8. The control method of claim 7, wherein after the control module determines the audio signal corresponding to the touch position, the method further comprises:
the control module processes the audio signal to ultrasonic waves with different frequencies;
the control module sends the audio signal to the sensor assembly, including:
sending the ultrasonic waves with different frequencies to different areas of the lower electrode, wherein the ultrasonic waves received by the lower electrode units in the same area have the same frequency;
the sensor assembly outputs sound waves according to the audio signal, including:
the sensor assembly sends out ultrasonic waves with different frequencies through the lower electrode units positioned in different areas, and the ultrasonic waves with different frequencies can generate nonlinear interaction so as to demodulate directional sound waves.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810836786.9A CN109032411B (en) | 2018-07-26 | 2018-07-26 | Display panel, display device and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810836786.9A CN109032411B (en) | 2018-07-26 | 2018-07-26 | Display panel, display device and control method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109032411A CN109032411A (en) | 2018-12-18 |
| CN109032411B true CN109032411B (en) | 2021-04-23 |
Family
ID=64645750
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810836786.9A Active CN109032411B (en) | 2018-07-26 | 2018-07-26 | Display panel, display device and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109032411B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109840481A (en) * | 2019-01-09 | 2019-06-04 | 昆山国显光电有限公司 | Display panel and its control method and display device |
| CN110265457B (en) * | 2019-06-27 | 2021-11-02 | 京东方科技集团股份有限公司 | Organic light emitting display panel and preparation method thereof |
| CN110389625A (en) * | 2019-07-29 | 2019-10-29 | 深圳传音控股股份有限公司 | The touch control display method and terminal of terminal shell, terminal shell |
| WO2021081925A1 (en) * | 2019-10-31 | 2021-05-06 | 京东方科技集团股份有限公司 | Organic light-emitting diode display substrate and manufacturing method therefor, and display apparatus |
| CN113140164A (en) * | 2020-01-19 | 2021-07-20 | 苏州佳世达电通有限公司 | Display device with sound production function |
| CN111615033B (en) | 2020-05-14 | 2024-02-20 | 京东方科技集团股份有限公司 | Sound generating device, driving method thereof, display panel and display device |
| CN113065440A (en) * | 2021-03-25 | 2021-07-02 | 惠州市华星光电技术有限公司 | Display panel and display device |
| CN113703614B (en) * | 2021-08-30 | 2024-03-26 | 苏州清听声学科技有限公司 | Directional ultrasonic touch device |
| CN114724459B (en) * | 2022-03-10 | 2024-04-19 | 武汉华星光电技术有限公司 | Display substrate and display panel |
| CN116055965A (en) * | 2023-01-16 | 2023-05-02 | 京东方科技集团股份有限公司 | Display device, display module and sounding device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103021208A (en) * | 2012-10-29 | 2013-04-03 | 苏州大学 | Click reading machine for click reading of ordinary books |
| CN103106031A (en) * | 2013-01-22 | 2013-05-15 | 北京小米科技有限责任公司 | Operation method and operation device of mobile terminal |
| CN104915137A (en) * | 2015-03-31 | 2015-09-16 | 努比亚技术有限公司 | Music playing method and device based on frame-free terminal |
| CN105655480A (en) * | 2016-01-04 | 2016-06-08 | 京东方科技集团股份有限公司 | Piezoelectric film sensor, piezoelectric film sensor circuit and manufacturing method |
| CN107291307A (en) * | 2017-07-26 | 2017-10-24 | 京东方科技集团股份有限公司 | Ultrasonic wave contactor control device and method, display device |
| CN107424593A (en) * | 2017-08-25 | 2017-12-01 | 广州彩磁信息技术有限公司 | A kind of digital musical instrument of region stroke touch curved surface object loudspeaker array |
| CN108072468A (en) * | 2016-11-15 | 2018-05-25 | 南台科技大学 | For detecting the ultrasonic wave touch sensor of chucking power |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101784420B1 (en) * | 2015-10-20 | 2017-10-11 | 연세대학교 산학협력단 | Apparatus and Method of Sound Modulation using Touch Screen with Pressure Sensor |
-
2018
- 2018-07-26 CN CN201810836786.9A patent/CN109032411B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103021208A (en) * | 2012-10-29 | 2013-04-03 | 苏州大学 | Click reading machine for click reading of ordinary books |
| CN103106031A (en) * | 2013-01-22 | 2013-05-15 | 北京小米科技有限责任公司 | Operation method and operation device of mobile terminal |
| CN104915137A (en) * | 2015-03-31 | 2015-09-16 | 努比亚技术有限公司 | Music playing method and device based on frame-free terminal |
| CN105655480A (en) * | 2016-01-04 | 2016-06-08 | 京东方科技集团股份有限公司 | Piezoelectric film sensor, piezoelectric film sensor circuit and manufacturing method |
| CN108072468A (en) * | 2016-11-15 | 2018-05-25 | 南台科技大学 | For detecting the ultrasonic wave touch sensor of chucking power |
| CN107291307A (en) * | 2017-07-26 | 2017-10-24 | 京东方科技集团股份有限公司 | Ultrasonic wave contactor control device and method, display device |
| CN107424593A (en) * | 2017-08-25 | 2017-12-01 | 广州彩磁信息技术有限公司 | A kind of digital musical instrument of region stroke touch curved surface object loudspeaker array |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109032411A (en) | 2018-12-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109032411B (en) | Display panel, display device and control method thereof | |
| US10983637B2 (en) | Display device | |
| WO2020259302A1 (en) | Ultrasonic sensor module, display screen module and electronic device | |
| US10509470B2 (en) | Vibrating device | |
| US9820055B2 (en) | Transducer system | |
| KR102025786B1 (en) | Display device | |
| KR101383702B1 (en) | Display device unit | |
| WO2019010982A1 (en) | Ultrasonic fingerprint sensor, display substrate and drive method thereof, and display device | |
| CN104143292A (en) | Display device | |
| CN110210435B (en) | Display panel, control method thereof and display device | |
| US11902761B2 (en) | Sound producing device and method for driving the same, display panel and display apparatus | |
| US20180335846A1 (en) | Touchscreen Panel Haptics | |
| US11521415B2 (en) | Display device | |
| EP3247133B1 (en) | Composite structure of piezoelectric receiver and ultrasonic wave generator | |
| CN110703955A (en) | Display panel and display device | |
| US20210385583A1 (en) | Transducer, method of manufacturing transducer, and transducing device | |
| KR20160061481A (en) | Display device | |
| US11417139B2 (en) | Display device | |
| JP6845590B2 (en) | Transparent touch screen parametric emitter | |
| CN116782105A (en) | Display panel, preparation method thereof and display device | |
| US11979737B2 (en) | Display device and operation method thereof | |
| US11599196B2 (en) | Display substrate, preparation method thereof, and display apparatus | |
| WO2020232934A1 (en) | Display panel structure and electronic device | |
| US11823482B2 (en) | Ultrasonic sensor, display panel and display apparatus | |
| TWM634046U (en) | Package-level piezoelectric vibration module and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |