CN108710449B - Electronic device - Google Patents
Electronic device Download PDFInfo
- Publication number
- CN108710449B CN108710449B CN201810408297.3A CN201810408297A CN108710449B CN 108710449 B CN108710449 B CN 108710449B CN 201810408297 A CN201810408297 A CN 201810408297A CN 108710449 B CN108710449 B CN 108710449B
- Authority
- CN
- China
- Prior art keywords
- light
- electronic device
- electrical signal
- generators
- receivers
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Abstract
The invention discloses an electronic device. The electronic device comprises a display component, a detection component and a processor. The detection assembly is arranged below the display assembly. The detection assembly includes a plurality of light generators and a plurality of light receivers. A plurality of light generators are configured to emit a plurality of beams of infrared light through the display assembly. The plurality of light receivers are used for receiving a plurality of infrared light beams which are reflected by external objects and pass through the display assembly to generate a plurality of electric signals. The processor is respectively connected with the plurality of light receivers and used for recognizing operation gestures according to the plurality of electric signals. According to the electronic device, the plurality of light generators emit infrared light, the plurality of light receivers receive the infrared light to generate the electric signals, and therefore operation gestures can be recognized according to the electric signals.
Description
Technical Field
The present invention relates to the field of gesture recognition technologies, and in particular, to an electronic device.
Background
Electronic devices such as mobile phones, tablets and the like are generally provided with a touch screen on which a user can perform a touch operation such as a slide operation, a click operation and the like while using the electronic device, however, when the user's hand is stained or stained, the screen of the electronic device is contaminated by performing the touch operation directly on the touch screen.
Disclosure of Invention
The embodiment of the invention provides an electronic device.
The electronic device of the embodiment of the invention is characterized by comprising a display component, a detection component and a processor, wherein the detection component is arranged below the display component, and comprises:
a plurality of light generators for emitting a plurality of beams of infrared light and passing through the display assembly; and
a plurality of light receivers for receiving a plurality of the infrared light reflected by an external object and passing through the display assembly to generate a plurality of electrical signals;
the processor is respectively connected with the light receivers and used for recognizing operation gestures according to the electric signals.
In some embodiments, the display assembly is formed with a display area and a non-display area, and the detection assembly corresponds to a position of the display area, and/or the detection assembly corresponds to a position of the non-display area.
In some embodiments, the display module is formed with a light emitting surface and a backlight surface opposite to each other, the plurality of infrared light beams emitted by the plurality of light generators sequentially pass through the backlight surface and the light emitting surface, and the backlight surface is coated with infrared transmissive ink.
In certain embodiments, a plurality of the light receivers are distributed on at least opposing sides of at least one of the light generators.
In certain embodiments, the plurality of light receivers are distributed on first and second opposing sides of at least one of the light generators, and the processor is configured to:
recognizing an operation gesture as a stroke from the first side to the second side when the electrical signal generated by the optical receiver of the first side is greater than the electrical signal generated by the optical receiver of the second side to become greater than the electrical signal generated by the optical receiver of the first side; or/and
recognizing an operation gesture as stroking from the second side to the first side when the electrical signal generated by the optical receiver of the second side is greater than the electrical signal generated by the optical receiver of the first side to change to the electrical signal generated by the optical receiver of the first side being greater than the electrical signal generated by the optical receiver of the second side.
In certain embodiments, a plurality of the light generators are distributed on at least opposing sides of at least one of the light receivers.
In some embodiments, a plurality of the light generators are configured to simultaneously emit a plurality of beams of infrared light at different wavelengths.
In certain embodiments, the plurality of light generators are distributed on first and second opposing sides of the at least one light receiver, the light generator on the first side emits infrared light at a first wavelength, the light generator on the second side emits infrared light at a second wavelength, the light receiver receives the infrared light at the first wavelength to generate a first type of electrical signal, and receives the infrared light at the second wavelength to generate a second type of electrical signal, the processor is configured to:
when the time of the peak occurrence of the first type of electric signals is detected to be earlier than the time of the peak occurrence of the second type of electric signals, identifying an operation gesture as a stroke from the first side to the second side; and
when the time of the second type of electric signal appearing peak is detected to be earlier than the time of the first type of electric signal appearing peak, identifying that the operation gesture is stroked from the second side to the first side.
In some embodiments, a plurality of the light generators are configured to alternately emit a plurality of beams of infrared light of the same wavelength.
In certain embodiments, the processor is configured to:
acquiring light emitting time sequences of a plurality of light generators; and
and identifying an operation gesture according to the light-emitting time sequence and the intensity of the electric signal.
In some embodiments, a plurality of the light receivers correspond to a plurality of the light generators, respectively.
In some embodiments, a plurality of the light receivers are distributed along a first direction; and/or a plurality of said light receivers are distributed along a second direction;
the processor is configured to:
identifying an operating gesture from a change in intensity of the electrical signal generated by the light receiver in the first direction and/or a change in intensity of the electrical signal generated by the light receiver in the second direction.
According to the electronic device, the plurality of light generators emit infrared light, the plurality of light receivers receive the infrared light to generate the electric signals, and therefore operation gestures can be recognized according to the electric signals.
Additional aspects and advantages of embodiments of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a schematic structural diagram of an electronic device according to some embodiments of the present invention;
FIG. 2 is a schematic plan view of an electronic device according to some embodiments of the invention;
FIG. 3 is a schematic plan view of an electronic device according to some embodiments of the invention;
FIG. 4 is a schematic view of a usage scenario of an electronic device according to some embodiments of the invention;
FIG. 5 is a schematic view of a usage scenario of an electronic device according to some embodiments of the invention;
FIG. 6 is a schematic view of a usage scenario of an electronic device according to some embodiments of the invention;
FIG. 7 is a schematic plan view of an electronic device according to some embodiments of the invention;
FIG. 8 is a schematic view of a usage scenario of an electronic device according to some embodiments of the invention;
FIG. 9 is a schematic illustration of different electrical signals generated by different wavelengths emitted by multiple light generators according to some embodiments of the present invention;
FIG. 10 is a schematic structural diagram of an electronic device according to some embodiments of the invention;
FIG. 11 is a schematic view of a usage scenario of an electronic device according to some embodiments of the invention.
Detailed Description
The following further describes embodiments of the present invention with reference to the drawings. The same or similar reference numbers in the drawings identify the same or similar elements or elements having the same or similar functionality throughout.
In addition, the embodiments of the present invention described below with reference to the accompanying drawings are exemplary only for the purpose of explaining the embodiments of the present invention, and are not to be construed as limiting the present invention.
In the present invention, unless otherwise expressly stated or limited, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through an intermediate. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.
Referring to fig. 1 and 2, an electronic device 100 according to an embodiment of the invention includes a display assembly 10, a detection assembly 20, and a processor 30. The electronic device 100 may be a mobile phone, a tablet computer, a laptop computer, a smart watch, a head-up display device, etc., and the embodiment of the invention is described by taking the electronic device 100 as a mobile phone, it is understood that the specific type of the electronic device 100 is not limited to the mobile phone.
The display assembly 10 may be used to form a portion of an exterior of the electronic device 100, and the display assembly 10 may display text or images for viewing by a user. In the embodiment of the present invention, the display module 10 includes a display screen 11 and a cover plate 12, the display screen 11 emits light outwards under the action of electric energy, the cover plate 12 is combined on the display screen 11, and the cover plate 12 may be made of a transparent material. In one example, conductive electrodes are also formed in the cover 12 and are responsive to a touch by a user on the cover 12. The display screen 11 may be an OLED display screen to provide the display screen 11 with better light transmission and ductility. The display assembly 10 is formed with a display area 14 and a non-display area 15, wherein the display area 14 refers to an area where content can be displayed and the non-display area 15 refers to an area where content cannot be displayed. In the present embodiment, the display module 10 is rectangular in overall shape, the display module 10 is formed with an upper edge 16, a lower edge 17, and a side edge 18, and the display region 14 and the non-display region 15 are each located within an area surrounded by the upper edge 16, the lower edge 17, and the side edge 18. The overall shape of the display area 14 may be rectangular, and the non-display area 15 is formed at a peripheral position of the display area 14, and the non-display area 15 may be used to cover internal components of the electronic device 100 and make them invisible in appearance. Of course, the shapes of the display assembly 10, the display area 14 and the non-display area 15 may be selected according to different requirements, for example, the display assembly 10 may be circular as a whole; or the display area 14 may be rectangular and provided with a notch (bang screen); or the non-display area 15 is formed only on one or both edges of the display area 14.
The detection component 20 is disposed below the display component 10, specifically, the display component 10 is exposed outside the electronic device 100, and the detection component 20 is shielded by the display component 10. Detection assembly 20 may be used to detect gesture operations by a user on display assembly 10. In one example, the detection assembly 20 may only turn on when the display screen 11 is in an illuminated state; in another example, the detecting component 20 can be controlled to be turned on or off by a switch provided on the electronic device 100; in yet another example, the detection component 20 may be turned on in both standby and operating states of the electronic device 100.
The detection component 20 may correspond to a position of the display area 14 of the display component 10, for example, be disposed at a middle position of the display area 14, so as to facilitate a user to perform a gesture operation on the display area 14; or the detection component 20 may be set to correspond to the position of the non-display area 15 of the display component 10, and a user may perform a touch operation on the display area 14 and perform a gesture operation on the non-display area 15, so that the interaction manner between the user and the electronic device 100 is enriched; or the detection assembly 20 corresponds partially to the position of the display area 14 and partially to the position of the non-display area 15. The detection assembly 20 can be positioned near the upper edge 16, such as in the bang of a "bang screen," or flush with the bang; the detection assembly 20 may be disposed proximate the lower edge 17; the sensing assembly 20 may also be positioned proximate the side edge 18.
The detection assembly 20 includes a light generator 21 and a light receiver 22. The light generator 21 is used for emitting infrared light to the display assembly 10, the infrared light can pass through the display assembly 10 to reach the outside of the electronic device 100, when a foreign object, such as a user's hand, is stroked over the display assembly 10, the foreign object can reflect the infrared light, and a part of the reflected infrared light can pass through the display assembly 10 and reach the light receiver 22. The optical receiver 22 receives the infrared light and generates an electrical signal. Wherein the light generator 21 may be an infrared light emitting diode and the light receiver 22 may be a photodiode.
Under certain conditions, the intensity of the electrical signal generated by the optical receiver 22 is inversely proportional to the distance from the external object to the optical receiver 22. That is, the farther the external object is from the optical receiver 22, the weaker the intensity of the electrical signal; the closer the foreign object is to the optical receiver 22, the stronger the intensity of the electrical signal. In the process that the external object approaches the light receiver 22, the intensity of the electric signal is increased; the intensity of the electrical signal decreases as the foreign object moves away from the optical receiver 22. In this way, the processor 30 can recognize the operation gesture by determining the variation trend of the electric signal strength.
In the embodiment of the present invention, the number of the light generators 21 is plural, and the number of the light receivers 22 is also plural. The plurality of light generators 21 are configured to emit a plurality of infrared light beams that pass through the display assembly 10, and the plurality of light receivers 22 are configured to receive the plurality of infrared light beams reflected by the external object and passing through the display assembly 10 to generate a plurality of electrical signals. The processor 30 recognizes the operation gesture according to the plurality of electrical signals. The user can perform input operation on the electronic device 100 through different operation gestures without contacting the display component 10, and the display component 10 is not polluted.
In certain embodiments, the processor 30 is connected to a plurality of light generators 21 and a plurality of light receivers 22, respectively. The processor 30 may independently control the operation of each light generator 21 and each light receiver 22. Specifically, the processor 30 may recognize the operation gesture by controlling the operation of one of the light generators 21 and the plurality of light receivers 22; or the processor 30 recognizes the operation gesture by controlling the plurality of light generators 21 and one of the light receivers 22 to operate; or the processor 30 recognizes the operation gesture by controlling the plurality of light generators 21 and the plurality of light receivers 22 to operate.
The following description will take the processor 30 as an example to recognize the operation gesture by controlling the operation of one light generator 21 and a plurality of light receivers 22.
Referring to fig. 3, in some embodiments, the plurality of light receivers 22 are distributed on at least two opposite sides of the at least one light generator 21 (other redundant light generators 21 are not shown in fig. 3), for example, the plurality of light receivers 22 are distributed on the left and right sides of the light generator 21, or the plurality of light receivers 22 are distributed on the upper and lower sides of the light generator 21, or the plurality of light receivers 22 are distributed on the left, right, upper and lower sides of the light generator 21. The number of the light receivers 22 may be set according to practical situations, for example, the number of the light receivers 22 is two, two light receivers 22 are respectively distributed on the left side and the right side of the light generator 21, and the distances between the light receivers 22 distributed on the left side and the right side and the light generator 21 may be equal. In one example, the plurality of light receivers 22 are distributed around the light generator 21 at equal angular intervals, for example, the angle between the line connecting two adjacent light receivers 22 and the light generator 21 is 180 degrees, 90 degrees, or 60 degrees, and specifically, the plurality of light receivers 22 are arranged around the light generator 21, and the plurality of light receivers 22 may be distributed in a circle around the position of the light generator 21.
The processor 30 may receive the electrical signals generated by the plurality of light receivers 22 and determine the operation gesture of the user according to the magnitude of the intensity of the electrical signals generated by different light receivers 22, the generated time, the trend of the change, and the like. In one example, referring to fig. 4, the light receivers 22 are distributed at least on a first side and a second side of the light generator 21, the first side and the second side being opposite to the light generator 21, and the number of the light receivers 22 on each side may be equal.
When the intensity of the electrical signal generated by the optical receiver 22 on the first side (shown as a solid line in fig. 4 b) is greater than the intensity of the electrical signal generated by the optical receiver 22 on the second side (shown as a dashed line in fig. 4 b), it can be determined that the hand of the user is on the first side, and when the intensity of the electrical signal changes such that the electrical signal generated by the optical receiver 22 on the second side is greater than the electrical signal generated by the optical receiver 22 on the first side, it can be determined that the hand of the user is on the second side, so that the operation gesture of the user can be comprehensively determined as being stroked from the first side to the second side. Similarly, when the intensity of the electrical signal generated by the optical receiver 22 on the second side is greater than the intensity of the electrical signal generated by the optical receiver 22 on the first side, it can be determined that the hand of the user is on the second side, and when the intensity of the electrical signal is changed to that the electrical signal generated by the optical receiver 22 on the first side is greater than the electrical signal generated by the optical receiver 22 on the second side, it can be determined that the hand of the user is on the first side, so that the operation gesture of the user can be comprehensively determined as being stroked from the second side to the first side.
It should be noted that the first side and the second side may be two opposite sides, for example, the first side and the second side are a left side and a right side, or an upper side and a lower side, or a left upper side and a right lower side, and the like. Further, after recognizing that the user strokes from one side to the other side, the electronic device 100 may perform a corresponding response, for example, the content displayed by the display component 10 of the electronic device 100 is turned over, the electronic device 100 is slid to unlock, the volume of the electronic device 100 is turned up or down, and the like.
Referring to fig. 5, in some embodiments, when the intensities of the electrical signals of the light receivers 22 increase at the same rate, the processor 30 is configured to recognize the operation gesture as moving toward the display device 10 along the light emitting direction of the display device 10. Referring to fig. 6, in some embodiments, when the intensities of the electrical signals of the plurality of light receivers 22 decrease at the same rate, the operation gesture is recognized to be stroked away from the display device 10 along the light emitting direction of the display device 10.
In one example, the same rates do not require the rates to be exactly equal, and when the difference in rates is small, the rates of increase or decrease may also be considered the same. Specifically, in the example shown in fig. 5 and 6, the number of the light receivers 22 is two, and the generated electrical signals of the two light receivers 22 are the electrical signals S1 and S2, respectively. As in fig. 5, when the operation gesture is a stroke in a direction to approach the display assembly 10, S1 and S2 increase at the same time, and the rate of increase also changes at the same time; as shown in fig. 6, when the operation gesture is a stroke in a direction away from the display assembly 10, S1 and S2 are simultaneously decreased, and the rate of decrease is also simultaneously changed. Further, the electronic device 100 may generate a corresponding response to the above-mentioned operation gesture, for example, when the operation gesture is a swipe in a direction close to the display component 10, the display brightness of the display component 10 may be decreased, and when the operation gesture is a swipe in a direction away from the display component 10, the display brightness of the display component 10 may be increased. Of course, the specific response mode of the electronic device 100 is not limited to the above exemplary discussion, and may also be adjusting parameters such as the volume of the electronic device 100.
The following description will take an example in which the processor 30 recognizes an operation gesture by controlling the operation of the plurality of light generators 21 and one of the light receivers 22.
Referring to fig. 7, the plurality of light generators 21 are distributed on at least two opposite sides of the at least one light receiver 22 (other redundant light receivers 22 are not shown in fig. 7), for example, the plurality of light generators 21 are distributed on the left and right sides of the light receiver 22, or the plurality of light generators 21 are distributed on the upper and lower sides of the light receiver 22, or the plurality of light generators 21 are distributed on the left, right, upper and lower sides of the light receiver 22. For example, two light generators 21 are located on opposite sides of the light receiver 22, i.e. the light receiver 22 is located between the two light generators 21, and the two light generators 21 may be located at equal distances from the light receiver 22. In one example, the plurality of light generators 21 are distributed at equal angular intervals around the periphery of the light receiver 22, for example, the angle between the connecting line of two adjacent light generators 21 and the light receiver 22 is 180 degrees, 90 degrees, or 60 degrees, specifically, the plurality of light generators 21 are arranged around the light receiver 22, and the plurality of light generators 21 may be distributed in a circle with the position of the light receiver 22 as the center.
The processor 30 may receive the plurality of electrical signals generated by the optical receiver 22 and determine the operation gesture of the user according to the strength, the time, the trend of the change, and other information of the plurality of electrical signals generated by the optical receiver 22. In one example, referring to fig. 8, the plurality of light generators 21 are distributed on at least a first side and a second side of the light receiver 22, the first side and the second side are opposite to the light receiver 22, and the number of the light receivers 22 on each side can be equal.
Referring to fig. 9, in the present embodiment, the plurality of light generators 21 can be configured to emit a plurality of infrared lights with different wavelengths, for example, any one value of the infrared lights in a range of 770 nm to 1000 nm, and the light receiver 22 receives the infrared lights emitted by the plurality of light generators 21 at the same time. The light generator 21 at the first side emits infrared light at a first wavelength l1 and the light generator 21 at the second side emits infrared light at a second wavelength l 2. The optical receiver 22 receives the infrared light with the first wavelength l1 to generate a first type of electric signal Q1, and receives the infrared light with the second wavelength l2 to generate a second type of electric signal Q2. When the hand of the user slides from the first side to the second side or slides from the second side to the first side, the time of the peak value of the first type electric signal Q1 is inconsistent with the time of the peak value of the second type electric signal Q2, and the operation gesture is identified by judging the time of the peak value of the first type electric signal Q1 and the second type electric signal Q2.
Specifically, the processor 30 is configured to recognize the operation gesture as a stroke from the first side to the second side when the time t1 of the peak occurrence of the first type electric signal Q1 is detected to be earlier than the time t2 of the peak occurrence of the second type electric signal Q2; when the time t2 when the peak of the second type electric signal Q2 is detected is earlier than the time t1 when the peak of the first type electric signal Q1 is detected, the operation gesture is recognized as a stroke from the second side to the first side.
It should be noted that the first side and the second side may be two opposite sides, for example, the first side and the second side are a left side and a right side, or an upper side and a lower side, or a left upper side and a right lower side, and the like. Further, after recognizing that the user strokes from one side to the other side, the electronic device 100 may perform a corresponding response, for example, the content displayed by the display component 10 of the electronic device 100 is turned over, the electronic device 100 is slid to unlock, the volume of the electronic device 100 is turned up or down, and the like.
In some embodiments, the light generating characteristics of the plurality of light generators 21 may not be such as to simultaneously emit infrared light of different wavelengths. In the present embodiment, the plurality of light generators 21 may be configured to alternately emit a plurality of infrared lights of the same wavelength, and the processor 30 is configured to obtain the light emitting timing of the plurality of light generators 21; and recognizing the operation gesture according to the luminous time sequence and the intensity of the electric signal.
Specifically, the processor 30 may determine, according to the light emitting timing of the light generators 21, which light generator 21 emits the infrared light at any time, that is, although the wavelengths of the infrared light emitted by the light generators 21 are the same, the processor 30 may determine, according to the time when the electrical signals are received and the light emitting timing of the light generators 21, which light generator 21 the electrical signal corresponds to.
Taking fig. 10 as an example, the two light generators 21 emit light alternately, for example, each light generator 21 may emit light alternately for 0.1 msec. After the two light generators 21 have emitted light once, the processor 30 compares the intensity of the electrical signals corresponding to the light emitted by the two light generators 21, and at this time, it can be determined whether the hand of the user is located at a position close to the light generator 21 on the left side or a position close to the light generator 21 on the right side, that is, whether the hand of the user is located on the left side or the right side of the light receiver 22.
Further, the processor 30 may further receive several sets of electrical signals generated by the two light generators 21, and identify the direction of the hand stroke of the user according to the variation trend of the intensity of the electrical signals corresponding to each light generator 21. For example, if it is determined that the hand of the user is on the left side of the optical receiver 22, if the electrical signal corresponding to the left light generator 21 is gradually increased and the electrical signal corresponding to the right light generator 21 is also gradually increased, it indicates that the hand of the user is stroked to the right side; if the electrical signal corresponding to the left light generator 21 is gradually decreased and the electrical signal corresponding to the right light generator 21 is also gradually decreased at this time, it indicates that the user's hand is stroked to the left side. Similarly, if it is determined that the hand of the user is on the right side of the optical receiver 22, if the electrical signal corresponding to the left light generator 21 is gradually increased and the electrical signal corresponding to the right light generator 21 is also gradually increased, it indicates that the hand of the user is stroked to the left side; if the electrical signal corresponding to the left light generator 21 is gradually decreased and the electrical signal corresponding to the right light generator 21 is also gradually decreased at this time, it indicates that the user's hand is stroked to the right. Therefore, the user can input the operation instruction to the electronic apparatus 100 without directly touching the electronic apparatus 100.
The following description will take an example in which the processor 30 recognizes an operation gesture by controlling the operation of the plurality of light generators 21 and the plurality of light receivers 22.
Referring to fig. 11, in some embodiments, a plurality of light receivers 22 correspond to a plurality of light generators 21, respectively. Each light receiver 22 is located adjacent to a corresponding one of the light generators 21. The number of the light generators 21 and the light receivers 22 may be set according to actual situations, for example, the number of the light generators 21 and the number of the light receivers 22 are two, three, four, five, or more.
The plurality of light receivers 22 are distributed along a first direction, and the processor 30 is used for identifying an operation gesture according to the intensity change of the electric signal generated by the light receivers 22 in the first direction; the light receivers 22 are distributed along the second direction, and the processor 30 is used for identifying the operation gesture according to the intensity change of the electric signal generated by the light receivers 22 in the second direction; or a plurality of light receivers 22 distributed along a first direction and a second direction, and the processor 30 is configured to recognize the operation gesture according to the intensity variation of the electrical signals generated by the light receivers 22 in the first direction and the second direction.
In the example shown in fig. 11, the number of the light generators 21 and the light receivers 22 is five each. The five light receivers 22 are a first light receiver 221, a second light receiver 222, a third light receiver 223, a fourth light receiver 224, and a fifth light receiver 225, respectively. The first light receiver 221, the third light receiver 223, and the second light receiver 222 are distributed in a first direction, and the fourth light receiver 224, the third light receiver 223, and the fifth light receiver 225 are distributed in a second direction. The distribution of the five light generators 21 is similar to that of the five light receivers 22, and will not be described herein.
When the intensity of the electrical signal generated by the first optical receiver 221 is greater than the intensity of the electrical signal generated by the second optical receiver 222, it can be determined that the hand of the user is located at the position of the first optical receiver 221, and when the intensity of the electrical signal is changed to that the electrical signal generated by the second optical receiver 222 is greater than the electrical signal generated by the first optical receiver 221, it can be determined that the hand of the user is located at the position of the second optical receiver 222, so that the operation gesture of the user can be comprehensively determined as sliding along the first direction. Similarly, when the intensity of the electrical signal generated by the second optical receiver 222 is greater than the intensity of the electrical signal generated by the first optical receiver 221, it can be determined that the hand of the user is located at the position of the second optical receiver 222, and when the intensity of the electrical signal is changed to that the electrical signal generated by the first optical receiver 221 is greater than the electrical signal generated by the second optical receiver 222, it can be determined that the hand of the user is located at the position of the first optical receiver 221, so that it can be comprehensively determined that the operation gesture of the user slides in the opposite direction of the first direction.
Similarly, the processor 30 may judge that the operation gesture of the user is sliding in the second direction or the reverse direction of the second direction through the strong heights of the electric signals generated by the fourth optical receiver 224 and the fifth optical receiver 225.
Further, when the intensities of the electric signals generated by the fourth light receiver 224, the third light receiver 223 and the fifth light receiver 225 change (increase, decrease or remain unchanged) at the same rate, and the operation gesture of the user has a process of sliding along the first direction, the operation gesture of the user can be comprehensively judged to be the operation gesture of flipping around the second direction (as shown in fig. 11 b). When the intensity of the electric signals generated by the first light receiver 221, the third light receiver 223 and the second light receiver 222 changes (increases, decreases or remains unchanged) at the same rate, and the operation gesture of the user has a process of sliding along the second direction, the operation gesture of the user can be comprehensively judged to be a flipping around the first direction as an axis.
Of course, the processor 30 may also use other determination mechanisms to identify the operation gesture (such as oblique incision, translation, circular sliding, etc.) of the user according to the intensity of the electrical signals generated by the plurality of light receivers 22, which is not limited herein.
Referring again to fig. 1, in some embodiments, the display assembly 10 is formed with a light emitting surface 1c and a back surface 1d opposite to each other, and the back surface 1d is coated with the infrared transmissive ink 13. The light emitting surface 1c may be formed on the cover plate 12, light emitted by the display module 10 passes through the light emitting surface 1c and then enters the outside, the backlight surface 1d is opposite to the light emitting surface 1c, the detection module 20 is disposed closer to the backlight surface 1d, infrared light emitted by the light generator 21 passes through the backlight surface 1d and the light emitting surface 1c and then enters the outside environment, and infrared light reflected by an external object passes through the light emitting surface 1c and the backlight surface 1d and then reaches the light receiver 22. The infrared transmitting ink 13 can filter most (more than 80%) of visible light, and has a high transmittance (more than 80%) to infrared light, which can pass through the infrared transmitting ink 13 at a high transmittance, and the detection member 20 in the display member 10 is difficult to be observed by a user from the outside.
In the description of the specification, reference to the terms "certain embodiments," "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, unless specifically limited otherwise.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and those skilled in the art can make changes, modifications, substitutions and alterations to the above embodiments within the scope of the present invention, which is defined by the claims and their equivalents.
Claims (10)
1. An electronic device comprising a display component, a detection component, and a processor, the detection component disposed below the display component, the detection component comprising:
a plurality of light generators for emitting a plurality of beams of infrared light and passing through the display assembly; and
a plurality of light receivers for receiving a plurality of the infrared light reflected by an external object and passing through the display assembly to generate a plurality of electrical signals;
the processor is respectively connected with the plurality of light receivers and is used for identifying an operation gesture according to the plurality of electric signals;
a plurality of the light generators are used for alternately emitting a plurality of beams of infrared light with the same wavelength;
the processor is configured to:
acquiring light emitting time sequences of a plurality of light generators; and
and identifying an operation gesture according to the light-emitting time sequence and the intensity of the electric signal.
2. The electronic device according to claim 1, wherein the display component is formed with a display area and a non-display area, and the detection component corresponds to a position of the display area, and/or the detection component corresponds to a position of the non-display area.
3. The electronic device as claimed in claim 1, wherein the display module is formed with a light emitting surface and a light emitting surface opposite to each other, and a plurality of beams of the infrared light emitted by the plurality of light generators sequentially pass through the light emitting surface and the light emitting surface, and the light emitting surface is coated with infrared transmissive ink.
4. The electronic device of claim 1, wherein a plurality of the light receivers are distributed on at least opposing sides of at least one of the light generators.
5. The electronic device of claim 4, wherein a plurality of the light receivers are distributed on opposing first and second sides of at least one of the light generators, and wherein the processor is configured to:
recognizing an operation gesture as a stroke from the first side to the second side when the electrical signal generated by the optical receiver of the first side is greater than the electrical signal generated by the optical receiver of the second side to become greater than the electrical signal generated by the optical receiver of the first side; or/and
recognizing an operation gesture as stroking from the second side to the first side when the electrical signal generated by the optical receiver of the second side is greater than the electrical signal generated by the optical receiver of the first side to change to the electrical signal generated by the optical receiver of the first side being greater than the electrical signal generated by the optical receiver of the second side.
6. An electronic device according to claim 1, wherein a plurality of the light generators are distributed on at least opposing sides of at least one of the light receivers.
7. An electronic device according to claim 6, wherein a plurality of the light generators are configured to emit a plurality of beams of infrared light of different wavelengths simultaneously.
8. The electronic device of claim 7, wherein a plurality of light generators are distributed on opposing first and second sides of at least one light receiver, wherein the light generator on the first side emits infrared light at a first wavelength and the light generator on the second side emits infrared light at a second wavelength, and wherein the light receiver receives the infrared light at the first wavelength to generate a first type of electrical signal and the infrared light at the second wavelength to generate a second type of electrical signal, and wherein the processor is configured to:
when the time of the peak occurrence of the first type of electric signals is detected to be earlier than the time of the peak occurrence of the second type of electric signals, identifying an operation gesture as a stroke from the first side to the second side; and
when the time of the second type of electric signal appearing peak is detected to be earlier than the time of the first type of electric signal appearing peak, identifying that the operation gesture is stroked from the second side to the first side.
9. The electronic device according to claim 1, wherein a plurality of the light receivers correspond to a plurality of the light generators, respectively.
10. The electronic device of claim 9, wherein a plurality of the light receivers are distributed along a first direction; and/or a plurality of said light receivers are distributed along a second direction;
the processor is configured to:
identifying an operating gesture from a change in intensity of the electrical signal generated by the light receiver in the first direction and/or a change in intensity of the electrical signal generated by the light receiver in the second direction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810408297.3A CN108710449B (en) | 2018-05-02 | 2018-05-02 | Electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810408297.3A CN108710449B (en) | 2018-05-02 | 2018-05-02 | Electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108710449A CN108710449A (en) | 2018-10-26 |
| CN108710449B true CN108710449B (en) | 2022-03-22 |
Family
ID=63868664
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810408297.3A Active CN108710449B (en) | 2018-05-02 | 2018-05-02 | Electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108710449B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109742109B (en) * | 2019-01-04 | 2021-01-26 | 京东方科技集团股份有限公司 | Display device, manufacturing method thereof and method for collecting information by using display device |
| CN112153187B (en) * | 2019-06-28 | 2022-06-14 | Oppo广东移动通信有限公司 | Electronic equipment and display screen state control method |
| CN111651034B (en) * | 2019-12-05 | 2023-12-26 | 寰采星科技(宁波)有限公司 | Intelligent glasses, control method and control chip of intelligent glasses |
| CN115856912B (en) * | 2023-02-06 | 2023-05-30 | 宜科(天津)电子有限公司 | Data processing system for detecting movement direction of object |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1892341A (en) * | 2005-07-09 | 2007-01-10 | 群康科技(深圳)有限公司 | Light-guiding plate and back-light module group using same and liquid-crystal display |
| CN102299990A (en) * | 2010-06-22 | 2011-12-28 | 希姆通信息技术（上海）有限公司 | Gesture control cellphone |
| CN102656547A (en) * | 2009-10-19 | 2012-09-05 | 平蛙实验室股份公司 | Determining touch data for one or more objects on a touch surface |
| CN204595878U (en) * | 2015-03-13 | 2015-08-26 | 彩丽电子（深圳）有限公司 | Gesture identification circuit |
| CN105453006A (en) * | 2013-07-08 | 2016-03-30 | 摩托罗拉移动有限责任公司 | Gesture-sensitive display |
| KR20160141023A (en) * | 2015-05-27 | 2016-12-08 | 주식회사 에보시스 | The method of dynamic and static gesture recognition using depth camera and interface of immersive media contents |
| CN106293282A (en) * | 2015-06-03 | 2017-01-04 | 西藏丹贝投资有限公司 | A kind of infrared touch panel with gesture identification function |
| CN206470695U (en) * | 2017-02-22 | 2017-09-05 | 张磊 | The system and device of a kind of non-contact type touch control operation |
| CN107329620A (en) * | 2017-07-03 | 2017-11-07 | 京东方科技集团股份有限公司 | A kind of suspension touch control display device |
| CN107450232A (en) * | 2017-08-18 | 2017-12-08 | 深圳市德仓科技有限公司 | A kind of backlight module and its visual color ameliorative way |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8836645B2 (en) * | 2008-12-09 | 2014-09-16 | Microsoft Corporation | Touch input interpretation |
| CN104320574B (en) * | 2014-09-26 | 2017-06-09 | 广东欧珀移动通信有限公司 | A kind of method of gesture control camera rotation, device and infrared gesture sensor |
| CN105094461B (en) * | 2015-07-10 | 2018-07-27 | 深圳市汇顶科技股份有限公司 | Touch pressure detection device and method |
| CN107608454B (en) * | 2017-08-31 | 2020-01-14 | Oppo广东移动通信有限公司 | Display screen and electronic equipment |
-
2018
- 2018-05-02 CN CN201810408297.3A patent/CN108710449B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1892341A (en) * | 2005-07-09 | 2007-01-10 | 群康科技(深圳)有限公司 | Light-guiding plate and back-light module group using same and liquid-crystal display |
| CN102656547A (en) * | 2009-10-19 | 2012-09-05 | 平蛙实验室股份公司 | Determining touch data for one or more objects on a touch surface |
| CN102299990A (en) * | 2010-06-22 | 2011-12-28 | 希姆通信息技术（上海）有限公司 | Gesture control cellphone |
| CN105453006A (en) * | 2013-07-08 | 2016-03-30 | 摩托罗拉移动有限责任公司 | Gesture-sensitive display |
| CN204595878U (en) * | 2015-03-13 | 2015-08-26 | 彩丽电子（深圳）有限公司 | Gesture identification circuit |
| KR20160141023A (en) * | 2015-05-27 | 2016-12-08 | 주식회사 에보시스 | The method of dynamic and static gesture recognition using depth camera and interface of immersive media contents |
| CN106293282A (en) * | 2015-06-03 | 2017-01-04 | 西藏丹贝投资有限公司 | A kind of infrared touch panel with gesture identification function |
| CN206470695U (en) * | 2017-02-22 | 2017-09-05 | 张磊 | The system and device of a kind of non-contact type touch control operation |
| CN107329620A (en) * | 2017-07-03 | 2017-11-07 | 京东方科技集团股份有限公司 | A kind of suspension touch control display device |
| CN107450232A (en) * | 2017-08-18 | 2017-12-08 | 深圳市德仓科技有限公司 | A kind of backlight module and its visual color ameliorative way |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108710449A (en) | 2018-10-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108710449B (en) | Electronic device | |
| EP2419812B1 (en) | Optical touch screen systems using reflected light | |
| US8368663B2 (en) | Touch sensing using shadow and reflective modes | |
| EP3260956B1 (en) | Non-contact input device and method | |
| KR100942293B1 (en) | A source of light type touch sensing method, touch panel and the system | |
| CN103744542B (en) | Hybrid pointing device | |
| US20100225588A1 (en) | Methods And Systems For Optical Detection Of Gestures | |
| US8854313B2 (en) | Sensor-integrated illuminated key sheet | |
| CN104932760A (en) | Infrared touch control method and device | |
| CN111312793B (en) | Electronic equipment | |
| EP3171256B1 (en) | Infrared touch screen and display device | |
| US11417141B2 (en) | In-screen fingerprint identification apparatus and electronic device | |
| WO2020253615A1 (en) | Fingerprint processing method, and electronic apparatus | |
| EP2960772A1 (en) | Electronic device for sensing 2d and 3d touch and method for controlling the same | |
| CN110770748B (en) | Optical fingerprint identification device, electronic equipment and fingerprint identification method | |
| CN101825797A (en) | Photo induction touch-control liquid crystal display device | |
| CN110825254B (en) | Touch device and interaction method thereof | |
| KR20130136313A (en) | Touch screen system using touch pen and touch recognition metod thereof | |
| CN102132239B (en) | Interactive display screen | |
| CN103309542A (en) | Multifunctional input equipment | |
| KR20050077230A (en) | Pen-type position input device | |
| JP2015095210A (en) | Operation input device | |
| KR20090118792A (en) | Touch screen apparatus | |
| JP2014063212A (en) | Touch panel device | |
| CN111240511A (en) | Display device and driving method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |