WO2018195828A1 - 眼球遥控系统及电子装置 - Google Patents

眼球遥控系统及电子装置 Download PDF

Info

Publication number
WO2018195828A1
WO2018195828A1 PCT/CN2017/082054 CN2017082054W WO2018195828A1 WO 2018195828 A1 WO2018195828 A1 WO 2018195828A1 CN 2017082054 W CN2017082054 W CN 2017082054W WO 2018195828 A1 WO2018195828 A1 WO 2018195828A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
light emitting
eyeball
display screen
control system
Prior art date
Application number
PCT/CN2017/082054
Other languages
English (en)
French (fr)
Inventor
杨孟达
Original Assignee
深圳市汇顶科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市汇顶科技股份有限公司 filed Critical 深圳市汇顶科技股份有限公司
Priority to PCT/CN2017/082054 priority Critical patent/WO2018195828A1/zh
Priority to CN201780000327.0A priority patent/CN107223276B/zh
Publication of WO2018195828A1 publication Critical patent/WO2018195828A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/30—User interface

Definitions

  • the present application relates to an eyeball remote control system and an electronic device, and more particularly to an eyeball remote control system and an electronic device capable of determining a concentrated area of a user's eyes.
  • the main object of the present application is to provide an eyeball remote control system and an electronic device that can determine a region where a user's eyes are concentrated.
  • an eyeball remote control system including a display screen including a plurality of pixel units, the plurality of pixel units including a plurality of invisible light emitting elements, and the plurality of pixel units
  • the plurality of invisible light emitting elements emit an incident light signal in a time sequence
  • the plurality of photosensitive elements are configured to receive a reflected light signal corresponding to the incident light signal, wherein the reflected light signal is reflected from a user's An eyeball
  • a judging module for receiving the reflected light according to At a time of the signal, determining a position of an invisible light emitting element corresponding to the reflected light signal on the display screen, and determining that the user's gaze is concentrated on a specific area of the display screen
  • an operation module Executing an operation related to the specific area.
  • the incident light signal is an invisible light signal
  • the invisible light emitting element is an invisible light emitting diode or an invisible light emitting transistor.
  • the incident light signal is an infrared signal
  • the invisible light emitting element is an infrared light emitting diode or an infrared light emitting transistor.
  • the determining module is configured according to the at least one pixel unit At the position of the display screen, it is determined that the user's gaze is concentrated on the specific area of the display screen.
  • the eyeball remote control system further includes a modulation signal generating module coupled to the display screen for generating a modulated signal, wherein the plurality of pixel units generate the incident light signal according to the modulated signal, The eyeball remote control system captures the reflected light signal associated with the modulated signal.
  • the modulated signal is composed of a plurality of square waves.
  • the plurality of pixel units emit the incident light signal by a first pixel unit of the plurality of pixel units at a first time in the chronological order, and by the plurality of A second pixel unit in the pixel unit emits the incident light signal.
  • the plurality of pixel units are arranged in an array, and the plurality of pixel units emit the incident light signal by a pixel unit located in a first row of the array at a first time according to the chronological order. Transmitting the incident optical signal by a pixel unit located in a second row of the array at a second time Number, the incident optical signal is emitted by a pixel unit located in a first column of the array at a third time, and the incident is emitted by a pixel unit located in a second column of the array at a fourth time Optical signal.
  • the eyeball remote control system further includes a modulation signal generating module coupled to the display screen for generating a first modulated signal and a second modulated signal; wherein the first modulated signal and the first The two modulated signals have a phase difference of 180° between them.
  • a modulation signal generating module coupled to the display screen for generating a first modulated signal and a second modulated signal; wherein the first modulated signal and the first The two modulated signals have a phase difference of 180° between them.
  • a first pixel unit of the plurality of pixel units generates and emits a first incident light signal according to the first modulation signal
  • a second pixel unit of the plurality of pixel units is configured according to The second modulated signal generates and emits a second incident light signal.
  • the distance is greater than one A specific value, the specific value being one-half of a picture width displayed by the display screen or one-half of a picture height.
  • the plurality of pixel units are arranged in an array, and at a specific time, a pixel unit of a first row in the array generates and emits a first incident light signal according to the first modulation signal, and simultaneously A pixel unit of a second row in the array generates and emits a second incident light signal according to the second modulated signal, and the first modulated signal and the second modulated signal have a phase difference of 180°.
  • a vertical distance corresponding to the first line of the first horizontal position of the display screen and a second horizontal position corresponding to the second line of the display screen the vertical distance It is greater than one-half of the height of a picture of the display screen.
  • the plurality of pixel units are arranged in an array.
  • a pixel unit of a first column in the array generates and emits a first incident light signal according to the first modulation signal.
  • a pixel unit of a second column in the array generates and emits a second incident light signal according to the second modulated signal, and the first modulated signal and the second modulated signal have a phase of 180° difference.
  • a horizontal distance corresponding to a first vertical position of the first column on the display screen and a second vertical position corresponding to the second column on the display screen the horizontal distance Greater than one-half of a width of the display screen.
  • the plurality of photosensitive elements are disposed in a light extraction module, and the light extraction module is disposed around the display screen.
  • the plurality of photosensitive elements are respectively disposed in the plurality of pixel units of the display screen.
  • the present application further provides an electronic device including an eyeball remote control system, the eyeball remote control system including a display screen including a plurality of pixel units, the plurality of pixel units including a plurality of invisible light emitting elements, the plurality of The plurality of invisible light emitting elements in the pixel unit emit an incident light signal in a time sequence; the plurality of photosensitive elements are configured to receive a reflected light signal corresponding to the incident light signal, wherein the reflected light signal reflects a judging panel of a user; a judging module, configured to determine, according to a time when the reflected light signal is received, a position of an invisible light emitting component corresponding to the reflected light signal on the display screen, and determine The user's gaze focuses on a particular area of the display screen; and an arithmetic module that performs an operation associated with the particular area.
  • the eyeball remote control system including a display screen including a plurality of pixel units, the plurality of pixel units including a plurality of invisible light emitting
  • the application uses a plurality of pixel units to scan whether a user's gaze is concentrated in a specific area of the display screen, and the light extraction module receives the reflected light signal corresponding to the incident light signal and is reflected from the user's eye ball, and the determining module can emit the incident light signal according to the time.
  • the position of the pixel unit determines that the user's gaze is concentrated on the area of the display screen.
  • FIG. 1 is a schematic diagram of the appearance of an eyeball remote control system according to an embodiment of the present application.
  • FIG. 2 is a functional block diagram of the eyeball remote control system of FIG. 1.
  • FIG. 3 is a schematic functional block diagram of an eyeball remote control system according to an embodiment of the present application.
  • Figure 4 is a waveform diagram of a modulated signal.
  • FIG. 5 is a schematic functional block diagram of an eyeball remote control system according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of the appearance of the eyeball remote control system of FIG. 5.
  • Fig. 7 is a waveform diagram of a plurality of modulated signals.
  • FIG. 8 is a schematic diagram of the appearance of the eyeball remote control system of FIG. 5.
  • FIG. 9 is a schematic diagram of the appearance of the eyeball remote control system of FIG. 5.
  • FIG. 10 is a schematic diagram of a pixel unit according to an embodiment of the present application.
  • FIG. 11 is a schematic diagram of a pixel unit according to an embodiment of the present application.
  • FIG. 12 is a schematic diagram of the appearance of an eyeball remote control system according to an embodiment of the present application.
  • FIG. 13 is a functional block diagram of the eyeball remote control system of FIG.
  • FIG. 14 is a schematic diagram of an electronic device according to an embodiment of the present application.
  • FIG. 1 and FIG. 2 are respectively schematic diagrams showing the appearance and functional blocks of the eyeball remote control system 10 according to the embodiment of the present application.
  • the eyeball remote control system 10 includes a display screen 12, a light extraction module 14, a determination module 16, and an operation module 18.
  • Display 12 The pixel unit DPX includes a light emitting element IVC, and the light emitting element IVC can be a light emitting diode (LED) or a light emitting transistor (Light Emitting Transistor).
  • the plurality of pixel units DPX are arranged on the display screen 12 as an array of pixels, and the plurality of pixel units DPX can respectively emit an incident light signal LE in a time sequence.
  • the light extraction module 14 is disposed around the display screen 12, and may include an optical lens (Lens) and a plurality of such as a Charge-coupled Device (CCD) or a complementary CMOS Image Sensor (CIS). In one embodiment, the light extraction module 14 can be disposed in a camera mounted around the display screen 12.
  • the light extraction module 14 is configured to receive a reflected light signal LR, wherein the reflected light signal LR is an eyeball EB corresponding to the incident light signal LE and reflected from a user.
  • the determining module 16 can determine that the corresponding reflected light signal LR is reflected by the eyeball EB according to the time when the reflected light signal LR is received.
  • the operation module 18 can be a microcontroller (MCU) or a central processing unit (CPU).
  • the present application utilizes a plurality of light-emitting elements IVC of a plurality of pixel units DPX to sequentially emit (in a specific time sequence) an incident light signal LE, which is equivalent to scanning a user's gaze with a plurality of pixel units DPX. Focusing on a certain area of the display screen 12, if the user's gaze is indeed concentrated in a certain area of the display screen 12, the light extraction module 14 can receive the reflected light signal LR corresponding to the incident light signal LE, at this time, the determining module 16 It can be judged that the user's eyes are concentrated on the area of the display screen 12.
  • the incident optical signal LE when the user's eye toward the display region 12 a ZN (i.e., at times t 1 a first user's eye toward the display screen 12 region ZN), and the case of the pixel region ZN turn DPX unit 'of the light emitting element IVC' emitted from the incident optical signal LE (i.e., according to the particular time sequence, times t 1 to the first light emitting module unit pixel DPX turn 'of the incident optical signal emitted IVC LE, that is to say the pixel unit DPX 'in the light emitting module IVC' transmit at times t 1 a first incident signal LE), times t 1 due to the first user's eye toward the display region ZN 12, the incident optical signal to the first LE times t 1 will
  • the reflected light signal LR is reflected by the eyeball EB, that is, the reflected light signal LR corresponding to the incident light signal LE is reflected from the eyeball EB toward the display screen 12.
  • the light extraction module 14 can be a reception times t 1 corresponding to the pixel unit DPX 'signal LE of the incident light LR reflected light signal emitted. Conversely, when the user's gaze is not concentrated on the area ZN, even if the pixel unit DPX' in the area ZN emits the incident light signal LE at this time, the reflected light corresponding to the incident light signal LE will be reflected to the user's location. Other spaces, and the light extraction module 14 will not be able to receive the reflected light corresponding to the incident light signal LE.
  • the determining module 16 may be a first time t 1, it is determined in accordance with the first incident light emission times t 1
  • the pixel unit DPX' of the signal LE is at the position of the display screen 12 to determine that the user's gaze is concentrated on the area ZN of the display screen 12, and the arithmetic module 18 can perform operations related to the area ZN.
  • the operation module 18 performs the operation related to the area ZN.
  • the operation module 18 can instruct the display screen 12 to display the image (Icon) located in the area ZN in a particularly bright manner, or
  • the computing module 18 can instruct the display screen 12 to display an enlarged image of the area ZN (or near the area ZN), or the computing module 18 can instruct the display screen 12 to display a cursor image pointing area ZN, all of which are within the scope of the present application.
  • the pixel unit DPX or the pixel unit DPX′ emits the incident light signal LE, and the pixel unit DPX or the pixel unit DPX′ uses the light-emitting element IVC therein to emit the incident light signal LE.
  • the pixel unit in the region ZN DPX 'at a first time t 1 under the premise of LE signal transmitting incident light only the user's attention to the first time t 1 concentrate in the region ZN, incident optical signal LE
  • the light extraction module 14 receives the reflected light signal LR by being reflected by the eyeball EB to the light extraction module 14.
  • the incident signal LE to be reflected by the eyeball EB elsewhere (except for light capture module 14), and the capture module 14 does not receive light To the reflected light corresponding to the incident light signal LE.
  • the incident light signal LE is an invisible light signal
  • the light-emitting element IVC included in each pixel unit DPX is an invisible light-emitting element (if not Invisible LED or Invisible Light Emitting Transistor.
  • the incident light signal LE is an infrared signal
  • the light emitting element IVC included in each pixel unit DPX is an infrared light emitting diode (IR LED) or an infrared light emitting transistor ( Infrared Emitting Transistor).
  • each pixel unit DPX may include a light emitting element VBC and a light emitting element IVC, as shown in FIG. 10, wherein the light emitting element VBC is a visible light emitting element, which may be an organic light emitting diode (Organic Light). Emitting Diode (OLED), the light-emitting element IVC is an invisible light-emitting element.
  • the display screen 12 displays a picture using a plurality of visible light emitting elements VBC located in the plurality of pixel units DPX, and scans a position where the user's eyes are gazing using a plurality of invisible light emitting elements IVC located in the plurality of pixel units DPX.
  • the manner in which the eyeball remote control system 10 scans the user's eyes with a plurality of pixel units DPX is not limited.
  • the plurality of pixel units DPX may be composed of only one pixel at a time in a time sequence.
  • the light-emitting element IVC in the unit DPX successively emits the incident light signal LE, that is, the incident light signal LE is emitted only by the light-emitting element IVC in the single pixel unit DPX at a time tn, and only by the other pixel at another time tk.
  • the light-emitting element IVC in the unit DPX emits an incident light signal LE.
  • the order in which the plurality of pixel units DPX sequentially emits the incident light signal LE by the light-emitting elements IVC in the single pixel unit DPX at a time is not limited.
  • the plurality of pixel units DPX may be left-to-right and
  • the incident light signal LE is emitted from the light-emitting element IVC in the single pixel unit DPX one by one, or from the light-emitting element IVC in the single pixel unit DPX from the bottom to the top and from the right to the left one by one. Incident light signal LE.
  • the plurality of pixel units DPX may emit the incident light signal LE by the light emitting elements IVC of the plurality of pixel units DPX in a time sequence, for example, the plurality of pixel units DPX may be in a time sequence.
  • the incident light signal LE is emitted by the light-emitting element IVC in the pixel unit DPX of the row X1 of the pixel array, and is emitted by the light-emitting element IVC located in the pixel unit DPX of the other row X2 of the pixel array at a time tx2.
  • the incident optical signal LE emits an incident optical signal LE by a light-emitting element IVC located in a pixel unit DPX of a column Y1 of the pixel array, and at a time ty2, by a pixel unit DPX located in another column Y2 of the pixel array
  • the light-emitting element IVC in the middle emits the incident light signal LE.
  • the present application utilizes a plurality of pixel units DPX to scan whether the user's gaze is concentrated on a certain area of the display screen 12. If the user's gaze does concentrate on a certain area of the display screen 12, the ray capture module 14 receives Corresponding to the reflected light signal LR of the incident light signal LE, the determining module 16 can determine that the user's gaze is concentrated on the area of the display screen 12 according to the position of the pixel unit DPX that emits the incident light signal LE at that time.
  • the display screen 12 can generate the incident light signal LE according to a modulated signal, and the light capturing module 14 and the determining module 16 can capture the optical signal having similar characteristics to the modulated signal. It is further subjected to signal processing (such as filtering, amplification, etc.) to accurately determine the position of the user's gaze.
  • signal processing such as filtering, amplification, etc.
  • FIG. 3 is a functional block diagram of an eyeball remote control system 30 according to an embodiment of the present application.
  • the eyeball remote control system 30 is similar to the eyeball remote control system 10, so the same elements follow the same symbols.
  • the eyeball remote control system 30 further includes a modulation signal generating module 32 coupled to the display screen 12 for generating a modulation signal MOD to a plurality of pixel units of the display screen 12.
  • the light-emitting element IVC in the plurality of pixel units DPX can generate and emit the incident light signal LE according to the modulation signal MOD.
  • the modulation signal MOD may be an alternating current (AC) signal, and the waveform thereof is not limited.
  • AC alternating current
  • FIG. 4 is a waveform diagram of the modulation signal MOD according to an embodiment of the present application.
  • the modulation signal MOD can be composed of a plurality of square waves.
  • the light extraction module 14 can extract the reflected light signal LR related to the modulation signal MOD, and the determination module 16 can further perform signal processing on the optical signal having similar characteristics (such as square wave characteristics) to the modulation signal MOD ( For example, filtering and amplifying operation, the determining module 16 can accurately determine the reflected light signal LR as a reflected light signal corresponding to the incident light signal LE (which has the characteristic of the modulated signal MOD), and judges that the user's eyes are concentrated on the display screen.
  • the position at which the pixel unit DPX that emits the incident light signal LE is located.
  • FIG. 5 is the eyeball remote control system 50 of the embodiment of the present application. Functional block diagram.
  • the eyeball remote control system 50 is similar to the eyeball remote control system 30, so the same elements follow the same symbols.
  • the eyeball remote control system 50 also includes A modulation signal generating module 52 is coupled to the display screen 12 for generating a modulation signal MOD1 and a modulation signal MOD2. As shown in FIG.
  • a light-emitting element IVC1 in a pixel unit DPX1 when a plurality of pixel units DPX in turn chronologically, a light-emitting element IVC1 in a pixel unit DPX1 generates and emits an incident light signal LE1 according to the modulation signal MOD1 (assuming a time ta), the eyeball remote control
  • the system can simultaneously (at time ta) generate and emit another incident optical signal LE2 that is opposite in phase with the incident optical signal LE1 according to the modulation signal MOD2 by a light-emitting element IVC2 in the other pixel unit DPX2, that is, the incident light signals LE1 and LE2 There is a phase difference of 180° between.
  • the reflected light reflected by the light extraction module 14 and reflected from the user's eye EB has the same signal characteristics as the incident light signal LE1, and the reflection
  • the reflected light from other objects approaches or equals the direct current (DC) signal for the sum of the incident light signal LE1 and the incident light signal LE2, thus, the light
  • the capturing module 14 and the judging module 16 can accurately obtain the reflected light reflected from the eye EB of the user, and determine that the user's gaze is concentrated on the position of the pixel unit DPX1 in the display screen 12.
  • the pixel unit DPX1 and the pixel unit DPX2 need to be separated by a sufficient distance.
  • the pixel unit DPX1 is at a first position of the display screen 12 and the pixel unit DPX2 is at a second position of the display screen 12. The distance between them is greater than one-half of the width W of a picture displayed on the display screen 12, or greater than one-half of the height H of a picture displayed on the display screen 12.
  • the eyeball remote control system 30 can generate and emit the incident light signal LE1 at a time tb using a plurality of light-emitting elements IVC located in a plurality of pixel units of a row X1' of the pixel array, and simultaneously at the same time.
  • Tb generates and emits an incident light signal LE2 using a plurality of light-emitting elements IVC in a plurality of pixel units of a row X2' of the pixel array, wherein the row corresponding to the pixel array X1' has a vertical distance ⁇ H between the horizontal position of the display screen 12 and the horizontal position corresponding to the row X2' of the pixel array on the display screen 12.
  • the vertical distance ⁇ H is greater than the height H of the screen displayed by the display screen 12.
  • the eyeball remote control system 30 can generate and emit the incident light signal LE1 at a time tc using a plurality of light-emitting elements IVC located in a plurality of pixel units of a column Y1' of the pixel array, and simultaneously at the same time.
  • Tc generates and emits an incident light signal LE2 using a plurality of light-emitting elements IVC in a plurality of pixel units of a column Y2' of the pixel array, wherein the column Y1' corresponding to the pixel array is at a vertical position of the display screen 12 and corresponds to the pixel
  • the column Y2' of the array has a horizontal distance ⁇ W between the vertical positions of the display screen 12, for example, the horizontal distance ⁇ W is greater than one-half of the width W of the screen displayed by the display screen 12.
  • the incident light signal LE1 is generated according to the modulation signal MOD1, and the incident light signal LE2 is generated according to the modulation signal MOD2.
  • the modulation signal MOD1 and the modulation signal MOD2 have a phase difference of 180°.
  • the eyeball remote control system of the present application is not limited to capturing the reflected light signal LR by using a camera.
  • the photosensitive element such as a CCD or CIS component
  • the plurality of photosensitive elements can be respectively disposed in a plurality of pixel units in the display screen.
  • FIG. 11 is a schematic diagram of a pixel unit PX according to an embodiment of the present application.
  • FIG. 12 and FIG. 13 are respectively schematic diagrams showing the appearance and functional blocks of the eyeball remote control system C0 according to the embodiment of the present application.
  • the eyeball remote control system C0 is similar to the eyeball remote control system 10, 30, 50, so the same components follow the same symbols.
  • the eyeball remote control system C0 includes a display screen C2, and the display screen C2 includes a plurality of pixel units PX, and each of the pixel units PX may include a visible light emitting element VBC and an invisible light emitting element IVC.
  • a photosensitive element LSC for sensing the reflected light signal LR corresponding to the incident light signal LE.
  • the light-emitting element IVC in the pixel unit PX' in the turn-on area ZN emits the incident light signal LE, since the user's gaze is concentrated on the area of the display screen 12.
  • the incident light signal LE is reflected back by the eyeball EB to become the reflected light signal LR, that is, the reflected light signal LR corresponding to the incident light signal LE is reflected from the eyeball EB toward the pixel unit PX' in the display C2, as shown in FIG.
  • the photosensitive element LSC in the pixel unit PX' can receive the reflected light signal LR corresponding to the incident light signal LE.
  • the determining module 16 can determine that the user's gaze is concentrated on the display according to the position of the pixel unit PX′ on the display screen C2.
  • the area ZN of the screen C2, and the arithmetic module 18 can perform operations related to the area ZN.
  • the eyeball remote control system C0 can be operated in conjunction with the modulation signal generating module 32 or the modulation signal generating module 52 to scan the user's gaze.
  • the details of the operation can be referred to the aforementioned related paragraphs, and details are not described herein again.
  • the modulated signal is not limited to being composed of a square wave, and the modulated signal may be composed of a triangular wave or a sine wave.
  • the modulated signal may be modulated according to a digital code, and the digital code may be a Hadamard Code. ) or in accordance with other coding formats, is also within the scope of this application.
  • the determining module, the computing module, or the modulation signal generating module may utilize an Application-Specific Integrated Circuit (ASIC) or a digital circuit (eg, A register transfer level (RTL) circuit or a processor is implemented.
  • ASIC Application-Specific Integrated Circuit
  • RTL register transfer level
  • the light-emitting element IVC is not limited to the invisible light-emitting element, and may be a visible light-emitting element, and also satisfies the requirements of the present application and falls within the scope of the present application.
  • the eyeball remote control system and the display screen therein are all disposed in a desktop desktop screen, and are not limited thereto.
  • the eyeball remote control system and the display screen of the present application can be applied/disposed to any electronic device having a display screen, such as a mobile phone, a tablet computer, a notebook computer, an All-in-One Personal Computer (AIO), a large television, and an interactive system.
  • Electronic display device (such as an automatic ticket vending machine in a station or an automatic ordering machine in a restaurant).
  • FIG. 14 is a schematic diagram of the appearance of an electronic device D0 according to an embodiment of the present application.
  • the electronic device D0 can be a tablet computer.
  • the electronic device D0 can include a casing D1 and a display.
  • An eyeball remote control system 10 or an eyeball remote control system C0 may be provided in D0, which is also within the scope of the present application.
  • the present application utilizes a plurality of pixel units to scan whether a user's gaze is concentrated in a specific area of the display screen. If the user's gaze is concentrated on a specific area of the display screen, the light extraction module receives the corresponding light signal and reflects From the reflected light signal of the user's eyeball, the judging module can judge that the user's gaze is concentrated on the area of the display screen according to the position of the pixel unit that emits the incident light signal at that time.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种眼球遥控系统，包括一显示屏（12），包含多个像素单元，每一像素单元包括一不可见光发光元件，所述多个像素单元按照一时间顺序发射一入射光信号；一光线撷取模块（13），设置于所述显示屏周围，用来接收对应于所述入射光信号的一反射光信号，其中所述反射光信号反射自一用户的一眼球；一判断模块（16），用来根据所述反射光信号，判断所述用户的目光集中于所述显示屏的一特定区域；以及一运算模块（18），执行相关于所述特定区域的一操作。

Description

眼球遥控系统及电子装置 技术领域
本申请涉及一种眼球遥控系统及电子装置，尤其涉及一种可判断用户目光集中区域的眼球遥控系统及电子装置。
背景技术
随着网络化、数字化和信息化技术的发展，人们对于电器备有了越来越高以及越来越智能化的要求，特别是对于远程遥控操作。远程遥控操作的使用便利程度决定了对该电器设备的使用便利程度。传统按键式遥控器需要透过人的手指来操作，这对于双手被占用的人或者残疾人士来讲是个很大的困难。
发明内容
因此，本申请的主要目的即在于提供一种可判断用户目光集中区域的眼球遥控系统及电子装置。
为了解决上述技术问题，本申请提供了一种眼球遥控系统，包括一显示屏，包含多个像素单元，所述多个像素单元包括多个不可见光发光元件，所述多个像素单元中的所述多个不可见光发光元件按照一时间顺序发射一入射光信号；多个感光元件，用来接收对应于所述入射光信号的一反射光信号，其中所述反射光信号反射自一用户的一眼球；一判断模块，用来根据收到所述反射光 信号的一时间，判断对应所述反射光信号的一不可见光发光元件于所述显示屏的位置，并据以判断所述用户的目光集中于所述显示屏的一特定区域；以及一运算模块，执行相关于所述特定区域的一操作。
例如，所述入射光信号为不可见光信号，所述不可见光发光元件为一不可见光发光二极管或一不可见光发光晶体管。
例如，所述入射光信号为红外线信号，所述不可见光发光元件为一红外线发光二极管或一红外线发光晶体管。
例如，当多个像素单元中至少一像素单元发射所述入射光信号以及多个感光元件接收对应于所述入射光信号的所述反射光信号后，所述判断模块根据所述至少一像素单元于所述显示屏的位置，判断所述用户的目光集中于所述显示屏的所述特定区域。
例如，所述眼球遥控系统还包括一调制信号产生模块，耦接于所述显示屏，用来产生一调制信号；其中，所述多个像素单元根据所述调制信号产生所述入射光信号，所述眼球遥控系统撷取相关于所述调制信号的所述反射光信号。
例如，所述调制信号由多个方波所构成。
例如，所述多个像素单元按照所述时间顺序，在一第一时间由所述多个像素单元中一第一像素单元发射所述入射光信号，以及在一第二时间由所述多个像素单元中一第二像素单元发射所述入射光信号。
例如，所述多个像素单元排列成一数组，所述多个像素单元按照所述时间顺序，在一第一时间由位于所述数组中一第一行的像素单元发射所述入射光信号，在一第二时间由位于所述数组中一第二行的像素单元发射所述入射光信 号，在一第三时间由位于所述数组中一第一列的像素单元发射所述入射光信号，以及在一第四时间由位于所述数组中一第二列的像素单元发射所述入射光信号。
例如，所述眼球遥控系统还包括一调制信号产生模块，耦接于所述显示屏，用来产生一第一调制信号及一第二调制信号；其中，所述第一调制信号与所述第二调制信号之间具有180°的相位差。
例如，在一特定时间，所述多个像素单元中一第一像素单元根据所述第一调制信号产生并发射一第一入射光信号，同时所述多个像素单元中一第二像素单元根据所述第二调制信号产生并发射一第二入射光信号。
例如，对应于所述第一像素单元于所述显示屏的一第一位置与对应于所述第二像素单元于所述显示屏的一第二位置之间具有一距离，所述距离大于一特定值，所述特定值为所述显示屏所显示的一画面宽度的二分之一或一画面高度的二分之一。
例如，所述多个像素单元排列成一数组，在一特定时间，于所述数组中一第一行的像素单元根据所述第一调制信号产生并发射一第一入射光信号，同时于所述数组中一第二行的像素单元根据所述第二调制信号产生并发射一第二入射光信号，所述第一调制信号与所述第二调制信号之间具有180°的相位差。
例如，对应于所述第一行于所述显示屏的一第一水平位置与对应于所述第二行于所述显示屏的一第二水平位置之间具有一垂直距离，所述垂直距离大于所述显示屏的一画面高度的二分之一。
例如，所述多个像素单元排列成一数组，在一特定时间，于所述数组中一第一列的像素单元根据所述第一调制信号产生并发射一第一入射光信号，同 时于所述数组中一第二列的像素单元根据所述第二调制信号产生并发射一第二入射光信号，所述第一调制信号与所述第二调制信号之间具有180°的相位差。
例如，对应于所述第一列于所述显示屏的一第一垂直位置与对应于所述第二列于所述显示屏的一第二垂直位置之间具有一水平距离，所述水平距离大于所述显示屏的一宽度的二分之一。
例如，所述多个感光元件设置于一光线撷取模块中，所述光线撷取模块设置于所述显示屏周围。
例如，所述多个感光元件分别设置于所述显示屏的所述多个像素单元中。
本申请另提供了一种电子装置，包括一眼球遥控系统，所述眼球遥控系统包括一显示屏，包含多个像素单元，所述多个像素单元包括多个不可见光发光元件，所述多个像素单元中的所述多个不可见光发光元件按照一时间顺序发射一入射光信号；多个感光元件，用来接收对应于所述入射光信号的一反射光信号，其中所述反射光信号反射自一用户的一眼球；一判断模块，用来根据收到所述反射光信号的一时间，判断对应所述反射光信号的一不可见光发光元件于所述显示屏的位置，并据以判断所述用户的目光集中于所述显示屏的一特定区域；以及一运算模块，执行相关于所述特定区域的一操作。
本申请利用多个像素单元扫描用户的目光是否集中在显示屏的特定区域，利用光线撷取模块接收对应于入射光信号且反射自用户眼球的反射光信号，判断模块可根据当时发射入射光信号的像素单元所在的位置判断用户的目光集中于显示屏的区域。
附图说明
图1为本申请实施例一眼球遥控系统的外观示意图。
图2为图1的眼球遥控系统的功能方块示意图。
图3为本申请实施例一眼球遥控系统的功能方块示意图。
图4为一调制信号的波形图。
图5为本申请实施例一眼球遥控系统的功能方块示意图。
图6为图5的眼球遥控系统的外观示意图。
图7为多个调制信号的波形图。
图8为图5的眼球遥控系统的外观示意图。
图9为图5的眼球遥控系统的外观示意图。
图10为本申请实施例一像素单元的示意图。
图11为本申请实施例一像素单元的示意图。
图12为本申请实施例一眼球遥控系统的外观示意图。
图13为图12的眼球遥控系统的功能方块示意图。
图14为本申请实施例一电子装置的示意图。
具体实施方式
为了使本申请的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本申请进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
请参考图1及图2，图1及图2分别为本申请实施例一眼球遥控系统10的外观示意图及功能方块示意图。如图1及图2所示，眼球遥控系统10包括一显示屏12、一光线撷取模块14、一判断模块16以及一运算模块18。显示屏12 包含多个像素单元DPX，每一像素单元DPX包括一发光元件IVC，发光元件IVC可为发光二极管(Light Emitting Diode，LED)或是发光晶体管(Light Emitting Transistor)。多个像素单元DPX在显示屏12上排列成一像素数组，多个像素单元DPX可按照一时间顺序分别发射一入射光信号LE。光线撷取模块14设置于显示屏12周围，其可包括光学镜头(Lens)以及多个如感光耦合元件(Charge-coupled Device，CCD)或互补式金氧半图像传感器(CMOS Image Sensor，CIS)等光感测元件或感光元件，于一实施例中，光线撷取模块14可设置于安装于显示屏12周围的一摄像头之中。光线撷取模块14用来接收一反射光信号LR，其中反射光信号LR为对应于入射光信号LE且反射自一使用者的一眼球EB。当光线撷取模块14接收到对应于入射光信号LE的反射光信号LR时，判断模块16可根据收到反射光信号LR的一时间，判断对应该反射光信号LR是由眼球EB反射显示屏12中一特定像素单元DPX’中的不可见光发光组件IVC’所发出的入射光信号LE，并进一步判断特定像素单元DPX’于显示屏12的位置，并据以判断用户的目光集中于显示屏12的一特定区域，而运算模块18即可执行相关于所述特定区域的一操作，运算模块18可为单片机(Microcontroller，MCU)或中央处理单元(Central Processing Unit，CPU)。
简单来说，本申请利用多个像素单元DPX中的多个发光元件IVC依序地(按照一特定时间顺序)发射入射光信号LE，其等效于利用多个像素单元DPX扫描用户的目光是否集中在显示屏12的某个区域，若用户的目光确实集中在显示屏12的某个区域，光线撷取模块14可接收到对应于入射光信号LE的反射光信号LR，此时判断模块16可判断用户的目光集中于显示屏12的区域。详细来说，当用户的目光集中于显示屏12的一区域ZN时(即于一第一时间t1 用户的目光集中于显示屏12的区域ZN)，且此时轮到区域ZN中的像素单元DPX’中的发光元件IVC’发射出入射光信号LE(即按照该特定时间顺序，于第一时间t1轮到像素单元DPX’的发光组件IVC发射出入射光信号LE，也就是说像素单元DPX’中的发光组件IVC’于第一时间t1发射入射光信号LE)，因于第一时间t1用户的目光集中于显示屏12的区域ZN，入射光信号LE于第一时间t1会经眼球EB反射回来而成为反射光信号LR，即对应于入射光信号LE的反射光信号LR自眼球EB往显示屏12的方向反射，如图2所示，光线撷取模块14即可于第一时间t1接收对应于像素单元DPX’所发射入射光信号LE的反射光信号LR。相反地，当使用者的目光并非集中于区域ZN时，即使此时区域ZN中的像素单元DPX’发射出入射光信号LE，而对应于入射光信号LE的反射光将会反射到使用者所在的其他空间，而光线撷取模块14将无法接收到对应于入射光信号LE的反射光。另外，当光线撷取模块14于第一时间t1接收到对应于入射光信号LE的反射光信号LR时，判断模块16可根据第一时间t1，判断于第一时间t1发射出入射光信号LE的像素单元DPX’在显示屏12的位置，以判断用户的目光集中于显示屏12的区域ZN，而运算模块18可执行相关于区域ZN的操作。其中，运算模块18所执行且相关于区域ZN的操作并未有所限，举例来说，运算模块18可指示显示屏12将位于区域ZN的图像(Icon)以特别明亮的方式显示，或是运算模块18可指示显示屏12将位于区域ZN(或于区域ZN附近)的图像放大显示，或是运算模块18可指示显示屏12显示一光标图像指向区域ZN，皆属于本申请的范畴。其中，像素单元DPX或像素单元DPX’发出入射光信号LE皆代表像素单元DPX或像素单元DPX’利用其中的发光元件IVC来发出入射光信号LE。
换句话说，在区域ZN中的像素单元DPX’于第一时间t1发射入射光信号LE的前提下，唯有使用者的目光于第一时间t1集中于区域ZN时，入射光信号LE才能经由眼球EB反射至光线撷取模块14，光线撷取模块14才会接收到反射光信号LR。当使用者的目光于第一时间t1并未集中于区域ZN时，入射光信号LE会经眼球EB反射至(光线撷取模块14以外)的其他地方，而光线撷取模块14不会接收到对应于入射光信号LE的反射光。
另外，为了避免入射光信号LE影响显示屏12所欲显示的画面，例如，入射光信号LE为不可见光信号，而每一像素单元DPX中所包括的发光元件IVC为不可见光发光元件(如不可见光发光二极管(Invisible LED)或不可见光发光晶体管(Invisible Light Emitting Transistor))。具体来说，于一实施例中，入射光信号LE为红外线信号而每一像素单元DPX中所包括的发光元件IVC为一红外线发光二极管(Infrared Light Emitting Diode，IR LED)或一红外线发光晶体管(Infrared Emitting Transistor)。
换句话说，于一实施例中，每一像素单元DPX可包含一发光元件VBC以及发光元件IVC，如图10所示，其中发光元件VBC为可见光发光元件，其可为有机发光二极管(Organic Light Emitting Diode，OLED)，发光元件IVC为不可见光发光元件。显示屏12利用位于多个像素单元DPX中的多个可见光发光元件VBC来显示画面，并利用位于多个像素单元DPX中的多个不可见光发光元件IVC来扫描用户目光注视的位置。
另外，眼球遥控系统10利用多个像素单元DPX扫描用户的目光(即利用多个像素单元DPX按照时间顺序分别发射入射光信号LE)的方式并未有所限。于一实施例中，多个像素单元DPX可按照一时间顺序一次仅由单一个像素 单元DPX中的发光元件IVC逐次地发射入射光信号LE，即于一时间tn仅由单一个像素单元DPX中的发光元件IVC发射入射光信号LE，而于另一时间tk也仅由另一个像素单元DPX中的发光元件IVC发射入射光信号LE。其中多个像素单元DPX一次由单一个像素单元DPX中的发光元件IVC逐次地发射入射光信号LE的顺序并未有所限，举例来说，多个像素单元DPX可先由左而右后由上而下逐一地一次由单一个像素单元DPX中的发光元件IVC发射入射光信号LE，或是先由下而上后由右而左逐一地一次由单一个像素单元DPX中的发光元件IVC发射入射光信号LE。
于另一实施例中，多个像素单元DPX可按照一时间顺序一次由多个像素单元DPX中的发光元件IVC发射入射光信号LE，举例来说，多个像素单元DPX可按照一时间顺序，于一时间tx1，由位于像素数组的一行X1的像素单元DPX中的发光元件IVC发射入射光信号LE，于一时间tx2，由位于像素数组的另一行X2的像素单元DPX中的发光元件IVC发射入射光信号LE，于一时间ty1，由位于像素数组的一列Y1的像素单元DPX中的发光元件IVC发射入射光信号LE，并于一时间ty2，由位于像素数组的另一列Y2的像素单元DPX中的发光元件IVC发射入射光信号LE。
简言之，本申请利用多个像素单元DPX扫描用户的目光是否集中在显示屏12的某个区域，若用户的目光确实集中在显示屏12的某个区域时，利用光线撷取模块14接收对应于入射光信号LE的反射光信号LR，此时判断模块16可根据当时发射入射光信号LE的像素单元DPX所在的位置，判断用户的目光集中于显示屏12的区域。
另外，为了区分反射光信号LR与来自环境的光线，显示屏12可根据一调制信号产生入射光信号LE，光线撷取模块14及判断模块16可撷取与调制信号具有相似特性的光信号并将之进行进一步信号处理(如滤波、放大等信号处理)，以准确地以判断用户目光集中的位置。
具体来说，请参考图3，图3为本申请实施例一眼球遥控系统30的功能方块示意图。眼球遥控系统30与眼球遥控系统10类似，故相同元件沿用相同符号。与眼球遥控系统10不同的是，眼球遥控系统30还包括一调制信号产生模块32，调制信号产生模块32耦接于显示屏12，用来产生一调制信号MOD至显示屏12的多个像素单元DPX，多个像素单元DPX中的发光元件IVC可根据调制信号MOD产生并发射入射光信号LE。其中，调制信号MOD可为一交流(Alternating Current，AC)信号，其波形并未有所限，举例来说，请参考图4，图4为本申请实施例调制信号MOD的波形图，如图4所示，调制信号MOD可由多个方波所构成。如此一来，光线撷取模块14可撷取相关于调制信号MOD的反射光信号LR，而判断模块16可对与调制信号MOD具有相似特性(如方波特性)的光信号进行进一步信号处理(如滤波、放大运算)，使得判断模块16可精准地判断反射光信号LR为对应于入射光信号LE(其具有调制信号MOD的特性)的反射光信号，并据以判断用户目光集中于显示屏12中发射入射光信号LE的像素单元DPX所在的位置。
除此之外，为了更精准地判断光线撷取模块14所接收到的反射光信号LR确实为反射自使用者眼球EB，请参考图5，图5为本申请实施例一眼球遥控系统50的功能方块示意图。眼球遥控系统50与眼球遥控系统30类似，故相同元件沿用相同符号。与眼球遥控系统30不同的是，眼球遥控系统50还包括 一调制信号产生模块52，调制信号产生模块52耦接于显示屏12，用来产生一调制信号MOD1以及一调制信号MOD2。如图6所示，当多个像素单元DPX按照时间顺序轮到一像素单元DPX1中的一发光元件IVC1根据调制信号MOD1产生并发射一入射光信号LE1时(假设于一时间ta)，眼球遥控系统可同时(于时间ta)利用另一像素单元DPX2中的一发光元件IVC2根据调制信号MOD2产生并发射与入射光信号LE1相位相反的另一入射光信号LE2，即入射光信号LE1与LE2之间具有180°的相位差。如此一来，当用户注视于像素单元DPX1于显示屏12所在的位置时，光线撷取模块14所接收反射自使用者眼球EB的反射光会与入射光信号LE1具有相同的信号特性，而反射自其他物件(如用户脸部或环境中的物件)的反射光为入射光信号LE1以及入射光信号LE2的总和而趋近于或等于一直流(Direct Current，DC)信号，如此一来，光线撷取模块14及判断模块16可精准地取得反射自使用者眼球EB的反射光，并据以判断用户目光集中于显示屏12中像素单元DPX1所在的位置。其中，调制信号MOD1与调制信号MOD2之间具有180°的相位差，如图7所示。另外，例如，像素单元DPX1与像素单元DPX2之间需相隔足够的距离，于一实施例中，像素单元DPX1于显示屏12的一第一位置与像素单元DPX2于显示屏12的一第二位置之间的距离大于显示屏12所显示的一画面宽度W的二分之一，或大于显示屏12所显示的一画面高度H的二分之一。
同理，如图8所示，眼球遥控系统30可于一时间tb利用位于像素数组的一行X1’的复数个像素单元中的复数个发光元件IVC产生并发射入射光信号LE1，并同时于时间tb利用位于像素数组的一行X2’的复数个像素单元中的复数个发光元件IVC产生并发射入射光信号LE2，其中，对应于像素数组的行 X1’于显示屏12的水平位置与对应于像素数组的行X2’于显示屏12的水平位置之间具有一垂直距离ΔH，例如，垂直距离ΔH大于显示屏12所显示的画面高度H的二分之一。同理，如图9所示，眼球遥控系统30可于一时间tc利用位于像素数组的一列Y1’的复数个像素单元中的复数个发光元件IVC产生并发射入射光信号LE1，并同时于时间tc利用位于像素数组的一列Y2’的复数个像素单元中的复数个发光元件IVC产生并发射入射光信号LE2，其中，对应于像素数组的列Y1’于显示屏12的垂直位置与对应于像素数组的列Y2’于显示屏12的垂直位置之间具有一水平距离ΔW，例如，水平距离ΔW大于显示屏12所显示的画面宽度W的二分之一。其中，入射光信号LE1为根据调制信号MOD1所产生，入射光信号LE2为根据调制信号MOD2所产生，调制信号MOD1与调制信号MOD2之间具有180°的相位差。
另外，本申请的眼球遥控系统不限于利用摄像头来捕捉反射光信号LR，换句话说，本申请的感光元件(如CCD或CIS元件)不限于设置于摄像头的光线撷取模块之中，本申请的多个感光元件可分别设置于显示屏中多个像素单元中。请参考图11至图13，图11为本申请实施例一像素单元PX的示意图，图12及图13分别为本申请实施例一眼球遥控系统C0的外观示意图及功能方块示意图。眼球遥控系统C0与眼球遥控系统10、30、50相似，故相同元件沿用相同符号。与眼球遥控系统10、30、50同的是，眼球遥控系统C0包含一显示屏C2，显示屏C2包含多个像素单元PX，每一像素单元PX可包含可见光发光元件VBC、不可见光发光元件IVC以及一感光元件LSC，感光元件LSC用来感测对应于入射光信号LE的反射光信号LR。
当用户的目光集中于显示屏C2的区域ZN时，且此时轮到区域ZN中的一像素单元PX’中的发光元件IVC发射出入射光信号LE，因用户的目光集中于显示屏12的区域ZN，入射光信号LE会经眼球EB反射回来而成为反射光信号LR，即对应于入射光信号LE的反射光信号LR自眼球EB往显示屏C2中像素单元PX’的方向反射，如图13所示，像素单元PX’中的感光元件LSC即可接收对应入射光信号LE的反射光信号LR。相反地，当使用者的目光并非集中于区域ZN时，即使此时区域ZN中的像素单元PX’发射出入射光信号LE，而对应于入射光信号LE的反射光将会反射到使用者所在的其他空间，而像素单元PX’中的感光元件LSC将无法接收到对应于入射光信号LE的反射光。另外，当像素单元PX’中的感光元件LSC接收到对应于入射光信号LE的反射光信号LR时，判断模块16可根据像素单元PX’在显示屏C2的位置，判断用户的目光集中于显示屏C2的区域ZN，而运算模块18可执行相关于区域ZN的操作。
同样地，眼球遥控系统C0可搭配调制信号产生模块32或调制信号产生模块52进行操作，以扫描用户目光注视之所在，其操作细节可参考前述相关段落，于此不再赘述。
需注意的是，前述实施例用以说明本申请的概念，本领域具通常知识者当可据以做不同之修饰，而不限于此。举例来说，调制信号不限于由方波所构成，调制信号亦可由三角波或弦波所构成，另外，调制信号可根据一数字码调制而成，该数字码可为一阿达马码(Hadamard Code)或是符合其他编码格式，亦属于本申请的范畴。另外，判断模块、运算模块或调制信号产生模块可利用专用集成电路(Application-Specific Integrated Circuit，ASIC)、数字电路(如 寄存器传输级(RTL)电路)或处理器(Process)来实现。另外，发光元件IVC不限于为不可见光发光元件，亦可为可见光发光元件，亦满足本申请的要求而属于本申请的范畴。
另外，于前述实施例中，眼球遥控系统及其中的显示屏均设置于一台式桌上型屏幕中，而不限于此。本申请的眼球遥控系统以及显示屏可应用/设置于任何具有显示屏幕的电子装置，如手机、平板计算机、笔记本电脑、一体机计算机(All-in-One Personal Computer，AIO)、大型电视、互动式电子显示装置(如车站内的自动售票机或餐厅内的自动点餐机)等。举例来说，请参考图14，图14为本申请实施例一电子装置D0的外观示意图，电子装置D0可为一平板计算机，就外观而言，电子装置D0可包括一机壳D1、一显示屏D2以及一光线撷取模块模块D4，其中显示屏D2可以用显示屏12或显示屏C2来实现，光线撷取模块模块D4可以用光线撷取模块14来实现，就功能而言，电子装置D0中可设置有眼球遥控系统10或眼球遥控系统C0，亦属于本申请的范畴。
简言之，本申请利用多个像素单元扫描用户的目光是否集中在显示屏的特定区域，若用户的目光集中在显示屏的特定区域时，利用光线撷取模块接收对应于入射光信号且反射自用户眼球的反射光信号，判断模块可根据当时发射入射光信号的像素单元所在的位置，判断用户的目光集中于显示屏的区域。
以上所述仅为本申请的部分实施例而已，并不用以限制本申请，凡在本申请的精神和原则之内所作的任何修改、等同替换和改进等，均应包含在本申请的保护范围之内。

Claims (19)

  1. 一种眼球遥控系统，其中，包括：
    一显示屏，包含多个像素单元，所述多个像素单元包括多个不可见光发光元件，所述多个像素单元中的所述多个不可见光发光元件按照一时间顺序发射一入射光信号；
    多个感光元件，用来接收对应于所述入射光信号的一反射光信号，其中所述反射光信号反射自一用户的一眼球；
    一判断模块，用来根据收到所述反射光信号的一时间，判断对应所述反射光信号的一不可见光发光元件于所述显示屏的位置，并据以判断所述用户的目光集中于所述显示屏的一特定区域；以及
    一运算模块，执行相关于所述特定区域的一操作。
  2. 如权利要求1所述的眼球遥控系统，其中，所述入射光信号为不可见光信号，所述多个不可见光发光元件为不可见光发光二极管或不可见光发光晶体管。
  3. 如权利要求1所述的眼球遥控系统，其中，所述入射光信号为红外线信号，所述多个不可见光发光元件为红外线发光二极管或红外线发光晶体管。
  4. 如权利要求1所述的眼球遥控系统，其中，当所述多个不可见光发光元件中对应于多个像素单元中至少一像素单元的至少一不可见光发光元件发射所述入射光信号以及所述多个感光元件接收对应于所述入射光信号的所述反射光信号后，所述判断模块根据所述至少一像素单元于所述显示屏的位置，判断所述用户的目光集中于所述显示屏的所述特定区域。
  5. 如权利要求1所述的眼球遥控系统，其中，还包括；
    一调制信号产生模块，耦接于所述显示屏，用来产生一调制信号；
    其中，所述多个像素单元中的所述多个不可见光发光元件根据所述调制信号产生所述入射光信号，所述眼球遥控系统撷取相关于所述调制信号的所述反射光信号。
  6. 如权利要求5所述的眼球遥控系统，其中，所述调制信号由多个方波所构成。
  7. 如权利要求1所述的眼球遥控系统，其中，所述多个像素单元按照所述时间顺序，在一第一时间由所述多个不可见光发光元件中对应于所述多个像素单元中一第一像素单元的一第一不可见光发光元件发射所述入射光信号，以及在一第二时间由所述多个不可见光发光元件中对应于所述多个像素单元中一第二像素单元的一第二不可见光发光元件发射所述入射光信号。
  8. 如权利要求1所述的眼球遥控系统，其中，所述多个像素单元排列成一数组，所述多个像素单元按照所述时间顺序，在一第一时间由所述多个不可见光发光元件中对应于位于所述数组中一第一行的像素单元的多个不可见光发光元件发射所述入射光信号，在一第二时间由所述多个不可见光发光元件中对应于位于所述数组中一第二行的像素单元的多个不可见光发光元件发射所述入射光信号，在一第三时间由所述多个不可见光发光元件中对应于位于所述数组中一第一列的像素单的多个不可见光发光元件元发射所述入射光信号，以及在一第四时间由所述多个不可见光发光元件中对应于位于所述数组中一第二列的像素单元的多个不可见光发光元件发射所述入射光信号。
  9. 如权利要求1所述的眼球遥控系统，其中，还包括；
    一调制信号产生模块，耦接于所述显示屏，用来产生一第一调制信号及一第二调制信号；
    其中，所述第一调制信号与所述第二调制信号之间具有180°的相位差。
  10. 如权利要求9所述的眼球遥控系统，其中，在一特定时间，所述多个不可见光发光元件中对应于所述多个像素单元中一第一像素单元的一第一不可见光发光元件根据所述第一调制信号产生并发射一第一入射光信号，同时所述多个不可见光发光元件中对应于所述多个像素中一第二像素单元的一第二不可见光发光元件根据所述第二调制信号产生并发射一第二入射光信号。
  11. 如权利要求10所述的眼球遥控系统，其中，对应于所述第一像素单元于所述显示屏的一第一位置与对应于所述第二像素单元于所述显示屏的一第二位置之间具有一距离，所述距离大于一特定值，所述特定值为所述显示屏所显示的一画面宽度的二分之一或一画面高度的二分之一。
  12. 如权利要求9所述的眼球遥控系统，其中，所述多个像素单元排列成一数组，在一特定时间，所述多个不可见光发光元件中对应于所述数组中一第一行的像素单元的多个不可见光发光元件根据所述第一调制信号产生并发射一第一入射光信号，同时所述多个不可见光发光元件中对应于所述数组中一第二行的像素单元的多个不可见光发光元件根据所述第二调制信号产生并发射一第二入射光信号，所述第一调制信号与所述第二调制信号之间具有180°的相位差。
  13. 如权利要求12所述的眼球遥控系统，其中，对应于所述第一行于所述显示屏的一第一水平位置与对应于所述第二行于所述显示屏的一第二水平位置之间具有一垂直距离，所述垂直距离大于所述显示屏的一画面高度的二分之一。
  14. 如权利要求9所述的眼球遥控系统，其中，所述多个像素单元排列成一数组，在一特定时间，所述多个不可见光发光元件中对应于所述数组中一第一列的像素单元的多个不可见光发光元件根据所述第一调制信号产生并发射一第一入射光信号，同时所述多个不可见光发光元件中对应于所述数组中一第二列的像素单元的多个不可见光发光元件根据所述第二调制信号产生并发射一第二入射光信号，所述第一调制信号与所述第二调制信号之间具有180°的相位差。
  15. 如权利要求14所述的眼球遥控系统，其中，对应于所述第一列于所述显示屏的一第一垂直位置与对应于所述第二列于所述显示屏的一第二垂直位置之间具有一水平距离，所述水平距离大于所述显示屏的一宽度的二分之一。
  16. 如权利要求1所述的眼球遥控系统，其中，所述多个感光元件设置于一光线撷取模块中，所述光线撷取模块设置于所述显示屏周围。
  17. 如权利要求1所述的眼球遥控系统，其中，所述多个感光元件分别设置于所述显示屏的所述多个像素单元中。
  18. 如权利要求17所述的眼球遥控系统，其中，当所述多个不可见光发光元件中对应于多个像素单元中至少一像素单元的至少一不可见光发光元件发射所述入射光信号，以及所述多个感光元件中对应于所述至少一像素单元的至少一感光元件接收对应于所述入射光信号的所述反射光信号后，所述判断模块根据所述至少一像素单元于所述显示屏的位置，判断所述用户的目光集中于所述显示屏的所述特定区域。
  19. 一种电子装置，其中，进一步包括：
    一眼球遥控系统，所述眼球遥控系统为权利要求1-18中任意一项所述的眼球遥 控系统。
PCT/CN2017/082054 2017-04-26 2017-04-26 眼球遥控系统及电子装置 WO2018195828A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/082054 WO2018195828A1 (zh) 2017-04-26 2017-04-26 眼球遥控系统及电子装置
CN201780000327.0A CN107223276B (zh) 2017-04-26 2017-04-26 眼球遥控系统及电子装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/082054 WO2018195828A1 (zh) 2017-04-26 2017-04-26 眼球遥控系统及电子装置

Publications (1)

Publication Number Publication Date
WO2018195828A1 true WO2018195828A1 (zh) 2018-11-01

Family

ID=59955203

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/082054 WO2018195828A1 (zh) 2017-04-26 2017-04-26 眼球遥控系统及电子装置

Country Status (2)

Country Link
CN (1) CN107223276B (zh)
WO (1) WO2018195828A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3605016B1 (en) 2018-04-16 2022-04-06 Shenzhen Goodix Technology Co., Ltd. Image sensing system and electronic device
CN110517470B (zh) * 2019-07-12 2020-11-17 华为技术有限公司 一种远程控制方法、设备和系统
CN115698903A (zh) * 2021-05-27 2023-02-03 京东方科技集团股份有限公司 显示装置、可穿戴显示设备及注视点的位置的确定方法
WO2022246742A1 (zh) * 2021-05-27 2022-12-01 京东方科技集团股份有限公司 可穿戴显示设备及注视点的位置的确定方法
CN115698904A (zh) * 2021-05-27 2023-02-03 京东方科技集团股份有限公司 可穿戴显示设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130113973A1 (en) * 2011-11-04 2013-05-09 Google Inc. Adaptive brightness control of head mounted display
CN103777759A (zh) * 2014-02-18 2014-05-07 马根昌 电子眼镜动作识别系统
CN105223692A (zh) * 2014-05-26 2016-01-06 联想(北京)有限公司 显示装置和电子设备
CN106132284A (zh) * 2013-11-09 2016-11-16 深圳市汇顶科技股份有限公司 光学眼动追踪

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH089222A (ja) * 1994-06-17 1996-01-12 Canon Inc 視線検出機能付き撮像装置
JP5754976B2 (ja) * 2010-03-31 2015-07-29 キヤノン株式会社 画像処理装置、及び、制御方法
CN102447858A (zh) * 2011-12-28 2012-05-09 彩虹集团公司 一种基于红外眼球跟踪技术的led背光控制方法
CN102830797B (zh) * 2012-07-26 2015-11-25 深圳先进技术研究院 一种基于视线判断的人机交互方法及系统
CN106062665B (zh) * 2013-09-11 2019-05-17 深圳市汇顶科技股份有限公司 基于用户的眼睛运动和位置的光学感测和跟踪的用户界面
CN105068646B (zh) * 2015-08-05 2017-11-10 广东欧珀移动通信有限公司 终端的控制方法和系统
CN106125931A (zh) * 2016-06-30 2016-11-16 刘兴丹 一种眼球追踪操作的方法及装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130113973A1 (en) * 2011-11-04 2013-05-09 Google Inc. Adaptive brightness control of head mounted display
CN106132284A (zh) * 2013-11-09 2016-11-16 深圳市汇顶科技股份有限公司 光学眼动追踪
CN103777759A (zh) * 2014-02-18 2014-05-07 马根昌 电子眼镜动作识别系统
CN105223692A (zh) * 2014-05-26 2016-01-06 联想(北京)有限公司 显示装置和电子设备

Also Published As

Publication number Publication date
CN107223276A (zh) 2017-09-29
CN107223276B (zh) 2020-03-20

Similar Documents

Publication Publication Date Title
WO2018195828A1 (zh) 眼球遥控系统及电子装置
US10909916B2 (en) OLED array substrate, OLED display panel, pixel circuit, driving method and method for fingerprint recognition using OLED display panel
US6512838B1 (en) Methods for enhancing performance and data acquired from three-dimensional image systems
US8818027B2 (en) Computing device interface
TWI470507B (zh) 具可切換漫射器的互動式平面電腦
US8514201B2 (en) Image pickup device, display-and-image pickup device, and electronic device
TW202009653A (zh) 指向判斷系統以及指向判斷方法
US20130314380A1 (en) Detection device, input device, projector, and electronic apparatus
US11295664B2 (en) Display-synchronized optical emitters and transceivers
US20140321700A1 (en) Light sensing module and system
US8913037B1 (en) Gesture recognition from depth and distortion analysis
US11663992B2 (en) Fade-in user interface display based on finger distance or hand proximity
US11677900B2 (en) Personal authentication device
US9959084B2 (en) Communication terminal, communication system, communication control method, and recording medium
CN108596015B (zh) 显示组件及其制备方法、显示装置
US11112961B2 (en) Information processing system, information processing method, and program for object transfer between devices
US11620414B2 (en) Display apparatus, display method, and image processing system
TW201918147A (zh) 可攜式電子裝置
KR100968205B1 (ko) 적외선 카메라 방식의 공간 터치 감지 장치, 방법 및스크린 장치
US20220367541A1 (en) Image sensor, mobile terminal, and image capturing method
KR20080037315A (ko) 포인터 이동 제어 장치를 포함하는 전자기기
US20170011713A1 (en) Image outputting device
TW201447737A (zh) 顯示裝置操作方法及系統
CN108321174B (zh) 显示组件及其制备方法、显示装置
KR100799766B1 (ko) 포인터 이동 제어 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17907594

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17907594

Country of ref document: EP

Kind code of ref document: A1