EP2207160A1 - Display device, display control method, and electronic device - Google Patents

Display device, display control method, and electronic device Download PDF

Info

Publication number
EP2207160A1
EP2207160A1 EP08848069A EP08848069A EP2207160A1 EP 2207160 A1 EP2207160 A1 EP 2207160A1 EP 08848069 A EP08848069 A EP 08848069A EP 08848069 A EP08848069 A EP 08848069A EP 2207160 A1 EP2207160 A1 EP 2207160A1
Authority
EP
European Patent Office
Prior art keywords
display
light
photosensor
detection
detection element
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP08848069A
Other languages
German (de)
French (fr)
Other versions
EP2207160B1 (en
EP2207160A4 (en
Inventor
Takayuki Nakanishi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Japan Display Inc
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of EP2207160A1 publication Critical patent/EP2207160A1/en
Publication of EP2207160A4 publication Critical patent/EP2207160A4/en
Application granted granted Critical
Publication of EP2207160B1 publication Critical patent/EP2207160B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406Control of illumination source
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00Photometry, e.g. photographic exposure meter
    • G01J1/10Photometry, e.g. photographic exposure meter by comparison with reference light or electric value provisionally void
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00Photometry, e.g. photographic exposure meter
    • G01J1/42Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G01J1/4204Photometry, e.g. photographic exposure meter using electric radiation detectors with determination of ambient light
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00Photometry, e.g. photographic exposure meter
    • G01J1/42Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G01J1/44Electric circuits
    • G01J1/46Electric circuits using a capacitor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412Digitisers structurally integrated in a display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00Photometry, e.g. photographic exposure meter
    • G01J1/02Details
    • G01J1/0219Electrical interface; User interface
    • GPHYSICS
    • G02OPTICS
    • G02FOPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/13306Circuit arrangements or driving methods for the control of single liquid crystal cells
    • G02F1/13312Circuits comprising photodetectors for purposes other than feedback
    • GPHYSICS
    • G02OPTICS
    • G02FOPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/1333Constructional arrangements; Manufacturing methods
    • G02F1/13338Input devices, e.g. touch panels
    • GPHYSICS
    • G02OPTICS
    • G02FOPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G02F1/133Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
    • G02F1/136Liquid crystal cells structurally associated with a semi-conducting layer or substrate, e.g. cells forming part of an integrated circuit
    • G02F1/13606Liquid crystal cells structurally associated with a semi-conducting layer or substrate, e.g. cells forming part of an integrated circuit having means for reducing parasitic capacitance
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2310/00Command of the display device
    • G09G2310/02Addressing, scanning or driving the display screen or processing steps related thereto
    • G09G2310/0237Switching ON and OFF the backlight within one frame
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/06Adjustment of display parameters
    • G09G2320/0626Adjustment of display parameters for control of overall brightness
    • G09G2320/0633Adjustment of display parameters for control of overall brightness by amplitude modulation of the brightness of the illumination source
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00Aspects of the architecture of display systems
    • G09G2360/14Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/144Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light being ambient light

Definitions

  • the present invention relates to a display device that displays predetermined video, a display control method for controlling the display device, and an electronic apparatus employing a display device.
  • a photosensor formed in a TFT panel as a liquid crystal display device e.g. refer to Japanese Patent Laid-open No. 2006-106294
  • a comparator is connected to the sensor output as shown in FIG. 16 and electric charges (including dark current leakage) generated due to light reception are accumulated in capacitance to thereby measure the time to attainment of a reference voltage.
  • FIG. 17 is a schematic diagram showing the structure of the photosensor.
  • the photosensor has a structure in which a light-receiving part composed of poly-silicon is opposed to a metal with the intermediary of an insulating film, and outputs charges depending on the amount of light captured by the light-receiving part.
  • the present invention is made in order to solve such a problem.
  • a display device including a detection element that detects the ambient light amount of a display area, a comparator that compares an output of the detection element with a predetermined reference value, and a control means that controls the amount of light supplied to the display area depending on a comparison result by the comparator, a switch for controlling application of a precharge potential is connected to a metal that exists near a light-receiving part of the detection element with the intermediary of an insulating film.
  • the switch for controlling application of the precharge potential is provided for the metal that exists near the light-receiving part of the detection element with the intermediary of the insulating film.
  • Examples of the switch that is connected to the metal and controls application of the precharge potential to the metal include an analog switch and an element with high resistance.
  • a precharge potential is applied to a metal that exists near a light-receiving part of the detection element with the intermediary of an insulating film before start of light amount detection by the detection element, and the potential of the metal is rendered a floating state in the light amount detection.
  • the precharge potential is applied to the metal opposed to the light-receiving part before the start of the light amount detection by the detection element.
  • charges are accumulated in parasitic capacitance between the light-receiving part and the metal by the precharge potential, so that the parasitic capacitance can be apparently decreased.
  • the display device includes a detection element that detects the ambient light amount of a display area, a comparator that compares an output of the detection element with a predetermined reference value, and a control means that controls the amount of light supplied to the display area depending on a comparison result by the comparator.
  • a switch for controlling application of a precharge potential is connected to a metal that exists near a light-receiving part of the detection element with the intermediary of an insulating film.
  • the switch for controlling application of the precharge potential is provided for the metal that exists near the light-receiving part of the detection element with the intermediary of the insulating film.
  • the present invention provides the following advantage. Specifically, because the parasitic capacitance of the detection element can be apparently decreased, the influence of the parasitic capacitance of the detection element itself can be suppressed at the time of the light amount detection, and the charge accumulation time can be shortened to allow rapid light amount detection.
  • FIG. 1 is a schematic configuration diagram of a display device according to the present embodiment.
  • a display panel 10 as the display device of the present embodiment includes a display area (sensor area) 11, a selection switch 12 that carries out scanning along the H (horizontal) direction for displaying, a V driver 13 that carries out scanning along the V (vertical) direction for displaying, a display driver 14, a sensor driver 15, and plural photosensors PS.
  • the display area (sensor area) 11 modulates light from a backlight, which is not shown in the drawing, and outputs display light.
  • the plural photosensors PS are disposed in the periphery of the display area 11 and are driven by the sensor driver 15.
  • the display driver 14 and the sensor driver 15 are collected into an integrated circuit and are mounted as a chip component on the substrate.
  • the selection switch 12 line-sequentially drives the liquid crystal elements of the respective pixels in the display area 11 together with the V driver 13, based on a display signal and a control clock for display driving, supplied from the display driver 14.
  • the photosensors PS are disposed around the display area 11.
  • the photosensors PS are formed of a diode configuration or a transistor configuration and are formed on the same substrate as that of the drive elements formed in the display area 11 for example.
  • the display panel 10 is connected via a cable to external interfaces (e.g. a display interface, CPU interface) and a backlight control means and is driven based on a control signal and a video signal from these units.
  • external interfaces e.g. a display interface, CPU interface
  • the control unit controls the light amount of the backlight based on the detection result by this photosensor.
  • FIG. 2 is a circuit diagram for explaining major part of the display device according to the present embodiment.
  • this display device includes a photosensor PS as a detection element that detects the ambient light amount of the display area, a comparator 102 that compares the output of the photosensor PS with a predetermined reference value, and a controller (backlight controller 105) that controls the amount of light supplied to the display area depending on a comparison result by the comparator 102.
  • the photosensor PS has a structure like that shown in FIG. 12 in the present embodiment. Specifically, a switch SW for controlling application of a precharge potential is connected to the metal that exists near the light-receiving part of the photosensor PS with the intermediary of an insulating film.
  • the switch SW connected to the metal may be an analog switch. Alternatively, it may be an element having high resistance.
  • the precharge potential is applied to the metal of the photosensor PS, so that charges are accumulated in parasitic capacitance formed between the metal and the light-receiving part.
  • the switch SW is turned OFF (opened) in this state to thereby render the metal potential the floating state, and the light amount is detected by the light-receiving part.
  • FIG. 3 is a timing chart for explaining a display control method of the display device of the present embodiment. Operation for measuring the illuminance will be described below.
  • reset is carried out for the entire circuit shown in FIG. 2 .
  • a reset transistor Tr-reset is turned ON and the switch SW connected to the metal of the photosensor PS is turned ON.
  • node A as the output line of the photosensor PS is fixed to a reset potential.
  • node B of a wiring connected to the metal of the photosensor ps is fixed to the precharge potential due to the turn-on of the switch SW.
  • This reset operation is carried out in e.g. a vertical blanking period of video displaying on the display area 11 (see FIG. 1 ). This can prevent the reset operation from affecting the video displaying.
  • the reset transistor Tr-reset As deactivation of the reset, the reset transistor Tr-reset is turned OFF and the switch is turned OFF. This reset deactivation renders the potential of node B the floating state, and thus node B keeps on holding the precharge potential accumulated in the reset.
  • node A is input to the comparator 102 and compared with the reference potential. When the potential of node A surpasses the reference potential, the comparator output (output) is inverted. The light amount can be measured based on the time from the reset to the output inversion.
  • the detection by the photosensor PS is started from the reset deactivation.
  • the time e.g. the number of steps
  • the time is counted and stored in the memory of the backlight controller 105.
  • the light amount of the backlight emitted onto the display area 11 is controlled by the backlight controller 105 based on the detection result by the photosensor PS, stored in the memory of the backlight controller 105. For example, the light amount of the backlight is increased when the ambient light amount is larger, whereas the light amount of the backlight is decreased when the ambient light amount is smaller.
  • the parasitic capacitance of the output of the photosensor PS can be decreased, which can shorten the detection time and thus allows rapid control of the light amount of the backlight.
  • FIG. 4 is a circuit diagram for explaining a configuration for carrying out display control with use of two photosensors. Specifically, in this configuration, a first photosensor PS1 that detects the ambient light amount of the display area and a second photosensor PS2 that detects dark current arising when light is blocked are used, and comparison between the detection results by these photosensors and predetermined reference values is carried out with one comparator 102. For this purpose, switching between the first photosensor PS1 and the second photosensor PS2 is carried out, and the comparator 102 is operated in a time-division manner. For each of the photosensors PS1 and PS2, the above-described switch (not shown) for controlling application of a precharge voltage is provided.
  • a changeover switch SW1 of the first photosensor PS1 is turned OFF, whereas a changeover switch SW2 of the second photosensor PS2 is turned ON.
  • reset of the second photosensor PS2 is carried out.
  • the switch connected to the metal of the second photosensor PS2 is turned ON, so that the connected line (node B) is fixed to the precharge potential.
  • the reset of the second photosensor PS2 is deactivated.
  • This reset deactivation renders node B the floating state, and thus node B keeps on holding the precharge potential accumulated in the reset.
  • light amount detection is started upon the reset deactivation. This detection is equivalent to measurement of dark current arising when light is blocked because a black color filter is provided for the second photosensor PS2.
  • the detection result is sent to one input of the comparator 102. To the other input of the comparator 102, a predetermined reference value used when the second photosensor PS2 is selected is input.
  • the time (e.g. the number of steps) from the detection start to the timing at which the detection value of the second photosensor PS2 surpasses the predetermined reference value is counted and stored in the memory of the difference calculation circuit 104.
  • the changeover switch SW2 of the second photosensor PS2 is turned OFF, whereas the changeover switch SW1 of the first photosensor PS1 is turned ON.
  • reset of the first photosensor PS1 is carried out.
  • the switch connected to the metal of the first photosensor PS1 is turned ON, so that the connected line (node B) is fixed to the precharge potential.
  • the reset of the first photosensor PS1 is deactivated.
  • This reset deactivation renders node B the floating state, and thus node B keeps on holding the precharge potential accumulated in the reset.
  • light amount detection is started upon the reset deactivation.
  • the first photosensor PS1 can receive ambient light, and thus this detection is equivalent to measurement of current arising at the time of light irradiation.
  • the detection result is sent to one input of the comparator 102.
  • a predetermined reference value used when the first photosensor PS1 is selected is input.
  • the time (e.g. the number of steps) from the detection start to the timing at which the detection value of the first photosensor PS1 surpasses the predetermined reference value is counted and stored in the memory of the difference calculation circuit 104.
  • the detection result by the first photosensor PS1 and the detection result by the second photosensor PS2, stored in the memory of the difference calculation circuit 104, are read out, and the difference calculation circuit 104 performs operation of subtracting the detection result by the second photosensor PS2 from the detection result by the first photosensor PS1.
  • the light amount of the backlight emitted onto the display area 11 is controlled by the backlight control means. For example, the light amount of the backlight is increased when the light amount of ambient light is larger, whereas the light amount of the backlight is decreased when the light amount of ambient light is smaller.
  • the detection results about two photosensors PS1 and PS2 are compared by using one comparator 102 and calculation is performed with use of the values.
  • the light amount detection can be accurately carried out without suffering from the influence of variation in the characteristics of the comparator 102.
  • the display device encompasses one having a flat module shape like that shown in FIG. 5 .
  • this display module is obtained as follows.
  • a pixel array part in which pixels each including a liquid crystal element, a thin film transistor, a thin film capacitor, a light-receiving element, and so on are integrally formed into a matrix is provided on an insulating substrate.
  • an adhesive is so disposed as to surround this pixel array part (pixel matrix part), and a counter substrate composed of glass or the like is bonded to the insulating substrate.
  • This transparent counter substrate may be provided with a color filter, protective film, light-blocking film, and so on according to need.
  • the display module may be provided with e.g. a FPC (flexible printed circuit) as a connector for input/output of signals and so on to/from the pixel array part from/to the external.
  • FPC flexible printed circuit
  • the display device can be applied to a display device that is included in electronic apparatus in any field and displays an image or video based on a video signal input to the electronic apparatus or produced in the electronic apparatus.
  • the display device can be applied to a display device in various kinds of electronic apparatus shown in FIGS. 6 to 10 , such as a digital camera, notebook personal computer, portable terminal apparatus typified by a cellular phone, and video camera. Examples of electronic apparatus to which the present embodiment is applied will be described below.
  • FIG. 6 is a perspective view showing a television to which the present embodiment is applied.
  • the television according to the present application example includes a video display screen 110 composed of a front panel 120, a filter glass 130, and so on, and is fabricated by using the display device according to the present embodiment as the video display screen 110.
  • FIG. 7 is a perspective view showing a digital camera to which the present embodiment is applied: (A) is a front-side perspective view and (B) is a backside perspective view.
  • the digital camera according to the present application example includes a light emission unit 111 for flash, a display part 112, a menu switch 113, a shutter button 114, and so on, and is fabricated by using the display device according to the present embodiment as the display part 112.
  • FIG. 8 is a perspective view showing a notebook personal computer to which the present embodiment is applied.
  • the notebook personal computer according to the present application example includes, in a main body 121 thereof, a keyboard 122 operated in inputting of characters and so forth, a display part 123 for image displaying, and so on.
  • This notebook personal computer is fabricated by using the display device according to the present embodiment as the display part 123.
  • FIG. 9 is a perspective view showing a video camera to which the present embodiment is applied.
  • the video camera according to the present application example includes a main body 131, a lens 132 that is disposed on the side face directed toward the front side and used to capture a subject image, a start/stop switch 133 used at the time of imaging, a display part 134, and so on.
  • This video camera is fabricated by using the display device according to the present embodiment as the display part 134.
  • FIG. 10 is a diagram showing portable terminal apparatus to which the present embodiment is applied, specifically e.g. a cellular phone: (A) and (B) are front view and side view, respectively, of the opened state, and (C), (D), (E), (F), and (G) are front view, left-side view, right-side view, top view, and bottom view, respectively, of the closed state.
  • the cellular phone according to the present application example includes an upper case 141, a lower case 142, a connection (hinge, in this example) 143, a display 144, a sub-display 145, a picture light 146, a camera 147, and so on. This cellular phone is fabricated by using the display device according to the present embodiment as the display 144 and the sub-display 145.
  • the display device can be applied to the following display-and-imaging device.
  • This display-and-imaging device can be applied to the above-described various kinds of electronic apparatus.
  • FIG. 11 shows the entire configuration of the display-and-imaging device.
  • This display-and-imaging device includes an I/O display panel 2000, a backlight 1500, a display drive circuit 1200, a light-reception drive circuit 1300, an image processing unit 1400, and an application program execution unit 1100.
  • the I/O display panel 2000 is formed of a liquid crystal panel (LCD (Liquid Crystal Display)) in which plural pixels are arranged in a matrix across the entire surface.
  • the I/O display panel 2000 has a function (display function) to display a predetermined image such as graphics and characters based on display data through line-sequential operation, and has a function (imaging function) to capture the image of an object in contact with or in proximity to the I/O display panel 2000 as described later.
  • the backlight 1500 is obtained by arranging e.g. plural light emitting diodes and serves as the light source of the I/O display panel 2000.
  • the backlight 1500 carries out ON/OFF operation at high speed at predetermined timings in synchronization with the operation timings of the I/O display panel 2000 as described later.
  • the display drive circuit 1200 drives the I/O display panel 2000 (drives line-sequential operation) for displaying of an image based on display data on the I/O display panel 2000 (for display operation).
  • the light-reception drive circuit 1300 drives the I/O display panel 2000 (drives line-sequential operation) for acquisition of light-reception data by the I/O display panel 2000 (for imaging of an object).
  • the light-reception data by the respective pixels are accumulated in a frame memory 1300A e.g. on a frame-by-frame basis and are output as a captured image to the image processing unit 14.
  • the image processing unit 1400 executes predetermined image processing (arithmetic processing) based on the captured image output from the light-reception drive circuit 1300, and detects and acquires information on the object in contact with or in proximity to the I/O display panel 2000 (position coordinate data, data relating to the shape and the size of the object, and so forth).
  • the application program execution unit 1100 executes processing corresponding to predetermined application software based on the detection result by the image processing unit 1400. Examples of the processing include one for incorporating the position coordinates of the detected object into display data to thereby display the object on the I/O display panel 2000.
  • the display data produced by the application program execution unit 1100 is supplied to the display drive circuit 1200.
  • the I/O display panel 2000 includes a display area (sensor area) 2100, a display H driver 2200, a display V driver 2300, a sensor readout H driver 2500, and a sensor V driver 2400.
  • the display area (sensor area) 2100 is an area for outputting display light through modulation of light from the backlight 1500 and capturing the image of an object in contact with or in proximity to this area.
  • liquid crystal elements as light-emitting elements (display elements) and light-receiving elements (imaging elements) to be described later are arranged in a matrix.
  • the display H driver 2200 line-sequentially drives the liquid crystal elements of the respective pixels in the display area 2100 together with the display V driver 2300, based on a display signal and a control clock for display driving, supplied from the display drive circuit 1200.
  • the sensor readout H driver 2500 line-sequentially drives the light-receiving elements of the respective pixels in the sensor area 2100 together with the sensor V driver 2400, to thereby acquire a light-reception signal.
  • a pixel 3100 shown in FIG. 13 includes a liquid crystal element as a display element and a light-receiving element.
  • a switching element 3100a formed of a thin film transistor (TFT) or the like is disposed at the intersection of a gate electrode 3100h extending along the horizontal direction and a drain electrode 3100i extending along the vertical direction.
  • a pixel electrode 3100b including a liquid crystal is disposed between the switching element 3100a and a counter electrode.
  • the switching element 3100a carries out ON/OFF operation based on a drive signal supplied via the gate electrode 3100h.
  • a pixel voltage is applied to the pixel electrode 3100b based on a display signal supplied via the drain electrode 3100i, so that the display state is set.
  • a light-reception sensor 3100c formed of e.g. a photodiode is disposed and a supply voltage VDD is provided thereto.
  • a reset switch 3100d and a capacitor 3100e are connected to the light-reception sensor 3100c. Charges dependent on the light-reception amount are accumulated in the capacitor 3100e, and charges are reset by the reset switch 3100d.
  • the accumulated charges are supplied via a buffer amplifier 3100f to a signal output electrode 3100j and output to the external.
  • the ON/OFF operation of the reset switch 3100d is controlled by a signal supplied from a reset electrode 3100k.
  • the ON/OFF operation of the readout switch 3100g is controlled by a signal supplied from a readout control electrode 3100k.
  • a pixel 3100 for red (R), a pixel 3200 for green (G), and a pixel 3300 for blue (B) are arranged.
  • Charges accumulated in capacitors connected to the light-reception sensors 3100c, 3200c, and 3300c in the respective pixels are amplified by the buffer amplifiers 3100f, 3200f, and 3300f, respectively, and are supplied via signal output electrodes to the sensor readout H driver 2500 at the turn-on timings of the readout switches 3100g, 3200g, and 3300g, respectively.
  • Constant current sources 4100a, 4100b, and 4100c are connected to the respective signal output electrodes, and thus signals dependent on the light-reception amounts are detected by the sensor readout H driver 2500 with high sensitivity.
  • this display-and-imaging device i.e. display operation and object imaging operation in a pixel, will be described below.
  • a drive signal for displaying is produced in the display drive circuit 1200 based on display data supplied from the application program execution unit 1100, and line-sequential display driving of the I/O display panel 2000 is carried out by this drive signal, so that an image is displayed.
  • the backlight 1500 is also driven by the display drive circuit 1200, so that lighting and lighting-stop operation in synchronization with the I/O display panel 2000 is carried out.
  • the backlight 1500 stops lighting (is in the off-state) and thus displaying is not carried out during the former period of each frame period (for 1/120 seconds).
  • the backlight 1500 carries out lighting (is in the on-state) and display signals are supplied to the respective pixels, so that an image corresponding to this frame period is displayed.
  • the former period of each frame period is a light-absent period during which display light is not output from the I/O display panel 2000.
  • the latter period of each frame period is a light-present period during which display light is output from the I/O display panel 2000.
  • the image of the object is captured by the light-receiving elements of the respective pixels in the I/O display panel 2000 through line-sequential light-reception driving by the light-reception drive circuit 1300, and light-reception signals from the respective light-receiving elements are supplied to the light-reception drive circuit 1300.
  • the light-reception signals of the pixels corresponding to one frame are accumulated in the light-reception drive circuit 1300 and are output as a captured image to the image processing unit 14.
  • the image processing unit 1400 executes predetermined image processing (arithmetic processing) based on this captured image, so that information on the object in contact with or in proximity to the I/O display panel 2000 (position coordinate data, data relating to the shape and the size of the object, and so forth) is detected.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Power Engineering (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Sustainable Development (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Liquid Crystal Display Device Control (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)
  • Photometry And Measurement Of Optical Pulse Characteristics (AREA)
  • Liquid Crystal (AREA)

Abstract

The present invention is to apparently decrease the parasitic capacitance of the detection element to thereby suppress the influence of the parasitic capacitance of the detection element itself at the time of light amount detection. According to the present invention, in a display device including a photosensor PS that detects the ambient light amount of a display area, a comparator (102) that compares the output of the photosensor PS with a predetermined reference value, and a backlight controller (105) that controls the amount of light supplied to the display area depending on a comparison result by the comparator (102), a switch SW for controlling application of a precharge potential is connected to a metal that exists near the light-receiving part of the photosensor PS with the intermediary of an insulating film.

Description

    Technical Field
  • The present invention relates to a display device that displays predetermined video, a display control method for controlling the display device, and an electronic apparatus employing a display device.
  • Background Art
  • Previously, for measurement of light illuminance by a photosensor formed in a TFT panel as a liquid crystal display device (e.g. refer to Japanese Patent Laid-open No. 2006-106294 ), there is a method in which a comparator is connected to the sensor output as shown in FIG. 16 and electric charges (including dark current leakage) generated due to light reception are accumulated in capacitance to thereby measure the time to attainment of a reference voltage.
  • FIG. 17 is a schematic diagram showing the structure of the photosensor. The photosensor has a structure in which a light-receiving part composed of poly-silicon is opposed to a metal with the intermediary of an insulating film, and outputs charges depending on the amount of light captured by the light-receiving part.
  • Disclosure of Invention
  • However, in readout of the light amount by such a structure, because charges are accumulated in capacitance, high parasitic capacitance of the photosensor element itself causes a problem that the time of the charge accumulation in capacitance is extended. Specifically, in a photosensor structure like that shown in FIG. 17, the parasitic capacitance between the light-receiving part and the metal provided with the intermediary of the insulating film is high and therefore the above-described charge accumulation time is extended, which precludes rapid light amount detection.
  • The present invention is made in order to solve such a problem. Specifically, according to the present invention, in a display device including a detection element that detects the ambient light amount of a display area, a comparator that compares an output of the detection element with a predetermined reference value, and a control means that controls the amount of light supplied to the display area depending on a comparison result by the comparator, a switch for controlling application of a precharge potential is connected to a metal that exists near a light-receiving part of the detection element with the intermediary of an insulating film.
  • In this present invention, the switch for controlling application of the precharge potential is provided for the metal that exists near the light-receiving part of the detection element with the intermediary of the insulating film. Thus, when the precharge potential is applied to the metal opposed to the light-receiving part of the detection element by this switch, charges are accumulated in parasitic capacitance between the light-receiving part and the metal by the precharge potential, so that the parasitic capacitance can be apparently decreased.
  • Examples of the switch that is connected to the metal and controls application of the precharge potential to the metal include an analog switch and an element with high resistance.
  • Furthermore, according to the present invention, in a display control method of detecting the ambient light amount of a display area by a detection element and controlling the amount of light supplied to the display area based on a result of comparison between a detection value and a predetermined reference value, a precharge potential is applied to a metal that exists near a light-receiving part of the detection element with the intermediary of an insulating film before start of light amount detection by the detection element, and the potential of the metal is rendered a floating state in the light amount detection.
  • In this present invention, the precharge potential is applied to the metal opposed to the light-receiving part before the start of the light amount detection by the detection element. Thus, charges are accumulated in parasitic capacitance between the light-receiving part and the metal by the precharge potential, so that the parasitic capacitance can be apparently decreased.
  • Furthermore, according to the present invention, in an electronic apparatus including a display device provided in a case, the display device includes a detection element that detects the ambient light amount of a display area, a comparator that compares an output of the detection element with a predetermined reference value, and a control means that controls the amount of light supplied to the display area depending on a comparison result by the comparator. In addition, a switch for controlling application of a precharge potential is connected to a metal that exists near a light-receiving part of the detection element with the intermediary of an insulating film.
  • In this present invention, the switch for controlling application of the precharge potential is provided for the metal that exists near the light-receiving part of the detection element with the intermediary of the insulating film. Thus, when the precharge potential is applied to the metal opposed to the light-receiving part of the detection element by this switch, charges are accumulated in parasitic capacitance between the light-receiving part and the metal by the precharge potential, so that the parasitic capacitance can be apparently decreased.
  • The present invention provides the following advantage. Specifically, because the parasitic capacitance of the detection element can be apparently decreased, the influence of the parasitic capacitance of the detection element itself can be suppressed at the time of the light amount detection, and the charge accumulation time can be shortened to allow rapid light amount detection.
  • Brief Description of Drawings
    • [FIG. 1]
      FIG. 1 is a schematic configuration diagram of a display device according to the present embodiment.
    • [FIG. 2]
      FIG. 2 is a circuit diagram for explaining major part of the display device according to the present embodiment.
    • [FIG. 3]
      FIG. 3 is a timing chart for explaining a display control method of the display device of the present embodiment.
    • [FIG. 4]
      FIG. 4 is a circuit diagram for explaining a configuration for carrying out display control with use of two photosensors.
    • [FIG. 5]
      FIG. 5 is a schematic diagram showing an example of a flat module shape.
    • [FIG. 6]
      FIG. 6 is a perspective view showing a television to which the present embodiment is applied.
    • [FIG. 7]
      FIG. 7 is a perspective view showing a digital camera to which the present embodiment is applied.
    • [FIG. 8]
      FIG. 8 is a perspective view showing a notebook personal computer to which the present embodiment is applied.
    • [FIG. 9]
      FIG. 9 is a perspective view showing a video camera to which the present embodiment is applied.
    • [FIG. 10]
      FIG. 10 is a diagram showing portable terminal apparatus to which the present embodiment is applied, specifically e.g. a cellular phone.
    • [FIG. 11]
      FIG. 11 is a block diagram showing the configuration of a display-and-imaging device according to the first embodiment of the present invention.
    • [FIG. 12]
      FIG. 12 is a block diagram showing a configuration example of an I/O display panel shown in FIG. 1.
    • [FIG. 13]
      FIG. 13 is a circuit diagram showing a configuration example of each pixel.
    • [FIG. 14]
      FIG. 14 is a circuit diagram for explaining the connection relationship between the respective pixels and a sensor readout H driver.
    • [FIG. 15]
      FIG. 15 is a timing diagram for explaining the relationship between the on-/off-state of a backlight and the display state.
    • [FIG. 16]
      FIG. 16 is a diagram for explaining a conventional example.
    • [FIG. 17]
      FIG. 17 is a schematic sectional view for explaining the structure of a photosensor.
    Best Modes for Carrying Out the Invention
  • An embodiment of the present invention will be described below based on the drawings.
  • <Outline of Display Device>
  • FIG. 1 is a schematic configuration diagram of a display device according to the present embodiment. Specifically, a display panel 10 as the display device of the present embodiment includes a display area (sensor area) 11, a selection switch 12 that carries out scanning along the H (horizontal) direction for displaying, a V driver 13 that carries out scanning along the V (vertical) direction for displaying, a display driver 14, a sensor driver 15, and plural photosensors PS.
  • The display area (sensor area) 11 modulates light from a backlight, which is not shown in the drawing, and outputs display light. The plural photosensors PS are disposed in the periphery of the display area 11 and are driven by the sensor driver 15. The display driver 14 and the sensor driver 15 are collected into an integrated circuit and are mounted as a chip component on the substrate.
  • The selection switch 12 line-sequentially drives the liquid crystal elements of the respective pixels in the display area 11 together with the V driver 13, based on a display signal and a control clock for display driving, supplied from the display driver 14.
  • Around the display area 11, the plural photosensors PS are disposed. The photosensors PS are formed of a diode configuration or a transistor configuration and are formed on the same substrate as that of the drive elements formed in the display area 11 for example.
  • The display panel 10 is connected via a cable to external interfaces (e.g. a display interface, CPU interface) and a backlight control means and is driven based on a control signal and a video signal from these units.
  • Although four photosensors PS are provided corresponding to the corners of the display area 11 in the example shown in FIG. 1, it is sufficient that at least one photosensor is provided. If two photosensors are provided, one of them may detect the ambient light amount and the other may detect dark current arising when light is blocked so that the detection value corresponding to the dark current may be cancelled based on the difference between these two photosensors. In the present embodiment, the control unit (backlight controller) controls the light amount of the backlight based on the detection result by this photosensor. A specific application example of this photosensor will be described below.
  • FIG. 2 is a circuit diagram for explaining major part of the display device according to the present embodiment. Specifically, this display device includes a photosensor PS as a detection element that detects the ambient light amount of the display area, a comparator 102 that compares the output of the photosensor PS with a predetermined reference value, and a controller (backlight controller 105) that controls the amount of light supplied to the display area depending on a comparison result by the comparator 102.
  • Further, in particular, the photosensor PS has a structure like that shown in FIG. 12 in the present embodiment. Specifically, a switch SW for controlling application of a precharge potential is connected to the metal that exists near the light-receiving part of the photosensor PS with the intermediary of an insulating film.
  • The switch SW connected to the metal may be an analog switch. Alternatively, it may be an element having high resistance. By turning ON (closing) this switch SW, the precharge potential is applied to the metal of the photosensor PS, so that charges are accumulated in parasitic capacitance formed between the metal and the light-receiving part. The switch SW is turned OFF (opened) in this state to thereby render the metal potential the floating state, and the light amount is detected by the light-receiving part. By this scheme, the apparent parasitic capacitance between the metal and the light-receiving part of the photosensor PS is decreased, which can shorten the charge accumulation time at the time of the light amount detection and thus allows rapid detection.
  • <Display Control Method by Display Device According to Present Embodiment: Basic Control Method>
  • FIG. 3 is a timing chart for explaining a display control method of the display device of the present embodiment. Operation for measuring the illuminance will be described below. First, reset is carried out for the entire circuit shown in FIG. 2. In the reset, a reset transistor Tr-reset is turned ON and the switch SW connected to the metal of the photosensor PS is turned ON. By this operation, node A as the output line of the photosensor PS is fixed to a reset potential.
  • Furthermore, node B of a wiring connected to the metal of the photosensor ps is fixed to the precharge potential due to the turn-on of the switch SW.
  • This reset operation is carried out in e.g. a vertical blanking period of video displaying on the display area 11 (see FIG. 1). This can prevent the reset operation from affecting the video displaying.
  • As deactivation of the reset, the reset transistor Tr-reset is turned OFF and the switch is turned OFF. This reset deactivation renders the potential of node B the floating state, and thus node B keeps on holding the precharge potential accumulated in the reset.
  • If light is incident on the light-receiving part of the photosensor PS in this state, charges are generated depending on the light amount and accumulated in the capacitance (parasitic capacitance) of node A as the output line.
    Furthermore, node A is input to the comparator 102 and compared with the reference potential. When the potential of node A surpasses the reference potential, the comparator output (output) is inverted. The light amount can be measured based on the time from the reset to the output inversion.
  • Consideration will be made below about the parasitic capacitance of node A, which is equivalent to the output line of the photosensor PS. At the time of the reset, high capacitance arises at node A because node A is connected to node B (= precharge potential) via the insulating film of the photosensor PS. However, when the reset is deactivated, node B follows change in node A because the potential of node B is in the floating state, although capacitance exists at node A because node B exists with the intermediary of the insulating film. Therefore, capacitance is absent from the viewpoint of node A. Thus, using this circuit can apparently decrease the parasitic capacitance of the sensor output at the time of photosensor readout.
  • The detection by the photosensor PS is started from the reset deactivation. As a result of the comparison by the comparator 102, the time (e.g. the number of steps) to the timing at which the detection value surpasses the predetermined reference value is counted and stored in the memory of the backlight controller 105.
  • Thereafter, the light amount of the backlight emitted onto the display area 11 (see FIG. 1) is controlled by the backlight controller 105 based on the detection result by the photosensor PS, stored in the memory of the backlight controller 105. For example, the light amount of the backlight is increased when the ambient light amount is larger, whereas the light amount of the backlight is decreased when the ambient light amount is smaller.
  • In the above-described manner, the parasitic capacitance of the output of the photosensor PS can be decreased, which can shorten the detection time and thus allows rapid control of the light amount of the backlight.
  • <Display Control Method by Display Device According to Present Embodiment: with Two Photosensors>
  • FIG. 4 is a circuit diagram for explaining a configuration for carrying out display control with use of two photosensors. Specifically, in this configuration, a first photosensor PS1 that detects the ambient light amount of the display area and a second photosensor PS2 that detects dark current arising when light is blocked are used, and comparison between the detection results by these photosensors and predetermined reference values is carried out with one comparator 102. For this purpose, switching between the first photosensor PS1 and the second photosensor PS2 is carried out, and the comparator 102 is operated in a time-division manner. For each of the photosensors PS1 and PS2, the above-described switch (not shown) for controlling application of a precharge voltage is provided.
  • Initially, a changeover switch SW1 of the first photosensor PS1 is turned OFF, whereas a changeover switch SW2 of the second photosensor PS2 is turned ON. In this state, reset of the second photosensor PS2 is carried out. By this reset, the switch connected to the metal of the second photosensor PS2 is turned ON, so that the connected line (node B) is fixed to the precharge potential.
  • Subsequently, the reset of the second photosensor PS2 is deactivated. This reset deactivation renders node B the floating state, and thus node B keeps on holding the precharge potential accumulated in the reset. Furthermore, light amount detection is started upon the reset deactivation. This detection is equivalent to measurement of dark current arising when light is blocked because a black color filter is provided for the second photosensor PS2. The detection result is sent to one input of the comparator 102. To the other input of the comparator 102, a predetermined reference value used when the second photosensor PS2 is selected is input.
  • Subsequently, the time (e.g. the number of steps) from the detection start to the timing at which the detection value of the second photosensor PS2 surpasses the predetermined reference value is counted and stored in the memory of the difference calculation circuit 104.
  • Subsequently, the changeover switch SW2 of the second photosensor PS2 is turned OFF, whereas the changeover switch SW1 of the first photosensor PS1 is turned ON. In this state, reset of the first photosensor PS1 is carried out. By this reset, the switch connected to the metal of the first photosensor PS1 is turned ON, so that the connected line (node B) is fixed to the precharge potential.
  • Subsequently, the reset of the first photosensor PS1 is deactivated. This reset deactivation renders node B the floating state, and thus node B keeps on holding the precharge potential accumulated in the reset. Furthermore, light amount detection is started upon the reset deactivation. The first photosensor PS1 can receive ambient light, and thus this detection is equivalent to measurement of current arising at the time of light irradiation. The detection result is sent to one input of the comparator 102. To the other input of the comparator 102, a predetermined reference value used when the first photosensor PS1 is selected is input.
  • Subsequently, the time (e.g. the number of steps) from the detection start to the timing at which the detection value of the first photosensor PS1 surpasses the predetermined reference value is counted and stored in the memory of the difference calculation circuit 104.
  • Subsequently, the detection result by the first photosensor PS1 and the detection result by the second photosensor PS2, stored in the memory of the difference calculation circuit 104, are read out, and the difference calculation circuit 104 performs operation of subtracting the detection result by the second photosensor PS2 from the detection result by the first photosensor PS1. This allows achievement of the result arising from subtraction of the component corresponding to the dark current from the detection result obtained at the time of the light irradiation. Based on this calculation result, the light amount of the backlight emitted onto the display area 11 (see FIG. 1) is controlled by the backlight control means. For example, the light amount of the backlight is increased when the light amount of ambient light is larger, whereas the light amount of the backlight is decreased when the light amount of ambient light is smaller.
  • In this manner, the detection results about two photosensors PS1 and PS2 are compared by using one comparator 102 and calculation is performed with use of the values. Thus, the light amount detection can be accurately carried out without suffering from the influence of variation in the characteristics of the comparator 102.
  • <Electronic Apparatus>
  • The display device according to the present embodiment encompasses one having a flat module shape like that shown in FIG. 5. For example, this display module is obtained as follows. A pixel array part in which pixels each including a liquid crystal element, a thin film transistor, a thin film capacitor, a light-receiving element, and so on are integrally formed into a matrix is provided on an insulating substrate. Furthermore, an adhesive is so disposed as to surround this pixel array part (pixel matrix part), and a counter substrate composed of glass or the like is bonded to the insulating substrate. This transparent counter substrate may be provided with a color filter, protective film, light-blocking film, and so on according to need. The display module may be provided with e.g. a FPC (flexible printed circuit) as a connector for input/output of signals and so on to/from the pixel array part from/to the external.
  • The display device according to the above-described present embodiment can be applied to a display device that is included in electronic apparatus in any field and displays an image or video based on a video signal input to the electronic apparatus or produced in the electronic apparatus. Specifically, the display device can be applied to a display device in various kinds of electronic apparatus shown in FIGS. 6 to 10, such as a digital camera, notebook personal computer, portable terminal apparatus typified by a cellular phone, and video camera. Examples of electronic apparatus to which the present embodiment is applied will be described below.
  • FIG. 6 is a perspective view showing a television to which the present embodiment is applied. The television according to the present application example includes a video display screen 110 composed of a front panel 120, a filter glass 130, and so on, and is fabricated by using the display device according to the present embodiment as the video display screen 110.
  • FIG. 7 is a perspective view showing a digital camera to which the present embodiment is applied: (A) is a front-side perspective view and (B) is a backside perspective view. The digital camera according to the present application example includes a light emission unit 111 for flash, a display part 112, a menu switch 113, a shutter button 114, and so on, and is fabricated by using the display device according to the present embodiment as the display part 112.
  • FIG. 8 is a perspective view showing a notebook personal computer to which the present embodiment is applied. The notebook personal computer according to the present application example includes, in a main body 121 thereof, a keyboard 122 operated in inputting of characters and so forth, a display part 123 for image displaying, and so on. This notebook personal computer is fabricated by using the display device according to the present embodiment as the display part 123.
  • FIG. 9 is a perspective view showing a video camera to which the present embodiment is applied. The video camera according to the present application example includes a main body 131, a lens 132 that is disposed on the side face directed toward the front side and used to capture a subject image, a start/stop switch 133 used at the time of imaging, a display part 134, and so on. This video camera is fabricated by using the display device according to the present embodiment as the display part 134.
  • FIG. 10 is a diagram showing portable terminal apparatus to which the present embodiment is applied, specifically e.g. a cellular phone: (A) and (B) are front view and side view, respectively, of the opened state, and (C), (D), (E), (F), and (G) are front view, left-side view, right-side view, top view, and bottom view, respectively, of the closed state. The cellular phone according to the present application example includes an upper case 141, a lower case 142, a connection (hinge, in this example) 143, a display 144, a sub-display 145, a picture light 146, a camera 147, and so on. This cellular phone is fabricated by using the display device according to the present embodiment as the display 144 and the sub-display 145.
  • <Display-and-Imaging Device>
  • The display device according to the present embodiment can be applied to the following display-and-imaging device. This display-and-imaging device can be applied to the above-described various kinds of electronic apparatus. FIG. 11 shows the entire configuration of the display-and-imaging device. This display-and-imaging device includes an I/O display panel 2000, a backlight 1500, a display drive circuit 1200, a light-reception drive circuit 1300, an image processing unit 1400, and an application program execution unit 1100.
  • The I/O display panel 2000 is formed of a liquid crystal panel (LCD (Liquid Crystal Display)) in which plural pixels are arranged in a matrix across the entire surface. The I/O display panel 2000 has a function (display function) to display a predetermined image such as graphics and characters based on display data through line-sequential operation, and has a function (imaging function) to capture the image of an object in contact with or in proximity to the I/O display panel 2000 as described later. The backlight 1500 is obtained by arranging e.g. plural light emitting diodes and serves as the light source of the I/O display panel 2000. The backlight 1500 carries out ON/OFF operation at high speed at predetermined timings in synchronization with the operation timings of the I/O display panel 2000 as described later.
  • The display drive circuit 1200 drives the I/O display panel 2000 (drives line-sequential operation) for displaying of an image based on display data on the I/O display panel 2000 (for display operation).
  • The light-reception drive circuit 1300 drives the I/O display panel 2000 (drives line-sequential operation) for acquisition of light-reception data by the I/O display panel 2000 (for imaging of an object). The light-reception data by the respective pixels are accumulated in a frame memory 1300A e.g. on a frame-by-frame basis and are output as a captured image to the image processing unit 14.
  • The image processing unit 1400 executes predetermined image processing (arithmetic processing) based on the captured image output from the light-reception drive circuit 1300, and detects and acquires information on the object in contact with or in proximity to the I/O display panel 2000 (position coordinate data, data relating to the shape and the size of the object, and so forth).
  • The application program execution unit 1100 executes processing corresponding to predetermined application software based on the detection result by the image processing unit 1400. Examples of the processing include one for incorporating the position coordinates of the detected object into display data to thereby display the object on the I/O display panel 2000. The display data produced by the application program execution unit 1100 is supplied to the display drive circuit 1200.
  • A detailed configuration example of the I/O display panel 2000 will be described below with reference to FIG. 12. The I/O display panel 2000 includes a display area (sensor area) 2100, a display H driver 2200, a display V driver 2300, a sensor readout H driver 2500, and a sensor V driver 2400.
  • The display area (sensor area) 2100 is an area for outputting display light through modulation of light from the backlight 1500 and capturing the image of an object in contact with or in proximity to this area. In this area, liquid crystal elements as light-emitting elements (display elements) and light-receiving elements (imaging elements) to be described later are arranged in a matrix.
  • The display H driver 2200 line-sequentially drives the liquid crystal elements of the respective pixels in the display area 2100 together with the display V driver 2300, based on a display signal and a control clock for display driving, supplied from the display drive circuit 1200.
  • The sensor readout H driver 2500 line-sequentially drives the light-receiving elements of the respective pixels in the sensor area 2100 together with the sensor V driver 2400, to thereby acquire a light-reception signal.
  • A detailed configuration example of each pixel in the display area 2100 will be described below with reference to FIG. 13. A pixel 3100 shown in FIG. 13 includes a liquid crystal element as a display element and a light-receiving element.
  • Specifically, on the display element side, a switching element 3100a formed of a thin film transistor (TFT) or the like is disposed at the intersection of a gate electrode 3100h extending along the horizontal direction and a drain electrode 3100i extending along the vertical direction. A pixel electrode 3100b including a liquid crystal is disposed between the switching element 3100a and a counter electrode. The switching element 3100a carries out ON/OFF operation based on a drive signal supplied via the gate electrode 3100h. When the switching element 3100a is in the on-state, a pixel voltage is applied to the pixel electrode 3100b based on a display signal supplied via the drain electrode 3100i, so that the display state is set.
  • On the other hand, on the light-receiving element side adjacent to the display element, a light-reception sensor 3100c formed of e.g. a photodiode is disposed and a supply voltage VDD is provided thereto. A reset switch 3100d and a capacitor 3100e are connected to the light-reception sensor 3100c. Charges dependent on the light-reception amount are accumulated in the capacitor 3100e, and charges are reset by the reset switch 3100d. At the turn-on timing of a readout switch 3100g, the accumulated charges are supplied via a buffer amplifier 3100f to a signal output electrode 3100j and output to the external. The ON/OFF operation of the reset switch 3100d is controlled by a signal supplied from a reset electrode 3100k. The ON/OFF operation of the readout switch 3100g is controlled by a signal supplied from a readout control electrode 3100k.
  • With reference to FIG. 14, the connection relationship between the respective pixels in the display area 2100 and the sensor readout H driver 2500 will be described below. In this display area 2100, a pixel 3100 for red (R), a pixel 3200 for green (G), and a pixel 3300 for blue (B) are arranged.
  • Charges accumulated in capacitors connected to the light- reception sensors 3100c, 3200c, and 3300c in the respective pixels are amplified by the buffer amplifiers 3100f, 3200f, and 3300f, respectively, and are supplied via signal output electrodes to the sensor readout H driver 2500 at the turn-on timings of the readout switches 3100g, 3200g, and 3300g, respectively. Constant current sources 4100a, 4100b, and 4100c are connected to the respective signal output electrodes, and thus signals dependent on the light-reception amounts are detected by the sensor readout H driver 2500 with high sensitivity.
  • The operation of the display-and-imaging device will be described in detail below.
  • Initially, the basic operation of this display-and-imaging device, i.e. display operation and object imaging operation in a pixel, will be described below.
  • In this display-and-imaging device, a drive signal for displaying is produced in the display drive circuit 1200 based on display data supplied from the application program execution unit 1100, and line-sequential display driving of the I/O display panel 2000 is carried out by this drive signal, so that an image is displayed. At this time, the backlight 1500 is also driven by the display drive circuit 1200, so that lighting and lighting-stop operation in synchronization with the I/O display panel 2000 is carried out.
  • With reference to FIG. 15, the relationship between the on-/off-state of the backlight 1500 and the display state of the I/O display panel 2000 will be described below.
  • First, in the case of image displaying with a frame cycle of e.g. 1/60 seconds, the backlight 1500 stops lighting (is in the off-state) and thus displaying is not carried out during the former period of each frame period (for 1/120 seconds). On the other hand, during the latter period of each frame period, the backlight 1500 carries out lighting (is in the on-state) and display signals are supplied to the respective pixels, so that an image corresponding to this frame period is displayed.
  • As above, the former period of each frame period is a light-absent period during which display light is not output from the I/O display panel 2000. On the other hand, the latter period of each frame period is a light-present period during which display light is output from the I/O display panel 2000.
  • When there is an object (such as a fingertip) in contact with or in proximity to the I/O display panel 2000, the image of the object is captured by the light-receiving elements of the respective pixels in the I/O display panel 2000 through line-sequential light-reception driving by the light-reception drive circuit 1300, and light-reception signals from the respective light-receiving elements are supplied to the light-reception drive circuit 1300. The light-reception signals of the pixels corresponding to one frame are accumulated in the light-reception drive circuit 1300 and are output as a captured image to the image processing unit 14.
  • The image processing unit 1400 executes predetermined image processing (arithmetic processing) based on this captured image, so that information on the object in contact with or in proximity to the I/O display panel 2000 (position coordinate data, data relating to the shape and the size of the object, and so forth) is detected.

Claims (3)

  1. A display device comprising:
    a detection element that detects an ambient light amount of a display area;
    a comparator that compares an output of the detection element with a predetermined reference value; and
    control means for controlling an amount of light supplied to the display area depending on a comparison result by the comparator, wherein
    a switch for controlling application of a precharge potential is connected to a metal that exists near a light-receiving part of the detection element with intermediary of an insulating film.
  2. A display control method of detecting an ambient light amount of a display area by detection means and controlling an amount of light supplied to the display area based on a result of comparison between a detection value and a predetermined reference value, wherein
    a precharge potential is applied to a metal that exists near a light-receiving part of the detection element with intermediary of an insulating film before start of light amount detection by the detection element, and a potential of the metal is rendered a floating state in the light amount detection.
  3. An electronic apparatus comprising a display device provided in a case, the display device including:
    a detection element that detects an ambient light amount of a display area;
    a comparator that compares an output of the detection element with a predetermined reference value; and
    control means that controls an amount of light supplied to the display area depending on a comparison result by the comparator, wherein
    a switch for controlling application of a precharge potential is connected to a metal that exists near a light-receiving part of the detection element with intermediary of an insulating film.
EP08848069.4A 2007-11-09 2008-10-16 Display device, display control method, and electronic device Not-in-force EP2207160B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2007291468A JP5196963B2 (en) 2007-11-09 2007-11-09 Display device, display control method, and electronic device
PCT/JP2008/068721 WO2009060700A1 (en) 2007-11-09 2008-10-16 Display device, display control method, and electronic device

Publications (3)

Publication Number Publication Date
EP2207160A1 true EP2207160A1 (en) 2010-07-14
EP2207160A4 EP2207160A4 (en) 2011-05-25
EP2207160B1 EP2207160B1 (en) 2015-07-15

Family

ID=40625600

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08848069.4A Not-in-force EP2207160B1 (en) 2007-11-09 2008-10-16 Display device, display control method, and electronic device

Country Status (7)

Country Link
US (1) US8552967B2 (en)
EP (1) EP2207160B1 (en)
JP (1) JP5196963B2 (en)
KR (1) KR101464012B1 (en)
CN (1) CN101583990B (en)
TW (1) TWI396889B (en)
WO (1) WO2009060700A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101855668B (en) 2007-11-14 2013-01-16 株式会社半导体能源研究所 Liquid crystal display device
DE102008046563A1 (en) 2008-09-10 2010-03-11 Siemens Aktiengesellschaft Method for data transmission between network nodes
CN102511025B (en) * 2009-09-30 2015-02-04 夏普株式会社 Display device
US9335854B2 (en) 2009-09-30 2016-05-10 Sharp Kabushiki Kaisha Display device
JP5510998B2 (en) * 2009-11-13 2014-06-04 株式会社ジャパンディスプレイ Sensor device, sensor element driving method, display device with input function, and electronic apparatus
US9069412B2 (en) * 2010-05-20 2015-06-30 Sharp Kabushiki Kaisha Touch-sensor-equipped display device comrpising photodetecting elements
FR2983296B1 (en) * 2011-11-29 2013-12-27 Soc Fr Detecteurs Infrarouges Sofradir RADIATION DETECTION DEVICE WITH ENHANCED ILLUMINATION SCALE
KR20150060129A (en) 2013-11-26 2015-06-03 삼성디스플레이 주식회사 Pixel circuit and display device having the same
US10515595B2 (en) 2016-12-23 2019-12-24 Samsung Electronics Co., Ltd. Display apparatus and method for driving the same
CN108303176B (en) * 2018-01-02 2020-02-11 京东方科技集团股份有限公司 Optical sensor, optical detection method and display device
KR102545211B1 (en) * 2018-01-10 2023-06-19 삼성전자주식회사 Electronic apparatus and control method thereof
CN112484850B (en) * 2019-09-11 2024-03-26 北京小米移动软件有限公司 Light intensity detection module, screen component and mobile terminal
CN111179861B (en) * 2019-12-11 2021-06-15 Tcl移动通信科技(宁波)有限公司 Brightness calibration method and device, storage medium and terminal
CN112235460B (en) * 2020-10-09 2021-07-09 Oppo(重庆)智能科技有限公司 Control method, control device, electronic device, and readable storage medium
CN112259053A (en) * 2020-11-05 2021-01-22 上海摩软通讯技术有限公司 Display method and display device
WO2023132379A1 (en) * 2022-01-05 2023-07-13 엘지전자 주식회사 Display device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4841349A (en) * 1984-11-16 1989-06-20 Fujitsu Limited Semiconductor photodetector device with light responsive PN junction gate
US6046466A (en) * 1997-09-12 2000-04-04 Nikon Corporation Solid-state imaging device
JP2000101928A (en) * 1998-09-18 2000-04-07 Honda Motor Co Ltd Optical sensor circuit and image sensor using the circuit
US20070046619A1 (en) * 2005-08-31 2007-03-01 Sanyo Epson Imaging Devices Corp. Liquid crystal display device
US20070188439A1 (en) * 2006-02-16 2007-08-16 Sanyo Epson Imaging Devices Corporation Electrooptic device, driving circuit, and electronic device

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0815320B2 (en) * 1986-12-09 1996-02-14 キヤノン株式会社 Photoelectric conversion device
JP3463309B2 (en) * 1993-02-16 2003-11-05 ソニー株式会社 Internal amplification type solid-state imaging device
JP4144058B2 (en) * 1998-01-09 2008-09-03 株式会社ニコン Solid-state imaging device
JP4609970B2 (en) * 2001-01-17 2011-01-12 カシオ計算機株式会社 Liquid crystal display device
JP2003046715A (en) * 2001-08-01 2003-02-14 Casio Comput Co Ltd Image reader and image reading method
JP2006039298A (en) * 2004-07-28 2006-02-09 Mitsubishi Electric Corp Liquid crystal display panel and liquid crystal display device using the same
JP2006106294A (en) 2004-10-04 2006-04-20 Sony Corp Liquid crystal display device
KR20070017695A (en) * 2005-08-08 2007-02-13 삼성전자주식회사 Display device and driving method thereof
JP4572799B2 (en) * 2005-10-18 2010-11-04 ソニー株式会社 Liquid crystal display
JP4813857B2 (en) * 2005-09-20 2011-11-09 株式会社 日立ディスプレイズ Display device with common electrode applied voltage adjustment function and adjustment method thereof
JP2007114315A (en) * 2005-10-18 2007-05-10 Toshiba Matsushita Display Technology Co Ltd Display device
JP2007279093A (en) * 2006-04-03 2007-10-25 Epson Imaging Devices Corp Liquid crystal display device
JP4431994B2 (en) * 2006-05-16 2010-03-17 株式会社 日立ディスプレイズ Liquid crystal display

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4841349A (en) * 1984-11-16 1989-06-20 Fujitsu Limited Semiconductor photodetector device with light responsive PN junction gate
US6046466A (en) * 1997-09-12 2000-04-04 Nikon Corporation Solid-state imaging device
JP2000101928A (en) * 1998-09-18 2000-04-07 Honda Motor Co Ltd Optical sensor circuit and image sensor using the circuit
US20070046619A1 (en) * 2005-08-31 2007-03-01 Sanyo Epson Imaging Devices Corp. Liquid crystal display device
US20070188439A1 (en) * 2006-02-16 2007-08-16 Sanyo Epson Imaging Devices Corporation Electrooptic device, driving circuit, and electronic device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2009060700A1 *

Also Published As

Publication number Publication date
WO2009060700A1 (en) 2009-05-14
JP2009116205A (en) 2009-05-28
JP5196963B2 (en) 2013-05-15
TWI396889B (en) 2013-05-21
TW200935126A (en) 2009-08-16
CN101583990A (en) 2009-11-18
US8552967B2 (en) 2013-10-08
KR20100086929A (en) 2010-08-02
CN101583990B (en) 2012-11-14
KR101464012B1 (en) 2014-11-20
US20100020009A1 (en) 2010-01-28
EP2207160B1 (en) 2015-07-15
EP2207160A4 (en) 2011-05-25

Similar Documents

Publication Publication Date Title
EP2207160B1 (en) Display device, display control method, and electronic device
EP2141688B1 (en) Display device, display control method and electronic device
US8564580B2 (en) Display device and electronic apparatus
TWI441125B (en) Display devices and electronic machines
US8334854B2 (en) Display device and display method
US7773068B2 (en) Display device
TWI406046B (en) Display
EP2330489A1 (en) Display panel with built-in optical sensor
US20100020006A1 (en) Display device and electronic equipment
KR101470647B1 (en) Display device, display control method, and electronic equipment
JP2007065508A (en) Display device and display method
US8400413B2 (en) Display apparatus and display method
JP2008064828A (en) Liquid crystal device and electronic apparatus
JP5697725B2 (en) Display device, display control method, and electronic device
JP2009059854A (en) Light-receiving device, electro-optical device including light-receiving device, and electronic equipment

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20090630

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20110421

17Q First examination report despatched

Effective date: 20110505

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: JAPAN DISPLAY WEST INC.

RIC1 Information provided on ipc code assigned before grant

Ipc: G02F 1/136 20060101ALI20141201BHEP

Ipc: G01J 1/10 20060101ALI20141201BHEP

Ipc: G09G 3/34 20060101ALI20141201BHEP

Ipc: G09F 9/00 20060101ALI20141201BHEP

Ipc: G01J 1/42 20060101ALI20141201BHEP

Ipc: G01J 1/02 20060101ALI20141201BHEP

Ipc: G02F 1/133 20060101ALI20141201BHEP

Ipc: G01J 1/46 20060101ALI20141201BHEP

Ipc: G09G 3/36 20060101AFI20141201BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150112

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: JAPAN DISPLAY INC.

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 737152

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150815

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602008039069

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 737152

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150715

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20150715

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151015

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151016

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20151021

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151116

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151115

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20151023

Year of fee payment: 8

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602008039069

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151016

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20160418

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151031

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151016

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20081016

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20161016

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20170630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161016

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150715

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20181019

Year of fee payment: 11

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602008039069

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200501