JP2010108303A - Image detection/display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image detection/display device sharing signal lines and changing an operation rate in response to detection of an image. <P>SOLUTION: An image detection/display device 100 includes a circuit control unit 600 which controls each part of display/optical sensor units 300, and a bus 400 connected to the circuit control unit 600 and the plurality of display/optical sensor units 300. The circuit control unit 600 includes a bus control unit 605 which switches the timing that each of liquid crystal panel driving circuits 304 acquires a data signal (D) and the timing that each of signal converting circuits 306 outputs a digital signal (DS) in a pause mode at a predetermined timing, to share the bus 400. When a sensor-equipped liquid crystal panel 301 arranged in a specific display/optical sensor unit 300 detects an image, the bus control unit 605 causes the liquid crystal panel driving circuit 304 arranged in the display/optical sensor unit 300 to switch the timing earlier than the predetermined timing. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image detection / display device capable of switching an operation ratio in a display unit in accordance with image detection in an image detection unit.

  There are display devices that display a character, a symbol, a graphic, or the like on the display element by arranging a large number of signal lines in the row direction and the column direction with respect to the matrix display element and driving the signal lines. . As the matrix type display element, an FPD (Flat Panel Display) such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an EL (Electroluminescence) display, or an FED (Field Emission Display) is used. Since FPD can be made thinner and lighter than a conventional CRT (Cathode Ray Tube), it has recently been used in various display devices.

  Generally, a display device includes a display module and a display controller. The display module includes the matrix display element and a drive circuit that drives the display element. On the other hand, the display controller transmits display data and various control signals for driving the display element to the display module.

  The conventional display device is a continuous drive system that performs a display operation for each frame. For this reason, it is necessary for the display controller to read display data from the memory and transfer it to the display module for each frame, and to transmit various control signals to the display module, which is a cause of high power consumption of the display device. It was.

Therefore, so-called intermittent drive type display devices capable of pausing the display operation have been developed, and are described in Patent Documents 1 to 4, for example.
JP 2001-060079 (published March 6, 2001) Japanese Patent Laid-Open No. 11-338425 (published on Dec. 10, 1999) JP 2001-31253 A (published on November 9, 2001) JP 2002-123234 A (published April 26, 2002) Japanese Patent Laid-Open No. 03-172911 (published July 26, 1991) Japanese Patent Application Laid-Open No. 08-223011 (released on August 30, 1996) JP 09-292598 A (published on November 11, 1997)

  Incidentally, in recent years, some display systems include other devices in addition to the display module and the display controller as the display device. As an example of the other device, an optical sensor provided integrally with the display module and capable of detecting a nearby image, and an optical sensor controller for controlling the optical sensor can be cited. In the display system, signals are often transmitted and received between the other devices. Hereinafter, a display system including the above-described optical sensor is referred to as an image detection / display device.

  Here, conventionally, the matrix type display device described in Patent Document 1 includes an input touch sensor and a touch sensor controller as the other devices, but the input type touch sensor and the touch sensor controller are not provided. The signal line for performing communication is provided independently of the signal line for the display controller to control the display module.

  For this reason, in the matrix type display device described in Patent Document 1, the number of signal lines increases when an image detection / display device including other devices in addition to the display module and the display controller is realized. A problem occurs.

  Usually, there are many tens of signal lines connected to the input touch sensor and the display module. Further, the matrix display device includes a touch sensor controller in addition to the display controller in order to control the input touch sensor. That is, the matrix type display device requires as many controllers as the number of input touch sensors and display modules.

  For this reason, the matrix type display device is increased in cost by the provision of the touch sensor controller, and the number of signal lines is increased by several tens. Therefore, it is necessary to consider the arrangement of the touch sensor controller (that is, in the component arrangement). Problem occurs.

  In particular, when the image detection / display apparatus includes a plurality of display modules and optical sensors, the display controller and the optical sensor controller are provided accordingly. For this reason, in the image detection / display device including a plurality of display modules and optical sensors, the problem of cost and the problem of component placement become significant.

  Patent Document 5 discloses an input / output device in which the same signal line is used for the input path from the liquid crystal display device to the key matrix and the input path from the output circuit to the key matrix. However, in the input / output device described in Patent Document 5, the signal from the liquid crystal display device and the signal from the output circuit are superimposed and input to the key matrix. System communication (that is, transmission of various signals from the display controller and transmission of signals between other devices) cannot be performed.

  Further, the input / output device includes a signal line control unit capable of performing communication of two systems (a plurality of systems) by one signal line (sharing the signal line). However, when a plurality of liquid crystal devices (display modules) and a key matrix (photosensor) are provided, the number of refresh operations performed in the display module is reduced, and the update frequency of images displayed on the display module is reduced. The problem of end up occurs.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an image detection / display device capable of sharing a signal line and switching an operation ratio according to image detection. There is.

  In order to solve the above problems, an image detection / display apparatus according to the present invention includes a display unit having an operation mode for performing a display operation and a pause mode for pausing the display operation, and an image for detecting a nearby image. An image detection / display device including a plurality of planar members provided with a detection unit, the operation control unit controlling a display operation in each display unit and an image detection operation in each image detection unit, An operation control unit and a signal line connected to the plurality of planar members, and the operation control unit acquires display image data for each display unit to perform a new display operation during the operation mode. A timing control unit that sequentially switches the acquisition timing and output timing for outputting image detection data indicating an image detected by each image detection unit during the pause mode at a predetermined timing, and shares the signal line, Timing system When the image detection unit disposed on the specific planar member among the plurality of planar members detects an image, the unit detects the acquisition timing of the display unit disposed on the specific planar member. The switching operation is faster than the switching operation at the predetermined timing.

  According to the above configuration, in the image detection / display device, the operation control unit controls the acquisition timing of the display image data in the display unit and the output timing of the image detection data in the image detection unit. A signal line can be shared.

  Therefore, the image detection / display apparatus can perform communication of a plurality of systems by sharing the signal line. Therefore, in the image detection / display device, the area for wiring a plurality of signal lines can be reduced.

  In addition, when the image detection unit detects an image, the operation control unit switches the acquisition timing switching operation in the display unit of the planar member in which the image detection unit is arranged, rather than the switching operation at a predetermined timing. Make it faster.

  For this reason, since the frequency of the refresh operation in the display unit of the planar member provided with the image detection unit that detects the image can be increased, even in the display unit having the operation mode and the pause mode, the image detection is performed. There is an effect that the operability of the part is not impaired.

  Furthermore, in the image detection / display apparatus according to the present invention, the timing control unit may be configured so that when the image detection unit disposed on the specific planar member detects an image, the timing control unit is other than the specific planar member. The acquisition timing switching operation in the display unit disposed on the planar member may be slower than the switching operation at the predetermined timing.

  According to the above configuration, when the image detection unit detects an image, the operation control unit delays the switching operation of the display image data acquisition timing in the display unit of the planar member not provided with the image detection unit. To do. For this reason, the frequency of the refresh operation in the display part of another planar member can be reduced. Thereby, in an image detection / display apparatus, the power consumption of the display part in another planar member can be reduced.

  Further, in the image detection / display apparatus according to the present invention, the timing control unit sends a switching signal for sequentially switching the acquisition timing and the output timing to each display unit and each image detection in the plurality of planar members. You may output to a part sequentially.

  According to the above configuration, in the image detection / display device, since the timing control unit sequentially outputs the switching signal to the plurality of planar members, the acquisition timing in each display unit and the output timing in each image detection unit are appropriately switched. be able to.

  Further, in the image detection / display apparatus according to the present invention, the operation control unit outputs display image data acquired by the display units and acquires image detection data output by the image detection units. Yes, and is input / output to / from the signal line in response to a control signal output from the timing control unit to control the output timing of the display image data and the acquisition timing of the image detection data in the operation control unit. A signal line switching unit that switches between the display image data and the image detection data may be further provided.

  According to the above configuration, the operation control unit outputs display image data to each display unit via the signal line, and acquires image detection data from each image detection unit. The signal line switching unit switches input / output of the display image data and the image detection data with respect to the signal line according to a control signal output from the timing control unit.

  Therefore, in the image detection / display device, the acquisition of display image data and the output of image detection data in the operation control unit can be appropriately controlled.

  Furthermore, in the image detection / display apparatus according to the present invention, the timing control unit may output the control signal in response to the switching signal.

  According to the above configuration, in the image detection / display device, the control signal is output in response to the switching signal output to the display unit and the image detection unit, so that the signal lines are provided to the plurality of planar members and the operation control unit. Can be shared.

  As described above, the image detection / display apparatus according to the present invention includes the operation control unit that controls the display operation in each display unit and the image detection operation in each image detection unit, the operation control unit, and a plurality of planar shapes. A signal line connected to the member, and the operation control unit obtains display image data for each display unit to perform a new display operation during the operation mode, A timing control unit for sequentially switching the output timing for outputting image detection data indicating an image detected by the detection unit during a pause mode at a predetermined timing and sharing the signal line; Among the plurality of planar members, when the image detection unit disposed on the specific planar member detects an image, the acquisition timing switching in the display unit disposed on the specific planar member is performed as described above. The predetermined tag It is characterized by faster than the switching in the timing.

  Therefore, the image detection / display device can perform communication of a plurality of systems by sharing the signal line, and thus an effect of reducing the area for wiring the plurality of signal lines can be achieved.

  Further, in the image detection / display device, the frequency of the refresh operation in the display unit of the planar member provided with the image detection unit that detects the image can be increased, so that the display unit having the operation mode and the pause mode can be used. Even if it exists, there exists an effect that the operativity of an image detection part is not impaired.

  An embodiment of the present invention will be described below with reference to FIGS.

  First, an outline of the sensor built-in liquid crystal panel (display unit, image detection unit) 301 included in the data display / sensor device (image detection / display device) 100 will be described below.

(Outline of LCD panel with built-in sensor)
The sensor built-in liquid crystal panel 301 provided in the data display / sensor device 100 is a liquid crystal panel capable of detecting an image of an object in addition to displaying data. Here, the image detection of the object is, for example, detection of a position pointed (touched) by the user with a finger or a pen, or reading (scanning) of an image of a printed material. The device used for display is not limited to a liquid crystal panel, and may be an organic EL (Electro Luminescence) panel or the like.

  The structure of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 2 is a diagram schematically showing a cross section of the sensor built-in liquid crystal panel 301. The sensor built-in liquid crystal panel 301 described here is an example, and any structure can be used as long as the display surface and the reading surface are shared.

  As shown in the figure, the sensor built-in liquid crystal panel 301 includes an active matrix substrate 51A disposed on the back surface side and a counter substrate 51B disposed on the front surface side, and has a structure in which a liquid crystal layer 52 is sandwiched between these substrates. is doing. The active matrix substrate 51A is provided with a pixel electrode 56, a data signal line 57, an optical sensor circuit 32 (not shown), an alignment film 58, a polarizing plate 59, and the like. The counter substrate 51B is provided with color filters 53r (red), 53g (green), 53b (blue), a light shielding film 54, a counter electrode 55, an alignment film 58, a polarizing plate 59, and the like. In addition, a backlight 307 is provided on the back surface of the sensor built-in liquid crystal panel 301.

  The photodiode 6 included in the photosensor circuit 32 is provided in the vicinity of the pixel electrode 56 provided with the blue color filter 53b, but is not limited to this configuration. It may be provided in the vicinity of the pixel electrode 56 provided with the red color filter 53r, or may be provided in the vicinity of the pixel electrode 56 provided with the green color filter 53g.

  Next, with reference to FIGS. 3A and 3B, two types of methods for detecting the position where the user touches the sensor built-in liquid crystal panel 301 with a finger or a pen will be described.

  FIG. 3A is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a reflected image. When the light 63 is emitted from the backlight 307, the optical sensor circuit 32 including the photodiode 6 detects the light 63 reflected by the object 64 such as a finger. Thereby, the reflected image of the target object 64 can be detected. Thus, the sensor built-in liquid crystal panel 301 can detect the touched position by detecting the reflected image.

  FIG. 3B is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a shadow image. As shown in FIG. 3B, the optical sensor circuit 32 including the photodiode 6 detects external light 61 transmitted through the counter substrate 51B and the like. However, when there is an object 62 such as a pen, the incident of the external light 61 is hindered, so that the amount of light detected by the optical sensor circuit 32 is reduced. Thereby, a shadow image of the object 62 can be detected. Thus, the sensor built-in liquid crystal panel 301 can also detect a touched position by detecting a shadow image.

  As described above, the photodiode 6 may detect reflected light (shadow image) of the light emitted from the backlight 307 or may detect a shadow image caused by external light. Further, the two types of detection methods may be used in combination to detect both a shadow image and a reflected image at the same time.

(Data display / sensor configuration)
Next, with reference to FIG. 4, the configuration of the main part of the data display / sensor device 100 will be described. FIG. 4 is a block diagram showing a main configuration of the data display / sensor device 100. As shown in FIG. As shown, the data display / sensor device 100 includes one or more display / light sensor units (planar members) 300, a circuit control unit (operation control unit) 600, a data processing unit 700, a main control unit 800, a storage. A unit 901, a primary storage unit 902, an operation unit 903, an external communication unit 907, an audio output unit 908, and an audio input unit 909. Here, the data display / sensor device 100 will be described as including two display / light sensor units 300 (first display / light sensor unit 300A and second display / light sensor unit 300B). When the first display / light sensor unit 300A and the second display / light sensor unit 300B are not distinguished, they are referred to as the display / light sensor unit 300.

  The display / light sensor unit 300 is a so-called liquid crystal display device with a built-in light sensor. The display / light sensor unit 300 includes a sensor built-in liquid crystal panel 301, a backlight 307, and a peripheral circuit 309 for driving them.

  The sensor built-in liquid crystal panel 301 includes a plurality of pixel circuits 31 and photosensor circuits 32 arranged in a matrix. The detailed configuration of the sensor built-in liquid crystal panel 301 will be described later.

  The peripheral circuit 309 includes a liquid crystal panel drive circuit (display unit) 304, an optical sensor drive circuit (image detection unit) 305, a signal conversion circuit (image detection unit) 306, and a backlight drive circuit 308.

  The liquid crystal panel drive circuit 304 outputs a control signal (G) and a data signal (S) in accordance with a timing control signal (TC1) and a data signal (D) (display image data) from the display control unit 601 of the circuit control unit 600. In this case, the pixel circuit 31 is driven. Details of the driving method of the pixel circuit 31 will be described later.

  The optical sensor driving circuit 305 is a circuit that drives the optical sensor circuit 32 by applying a voltage to the signal line (R) in accordance with a timing control signal (TC2) from the sensor control unit 602 of the circuit control unit 600. Details of the driving method of the optical sensor circuit 32 will be described later.

  The signal conversion circuit 306 is a circuit that converts the sensor output signal (SS) output from the optical sensor circuit 32 into a digital signal (DS) (image detection data) and transmits the converted signal to the sensor control unit 602. is there.

  The backlight 307 includes a plurality of white LEDs (Light Emitting Diodes) and is disposed on the back surface of the sensor built-in liquid crystal panel 301. When a power supply voltage is applied from the backlight drive circuit 308, the backlight 307 is turned on and irradiates the sensor built-in liquid crystal panel 301 with light. Note that the backlight 307 is not limited to white LEDs, and may include LEDs of other colors. The backlight 307 may include, for example, a cold cathode fluorescent lamp (CCFL) instead of the LED.

  The backlight driving circuit 308 applies a power supply voltage to the backlight 307 when the control signal (BK) from the backlight control unit 603 of the circuit control unit 600 is at a high level, and conversely, the backlight control unit 603. When the control signal from is at a low level, no power supply voltage is applied to the backlight 307.

  The display / light sensor unit 300 and the circuit control unit 600 are connected to a bus (signal line) 400 for inputting / outputting data signals (D) and digital signals (DS). The bus 400 includes a data signal (D) output to the first display / light sensor unit 300A, a data signal (D) output to the second display / light sensor unit 300B, and a first display / light sensor unit. The digital signal (DS) output by 300A and the digital signal (DS) output by the second display / light sensor unit 300B are supplied in a predetermined order. That is, the bus 400 is connected between the first display / light sensor unit 300A or the second display / light sensor unit 300B and the circuit control unit 600 in order to input / output data signals (D) or digital signals (DS). It is shared.

  For this reason, the first display / light sensor unit 300A, the second display / light sensor unit 300B, and the circuit control unit 600 share the bus 400 so that signals can be input and output. Each unit receives an LCD select signal (switching signal) or a sensor select signal (switching signal) for controlling the pixel circuit 31, the optical sensor circuit 32, and the backlight 307 from the circuit control unit 600.

  The data display / sensor device 100 according to the present invention includes a display unit (the liquid crystal panel drive circuit 304 and the sensor built-in liquid crystal panel 301) having an operation mode in which a display operation is performed (that is, intermittent drive), and a nearby image. The display / light sensor unit 300 includes a plurality of display / light sensor units 300 in which image detection units (a photo sensor driving circuit 305, a signal conversion circuit 306, and a sensor built-in liquid crystal panel 301) are arranged.

  Here, the operation mode refers to a period during which the liquid crystal panel drive circuit 304 acquires the data signal (D) supplied via the bus 400 and switches (refreshes) to a new image on the sensor built-in liquid crystal panel 301. . On the other hand, the sleep mode refers to a period in which the data signal (D) is not acquired (ignored) and the image on the sensor built-in liquid crystal panel 301 is not refreshed.

  Next, the circuit control unit 600 will be described. The circuit control unit 600 has a function as a device driver that controls the peripheral circuit 309 of the display / light sensor unit 300. The circuit control unit 600 includes a display control unit 601, a sensor control unit 602, a backlight control unit 603, and a display data storage unit 604.

  The display control unit 601 receives display data from the display data processing unit 701 of the data processing unit 700, and performs timing control on the liquid crystal panel driving circuit 304 of the display / light sensor unit 300 in accordance with an instruction from the display data processing unit 701. A signal (TC1) and a data signal (D) are transmitted, and the received display data is displayed on the sensor built-in liquid crystal panel 301.

  The display control unit 601 temporarily stores the display data received from the display data processing unit 701 in the display data storage unit 604. Then, a data signal (D) is generated based on the primary stored display data. The display data storage unit 604 is, for example, a video random access memory (VRAM).

  The sensor control unit 602 transmits a timing control signal (TC2) to the optical sensor driving circuit 305 of the display / optical sensor unit 300 in accordance with an instruction from the sensor data processing unit 703 of the data processing unit 700, and the sensor built-in liquid crystal panel 301. Run the scan with.

  In addition, the sensor control unit 602 receives a digital signal (DS) from the signal conversion circuit 306. Then, image data is generated based on the digital signal (DS) corresponding to the sensor output signal (SS) output from all the optical sensor circuits 32 included in the sensor built-in liquid crystal panel 301. That is, the image data read in the entire reading area of the sensor built-in liquid crystal panel 301 is generated. Then, the generated image data is transmitted to the sensor data processing unit 703.

  The backlight control unit 603 transmits a control signal (BK) to the backlight drive circuit 308 of the display / light sensor unit 300 in accordance with instructions from the display data processing unit 701 and the sensor data processing unit 703 to drive the backlight 307. Let

  When the data display / sensor device 100 includes a plurality of display / light sensor units 300, the display control unit 601 determines which display / light sensor unit 300 displays the display data from the data processing unit 700. When an instruction is received, the liquid crystal panel drive circuit 304 of the display / light sensor unit 300 is controlled according to the instruction. When the sensor control unit 602 receives an instruction from the data processing unit 700 as to which display / light sensor unit 300 is to scan the object, the sensor control unit 602 responds to the light of the display / light sensor unit 300 according to the instruction. The sensor drive circuit 305 is controlled and a digital signal (DS) is received from the signal conversion circuit 306 of the display / light sensor unit 300 according to the instruction.

  Furthermore, the circuit control unit 600 enables the first display / light sensor unit 300A, the second display / light sensor unit 300B, and the circuit control unit 600 to share the bus 400 and input / output signals. Further, a bus control unit (timing control unit) 605 and a bus switching unit (signal line switching unit) 606 are provided.

  The circuit control unit 600 outputs a data signal (D) acquired by each liquid crystal panel drive circuit 304 and also acquires a digital signal (DS) output by each signal conversion circuit 306.

  The bus control unit 605 outputs various control signals to the display control unit 601, the sensor control unit 602, and the bus switching unit 606 based on the timing instruction signal output from the main control unit 800, and the first display / light sensor. Various select signals are output to the unit 300A or the second display / light sensor unit 300B.

  That is, the bus control unit 605 obtains a data signal (D) for each liquid crystal panel drive circuit 304 to acquire a data signal (D) for performing a new display operation during the operation mode of each sensor built-in liquid crystal panel 301, and each sensor. A digital signal (DS) indicating an image detected by the built-in liquid crystal panel 301 is sequentially switched at a predetermined timing with an output timing output from each signal conversion circuit 306 during a pause mode, and the signal lines are shared. is there.

  In addition, the bus control unit 605 sends various select signals for sequentially switching the acquisition timing and the output timing to each of the liquid crystal panel drive circuits 304, each of the photo sensor drive circuits 305, and each of the plurality of display / light sensor units 300. The signals are sequentially output to the signal conversion circuit 306.

  The bus switching unit 606 switches signals input / output via the bus 400 based on a control signal from the bus control unit 605. That is, the bus switching unit 606 selects a data signal (D) or a digital signal (DS) at a predetermined timing based on the control signal.

  That is, the bus switching unit 606 responds to the control signal that is output from the bus control unit 605 and controls the output timing of the data signal (D) and the acquisition timing of the digital signal (DS) in the circuit control unit 600. A data signal (D) and a digital signal (DS) input / output to / from the line are switched.

  Control signals and select signals output from the bus control unit 605 and the bus switching unit 606 will be described later.

  Next, the data processing unit 700 will be described. The data processing unit 700 has a function as middleware that gives an instruction to the circuit control unit 600 based on a “command” received from the main control unit 800. Details of the command will be described later.

  The data processing unit 700 includes a display data processing unit 701 and a sensor data processing unit 703. When the data processing unit 700 receives a command from the main control unit 800, at least one of the display data processing unit 701 and the sensor data processing unit 703 depends on the value of each field (described later) included in the received command. One works.

  The display data processing unit 701 receives display data from the main control unit 800, and gives instructions to the display control unit 601 and the backlight control unit 603 according to the command received by the data processing unit 700, and displays the received display data. The image is displayed on the sensor built-in liquid crystal panel 301. The operation of the display data processing unit 701 according to the command will be described later.

  The sensor data processing unit 703 gives an instruction to the sensor control unit 602 and the backlight control unit 603 according to the command received by the data processing unit 700.

  The sensor data processing unit 703 receives image data from the sensor control unit 602 and stores the image data in the image data buffer 704 as it is. Then, in accordance with the command received by the data processing unit 700, the sensor data processing unit 703 performs “whole image data”, “partial image data (partial image coordinate data) based on the image data stored in the image data buffer 704. At least one of “including coordinate data” and “coordinate data” is transmitted to the main control unit 800. The whole image data, partial image data, and coordinate data will be described later. The operation of the sensor data processing unit 703 according to the command will be described later.

  Next, the main control unit 800 executes an application program. The main control unit 800 reads the program stored in the storage unit 901 into a primary storage unit 902 configured by, for example, a RAM (Random Access Memory) and executes the program.

  An application program executed by the main control unit 800 causes the data processing unit 700 to display display data on the sensor built-in liquid crystal panel 301 or to scan an object on the sensor built-in liquid crystal panel 301. Send commands and display data. When “data type” is designated as a command, at least one of whole image data, partial image data, and coordinate data is received from the data processing unit 700 as a response to the command.

  The circuit control unit 600, the data processing unit 700, and the main control unit 800 can be configured by a CPU (Central Processing Unit), a memory, and the like, respectively. The data processing unit 700 may be configured by a circuit such as an ASIC (application specific integrate circuit).

  Next, the storage unit 901 stores programs and data executed by the main control unit 800 as shown in the figure. The program executed by the main control unit 800 may be separated into an application-specific program and a general-purpose program that can be shared by each application.

  Next, the operation unit 903 receives an input operation of the user of the data display / sensor device 100. The operation unit 903 includes input devices such as a switch, a remote controller, a mouse, and a keyboard, for example. Then, the operation unit 903 generates a control signal corresponding to the user's input operation of the data display / sensor device 100, and transmits the generated control signal to the main control unit 800.

  As an example of the switch, a hinge switch 904 that is provided at the hinge portion of the housing and detects the open / closed state of the housing, a power switch 905 that switches power on and off, and a predetermined function are assigned in advance. A hardware switch such as a user switch 906 is assumed.

  In addition, the data display / sensor device 100 includes an external communication unit 907 for communicating with an external device by wireless / wired communication, an audio output unit 908 such as a speaker for outputting audio, and a microphone for inputting an audio signal. A voice input unit 909 such as the above may be provided as appropriate.

(Command details)
Next, details of commands transmitted from the main control unit 800 to the data processing unit 700 will be described with reference to FIGS. 5 and 6. FIG. 5 is a diagram schematically illustrating an example of a command frame structure. FIG. 6 is a diagram for explaining an example of values that can be specified for each field included in the command and an outline thereof.

  As shown in FIG. 5, the commands are “header”, “data acquisition timing”, “data type”, “scan method”, “scan image gradation”, “scan resolution”, “scan panel”, “display panel”. "And" Reserve "fields. In each field, for example, values shown in FIG. 6 can be designated.

  The “header” field is a field indicating the start of a frame. As long as it is possible to identify the “header” field, the value of the “header” field may be any value.

  Next, the “data acquisition timing” field is a field for designating a timing at which data should be transmitted to the main control unit 800. In the “data acquisition timing” field, for example, values “00” (sense), “01” (event), and “10” (all) can be specified.

  Here, “sense” designates that the latest data is transmitted immediately. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “sense”, the latest data specified in the “data type” field is immediately updated to the main control unit 800. Send to.

  The “event” designates transmission at a timing when a change occurs in the image data received from the sensor control unit 602. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “event”, the image that receives the data specified in the “data type” field from the sensor control unit 602. The data is transmitted to the main control unit 800 at a timing when a change larger than a predetermined threshold occurs.

  “All” designates data transmission at a predetermined cycle. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “all”, the data designated in the “data type” field is transferred to the main control unit 800 at a predetermined cycle. Send to.

  Next, the “data type” field is a field for designating the type of data acquired from the sensor data processing unit 703. In the “data type” field, for example, values of “001” (coordinates), “010” (partial image), and “100” (entire image) can be specified. Furthermore, by adding these values, “coordinates” and “partial image” / “whole image” can be specified simultaneously. For example, when “coordinate” and “partial image” are specified at the same time, “011” can be specified.

  When the sensor data processing unit 703 receives a command whose value of the “data type” field is “whole image”, the sensor data processing unit 703 transmits the image data itself stored in the image data buffer 704 to the main control unit 800. The image data itself stored in the image data buffer 704 is referred to as “whole image data”.

  In addition, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 selects a portion where a change larger than a predetermined threshold has occurred from the image data received from the sensor control unit 602. A region to be included is extracted, and image data of the extracted region is transmitted to the main control unit 800. Here, the image data is referred to as “partial image data”. When a plurality of partial image data are extracted, the sensor data processing unit 703 transmits each extracted partial image data to the main control unit 800.

  Further, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 detects representative coordinates in the partial image data and indicates the position of the representative coordinates in the partial image data. The coordinate data is transmitted to the main control unit 800. The representative coordinates include, for example, the coordinates of the center of the partial image data, the coordinates of the center of gravity of the partial image data, and the like.

  Next, when receiving a command whose value of the “data type” field is “coordinate”, the sensor data processing unit 703 transmits coordinate data indicating the position of the representative coordinate in the entire image data to the main control unit 800. When a plurality of partial image data are extracted, the sensor data processing unit 703 detects representative coordinates in the entire image data of the extracted partial image data, and the coordinate data indicating the representative coordinates is detected. Each is transmitted to the main control unit 800 (multi-point detection).

  Specific examples of the whole image data, the partial image data, and the coordinate data will be described later with reference to schematic diagrams.

  Next, the “scan method” field is a field for designating whether or not the backlight 307 is turned on at the time of executing the scan. In the “scan method” field, for example, values of “00” (reflection), “01” (transmission), and “10” (reflection / transmission) can be designated.

  “Reflection” designates that scanning is performed with the backlight 307 turned on. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “reflection”, the sensor data processing unit 703 performs sensor control so that the optical sensor driving circuit 305 and the backlight driving circuit 308 operate in synchronization. An instruction is given to the unit 602 and the backlight control unit 603.

  “Transmission” specifies that scanning is performed with the backlight 307 turned off. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “transparent”, the sensor control unit 602 operates the optical sensor driving circuit 305 and does not operate the backlight driving circuit 308. Instructions to the backlight control unit 603. Note that “reflection / transmission” specifies that scanning is performed using both “reflection” and “transmission”.

  Next, the “scanned image gradation” field is a field for designating gradations of the partial image data and the entire image data. In the “scanned image gradation” field, for example, values of “00” (binary) and “01” (multivalue) can be designated.

  When the sensor data processing unit 703 receives a command whose “scan image gradation” field value is “binary”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as monochrome data. .

  When the sensor data processing unit 703 receives a command whose “scanned image gradation” field value is “multivalued”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as multitone data. To do.

  Next, the “scan resolution” field is a field for designating the resolution of the partial image data and the entire image data. In the “scan resolution” field, for example, values of “0” (high) and “1” (low) can be specified.

  Here, “high” designates a high resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “high”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 with high resolution. For example, it is desirable to designate “high” for image data (image data such as a fingerprint) to be subjected to image processing such as image recognition.

  “Low” designates a low resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “low”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 at a low resolution. For example, it is desirable to designate “low” for image data (such as touched finger or hand image data) that only needs to be recognized.

  Next, the “scan panel” field is a field for designating which display / light sensor unit 300 is to scan the object. In the “scan panel” field, for example, values “001” (first display / light sensor unit 300A) and “010” (second display / light sensor unit 300B) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when “first display / light sensor unit 300A” and “second display / light sensor unit 300B” are specified at the same time, “011” can be specified.

  When the sensor data processing unit 703 receives a command whose “scan panel” field value is “first display / photosensor unit 300A”, the sensor data processing unit 703 and the photosensor drive circuit 305 of the first display / photosensor unit 300A and An instruction is given to the sensor control unit 602 and the backlight control unit 603 so as to control the backlight drive circuit 308.

  Next, the “display panel” field is a field for designating which display / light sensor unit 300 displays the display data. In the “display panel” field, for example, values of “001” (first display / light sensor unit 300A) and “010” (second display / light sensor unit 300B) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when “first display / light sensor unit 300A” and “second display / light sensor unit 300B” are specified at the same time, “011” can be specified.

  Here, for example, when the display data processing unit 701 receives a command whose value of the “display panel” field is “first display / light sensor unit 300A”, the display data processing unit 701 displays the display data on the first display / light sensor unit 300A. Therefore, an instruction is given to the display control unit 601 and the backlight control unit 603 to control the liquid crystal panel driving circuit 304 and the backlight driving circuit 308 of the first display / light sensor unit 300A.

  Next, the “reserved” field is a field that is appropriately specified when it is necessary to further specify information other than information that can be specified in the above-described fields.

  Note that an application executed by the main control unit 800 does not need to use all the above-described fields when transmitting a command, and an invalid value (such as a NULL value) may be set for a field that is not used. .

  When the user wants to acquire coordinate data of a position touched with a finger or pen, a command specifying “coordinate” in the “data type” field is transmitted to the data processing unit 700. Therefore, it is desirable to specify “all” in the “data acquisition timing” field of the command to acquire coordinate data. Further, since it is only necessary to acquire coordinate data of the touched position, the scanning accuracy may not be high. Therefore, “low” may be specified as the value of the “scan resolution” field of the above command.

  Further, when “coordinate” is specified in the “data type” field of the command, for example, when the user touches the sensor built-in liquid crystal panel 301 with a plurality of fingers or pens at the same time, the coordinate data of the touched position is used. Can be acquired (multi-point detection).

  When acquiring image data of an object such as a document, a command specifying “whole image” in the “data type” field is transmitted to the data processing unit 700. Since it is common to perform a scan in a stationary state, it is not necessary to periodically perform the scan. Therefore, in this case, it is desirable to designate “sense” or “event” in the “data acquisition timing” field. When scanning an object such as a document, it is desirable that the scanning accuracy is high so that the user can easily read the characters. Therefore, it is desirable to designate “high” in the “scan resolution” field.

(Whole image data / Partial image data / Coordinate data)
Next, the whole image data, the partial image data, and the coordinate data will be described with reference to FIG. The image data shown in FIG. 7A is image data obtained as a result of scanning the entire sensor built-in liquid crystal panel 301 when the object is not placed on the sensor built-in liquid crystal panel 301. The image data shown in FIG. 7B is image data obtained as a result of scanning the entire sensor-equipped liquid crystal panel 301 when the user touches the sensor-equipped liquid crystal panel 301 with a finger.

  When the user touches the sensor built-in liquid crystal panel 301 with a finger, the amount of light received by the photosensor circuit 32 in the vicinity of the touch changes, so that the voltage output from the photosensor circuit 32 changes, and as a result, In the image data generated by the sensor control unit 602, the brightness of the pixel value of the portion touched by the user changes.

  In the image data shown in FIG. 7B, the brightness of the pixel value of the portion corresponding to the user's finger is higher than that in the image data shown in FIG. In the image data shown in FIG. 7B, the smallest rectangular area (area PP) that includes all pixel values whose lightness changes more than a predetermined threshold is “partial image data”.

  The image data indicated by the area AP is “whole image data”.

  Also, the coordinate data in the whole image data (area AP) of the representative coordinates Z of the partial image data (area PP) is (Xa, Ya), and the coordinate data in the partial image data (area PP) is (Xp, Yp). It is.

(Configuration of sensor built-in liquid crystal panel)
Next, the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309 of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 8 is a block diagram showing the main part of the display / light sensor unit 300, particularly the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309.

  The sensor built-in liquid crystal panel 301 includes a pixel circuit 31 for setting light transmittance (brightness) and an optical sensor circuit 32 that outputs a voltage corresponding to the intensity of light received by the sensor. The pixel circuit 31 is used as a general term for the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b corresponding to the red, green, and blue color filters, respectively.

  The pixel circuits 31 are arranged on the sensor built-in liquid crystal panel 301 in the column direction (vertical direction) and 3n in the row direction (horizontal direction). A set of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b is continuously arranged in the row direction (lateral direction). This set forms one pixel.

  In order to set the light transmittance of the pixel circuit 31, first, the high level voltage (TFT 33 is turned on) to the scanning signal line Gi connected to the gate terminal of the TFT (Thin Film Transistor) 33 included in the pixel circuit 31. Voltage). Thereafter, a predetermined voltage is applied to the data signal line SRj connected to the source terminal of the TFT 33 of the R pixel circuit 31r. Similarly, the light transmittance is also set for the G pixel circuit 31g and the B pixel circuit 31b. Then, by setting these light transmittances, an image is displayed on the sensor built-in liquid crystal panel 301.

  Next, the photosensor circuit 32 is arranged for each pixel. One pixel may be arranged in the vicinity of each of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b.

  In order for the optical sensor circuit 32 to output a voltage according to the light intensity, first, the sensor readout line RWi connected to one electrode of the capacitor 35 and the anode terminal of the photodiode 6 are connected. A predetermined voltage is applied to the sensor reset line RSi. In this state, when light is incident on the photodiode 6, a current corresponding to the amount of incident light flows through the photodiode 6. And according to the said electric current, the voltage of the connection point (henceforth connection node V) of the other electrode of the capacitor | condenser 35 and the cathode terminal of the photodiode 6 falls. When the power supply voltage VDD is applied to the voltage application line SDj connected to the drain terminal of the sensor preamplifier 37, the voltage at the connection node V is amplified and output from the source terminal of the sensor preamplifier 37 to the sensing data output line SPj. Based on the output voltage, the amount of light received by the optical sensor circuit 32 can be calculated.

  Next, the liquid crystal panel drive circuit 304, the optical sensor drive circuit 305, and the sensor output amplifier 44, which are peripheral circuits of the sensor built-in liquid crystal panel 301, will be described.

  The liquid crystal panel drive circuit 304 is a circuit for driving the pixel circuit 31, and includes a scanning signal line drive circuit 3041 and a data signal line drive circuit 3042.

  Based on the timing control signal TC1 received from the display control unit 601 and the LCD select signal received from the bus control unit 605, the scanning signal line drive circuit 3041 is selected from the scanning signal lines G1 to Gm for each line time. One scanning signal line is sequentially selected, a high level voltage is applied to the selected scanning signal line, and a low level voltage is applied to the other scanning signal lines.

  The data signal line driver circuit 3042 performs one row for each line time based on the display data D (DR, DG, and DB) received from the display control unit 601 and the LCD select signal received from the bus control unit 605. A predetermined voltage corresponding to the minute display data is applied to the data signal lines SR1 to SRn, SG1 to SGn, and SB1 to SBn (line sequential method). Note that the data signal line driver circuit 3042 may be driven by a dot sequential method.

  The optical sensor driving circuit 305 is a circuit for driving the optical sensor circuit 32. Based on the timing control signal TC2 received from the sensor control unit 602 and the sensor select signal received from the bus control unit 605, the optical sensor driving circuit 305 selects one of the sensor read signal lines RW1 to RWm for each line time. A predetermined readout voltage is applied to the sensor readout signal lines selected one by one, and a voltage other than the predetermined readout voltage is applied to the other sensor readout signal lines. Similarly, based on the timing control signal TC2 and the sensor select signal, a predetermined reset voltage is applied to the sensor reset signal line selected from the sensor reset signal lines RS1 to RSm for each line time. In addition, a voltage other than a predetermined reset voltage is applied to the other sensor reset signal lines.

  The sensing data output signal lines SP1 to SPn are grouped into p groups (p is an integer of 1 to n), and the sensing data output signal lines belonging to each group are connected via a switch 47 that is sequentially turned on in time division. And connected to the sensor output amplifier 44. The sensor output amplifier 44 amplifies the voltage from the group of sensing data output signal lines connected by the switch 47 and outputs the amplified voltage to the signal conversion circuit 306 as sensor output signals SS (SS1 to SSp).

  In the above description, the optical sensor drive circuit 305 is driven based on the sensor select signal, but is not limited to this. That is, the optical sensor drive circuit 305 may output the sensor output signal SS from the signal conversion circuit 306 based on the timing control signal TC2 even when the sensor select signal is in a low level period.

  In this case, the signal conversion circuit 306 converts the sensor output signal SS into a digital signal (DS) and temporarily stores the digital signal (DS). The signal conversion circuit 306 outputs the temporarily stored digital signal (DS) to the bus 400 when acquiring the high level sensor select signal.

(Data display / sensor device housing)
Next, the housing of the data display / sensor device 100 according to the present invention will be described with reference to FIGS. 9 (a) and 9 (b). FIG. 9A and FIG. 9B are schematic views showing the housing of the data display / sensor device 100. FIG. As shown in the figure, the data display / sensor device 100 is a so-called clamshell type housing that can be folded at the hinge portion H so that the first display / light sensor portion 300A and the second display / light sensor portion 300B face each other. Have a body.

  FIG. 9A shows a sensor built-in liquid crystal panel 301 disposed in each of the first display / light sensor unit 300A and the second display / light sensor unit 300B (sensor built-in liquid crystal panels 301A and 300B shown in FIG. 9B). ) Are opposed to each other, and the casing of the data display / sensor device 100 is closed (that is, folded). At this time, since the image displayed on the sensor built-in liquid crystal panel 301 cannot be viewed, the data display / sensor device 100 may turn off the display function of the sensor built-in liquid crystal panel 301.

  FIG. 9B is a diagram illustrating a state where the housing of the data display / sensor device 100 is opened (that is, not folded). At this time, the data display / sensor device 100 displays images on the sensor built-in liquid crystal panels 301A and 301B based on an application program executed by the main control unit 800.

  FIG. 9B shows a state in which the sensor built-in liquid crystal panel 301A acquires an input by the user (input by the pen P) and displays the cursor C according to the tip position of the pen P. That is, when the user moves the pen P on the sensor built-in liquid crystal panel 301A, the image on the sensor built-in liquid crystal panel 301A is switched and displayed so that the cursor C moves following the pen P.

  FIG. 9B illustrates the case where the sensor built-in liquid crystal panel 301A acquires an input by the user. However, the present invention is not limited to this, and the same applies when there is an input to the sensor built-in liquid crystal panel 301B.

(Main components of display / light sensor unit and circuit control unit)
Next, the main configuration of the data display / sensor device 100 will be further described with reference to FIG. FIG. 1 is a block diagram showing a main configuration of the display / light sensor unit 300 and the circuit control unit 600 of the data display / sensor device 100. Here, the data display / sensor device 100 has a configuration including two display / light sensor units 300, that is, a configuration including a first display / light sensor unit 300A and a second display / light sensor unit 300B. .

  The first display / light sensor unit 300A includes a sensor built-in liquid crystal panel 301A, a backlight 307A, and a peripheral circuit 309A for driving them. The sensor built-in liquid crystal panel 301A includes a plurality of pixel circuits 31A and an optical sensor circuit 32A. The peripheral circuit 309A includes a liquid crystal panel drive circuit 304A, an optical sensor drive circuit 305A, a signal conversion circuit 306A, and a backlight drive circuit 308A.

  The second display / light sensor unit 300B includes a sensor built-in liquid crystal panel 301B, a backlight 307B, and a peripheral circuit 309B for driving them. The sensor built-in liquid crystal panel 301B includes a plurality of pixel circuits 31B and an optical sensor circuit 32B. The peripheral circuit 309B includes a liquid crystal panel drive circuit 304B, an optical sensor drive circuit 305B, a signal conversion circuit 306B, and a backlight drive circuit 308B.

  Note that the first display / light sensor unit 300A and the second display / light sensor unit 300B have the same configuration as the main part of the display / light sensor unit 300 collectively. For this reason, since each part of 300 A of 1st display / light sensor parts and 300 B of 2nd display / light sensor parts has the same function as each part of the display / light sensor part 300 mentioned above, the description is abbreviate | omitted here.

  As described above, in order to enable the first display / light sensor unit 300A, the second display / light sensor unit 300B, and the circuit control unit 600 to share the bus 400 and input / output signals, The bus control unit 605 of the control unit 600 outputs various control signals to each unit of the circuit control unit 600. Hereinafter, the bus control unit 605 and various control signals will be described, but before that, the main configuration of the bus switching unit 606 will be described.

  As described above, the bus switching unit 606 switches between the data signal (D) and the digital signal (DS) input / output via the bus 400. For this purpose, the bus switching unit 606 includes a switching transistor 6061 and an amplifier 6062.

  The switching transistor 6061 switches on / off based on a control signal output from the bus control unit 605. The source (emitter) and drain (collector) of the switching transistor 6061 are connected to the output terminal (not shown) of the display control unit 601 and the bus 400, respectively. The gate (base) of the switching transistor 6061 is connected to the output terminal (not shown) of the bus control unit 605.

  When a high level control signal is input to the gate (base) of the switching transistor 6061, the switching transistor 6061 is turned on, and the data signal (D) output from the display control unit 601 is sent to the bus 400 and the amplifier 6062. Supplied. On the other hand, when a low level control signal is input to the gate (base) of the switching transistor 6061, the switching transistor 6061 is turned off, and the data signal (D) output from the display control unit 601 at this time is sent to the bus 400. Is not supplied.

  Actually, the bus control unit 605 controls the display control unit 601 not to output the data signal (D) while the low-level control signal is input to the switching transistor 6061.

  The amplifier 6062 amplifies the digital signal (DS) or the data signal (D) flowing from the bus 400 or the sensor control unit 602. The source (emitter) and drain (collector) of the amplifier 6062 are respectively connected between the switching transistor 6061 and the bus 400 and to an input terminal (not shown) of the sensor control unit 602. The digital signal (DS) or data signal (D) amplified by the amplifier 6062 is supplied to the sensor control unit 602.

  In the above description, when the switching transistor 6061 is on, the data signal (D) flows into the sensor control unit 602 via the amplifier 6062, but actually the sensor control unit 602 acquires the data signal (D). There is no. This is because the bus control unit 605 supplies a control signal (specifically, an “input stop signal” of the control signal SC_CTRL) to the sensor control unit 602 while the switching transistor 6061 is on.

  Next, the bus control unit 605 and various control signals will be described.

  The bus control unit 605 controls the timing at which the display control unit 601 outputs the data signal (D) by outputting the control signal LCD_CTRL to the display control unit 601.

  Specifically, when the bus control unit 605 outputs “display command A” as the control signal LCD_CTRL, the display control unit 601 refers to the display data storage unit 604 and supplies it to the first display / light sensor unit 300A. “Display data A” which is a data signal (D) to be generated is generated and output to the bus switching unit 606. On the other hand, when the “display command B” is received as the control signal LCD_CTRL from the bus control unit 605, the display control unit 601 refers to the display data storage unit 604 and supplies it to the second display / light sensor unit 300B. “Display data B”, which is a power data signal (D), is generated and output to the bus switching unit 606. That is, the display control unit 601 generates either “display data A” or “display data B”, which is the data signal (D), based on the control signal LCD_CTRL, and outputs the generated data signal to the bus switching unit 606.

  Further, the bus control unit 605 controls the timing for acquiring the digital signal (DS) output from the bus switching unit 606 by outputting a control signal SC_CTRL to the sensor control unit 602.

  Specifically, when the bus control unit 605 outputs “input command A” as the control signal SC_CTRL, the sensor control unit 602 displays the “sensor” that is a digital signal (DS) output from the first display / light sensor unit 300A. Data A "is acquired. On the other hand, when the bus control unit 605 outputs “input command B” as the control signal SC_CTRL, the sensor control unit 602 displays “sensor data B” which is a digital signal (DS) output from the second display / light sensor unit 300B. To get. That is, the sensor control unit 602 can selectively acquire “sensor data A” and “sensor data B”, which are digital signals (DS), from the bus switching unit 606 based on the control signal SC_CTRL.

  In addition, the bus control unit 605 outputs a control signal BUS_CTRL to the bus switching unit 606, so that the bus switching unit 606 outputs a data signal (D) or digital signal to the bus 400 (the display control unit 601 and the sensor control unit 602). It controls the input / output timing of the signal (DS).

  Specifically, while the bus control unit 605 outputs the high-level control signal BUS_CTRL, the switching transistor 6061 is on, so that the data signal (D) is output to the bus 400. On the other hand, while the bus control unit 605 outputs the low level control signal BUS_CTRL, the switching transistor 6061 is turned off and the data signal (D) is not supplied to the bus 400.

  Further, the bus control unit 605 sends select signals (LCD select signals A and B and sensor select signals A and B) to the first display / light sensor unit 300A or the second display / light sensor unit 300B at a predetermined timing. Is output. That is, the bus control unit 605 sets one select signal among the select signals to a high level (other select signals are set to a low level) every one frame period (one period in the vertical synchronization signal), and performs the first display / This is supplied to the optical sensor unit 300A or the second display / optical sensor unit 300B.

  Specifically, the bus control unit 605 selects the LCD select signal A for the liquid crystal panel drive circuit 304A of the first display / light sensor unit 300A, and the sensor select for the light sensor drive circuit 305A and the signal conversion circuit 306A. Signal A is supplied. Also, the bus control unit 605 receives an LCD select signal B for the liquid crystal panel drive circuit 304B of the second display / light sensor unit 300B, and a sensor select signal B for the light sensor drive circuit 305B and the signal conversion circuit 306B. Supplied.

  For example, while the bus control unit 605 is supplying the high-level LCD select signal A to the liquid crystal panel drive circuit 304A, the liquid crystal panel drive circuit 304A receives the signal (data signal (D)) supplied to the bus 400 at this time. "Display data A") can be acquired. On the other hand, while the bus control unit 605 supplies the low-level LCD select signal A to the liquid crystal panel drive circuit 304A, the liquid crystal panel drive circuit 304A does not acquire the signal supplied to the bus 400 at this time (that is, ignore it). To do).

  As described above, in the data display / sensor device 100, the bus control unit 605 supplies various control signals and various select signals, thereby sharing the bus 400 and inputting / outputting data signals (D) and digital signals (DS). Can be realized.

(Timing chart of various control signals and various select signals)
Next, referring to FIG. 10, the timing at which various control signals and various select signals are output from the bus control unit 605, the data signal (D), and the digital signal (DS) are displayed / optical sensor unit 300 and circuit. The timing input / output by the control unit 600 will be described. FIG. 10 illustrates a control signal and a select signal output from the bus control unit 605, a display control unit 601, a sensor control unit 602, liquid crystal panel drive circuits 304A and 304B, and optical sensor drive circuits 305A and 305B. 4 is a timing chart showing the relationship among control signals, select signals, data signals (D), and digital signals (DS) input / output to / from the signal conversion circuits 306A and 306B.

  Here, the timing chart shown in FIG. 10 illustrates the case of the intermittent drive method in which the operation ratio between the operation mode and the pause mode of the liquid crystal panel drive circuit 304 is 1: 3. That is, after an operation mode for one frame period (the bus control unit 605 outputs a high level LCD select signal A or B), a pause mode for three frame periods (the bus control unit 605 has a low level LCD select signal A or B). The case of the intermittent drive system in which B is output) is illustrated.

  Note that when “operation ratio” is simply described, it represents “operation mode: sleep mode”. Here, the operation ratio between the operation mode and the sleep mode is one frame period or a multiple thereof, but it may be a period unrelated to one frame period.

  Further, the liquid crystal panel drive circuit 304 in the period of the pause mode (LCD select signal A and / or B is at low level) does not perform a refresh operation for switching to a new image, so that the liquid crystal panel drive circuit 304 is operated. There is no need to keep it. Therefore, in the data display / sensor device 100, the power consumption in these circuits can be reduced by stopping the operation of the liquid crystal panel drive circuit 304 during the pause mode period.

  First, input / output timings of various control signals, various select signals, data signals (D), and digital signals (DS) in the circuit control unit 600 will be described.

  As shown in FIG. 10, the bus control unit 605 outputs a high level LCD select signal A, LCD select signal B, sensor select signal A, and sensor select signal B in this order for each frame period. Note that the output order of the select signals is not limited to this, and may be any order.

  Further, the bus control unit 605 outputs a high-level control signal BUS_CTRL to the bus switching unit 606 during a period in which the LCD select signal A or the LCD select signal B is output at a high level. On the other hand, the bus control unit 605 outputs a low-level control signal BUS_CTRL to the bus switching unit 606 during a period when the sensor select signal A or the sensor select signal B is output at a high level.

  Further, the bus control unit 605 outputs a “display command A” to the display control unit 601 as the control signal LCD_CTRL during a period in which the LCD select signal A is output at a high level. Further, during the period in which the LCD select signal B is output at a high level, the “display command B” is output to the display control unit 601 as the control signal LCD_CTRL.

  On the other hand, the bus control unit 605 outputs an “output stop command” to the display control unit 601 as the control signal LCD_CTRL during a period in which the LCD select signals A and B are both output at a low level. The display control unit 601 does not output the data signal (D) to the bus switching unit 606 while receiving this “output stop command”.

  Further, the bus control unit 605 outputs an “input command A” to the sensor control unit 602 as the control signal SC_CTRL during a period in which the sensor select signal A is output at a high level. Further, during the period when the sensor select signal B is output at a high level, the “input command B” is output to the sensor control unit 602 as the control signal SC_CTRL.

  On the other hand, the bus control unit 605 outputs an “input stop command” to the sensor control unit 602 as the control signal SC_CTRL during a period in which both the sensor select signals A and B are output at a low level. The sensor control unit 602 acquires the digital signal (DS) as a signal (data signal (D)) output from the bus switching unit 606 as “invalid data” while the “input stop command” is received. That is, the sensor control unit 602 invalidates the signal received during this period.

  Next, in accordance with an instruction from the display data processing unit 701 of the data processing unit 700, the display control unit 601 generates a clock signal and a synchronization signal for controlling display timing in the liquid crystal panel driving circuit 304 as a timing control signal (TC1). As output.

  In addition, the display control unit 601 generates “display data A” as the data signal (D) during the period when the “display command A” is output as the control signal LCD_CTRL from the bus control unit 605, and the bus switching unit 606 Output. On the other hand, the display control unit 601 generates “display data B” as the data signal (D) during the period when the “display command B” is output as the control signal LCD_CTRL from the bus control unit 605, and the bus switching unit 606. Output to.

  Next, in accordance with an instruction from the sensor data processing unit 703 of the data processing unit 700, the sensor control unit 602 outputs a clock signal and a sensor control signal for controlling the image detection timing in the optical sensor driving circuit 305 as a timing control signal. (TC2) is output.

  In addition, the sensor control unit 602 acquires “sensor data A” from the bus switching unit 606 as a digital signal (DS) during a period in which “input command A” is output as the control signal SC_CTRL from the bus control unit 605. On the other hand, the sensor control unit 602 acquires “sensor data B” from the bus switching unit 606 as a digital signal (DS) during a period in which “input command B” is output as the control signal SC_CTRL.

  Next, input / output timings of various control signals, various select signals, data signal (D), and digital signal (DS) will be described.

  The liquid crystal panel drive circuit 304A of the first display / light sensor unit 300A displays an image based on the data signal (D) on the sensor built-in liquid crystal panel 301A in accordance with the timing control signal (TC1) output from the display control unit 601.

  Further, the liquid crystal panel drive circuit 304 </ b> A acquires “display data A” as the data signal (D) while the high-level LCD select signal A is output from the bus control unit 605. On the other hand, the liquid crystal panel drive circuit 304A is configured to display “display data B” as the data signal (D) and digital signal (DS) while the low level LCD select signal B is output from the bus control unit 605. Even if “sensor data A” and “sensor data B” are output to the bus 400, these signals are ignored. That is, the liquid crystal panel drive circuit 304A acquires “display data A” that is display image data to be output to the first display / light sensor unit 300A only during a period when the LCD select signal A is at a high level.

  Next, the liquid crystal panel drive circuit 304B of the second display / light sensor unit 300B displays an image based on the data signal (D) on the sensor built-in liquid crystal panel 301B in accordance with the timing control signal (TC1) output from the display control unit 601. Display.

  Further, the liquid crystal panel drive circuit 304B acquires “display data B” as the data signal (D) during the period when the high-level LCD select signal B is output from the bus control unit 605. On the other hand, the liquid crystal panel driving circuit 304B is configured to display “display data A” as the data signal (D) and digital signal (DS) while the low level LCD select signal B is output from the bus control unit 605. Even if “sensor data A” and “sensor data B” are output to the bus 400, these signals are ignored. In other words, the liquid crystal panel drive circuit 304B acquires “display data B” that is display image data to be output to the second display / light sensor unit 300B only during a period when the LCD select signal B is at a high level.

  Next, the optical sensor driving circuit 305A and the signal conversion circuit 306A of the first display / optical sensor unit 300A, in accordance with the timing control signal (TC2) output from the sensor control unit 602, the sensor output signal (SS) and the digital signal ( DS).

  Further, the optical sensor driving circuit 305A and the signal conversion circuit 306A output “sensor data A” to the bus 400 as a digital signal (DS) during a period when the high level sensor select signal A is output from the bus control unit 605. To do.

  On the other hand, the optical sensor drive circuit 305A and the signal conversion circuit 306A are connected to an output terminal (not shown) of the liquid crystal panel drive circuit 304A during a period when the low level sensor select signal A is output from the bus control unit 605. Set to high impedance output (state). As a result, the optical sensor driving circuit 305A and the signal conversion circuit 306A allow “display data A” and “display data B” as the data signal (D) output to the bus 400 during the period when the sensor select signal A is at a low level. Or “sensor data B” as a digital signal (DS) is not acquired.

  That is, the optical sensor drive circuit 305A and the signal conversion circuit 306A output “sensor data A” as a digital signal (DS) only when the sensor select signal A is at a high level, and acquire signals that are not required during a low level period. It has a configuration that does not.

  Next, the optical sensor driving circuit 305B and the signal conversion circuit 306B of the second display / optical sensor unit 300B, according to the timing control signal (TC2) output from the sensor control unit 602, output the sensor output signal (SS) and the digital signal ( DS).

  Further, the optical sensor driving circuit 305B and the signal conversion circuit 306B output “sensor data B” to the bus 400 as a digital signal (DS) during a period in which the high level sensor select signal B is output from the bus control unit 605. To do.

  On the other hand, the optical sensor drive circuit 305B and the signal conversion circuit 306B are connected to an output terminal (not shown) of the liquid crystal panel drive circuit 304B during a period when the low level sensor select signal B is output from the bus control unit 605. Set to high impedance output (state). As a result, the optical sensor drive circuit 305B and the signal conversion circuit 306B allow “display data A” and “display data B” as the data signal (D) output to the bus 400 during the period when the sensor select signal B is at a low level. Or “sensor data A” as a digital signal (DS) is not acquired.

  That is, the optical sensor drive circuit 305B and the signal conversion circuit 306B output “sensor data B” as a digital signal (DS) only when the sensor select signal B is at a high level, and acquire signals that are not necessary during a low level period. It has a configuration that does not.

  As described above, in the data display / sensor device 100, the bus control unit 605 sequentially outputs the LCD select signal A, the LCD select signal B, the sensor select signal A, and the select select signal B for each frame period. The operation of outputting the control signals BUS_CTRL, LCD_CTRL, and SC_CTRL is repeated. In addition, the display / light sensor unit 300, the display control unit 601, the sensor control unit 602, and the bus switching unit 606 have a data signal (D) or a digital signal (D) during a period in which the select signal and the control signal are output (supplied). Obtain or ignore (invalidate) DS).

  Thus, in the data display / sensor device 100, the input / output of the data signal (D) or the digital signal (DS) in the sensor built-in liquid crystal panels 301A and 301B can be changed every frame period. Does not require a corresponding bus. Therefore, in the data display / sensor device 100, the bus 400 can be shared for the input and output of the signal.

  In other words, in the data display / sensor device 100, the liquid crystal panel drive circuits 304A and 304B can appropriately refresh the images displayed on the sensor built-in liquid crystal panels 301A and B using only the bus 400, respectively. In the data display / sensor device 100, the liquid crystal panel drive circuits 304A and 304B use the pause mode period, thereby using only the bus 400 to indicate a signal (an image indicating the image detected by the sensor built-in liquid crystal panels 301A and B). A digital signal (DS) can be output to the circuit control unit 600 (main control unit 800 side).

  Therefore, the data display / sensor device 100 can perform at least four systems of communication using one signal line. Therefore, in the data display / sensor device 100, the area for wiring a plurality of signal lines can be reduced.

(About bus sharing)
Next, various examples of signal input / output timing for the bus 400 will be described with reference to FIG. FIG. 11 is a timing chart showing various input / output timings of signals with respect to the bus 400.

  Here, it is assumed that the input / output timings and periods of signals to / from bus 400 are the same as the output timings and periods of various select signals shown in FIG. Note that FIGS. 11B to 11D described later are different from the timing chart shown in FIG. However, the operation ratios shown in FIGS. 11B to 11D are realized by adjusting the input / output timings of various select signals shown in FIG. 10 and changing the timings of other signals in accordance with this adjustment. Is done.

  First, FIG. 11A is a timing chart showing a case where image display is performed on the sensor built-in liquid crystal panels 301A and 301B using the intermittent drive method. In FIG. 11A, it is assumed that the user's input operation is not performed on any of the sensor built-in liquid crystal panels 301A and 301B (touch standby state).

  As shown in the figure, the sensor built-in liquid crystal panels 301A and 301B display images using an intermittent drive method in which the operation ratio between the operation mode and the pause mode of the liquid crystal panel drive circuits 304A and 304B is 1: 3. Yes. That is, the first display / light sensor units 300A and 300B and the circuit control unit 600 are operating according to the timing chart shown in FIG.

  In this case, “display data A” is supplied to the bus 400 during the period when the LCD select signal A is at the high level. That is, “display data A” occupies the bus 400 during this period.

  Similarly, “display data B” is supplied to the bus 400 while the LCD select signal B is at a high level, and “sensor data A” is supplied to the bus 400 while the sensor select signal A is at a high level. The “sensor data B” is supplied to the bus 400 while the sensor select signal B is at a high level. That is, “display data B”, “sensor data A”, or “sensor data B” occupies the bus 400 in each period.

  Thus, in the data display / sensor device 100, the data display / sensor device 100 can share the bus 400 for the input / output of the data signal (D) and the digital signal (DS). That is, the liquid crystal panel drive circuit 304A (display A), the liquid crystal panel drive circuit 304B (display B), the optical sensor drive circuit 305A and the signal conversion circuit 306A (sensor A), the optical sensor drive circuit 305B and the signal conversion circuit 306B. (Sensor B) can occupy the bus 400 during a predetermined one frame period.

  Next, FIG. 11B is a timing chart showing another example in the case where image display is performed on the sensor built-in liquid crystal panels 301A and 301B using the intermittent drive method. In FIG. 11B as well, it is assumed that the user's input operation is not performed on any of the sensor built-in liquid crystal panels 301A and 301B (touch standby state).

  As shown in the figure, in the sensor built-in liquid crystal panels 301A and 301B, image display is performed using an intermittent drive method in which the operation ratio of the liquid crystal panel drive circuits 304A and 304B is 1: 5. That is, after an operation mode for one frame period (the bus control unit 605 outputs a high level LCD select signal A or B), a pause mode for five frame periods (the bus control unit 605 has a low level LCD select signal A or B). The case of the intermittent drive system in which B is output) is illustrated.

  Also in this case, as in FIG. 11A, the data signal (D) or the digital signal (DS) corresponding to this period occupies the bus 400 during the high level period of various select signals.

  Here, since the refresh operation for switching to a new image is not performed during the pause mode, there is no need to operate the liquid crystal panel drive circuit 304. For this reason, in the operation ratio, when the ratio of the pause mode is larger than the ratio of the operation mode, the liquid crystal panel drive circuit 304 can stop the operation of the liquid crystal panel drive circuit 304 for the period. Therefore, in the data display / sensor device 100, the power consumption in the liquid crystal panel drive circuit 304 can be further reduced as the period of the pause mode is longer.

  Therefore, compared with the case of FIG. 11A in which the operation ratio is 1: 3, the power consumption in the liquid crystal panel drive circuit 304 can be further reduced in FIG. 11B.

  However, since the liquid crystal panel drive circuit 304 does not perform the refresh operation for the period of the pause mode, flickering increases when the moving image is displayed on the sensor built-in liquid crystal panel 301. End up. For this reason, it is necessary to set the operation ratio to such an extent that the display accuracy is maintained so that at least the sensor built-in liquid crystal panel 301 does not flicker (flash).

  That is, when the operation ratio is compared with 1: 3 (in the case of FIG. 11 (a)) and 1: 5 (in the case of FIG. 11 (b)), the case of FIG. It can be said that the case of FIG. Of course, when the operation ratio is 1: 1, it can be said that the intermittent drive method is most suitable for moving images.

  In FIG. 11B, the operation ratio of the liquid crystal panel drive circuit 304 is 1: 5, and the “sensor data A” and “sensor data B” occupy the bus 400 for one frame period accordingly. . That is, in FIG. 11B, a “vacant” time in which the bus 400 is not occupied by any signal is generated. As shown in the figure, when the operation ratio of the liquid crystal panel driving circuit 304 is 1: 5, “empty” for two frame periods is created.

  Therefore, in the case of FIG. 11B, the data display / sensor device 100 can further include, for example, an intermittent drive type display / light sensor unit 300.

  Next, in FIG. 11C, from the state shown in FIG. 11A (the operation ratio of the liquid crystal panel drive circuit 304 is 1: 3), the sensor built-in liquid crystal panel 301A detects an image (the sensor A is touched). It is a timing chart showing the case. Here, a case where only the sensor built-in liquid crystal panel 301A detects an image will be described. However, the present invention is not limited thereto, and only the sensor built-in liquid crystal panel 301B may detect an image.

  As shown in the figure, the operation ratio of the liquid crystal panel drive circuit 304 until the sensor built-in liquid crystal panel 301A detects an image is 1: 3, and each digital signal (DS) is in the period when the liquid crystal panel drive circuit 304 is in the pause mode. ) Sequentially occupies the bus 400 (ie, the state of FIG. 11A). Further, as shown in the figure, image detection (touch detection) in the sensor built-in liquid crystal panel 301A occurs at the seventh frame, and the operation ratio and the image detection frequency (detection frequency) are changed from the ninth frame.

  When the sensor built-in liquid crystal panel 301A detects an image, the bus control unit 605 starts the liquid crystal panel drive circuit 304A from the next cycle (in this case, the ninth frame) based on the timing instruction signal transmitted from the main control unit 800. And the operation ratio of 304B is changed.

  At this time, the bus control unit 605 changes the operation ratio of the sensor built-in liquid crystal panel 301A that detects the image from 1: 3 to 1: 1, and changes the operation ratio of the sensor built-in liquid crystal panel 301B that does not detect the image to 1: Change from 3 to 1: 5. Then, the bus control unit 605 increases the period during which the bus 400 cannot be occupied by slightly reducing the image detection frequency in accordance with the change in the operation ratio.

  That is, the bus control unit 605 outputs the high level LCD select signal A three times in any six frames. That is, the bus control unit 605 controls the LCD select signal A and various control signals so that the display data A occupies the bus 400 in three of the six frames.

  Further, the bus control unit 605 outputs the high level LCD select signal B, the sensor select signal A, and the sensor select while the low level LCD select signal A is being output (while the liquid crystal panel drive circuit 304A is in the pause mode). Signal B is output sequentially. That is, the bus control unit 605 selects the above three frames so that the display data A occupies the remaining three frames not occupying the bus 400 and the display data B, sensor data A, or sensor data B occupies the bus 400 frame by frame. Control signals and various control signals.

  Here, as shown in FIG. 9B, in the data display / sensor device 100, when the sensor built-in liquid crystal panel 301A detects an image of a pen P or the like, a cursor C is displayed in accordance with the position of the image. Let Then, the data display / sensor device 100 continues to detect the image of the pen P and displays the cursor C in accordance with the position of the image. That is, in the data display / sensor device 100 that displays the cursor C, when the user moves the pen P along the surface of the sensor built-in liquid crystal panel 301A, the pen P follows the movement. ) Display the cursor C.

  When the cursor C is displayed, the image on which the cursor C is displayed often includes, for example, a function key that can acquire a user's input operation. For this reason, the data display / sensor device 100 can not only display an image in accordance with the movement of the cursor C, but also needs to switch the image when a selection operation or a confirmation operation is performed on the function key. . That is, in the data display / sensor device 100, it is necessary to frequently perform the refresh operation of the sensor built-in liquid crystal panel 301 for displaying the cursor C so as not to impair the user's operability.

  In the data display / sensor device 100 according to the present invention, when the sensor built-in liquid crystal panel 301A detects an image, the data signal (D) in the first display / light sensor unit 300A in which the sensor built-in liquid crystal panel 301 is disposed. The acquisition timing switching operation is made faster than the switching operation at a predetermined timing. That is, in the data display / sensor device 100, when the sensor built-in liquid crystal panel 301A detects an image, the timing at which the bus control unit 605 outputs various select signals is switched as described above.

  For this reason, in the data display / sensor device 100, since the frequency of the refresh operation of the sensor built-in liquid crystal panel 301A can be increased, the operability of the user is not impaired even in the intermittent drive method.

  In the data display / sensor device 100, the data signal (second display / light sensor unit 300B in which the sensor built-in liquid crystal panel 301B that does not detect an image is disposed while the sensor built-in liquid crystal panel 301A is detecting an image is provided. The acquisition timing switching operation of D) is delayed.

  Therefore, in the data display / sensor device 100, the frequency of the refresh operation in the second display / light sensor unit 300B can be reduced while the sensor built-in liquid crystal panel 301A is detecting an image. Thereby, in the data display / sensor device 100, the power consumption of the second display / light sensor unit 300B can be reduced.

  Next, FIG. 11D shows that the sensor built-in liquid crystal panel 301A detects an image from the state shown in FIG. 11A (the operation ratio of the liquid crystal panel drive circuit 304 is 1: 3) (the sensor A is touched). ) Is a timing chart showing another example of the case.

  As shown in the figure, the operation ratio of the liquid crystal panel drive circuit 304 until the sensor built-in liquid crystal panel 301A detects an image is 1: 3, and each digital signal (DS) is in the period when the liquid crystal panel drive circuit 304 is in the pause mode. ) Sequentially occupies the bus 400 (ie, the state of FIG. 11A). Further, as shown in the figure, image detection (touch detection) in the sensor built-in liquid crystal panel 301A occurs at the seventh frame, and the operation ratio and the image detection frequency (detection frequency) are changed from the ninth frame.

  When the sensor built-in liquid crystal panel 301A detects an image, the bus control unit 605 starts the liquid crystal panel drive circuit 304A from the next cycle (in this case, the ninth frame) based on the timing instruction signal transmitted from the main control unit 800. Change the operation ratio.

  At this time, the bus control unit 605 changes the operation ratio of the sensor built-in liquid crystal panel 301A that has detected the image from 1: 3 to 1: 1. Also, unlike the case of FIG. 11C, the bus control unit 605 maintains the operation ratio of the sensor built-in liquid crystal panel 301B that does not detect an image at 1: 3. Then, the bus control unit 605 increases the period during which the bus 400 cannot be occupied by slightly reducing the image detection frequency in accordance with the change in the operation ratio.

  That is, the bus control unit 605 outputs the high-level LCD select signal A twice in any four frames. That is, the bus control unit 605 controls the LCD select signal A and various control signals so that the display data A occupies the bus 400 in two of the four frames.

  Further, the bus control unit 605 outputs the high-level LCD select signal B and the sensor select signal A or the sensor while the low-level LCD select signal A is being output (while the liquid crystal panel drive circuit 304A is in the pause mode). The select signal B is sequentially output. That is, the bus control unit 605 controls the select signal and various control signals so that the display data A occupies one of the remaining two frames not occupying the bus 400 and the display data B occupies the bus 400. To do. Further, the select signal and various control signals are controlled so that the sensor data A or B occupies the bus 400 for the remaining one frame. That is, as shown in the figure, the sensor data A or B occupies the bus 400 in one of the eight frames.

  Even in this case, in the data display / sensor device 100, when the sensor built-in liquid crystal panel 301A detects an image, the timing at which the bus control unit 605 outputs various select signals is switched as described above. For this reason, since the frequency of the refresh operation of the sensor built-in liquid crystal panel 301A can be increased, the operability of the user is not impaired even in the intermittent drive method.

  In FIG. 11C and FIG. 11D, the frequency of the refresh operation of the sensor built-in liquid crystal panel 301B that has not detected the image is increased in order to increase the frequency of the refresh operation of the sensor built-in liquid crystal panel 301A that has detected the image. Is low. Normally, while performing an input operation on the sensor built-in liquid crystal panel 301A, the user mainly watches the sensor built-in liquid crystal panel 301A. For this reason, the data display / sensor device 100 is less likely to affect the user's input operation even if the refresh operation of the sensor built-in liquid crystal panel 301B is lowered.

  That is, the operation ratio of the liquid crystal panel drive circuit 304 when the user's input operation is not acquired is an operation ratio that does not cause flicker even after the display / light sensor unit 300 detects an image. It may be set to such an extent that it can be changed. In the case of FIG. 11C, a still image capable of suppressing flickering is displayed on the sensor built-in liquid crystal panel 301B that does not detect an image even if the operation ratio of the liquid crystal panel drive circuit 304B is 1: 5. It is preferable to make it.

  Further, in FIGS. 11C and 11D, the image detection frequency is lowered in order to increase the frequency of the refresh operation of the sensor built-in liquid crystal panel 301A. Usually, in order to prevent flickering of an image displayed on the sensor built-in liquid crystal panel 301, one frame period is several ten milliseconds. On the other hand, even if the detection interval for the sensor built-in liquid crystal panel 301 to detect an image is about 0.5 seconds, the operability of the user is not impaired. Therefore, in the data display / sensor device 100, even when the sensor built-in liquid crystal panel 301 reduces the image detection frequency, the image can be detected to the extent that the operability for the user is not impaired.

  That is, the image detection interval may be set / changed in any way as long as the detection interval is such that the user's input operation can be acquired. That is, as shown in FIG. 11 (d), even when the image detection frequency is lower than in the case of FIG. 11 (c), the image is detected at a rate of 1 frame out of 8 frames. User operability is not impaired.

  Further, in FIGS. 11C and 11D, it has been described that the sensor built-in liquid crystal panel 301A is detecting during the period in which the high-level sensor select signal A is output. However, the present invention is not limited to this, and the data display / sensor device 100 uses the digital signal (DS) indicating the image detected in the previous period during which the low-level sensor select signal A is output as the high-level sensor select. You may be comprised so that it may output in the period when the signal A is output.

  Furthermore, the data display / sensor device 100 returns to the initial state (the state shown in FIG. 11A) when the sensor built-in liquid crystal panel 301A no longer detects an image (when the user's input operation is completed). It may be configured to return.

(Configuration and processing flow of main control unit 800)
Next, with reference to FIG. 12 and FIG. 13, the main configuration of the main control unit 800 and the flow of processing will be described. Here, in order to make the description easy to understand, the description of the operations of the data processing unit 700 and the circuit control unit 600 located between the main control unit 800 and the display / light sensor unit 300 will be omitted as appropriate. However, more precisely, each unit of the main control unit 800 transmits a command to the data processing unit 700, the data processing unit 700 controls the circuit control unit 600 based on the command, and the circuit control unit 600 displays the display / light sensor. A signal is transmitted to unit 300. Further, the main control unit 800 acquires the entire image data, the partial image data, and the coordinate data from the data processing unit 700 as a response to the command transmitted to the data processing unit 700.

  FIG. 12 is a block diagram showing a main configuration of the main control unit 800. As illustrated, the main control unit 800 includes a timing instruction unit 810, a detection determination unit 820, and a display data control unit 830.

  The timing instruction unit 810 instructs the timing of various select signals output from the bus control unit 605 by referring to the storage unit 901. Therefore, the timing instruction unit 810 transmits a timing instruction signal for instructing the timing to the bus control unit 605.

  The detection determination unit 820 determines whether an image is detected by the sensor built-in liquid crystal panel 301. The detection determination unit 820 also determines which sensor built-in liquid crystal panel 301 detects the image. When the detection determination unit 820 determines that the image is detected by the sensor built-in liquid crystal panel 301, the detection determination unit 820 transmits a detection confirmation signal to the timing instruction unit 810 and the display data control unit 830 as a determination result.

  The display data control unit 830 generates images to be displayed on the sensor built-in liquid crystal panels 301A and 301B according to the application program stored in the storage unit 901 and the detection confirmation signal from the detection determination unit 820, respectively. The display data control unit 830 transmits the generated image as display data to the sensor built-in liquid crystal panels 301A and 301B, respectively.

  In addition to the application program executed by the main control unit 800, the storage unit 901 stores operation ratios of the liquid crystal panel drive circuits 304A and 304B and output timings of various select signals associated with these operation ratios. Has been.

  This operation ratio is set in several types (for example, “1: 1”, “1: 3”, “1: 5”) so that it can be changed after the sensor built-in liquid crystal panel 301 detects an image. For this reason, the output timing of various select signals is stored in the storage unit 901 corresponding to each operation ratio.

  Next, a processing flow of the main control unit 800 will be described with reference to FIG. FIG. 13 is a flowchart showing a process flow of the main control unit 800.

  First, the timing instruction unit 810 instructs the bus control unit 605 to output various select signals at a predetermined timing (S1). That is, the timing instruction unit 810 reads the operation ratios of the liquid crystal panel drive circuits 304A and 304B and the output timings of various select signals associated with these operation ratios stored in the storage unit 901, and the operation ratios and The output timing is transmitted to the bus control unit 605 as a timing instruction signal.

  When the bus control unit 605 receives the timing instruction signal, it outputs various select signals at the output timing indicated by the timing instruction signal, and various control signals and data signals (D) based on the output timing of the various select signals. And a digital signal (DS) is output.

  Further, the display data control unit 830 reads out and executes the application program from the storage unit 901, thereby transmitting the images to be displayed on the sensor built-in liquid crystal panels 301A and 301B to the data processing unit 700 as display data.

  When the display data control unit 830 transmits display data to be displayed on the sensor built-in liquid crystal panel 301A to the data processing unit 700, the display data control unit 830 displays “first display” as the value of the “display panel” field. / A command specifying the optical sensor unit 300A "(" 001 ") is transmitted to the data processing unit 700. On the other hand, when the display data control unit 830 transmits display data to be displayed on the sensor built-in liquid crystal panel 301B to the data processing unit 700, the value of the “display panel” field is “second display / light sensor unit 300B” ( A command designating “010”) is transmitted to the data processing unit 700.

  Next, the detection determination unit 820 determines whether an image is detected (whether there is a sense) by the sensor built-in liquid crystal panel 301A or 301B (S2). Specifically, the detection determination unit 820 acquires, for example, partial image data from the data processing unit 700 when an image is detected in the sensor built-in liquid crystal panel 301. That is, the detection determination unit 820 determines that the sensor built-in liquid crystal panel 301 has detected an image when the partial image data is acquired.

  In the data display / sensor device 100, the sensor built-in liquid crystal panel 301 needs to be in a scannable state so that the sensor built-in liquid crystal panel 301 can detect an image. For this reason, the detection determination unit 820 performs “reflection” (“00”), “transmission” (“01”), “reflection / reflection” as the value of the “scan method” field at the time of (or before) the processing of S1. One of “Transmission” (“10”), “Binary” (“00”), “Multi-value” (“01”) as the value of the “Scanned image gradation” field, One of “binary” (“00”) and “multivalue” (“01”) as the value, and “first display / light sensor section” (“001”) and “first” as the value in the “scan panel” field A command designating “2 display / light sensor unit” (“010”) is transmitted to the data processing unit 700.

  In addition, the detection determination unit 820 determines the entire image data when there is a change on the sensor built-in liquid crystal panel 301 in order to determine whether an image is detected by the sensor built-in liquid crystal panel 301A or 301B. Obtain from 700. Therefore, for example, the detection determination unit 820 receives a command specifying “event” (“01”) as the value of the “data acquisition timing” field and “partial image” (“010”) as the value of the “data type” field. To the data processing unit 700.

  When the detection determination unit 820 acquires the partial image data, for example, representative coordinates (coordinates in the partial image) of the partial image are used as information indicating which of the sensor built-in liquid crystal panels 301A and 301B has been detected. Shall be used. Accordingly, the detection determination unit 820 can recognize which sensor-equipped liquid crystal panel 301 is the partial image data including the image detected by acquiring the value of the representative coordinate.

  If the detection determination unit 820 determines that an image is detected by the sensor built-in liquid crystal panel 301A or 301B (YES in S2), the detection confirmation indicates that the image detection by either the sensor built-in liquid crystal panel 301A or 301B has been confirmed. The signal is transmitted to the timing instruction unit 810 and the display data control unit 830. If NO in S2, the detection determination unit 820 waits for partial image data transmitted from the data processing unit 700.

  When receiving the detection confirmation signal, the timing instruction unit 810 confirms which of the sensor built-in liquid crystal panels 301 has detected the image. Then, the timing instruction unit 810 stores, from the storage unit 901, the operation frequency at which the refresh operation frequency of the sensor built-in liquid crystal panel 301 in which the image is detected is set high, and various select signals associated with the operation frequency. The output timing is read out, and the operation ratio and the output timing are determined as a new timing instruction signal. That is, the timing instruction unit 810 determines the output timing of various select signals as the read output timing (S3).

  When determining the output timing, the timing instruction unit 810 instructs the bus control unit 605 to output various select signals at the determined timing (S4). That is, the timing instruction unit 810 transmits the timing instruction signal determined in S3 to the bus control unit 605.

  When the bus control unit 605 receives the timing instruction signal, the bus control unit 605 changes the output timing indicated by the timing instruction signal to output various select signals, and based on the output timings of the various select signals, (D) and a digital signal (DS) are output.

  Further, when the display data control unit 830 receives the detection confirmation signal in the case of YES in S2, the display data control unit 830 confirms which of the sensor built-in liquid crystal panels 301 has detected the image. Then, the display data control unit 830 reads the application program, and transmits an image to be displayed on each sensor-equipped liquid crystal panel 301 to the data processing unit 700 as display data.

  When the sensor built-in liquid crystal panel 301A detects an image, the display data control unit 830 transmits an image including the cursor C, function keys, and the like to the sensor built-in liquid crystal panel 301A, for example.

(Supplement)
Finally, each block of the data display / sensor device 100 according to the present embodiment, particularly the timing instruction unit 810, the detection determination unit 820, and the display data control unit 830 of the main control unit 800 may be configured by hardware logic. However, it may be realized by software using a CPU as follows.

  That is, the data display / sensor device 100 according to the present embodiment expands a CPU (Central Processing Unit) that executes instructions of a control program that realizes each function, a ROM (Read Only Memory) that stores the program, and the program. A random access memory (RAM), a storage device (recording medium) such as a memory for storing the program and various data, and the like. An object of the present invention is a record in which a program code (execution format program, intermediate code program, source program) of a control program for the data display / sensor device 100, which is software for realizing the functions described above, is recorded so as to be readable by a computer. This can also be achieved by supplying a medium to the data display / sensor device 100 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  In addition, the data display / sensor device 100 according to the present embodiment may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  For example, in the above embodiment, the present invention is applied to the sensor built-in liquid crystal panel 301. However, the present invention is not limited to this, and the present invention may be applied to an electronic device such as a desktop PC (Personal Computer). In the above embodiment, the present invention is applied to an image display system including an LCD. However, the present invention can also be applied to an image display system including other FPDs such as a PDP, an EL display, and an FED.

  As described above, the present invention is particularly suitable for an image detection / display apparatus including a member provided with an intermittent drive type display unit and an image detection unit for detecting an image.

It is a block diagram which shows the principal part structure of the display / light sensor part of the data display / sensor apparatus which concerns on one Embodiment of this invention, and a circuit control part. It is a figure which shows typically the cross section of the liquid crystal panel with a built-in sensor with which the data display / sensor apparatus which concerns on one Embodiment of this invention is provided. FIG. 3A is a schematic diagram showing a state in which a position touched by a user is detected by detecting a reflected image on a sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment of the present invention. is there. FIG. 3B is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a shadow image on the sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment of the present invention. . It is a block diagram which shows the principal part structure of the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure which shows typically an example of the frame structure of the command used with the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure explaining an example of the value which can be specified to each field contained in the command shown in FIG. 5, and its outline. FIG. 7A is a result of scanning the entire sensor-equipped liquid crystal panel when the object is not placed on the sensor-equipped liquid crystal panel in the data display / sensor device according to the embodiment of the present invention. Image data. FIG. 7B shows image data obtained as a result of scanning when the user is touching the sensor-equipped liquid crystal panel with a finger in the data display / sensor device according to the embodiment of the present invention. It is a block diagram which shows the structure of the liquid crystal panel with a sensor with which the data display / sensor apparatus which concerns on one Embodiment of this invention is provided, and the structure of its peripheral circuit. FIG. 9A is a diagram illustrating a state in which the housing of the data display / sensor device according to the embodiment of the present invention is closed. FIG. 9B is a diagram illustrating a state in which the housing of the data display / sensor device according to the embodiment of the present invention is opened. In a data display / sensor device according to an embodiment of the present invention, a control signal and a select signal output from a bus control unit, a display control unit, a sensor control unit, a liquid crystal panel drive circuit, and an optical sensor drive circuit 4 is a timing chart showing the relationship among control signals, select signals, data signals, and digital signals inputted to and outputted from the signal conversion circuit. FIG. 11A is a timing chart showing a case where image display is performed using the intermittent drive method on the sensor built-in liquid crystal panel of the data display / sensor device according to the embodiment of the present invention. FIG. 11B is a timing chart showing another example in the case where image display is performed using the intermittent drive method on the sensor built-in liquid crystal panel of the data display / sensor device according to the embodiment of the present invention. FIG. 11C is a timing chart showing a case where the sensor built-in liquid crystal panel of the data display / sensor device according to the embodiment of the present invention detects an image from the state shown in FIG. FIG. 11D is a timing chart showing another example when the image is detected by the sensor built-in liquid crystal panel of the data display / sensor device according to the embodiment of the present invention from the state shown in FIG. . It is a block diagram which shows the principal part structure of the main control part of the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows the flow of a process of the main control part shown in FIG.

Explanation of symbols

100 Data display / sensor device (image detection / display device)
300 Display / Optical sensor part (planar member)
301 Liquid crystal panel with built-in sensor (display unit, image detection unit)
304 Liquid crystal panel drive circuit (display unit)
305 Optical sensor drive circuit (image detector)
306 Signal conversion circuit (image detection unit)
400 Signal line (bus)
600 Circuit controller (operation controller)
605 Bus control unit (timing control unit)
606 Bus switching unit (signal line switching unit)

Claims (5)

An image detection / display device including a plurality of planar members each provided with a display unit having an operation mode for performing a display operation and a pause mode for pausing the display operation, and an image detection unit for detecting a nearby image There,
An operation control unit for controlling the display operation in each display unit and the image detection operation in each image detection unit;
A signal line connected to the operation control unit and the plurality of planar members,
The operation control unit is
Acquisition timing for acquiring display image data for performing a new display operation during the operation mode period of each display unit, and output timing for outputting image detection data indicating an image detected by each image detection unit during the pause mode period Are sequentially switched at a predetermined timing, and a timing control unit that shares the signal line is provided,
The timing control unit, when the image detection unit disposed on the specific planar member among the plurality of planar members detects an image, the display unit disposed on the specific planar member An image detection / display apparatus characterized in that an acquisition timing switching operation is made faster than a switching operation at the predetermined timing.   When the image detection unit disposed on the specific planar member detects an image, the timing control unit obtains the acquisition in the display unit disposed on another planar member other than the specific planar member. The image detection / display apparatus according to claim 1, wherein the timing switching operation is made slower than the switching operation at the predetermined timing.   2. The timing control unit sequentially outputs a switching signal for sequentially switching the acquisition timing and the output timing to each display unit and each image detection unit in the plurality of planar members. Or the image detection / display device according to 2; The operation control unit is
Output the display image data acquired by each display unit, and acquire the image detection data output by each image detection unit,
The display that is input to and output from the signal line in response to a control signal that is output from the timing control unit and that controls the output timing of the display image data and the acquisition timing of the image detection data in the operation control unit. 4. The image detection / display device according to claim 1, further comprising a signal line switching unit that switches between image data and the image detection data.   The image detection / display apparatus according to claim 4, wherein the timing control unit outputs the control signal in response to the switching signal.

Images