JP2010186442A - Input device and input control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input device capable of invalidating input corresponding to input conditions without providing an input stop button or the like, and to provide an input control method. <P>SOLUTION: A data display/sensor device 100 determines whether or not the spread of an area on a planar member (sensor incorporating liquid crystal panel 301 or the like) selected by an object (finger 64 or dustcloth 65 or the like) is a prescribed reference value or more, and when the spread of the area is the prescribed reference value or more, invalidates the input to the planar member by the object. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an input device and an input control method in the device. In particular, the present invention relates to an input device that can reduce the possibility of erroneous input when cleaning an input screen, and an input control method in the device.

  In an information device that accepts an input by touching the input screen with a finger or the like, the information device may accept an erroneous input when the dirt on the input screen is cleaned using a cloth or a cloth. That is, if the application is cleaned without turning off the power of the information device, some input is generated in the application, which may cause an erroneous operation.

  Therefore, in order to prevent erroneous input, the input screen is cleaned after the information device is turned off and no input is accepted. Or when it is necessary to drive an information device without a break, the structure which switches to the cleaning mode for cleaning the input screen, without turning off the power supply of the said information device is employ | adopted.

  For example, Patent Document 1 discloses an information input device that can clean an input-prohibited area by providing an input-prohibited area and an input-capable area whose position can be changed in the input screen in the input screen cleaning mode. It is disclosed. Further, in the information input device, the cleaning mode is canceled when the input possible area is touched twice on the input screen.

  Patent Documents 2 to 5 disclose an information terminal device or the like that is provided with an input pause button or the like and does not accept input for a predetermined period when the button or the like is selected. Then, the input screen can be cleaned without causing malfunction during the predetermined period.

  Patent Document 6 further discloses a configuration in which an input screen accepts a plurality of predetermined inputs to cancel a state in which no input is accepted (input invalid state).

Japanese Patent Laid-Open No. 1-125614 (Publication Date: May 18, 1989) Japanese Patent Laid-Open No. 10-177457 (publication date: June 30, 1998) JP 2000-284910 A (publication date October 13, 2000) JP 2004-334762 A (publication date November 25, 2004) JP 2004-355078 A (publication date December 16, 2004) Japanese Patent Laying-Open No. 2005-71008 (Publication date: March 17, 2005)

  However, in the configuration in which the input screen is cleaned after the information device is turned off, there is a problem that it takes time to terminate and restart the information device after the power is turned off. In addition, if the information device cannot be turned off, the input screen cannot be cleaned at all.

  On the other hand, with the technique described in Patent Document 1, the input screen can be cleaned without turning off the power. However, there is a problem that if the input possible area is accidentally cleaned in the cleaning mode, the information input device malfunctions.

  In the techniques described in Patent Documents 2 to 5, 1) it is necessary to select a predetermined input pause button or the like in order to clean the input screen, and 2) when the cleaning mode is entered, There is a problem that an input cannot be accepted again unless the period has passed.

  In the technique described in Patent Document 6, 1) it is necessary to select a cleaning button in order to clean the input screen, and 2) after entering the cleaning mode, if a plurality of predetermined inputs are not waited, the normal operation is resumed. There is a problem of not being able to accept input.

  The present invention has been made in view of the above problems, and a main object of the present invention is to provide a novel technique for invalidating an input according to an input state on an input screen without providing an input stop button or the like. .

  In order to solve the above-described problems, an input device according to the present invention detects a target image and detects an area of the planar member selected by the target object. An area detection means, an area width detection means for detecting the extent of the area, and whether or not the extent of the area is equal to or greater than a predetermined reference value, and the extent of the area is equal to or greater than a predetermined reference value And an input control means for invalidating the input to the planar member by the object.

  According to said structure, an input can be invalidated according to the input condition to the planar member by the target object located in the vicinity, without providing an input stop button etc.

  Here, when there is no area on the planar member selected by the object (that is, when the object is not in the vicinity of the planar member), the area size detection means does not expand the area. Judge as (zero).

  In the input device according to the present invention, the area width detection unit obtains the number of detections of the image of the object at each position on the planar member, or when the planar member is divided into a plurality of divided regions. The configuration may be such that the spread of the region is detected by obtaining the number of the divided regions selected by the object.

  In the input device according to the present invention, the input control means cancels the input invalid state for the planar member when the spread of the region becomes less than a predetermined reference value after invalidating the input to the planar member. The configuration is preferably According to this configuration, for example, after the cleaning of the planar member is completed, the input invalid state for the planar member can be automatically canceled.

  In the input device according to the present invention, in order to inform the user of the state of the device, when the input to the planar member by the object is invalidated by the input control means, an image for notifying that the input is invalid is planar. The structure displayed on a member may be sufficient.

  The input device according to the present invention includes a movement direction detecting means for detecting a movement direction of the object relative to the planar member, and the movement of the object is either a reciprocating movement or a repetitive movement, and has a wide area. The input control means may be configured to invalidate the input to the planar member when the spread of the area detected by the height detection means is greater than or equal to a predetermined reference value. According to this configuration, since the input invalidity determination is made based on the movement pattern of the object, the input control in the input device can be performed more accurately.

  In the input device according to the present invention, the planar member may include a photodiode group, and the image may be detected based on a change in the amount of received light detected by the photodiode group.

  An input control method according to the present invention is an input control method in an input device including a planar member that detects an image of an object and receives an input, and includes the following steps performed by the input device: (1) by an object A selection area detecting step for detecting an area on the selected planar member; (2) an area width detecting step for detecting the extent of the area; and (3) whether the extent of the area is equal to or greater than a predetermined reference value. And an input control step of invalidating input to the planar member by the object when the spread of the area is equal to or greater than a predetermined reference value.

  According to said structure, there exists an effect similar to the input device which concerns on this invention.

  Further, a program for operating the input device according to the present invention, which is characterized in that a computer is driven as each of the above-mentioned means, and a computer-readable recording medium on which the program is recorded. It can also be used for realization.

  According to the input device and the input control method of the present invention, the spread of a region on a planar member selected by an object located in the vicinity is detected, and whether or not the spread of the region is equal to or greater than a predetermined reference value. If the spread of the area is equal to or greater than a predetermined reference value, the input to the planar member by the object is invalidated. Thereby, the said input can be invalidated according to the input condition to the planar member by a target object, without providing an input stop button etc.

It is a figure which shows typically the external appearance of the data display / sensor apparatus which concerns on one Embodiment of this invention. (A) shows the appearance of the data display / sensor device in the normal mode, and (b) shows the appearance of the data display / sensor device in the cleaning mode. It is a figure which shows typically the cross section of the liquid crystal panel with a built-in sensor with which the data display / sensor apparatus which concerns on one Embodiment of this invention is provided. FIG. 3A is a schematic diagram showing a state in which a position touched by a user is detected by detecting a reflected image on a sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment of the present invention. is there. FIG. 3B is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a shadow image on the sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment of the present invention. . It is a block diagram which shows the principal part structure of the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure which shows typically an example of the frame structure of the command used with the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure explaining an example of the value which can be specified to each field contained in the command shown in FIG. 5, and its outline. FIG. 7A is a result of scanning the entire sensor-equipped liquid crystal panel when the object is not placed on the sensor-equipped liquid crystal panel in the data display / sensor device according to the embodiment of the present invention. Image data. FIG. 7B shows image data obtained as a result of scanning when the user is touching the sensor-equipped liquid crystal panel with a finger in the data display / sensor device according to the embodiment of the present invention. It is a block diagram which shows the structure of the liquid crystal panel with a sensor with which the data display / sensor apparatus which concerns on one Embodiment of this invention is provided, and the structure of its peripheral circuit. It is a block diagram which shows the structure of the data display / sensor apparatus which concerns on one Embodiment of this invention centering on a main-control part and a memory | storage part. It is a flowchart explaining an example of operation | movement of the data display / sensor apparatus which concerns on one Embodiment of this invention. FIG. 11A and FIG. 11B are obtained as a result of scanning when the user touches the sensor built-in liquid crystal panel with a rag in the data display / sensor device according to the embodiment of the present invention. Image data. FIG. 11C is obtained as a result of scanning the entire liquid crystal panel with a sensor when the object is not placed on the liquid crystal panel with a sensor in the data display / sensor device according to one embodiment of the present invention. Image data.

(Outline of data display / sensor device operation)
FIGS. 1A and 1B are views schematically showing the appearance of a data display / sensor device (input device) 100 according to an embodiment of the present invention. As shown in FIGS. 1A and 1B, the data display / sensor device 100 has a sensor built-in liquid crystal panel (planar member) 301 disposed on one surface of a casing, and the rectangular panel surface ( It is a touch panel type input / display device that accepts image display and information input on the display surface.

  The data display / sensor device 100 has a normal mode for accepting an input from the operator and a cleaning mode for cleaning the panel surface of the sensor built-in liquid crystal panel 301. As will be described later, the data display / sensor device 100 can automatically switch between the normal mode and the cleaning mode in accordance with the input state to the sensor built-in liquid crystal panel 301. More specifically, for example, the data display / sensor device 100 can automatically switch between the normal mode and the cleaning mode in accordance with the size of an object that approaches or contacts the sensor built-in liquid crystal panel 301. .

  As shown in FIG. 1A, in the normal mode, a plurality of input keys 350 are displayed on the display surface of the sensor built-in liquid crystal panel 301, and the data display / sensor device 100 is operated by the operator using the input keys 350. The input by the finger (object) 64 of the user is accepted. However, none of the input keys 350 is an input key for switching between the normal mode and the cleaning mode.

  On the other hand, when the dust cloth (object) 65 is brought close to or in contact with the panel surface of the sensor built-in liquid crystal panel 301 in the normal mode, the data display / sensor device 100 automatically shifts to the cleaning mode shown in FIG. To do. In the cleaning mode, the data display / sensor device 100 displays a full black image (input invalid image) with the characters “input invalid” on the panel surface of the sensor built-in liquid crystal panel 301. In the cleaning mode, all input by the object to the sensor built-in liquid crystal panel 301 is invalidated (not accepted), so that there is no problem of erroneous input by the dust cloth 65 and the hand 66 that handles the dust cloth. And the cleaning mode continues during the period when the dust cloth 65 is close to or in contact with the panel surface.

  When cleaning of the panel surface is completed and the dust cloth 65 is separated from the panel surface, the data display / sensor device 100 automatically shifts again to the normal mode shown in FIG. The input by the person's finger 64 is accepted again. The transition from the cleaning mode to the normal mode can be automatically performed with a trigger when the dust cloth 65 is separated from the panel surface. For example, 1) In the data display / sensor device 100, the dust cloth 65 is removed from the panel surface. The data display / sensor device 100 may return to the normal mode as soon as it leaves, or the data display / sensor device 100 may automatically return to the normal mode after a predetermined time elapses after the dust cloth 65 leaves the panel surface. Good.

  As described above, in the configuration of the data display / sensor device 100, the normal mode and the cleaning mode are automatically set according to the input state (input with a finger or input with a dust cloth larger than the finger) to the sensor built-in liquid crystal panel 301. Switch. Thereby, the data display / sensor device 100 can automatically invalidate the input when cleaning the panel surface of the sensor built-in liquid crystal panel 301 without providing an input stop button, a mode switching button, or the like.

  The input by the finger 64 may be performed simultaneously with the finger 64 contacting or approaching the display surface of the sensor built-in liquid crystal panel 301, or after the finger 64 once touching or approaching the display surface. It may be performed when the releasing operation (up operation) is performed.

  In addition to the finger 64, the user may instruct on the sensor built-in liquid crystal panel 301 using a light shielding object such as a touch pen.

  Hereinafter, the structure of each member which implement | achieves the function mentioned above is demonstrated in detail. First, an outline of the sensor built-in liquid crystal panel 301 included in the data display / sensor device 100 will be described.

(Outline of LCD panel with built-in sensor)
The sensor built-in liquid crystal panel 301 provided in the data display / sensor device 100 is a liquid crystal panel capable of detecting an image of an object in addition to displaying data. Here, the image detection of the object is, for example, detection of a position (that is, a selected area) where the user points (touches) with a finger or a pen, or reading (scanning) of an image of a printed material. The device used for display is not limited to a liquid crystal panel, and may be an organic EL (Electro Luminescence) panel or the like.

  The structure of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 2 is a diagram schematically showing a cross section of the sensor built-in liquid crystal panel 301. The sensor built-in liquid crystal panel 301 described here is an example, and any structure can be used as long as the display surface and the reading surface are shared.

  As shown in the figure, the sensor built-in liquid crystal panel 301 includes an active matrix substrate 51A disposed on the back surface side and a counter substrate 51B disposed on the front surface side, and has a structure in which a liquid crystal layer 52 is sandwiched between these substrates. is doing. The active matrix substrate 51A is provided with a pixel electrode 56, a data signal line 57, an optical sensor circuit 32 (not shown), an alignment film 58, a polarizing plate 59, and the like. The counter substrate 51B is provided with color filters 53r (red), 53g (green), 53b (blue), a light shielding film 54, a counter electrode 55, an alignment film 58, a polarizing plate 59, and the like. In addition, a backlight 307 is provided on the back surface of the sensor built-in liquid crystal panel 301.

  The photodiode 6 included in the photosensor circuit 32 is provided in the vicinity of the pixel electrode 56 provided with the blue color filter 53b, but is not limited to this configuration. It may be provided in the vicinity of the pixel electrode 56 provided with the red color filter 53r, or may be provided in the vicinity of the pixel electrode 56 provided with the green color filter 53g.

  Next, with reference to FIG. 3A and FIG. 3B, two types of methods for detecting a position (selection region) where the user touches the sensor built-in liquid crystal panel 301 with a finger or a pen will be described. To do.

  FIG. 3A is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a reflected image. When the light 63 is emitted from the backlight 307, the optical sensor circuit 32 including the photodiode 6 detects the light 63 reflected by an object such as a finger 64. Thereby, a reflected image of an object such as the finger 64 can be detected. Thus, the sensor built-in liquid crystal panel 301 can detect the touched position by detecting the reflected image.

  FIG. 3B is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a shadow image. As shown in FIG. 3B, the optical sensor circuit 32 including the photodiode 6 detects external light 61 transmitted through the counter substrate 51B and the like. However, when there is an object 62 such as a pen, the incident of the external light 61 is hindered, so that the amount of light detected by the optical sensor circuit 32 is reduced. Thereby, a shadow image of the object 62 can be detected. Thus, the sensor built-in liquid crystal panel 301 can also detect a touched position by detecting a shadow image.

  As described above, the photodiode 6 may detect reflected light (shadow image) of the light emitted from the backlight 307 or may detect a shadow image caused by external light. Further, the two types of detection methods may be used in combination to detect both a shadow image and a reflected image at the same time.

(Data display / sensor configuration)
Next, with reference to FIG. 4, the configuration of the main part of the data display / sensor device 100 will be described. FIG. 4 is a block diagram showing a main configuration of the data display / sensor device 100. As shown in FIG. As illustrated, the data display / sensor device 100 includes one or more display / light sensor units 300, a circuit control unit 600, a data processing unit 700, a main control unit 800, a storage unit 901, a primary storage unit 902, and an operation unit. 903, an external communication unit 907, an audio output unit 908, and an audio input unit 909. Here, although the data display / sensor device 100 is described as including a single display / light sensor unit 300, a plurality of data display / sensor devices 100 may be included.

  The display / light sensor unit 300 is a so-called liquid crystal display device with a built-in light sensor. The display / light sensor unit 300 includes a sensor built-in liquid crystal panel 301, a backlight 307, and a peripheral circuit 309 for driving them.

  The sensor built-in liquid crystal panel 301 includes a plurality of pixel circuits 31 and photosensor circuits 32 arranged in a matrix. The detailed configuration of the sensor built-in liquid crystal panel 301 will be described later.

  The peripheral circuit 309 includes a liquid crystal panel drive circuit 304, an optical sensor drive circuit 305, a signal conversion circuit 306, and a backlight drive circuit 308.

  The liquid crystal panel driving circuit 304 outputs a control signal (G) and a data signal (S) in accordance with the timing control signal (TC1) and the data signal (D) from the display control unit 601 of the circuit control unit 600, and the pixel circuit 31. It is a circuit which drives. Details of the driving method of the pixel circuit 31 will be described later.

  The optical sensor driving circuit 305 is a circuit that drives the optical sensor circuit 32 by applying a voltage to the signal line (R) in accordance with a timing control signal (TC2) from the sensor control unit 602 of the circuit control unit 600. Details of the driving method of the optical sensor circuit 32 will be described later.

  The signal conversion circuit 306 is a circuit that converts the sensor output signal (SS) output from the optical sensor circuit 32 into a digital signal (DS) and transmits the converted signal to the sensor control unit 602.

  The backlight 307 includes a plurality of white LEDs (Light Emitting Diodes) and is disposed on the back surface of the sensor built-in liquid crystal panel 301. When a power supply voltage is applied from the backlight drive circuit 308, the backlight 307 is turned on and irradiates the sensor built-in liquid crystal panel 301 with light. Note that the backlight 307 is not limited to white LEDs, and may include LEDs of other colors. The backlight 307 may include, for example, a cold cathode fluorescent lamp (CCFL) instead of the LED.

  The backlight driving circuit 308 applies a power supply voltage to the backlight 307 when the control signal (BK) from the backlight control unit 603 of the circuit control unit 600 is at a high level, and conversely, the backlight control unit 603. When the control signal from is at a low level, no power supply voltage is applied to the backlight 307.

  Next, the circuit control unit 600 will be described. The circuit control unit 600 has a function as a device driver that controls the peripheral circuit 309 of the display / light sensor unit 300. The circuit control unit 600 includes a display control unit 601, a sensor control unit 602, a backlight control unit 603, and a display data storage unit 604.

  The display control unit 601 receives display data from the display data processing unit 701 of the data processing unit 700, and performs timing control on the liquid crystal panel driving circuit 304 of the display / light sensor unit 300 in accordance with an instruction from the display data processing unit 701. A signal (TC1) and a data signal (D) are transmitted, and the received display data is displayed on the sensor built-in liquid crystal panel 301.

  The display control unit 601 temporarily stores the display data received from the display data processing unit 701 in the display data storage unit 604. Then, a data signal (D) is generated based on the primary stored display data. The display data storage unit 604 is, for example, a video random access memory (VRAM).

  The sensor control unit 602 transmits a timing control signal (TC2) to the optical sensor driving circuit 305 of the display / optical sensor unit 300 in accordance with an instruction from the sensor data processing unit 703 of the data processing unit 700, and the sensor built-in liquid crystal panel 301. Run the scan with.

  In addition, the sensor control unit 602 receives a digital signal (DS) from the signal conversion circuit 306. Then, image data is generated based on the digital signal (DS) corresponding to the sensor output signal (SS) output from all the optical sensor circuits 32 included in the sensor built-in liquid crystal panel 301. That is, the image data read in the entire reading area of the sensor built-in liquid crystal panel 301 is generated. Then, the generated image data is transmitted to the sensor data processing unit 703.

  The backlight control unit 603 transmits a control signal (BK) to the backlight drive circuit 308 of the display / light sensor unit 300 in accordance with instructions from the display data processing unit 701 and the sensor data processing unit 703 to drive the backlight 307. Let

  When the data display / sensor device 100 includes a plurality of display / light sensor units 300, the display control unit 601 determines which display / light sensor unit 300 displays the display data from the data processing unit 700. When an instruction is received, the liquid crystal panel drive circuit 304 of the display / light sensor unit 300 is controlled according to the instruction. When the sensor control unit 602 receives an instruction from the data processing unit 700 as to which display / light sensor unit 300 is to scan the object, The sensor drive circuit 305 is controlled and a digital signal (DS) is received from the signal conversion circuit 306 of the display / light sensor unit 300 according to the instruction.

  Next, the data processing unit 700 will be described. The data processing unit 700 has a function as middleware that gives an instruction to the circuit control unit 600 based on a “command” received from the main control unit 800. Details of the command will be described later.

  The data processing unit 700 includes a display data processing unit 701 and a sensor data processing unit 703. When the data processing unit 700 receives a command from the main control unit 800, at least one of the display data processing unit 701 and the sensor data processing unit 703 depends on the value of each field (described later) included in the received command. One works.

  The display data processing unit 701 receives display data from the main control unit 800, and gives instructions to the display control unit 601 and the backlight control unit 603 according to the command received by the data processing unit 700, and displays the received display data. The image is displayed on the sensor built-in liquid crystal panel 301. The operation of the display data processing unit 701 according to the command will be described later.

  The sensor data processing unit 703 gives an instruction to the sensor control unit 602 and the backlight control unit 603 according to the command received by the data processing unit 700.

  The sensor data processing unit 703 receives image data from the sensor control unit 602 and stores the image data in the image data buffer 704 as it is. Then, the sensor data processing unit 703 performs “whole image data”, “partial image data”, and “coordinate data” based on the image data stored in the image data buffer 704 in accordance with the command received by the data processing unit 700. ] Is transmitted to the main control unit 800. The whole image data, partial image data, and coordinate data will be described later. The operation of the sensor data processing unit 703 according to the command will be described later.

  Next, the main control unit 800 executes an application program. The main control unit 800 reads the program stored in the storage unit 901 into a primary storage unit 902 configured by, for example, a RAM (Random Access Memory) and executes the program.

  An application program executed by the main control unit 800 causes the data processing unit 700 to display display data on the sensor built-in liquid crystal panel 301 or to scan an object on the sensor built-in liquid crystal panel 301. Send commands and display data. When “data type” is designated as a command, at least one of whole image data, partial image data, and coordinate data is received from the data processing unit 700 as a response to the command.

  The circuit control unit 600, the data processing unit 700, and the main control unit 800 can each be configured with a CPU (Central Processing Unit), a memory, and the like. The data processing unit 700 may be configured by a circuit such as an ASIC (application specific integrate circuit).

  Next, the storage unit 901 stores programs and data executed by the main control unit 800 as shown in the figure. The program executed by the main control unit 800 may be separated into an application-specific program and a general-purpose program that can be shared by each application.

  Next, the operation unit 903 receives an input operation of the user of the data display / sensor device 100. The operation unit 903 includes input devices such as a switch, a remote controller, a mouse, and a keyboard, for example. Then, the operation unit 903 generates a control signal corresponding to the user's input operation of the data display / sensor device 100, and transmits the generated control signal to the main control unit 800.

  As an example of the switch, a hardware switch such as a power switch 905 that switches power on and off and a user switch 906 to which a predetermined function is assigned in advance is assumed.

  In addition, the data display / sensor device 100 includes an external communication unit 907 for communicating with an external device by wireless / wired communication, an audio output unit 908 such as a speaker for outputting audio, and a microphone for inputting an audio signal. A voice input unit 909 or the like may be provided as appropriate.

(Command details)
Next, details of commands transmitted from the main control unit 800 to the data processing unit 700 will be described with reference to FIGS. 5 and 6. FIG. 5 is a diagram schematically illustrating an example of a command frame structure. FIG. 6 is a diagram for explaining an example of values that can be specified for each field included in the command and an outline thereof.

  As shown in FIG. 5, the commands are “header”, “data acquisition timing”, “data type”, “scan method”, “scan image gradation”, “scan resolution”, “scan panel”, “display panel”. "And" Reserve "fields. In each field, for example, values shown in FIG. 6 can be designated.

  The “header” field is a field indicating the start of a frame. As long as it is possible to identify the “header” field, the value of the “header” field may be any value.

  Next, the “data acquisition timing” field is a field for designating a timing at which data should be transmitted to the main control unit 800. In the “data acquisition timing” field, for example, values “00” (sense), “01” (event), and “10” (all) can be specified.

  Here, “sense” designates that the latest data is transmitted immediately. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “sense”, the latest data specified in the “data type” field is immediately updated to the main control unit 800. Send to.

  The “event” designates transmission at a timing when a change occurs in the image data received from the sensor control unit 602. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “event”, the image that receives the data specified in the “data type” field from the sensor control unit 602. The data is transmitted to the main control unit 800 at a timing when a change larger than a predetermined threshold occurs.

  “All” designates data transmission at a predetermined cycle. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “all”, the data designated in the “data type” field is transferred to the main control unit 800 at a predetermined cycle. Send to. The predetermined period coincides with the period in which the optical sensor circuit 32 performs scanning.

  Next, the “data type” field is a field for designating the type of data acquired from the sensor data processing unit 703. In the “data type” field, for example, values of “001” (coordinates), “010” (partial image), and “100” (entire image) can be specified. Furthermore, by adding these values, “coordinates” and “partial image” / “whole image” can be specified simultaneously. For example, when “coordinate” and “partial image” are specified at the same time, “011” can be specified.

  When the sensor data processing unit 703 receives a command whose value of the “data type” field is “whole image”, the sensor data processing unit 703 transmits the image data itself stored in the image data buffer 704 to the main control unit 800. The image data itself stored in the image data buffer 704 is referred to as “whole image data”.

  In addition, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 selects a portion where a change larger than a predetermined threshold has occurred from the image data received from the sensor control unit 602. A region to be included is extracted, and image data of the extracted region is transmitted to the main control unit 800. Here, the image data is referred to as “partial image data”. When a plurality of partial image data are extracted, the sensor data processing unit 703 transmits each extracted partial image data to the main control unit 800.

  Further, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 detects representative coordinates in the partial image data and indicates the position of the representative coordinates in the partial image data. The coordinate data is transmitted to the main control unit 800. The representative coordinates include, for example, the coordinates of the center of the partial image data, the coordinates of the center of gravity of the partial image data, and the like.

  In addition, the sensor data processing unit 703 also detects coordinates other than the representative coordinates included in the partial image data, and transmits coordinate data indicating the position of the coordinates in the partial image data or the entire image data to the main control unit 800. . Examples of coordinates other than the representative coordinates include coordinates corresponding to the pixels constituting the contour portion of the partial image data (referred to as “end point coordinates”).

  Next, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “coordinate”, the main control unit displays coordinate data indicating the position in the entire image data such as the representative coordinate and the end point coordinate. To 800. When a plurality of partial image data are extracted, the sensor data processing unit 703 detects representative coordinates and end point coordinates of the extracted partial image data in the entire image data, and the representative coordinates and Each piece of coordinate data indicating end point coordinates or the like is transmitted to the main control unit 800.

  Specific examples of the whole image data, the partial image data, and the coordinate data will be described later with reference to schematic diagrams.

  Next, the “scan method” field is a field for designating whether or not the backlight 307 is turned on at the time of executing the scan. In the “scan method” field, for example, values of “00” (reflection), “01” (transmission), and “10” (reflection / transmission) can be designated.

  “Reflection” designates that scanning is performed with the backlight 307 turned on. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “reflection”, the sensor data processing unit 703 performs sensor control so that the optical sensor driving circuit 305 and the backlight driving circuit 308 operate in synchronization. An instruction is given to the unit 602 and the backlight control unit 603.

  “Transmission” specifies that scanning is performed with the backlight 307 turned off. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “transparent”, the sensor control unit 602 operates the optical sensor driving circuit 305 and does not operate the backlight driving circuit 308. Instructions to the backlight control unit 603. Note that “reflection / transmission” specifies that scanning is performed using both “reflection” and “transmission”.

  Next, the “scanned image gradation” field is a field for designating gradations of the partial image data and the entire image data. In the “scanned image gradation” field, for example, values of “00” (binary) and “01” (multivalue) can be designated.

  When the sensor data processing unit 703 receives a command whose “scan image gradation” field value is “binary”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as monochrome data. .

  When the sensor data processing unit 703 receives a command whose “scanned image gradation” field value is “multivalued”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as multitone data. To do.

  Next, the “scan resolution” field is a field for designating the resolution of the partial image data and the entire image data. In the “resolution” field, for example, values of “0” (high) and “1” (low) can be designated.

  Here, “high” designates a high resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “high”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 with high resolution. For example, it is desirable to designate “high” for image data (image data such as a fingerprint) to be subjected to image processing such as image recognition.

  “Low” designates a low resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “low”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 at a low resolution. For example, it is desirable to specify “low” for image data (such as touched finger or hand image data) that only needs to be recognized.

  Next, in the “scan panel” field, when the data display / sensor device 100 includes a plurality of display / light sensor units 300, which display / light sensor unit 300 performs scanning of an object. This field is specified. In the “scan panel” field, for example, values “001” (first display / light sensor unit 300) and “010” (second display / light sensor unit 300) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when both the first and second display / light sensor units 300 are specified at the same time, “011” can be specified.

  Here, the sensor data processing unit 703 controls the photo sensor driving circuit 305 and the backlight driving circuit 308 of the designated display / light sensor unit 300 according to the value of the “scan panel” field of the received command. An instruction is given to the sensor control unit 602 and the backlight control unit 603.

  Next, the “display panel” field specifies which display / light sensor unit 300 displays the display data when the data display / sensor device 100 includes a plurality of display / light sensor units 300. It is a field to be. In the “display panel” field, for example, values of “001” (first display / light sensor unit 300) and “010” (second display / light sensor unit 300) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when both the first and second display / light sensor units 300 are specified at the same time, “011” can be specified.

  Here, for example, when the display data processing unit 701 receives a command whose value of the “display panel” field is the display / light sensor unit 300, the display / light sensor unit 300 displays the display / light sensor unit 300 to display the display data. An instruction is given to the display control unit 601 and the backlight control unit 603 so as to control the liquid crystal panel driving circuit 304 and the backlight driving circuit 308 of the optical sensor unit 300.

  Next, the “reserved” field is a field that is appropriately specified when it is necessary to further specify information other than information that can be specified in the above-described fields.

  Note that an application executed by the main control unit 800 does not need to use all the above-described fields when transmitting a command, and an invalid value (such as a NULL value) may be set for a field that is not used. .

  When the user wants to acquire coordinate data of a position touched with a finger or pen, a command specifying “coordinate” in the “data type” field is transmitted to the data processing unit 700. Therefore, it is desirable to specify “all” in the “data acquisition timing” field of the command to acquire coordinate data. Further, since it is only necessary to acquire coordinate data of the touched position, the scanning accuracy may not be high. Therefore, “low” may be specified as the value of the “resolution” field of the command.

  Further, when “coordinate” is specified in the “data type” field of the command, for example, when the user touches the sensor built-in liquid crystal panel 301 with a plurality of fingers or pens at the same time, the coordinate data of the touched position is used. Can be acquired (multi-point detection).

  When acquiring image data of an object such as a document, a command specifying “whole image” in the “data type” field is transmitted to the data processing unit 700. Since it is common to perform a scan in a stationary state, it is not necessary to periodically perform the scan. Therefore, in this case, it is desirable to designate “sense” or “event” in the “data acquisition timing” field. When scanning an object such as a document, it is desirable that the scanning accuracy is high so that the user can easily read the characters. Therefore, it is desirable to designate “high” in the “resolution” field.

(Whole image data / Partial image data / Coordinate data)
Next, the whole image data, the partial image data, and the coordinate data will be described with reference to FIG. The image data shown in FIG. 7A is image data obtained as a result of scanning the entire sensor built-in liquid crystal panel 301 when the object is not placed on the sensor built-in liquid crystal panel 301. 7B is image data obtained as a result of scanning the entire sensor-equipped liquid crystal panel 301 when the user touches the sensor-equipped liquid crystal panel 301 with the finger 64. The image data shown in FIG.

  When the user touches the sensor-equipped liquid crystal panel 301 with the finger 64, the amount of light received by the photosensor circuit 32 in the vicinity of the touch changes, so that the voltage output from the photosensor circuit 32 changes, and as a result In the image data generated by the sensor control unit 602, the brightness of the pixel value of the portion touched by the user changes.

  In the image data shown in FIG. 7B, the brightness of the pixel value of the portion corresponding to the user's finger 64 is higher than that in the image data shown in FIG. In the image data shown in FIG. 7B, the smallest rectangular area (area PP) that includes all pixel values whose lightness changes more than a predetermined threshold is “partial image data”.

  The image data indicated by the area AP is “whole image data”.

  Also, the coordinate data in the whole image data (area AP) of the representative coordinates Z of the partial image data (area PP) is (Xa, Ya), and the coordinate data in the partial image data (area PP) is (Xp, Yp). It is.

  In the present invention, an area composed of pixels whose lightness changes more than a predetermined threshold included in the partial image data is an area of the sensor built-in liquid crystal panel 301 selected by the finger (object) 64. This corresponds to (selection area 360).

  In the data display / sensor device 100, the coordinate axis is set with the horizontal direction of the sensor built-in liquid crystal panel 301 (see FIG. 1) when used by the user as the X axis and the vertical direction (ie, the vertical direction) as the Y axis. Information related to the XY coordinate axes is stored in the storage unit 901 (see FIG. 4). Note that the intersection of the X axis and the Y axis, that is, the origin of the coordinate axis may be fixed at the center of gravity of the panel surface of the sensor built-in liquid crystal panel 301, for example.

(Configuration of sensor built-in liquid crystal panel)
Next, the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309 of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 8 is a block diagram showing the main part of the display / light sensor unit 300, particularly the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309.

  The sensor built-in liquid crystal panel 301 includes a pixel circuit 31 for setting light transmittance (brightness) and an optical sensor circuit 32 that outputs a voltage corresponding to the intensity of light received by the sensor. The pixel circuit 31 is used as a general term for the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b corresponding to the red, green, and blue color filters, respectively.

  The pixel circuits 31 are arranged on the sensor built-in liquid crystal panel 301 in the column direction (vertical direction) and 3n in the row direction (horizontal direction). A set of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b is continuously arranged in the row direction (lateral direction). This set forms one pixel.

  In order to set the light transmittance of the pixel circuit 31, first, the high level voltage (TFT 33 is turned on) to the scanning signal line Gi connected to the gate terminal of the TFT (Thin Film Transistor) 33 included in the pixel circuit 31. Voltage). Thereafter, a predetermined voltage is applied to the data signal line SRj connected to the source terminal of the TFT 33 of the R pixel circuit 31r. Similarly, the light transmittance is also set for the G pixel circuit 31g and the B pixel circuit 31b. Then, by setting these light transmittances, an image is displayed on the sensor built-in liquid crystal panel 301.

  Next, the photosensor circuit 32 is arranged for each pixel. One pixel may be arranged in the vicinity of each of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b.

  In order for the optical sensor circuit 32 to output a voltage corresponding to the light intensity, first, the sensor readout line RWi connected to one electrode of the capacitor 35 and the anode terminal of the photodiode 36 are connected. A predetermined voltage is applied to the sensor reset line RSi. In this state, when light is incident on the photodiode 36, a current corresponding to the amount of incident light flows through the photodiode 36. Then, according to the current, the voltage at the connection point (hereinafter referred to as connection node V) between the other electrode of the capacitor 35 and the cathode terminal of the photodiode 36 decreases. When the power supply voltage VDD is applied to the voltage application line SDj connected to the drain terminal of the sensor preamplifier 37, the voltage at the connection node V is amplified and output from the source terminal of the sensor preamplifier 37 to the sensing data output line SPj. Based on the output voltage, the amount of light received by the optical sensor circuit 32 can be calculated.

  Next, the liquid crystal panel drive circuit 304, the optical sensor drive circuit 305, and the sensor output amplifier 44, which are peripheral circuits of the sensor built-in liquid crystal panel 301, will be described.

  The liquid crystal panel drive circuit 304 is a circuit for driving the pixel circuit 31, and includes a scanning signal line drive circuit 3041 and a data signal line drive circuit 3042.

  The scanning signal line driving circuit 3041 sequentially selects one scanning signal line from the scanning signal lines G1 to Gm for each line time based on the timing control signal TC1 received from the display control unit 601, and A high level voltage is applied to the selected scanning signal line, and a low level voltage is applied to the other scanning signal lines.

  Based on the display data D (DR, DG, and DB) received from the display controller 601, the data signal line driver circuit 3042 generates a predetermined voltage corresponding to the display data for one row for each line time. The data signal lines SR1 to SRn, SG1 to SGn, and SB1 to SBn are applied (line sequential method). Note that the data signal line driver circuit 3042 may be driven by a dot sequential method.

  The optical sensor driving circuit 305 is a circuit for driving the optical sensor circuit 32. Based on the timing control signal TC2 received from the sensor control unit 602, the optical sensor driving circuit 305 selects a predetermined sensor readout signal line from the sensor readout signal lines RW1 to RWm for each line time. A read voltage is applied, and a voltage other than a predetermined read voltage is applied to the other sensor read signal lines. Similarly, based on the timing control signal TC2, a predetermined reset voltage is applied to the sensor reset signal line selected from the sensor reset signal lines RS1 to RSm for each line time, and the others. A voltage other than a predetermined reset voltage is applied to the sensor reset signal line.

  The sensing data output signal lines SP1 to SPn are grouped into p groups (p is an integer of 1 to n), and the sensing data output signal lines belonging to each group are connected via a switch 47 that is sequentially turned on in time division. And connected to the sensor output amplifier 44. The sensor output amplifier 44 amplifies the voltage from the group of sensing data output signal lines connected by the switch 47 and outputs the amplified voltage to the signal conversion circuit 306 as sensor output signals SS (SS1 to SSp).

(Example of more detailed configuration of data display / sensor device)
Next, a more detailed configuration of the data display / sensor device 100 will be described with reference to FIG. Here, for easy understanding, the operations of the data processing unit 700 and the circuit control unit 600 (see FIG. 4) located between the main control unit 800 and the display / light sensor unit 300 are described. Omitted. However, to be precise, when displaying data and scanning an object, each unit of the main control unit 800 transmits a command to the data processing unit 700, and the data processing unit 700 controls the circuit control unit 600 based on the command. Then, the circuit control unit 600 transmits a signal to the display / light sensor unit 300. Further, the main control unit 800 acquires the entire image data, the partial image data, and the coordinate data from the data processing unit 700 as a response to the command transmitted to the data processing unit 700.

  FIG. 9 is a block diagram showing the configuration of the data display / sensor device 100 according to the present embodiment, centering on the main control unit 800 and the storage unit 901. As shown in FIG. 9, the main control unit 800 includes a selection region detection unit (selection region detection unit) 12, a region size detection unit (region size detection unit) 13, and a movement direction detection unit (movement direction detection unit) 14. , An input control unit (input control means) 15, an input recognition unit 16, and an image switching unit 17. The storage unit 901 includes a reference value storage unit (storage unit) 21 and an image data storage unit 23.

  Next, an example of the operation of the data display / sensor device 100 will be described with reference to FIGS. 9 to 11C. FIG. 10 is a flowchart for explaining the operation of the data display / sensor device 100 according to the present embodiment.

  In step S1, the data display / sensor device 100 displays, as an initial setting, an application screen, that is, a screen including an input key 350 for accepting an input with the finger 64 on the sensor built-in liquid crystal panel 301 (FIG. See also)). Note that step S <b> 1 may be started as necessary, for example, when the application is started.

  Next, in step S2, the data display / sensor device 100 displays an area selected by the finger 64 or the dust cloth 65 (object) on the sensor built-in liquid crystal panel 301 (referred to as a “selection area”: the selection area 360 or the like). Corresponding (see FIG. 7B)) is detected. In one embodiment, the selection area detection unit 12 acquires the coordinate data of the representative coordinates Z and other coordinates included in the selection area from the sensor data processing unit 703, and uses these coordinate data in the area size detection unit 13. Used for calculation processing.

  More specifically, the selection area detection unit 12 sends the above-mentioned command with “data type” as “coordinate” and “data acquisition timing” as “event” to the data processing unit 700. The selection area detection unit 12 recognizes the position of the selection area in the display surface of the sensor built-in liquid crystal panel 301 based on the coordinate data obtained from the sensor data processing unit 703 as a response to the command. Next, the coordinate data is subjected to an area calculation process in the area size detection unit 13. When the selection area detection unit 12 determines the data acquisition timing and the change in the acquired data, the “data acquisition timing” of the command may be “all” or “sense”.

  Step S2 is performed every time an object approaches or comes into contact with the liquid crystal panel 301 with a built-in sensor.

  Next, in step S3, the data display / sensor device 100 calculates the area as the width of the selected region. In one embodiment, the area size detection unit 13 determines the number of pixels corresponding to the selected area based on all end point coordinate data of the selected area provided from the selection area detection unit 12. Here, the photosensor circuit 32 is arranged for each predetermined number of pixels (N), and a plurality of pixels are formed in a matrix. By integrating the number of corresponding optical sensor circuits 32 and the above N and S, the area of the selected region can be calculated. For the purpose of calculating the area of the selected region more accurately, a configuration in which the photosensor circuit 32 is arranged for each pixel is more preferable.

  Next, in step S4, the data display / sensor device 100 determines whether or not the area of the selected region detected in step S3 is equal to or larger than a predetermined reference value. In one embodiment, the input control unit 15 compares the predetermined reference value provided from the reference value storage unit 21 with the area of the selected region detected in step S3.

  Here, the “predetermined reference value” stored in the reference value storage unit 21 is an input by an object used for input to the sensor built-in liquid crystal panel 301 (referred to as an “input object”), and the input object. This is a threshold value of the area of the selected region for distinguishing input from a larger object (referred to as “non-input object”).

  Therefore, the “predetermined reference value” is set to a value larger than the area of the selected region that is normally assumed when the input object approaches or comes into contact with the sensor built-in liquid crystal panel 301. In addition, the “predetermined reference value” is a value smaller than the area of the selection region that is normally assumed when the non-input target (such as the dust cloth 65) approaches or comes into contact with the liquid crystal panel 301 with a built-in sensor. preferable. That is, the “predetermined reference value” includes the assumed type of input object, the assumed type of non-input object, the installation environment of the data display / sensor device 100 having the sensor built-in liquid crystal panel 301, and the like. It is a value set appropriately according to the above.

  When an input using a plurality of types of input objects is assumed, in one example, the reference value storage unit 21 sets a predetermined reference value corresponding to each type of the input object (finger, touch pen, etc.). It may be stored. When the sensor built-in liquid crystal panel 301 is in the finger operation mode, the predetermined reference value corresponding to the finger is input from the reference value storage unit 21 and the predetermined reference value corresponding to the touch pen is input from the reference value storage unit 21. It is good also as a structure provided with respect to the part 15. FIG. Alternatively, among the plurality of types of input objects, the above-mentioned “predetermined reference value” is set based on the input object having the largest contact area with the panel surface (display surface / input surface) of the sensor built-in liquid crystal panel 301. You can also set one.

  If it is determined in step S4 that the area of the selected region is not equal to or greater than the predetermined reference value (that is, less than the predetermined reference value), the application screen of the sensor built-in liquid crystal panel 301 is an input object (such as a finger 64). It is assumed that it was selected by. Accordingly, the process proceeds to step S5, and the data display / sensor device 100 accepts the input to the application screen as valid. In one embodiment, the input recognition unit 16 receives the determination result by the input control unit 15 in step S3 and determines that the input by the object is valid. Then, the determination result by the input recognition unit 16 is provided to the data processing unit 700, and an application corresponding to the input is executed. When step S5 ends, the data display / sensor device 100 returns to step S2 and waits for a new input on the application screen.

  On the other hand, if it is determined in step S4 that the area of the selected region is equal to or larger than the predetermined reference value, it is assumed that the application screen of the sensor built-in liquid crystal panel 301 is selected by a non-input object (such as a dust cloth 65). . Accordingly, the process proceeds to step S6, and the data display / sensor device 100 determines that the input to the application screen by the object is invalid. In one embodiment, the input control unit 15 determines that the input to the application screen is invalid, and provides the determination result to the data processing unit 700. As a result, the data display / sensor device 100 stops executing the application and switches the mode from the normal mode to the cleaning mode.

  In step S6, the data display / sensor device 100 further displays a screen (referred to as an “input invalid screen”) for notifying that the input to the sensor built-in liquid crystal panel 301 is invalid on the panel surface of the sensor built-in liquid crystal panel 300 (refer to FIG. On the display surface (see FIG. 1B). In one embodiment, the input control unit 15 provides the image switching unit 17 with a determination result indicating that the input by the object is invalid. In response to the determination result, the image switching unit 17 supplies the data processing unit 700 with the image data corresponding to the input invalid screen stored in the image data storage unit 23. As a result, the data display / sensor device 100 displays the input invalid screen on the panel surface of the sensor built-in liquid crystal panel 300.

  During the cleaning mode (after step S6), the data display / sensor device 100 continues to determine that the input to the sensor built-in liquid crystal panel 301 by the object is invalid. In parallel, in step S7, the data display / sensor device 100 constantly detects a region (selected region) selected by the object on the sensor built-in liquid crystal panel 301 displaying the input invalid screen. In one embodiment, the selection area detection unit 12 acquires the coordinate data of the representative coordinates Z and other coordinates included in the selection area from the sensor data processing unit 703, and uses these coordinate data in the area size detection unit 13. Used for calculation processing. Note that step S7 is realized by the same operation as step S2.

  Next, in step S8, the data display / sensor device 100 calculates the area of the selected region detected in step S7. Note that step S8 is realized by the same operation as step S3.

  Fig.11 (a)-FIG.11 (c) show an example of the image data of the selection area | region used as the object of detection and area calculation in said step S7 and S8. The image data shown in FIGS. 11A and 11B is image data obtained as a result of scanning the entire sensor-equipped liquid crystal panel 301 while the panel surface of the sensor-equipped liquid crystal panel 301 is being cleaned with the dust cloth 65. . Further, the image data shown in FIG. 11C is image data obtained as a result of scanning the entire sensor-equipped liquid crystal panel 301 when the cleaning of the panel surface is finished and the dust cloth 65 is separated from the panel surface. is there.

  When the user touches the sensor built-in liquid crystal panel 301 with the dust cloth 65, the amount of light received by the photosensor circuit 32 in the vicinity of the touch changes, so that the voltage output from the photosensor circuit 32 changes, and as a result In the image data generated by the sensor control unit 602, the brightness of the pixel value of the portion touched by the user changes (see also FIG. 4).

  In the present invention, an area composed of pixels whose brightness has changed more than a predetermined threshold is an area of the sensor built-in liquid crystal panel 301 selected by the dust cloth (object) 65 (“selection area”: selection area 360a). -It corresponds to 360b). FIG. 11A shows, for example, image data obtained in a state in which cleaning is performed while firmly pressing the dust cloth 65 against the sensor built-in liquid crystal panel 301, or in a state in which the predetermined threshold is set more loosely. Further, FIG. 11B is obtained, for example, in a state in which the sensor built-in liquid crystal panel 301 is cleaned while supporting the dust cloth 65 with the belly of the finger and a part of the palm, or in a state in which the predetermined threshold is set more strictly. Image data.

  In step S8, the data display / sensor device 100 calculates the area of the selection region 360a in the case shown in FIG. 11A, and the area of the plurality of selection regions 360b in the case shown in FIG. In the case where the total value is calculated and shown in FIG. 11C, since there is no selection area by the object, the area of the selection area is set to 0 (zero). Next, the process proceeds to step S9.

  In step S9, the data display / sensor device 100 determines whether or not the area of the selected region detected in step S8 is equal to or larger than a predetermined reference value. In one embodiment, the input control unit 15 compares the predetermined reference value provided from the reference value storage unit 21 with the area of the selected region detected in step S8. Note that step S9 is realized by the same operation as step S4, and the “predetermined reference value” may be the same value as step S4.

  If it is determined in step S9 that the area of the selected region is equal to or greater than a predetermined reference value, it is assumed that the input invalid screen of the sensor built-in liquid crystal panel 301 is continuously selected by the non-input object (such as the dust 65). Is done. For example, it is assumed that cleaning of the sensor built-in liquid crystal panel 301 by the dust cloth 65 is continued. Accordingly, the process returns to step S6, and the data display / sensor device 100 continues the state in which the input to the input invalid screen by the object is determined to be invalid. For example, while the state shown in FIG. 11A or FIG. 11B continues (during cleaning), the steps from step S6 to step S9 are repeated.

  On the other hand, if it is determined in step S9 that the area of the selected region is not equal to or larger than the predetermined reference value (that is, less than the predetermined reference value), the data display / sensor device 100 has finished cleaning with the dust cloth 65. Then, the process proceeds to step S10, and the application image is displayed again on the panel surface (display surface) of the sensor built-in liquid crystal panel 301 (see FIG. 1A). For example, if the state shown in FIG. 11C is reached, it is considered that the cleaning has been completed, and the process proceeds to step S10. In one embodiment, the input control unit 15 provides the determination result in step S <b> 9 to the image switching unit 17. In response to the determination result, the image switching unit 17 supplies the data processing unit 700 with the image data corresponding to the application screen stored in the image data storage unit 23. As a result, the data display / sensor device 100 displays the application screen on the panel surface of the sensor-equipped liquid crystal panel 300. Further, when the input control unit 15 provides the determination result in step S9 to the data processing unit 700, the data display / sensor device 100 determines that the input to the sensor built-in liquid crystal panel 300 is invalid. finish.

  When step S10 ends, the data display / sensor device 100 returns to step S2 and waits for a new input on the application screen.

  Here, the application screen displayed on the sensor built-in liquid crystal panel 300 in steps S1 and S10 is exemplified, but the present invention is not particularly limited thereto. For example, a configuration in which at least a part of the input keys is printed in advance on the surface of the sensor built-in liquid crystal panel may be employed. Note that steps S1 and S10 are omitted when an input key printed in advance is used.

  Although not particularly limited to this application, the data display / sensor device 100 according to the present invention is suitable, for example, as a POS terminal, a service station (referred to as “SS”) outside a gas station, or the like. In particular, in the SS industry and restaurants, there is a high possibility that the input screen will be heavily soiled. When cleaning dirt on a touch panel type input screen with a POS terminal or the SS external machine, a cloth or a cloth is used. At this time, in the conventional configuration, if the application is cleaned without turning off the power supply of the apparatus, there is a possibility that some input is generated in the application and erroneous operation is performed. Therefore, the input screen is cleaned by shifting to a state in which touch input to the apparatus is disabled or by turning off the apparatus. However, the device cannot be turned off during 24 hours. Further, when the power is turned off, it takes time for the termination / startup process. Furthermore, in the case of a machine having only an input device with a touch panel, there is a problem that it is difficult to return to the effective state when the touch input is disabled.

  On the other hand, as described above, the data display / sensor device 100 according to the present invention automatically shifts to the cleaning mode when an input having a spread larger than a predetermined threshold is detected on the panel surface of the sensor built-in liquid crystal panel 301, and the application screen is displayed. Disable input to. At this time, the data display / sensor device 100 displays on the panel surface a cleaning mode and / or a display indicating that all inputs are invalid.

  Further, the data display / sensor device 100 automatically cancels the cleaning mode and returns to the application screen when there is no input to the panel surface after the transition to the cleaning mode. That is, the data display / sensor device 100 automatically enters the input invalid mode and automatically enters the input valid mode. Therefore, an erroneous operation can be prevented in the operation by the user. In addition, the user does not have to turn off the power of the data display / sensor device 100 even during 24-hour business hours.

(Modification of data display / sensor device)
In the data display / sensor device 100, in step S3 and step S8 in the flow shown in FIG. 10, the area size detection unit 13 detects the number of inputs by the object to the sensor built-in liquid crystal panel 301 and selects the selected area. It is good also as composition which asks for the spread of. In other words, the area size detection unit 13 1) obtains the number of object images detected at each position of the sensor built-in liquid crystal panel 301, or 2) divides the sensor built-in liquid crystal panel 301 into a plurality of divided areas. In such a case, it is possible to obtain the spread of the selected region by acquiring the number of the divided regions selected by the object. In addition, in order to determine the spread of the selected region, the process of either 1) or 2) is also involved when the area of the selected region is calculated as described above.

  The number of object images detected at each position of the sensor-equipped liquid crystal panel 301 is obtained by setting a plurality of fixed points on the sensor-equipped liquid crystal panel 301 and obtaining information on how many fixed points the object image has been detected. To do. As an example, when the photodiode 6 is provided for each pixel of the liquid crystal panel 301 with a built-in sensor, each pixel may be a fixed point. Alternatively, when a plurality of pixels (for example, 10 pixels × 10 pixels) are regarded as one unit, a predetermined pixel (for example, one pixel at the upper left corner) included in the unit may be set as a fixed point in each unit. The data display / sensor device 100 then performs normal operation with the finger 64 or the like based on information on the number of detected images of the target object (the number of fixed points at which the image is detected, that is, the number of inputs by the target object). It is discriminated whether input is performed or cleaning or the like with a dust cloth 65 or the like is performed.

  In addition, when the sensor built-in liquid crystal panel 301 is divided into a plurality of divided areas, acquisition of the number of divided areas selected by the object means that an image of the object is detected by an arbitrary pixel included in the divided area. In this case, it is assumed that the divided area is selected by the object, and the number of such divided areas is acquired. The data display / sensor device 100 then performs normal input with the finger 64 or the like based on the acquired information on the number of divided regions (the number of divided regions selected by the object, that is, the number of inputs by the object). It is determined whether or not cleaning is performed with a dust cloth 65 or the like.

  For example, in the data display / sensor apparatus 100, the panel surface (display surface / input surface) of the sensor built-in liquid crystal panel 301 is divided into areas in a grid shape, and one input is recognized for each divided area. Then, the area size detection unit 13 detects the number of inputs by the object corresponding to the selection areas 360, 360a, and 360b (see FIGS. 7B, 11A, and 11B). . Here, as for the size of the divided area, for example, one input is recognized in the case of an input with a finger 64 or the like (so-called single touch state), but a plurality of inputs are input in the case of an input with a cloth 65 or the like larger than the finger 64. Is appropriately set so that is recognized (so-called multi-touch state). In this case, when an object having a larger area than the belly of the finger 64 approaches or comes into contact with the sensor built-in liquid crystal panel 301, the area size detection unit 13 recognizes a plurality of inputs.

  Next, in step S4 and step S9 in the flow shown in FIG. 10, the data display / sensor device 100 determines whether or not the number of inputs by the object detected in step S3 is greater than or equal to a predetermined reference value. judge. In one embodiment, the input control unit 15 compares the predetermined reference value provided from the reference value storage unit 21 with the number of inputs by the object detected in step S3 and step S8.

  Here, the “predetermined reference value” stored in the reference value storage unit 21 is an input by an object used for input to the sensor built-in liquid crystal panel 301 (“input object”) and larger than the input object. This is a threshold value of the number of inputs by the object for distinguishing from the input by the object (“object for non-input”).

  Therefore, the “predetermined reference value” is set to a value larger than the number of inputs normally assumed when the input object approaches or touches the sensor built-in liquid crystal panel 301. In addition, the “predetermined reference value” is preferably a value smaller than the number of inputs normally assumed when a non-input object (such as the dust cloth 65) approaches or comes into contact with the sensor built-in liquid crystal panel 301. . That is, the “predetermined reference value” includes the assumed type of input object, the assumed type of non-input object, the installation environment of the data display / sensor device 100 having the sensor built-in liquid crystal panel 301, and the like. It is a value set appropriately according to the above.

(Other variations of data display / sensor device)
In the flow shown in FIG. 10, the data display / sensor device 100 is configured to display the object with respect to the sensor built-in liquid crystal panel 301 at least one of steps S4 and S6 and steps S9 and S6. The moving direction may be detected, and it may be determined whether to proceed to step S6 based on the detection result.

  In one embodiment, the movement direction detection unit (movement direction detection unit) 14 illustrated in FIG. 9 acquires the entire image data from the sensor data processing unit 703, and based on the entire image data, the object (finger 64 or dust cloth 65). )) Is detected.

  More specifically, the movement direction detection unit 14 sends a command with “data type” set to “whole image” and “data acquisition timing” set to, for example, “sense” to the data processing unit 700, and the whole image data is sent. Get continuously. Next, the movement direction detection unit 14 detects information related to the movement direction of the object in the display surface (in the panel surface) of the sensor built-in liquid crystal panel 301 based on the acquired entire image data. Alternatively, the movement direction detection unit 14 sends a command with “data type” as “coordinate” and “data acquisition timing”, for example, “sense” to the data processing unit 700, and continues the representative coordinates of the selected region. To get. Next, the movement direction detection unit 14 detects information related to the movement direction of the object in the display surface of the sensor built-in liquid crystal panel 301 based on the change in the representative coordinates. Next, the movement direction detection unit 14 provides information regarding the movement direction of the object to the input control unit 15.

  If it is determined in step S4 or step S9 that the area of the selected region is equal to or larger than a predetermined reference value, the input control unit 15 indicates that the moving direction of the object is 1) reciprocating movement or repetitive movement. Or 2) Judge whether the movement is other than that.

  And when the input control part 15 judges that the moving direction of a target object is a reciprocating movement or a repetitive movement, since the possibility that it is cleaning is very high, it progresses to step S6. On the other hand, when the input control unit 15 determines that the moving direction of the target object is not reciprocal movement or repetitive movement, it is determined that the object is not being cleaned, and the process proceeds to step S5 or step S10.

  The “reciprocating movement” means that the object moves in one direction on the panel surface of the sensor built-in liquid crystal panel 301 and then moves in the direction opposite to the one direction. For example, on the panel surface of the sensor built-in liquid crystal panel 301, the object moves from the upper side to the lower side and then moves from the lower side to the upper side, or the object moves from the left side to the right side and then continues. A movement that moves from right to left. “Repeated movement” means that movement in one direction is repeated a plurality of times. For example, the movement of the object moves from the upper side to the lower side twice or more on the panel surface of the sensor built-in liquid crystal panel 301, or the movement of the object moves in a circle twice or more times.

  The above-described “reciprocating movement” and “repetitive movement” frequently appear during cleaning using the dust cloth 65. Therefore, according to the configuration of the modified example described here, it is possible to automatically invalidate the input according to the input status on the input screen while more reliably determining whether or not the cleaning is being performed. .

(Program and recording medium)
Finally, the circuit control unit 600, the data processing unit 700, and the main control unit 800 included in the data display / sensor device 100 may be configured by hardware logic. Alternatively, it may be realized by software using a CPU (Central Processing Unit) as follows.

  That is, the circuit control unit 600, the data processing unit 700, and the main control unit 800 are a CPU such as an MPU that executes instructions of a program that realizes each function, a ROM (Read Only Memory) that stores the program, and executes the program. A RAM (Random Access Memory) that expands into a possible format and a storage device (recording medium) such as a memory that stores the program and various data are provided.

  The object of the present invention is not limited to the case where the program memory of the circuit control unit 600, the data processing unit 700, and the main control unit 800 is fixedly supported, but the program code of the above program (execution format program, intermediate code) Also, a recording medium in which a program or a source program is recorded is supplied to the data display / sensor device 100, and the data display / sensor device 100 reads and executes the program code recorded in the recording medium. Achievable.

  The recording medium is not limited to a specific structure or type. That is, the recording medium includes, for example, a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. System, a card system such as an IC card (including a memory card) / optical card, or a semiconductor memory system such as a mask ROM / EPROM / EEPROM / flash ROM.

  The object of the present invention can be achieved even if the circuit control unit 600, the data processing unit 700, and the main control unit 800 (or the data display / sensor device 100) are configured to be connectable to a communication network. In this case, the program code is supplied to the circuit control unit 600, the data processing unit 700, and the main control unit 800 via the communication network. The communication network only needs to be able to supply program codes to the circuit control unit 600, the data processing unit 700, and the main control unit 800, and is not limited to a specific type or form. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication network, etc. may be used.

  The transmission medium constituting the communication network may be any medium that can transmit the program code, and is not limited to a specific configuration or type. For example, even with wired lines such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL (Asymmetric Digital Subscriber Line) line, infrared rays such as IrDA and remote control, Bluetooth (registered trademark), 802.11 wireless, HDR, mobile phone It can also be used by radio such as a telephone network, a satellite line, and a terrestrial digital network. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The present invention has been specifically described above based on the embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims.

  The present invention can be used in various information devices.

6 Photodiode 13 Area Area Detection Unit (Area Area Detection Means)
14 Movement direction detection part (movement direction detection means)
15 Input control unit (input control means)
21 Reference value storage unit (storage means)
64 fingers (object)
65 Dust cloth (object)
100 Data display / sensor device (input device)
301 Liquid crystal panel with built-in sensor (planar member)
360 selection area (area on the planar member selected by the object)
360a Selection area (area on the planar member selected by the object)
360b selection area (area on the planar member selected by the object)

Claims (7)

A planar member that detects an image of the object and receives input from the object;
A selection area detecting means for detecting an area on the planar member selected by the object from an image of the object detected by the planar member;
Area detection means for detecting the spread of the area detected by the selection area detection means;
It is determined whether or not the spread of the region detected by the region width detection means is greater than or equal to a predetermined reference value. If the spread of the region is greater than or equal to a predetermined reference value, the planar shape by the object is determined. Input control means for disabling input to the member;
An input device comprising:   The area width detecting means obtains the number of detections of the image of the object at each position on the planar member, or the object in the case where the planar member is divided into a plurality of divided areas. The input device according to claim 1, wherein the spread of the area is detected by acquiring the number of the selected divided areas.   After the input to the planar member is invalidated, the input control means cancels the invalid state of input to the planar member when the spread of the region becomes less than the predetermined reference value. The input device according to claim 1 or 2. The planar member further has a function of displaying an image,
When the input to the planar member by the object is invalidated by the input control means, an image notifying that the input is invalid is displayed on the planar member. The input device according to any one of 3. A moving direction detecting means for detecting a moving direction of the object relative to the planar member;
The movement of the object detected by the moving direction detection means is either a reciprocating movement or a repetitive movement, and the spread of the area detected by the area width detection means is equal to or greater than a predetermined reference value. If
The input device according to claim 1, wherein the input control unit invalidates an input to the planar member.   The planar member includes a photodiode group that detects a light reception amount at each position on the planar member, and detects an image of the object based on a change in the light reception amount detected by the photodiode group. The input device according to any one of claims 1 to 5, characterized in that: An input control method in an input device including a planar member that detects an image of an object and receives an input from the object,
Including the following steps (1) to (3) performed by the input device:
(1) a selection area detecting step of detecting an area on the planar member selected by the object from the image of the object detected by the planar member;
(2) a region width detection step for detecting the spread of the region detected in the selection region detection step;
(3) It is determined whether or not the spread of the region detected in the region width detection step is greater than or equal to a predetermined reference value, and if the spread of the region is greater than or equal to a predetermined reference value, An input control step for invalidating the input to the planar member,
An input control method characterized by the above.

Images