JP2010118015A - Numerical value input device, numerical value input method, numerical value input program, and computer-readable recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a numerical value input device for correctly and easily inputting a numerical value and a coordinate by using a touch panel, and selecting a menu, using the numerical value input. <P>SOLUTION: The numerical value input device includes: a data acquiring part 820 for detecting the areas of an image on a liquid crystal panel with a built-in sensor, based on the image or coordinate data of a finger detected by the liquid crystal panel with the built in sensor; and a coordinate data counting part 830 for counting the number of areas detected by the data acquiring part 820, and recognizing the counted number of the areas as an input numerical value which is input by a user. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention is capable of simultaneously displaying an image and reading an object, and in particular, a numerical value input device, a numerical value input method, a numerical value input program, and a computer-readable recording capable of accurately inputting a numerical value by a simple operation. It relates to the medium.

  2. Description of the Related Art In recent years, in portable information terminals such as mobile phones and portable game devices, devices having a display unit for displaying images are increasing. In these devices, in addition to the function of displaying an image, the display unit often has a so-called touch panel function that can detect a position pointed (touched) by a user with a finger or the like.

  In these devices, when the user touches the touch panel with a finger or the like, an image desired by the user can be displayed on the display unit.

  When selecting a plurality of items displayed on the display unit, the user touches a position where the desired selection item is displayed with a finger or selects a desired selection item that is displayed. The method of entering is generally used.

  Patent Document 1 discloses an image display device that can change the number of pages to be turned based on the number of fingers touching the touch panel.

In the image display device of Patent Document 1, a difference value between the maximum value and the minimum value of coordinates in an area where a plurality of fingers are in contact is set on the touch panel in association with the number of fingers. . Then, the number of pages to be turned is changed according to the recognized number of fingers.
JP-A-8-76926 (Publication date: March 22, 1996)

  However, the image display device described in Patent Document 1 does not recognize the number of fingers touching the touch panel, but estimates the number of fingers from the size of the contact area. Can not. That is, there is a problem that the input numerical value is not accurate because it varies depending on the user, such as the size of the finger and the interval between a plurality of fingers in contact.

  In addition, when selecting a desired selection item from among a plurality of displayed selection items, the user frequently uses the conventional method of directly touching a portion of the display unit where the desired selection item is displayed. There is a problem that the operability is poor, especially when the finger needs to be moved, especially when the screen is enlarged.

  Furthermore, in the method of directly inputting a numerical value in order to select a desired selection item, it is troublesome to input the numerical value, and this method also has a problem that the operability is poor.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a numerical value input device, a numerical value input method, a numerical value input program, and a computer-readable recording capable of accurately and easily inputting numerical values. To provide a medium.

  In order to solve the above problems, the numerical input device of the present invention is based on a planar member that detects a nearby image and an image of the object detected by the planar member, and the image on the planar member. Area detecting means for detecting the area, and input numerical value recognizing means for counting the number of the areas detected by the area detecting means and recognizing the counted number of the areas as an input numerical value input by a user. It is characterized by that.

  Further, in order to solve the above problems, the numerical input method of the present invention is an image of an object detected by the planar member in the numerical input method of the numerical input device provided with the planar member that detects a nearby image. Based on the area detection step for detecting the area of the image on the planar member, the number of the areas detected in the area detection step is counted, and the number of the counted areas is input by the user. And an input numerical value recognition step for recognizing the input numerical value.

  With the above configuration, the area detection unit detects an image of the object detected by the planar member. The input numerical value recognition means counts the number of the areas detected by the area detection means, and recognizes the counted number of the areas as an input numerical value input by the user.

  That is, the input numerical value recognition means can recognize the input numerical value corresponding to the number of objects, so that, for example, compared with the case where the input numerical value is recognized based on the size of the object that touches the touch pad or the like. Thus, the input numerical value can be accurately recognized.

  Further, when changing the input numerical value recognized by the input numerical value recognition means, it is only necessary to change the number of objects close to the planar member, and therefore it is easy to input numerical values and change the input numerical values.

  Thus, according to the above configuration, it is possible to provide a numerical value input device capable of inputting numerical values accurately and easily.

  The planar member of the numerical input device of the present invention further displays an image, and includes display data control means for displaying an image including a plurality of selection items selectable by the user on the planar member, The display data control unit causes the planar member to display an image in which the selection item associated with the input numerical value recognized by the input numerical value recognition unit among the plurality of selection items is selected. Is preferred.

  According to the above configuration, in order to select a selection item desired by the user from among a plurality of selection items displayed on the planar member, as many objects as the number corresponding to the desired selection item are selected. What is necessary is just to make it adjoin to the said planar member.

  Thereby, the input numerical value recognition means recognizes the number of the target members brought close to the planar member by the user as an input numerical value. And the said display data control means can display the image which made the selection item matched with the said input numerical value recognized by the said input numerical value recognition means a selection state on the said planar member.

  That is, the numerical input device can selectively display a selection item desired by the user.

  As described above, according to the above configuration, since numerical input can be performed accurately and easily, it is possible to accurately select a desired selection item from among a plurality of displayed selection items and easily change the selection item to be selected. It can be carried out.

  The area detecting means of the numerical input device of the present invention comprises a storage means for detecting the area at a predetermined timing and storing the input numerical values in the order recognized by the input numerical value recognizing means. The means acquires the latest input numerical value stored in the storage means when the area detection means does not detect the area, and executes the function of the selection item associated with the acquired input numerical value. It is preferable.

  According to the above configuration, in order to execute the function of the selection item, the user inputs the numerical value to the numerical value input device of the present invention, and the same number of objects as the input numerical value associated with the selection item. An object may be brought close to the planar member, and the object may be separated to a distance at which the planar member cannot detect an image of the approached object.

  Thus, the latest input numerical value is stored in the storage means. The display data control means acquires the latest input numerical value stored in the storage means when the area detection means does not detect the area. Thereby, the display data control means can execute the function of the selection item associated with the acquired input numerical value.

  According to the above configuration, since the numerical value can be input accurately and easily, the function of the selection item associated with the input numerical value can be accurately and easily executed.

  The numerical input device of the present invention calculates a movement amount and a movement direction of the representative coordinates when the area moves, the coordinate detection means for detecting the representative coordinates in the area detected by the area detection means, and the movement amount And a coordinate control means for outputting the movement direction to the display data control means. The display data control means selects the selection item based on the movement amount and movement direction of the representative coordinates output from the coordinate control means. It is preferable to move.

  According to the above configuration, when the user moves the selection item, the user moves the object close to the planar member in parallel with the planar member.

  Thereby, the coordinate control means calculates the movement amount and movement direction of the representative coordinates detected by the coordinate detection means. The display data control means moves the selection item based on the movement amount and movement direction of the representative coordinates from the coordinate control means.

  Thus, according to the said structure, the selection item currently displayed on the said planar member can be moved with the movement of the said target object.

  For this reason, it is possible to provide a numerical input device in which selection items can be easily moved.

  Further, a program for operating the numerical input device according to the present invention, which is characterized in that the computer is driven as each of the above-mentioned means, and a computer-readable recording medium storing the program are also included in the present invention. Included in the category.

  The numerical input device of the present invention includes a planar member that detects an image in the vicinity, and a region detecting unit that detects a region of the image on the planar member based on an image of an object detected by the planar member. And an input numerical value recognizing unit that counts the number of the regions detected by the region detecting unit and recognizes the counted number of the regions as an input numerical value input by the user.

  The numerical value input method of the present invention is the numerical value input method of a numerical value input device provided with a planar member for detecting a nearby image, wherein the planar member is based on the image of the object detected by the planar member. An area detection step for detecting an area of the image on the upper side, an input numerical value for counting the number of the areas detected in the area detection step and recognizing the counted number of the areas as an input numerical value input by a user A recognition step.

  Thereby, there is an effect that a numerical value can be input accurately and easily.

  One embodiment of the present invention will be described below with reference to FIGS.

  The data display / sensor device 100 (numerical value input device) according to the present embodiment includes a sensor built-in liquid crystal panel 301 (planar member) that detects a nearby image, and a finger (object) detected by the sensor built-in liquid crystal panel 301. The data acquisition unit 820 (region detection means) for detecting the finger image region on the sensor built-in liquid crystal panel 301 and the number of the regions detected by the data acquisition unit 820 are counted. This is a device comprising a coordinate data count unit 830 (input numerical value recognition means) for recognizing the number of areas as an input numerical value input by a user.

  First, an outline of the sensor built-in liquid crystal panel 301 included in the data display / sensor device 100 will be described below.

(Outline of LCD panel with built-in sensor)
The sensor built-in liquid crystal panel 301 provided in the data display / sensor device 100 is a liquid crystal panel capable of detecting an image of an object in addition to displaying data. Here, the image detection of the object is, for example, detection of a position pointed (touched) by the user with a finger or a pen, or reading (scanning) of an image of a printed material. The device used for display is not limited to a liquid crystal panel, and may be an organic EL (Electro Luminescence) panel or the like.

  The structure of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 2 is a diagram schematically showing a cross section of the sensor built-in liquid crystal panel 301. The sensor built-in liquid crystal panel 301 described here is an example, and any structure can be used as long as the display surface and the reading surface are shared.

  As shown in the figure, the sensor built-in liquid crystal panel 301 includes an active matrix substrate 51A disposed on the back surface side and a counter substrate 51B disposed on the front surface side, and has a structure in which a liquid crystal layer 52 is sandwiched between these substrates. is doing. The active matrix substrate 51A is provided with a pixel electrode 56, a data signal line 57, an optical sensor circuit 32 (not shown), an alignment film 58, a polarizing plate 59, and the like. The counter substrate 51B is provided with color filters 53r (red), 53g (green), 53b (blue), a light shielding film 54, a counter electrode 55, an alignment film 58, a polarizing plate 59, and the like. In addition, a backlight 307 is provided on the back surface of the sensor built-in liquid crystal panel 301.

  The photodiode 6 included in the photosensor circuit 32 is provided in the vicinity of the pixel electrode 56 provided with the blue color filter 53b, but is not limited to this configuration. It may be provided in the vicinity of the pixel electrode 56 provided with the red color filter 53r, or may be provided in the vicinity of the pixel electrode 56 provided with the green color filter 53g.

  Next, with reference to FIGS. 3A and 3B, two types of methods for detecting the position where the user touches the sensor built-in liquid crystal panel 301 with a finger or a pen will be described.

  FIG. 3A is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a reflected image. When the light 63 is emitted from the backlight 307, the optical sensor circuit 32 including the photodiode 6 detects the light 63 reflected by the object 64 such as a finger. Thereby, the reflected image of the target object 64 can be detected. Thus, the sensor built-in liquid crystal panel 301 can detect the touched position by detecting the reflected image.

  FIG. 3B is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a shadow image. As shown in FIG. 3B, the optical sensor circuit 32 including the photodiode 6 detects external light 61 transmitted through the counter substrate 51B and the like. However, when there is an object 62 such as a pen, the incident of the external light 61 is hindered, so that the amount of light detected by the optical sensor circuit 32 is reduced. Thereby, a shadow image of the object 62 can be detected. Thus, the sensor built-in liquid crystal panel 301 can also detect a touched position by detecting a shadow image.

  As described above, the photodiode 6 may detect reflected light (shadow image) of the light emitted from the backlight 307 or may detect a shadow image caused by external light. Further, the two types of detection methods may be used in combination to detect both a shadow image and a reflected image at the same time.

(Data display / sensor configuration)
Next, with reference to FIG. 4, the configuration of the main part of the data display / sensor device 100 will be described. FIG. 4 is a block diagram showing a main configuration of the data display / sensor device 100. As shown in FIG. As illustrated, the data display / sensor device 100 includes one or more display / light sensor units 300, a circuit control unit 600, a data processing unit 700, a main control unit 800, a storage unit 901, a primary storage unit 902, and an operation unit. 903, an external communication unit 907, an audio output unit 908, and an audio input unit 909. Here, the data display / sensor device 100 will be described as including two display / light sensor units 300 (first display / light sensor unit 300A and second display / light sensor unit 300B). When the first display / light sensor unit 300A and the second display / light sensor unit 300B are not distinguished, they are referred to as the display / light sensor unit 300.

  The display / light sensor unit 300 is a so-called liquid crystal display device with a built-in light sensor. The display / light sensor unit 300 includes a sensor built-in liquid crystal panel 301, a backlight 307, and a peripheral circuit 309 for driving them.

  The sensor built-in liquid crystal panel 301 includes a plurality of pixel circuits 31 and photosensor circuits 32 arranged in a matrix. The detailed configuration of the sensor built-in liquid crystal panel 301 will be described later.

  The peripheral circuit 309 includes a liquid crystal panel drive circuit 304, an optical sensor drive circuit 305, a signal conversion circuit 306, and a backlight drive circuit 308.

  The liquid crystal panel driving circuit 304 outputs a control signal (G) and a data signal (S) in accordance with the timing control signal (TC1) and the data signal (D) from the display control unit 601 of the circuit control unit 600, and the pixel circuit 31. It is a circuit which drives. Details of the driving method of the pixel circuit 31 will be described later.

  The optical sensor driving circuit 305 is a circuit that drives the optical sensor circuit 32 by applying a voltage to the signal line (R) in accordance with a timing control signal (TC2) from the sensor control unit 602 of the circuit control unit 600. Details of the driving method of the optical sensor circuit 32 will be described later.

  The signal conversion circuit 306 is a circuit that converts the sensor output signal (SS) output from the optical sensor circuit 32 into a digital signal (DS) and transmits the converted signal to the sensor control unit 602.

  The backlight 307 includes a plurality of white LEDs (Light Emitting Diodes) and is disposed on the back surface of the sensor built-in liquid crystal panel 301. When a power supply voltage is applied from the backlight drive circuit 308, the backlight 307 is turned on and irradiates the sensor built-in liquid crystal panel 301 with light. Note that the backlight 307 is not limited to white LEDs, and may include LEDs of other colors. The backlight 307 may include, for example, a cold cathode fluorescent lamp (CCFL) instead of the LED.

  The backlight driving circuit 308 applies a power supply voltage to the backlight 307 when the control signal (BK) from the backlight control unit 603 of the circuit control unit 600 is at a high level, and conversely, the backlight control unit 603. When the control signal from is at a low level, no power supply voltage is applied to the backlight 307.

  Next, the circuit control unit 600 will be described. The circuit control unit 600 has a function as a device driver that controls the peripheral circuit 309 of the display / light sensor unit 300. The circuit control unit 600 includes a display control unit 601, a sensor control unit 602, a backlight control unit 603, and a display data storage unit 604.

  The display control unit 601 receives display data from the display data processing unit 701 of the data processing unit 700, and performs timing control on the liquid crystal panel driving circuit 304 of the display / light sensor unit 300 in accordance with an instruction from the display data processing unit 701. A signal (TC1) and a data signal (D) are transmitted, and the received display data is displayed on the sensor built-in liquid crystal panel 301.

  The display control unit 601 temporarily stores the display data received from the display data processing unit 701 in the display data storage unit 604. Then, a data signal (D) is generated based on the primary stored display data. The display data storage unit 604 is, for example, a video random access memory (VRAM).

  The sensor control unit 602 transmits a timing control signal (TC2) to the optical sensor driving circuit 305 of the display / optical sensor unit 300 in accordance with an instruction from the sensor data processing unit 703 of the data processing unit 700, and the sensor built-in liquid crystal panel 301. Run the scan with.

  In addition, the sensor control unit 602 receives a digital signal (DS) from the signal conversion circuit 306. Then, image data is generated based on the digital signal (DS) corresponding to the sensor output signal (SS) output from all the optical sensor circuits 32 included in the sensor built-in liquid crystal panel 301. That is, the image data read in the entire reading area of the sensor built-in liquid crystal panel 301 is generated. Then, the generated image data is transmitted to the sensor data processing unit 703.

  The backlight control unit 603 transmits a control signal (BK) to the backlight drive circuit 308 of the display / light sensor unit 300 in accordance with instructions from the display data processing unit 701 and the sensor data processing unit 703 to drive the backlight 307. Let

  When the data display / sensor device 100 includes a plurality of display / light sensor units 300, the display control unit 601 determines which display / light sensor unit 300 displays the display data from the data processing unit 700. When an instruction is received, the liquid crystal panel drive circuit 304 of the display / light sensor unit 300 is controlled according to the instruction. When the sensor control unit 602 receives an instruction from the data processing unit 700 as to which display / light sensor unit 300 is to scan the object, The sensor drive circuit 305 is controlled and a digital signal (DS) is received from the signal conversion circuit 306 of the display / light sensor unit 300 according to the instruction.

  Next, the data processing unit 700 will be described. The data processing unit 700 has a function as middleware that gives an instruction to the circuit control unit 600 based on a “command” received from the main control unit 800. Details of the command will be described later.

  The data processing unit 700 includes a display data processing unit 701 and a sensor data processing unit 703. When the data processing unit 700 receives a command from the main control unit 800, at least one of the display data processing unit 701 and the sensor data processing unit 703 depends on the value of each field (described later) included in the received command. One works.

  The display data processing unit 701 receives display data from the main control unit 800, and gives instructions to the display control unit 601 and the backlight control unit 603 according to the command received by the data processing unit 700, and displays the received display data. The image is displayed on the sensor built-in liquid crystal panel 301. The operation of the display data processing unit 701 according to the command will be described later.

  The sensor data processing unit 703 gives an instruction to the sensor control unit 602 and the backlight control unit 603 according to the command received by the data processing unit 700.

  The sensor data processing unit 703 receives image data from the sensor control unit 602 and stores the image data in the image data buffer 704 as it is. Then, in accordance with the command received by the data processing unit 700, the sensor data processing unit 703 performs “whole image data”, “partial image data (partial image coordinate data) based on the image data stored in the image data buffer 704. At least one of “including coordinate data” and “coordinate data” is transmitted to the main control unit 800. The whole image data, partial image data, and coordinate data will be described later. The operation of the sensor data processing unit 703 according to the command will be described later.

  Next, the main control unit 800 executes an application program. The main control unit 800 reads the program stored in the storage unit 901 into a primary storage unit 902 configured by, for example, a RAM (Random Access Memory) and executes the program.

  An application program executed by the main control unit 800 causes the data processing unit 700 to display display data on the sensor built-in liquid crystal panel 301 or to scan an object on the sensor built-in liquid crystal panel 301. Send commands and display data. When “data type” is designated as a command, at least one of whole image data, partial image data, and coordinate data is received from the data processing unit 700 as a response to the command.

  The circuit control unit 600, the data processing unit 700, and the main control unit 800 can be configured by a CPU (Central Processing Unit), a memory, and the like, respectively. The data processing unit 700 may be configured by a circuit such as an ASIC (application specific integrate circuit).

  Next, the storage unit 901 stores programs and data executed by the main control unit 800 as shown in the figure. The program executed by the main control unit 800 may be separated into an application-specific program and a general-purpose program that can be shared by each application.

  Next, the operation unit 903 receives an input operation of the user of the data display / sensor device 100. The operation unit 903 includes input devices such as a switch, a remote controller, a mouse, and a keyboard, for example. Then, the operation unit 903 generates a control signal corresponding to the user's input operation of the data display / sensor device 100, and transmits the generated control signal to the main control unit 800.

  As an example of the switch, a hinge switch 904 that is provided at the hinge portion of the housing and detects the open / closed state of the housing, a power switch 905 that switches power on and off, and a predetermined function are assigned in advance. A hardware switch such as a user switch 906 is assumed.

  In addition, the data display / sensor device 100 includes an external communication unit 907 for communicating with an external device by wireless / wired communication, an audio output unit 908 such as a speaker for outputting audio, and a microphone for inputting an audio signal. A voice input unit 909 such as the above may be provided as appropriate.

(Command details)
Next, details of commands transmitted from the main control unit 800 to the data processing unit 700 will be described with reference to FIGS. 5 and 6. FIG. 5 is a diagram schematically illustrating an example of a command frame structure. FIG. 6 is a diagram for explaining an example of values that can be specified for each field included in the command and an outline thereof.

  As shown in FIG. 5, the commands are “header”, “data acquisition timing”, “data type”, “scan method”, “scan image gradation”, “scan resolution”, “scan panel”, “display panel”. "And" Reserve "fields. In each field, for example, values shown in FIG. 6 can be designated.

  The “header” field is a field indicating the start of a frame. As long as it is possible to identify the “header” field, the value of the “header” field may be any value.

  Next, the “data acquisition timing” field is a field for designating a timing at which data should be transmitted to the main control unit 800. In the “data acquisition timing” field, for example, values “00” (sense), “01” (event), and “10” (all) can be specified.

  Here, “sense” specifies that the latest data is to be transmitted immediately. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “sense”, the latest data specified in the “data type” field is immediately updated to the main control unit 800. Send to.

  The “event” designates transmission at a timing when a change occurs in the image data received from the sensor control unit 602. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “event”, the image that receives the data specified in the “data type” field from the sensor control unit 602. The data is transmitted to the main control unit 800 at a timing when a change larger than a predetermined threshold occurs.

  “All” designates data transmission at a predetermined cycle. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “all”, the data designated in the “data type” field is transferred to the main control unit 800 at a predetermined cycle. Send to. The predetermined period coincides with the period in which the optical sensor circuit 32 performs scanning.

  Next, the “data type” field is a field for designating the type of data acquired from the sensor data processing unit 703. In the “data type” field, for example, values of “001” (coordinates), “010” (partial image), and “100” (entire image) can be specified. Furthermore, by adding these values, “coordinates” and “partial image” / “whole image” can be specified simultaneously. For example, when “coordinate” and “partial image” are specified at the same time, “011” can be specified.

  When the sensor data processing unit 703 receives a command whose value of the “data type” field is “whole image”, the sensor data processing unit 703 transmits the image data itself stored in the image data buffer 704 to the main control unit 800. The image data itself stored in the image data buffer 704 is referred to as “whole image data”.

  In addition, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 selects a portion where a change larger than a predetermined threshold has occurred from the image data received from the sensor control unit 602. A region to be included is extracted, and image data of the extracted region is transmitted to the main control unit 800. Here, the image data is referred to as “partial image data”. When a plurality of partial image data are extracted, the sensor data processing unit 703 transmits each extracted partial image data to the main control unit 800.

  Further, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 detects representative coordinates in the partial image data and indicates the position of the representative coordinates in the partial image data. The coordinate data is transmitted to the main control unit 800. The representative coordinates include, for example, the coordinates of the center of the partial image data, the coordinates of the center of gravity of the partial image data, and the like.

  Next, when receiving a command whose value of the “data type” field is “coordinate”, the sensor data processing unit 703 transmits coordinate data indicating the position of the representative coordinate in the entire image data to the main control unit 800. When a plurality of partial image data are extracted, the sensor data processing unit 703 detects representative coordinates in the entire image data of the extracted partial image data, and the coordinate data indicating the representative coordinates is detected. Each is transmitted to the main control unit 800 (multi-point detection).

  Specific examples of the whole image data, the partial image data, and the coordinate data will be described later with reference to schematic diagrams.

  Next, the “scan method” field is a field for designating whether or not the backlight 307 is turned on at the time of executing the scan. In the “scan method” field, for example, values of “00” (reflection), “01” (transmission), and “10” (reflection / transmission) can be designated.

  “Reflection” specifies that scanning is performed with the backlight 307 turned on. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “reflection”, the sensor data processing unit 703 performs sensor control so that the optical sensor driving circuit 305 and the backlight driving circuit 308 operate in synchronization. An instruction is given to the unit 602 and the backlight control unit 603.

  “Transmission” specifies that scanning is performed with the backlight 307 turned off. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “transparent”, the sensor control unit 602 operates the optical sensor driving circuit 305 and does not operate the backlight driving circuit 308. Instructions to the backlight control unit 603. Note that “reflection / transmission” specifies that scanning is performed using both “reflection” and “transmission”.

  Next, the “scanned image gradation” field is a field for designating gradations of the partial image data and the entire image data. In the “scanned image gradation” field, for example, values of “00” (binary) and “01” (multivalue) can be designated.

  When the sensor data processing unit 703 receives a command whose “scan image gradation” field value is “binary”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as monochrome data. .

  When the sensor data processing unit 703 receives a command whose “scanned image gradation” field value is “multivalued”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as multitone data. To do.

  Next, the “scan resolution” field is a field for designating the resolution of the partial image data and the entire image data. In the “resolution” field, for example, values of “0” (high) and “1” (low) can be designated.

  Here, “high” designates a high resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “high”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 with high resolution. For example, it is desirable to designate “high” for image data (image data such as a fingerprint) to be subjected to image processing such as image recognition.

  “Low” designates a low resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “low”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 at a low resolution. For example, it is desirable to designate “low” for image data (such as touched finger or hand image data) that only needs to be recognized.

  Next, the “scan panel” field is a field for designating which display / light sensor unit 300 is to scan the object. In the “scan panel” field, for example, values “001” (first display / light sensor unit 300A) and “010” (second display / light sensor unit 300B) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when “first display / light sensor unit 300A” and “second display / light sensor unit 300B” are specified at the same time, “011” can be specified.

  When the sensor data processing unit 703 receives a command whose “scan panel” field value is “first display / photosensor unit 300A”, the sensor data processing unit 703 and the photosensor drive circuit 305 of the first display / photosensor unit 300A and An instruction is given to the sensor control unit 602 and the backlight control unit 603 so as to control the backlight drive circuit 308.

  Next, the “display panel” field is a field for designating which display / light sensor unit 300 displays the display data. In the “scanned image gradation” field, for example, values of “001” (first display / light sensor unit 300A) and “010” (second display / light sensor unit 300B) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when “first display / light sensor unit 300A” and “second display / light sensor unit 300B” are specified at the same time, “011” can be specified.

  Here, for example, when the display data processing unit 701 receives a command whose value of the “display panel” field is “first display / light sensor unit 300A”, the display data processing unit 701 displays the display data on the first display / light sensor unit 300A. Therefore, an instruction is given to the display control unit 601 and the backlight control unit 603 to control the liquid crystal panel driving circuit 304 and the backlight driving circuit 308 of the first display / light sensor unit 300A.

  Next, the “reserved” field is a field that is appropriately specified when it is necessary to further specify information other than information that can be specified in the above-described fields.

  Note that an application executed by the main control unit 800 does not need to use all the above-described fields when transmitting a command, and an invalid value (such as a NULL value) may be set for a field that is not used. .

  When the user wants to acquire coordinate data of a position touched with a finger or pen, a command specifying “coordinate” in the “data type” field is transmitted to the data processing unit 700. Therefore, it is desirable to specify “all” in the “data acquisition timing” field of the command to acquire coordinate data. Further, since it is only necessary to acquire coordinate data of the touched position, the scanning accuracy may not be high. Therefore, “low” may be specified as the value of the “resolution” field of the command.

  Further, when “coordinate” is specified in the “data type” field of the command, for example, when the user touches the sensor built-in liquid crystal panel 301 with a plurality of fingers or pens at the same time, the coordinate data of the touched position is used. Can be acquired (multi-point detection).

  When acquiring image data of an object such as a document, a command specifying “whole image” in the “data type” field is transmitted to the data processing unit 700. Since it is common to perform a scan in a stationary state, it is not necessary to periodically perform the scan. Therefore, in this case, it is desirable to designate “sense” or “event” in the “data acquisition timing” field. When scanning an object such as a document, it is desirable that the scanning accuracy is high so that the user can easily read the characters. Therefore, it is desirable to designate “high” in the “resolution” field.

(Whole image data / Partial image data / Coordinate data)
Next, the whole image data, the partial image data, and the coordinate data will be described with reference to FIG. The image data shown in FIG. 7A is image data obtained as a result of scanning the entire sensor built-in liquid crystal panel 301 when the object is not placed on the sensor built-in liquid crystal panel 301. The image data shown in FIG. 7B is image data obtained as a result of scanning the entire sensor-equipped liquid crystal panel 301 when the user touches the sensor-equipped liquid crystal panel 301 with a finger.

  When the user touches the sensor built-in liquid crystal panel 301 with a finger, the amount of light received by the photosensor circuit 32 in the vicinity of the touch changes, so that the voltage output from the photosensor circuit 32 changes, and as a result, In the image data generated by the sensor control unit 602, the brightness of the pixel value of the portion touched by the user changes.

  In the image data shown in FIG. 7B, the brightness of the pixel value of the portion corresponding to the user's finger is higher than that in the image data shown in FIG. In the image data shown in FIG. 7B, the smallest rectangular area (area PP) that includes all pixel values whose lightness changes more than a predetermined threshold is “partial image data”.

  The image data indicated by the area AP is “whole image data”.

  Also, the coordinate data in the whole image data (area AP) of the representative coordinates Z of the partial image data (area PP) is (Xa, Ya), and the coordinate data in the partial image data (area PP) is (Xp, Yp). It is.

(Configuration of sensor built-in liquid crystal panel)
Next, the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309 of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 8 is a block diagram showing the main part of the display / light sensor unit 300, particularly the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309.

  The sensor built-in liquid crystal panel 301 includes a pixel circuit 31 for setting light transmittance (brightness) and an optical sensor circuit 32 that outputs a voltage corresponding to the intensity of light received by the sensor. Note that the pixel circuit 31 is a generic term for the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b corresponding to the red, green, and blue color filters, respectively.

  The pixel circuits 31 are arranged on the sensor built-in liquid crystal panel 301 in the column direction (vertical direction) and 3n in the row direction (horizontal direction). A set of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b is continuously arranged in the row direction (lateral direction). This set forms one pixel.

  In order to set the light transmittance of the pixel circuit 31, first, the high level voltage (TFT 33 is turned on) to the scanning signal line Gi connected to the gate terminal of the TFT (Thin Film Transistor) 33 included in the pixel circuit 31. Voltage). Thereafter, a predetermined voltage is applied to the data signal line SRj connected to the source terminal of the TFT 33 of the R pixel circuit 31r. Similarly, the light transmittance is also set for the G pixel circuit 31g and the B pixel circuit 31b. Then, by setting these light transmittances, an image is displayed on the sensor built-in liquid crystal panel 301.

  Next, the photosensor circuit 32 is arranged for each pixel. One pixel may be arranged in the vicinity of each of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b.

  In order for the optical sensor circuit 32 to output a voltage corresponding to the light intensity, first, the sensor readout line RWi connected to one electrode of the capacitor 35 and the anode terminal of the photodiode 36 are connected. A predetermined voltage is applied to the sensor reset line RSi. In this state, when light is incident on the photodiode 36, a current corresponding to the amount of incident light flows through the photodiode 36. Then, according to the current, the voltage at the connection point (hereinafter referred to as connection node V) between the other electrode of the capacitor 35 and the cathode terminal of the photodiode 36 decreases. When the power supply voltage VDD is applied to the voltage application line SDj connected to the drain terminal of the sensor preamplifier 37, the voltage at the connection node V is amplified and output from the source terminal of the sensor preamplifier 37 to the sensing data output line SPj. Based on the output voltage, the amount of light received by the optical sensor circuit 32 can be calculated.

  Next, the liquid crystal panel drive circuit 304, the optical sensor drive circuit 305, and the sensor output amplifier 44, which are peripheral circuits of the sensor built-in liquid crystal panel 301, will be described.

  The liquid crystal panel drive circuit 304 is a circuit for driving the pixel circuit 31, and includes a scanning signal line drive circuit 3041 and a data signal line drive circuit 3042.

  The scanning signal line driving circuit 3041 sequentially selects one scanning signal line from the scanning signal lines G1 to Gm for each line time based on the timing control signal TC1 received from the display control unit 601, and A high level voltage is applied to the selected scanning signal line, and a low level voltage is applied to the other scanning signal lines.

  Based on the display data D (DR, DG, and DB) received from the display controller 601, the data signal line driver circuit 3042 generates a predetermined voltage corresponding to the display data for one row for each line time. The data signal lines SR1 to SRn, SG1 to SGn, and SB1 to SBn are applied (line sequential method). Note that the data signal line driver circuit 3042 may be driven by a dot sequential method.

  The optical sensor driving circuit 305 is a circuit for driving the optical sensor circuit 32. Based on the timing control signal TC2 received from the sensor control unit 602, the optical sensor driving circuit 305 selects a predetermined sensor readout signal line from the sensor readout signal lines RW1 to RWm for each line time. A read voltage is applied, and a voltage other than a predetermined read voltage is applied to the other sensor read signal lines. Similarly, based on the timing control signal TC2, a predetermined reset voltage is applied to the sensor reset signal line selected from the sensor reset signal lines RS1 to RSm for each line time, and the others. A voltage other than a predetermined reset voltage is applied to the sensor reset signal line.

  The sensing data output signal lines SP1 to SPn are grouped into p groups (p is an integer of 1 to n), and the sensing data output signal lines belonging to each group are connected via a switch 47 that is sequentially turned on in time division. And connected to the sensor output amplifier 44. The sensor output amplifier 44 amplifies the voltage from the group of sensing data output signal lines connected by the switch 47 and outputs the amplified voltage to the signal conversion circuit 306 as sensor output signals SS (SS1 to SSp).

(Description of data display / sensor device operation)
Next, a typical example of processing in which the data display / sensor device 100 performs display of the selection screen and determination operation will be described with reference to FIGS. Here, an outline of the processing will be described, and details of each processing will be described later.

  In addition, here, the display / light sensor unit 300 provided in the data display / sensor device 100 may be displayed on either the first display / light sensor unit 300A or the second display / light sensor unit 300B. . Therefore, in FIGS. 9A to 9F and the following description, only one display / light sensor unit 300 will be described as the data display / sensor device 100. FIG. Further, the data display / sensor device 100 may be composed of one display / light sensor unit 300. In this case, the hinge switch 904 can be omitted.

  A case where the user operates the data display / sensor device 100 with one hand (five fingers) will be described.

(Selection screen display and confirmation operation)
FIG. 9A is an explanatory diagram showing a state in which a selection screen is displayed on the data display / sensor device 100 according to the embodiment of the present invention. FIG. 9B is an explanatory diagram showing a state in which a selection screen is displayed when one finger is touched on the data display / sensor device 100 shown in FIG. FIG. 9C is an explanatory diagram showing a state in which a selection screen is displayed when two fingers are touched on the data display / sensor device 100 shown in FIG. 9B. FIG. 9D is an explanatory diagram illustrating a state in which a confirmation screen is displayed when all fingers are removed from the data display / sensor device 100 illustrated in FIG. FIG. 9 (e) is an explanatory diagram showing a state where a selection screen is displayed when five fingers are touched on the data display / sensor device 100 shown in FIG. 9 (a). FIG. 9F is an explanatory diagram showing a state when one finger is touched on the data display / sensor device 100 displaying the selection screen shown in FIG.

  As shown in FIG. 9A, the sensor built-in liquid crystal panel 301 displays a selection screen (image) including selection items divided into items for the user to select. In the present embodiment, this selection screen has four display areas (first area SD1 to fourth area SD4) arranged vertically as selection items, and allows the user to select each area. Item information is displayed.

  Here, “confidential” is displayed as item information in the first area SD1, “delimit” as item information in the second area SD2, “strike” as item information in the third area, and “struck” as item information in the fourth area. is doing. Note that the arrangement of the first region to the fourth region may be arbitrarily set.

  Next, as shown in FIG. 9B, the user selects 1 to 4 display areas in which the item information to be selected is displayed from the first area SD1 to the fourth area SD4. A finger (object) touches the sensor built-in liquid crystal panel 301.

  Here, the finger does not need to be in full contact with the sensor-embedded liquid crystal panel 301, and may be brought into contact with the sensor-embedded liquid crystal panel 301 to such an extent that the sensor-embedded liquid crystal panel 301 can clearly detect the finger image.

  Then, the data display / sensor device 100 recognizes the number of fingers touched on the sensor built-in liquid crystal panel 301 by the user (that is, the number of coordinate data (representative coordinates) acquired by the data acquisition unit 820) as an input numerical value. The data display / sensor device 100 then displays the display area associated with the input numerical value in the first area SD1 to the fourth area SD4, for example, the character color and the background color are inverted. Then, a selection screen switched to a display (selection display) so that the user can know that the selection has been made is displayed on the sensor built-in liquid crystal panel 301.

  Here, the user touches one finger on the sensor built-in liquid crystal panel 301 in order to select “confidential” displayed in the first area SD1. Then, the data display / sensor device 100 recognizes that the input numerical value is “1” by detecting the touch of one finger on the sensor built-in liquid crystal panel 301. Then, the data display / sensor device 100 causes the sensor built-in liquid crystal panel 301B to display a selection screen that selectively displays the first area SD1 associated with the input numerical value “1”.

  In this way, the data display / sensor device 100 recognizes the number of fingers touched by the user on the sensor built-in liquid crystal panel 301 as an input numerical value, and selects and displays a display area associated with the recognized input numerical value. The screen can be displayed on the sensor built-in liquid crystal panel 301.

  Here, in order to select the first region SD1, the user may touch one finger on the sensor built-in liquid crystal panel 301, and may touch any position on the sensor built-in liquid crystal panel 301. That is, the data display / sensor device 100 can recognize the number of touched fingers as an input numerical value, regardless of the position where the user touches the finger, as long as it is within the sensor built-in liquid crystal panel 301.

  Further, as shown in FIG. 9C, when the user does not decide the display area selected once and wants to select another display area, the user does not release the finger touching the sensor built-in liquid crystal panel 301, By touching another finger on the liquid crystal panel 301 with a built-in sensor, another display area can be selected.

  For example, in order to select “delimit” displayed in the second area SD2, the user does not release the finger touching the sensor built-in liquid crystal panel 301 in FIG. Touch panel 301.

  Then, the data display / sensor device 100 recognizes that the input numerical value is “2”, and displays a selection screen in which the second area SD2 associated with the input numerical value “2” is selected and displayed. To display.

  That is, the user arbitrarily increases or decreases the number of fingers touching the sensor built-in liquid crystal panel 301 until all the fingers touching the sensor built in liquid crystal panel 301 are released. The desired display area can be changed to selection display.

  Then, the data display / sensor device 100 recognizes the number of fingers that are arbitrarily increased or decreased as an input numerical value until it recognizes that all fingers touching the sensor built-in liquid crystal panel 301 are separated, and sets the recognized input numerical value as the recognized input numerical value. A selection screen that selectively displays the associated display area is displayed on the sensor built-in liquid crystal panel 301.

  Then, when the user wants to confirm the display area selected and displayed, all the fingers touching the sensor built-in liquid crystal panel 301 are separated from the sensor built-in liquid crystal panel 301. As a result, the data display / sensor device 100 recognizes that all the fingers touching the sensor built-in liquid crystal panel 301 have been released, and performs a determination operation (described later).

  For example, as shown in FIG. 9D, when the user wants to confirm “delimit” displayed in the second region selected in FIG. 9C, the user touches the sensor built-in liquid crystal panel 301. Release two fingers.

  As a result, the display data control unit 810 recognizes that the user's finger has been removed from the sensor-equipped liquid crystal panel 301, and performs a determination operation. Here, as the confirmation operation, the display data control unit 810 causes the sensor built-in liquid crystal panel 301 to display a confirmation screen for causing the second area to blink, for example, for a certain period of time.

  As a result, the user can recognize that the “delimit” of the second area has been determined.

(Selection screen scroll)
Next, a case where the selection screen displayed on the sensor built-in liquid crystal panel 301 is scrolled to change the item information displayed in the first area SD1 to the fourth area SD4 by one screen will be described.

  As shown in FIG. 9E, when the user wants to change the item information of each of the first area SD1 to the fourth area SD4, the user touches five fingers on the sensor built-in liquid crystal panel 301, and the touched 5 All fingers are separated from the liquid crystal panel 301 with a built-in sensor.

  As a result, the data display / sensor device 100 recognizes that the input numerical value “5” has been input and confirmed, refers to the storage unit 901, and stores the first area SD1 to the fourth area SD4 in the sensor-equipped liquid crystal panel 301. A selection screen with updated item information is displayed.

  Subsequently, as described in FIGS. 9A to 9D, the user touches the sensor built-in liquid crystal panel 301 on which the updated selection screen is displayed. As a result, the data display / sensor device 100 recognizes the number of fingers touching the sensor built-in liquid crystal panel 301 as an input numerical value, and displays a selection screen that selectively displays a display area associated with the recognized input numerical value. The image is displayed on the built-in liquid crystal panel 301. Further, the user separates all fingers touching the sensor built-in liquid crystal panel 301 from the sensor built-in liquid crystal panel 301. As a result, the data display / sensor device 100 recognizes that all the fingers touching the sensor built-in liquid crystal panel 301 have been separated, and performs a determination operation.

  For example, as shown in FIG. 9 (f), when the user touches the sensor-equipped liquid crystal panel 301 with one finger, the data display / sensor device 100 recognizes the input numerical value “1” and is updated. The display screen in which the first area SD1 in which the item information “annotate” of the selected screen is displayed can be displayed on the sensor built-in liquid crystal panel 301.

  Then, the data display / sensor device 100 recognizes that the one finger touching the sensor built-in liquid crystal panel 301 has been released, and thereby displays a confirmation screen in which the first area SD1 selected and displayed blinks for a certain period of time. The image is displayed on the built-in liquid crystal panel 301.

  Here, the data display / sensor apparatus 100 has been described with respect to the case where the item information is scrolled by one screen when the touch or determination of five fingers on the sensor built-in liquid crystal panel 301 is detected, but the item information is scrolled. What is necessary is just to set the quantity to do arbitrarily.

  For example, the display data control unit 810 detects, for example, the first region every time it detects the touch and confirmation of five fingers on the sensor built-in liquid crystal panel 301, that is, every time it recognizes the input and confirmation of the input numerical value “5”. Item information such as “delimit” in SD1, “strike” in second area SD2, “struck” in third area SD3, “annotate” in fourth area SD4 is displayed on sensor-equipped liquid crystal panel 301. And the display area may be shifted one by one.

(Explanation of main parts of data display / sensor device)
Next, the data display / sensor device 100 will be described in detail with reference to FIG.

  FIG. 1 is a block diagram showing a main configuration of the data display / sensor device 100.

  As shown in FIG. 1, the main control unit 800 includes a display data control unit (display data control unit) 810, a data acquisition unit (region detection unit, coordinate detection unit) 820, and a coordinate data count unit (input numerical value recognition unit). 830.

  The display data control unit 810 is associated with information input from a user operation, a coordinate data count unit 830, or a coordinate data control unit (coordinate data control unit) 840 (not shown in FIG. 1) described later. Information is read from the storage unit 901, and a selection screen including the read information and a confirmation screen are displayed on the sensor built-in liquid crystal panel 301.

  The data acquisition unit 820 detects a finger image area close to the sensor built-in liquid crystal panel 301 and coordinate data (representative coordinates) at a predetermined timing.

  The coordinate data count unit 830 counts the number of finger image areas and coordinate data detected by the data acquisition unit 820, and calculates the number of finger image areas and the number of coordinate data as input numerical values input to the user. Recognize.

  The storage unit 930 stores the input numerical values in the order recognized by the coordinate data count unit 830.

  The display data control unit 810 displays an image including a plurality of selection items selectable by the user on the sensor built-in liquid crystal panel 301 (not shown in FIG. 1).

  In addition, the display data control unit 810 displays, on the sensor built-in liquid crystal panel 301, an image in which a selection item associated with the input numerical value recognized by the coordinate data counting unit 830 is selected among the plurality of selection items. Display.

  For this reason, in order for a user to select a desired selection item from among a plurality of selection items displayed on the sensor built-in liquid crystal panel 301, the number of fingers associated with the desired selection item is What is necessary is just to make it adjoin to the liquid crystal panel 301 with a built-in sensor.

  As a result, the coordinate data count unit 830 recognizes the number of fingers that the user has brought close to the sensor built-in liquid crystal panel 301 as an input numerical value. The display data control unit 810 can cause the sensor built-in liquid crystal panel 301 to display an image in which the selection item associated with the input numerical value recognized by the coordinate data count unit 830 is selected.

  As described above, according to the above configuration, since numerical input can be performed accurately and easily, it is possible to accurately select a desired selection item from among a plurality of displayed selection items and easily change the selection item to be selected. It can be carried out.

  Then, the display data control unit 810 displays the latest input numerical value stored in the storage unit 930 when the data acquisition unit 820 does not detect (acquire) the image area or the coordinate data on the sensor built-in liquid crystal panel 301. Acquire and execute the function of the selection item associated with the acquired input numerical value.

  As described above, in order to execute the function of the selection item, in order for the user to input a numerical value, the same number of fingers as the input numerical value associated with the selection item are brought close to the sensor built-in liquid crystal panel 301, It suffices to release the finger to such a distance that the sensor-equipped liquid crystal panel 301 cannot detect the image of the finger that has been brought close to it.

  As a result, the latest input numerical value is stored in the storage unit 930. Then, the display data control unit 810 acquires the latest input numerical value stored in the storage unit 930 when the data acquisition unit 820 does not detect the area. Thereby, the display data control unit 810 can execute the function of the selection item associated with the acquired input numerical value.

  Here, the execution (confirmation operation) of the function of the selection item associated with the input numerical value is to confirm and display the selection item (display area) associated with the input numerical value. The confirmed display may be any display that can recognize that the user has been confirmed. For example, the confirmed display area blinks for a certain period of time.

  Further, as a finalizing operation, as described above, the display data control unit 810 displays a finalized display on the sensor built-in liquid crystal panel 301, reads a function of a predetermined application from the storage unit 901, and displays a display screen representing the result as a sensor. Display data may be generated for display on the built-in liquid crystal panel 301, and the generated display data may be output to the data processing unit 700.

  For example, if the selection screen displayed on the sensor built-in liquid crystal panel 301 is a selection screen for selecting an answer such as a quiz, correct / incorrect determination is performed in association with the content of the item information in the display area determined by the user. The display screen shown is displayed on the sensor built-in liquid crystal panel 301.

  When the coordinate data count unit 830 acquires the entire image data and the coordinate data (or finger image region) from the data acquisition unit 820, the coordinate data count unit 830 counts the number of the acquired coordinate data (or finger image region). The number of coordinate data (or finger image areas) is recognized as an input numerical value. The coordinate data count unit 830 notifies the display data control unit 810 of the recognized input numerical value and temporarily stores it in the storage unit 901.

  Also, the coordinate data count unit 830 determines whether or not the user has released all of the fingers touching the sensor built-in liquid crystal panel 301 depending on the presence or absence of the coordinate data (or finger image area) output from the data acquisition unit 820. Is determined.

  That is, the coordinate data count unit 830 acquires only the entire image data from the data acquisition unit 820, thereby recognizing that the user has released all the fingers touching the sensor built-in liquid crystal panel 301. When the coordinate data count unit 830 recognizes that all of the user's fingers are separated from the sensor built-in liquid crystal panel 301, the coordinate data count unit 830 outputs confirmation information to the display data control unit 810 and the storage unit 901 in order to confirm the input numerical value.

  Here, the confirmation information may be, for example, error information indicating that the coordinate data could not be counted, or may be an input numerical value “0 (zero)”.

  Further, the storage unit 901 stores the input numerical value output from the coordinate data count unit 830 in association with the order output from the coordinate data count unit 830. Further, the input numerical value and each display area are stored in association with each other, and each display area and item information to be displayed in each display area are stored in association with each other.

(Flowchart explanation)
Next, with reference to FIGS. 9A to 9F and FIG. 10, the processing flow of the data display / sensor device 100 and the details of the command transmitted from the main control unit 800 to the data processing unit 700 will be described. explain.

  FIG. 10 is a flowchart showing the flow of processing of the data display / sensor device 100.

  First, when the data display / sensor device 100 is turned off, the user presses the power switch 905 to turn on the data display / sensor device 100 (step S11).

  The display data control unit 810 includes a plurality of selection items (display areas) that can be selected by the user with reference to the storage unit 901 by detecting a user operation (for example, pressing the user switch 905). Display data for displaying the selection screen on the sensor built-in liquid crystal panel 301 is generated, and the generated display data is output to the data processing unit 700.

  Here, the display data control unit 810, from the storage unit 901, arranges the first area SD1 to the fourth area SD4 as display areas on the sensor-embedded liquid crystal panel 301 and displays associated with the display areas. The information (item information) to be displayed in the area is read. The item information “confidential” of the first area SD1, the item information “delimit” of the second area SD2, the item information “strike” of the third area SD3, and the fourth area SD4 Read item information “struck”. Then, the display data control unit 810 generates display data for displaying the selection screen including these on the sensor built-in liquid crystal panel 301, and outputs the generated display data to the data processing unit 700.

  In addition, when displaying the selection screen on the first display / light sensor unit 300A, the display data control unit 810 performs a data processing on a command specifying the upper screen (“001”) as the value of the “display panel” field. Output to the unit 700. Further, when displaying the selection screen on the second display / light sensor unit 300B, the display data control unit 810 sends a command specifying the lower screen ("010") as the value of the "display panel" field to the data processing unit. Output to 700.

  As a result, as shown in FIG. 9A, the display data control unit 810 displays a selection screen on the sensor built-in liquid crystal panel 301 (step S12).

  Note that the display data control unit 810 may display the selection screen on the sensor built-in liquid crystal panel 301 by detecting the pressing of the power switch 905.

  Here, a message for prompting the user to select item information displayed on the selection screen on the upper screen (not shown in FIG. 9A) is displayed on the liquid crystal panel 301 with built-in sensor. You may display on the sensor built-in liquid crystal panel 301 of the side by which the selection screen is not displayed.

  In this case, the display data control unit 810 generates display data for causing the sensor built-in liquid crystal panel 301 to display a message for prompting the user to select item information, and sends the generated display data to the data processing unit 700. Output.

  In addition, when the selection screen is displayed on the first display / light sensor unit 300A, the display data control unit 810 sends a command specifying the lower screen (“010”) as the value of the “display panel” field, The data is output to the data processing unit 700. In addition, when the selection screen is displayed on the second display / light sensor unit 300B, the display data control unit 810 executes a command specifying the upper screen (“001”) as the value of the “display panel” field. The data is output to the processing unit 700.

  Then, the data display / sensor device 100 stands by until a finger touch on the sensor built-in liquid crystal panel 301 is detected (step S13, NO in step S13).

  In order to perform the above detection, when the display data control unit 810 outputs display data for displaying the selection screen on the sensor built-in liquid crystal panel 301 to the data processing unit 700, the display data control unit 810 also displays the data in the “data acquisition timing” field. , “Event” is designated, and a command in which both “coordinate” and “whole image” are designated (“101” is designated) in the “data type” field is output to the data processing unit 700.

  Thereby, when the number of fingers touching the sensor built-in liquid crystal panel 301 is changed, the data acquisition unit 820 can acquire the coordinate data and the entire image data from the data processing unit 700.

  Specifically, as shown in FIG. 9B, when the user touches the sensor-equipped liquid crystal panel 301 with the finger, the optical sensor circuit 32 detects at least one of a shadow image and a reflected image of the touched finger. As a result, the data processing unit 700 changes in the image data acquired from the sensor control unit 602.

  The data acquisition unit 820 acquires the coordinate data and the entire image data output from the data processing unit 700 when a change occurs in the image data, so that the finger touches the sensor built-in liquid crystal panel 301. Is detected (YES in step S13).

  When the data acquisition unit 820 detects a touch of a finger on the sensor built-in liquid crystal panel 301, the data acquisition unit 820 outputs the coordinate data and the entire image data acquired from the data processing unit 700 to the coordinate data count unit 830.

  The coordinate data count unit 830 counts the number of coordinate data output from the data acquisition unit 820 (step S14), and recognizes the counted number of coordinate data as an input numerical value (step S15). The coordinate data count unit 830 notifies the display data control unit 810 of the recognized input numerical value and temporarily stores it in the storage unit 901.

  For example, in FIG. 9B, since one finger is touching the sensor built-in liquid crystal panel 301, the number of coordinate data acquired by the coordinate data count unit 830 from the data acquisition unit 820 is one. Therefore, in the case of FIG. 9B, the coordinate data count unit 830 recognizes the input numerical value “1”.

  In FIG. 9C, since two fingers are touching the sensor built-in liquid crystal panel 301, the number of coordinate data acquired by the coordinate data count unit 830 from the data acquisition unit 820 is two. Therefore, in the case of FIG. 9C, the coordinate data count unit 830 recognizes the input numerical value “2”.

  Further, the coordinate data count unit 830 determines whether or not the user has released all the fingers that have touched the sensor built-in liquid crystal panel 301 based on the presence or absence of coordinate data output from the data acquisition unit 820 (step S16). The YES process in step S16 will be described later.

  If the coordinate data count unit 830 determines that the user has not released all the fingers touching the sensor built-in liquid crystal panel 301 (NO in step S16), the display data control unit 810 displays the coordinate data count unit 830. Get the input numerical value output from.

  Then, the display data control unit 810 refers to the storage unit 901, specifies a display area associated with the input numerical value (step S17), and displays a selection screen that selectively displays the specified display area as a sensor built-in liquid crystal panel. Display data to be displayed on 301 is generated.

  Then, the display data control unit 810 outputs the generated display data to the data processing unit 700.

  In addition, when displaying the selection screen on the first display / light sensor unit 300A, the display data control unit 810 performs a data processing on a command specifying the upper screen (“001”) as the value of the “display panel” field. Output to the unit 700. Alternatively, when displaying the selection screen on the second display / light sensor unit 300B, the display data control unit 810 uses a command specifying the lower screen (“010”) as the value of the “display panel” field, as the data processing unit. Output to 700.

  Thereby, the sensor built-in liquid crystal panel 301 displays a selection screen in which the display area associated with the input numerical value is selected and displayed (step S18).

  For example, as shown in FIG. 9B, the sensor built-in liquid crystal panel 301 displays a selection screen in which the first area SD1 associated with the input numerical value “1” is selected, or FIG. ), A selection screen in which the second area SD2 associated with the input numerical value “2” is selected is displayed.

  In step S16, the coordinate data counting unit 830 recognizes that the user has released all the fingers touching the sensor built-in liquid crystal panel 301 (YES in step S16), that is, the coordinate data counting unit 830 Until only the entire image data is acquired from the data acquisition unit 820, the above-described processing of step S14 to step S18 is repeated.

  Next, the YES process in step S16 will be described.

  As shown in FIG. 9D, when the user releases all fingers touching the sensor built-in liquid crystal panel 301, the data acquisition unit 820 acquires only the entire image data from the data processing unit 700, and coordinates data Is not acquired (detected). Then, the data acquisition unit 820 outputs only the entire coordinate data acquired from the data processing unit 700 to the coordinate data count unit 830. The coordinate data count unit 830 acquires only the entire image data from the data acquisition unit 820.

  As a result, the coordinate data count unit 830 recognizes that the number of fingers touching the sensor-equipped liquid crystal panel 301 has changed. However, the coordinate data count unit 830 does not acquire coordinate data from the data acquisition unit 820, and therefore does not count the number of coordinate data.

  That is, the coordinate data count unit 830 acquires only the entire image data from the data acquisition unit 820, thereby recognizing that the user has released all the fingers touching the sensor built-in liquid crystal panel 301 (YES in step S15). be able to.

  When the coordinate data count unit 830 recognizes that all of the user's fingers are separated from the sensor built-in liquid crystal panel 301, the coordinate data count unit 830 outputs confirmation information to the display data control unit 810 and the storage unit 901 in order to confirm the input numerical value.

  When the display data control unit 810 obtains the confirmation information from the coordinate data count unit 830, the display data control unit 810 obtains the input numerical value stored immediately before the stored confirmation information from the storage unit 901. Then, the display data control unit 810 recognizes the acquired input numerical value as an input numerical value (confirmed input numerical value). Then, the display data control unit 810 determines the input numerical value (step S19).

  Next, the display data control unit 810 determines whether or not the input numerical value determined in step S19 is “5” (step S20).

  When the display data control unit 810 determines that the determined input numerical value is not “5” (that is, “1” to “4”) (NO in step S20), the display data control unit 810 stores the data. A display for referring to the unit 901 to read a confirmed operation associated with the confirmed input numerical value, and to display a confirmed screen that is a confirmed display screen on the sensor built-in liquid crystal panel 301 based on the read confirmed operation. Generate data. Then, the generated display data is output to the data processing unit 700.

  In addition, when the display data control unit 810 displays the confirmed display screen on the first display / light sensor unit 300A, the display data control unit 810 executes a command specifying the upper screen (“001”) as the value of the “display panel” field, The data is output to the data processing unit 700. Alternatively, when displaying the determined display screen on the second display / light sensor unit 300B, the display data control unit 810 uses a command specifying the lower screen (“010”) as the value of the “display panel” field as the data The data is output to the processing unit 700.

  Thereby, the sensor built-in liquid crystal panel 301 displays a confirmation screen which is a display screen associated with the confirmed input numerical value (step S21).

(scroll)
As shown in FIG. 9E, when the number of fingers touching the sensor built-in liquid crystal panel 301 is five, that is, the display data control unit 810 has a fixed input numerical value of “5”. If it is determined that there is (YES in step S20), the display data control unit 810 displays a selection screen in which the item information displayed in the display area (first area SD1 to fourth area SD4) is updated as a sensor built-in liquid crystal panel. 301 is displayed.

  In other words, when the display data control unit 810 determines that the determined input numerical value is “5”, the display data control unit 810 refers to the storage unit 910 and updates the item information associated with each display area (step S22).

  Here, the display data control unit 810 refers to the storage unit 910, “annotate” in the first area SD1, “advise” in the second area, “deceive” in the third area SD3, and “identify” in the fourth area SD4. The display data for displaying the selection screen displaying "" on the sensor built-in liquid crystal panel 301 is generated. Then, the display data control unit 810 outputs the generated display data to the data processing unit 700.

  In addition, when displaying the selection screen on the first display / light sensor unit 300A, the display data control unit 810 performs a data processing on a command specifying the upper screen (“001”) as the value of the “display panel” field. Output to the unit 700. Alternatively, when displaying the selection screen on the second display / light sensor unit 300B, the display data control unit 810 uses a command specifying the lower screen (“010”) as the value of the “display panel” field, as the data processing unit. Output to 700.

  Thereby, the sensor built-in liquid crystal panel 301 displays the selection screen in which the item information of each of the first area SD1 to the fourth area SD4 is updated (step S23).

  Thereafter, the process returns to step S14.

  Thereby, the user can select and confirm a display area in which desired item information is displayed from the updated selection screen.

  For example, as shown in FIG. 9 (f), the display data control unit 810 recognizes and updates the input numerical value “1” by bringing the finger into contact with the sensor-equipped liquid crystal panel 301. The item information “annotate” displayed in the first area SD1 of the selection screen can be selected.

(Modification)
Next, a modified example will be described with reference to FIGS.

  The data display / sensor device 100 may be configured to move the information of the display area that is selected and displayed in accordance with the movement of the finger touching the sensor built-in liquid crystal panel 301 by the user.

  As shown in FIG. 11, the sensor built-in liquid crystal panel 301 displays, for example, the first area SD1 to the fourth area SD4 at the lower right of the screen, and further, in an area different from the first area SD1 to the fourth area SD4. An application area P, which is an area for operating a specific application, is displayed.

  Then, the user moves the finger touching the sensor built-in liquid crystal panel 301 in the direction of the arrow SM1. Then, the data display / sensor device 100 moves the display area (here, the first area SD1) that is selected and displayed in the direction of the arrow SM2 in accordance with the direction of the arrow SM1.

  Next, when the first area SD1 moves to the application area P, the user releases all fingers touching the sensor built-in liquid crystal panel 301 from the sensor built-in liquid crystal panel 301. As a result, the data display / sensor device 100 displays the confirmation screen and operates the application associated with the application area P.

  For example, when an application having a deletion function is associated with the application area P, the first area SD1 moved to the application area P is deleted.

  In this manner, the data display / sensor device 100 moves the display area selected and displayed in accordance with the movement of the user's finger, and displays a confirmation when the user releases the finger from the sensor built-in liquid crystal panel 301. , Can operate a specific application.

(Specific description of modification)
Next, a specific configuration of a modified example of the data display / sensor device 100 will be described with reference to FIG.

  In the modification, a coordinate data control unit 840 is provided in the main control unit 800.

  The coordinate data control unit 840 calculates the movement amount and movement direction of the coordinate data from the plurality of coordinate data detected by the data acquisition unit 820, and sends the calculated movement amount and movement direction of the coordinate data to the display data control unit 810. Output.

  Then, the display data control unit 810 moves the selection item based on the movement amount and movement direction of the coordinate data output from the coordinate data control unit 840.

  That is, the display data control unit 810 moves the arrangement position in the sensor built-in liquid crystal panel 301 of the selection item to be displayed on the sensor built-in liquid crystal panel 301 from the moving direction and moving amount of the coordinate data output from the coordinate data control 840. To do. Then, the display data control unit 810 causes the sensor built-in liquid crystal panel 301 to display a selection screen including a selection item whose arrangement position has been moved.

  Thereby, the selection item currently displayed on the sensor built-in liquid crystal panel 301 can be moved with the movement of the said finger | toe.

(Processing flow of the modified example)
Next, a processing flow of a modification of the data display / sensor device 100 will be described with reference to FIG.

  FIG. 13 is a flowchart showing the flow of processing of a modification of the data display / sensor device 100. Here, the description of the same processing as that described in FIG. 10 is omitted.

  First, in the case of YES in step S13, the data acquisition unit 820 outputs the coordinate data and the entire image data acquired from the data processing unit 700 to the coordinate data count unit 830 and sends the coordinate data to the coordinate data control unit 840. Output.

  Then, after the process of step S14, the coordinate data control unit 840 acquires the input numerical value primarily stored in the storage unit 901 by the coordinate data count unit 830.

  Then, the coordinate data control unit 840 determines whether or not the number of coordinate data has been changed by acquiring the input numerical value from the storage unit 901 (step S30).

  Next, when it is determined that the input numerical value has been changed (YES in step S30), the coordinate data control unit 840 performs processing subsequent to step S16.

  When the coordinate data control unit 840 determines that the input numerical value has not been changed (NO in step S30), the coordinate data control unit 840 calculates the movement amount of the coordinate data acquired from the data acquisition unit 820, and is equal to or greater than a predetermined threshold. It is determined whether or not there is (step SS31).

  Then, when the movement amount of the coordinate data calculated by the coordinate data control unit 840 is less than a predetermined threshold value (NO in step S31), the processing after step S16 is performed.

  When the coordinate data control unit 840 determines that the movement amount of the coordinate data calculated by the coordinate data control unit 840 is equal to or greater than a predetermined threshold (YES in step S31), the coordinate data control unit 840 determines the movement direction of the coordinate data. The amount of movement of the coordinate data is output to the display data control unit 810. Then, the process after step S15 is performed. The threshold value can be arbitrarily set.

  Then, the display data control unit 810 displays the display associated with the input numerical value based on the movement direction of the coordinate data acquired from the coordinate data control unit 840 and the movement amount of the coordinate data in the process of step S18. Display data for displaying on the sensor built-in liquid crystal panel 301 a selection screen in which the region coordinates (arrangement position on the sensor built-in liquid crystal panel 301) are changed is generated. Then, the display data control unit 810 outputs the generated display data to the data processing unit 700.

  In addition, when displaying the selection screen on the first display / light sensor unit 300A, the display data control unit 810 performs a data processing on a command specifying the upper screen (“001”) as the value of the “display panel” field. Output to the unit 700. Alternatively, when displaying the selection screen on the second display / light sensor unit 300B, the display data control unit 810 uses a command specifying the lower screen (“010”) as the value of the “display panel” field, as the data processing unit. Output to 700.

  Thereby, the sensor built-in liquid crystal panel 301 displays a selection screen that selectively displays the display area associated with the input numerical value (step S32).

(Additional notes)
In the above description, when the input numerical value is “5”, the display data control unit 810 has been described to update the item information (scroll the selection screen). However, the selection screen is provided with five selection items. May be displayed on the sensor built-in liquid crystal panel 301.

  That is, the fifth area SD5 is provided as a display area, and item information associated with the fifth area SD5 is stored in the storage unit 901 in order to display the fifth area SD5. When the display data control unit 810 acquires the input numerical value “5” from the coordinate data count unit 830, the display data control unit 810 reads the item information associated with the input numerical value “5” and displays the display screen on which the fifth area SD5 is selected and displayed. The image is displayed on the sensor built-in liquid crystal panel 301.

  As a result, the data display / sensor device 100 can display a selection screen with five selection items on the sensor built-in liquid crystal panel 301.

  Further, as described above, when a selection screen with five selection items is displayed on the sensor-incorporated liquid crystal panel 301, the user releases all the fingers touching the sensor-incorporated liquid crystal panel 301 in order to determine the input numerical value. Then, the confirmation screen is displayed on the sensor built-in liquid crystal panel 301, and the display data control unit 810 may display the selection screen on which the item information is updated (the selection screen is scrolled) on the sensor built-in liquid crystal panel 301.

  Further, although the present embodiment has been described with reference to inputting a numerical value with one hand, a numerical value may be input to the data display / sensor device 100 with both hands. That is, the input numerical value is not limited to “1” to “5”, and may be “6” to “10” or may be “10” or more.

(Program, computer-readable recording medium)
In addition, each block of the data display / sensor device 100, particularly the display data control unit 810, the data acquisition unit 820, and the coordinate data count unit 830, may be configured by hardware logic or using a computer as follows. It may be realized by software.

  That is, the display data control unit 810, the data acquisition unit 820, and the coordinate data count unit 830 are a CPU (central processing unit) that executes instructions of a control program that realizes each function, and a ROM (read only memory) that stores the program. A RAM (random access memory) for expanding the program, and a storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is to provide program codes (execution format program, intermediate code program, source program) of control programs for the display data control unit 810, the data acquisition unit 820, and the coordinate data count unit 830, which are software for realizing the functions described above. ) Is recorded in a computer-readable manner to the display data control unit 810, the data acquisition unit 820, and the coordinate data count unit 830, and the computer (or CPU or MPU) is recorded on the recording medium. This can also be achieved by reading and executing the program code.

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Further, the display data control unit 810, the data acquisition unit 820, and the coordinate data count unit 830 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The present invention can be applied to a device that performs numerical input, and in particular, can be suitably applied to a data display / sensor device that allows a user to select an option.

It is a block diagram showing the principal part structure of the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure which shows typically the cross section of the liquid crystal panel with a built-in sensor with which the data display / sensor apparatus which concerns on one Embodiment of this invention is provided. FIG. 3A is a schematic diagram showing a state in which a position touched by a user is detected by detecting a reflected image on a sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment of the present invention. is there. FIG. 3B is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a shadow image on the sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment of the present invention. . It is a block diagram which shows the principal part structure of the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure which shows typically an example of the frame structure of the command used with the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure explaining an example of the value which can be specified to each field contained in the command shown in FIG. 5, and its outline. FIG. 7A is a result of scanning the entire sensor-equipped liquid crystal panel when the object is not placed on the sensor-equipped liquid crystal panel in the data display / sensor device according to the embodiment of the present invention. Image data. FIG. 7B shows image data obtained as a result of scanning when the user is touching the sensor-equipped liquid crystal panel with a finger in the data display / sensor device according to the embodiment of the present invention. It is a block diagram which shows the structure of the liquid crystal panel with a sensor with which the data display / sensor apparatus which concerns on one Embodiment of this invention is provided, and the structure of its peripheral circuit. FIG. 9A is an explanatory diagram showing a state in which a selection screen is displayed on the data display / sensor device according to the embodiment of the present invention. FIG. 9B is an explanatory diagram showing a state in which a selection screen is displayed when one finger is touched on the data display / sensor device shown in FIG. FIG. 9C is an explanatory diagram showing a state in which a selection screen is displayed when two fingers are touched on the data display / sensor device shown in FIG. 9B. FIG. 9D is an explanatory diagram showing a state in which a confirmation screen is displayed when all fingers are removed from the data display / sensor device shown in FIG. FIG. 9E is an explanatory diagram showing a state where a selection screen is displayed when five fingers are touched on the data display / sensor device shown in FIG. FIG. 9F is an explanatory diagram showing a state when one finger is touched on the data display / sensor device displaying the selection screen shown in FIG. FIG. 10 is a flowchart showing a process flow of the data display / sensor device according to the embodiment of the present invention. It is explanatory drawing explaining operation | movement of the modification of the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a block diagram showing the principal part structure of the modification of the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a flowchart showing a part of flow of a process of the modification of the data display / sensor apparatus which concerns on one Embodiment of this invention.

Explanation of symbols

100 Data display / sensor device (numerical value input device)
300 Display / light sensor unit 301 Liquid crystal panel with built-in sensor (planar member)
700 Data processing unit 800 Main control unit 810 Display data control unit (display data control means)
820 Data acquisition unit (region detection means, coordinate detection means)
830 Coordinate data count unit (input numerical value recognition means)
840 Coordinate data control unit (coordinate control means)
901 Storage unit (storage means)

Claims (7)

A planar member for detecting a nearby image;
An area detecting means for detecting an area of the image on the planar member based on an image of the object detected by the planar member;
A numerical value input device comprising: an input numerical value recognizing unit that counts the number of the regions detected by the region detecting unit and recognizes the counted number of the regions as an input numerical value input by a user. The planar member further displays an image,
A display data control means for displaying an image including a plurality of selection items selectable by the user on the planar member;
The display data control unit causes the planar member to display an image in which the selection item associated with the input numerical value recognized by the input numerical value recognition unit among the plurality of selection items is selected. The numerical input device according to claim 1. The area detection means detects the area at a predetermined timing,
Storage means for storing the input numerical values in the order recognized by the input numerical value recognition means;
The display data control means acquires the latest input numerical value stored in the storage means when the area detection means does not detect the area, and a selection item associated with the acquired input numerical value. The numerical input device according to claim 2, wherein the numerical value input device executes the following function. Coordinate detection means for detecting representative coordinates in the area detected by the area detection means;
A coordinate control unit that calculates a movement amount and a movement direction of the representative coordinates when the region moves, and outputs the movement amount and the movement direction to the display data control unit;
The numerical input device according to claim 2, wherein the display data control unit moves the selection item based on a movement amount and a movement direction of the representative coordinates output from the coordinate control unit. In a numerical input method of a numerical input device provided with a planar member for detecting a nearby image,
A region detecting step for detecting a region of the image on the planar member based on an image of the object detected by the planar member;
A numerical value input method comprising: an input numerical value recognition step that counts the number of the regions detected in the region detection step and recognizes the counted number of the regions as an input numerical value input by a user.   A program for operating the numerical input device according to any one of claims 1 to 4, wherein the computer is driven as each of the above means.   A computer-readable recording medium in which the numerical input program according to claim 6 is recorded.

Images