JP3277052B2 - Coordinate input device and coordinate input method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a coordinate input device, a coordinate specifying information display device and method, and a coordinate specifying information display board. The present invention relates to a technique for inputting the coordinates of a position where the position has been set, and a technique for displaying the optical information.

[0002]

2. Description of the Related Art Conventionally, as a technique for inputting coordinates, for example, a method of inputting coordinates on a display screen of a CRT (Cathode Ray Tube) using a means for reading optical information such as a light pen, and the like, There is a method of inputting coordinates on a tablet with a stylus pen or the like by a resistance pressure type, a capacitance type, an electromagnetic induction type, or the like.

In the case of a coordinate input device using a light pen or the like, the optical amount received by the light pen or the like is compared with the time change of a scanning line on a display screen of a CRT to thereby determine the position indicated by the light pen or the like. Is configured to be able to identify the coordinates. Therefore, this device is used exclusively for inputting coordinates on the display screen of a CRT.

Further, in the case of an apparatus having a tablet of a resistance pressure type, a capacitance type, an electromagnetic induction type, or the like, a tablet and a display means such as a CRT are often used in combination, and a coordinate designation range on the tablet is used. Is associated with the display screen of the display means, and when the stylus pen is moved on the tablet, the cursor is moved on the display screen accordingly.

The technique for inputting coordinates represented by the above-mentioned ones is important as an input means in a personal computer, a workstation, an electronic organizer or the like, or an operating means in a home appliance such as a VCR or a microwave oven. Technology, and various proposals have been made.

Proposals concerning this type of technology include, for example, JP-A-61-296421 (coordinate input device), JP-A-61-296422 (coordinate input device), and JP-A-63-196929. (Image input display device). The two coordinate input devices have a coordinate plate in which optical information for identifying the position of each section is arranged in each section divided in a matrix. When an arbitrary position on the coordinate plate is designated by a coordinate indicator having a detecting means for detecting the optical information, the optical information of the section at that position is read.
Based on the read information, the absolute coordinates of the position designated by the coordinate indicator are identified. In the case of Japanese Patent Application Laid-Open No. 61-296421, a bar code is exemplified as the optical information arranged in the section.
In the case of Japanese Patent Publication No. 22, color information is exemplified. on the other hand,
The image input display device is a device typified by an overhead projector, is configured by integrating a screen on which an image is projected and a touch panel, and displays coordinates of a position designated on the touch panel on the screen. The calculation can be performed based on the enlargement or reduction ratio.

[0007]

In the case of the coordinate input device using a light pen or the like described above, the display means uses a CRT in order to specify the coordinates using the time change of the scanning line on the display screen of the CRT. It must be configured.

In the case of a coordinate input device having a tablet as described above, the tablet must be configured in accordance with various systems such as a resistive type, a capacitive type and an electromagnetic induction type, and the device configuration becomes complicated. Become. In addition, tablets
Usually, since it is configured as a flat plate, a large arrangement space is required.

On the other hand, the aforementioned Japanese Patent Application Laid-Open No. 61-296421.
In the coordinate input device disclosed in Japanese Patent Laid-Open Publication No. 61-296422 and Japanese Patent Application Laid-Open No. 61-296422, the configuration is such that coordinates are specified by optical information. Has the advantage of being simpler. However, a coordinate plate must be used for both, and a wide arrangement space is required as in the related art. In the case of Japanese Unexamined Patent Publication (Kokai) No. 61-296421, it has been proposed to use a barcode as optical information, but the barcode arrangement method and the like have not yet been embodied. . JP-A-61-
Japanese Patent Application Laid-Open No. 296422 proposes a configuration in which color information is used as optical information, a change in color is identified, and coordinates are specified. In the case of this apparatus, a means for reading color information and a means for discriminating a change in color must be provided, so that the structure of the apparatus may be complicated and assembly parts may be expensive.

Further, in the case of the image input / display apparatus disclosed in Japanese Patent Application Laid-Open No. 63-196929, it is necessary to provide a large touch panel, and to recognize the enlargement / reduction ratio of the projected image on the screen. Special mechanism is required.

The present invention has been conceived in view of the above circumstances, and its object is to provide a CRT or an LCD (Liquid Cryst).
al Display) and easily coordinate input can be performed coordinate input device on the display screen of various display means such as plasma, it is to provide a coordinate input how.

[0012]

In order to achieve the above-mentioned object, the invention according to claim 1 has a display screen, and first image information for human perception and X on the display screen.
Array of dots containing two-dimensional coordinate information in the direction and Y direction
Second image information and, in the image information of the second dots of
And Table <br/> Display unit that displays a second inverting the image information obtained by inverting the sequence of during the display of the first image information, a predetermined Thailand
The second image information followed by the second inversion
Said <br/> display means control to that control means so as to display the interrupt image information at the same time alternately, by designating a desired position on the display screen, it is displayed on the display screen image
Instruction means for optically reading information, and the instruction means
From the read image information by the dot included in the second image information.
The display screen is detected from the dot arrangement.
To calculate two-dimensional coordinate information in the X and Y directions at
A coordinate input device; and a calculation output unit that. According to a second aspect of the present invention, there is provided a display device according to the first aspect.
First image information for human recognition on a screen, and the display
Includes two-dimensional coordinate information in the X and Y directions on the screen.
Second image information composed of an array of dots
Second inverted image information obtained by inverting the dot arrangement of the image information
A display step of displaying the first image information and a table of the first image information.
During the display, the second image information is continued at a predetermined timing.
And the second reverse image information is alternately displayed for the same time in the interrupt table.
A control step of controlling said display means to show
And an arbitrary position on the display screen.
For optically reading image information displayed on the screen
An instruction step and image information read in the instruction step
To detect the arrangement of dots included in the second image information,
From the arrangement of the dots, the X direction and the
And a calculation step for calculating two-dimensional coordinate information in the Y direction.
This is a coordinate input method characterized by having

[0013]

[0014]

[0015]

[0016]

[0017]

[0018]

[0019]

[0020]

[0021]

According to the structure of the first aspect , the control means includes the first
During the display of the image information of the second
Subsequently, the image information is alternately divided into the second inverted image information for the same time.
And controls the display means so as to write the display, afterimage effect
The second image information and the second inverted image information
Can be displayed during the display of the first image information so that
You . The calculating means calculates a second value based on the image information read by the instruction means .
The array of dots contained in the image information of
Of the X and Y directions on the display screen from the array of
Calculate dimensional coordinate information . Further, in the structure of claim 2
Thus, the control step includes the step of displaying the first image information.
At a certain timing, the second image information is sequentially followed by a second inversion.
Display the image information so that it is displayed alternately at the same time
Control means, the second image information and the
The first image is displayed so that the second inverted image information cannot be recognized by a person.
It can be displayed while displaying image information. The calculation step is the instruction step.
Included in the second image information from the image information read in the step
The array of dots to be detected is detected, and the display
Calculates two-dimensional coordinate information in X and Y directions on a plane
I do.

[0022]

[0023]

[0024]

[0025]

[0026]

[0027]

[0028]

[0029]

[0030]

An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram including a partial schematic diagram showing a basic configuration of a coordinate input device according to the present embodiment. The coordinate input device 21 includes a display unit 23 and an optical pen 25.
, A coordinate pattern generator 27, a display controller 29, a dot detector 31, a data corrector 33, and a coordinate detector 3.
5 and an information control unit 37. The display unit 23 is for displaying optical information shown in FIGS.
It is configured by an image display device such as a CRT, LCD, or plasma display device. The optical pen 25 is a means for indicating a position on the display unit 23 and reading optical information at the indicated position. The detailed configuration of the optical pen 25 will be described later with reference to FIGS.

The information for specifying the coordinates on the display unit 23 (hereinafter referred to as "coordinate pattern") is generated by the coordinate pattern generation unit 27. The display control unit 29 causes the display unit 23 to display the data of the generated coordinate pattern.

The optical pen 25 is configured so that information in a predetermined area on the display unit 23 can be read.
When the pen tip contacts the display unit 23, the optical pen 25 reads optical information at that position. The data read by the optical pen 25 is sent to the dot detection unit 31. The dot detection unit 31 detects a dot image included in the coordinate pattern shown in FIG. 2 described later, and sends data of the detected dot image to the data correction unit 33. The data correction unit 33 performs a correction process described below on the received dot image data, and sends the corrected data to the coordinate detection unit 35.
The coordinate detection unit 35 detects the coordinates of the position specified by the optical pen 25 based on the corrected dot image data.

The above-described series of operations in the coordinate input device 21 is controlled by the information control unit 37. The information control unit 37 sends a control command signal for controlling the display operation of the display unit 23 to the display control unit 29,
The coordinate data detected by the coordinate detector 35 is received.

[0035]

FIG. 2 is a schematic diagram showing the configuration of a coordinate pattern displayed on the display unit 23. In the illustrated configuration, the display surface of the display unit 23 has a horizontal direction of 0 to 639 and a vertical direction of 0 to 23.
This is a case where nine 640 × 240 dots are included. The coordinate pattern is configured so as to have 106 × 40 blocks as a whole by being divided in units of 6 dots in the horizontal direction except for both horizontal ends and also in units of 6 dots in the vertical direction.

The horizontal position of each block is 0BKx to
Similarly, the vertical position is represented by block numbers 0BKy to 39BKy. 2 × 6 on both sides of the display surface
A block including the dots is formed. The 6 dots at the left end and the 6 dots at the upper end of each block (2 dots for the blocks at both ends in the horizontal direction) always display black.
Other dots are displayed in white or black as required. Note that “displaying black” actually means that the display of the dot is OFF (non-display).

FIG. 3 is a schematic diagram showing the configuration of one block in the coordinate pattern shown in FIG. The information represented by the 6 × 6 dots included in the block will be described with reference to FIG. The dots included in the block are α1 to α6 in the horizontal direction and β1 to
The position is identified by the number β6. For example, the dot at the top left in the block is
The dot at α1β1 and the upper rightmost position are identified as α6β1. "0" or "1" for each dot
Is displayed. If the display data is 1,
In the coordinate pattern shown in FIG. 2, the dot is black (non-display), and when the display data is 0, it is white (display).

The uppermost dot and the leftmost dot in the block, ie, α1β1 to α6β1 and α1
“1” is given to the dots β2 to α1β6 as display data. As a result, in the coordinate pattern shown in FIG. 2, the dots on the boundary between the blocks become black, and a grid-like image pattern in which the display area is divided for each block as the entire coordinate pattern is displayed. become.

Display data “1” is given to the dot of α2β2, and α3β2 to α6β2 and α2β3 to α
Display data “0” is given to the dot of 2β6.
Furthermore, α6β at the lower right position in the block
Display data “0” is given to the dot 6.

The display data "1" given to each dot described above
Alternatively, “0” is fixed data in the coordinate pattern shown in FIG. Α2 given display data “1”
The dot of β2 is a dot representing a coordinate reference in one block. This dot is called a coordinate reference point in the following description.

As described above, the uppermost dot and the leftmost dot in the block, the coordinate reference point, the dots in the same row and the same column with respect to the coordinate reference point, and the lower right position in the block Are given fixed display data. Thus, when the image of the block is read, which dot is the coordinate reference point and the vertical and horizontal directions of the image can always be identified.

The 15 dots other than the dots to which the fixed display data are given in the block are used for displaying information indicating the relative position of the block in the entire coordinate pattern. α3β3-α6β3 and α3β
The eight dots 4 to α6β4 have X0 to X7, respectively.
Is given. The seven dots α3β5 to α6β5 and α3β6 to α5β6 have Y0
To Y6.

The dots X0 to X7 indicate the numbers 0BKx to 105BKx in the horizontal direction in the coordinate pattern shown in FIG. 2 by ON / OFF of each display. Similarly, the dots Y0 to Y6 represent the numbers 0BKy to 39BKy in the vertical direction in the coordinate pattern. In the case of a block including 6 × 6 dots as shown in this embodiment, eight dots can be used in the horizontal direction and seven dots in the vertical direction to represent the position of the block. In the horizontal direction, a maximum of 256 block numbers of 0BKx to 255BKx can be represented, and in the vertical direction, a maximum of 126 block numbers of 0BKy to 125BKy can be defined. When the size of the definable coordinate space is changed, it can be easily adjusted by increasing or decreasing the number of dots included in one block.

FIG. 4 is a schematic diagram showing the configuration of an inverted image of the coordinate pattern shown in FIG. The inverted image of the coordinate pattern is obtained by reversing ON / OFF of the display of each dot. In the present embodiment, when displaying the coordinate pattern on the display unit 23, the display is repeated by switching the coordinate pattern and its inverted image at a predetermined timing.

Specifically, the display controller 29 shown in FIG. 1 receives the data of the coordinate pattern output from the coordinate pattern generator 27 and causes the display 23 to display the coordinate pattern. Then, at a predetermined timing, the display unit 23
By controlling ON / OFF of each dot of
The display unit 23 is controlled so that the coordinate pattern shown in FIG. 2 and the inverted image shown in FIG. 4 are switched and displayed.

As described above, by switching and displaying the coordinate pattern and its inverted image, a person viewing the display unit 23 can recognize each dot in gray due to the afterimage effect. Therefore, the user can input coordinates without being aware that the coordinate pattern is being displayed. By controlling the display time of the coordinate pattern of FIG. 2 and the coordinate pattern of FIG. 4 to be substantially equal, the user is not conscious of this coordinate pattern.

The operation of switching and displaying the coordinate pattern and its inverted image on the display unit 23 is performed during the operation of displaying a normal image on the display unit 23. A normal image varies depending on the type of system to which the coordinate input device 21 is applied. For example, if the coordinate input device 21 is a CAD (Comput
er Aided Design) system, an ordinary image is an image of a design drawing or an image of a system operation menu.

The display control unit 29 (see FIG. 1) switches the coordinate pattern and its inverted image while the normal image is displayed on the display unit 23.
7 is controlled in response to a control command from the control unit 7. The optical pen 25 (see FIG. 1) performs a reading operation in accordance with the timing when the coordinate pattern or its inverted image is displayed on the display unit 23. Then, the display time of the normal image pattern is made longer than the display time of the coordinate patterns of FIGS. 2 and 4, thereby reducing the degree of graying of the display screen by displaying the patterns of FIGS. Can be done.

[0050]

[0051]

[0052]

FIG. 5 is a schematic diagram showing the basic configuration of the optical pen 25 (see FIG. 1). The optical pen 25 includes a condenser lens 39, a CCD (Charge Coupled Device) 41, a signal processing unit 43, a transmission unit 45, a power supply 47, and a piezoelectric element 4.
9 is included. In this configuration, the light 40 in a predetermined range of the reading area of the coordinate pattern (see FIG. 2) emitted from the display unit 23 is condensed on the light receiving surface of the CCD 41 by the condenser lens 39, and the CCD 41 is moved to the reading area. The image of the included coordinate pattern is read. The image information read by the CCD 41 is sent to the signal processing unit 43. The signal processing unit 43 converts the information of the read image into a data signal and sends the data signal to the transmission unit 45. The transmission unit 45 transmits a data signal to the dot detection unit 31 (see FIG. 1) via a signal line 46 that is a communication unit.

The above series of reading operations are performed when the tip of the optical pen 25 is in contact with the display unit 23. That is, the piezoelectric element 4 provided on the bonding portion of the condenser lens 39
9 sends a signal indicating that the condenser lens 39 is in contact with the display surface 23 to the signal processing unit 43. In response to this signal being sent, the signal processing unit 43 operates to process the read output of the CCD 41.

The present invention is not limited to the configuration in which the reading operation is performed when the tip of the optical pen 25 is in contact with the display unit 23. For example, a switch for inputting a reading command by a user is provided. In response to being pressed,
The reading operation may be performed even when the optical pen 25 is separated from the display unit 23. On the other hand, the means for transmitting the output signal of the optical pen 25 to the dot detection unit 31 is not limited to the signal line 46. For example, transmission is possible by infrared communication or the like, so that the optical pen 25 can be used as a cordless instruction means. It may be.

FIG. 6 is a schematic diagram showing the configuration of the light receiving surface of the CCD 41 of the optical pen 25. The light receiving surface of the CCD 41
It is empirically known that a practicable coordinate input device can be configured if the dot density of the coordinate pattern (see FIG. 2) is configured to have about three times the resolution in each of the vertical and horizontal directions. . In the present embodiment, the light receiving surface of the CCD 41 is configured so that the reading area is substantially circular with a predetermined size as shown in the figure.

Note that, instead of the CCD 41, another light receiving element such as a phototransistor or a photodiode can be used. In that case, (6 dots × 3 times) × (6 dots × 3) is provided between the condenser lens 39 and the light receiving element.
A liquid crystal shutter having (double) lattices is provided. And
As shown in FIG. 6, the liquid crystal shutter controls the transmission and blocking of the light of the individual grids so that the read information of the dots included in the coordinate pattern is sequentially incident on the light receiving surface of the light receiving element for each dot. The same resolution as that of such a light receiving surface can be realized.

FIG. 7 is a block diagram including a partial schematic diagram showing a modification of the coordinate input device. This figure shows a basic configuration of a coordinate input device 121 obtained by modifying the coordinate input device 21 shown in FIG. 1, and those having the same functions as those shown in FIG. 1 are denoted by the same reference numerals. . The coordinate input device 121 prints the coordinate pattern shown in FIG. 2 on a predetermined sheet 131 instead of displaying it on the display means, and indicates an arbitrary position on the sheet 131 using the optical pen 125. Thus, the coordinate input can be performed. The coordinate input device 2 shown in FIG.
The difference from 1 is that a printing unit 123 for printing a coordinate pattern on a sheet 131 is provided instead of the display unit 23, and the data of the coordinate pattern generated by the coordinate pattern generating unit 27 is printed on the printing unit 123. This is provided with a print control unit 129 for performing the above operation. The paper 131 on which the coordinate pattern is printed may be used as it is placed on a desk, or may be used by attaching it to, for example, an acrylic plate. Naturally, the present paper is not limited to the output from the printing unit, but can be prepared separately.

FIG. 8 shows the coordinate input device 1 shown in FIG.
FIG. 2 is a schematic diagram showing a basic configuration of an optical pen 125 used for 21. Components having the same functions as those shown in FIG. 5 are denoted by the same reference numerals. Coordinate input device 12
In the case of 1, the coordinate pattern is printed on the paper 131. Therefore, when reading the coordinate pattern with the optical pen 125, it is necessary to irradiate the paper 131 with light and receive the reflected light so that information on the read area can be obtained. Therefore, the optical pen 125 includes a light emitting element 151 for irradiating a reading area on the sheet 131 with light. The light emitting operation of the light emitting element 151 is performed in response to the piezoelectric element 49 outputting a signal indicating that the condensing lens 39 is in contact with the sheet 131 or the signal in response to the pressing of the light emitting instruction switch 153. This is performed in response to a light emission command signal output from the processing unit 43.

[0060]

FIG. 9 is a block diagram including a partial schematic diagram showing another modification of the coordinate input device. In the configuration shown in FIG. 1, the dot detecting unit 31, the data correcting unit 33, and the coordinate detecting unit 35 are provided on the main body side of the coordinate input device 21, and the optical pen 25 has only a reading function. In the configuration shown in FIG. 9, a dot detection function, a data correction function, and a coordinate detection function are provided inside the optical pen 225, and the configuration of the body of the coordinate input device 221 is simplified.

FIG. 10 is a schematic diagram showing the basic configuration of the optical pen 225 used in the coordinate input device 221 shown in FIG. Inside the optical pen 225, the dot detection unit 2 having the same functions as the dot detection unit 31, the data correction unit 33, and the coordinate detection unit 35 shown in FIG.
31, a data correction unit 233, and a coordinate detection unit 235. The transmission unit 245 transmits the coordinate data sent from the coordinate detection unit 235 to the information control unit 37 (see FIG. 9) via the signal line 246.

As in the case of the optical pen 225, the dot detecting section 231, the data correcting section 233, and the coordinate detecting section 23
5 need not be provided inside the optical pen 225. For example, only the dot detector 231 may be provided inside the optical pen 22.
5, the data correction unit 33 and the coordinate detection unit 35 may be provided on the main body side of the coordinate input device 221.

[0064]

Further, another modification of the coordinate input device will be described. In displaying the coordinate pattern on the display unit 23, it is not always necessary to display the coordinate pattern on the entire display surface of the display unit 23. Since the optical pens 25 and 225 read the coordinate pattern in a predetermined range of the designated position, it is sufficient to display a part of the coordinate pattern on the display unit 23 within the range including the read region. Therefore, the coordinate input device is configured to display a part of the coordinate pattern in a range near the coordinates after the coordinates of the position designated last time are detected. At this time, based on the coordinates of the plurality of positions designated up to the previous time, the position designated next time is estimated, and a part of the coordinate pattern is displayed in a predetermined range including the estimated position. Is also good. in this way,
By minimizing the display of the coordinate pattern, the coordinate input operation can be performed without affecting the display of the normal image on the display unit 23.

[0066]

[0067]

Next, referring to FIGS. 11 to 18, the coordinate pattern displayed on the display unit 23 is read using the optical pen 25, and the position of the position indicated by the optical pen 25 is specified based on the read data. The process of detecting coordinates will be described. In the following description, processing in the coordinate input device 21 having the configuration shown in FIGS. 1 to 6 will be described. However, processing in the coordinate input devices 121 and 221 in the two modified examples shown in FIGS. The principle is the same.

FIG. 11 is a schematic diagram showing a reading state of a coordinate pattern. In the figure, a coordinate pattern is displayed on a display unit 23, and two points on the display unit 23 are
Indicate areas A1 and A2 that are read when instructed by. In the reading areas A1 and A2, the central point of the area is P
1, P2. The center points P1 and P2 are positions designated by the optical pen 25, and the coordinate input device 21 detects the coordinates of the center points P1 and P2.

Arrows U1 and U2 indicate the relative upward directions of the read data when the coordinate patterns included in the read areas A1 and A2 are read, respectively. The user of the coordinate input device 21 performs a corresponding input operation without being aware of the up, down, left, and right directions in the reading area of the optical pen 25. Therefore, as in the case of the reading area A1, the upward direction U1 of the read data rarely coincides with the upward direction of the actual coordinate pattern. Normally, as in the case of the reading area A2, the upward direction U2 of the read data does not match the actual upward direction of the coordinate pattern.

FIG. 12 is a schematic diagram showing a process in which the dot detection unit 31 identifies display data (0/1) of each dot included in the coordinate pattern read by the optical pen 25. The illustrated data is data read in the reading area A2 in FIG. In the figure, (a) shows the data immediately after reading, (b) rotates the read data so that the upper direction of the actual coordinate pattern matches the upper direction of the processing data, and FIG. 3 is a diagram showing a state in which is divided for each dot. (C) is a diagram showing a state where the display data of each dot is identified as “0” or “1”.

As shown in FIG. 12A, the data immediately after reading has the point P2 at the center and U2 at the top.
In such a state, since it is difficult to perform the process of detecting the coordinates of the center point P2, the data is rotated such that the upward direction of the read data matches the upward direction of the actual coordinate pattern.

Various methods are known for rotating read data. One example is described below. First, in FIG. 12A, the dot detection unit 31 detects a black (display OFF) portion on the outer peripheral line of the reading area A2. Next, the dot detection unit 31 checks the length of the continuous black portion that has been detected, and detects that the black portion has a length of 6 dots or more. This is a process for detecting a continuous portion of black dots at the boundary between blocks. Here, considering the size of the reading area, if the black portion is 6 dots or more, it can be determined that the dot is a black dot indicating a block boundary. By this processing, in the case of the reading area A2 shown in FIG.
Block boundary lines L1 and L2 can be detected. If two or more black portions having a length of 6 dots or more are detected in the same direction, the longer one is selected. Subsequently, the dot detection unit 31 rotates the data such that the longitudinal direction of the detected block boundary lines L1 and L2 matches the vertical direction or the horizontal direction of the read data. After the rotation processing, a black corner is detected from four corners formed by the block boundary lines L1 and L2. The black corners formed by the block boundaries L1 and L2 correspond to the dots of the coordinate reference points α2β2 shown in FIG. The dot detection unit 31 detects a vertical displacement between the read data and the actual coordinate pattern based on the positional relationship between the block boundary lines L1 and L2 and the coordinate reference point, and a state where the positional relationship between the read data and the actual coordinate pattern matches, that is, When the state as shown in FIG. 12B is reached, the data rotation processing ends.

When the vertical direction of the read data is determined, the dot detecting section 31 divides each block included in the read area for each dot with reference to the block boundaries L1 and L2. Specifically, based on the center line x0, y0 of the block boundary line L1, L2, by setting the dot detection reference line _{x -4 ~x 3, y -3 ~y} 4 based on the dot size , And determine the position of the dot.

The rotation process of the read data is not necessary when the optical pen 25 reads the data while correcting the relative rotation deviation between the read data and the actual coordinates.

When the rotation of the read data and the process of determining the dot position are completed by the above procedure, the dot detecting section 31
The display data of each dot is “0 (white in the figure, display O
N) ”or“ 1 (black in the figure, display OFF) ”. FIG. 12C shows a state where the display data of each dot included in the reading area is determined.

FIGS. 13 and 14 are schematic diagrams showing the process of correcting the display data of each dot included in the reading area and detecting the coordinates of the center point of the reading area. Dot detector 3
1 is based on the display data detected by the procedure shown in FIG. 12, and the data correction unit 33 (see FIG. 1) performs X0 to X7, Y0 to Y6 shown in FIG. The display data of the dot is obtained by the correction processing.

As described above, the dots X0 to X7 and Y0 to Y6 indicate the position of each block in the coordinate pattern, and display data is set according to a certain rule. This rule is shown in FIG. As illustrated, X _n is the same for blocks having the same horizontal position, and Y _n is the same for blocks having the same vertical position.

FIG. 13B shows display data of each dot included in the reading area A2 (see FIG. 11) obtained by the procedure shown in FIG. “?” Is set for a dot whose display data is unknown. According to the rule shown in FIG. 13A, for example, X0 to X7 (hereinafter, referred to as X area) of the upper left block and the lower left block are the same, and the upper left block and the upper right block Y0 to Y6 (hereinafter, referred to as Y area) are the same. Therefore, the display data of the dots included in the four blocks at the upper left, lower left, upper right, and lower right can be obtained from the display data of the blocks related to each other by correction.

Correcting the display data of the block with reference to the data of another block having the same display data in the X area or the Y area is called mutual correction. FIG. 13C shows a state after the mutual correction has been performed on the display data of the four blocks shown in FIG.

Next, the display data of the dot which could not be obtained by the mutual correction is obtained by the prediction correction. This predictive correction means that X _n and X shown in FIG.
from _{n + 1,} the relationship of Y _n and Y _{n + 1,} say the X region of the adjacent blocks in the transverse direction, that determined by prediction based on rule display data of the Y region of the adjacent blocks in the vertical direction. FIG. 14A shows a state after performing the prediction correction on the data shown in FIG.

When the display data of each block is determined by the display data correction processing by the data correction unit 33 described above, the display data is sent to the coordinate detection unit 35.

The coordinate detection unit 35 obtains the number of each block based on the transmitted display data as shown in FIG. 14B, and determines the center point P2 of the reading area at which dot position of which block. Detect if there is. In the example of FIG. 14B, the center point P2 of the reading area A2, that is, the optical pen 25
Can be determined to be included in a block whose number in the horizontal direction (X direction) is 3BKx and whose number in the vertical direction (Y direction) is 2BKy.

Further, the center point P2 in the block
, The coordinates of the center point P2 on the coordinate pattern can be calculated based on the block number and the relative position within the block. In the example, the center point P
2 is on the lower rightmost dot in the block of (X, Y) = (3BKx, 2BKy), and it is detected that the dot coordinates in the coordinate pattern are (X, Y) = (25, 17). ing.

In order to input coordinates with higher accuracy, the resolution of the CCD 41 is increased, as described above, the number of dots included in one block is increased, or the center point P2, ie, the point After obtaining the dot including the set position, interpolation processing is performed using a method such as multipoint interpolation, and the coordinates on the coordinate pattern may be obtained exactly.

FIGS. 15 and 16 are flowcharts showing the processing procedure of the coordinate input device 21. Optical pen 25 (FIG. 5)
), The signal processing unit 43 responds to the signal output from the piezoelectric element 49 indicating that the optical pen 25 is in contact with the display unit 23 (step (hereinafter simply referred to as “S”) 1). ), And reads the imaging information from the CCD 41 (S2). The signal processing unit 43 sends the read data to the dot detection unit 31.

The dot detecting section 31 rotates the read data according to the procedure shown in FIG. 12 (S3), matches the vertical direction of the read data with the vertical direction of the actual coordinate pattern, and is included in each block. Determine the position of the dot.

Here, if the coordinate pattern displayed on the display unit 23 is the positive pattern shown in FIG. 2, the dot detection unit 31 determines the black coordinate reference point and the block boundary (see FIG. 12). The rotation process can be performed by using as a reference. On the other hand, if the coordinate pattern displayed on the display unit 23 is the negative pattern shown in FIG. 4, the dot detection unit 31 does not detect the black coordinate reference point and the block boundary, but outputs the white A coordinate reference point and a block boundary must be detected, and the read data must be rotated with reference to them.

The procedure when the coordinate pattern is a positive pattern will be described. If there is a continuous black portion of 6 dots or more in the read data (YES in S4), it is a block boundary, and it can be determined that the read data is data of a positive coordinate pattern. In this case, the dot detection unit 31 searches for a black coordinate reference point in the rotation processing (S9).

When the coordinate reference point is found (YES in S9), dot detection unit 31 ends the read data rotation process at that time. Next, the dot detection unit 31 divides each block for each dot, identifies display data of each dot, and displays X _n , X _{n + 1} , and X _n shown in FIG.
The data of Y _n and Y _{n + 1} is obtained (S10). After obtaining the data of X _n , X _{n + 1} , Y _n , and Y _{n + 1} , the dot detection unit 31 sends the data to the data correction unit 33. The data correction unit 33 applies the data shown in FIG.
The mutual correction processing shown in (b) and (c) is performed (S1
6).

Next, the data correction section 33 performs the processing shown in FIG.
The prediction correction processing shown in (a) is performed on _Xn and _{Xn + 1} (S17). If the prediction correction process is possible for X _n and X _{n + 1} (Y in S19)
ES) Then, a prediction correction process is performed on Y _n and Y _{n + 1} (S20). The data correction unit 33 calculates Y _n and Y _{n + 1}
If the prediction correction process is possible for (S21)
YES), the data is sent to the coordinate detection unit 35.

The coordinate detecting section 35 performs the coordinate detecting process shown in FIG. 14B on the transmitted data,
The coordinates of the designated position are detected (S22). The coordinate detection unit 35 sends the detected coordinates to the information control unit 37 (S2
3).

At S1, the display unit 2 is moved from the piezoelectric element 49 to the display unit 2.
As long as no signal indicating that it has come into contact with No. 3 is not output (NO in S1), signal processing unit 43 is always in a standby state. If the black portion has no more than 6 dots in S4 (NO in S4), the dot detecting section 31 prints the detected coordinate pattern on the display section 23 or on the printing paper 131. It is determined whether it has been performed (S5).

If the coordinate pattern is displayed on the display unit 23 (YES in S5), there is a possibility that the coordinate pattern is the negative pattern shown in FIG. It is checked whether or not the read data has six or more white portions (S6).

If a portion where a white portion is continuous for 6 dots or more is found (YES in S6), dot detecting section 31 performs processing in a negative coordinate pattern. Dot detector 3
1 is to perform processing in a negative coordinate pattern.
The procedure shown in S9 and S10 is performed for the white coordinate reference point (S12, S13). Then, the dot detection unit 31 inverts the detected data for subsequent mutual correction and prediction correction processing (S14).

The dot detecting section 31 determines the coordinate reference point for black (S9) or the reference point for white color (S12), and if the coordinate reference point cannot be determined (S9). (NO, NO in S12), it is determined whether the rotation of the read data has reached 360 ° (S7). If the rotation of the read data has not yet reached 360 ° (YES in S7), the dot detection unit 31
Further, the read data is rotated (S3), and the process of obtaining the coordinate reference point is continued. When the rotation of the read data has already reached 360 °, the dot detection unit 31 (S
(NO at 7), since it is impossible to detect the data, it is processed as a coordinate input error (S8).

Further, the data correction unit 33 performs the processing in S19 and S19.
X at S21_nAnd X_{n + 1}, Y_nAnd Y _{n + 1}Forecast about
If correction is not possible, control is transferred to the dot detector 31.
You. The dot detecting unit 31 returns to S7 and further performs the rotation process.
Processing or handle the coordinate input error.

If the processing of S1 to S23 is completed, 1
The coordinate input process by the optical pen 25 is ended.

FIGS. 17 and 18 show S1 shown in FIG.
6 is a flowchart illustrating a detailed procedure of a mutual correction process of No. 6; In order to facilitate the explanation, FIG.
In the schematic diagrams of the read data shown in (b) and (c),
In the upper left block of the four blocks, block A,
A description will be given with the upper right block named Block B, the lower left block named Block C, and the lower right block named Block D.

As shown in FIGS. 13 (b) and 13 (c), the data correction unit 33 first sets X0 to X0 of the block A.
Among the dots of X7, those whose display data is "?" Are detected, and the data of the dots of X0 to X7 of the block C are set to the dots (S31). Similarly, the data correction unit 33 sets the data of the dots X0 to X7 of the block A to those of “?” In the dots X0 to X7 of the block C (S32).

Next, the data correction section 33 collates X0 to X7 of block A with X0 to X7 of block C (S3).
3) For a dot whose display data does not match, "?"
Is set (S34). Similarly, the data correction unit 33 mutually corrects each of X0 to X7 for the block B and the block D (S35 to S3).
8).

Subsequently, the data correction unit 33 outputs the block A
A mutual correction process is performed on Y0 to Y6 of the block and the block B (S40 to S43). Similarly, the data correction unit 33
Is for Y0 to Y6 of block C and block D.
A mutual correction process is performed (S50 to S53).

The data correction section 33 performs the processing in S31 to S5
By the process of 3, the mutual correction process of each dot of the four blocks A, B, C, D relating to the reading area A2 is performed.
For the dots for which "?" Has been set in S34, S38, S43, and S53, the data correction unit 33 sets the display data of "0" or "1" in the subsequent prediction correction processing. Try.

As described above, according to this embodiment, the coordinates of the designated position are detected using the optical coordinate pattern displayed on the display device or printed on the printing paper. The type of display device is limited,
The coordinate input processing can be easily performed without using a complicated tablet device or the like.

The present invention is not limited to the configuration described above, and various modifications are possible. For example, the coordinate input devices 21, 121, and 221 are not limited to the applications described in the present embodiment, but may be CAD or other information processing systems, or general household appliances having an operation panel, or The present invention can be widely applied to an overhead projector or the like used by projecting an image on a screen.

In the case of an overhead projector, the configuration of the optical pen is not used in contact with the screen. For example, the tip is bent in a U-shape so that optical information emitted from the projection device side can be read. It is desirable to provide a telephoto lens or the like at the tip so that a coordinate pattern projected on a screen can be imaged from a long distance, or to adjust the resolution unit of a light receiving element such as a CCD as a reading means.

As optical information for specifying coordinates, not only a matrix-like coordinate pattern as shown in this embodiment but also a general bar code may be used.

[0108]

As described above, the coordinate input according to the present invention is performed.
According to the device , the control means displays the first image information.
In the meantime, at a predetermined timing, the second image information is
2 Inverted image information alternately displayed for the same time (for example,
If it ’s too short for people to see)
Control the display means, the second image information and the second counter
Each dot becomes gray (dot
Is displayed in black and white), and the person can read the second image information and the second image information.
Cannot be further recognized. The calculation means is:
Included in the second image information from the image information read by the instruction means
Detect the array of dots to be displayed and display from the array of dots
The two-dimensional coordinate information in the X and Y directions on the screen is calculated . Thus, the human perception only the first image information
By, it is possible to calculate the coordinates on the display screen by using the second image information which a person can not be recognized. In addition, high precision
When inputting the coordinates, the 1 included in the second image information
Even if the number of dots of two two-dimensional coordinate information is increased, the second image
Due to the afterimage effect of the image information and the second inverted image information, each dot
Is gray (dots are displayed in black and white)
The second image information and the second inverted image information cannot be recognized.
And let people recognize only the first image information,
Coordinates can be entered. From the above,
In the light coordinate input device, the type of display device is controlled as in the past.
Use limited or complicated tablet devices
Without this, the coordinate input processing can be easily performed. In addition, the present invention
According to the coordinate input method of the first aspect, in the control step, the first image
While displaying information, the second image information is displayed at a predetermined timing.
Then, the second inverted image information is alternately displayed for the same time in the interrupt table.
Indications (for example, a time that is too short for humans to perceive)
Since the display means is controlled to cause the second image information
Each dot is grayed out due to the afterimage effect between the image and the second inverted image information.
Color (dots are displayed in black and white)
The information and the second inverted image information cannot be further recognized. Arithmetic
In the output step, the image information read in the instruction step is
2 is detected, and the dot arrangement included in the image information is detected.
Of the X and Y directions on the display screen from the array of
Calculating a two-dimensional coordinate information. This gives people a first
A second image that only the image information can be recognized
The coordinates on the display screen can be calculated using the image information.
You. Also, when performing high-precision coordinate input, the second screen
Increase the number of dots of one two-dimensional coordinate information included in the image information
Even if the second image information and the second inverted image information remain,
Each dot is gray due to the image effect (dots are displayed in black and white)
The second image information and the second inverted image
Information cannot be recognized, and only the first image
Recognition allows input of highly accurate coordinates.
From the above, the coordinate input method of the present invention is
The type of display device is limited to the
Coordinate input processing can be easily performed without using a
I can do it.

According to the second aspect of the present invention, the control means
Alternates the two pieces of information when displaying the second piece of information
Then, the display means is controlled so as to display the same time. This
, The dot patterns are inverted from each other.
Therefore, by displaying these two information repeatedly,
In humans, each dot is gray (dots are displayed in black and white) due to the afterimage effect.
If indicated). This allows a person to
Recognize that the second information of the turn is displayed
No longer recognizes only the first information that represents normal information
I do. The instruction means displays the second information on the display surface.
Reading the second information at the same timing
Can be.

According to the third aspect of the present invention, the display step
The pre-defined first information for human recognition
To display time and specify coordinates on the display surface
Time table shorter than the predetermined time for the second information
Is displayed repeatedly. For example, the first information
Indicates a time that can be visually recognized by a person. Second
Information is displayed only for a short period of time so that people can not visually recognize it
do not do. In the state where such a display is repeated, the instruction step
When the position on the display surface is indicated by, the indicated display surface
On the display surface based on the second information corresponding to the upper position.
The coordinates are calculated.

According to the fourth aspect of the present invention, on the display surface
To specify coordinates on the display surface around predetermined coordinates
Following the first step of displaying information for
Based on data obtained by indicating information content
Performing the second step of calculating the coordinates specified by the
Specify coordinates based on coordinates calculated in step 2
To determine and display the next display position of the information to perform
Steps are performed. This second step and the third step
Is repeated in the fourth step . Therefore, the display
When indicating coordinates on the surface continuously, the image display device
A position determined based on the coordinates previously indicated above
Display the coordinate identification information on the
Information can be prevented from being displayed. This
And coordinates only when needed at the required location on the image display surface
The coordinate input operation can be performed while displaying the specific information .

[0112]

[0113]

[0114]

[0115]

[0116]

[Brief description of the drawings]

FIG. 1 is a block diagram including a partial schematic diagram showing a basic configuration of a coordinate input device according to an embodiment of the present invention.

FIG. 2 is a schematic diagram illustrating a configuration of a coordinate pattern displayed on a display unit.

FIG. 3 is a schematic diagram showing a configuration of one block in a coordinate pattern.

FIG. 4 is a schematic diagram illustrating a configuration of an inverted image of a coordinate pattern.

FIG. 5 is a schematic diagram showing a basic configuration of an optical pen.

FIG. 6 is a schematic diagram illustrating a configuration of a light receiving surface of a CCD of the optical pen.

FIG. 7 is a block diagram including a partial schematic diagram showing a basic configuration of a coordinate input device using a coordinate pattern printed on a sheet.

FIG. 8 is a schematic diagram showing a basic configuration of an optical pen used in a coordinate input device using a coordinate pattern printed on a sheet.

FIG. 9 is a block diagram showing a basic configuration of a modified example of the coordinate input device, including a partial schematic diagram showing a configuration of the coordinate input device in a case where the optical pen has a dot detection unit, a data correction unit, and a coordinate detection unit; It is.

FIG. 10 is a schematic diagram illustrating a basic configuration of an optical pen according to a modification including a dot detection unit, a data correction unit, and a coordinate detection unit.

FIG. 11 is a schematic diagram showing a reading state of a coordinate pattern.

FIG. 12 is a schematic diagram showing a process of identifying display data of each dot included in the coordinate pattern read by the optical pen.

FIG. 13 is a schematic diagram illustrating a process of correcting display data of each dot included in a reading area and detecting coordinates of a center point.

FIG. 14 is a schematic diagram illustrating a process of correcting display data of each dot included in a reading area and detecting coordinates of a center point.

FIG. 15 is a flowchart illustrating a processing procedure of the coordinate input device.

FIG. 16 is a flowchart illustrating a processing procedure of the coordinate input device.

FIG. 17 is a flowchart illustrating a procedure of a mutual correction process.

FIG. 18 is a flowchart illustrating a procedure of a mutual correction process.

[Explanation of symbols]

 21, 121, 221 Coordinate input device 23 Display unit 25, 125 Optical pen 27 Coordinate pattern generation unit 29 Display control unit 31 Dot detection unit 33 Data correction unit 35 Coordinate detection unit 37 Information control unit 39 Condenser lens 41 CCD 43 Signal processing Unit 45 transmission unit 123 printing unit 129 printing control unit 131 paper 231 dot detection unit 233 data correction unit 235 coordinate detection unit 245 transmission unit A1, A2 reading area P1, P2 center point of reading area U1, U2 upward reference of read data Line X0-X7 Dot for X-direction notation Y0-Y6 Dot for Y-direction notation

Claims (2)

(57) [Claims] 1. A first image information having a display screen for human recognition and a second image information comprising an array of dots including one-dimensional coordinate information in the X and Y directions on the display screen. And the dot arrangement of the second image information is inverted.
And Viewing means that displays a second inverting the image information which has to While browsing of the first image information at a predetermined timing,
Following the second image information, the second inverted image information
Said system that controls the display unit control means so as to interrupt the display at the same time alternately, by designating a desired position on the display screen, reading the image information displayed on the display screen in the optical and instruction means for, in the second image information from the image information said instruction means is read
From Included detects an array of dots, those 該Do Tsu door of the array
Coordinate input device characterized by chromatic and calculation detecting means that to calculate the two-dimensional coordinate information of the X and Y directions on the display screen. 2. A second image comprising, on a display screen of a display means, first image information for human recognition and an array of dots including two-dimensional coordinate information in the X and Y directions on the display screen. Information and an array of dots of the second image information.
A display step of displaying a second inverted image information is inverted, the While browsing of the first image information at a predetermined timing,
Following the second image information, the second inverted image information
A control step for controlling the display means so as to interrupt the display at the same time alternately, by designating a desired position on the display screen, for reading image information optically displayed on the display screen an instruction step, the instruction to detect the sequence of dots included from the image information read in step to the second image data, 2-dimensional coordinate information of the X and Y directions on the display screen from this 該Do Tsu City of sequence characterized in that it has a calculation step of calculating a
Coordinate input method to.