JP3551591B2 - Pen input device - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a pen input device in a computer system or the like having a handwriting input function, and more particularly to a pen input device capable of improving operability and diversifying usage by enabling remote input.
[0002]
[Prior art]
Conventionally, as an input device in a computer system or the like having a handwriting input function,
1) Infrared method
2) Pressure-sensitive method
3) Capacitance method
4) Electromagnetic method
5) By ultrasonic method
Etc. are known.
[0003]
Here, as the method using the infrared ray method of 1), a spot position detected by a light pen that emits an infrared ray is detected using a semiconductor position detecting element, and a plurality of infrared light emitting elements and a light receiving element are arranged on an input surface. In addition, there has been known an apparatus that detects a pointed position by determining a position where infrared light emitted from an infrared light emitting element is blocked by a finger, an input pen, or the like from an output of the light receiving element.
[0004]
In the pressure sensing method 2), an electrode sheet provided with a plurality of X-axis electrodes and a support provided with a plurality of Y-axis electrodes are overlapped with a dot spacer interposed therebetween. One that uses a pressure panel, one that superimposes two parallel plates via a three-dimensional spring, and that detects a designated position by detecting a change in current at a position touched by a finger, an input pen, or the like is known. Has been.
[0005]
According to the capacitance method 3), conductive films formed by vapor deposition on two sheets of glass are used as X-axis and Y-axis electrode patterns, respectively, and these two sheets of glass face the electrode pattern forming surface. Panels using a capacitive coupling type panel that is attached and bonded are known.
[0006]
Further, in the electromagnetic method of 4), a plurality of sensor antenna coils are arranged on the input surface, and a resonance circuit including a coil and a capacitor is built in the input pen. The current is passed to the resonance circuit of the input pen using electromagnetic induction by flowing the current, and then the alternating current flowing to the plurality of sensor antenna coils is cut off. There is known a device that detects a pointing position of an input pen by detecting a magnetic field generated by a flowing current with the plurality of sensor antenna coils.
[0007]
In the ultrasonic method of 5), an ultrasonic vibration element and an ultrasonic receiving element for generating an ultrasonic surface acoustic wave are provided on a glass substrate, and the presence of an elastic wave absorber such as a finger is determined as described above. There is known an ultrasonic surface acoustic wave method and the like which detect the change from a change in a reception signal of an ultrasonic receiving element.
[0008]
Further, as disclosed in Japanese Utility Model Application Laid-Open No. 64-7340, microphones are arranged at three or more known points on the same plane, A sounding body that can be placed at an arbitrary coordinate position is provided, and a position of a hyperbola including the sounding body is determined from a time difference between voltages generated in two microphones among the microphones. In some cases, the coordinate position of the sounding body is determined.
[0009]
[Problems to be solved by the invention]
However, since each of the above conventional input devices only detects an input position with respect to a predetermined one input surface, for example, even if an input position on a predetermined handwriting input board can be detected, Handwriting input could not be performed at a position away from the handwriting input board.
[0010]
Therefore, in the conventional input device, each operator is forced to perform a handwriting operation on the predetermined handwriting input board. In particular, in a conference or the like using a large screen screen as a handwriting input surface, the operability is poor for the participants. This became more pronounced as the input surface size increased.
[0011]
In order to solve this point, a configuration in which a plurality of handwriting input boards are provided and local input is enabled by inputting the plurality of handwriting input boards to the system via the input port is also considered. Must distribute this handwriting input board to multiple operators, and the multiple handwriting input boards must be connected by signal lines, so that the entire system becomes expensive, and Since they must be connected by wires, there is a problem in their operability.
[0012]
In addition, a configuration is conceivable in which an information device that performs main processing and an information device used by each operator are connected via a network, and local input processing is performed by each operator. The problem that it became expensive occurred.
[0013]
Therefore, an object of the present invention is to provide a pen input device that enables handwriting pen input from a plurality of operators with an inexpensive configuration.
[0014]
[Means for Solving the Problems]
In order to achieve the above object, a first aspect of the present invention is directed to a pen input device for inputting a position indicated by an input pen (1, 2 in FIG. 1). 11, 15, 17) and a plurality of ultrasonic receiving elements (31a, 31b, 31c in FIG. 1) which are disposed at predetermined positions in the three-dimensional space and receive the ultrasonic waves transmitted from the ultrasonic transmitting means. ), A first input means having a first input area (10 in FIG. 1), and a predetermined distance from the input area of the first input means. A second input unit having a second input area (20 in FIG. 1) provided, and a plurality of ultrasonic waves of the ultrasonic receiving unit based on reception outputs of a plurality of ultrasonic receiving elements of the ultrasonic receiving unit. The first coordinate system fixed to the array position of the receiving element A computing means (42 in FIG. 1) for computing designated position information indicating a designated position by a force pen, and whether the designated position corresponding to the designated position information computed by the computing means is included in the first input area. Discriminating means (43 in FIG. 1) for discriminating whether the designated position is included in the second input area; and, when the discriminating means determines that the designated position is included in the first input area, the designated position First conversion means (44 in FIG. 1) for converting information into first position information indicating a position on a second coordinate system fixed to the first input area; Is determined to be included in the second input area, the designated position information is converted into second position information indicating a position on a third coordinate system fixed to the second input area. And second conversion means (45 in FIG. 1). The features.
[0015]
In the above configuration,
A display unit (50 in FIG. 1) for performing a display corresponding to a position pointed by the input pen with respect to a first input area of the first input unit or a second input area of the second input unit; Display control means for performing display control on the display means based on the first position information converted by the first conversion means and the second position information converted by the second conversion means (46 in FIG. 1) And further characterized by:
[0016]
Here, the ultrasonic transmitting means transmits ultrasonic waves at a preset timing, and the calculating means includes a plurality of ultrasonic receiving means based on ultrasonic transmitting timing from the ultrasonic transmitting means. It is possible to detect the reception timing of the ultrasonic wave from the ultrasonic wave transmitting means by the ultrasonic reception element and calculate the indicated position information based on the reception timing.
[0017]
Further, the input pen includes a plurality of input pens, and the ultrasonic wave transmitting means is disposed on each of the plurality of input pens, and the preset timing is set corresponding to each of the input pens. The arithmetic unit is configured to transmit the ultrasonic wave from each ultrasonic transmission unit by a plurality of ultrasonic reception elements of the ultrasonic reception unit based on the ultrasonic transmission timing from each ultrasonic transmission unit corresponding to each input pen. The reception timing of the ultrasonic wave is detected, and the pointing position information corresponding to each of the input pens is calculated based on the reception timing.
[0018]
Further, the ultrasonic wave transmitting means can receive timing information indicating the preset timing via the pen holder when the input pen is stored in a pen holder (34 in FIG. 3). .
[0019]
According to a second aspect of the present invention, an input pen (1 in FIG. 12) for inputting position information and a first input surface formed by the input pen are provided and a display based on the position information input by the input pen is performed. In a pen input device having display means (500 in FIG. 12), an ultrasonic transmitting means (11, 15, 17 in FIG. 6) provided on the input pen, and a predetermined position with respect to the first input surface. An ultrasonic receiving means (30 in FIG. 1) having a plurality of ultrasonic receiving elements (31a, 31b, 31c in FIG. 1) arranged in a relationship and receiving ultrasonic waves transmitted from the ultrasonic transmitting means; A remote input unit disposed at a predetermined distance from the first input surface and having a second input surface (21 in FIG. 12 and 22 in FIG. 20) by the input pen; The ultrasonic receiving element with respect to the array position First pointing position information with respect to the first input surface by the input pen based on first information indicating a relative positional relationship of the first input surface and reception outputs of a plurality of ultrasonic receiving elements of the ultrasonic receiving means. And second information indicating the relative positional relationship of the second input surface with respect to the array position of the plurality of ultrasonic receiving elements of the ultrasonic receiving means. A second calculating means (45 in FIG. 1) for calculating second pointing position information with respect to the second input surface by the input pen based on reception outputs of the plurality of ultrasonic receiving elements of the ultrasonic receiving means; A display control means (46 in FIG. 1) for controlling display on the display means based on the first designated position information and the second designated position information.
[0020]
Here, the second input surface is made of paper (21 in FIG. 12) writable by a writing instrument, and the input pen can be configured by mounting the ultrasonic wave transmitting means on the writing instrument.
[0021]
Further, the remote input means includes a notifying means for notifying the second information to the second computing means, and the notifying means is arranged in a predetermined positional relationship with respect to the second input surface. 32, Ua, Ub, Uc, Ud in FIG. 21 and 261 in FIG. 32, and the second arithmetic unit includes a plurality of ultrasonic reception units of the ultrasonic reception unit. The second information may be calculated based on a reception output of an ultrasonic wave from the position information notification ultrasonic wave transmitting means by an element.
[0022]
Further, the second input surface is made of paper (21 in FIG. 12) writable by a writing instrument, and the ultrasonic wave transmitting unit for positional information notification (261 in FIG. 32) is provided with a clip (FIG. 32) for sandwiching the paper. 260).
[0023]
Further, the second input surface is formed of a binder (250 in FIG. 30) in which a plurality of sheets writable by a writing instrument are bound, and the binder is a detecting unit (FIG. 30) for detecting a page turn due to the detachment of the sheet. 255) and page turning information notifying means (Ua, Ub, Uc, Ud in FIG. 21) for notifying the display control means of page turning information based on the detection output of the detecting means. Can be.
[0024]
According to a third aspect of the present invention, an input pen (1 in FIG. 23) for inputting position information and a first input surface formed by the input pen are provided, and a display based on the position information input by the input pen is performed. In the pen input device having the first display means (500 in FIG. 23), the ultrasonic input means (11, 15, 17 in the figure) provided on the input pen and a predetermined distance from the first input surface. Ultrasonic receiving means (30 in FIG. 1) having a plurality of ultrasonic receiving elements (31a, 31b, 31c in FIG. 1) arranged in the following positional relationship and receiving ultrasonic waves transmitted from the ultrasonic transmitting means. And a second display means disposed at a predetermined distance from the first input surface to constitute a second input surface by the input pen and to perform a display based on position information input by the input pen. Remote input means (FIG. 23) 22) first information indicating a relative positional relationship of the first input surface with respect to an arrangement position of the plurality of ultrasonic receiving elements of the ultrasonic receiving means, and a plurality of ultrasonic receiving elements of the ultrasonic receiving means; First calculating means (44 in FIG. 1) for calculating first pointing position information of the input pen with respect to the first input surface based on the reception output of the input pen, and a plurality of ultrasonic receiving elements of the ultrasonic receiving means Based on the second information indicating the relative positional relationship of the second input surface with respect to the array position and the reception output of the plurality of ultrasonic receiving elements of the ultrasonic receiving means, with respect to the second input surface by the input pen. Second calculating means (45 in FIG. 1) for calculating the second designated position information; the first display means and the second designated position information based on the first designated position information and the second designated position information; Table in display means Characterized by comprising a display control means for controlling (46 in Figure 1).
[0025]
BEST MODE FOR CARRYING OUT THE INVENTION
In the pen input device of the present invention, an ultrasonic wave generating means for transmitting ultrasonic waves to the input pen is provided, and a position indicated by the input pen is detected using the ultrasonic waves transmitted from the ultrasonic wave generating means.
[0026]
That is, in the present invention, a plurality of three-dimensionally arranged ultrasonic receiving elements are used as ultrasonic receiving means for receiving ultrasonic waves transmitted from the input pen. In this case, the position of the input pen based on the reception outputs of the plurality of ultrasonic receiving elements can be detected three-dimensionally.
[0027]
Therefore, for example, when a first input area and a second input area separated by a predetermined distance from the first input area are set as the input areas by the input pen, the first input area and the second input area , It is possible to detect the position indicated by the input pen. Here, in the present invention, since the position of the input pen can be detected three-dimensionally, the position of the first input area and the second input area may be in any state. If the positional relationship between the first input area and the second input area with respect to the plurality of three-dimensionally arranged ultrasonic receiving elements can be known, an instruction with the input pen in the first input area and the second input area can be made. Each position can be detected.
[0028]
Here, the positional relationship between the first input region and the second input region with respect to the plurality of three-dimensionally arranged ultrasonic receiving elements may be detected using a position indicated by an input pen. Preferably, another ultrasonic wave transmitting means for notifying position information is provided for each of the first input area and the second input area, and detection is performed based on the ultrasonic wave transmitted from the ultrasonic wave transmitting means for notifying position information. May be configured.
[0029]
The ultrasonic wave transmitting means for notifying position information can be constituted by, for example, ultrasonic wave transmitting elements provided at four corners of the local input device corresponding to the second input area. Further, the ultrasonic wave transmitting means for notifying the position information may be provided on a clip for binding a sheet provided corresponding to the second input area.
[0030]
Further, a configuration is conceivable in which display control of a graphic or the like is performed on the display screen of the display device based on the position information input in the first input area and the position information input in the second input area. A display device may be provided corresponding to the region and the second input region, or a display device may be provided corresponding to only one of the first input region and the second input region. Good.
[0031]
The number of input pens is not limited to one, and a plurality of input pens can be used.
[0032]
For example, when a display device having a large display screen is considered, a display screen of the display device is set as a first input area, and a second input area is set away from the display apparatus, for example, on a table. think of.
[0033]
Here, considering a configuration in which the input pen is provided with a function as a drawing pen and a figure drawn by the input pen is displayed on the display screen of the display device, the first input pen is displayed on the display screen of the display device. The drawn figure is displayed on the display screen of the display device, and the figure drawn by the second input pen on the second input area set on the table remote from the display device is displayed on the display device. Control for display on the display screen becomes possible.
[0034]
Here, the second input pen may be composed of a pen that can write on paper, and the second input area may be composed of paper that can be drawn with the second input pen. The region may be configured by a display screen of another display device that performs the same display as the above display device.
[0035]
By the way, in the above configuration, it is necessary to determine whether the designated position is for the first input area or the second input area using the first and second input pens. This determination can be made by checking whether the indicated position belongs to the first input area or the second input area with the input pen based on the three-dimensional detection position of the input pen.
[0036]
The number of the input areas is not limited to two, and a plurality of three or more areas can be set.
[0037]
Hereinafter, embodiments of a pen input device according to the present invention will be described in detail with reference to the accompanying drawings.
[0038]
FIG. 1 is a block diagram showing a schematic configuration of one embodiment of an information processing system configured by applying a pen input device according to the present invention.
[0039]
In FIG. 1, the information processing system displays an image corresponding to a designated position designated by using stylus pens (hereinafter, simply referred to as pens) 1 and 2 for inputting information on a display unit 50. In, a plurality of input areas of a first input area 10 and a second input area 20 are set for inputting a position indicated by the pens 1 and 2.
[0040]
Here, the first input area 10 is disposed, for example, in association with the display unit 50 and forms a main input area of the system, and the second input area 20 is formed of the first input area 10. In other words, the local input area is provided at a predetermined distance from the display unit 50 and can input a designated position at an arbitrary position.
[0041]
Further, the first input area 10 and the second input area 20 may be configured by a planar two-dimensional input area, or may be configured by a three-dimensional area formed of a fixed three-dimensional space. Good.
[0042]
Note that the first input area 10 is not disposed in relation to the display unit 50 as described above, and the first input area 10 is separated from the display unit 50 by a predetermined distance in the same manner as the second input area 20. And a local input area in which a designated position can be input at an arbitrary position.
[0043]
In this embodiment, the pens 1 and 2 are provided with ultrasonic transmitting means for outputting ultrasonic waves from the tips thereof as will be described later in detail, and the pens 1 and 2 for the first input area 10 and the second input area 20 are provided. An ultrasonic receiving unit 30 having a set of ultrasonic receiving means composed of a plurality of (three in the embodiment) ultrasonic receiving elements 31a, 31b, and 31c in which positions indicated by 1, 2 are three-dimensionally arranged. To detect and control the display on the display unit 50 in accordance with the detection result.
[0044]
First, detection of the pointing position by the pens 1 and 2 with respect to the first input area 10 and the second input area 20 by the three ultrasonic receiving elements 31a, 31b and 31c three-dimensionally arranged in this embodiment. The principle will be described.
[0045]
FIG. 2 shows the relationship between the three ultrasonic receiving elements 31a, 31b, and 31c three-dimensionally arranged and the pointing position of the pen 1 among the pens 1 and 2.
[0046]
Now, consider a three-dimensional coordinate system XYZ fixed to three ultrasonic receiving elements 31a, 31b, and 31c arranged three-dimensionally.
[0047]
Here, the ultrasonic receiving element 31a is disposed at the origin of the three-dimensional coordinate system XYZ, and the ultrasonic receiving element 31b is located on the Y axis of the three-dimensional coordinate system XYZ. (0, Ly, 0), and the ultrasonic receiving element 31c is disposed at a point (0, 0, Lz) on the Z-axis of the three-dimensional coordinate system XYZ. I do.
[0048]
Further, it is assumed that the position pointed by the pen 1 is a point (x, y, z) on the three-dimensional coordinate system XYZ, and from the ultrasonic receiving element 31a to the point (x, y, z). Is n, the distance from the ultrasonic receiving element 31b to the point (x, y, z) is m, and the distance from the ultrasonic receiving element 31c to the point (x, y, z) is l.
l²= (Lz-z)²+ N²-Z²                        … (1)
n²= X²+ Y²+ Z²                                  … (2)
m²= X²+ (Ly-y)²+ Z²                        … (3)
Is established. From equations (1) to (3), solving for x, y, z
x = ± SQRT [n²− ｛(Ly²+ N²-M²) / 2Ly｝²
− ｛(Lz²+ N²−l²) / 2Lz｝²] ... (4)
y = (Ly²+ N²-M²) / 2Ly (5)
z = (Lz²+ N²−l²) / 2Lz (6)
Here, SQRT (A) indicates the square root of A.
[0049]
It becomes. Here, since Ly and Lz are known values determined by the arrangement positions of the ultrasonic receiving elements 31a, 31b, and 31c, the distance n from the ultrasonic receiving element 31a to the point (x, y, z) is n, If the distance m from the ultrasonic receiving element 31b to the point (x, y, z) and the distance 1 from the ultrasonic receiving element 31c to the point (x, y, z) are known, the three-dimensionally arranged 3 The position (x, y, z) indicated by the pen 1 on the three-dimensional coordinate system XYZ fixed to the three ultrasonic receiving elements 31a, 31b, 31c can be obtained.
[0050]
In this embodiment, the distance n from the ultrasonic receiving element 31a to the position (x, y, z) indicated by the pen 1 and the distance from the ultrasonic receiving element 31b to the position (x, y, z) indicated by the pen 1 m, the distance 1 from the ultrasonic receiving element 31c to the position (x, y, z) indicated by the pen 1 is detected using the ultrasonic wave output from the tip of the pen 1.
[0051]
Specifically, the detection of the distance n, the distance m, and the distance 1 is based on the time Ta, Tb, Tc until the ultrasonic wave output from the tip of the pen 1 is detected by the ultrasonic receiving elements 31a, 31b, 31c. This is done by detecting.
[0052]
That is, assuming that the spatial transmission speed of the ultrasonic wave output from the tip of the pen 1 is C, the distances n, m, and l are obtained by detecting the times Ta, Tb, and Tc.
n = C × Ta (7)
m = C × Tb (8)
1 = C × Tc (9)
Can be obtained by
[0053]
The processing for detecting the time Ta, Tb, Tc until the ultrasonic wave output from the tip of the pen 1 is detected by the ultrasonic wave receiving elements 31a, 31b, 31c is performed by the reception processing in the ultrasonic wave receiving unit 30 shown in FIG. This is performed in the unit 32.
[0054]
FIG. 3 shows a specific configuration of the reception processing unit 32 in the ultrasonic receiving unit 30 shown in FIG. In this embodiment, a pen holder 35 for accommodating the pen 1 when the pen 1 is not used is provided. The pen holder 35 includes, as described in detail later, an ultrasonic output from the ultrasonic transmission means of the pen 1. A synchronization circuit 35 is provided for synchronizing the output timing of the sound wave with the reception processing in the reception processing unit 32.
[0055]
The synchronization circuit 35 counts the basic clock output from the basic clock generation circuit 324 provided in the reception processing unit 32, and outputs the basic clock every time the counted value becomes a constant value, which is output from the ultrasonic transmission unit of the pen 1. It is configured to output a synchronization signal for controlling the output timing of the ultrasonic wave.
[0056]
The pen 1 is provided with a basic clock generation circuit (not shown) that generates a basic clock having the same frequency as that of the basic clock generation circuit 324. The basic clock generation circuit stores the pen 1 in a pen holder 35. Then, the synchronization signal output from the synchronization circuit 35 is input to establish synchronization with the basic clock generation circuit 324 provided in the reception processing unit 32, and the pen 1 is taken out of the pen holder 35. Thereafter, the basic clock output from the basic clock generation circuit operating in synchronization with the basic clock generation circuit 324 provided in the reception processing unit 32 is counted as in the case of the synchronization circuit 35, and the count value is constant. The output timing of the ultrasonic wave output from the ultrasonic wave transmitting means of the pen 1 is controlled every time when the value of.
[0057]
That is, when the pen 1 is stored in the pen holder 35, the output timing of the ultrasonic wave output from the ultrasonic transmission unit of the pen 1 and the reception processing in the reception processing unit 32 are synchronized, and the ultrasonic transmission unit of the pen 1 The output timing of the output ultrasonic wave coincides with the timing of the synchronization signal applied from the synchronization circuit 35 to the reception processing unit 32.
[0058]
The synchronization signal applied from the synchronization circuit 35 to the reception processing unit 32 is applied to reset terminals of the counters 321, 322, and 323 of the reception processing unit 32, and the counters 321, 322, and 323 are cleared in synchronization with the synchronization signal. .
[0059]
The basic clock output from the basic clock generation circuit 324 is input to the count input terminals of the counters 321, 322, and 323, and the control input terminal for controlling the counting stop of the counters 321, 322, and 323 is connected to a pen. The receiving clocks output from the ultrasonic receiving elements 31a, 31b, and 31c when receiving the ultrasonic wave output from the front end of the receiving device 1 are input.
[0060]
That is, the counters 321, 322, and 323 are simultaneously reset at the timing when the ultrasonic wave is output from the tip of the pen 1, and the basic clock generation circuit 324 is operated until the reception clock is input from each of the ultrasonic receiving elements 31a, 31b, and 31c. Are counted, and as a result, the count values of the counters 321, 322, and 323 indicate the time until the ultrasonic waves output from the tip of the pen 1 are detected by the ultrasonic receiving elements 31a, 31b, and 31c. These correspond to Ta, Tb, and Tc.
[0061]
FIG. 4 is a timing chart showing the operation of detecting the times Ta, Tb, and Tc by the counters 321, 322, and 323.
[0062]
That is, the basic clock generation circuit (not shown) of the pen 1 generates the basic clock shown in FIG. 4A, and generates an ultrasonic wave from the tip of the pen 1 in synchronization with the rise of the synchronization signal shown in FIG. A transmission clock shown in FIG. 4C for output is generated, and the ultrasonic transmission means of the pen 1 is driven in synchronization with the transmission clock shown in FIG.
An ultrasonic drive signal shown in (d) is generated. The ultrasonic driving signal of the pen 1 is driven by the ultrasonic driving signal, and the ultrasonic wave is output from the tip of the pen 1 only while the transmission clock is generated.
[0063]
The ultrasonic waves output from the tip of the pen 1 are received by the ultrasonic receiving elements 31a, 31b, and 31c, and the ultrasonic receiving elements 31a, 31b, and 31c correspond to the reception of the ultrasonic waves in FIG. ) Is output. Therefore, the counters 321, 322, and 323 determine the time T from the rising timing of the synchronization signal shown in FIG. 4B to the rising timing of the reception clock shown in FIG. 4E, that is, the times Ta, Tb, and Tc. It can be obtained by counting the basic clocks shown in FIG.
[0064]
Times Ta, Tb, and Tc until the ultrasonic waves output from the tip of the pen 1 counted by the counters 321, 322, and 323 are detected by the ultrasonic wave receiving elements 31a, 31b, and 31c are represented by a reception time holding circuit 325. These are held at 326 and 327, respectively, and transmitted to the arithmetic processing unit 40 shown in FIG.
[0065]
In the above description, the detection processing of the time Ta, Tb, Tc until the ultrasonic wave output from the tip of the pen 1 is detected by the ultrasonic receiving elements 31a, 31b, 31c has been described. The times Ta, Tb, and Tc until the ultrasonic waves output from are detected by the ultrasonic receiving elements 31a, 31b, and 31c can be similarly detected.
[0066]
The arithmetic processing unit 40 receives the times Ta, Tb, and Tc transmitted through the communication unit 33 through the communication unit 41, and instructs the arithmetic unit 42 with the pens 1 and 2 based on the times Ta, Tb, and Tc. The calculated designated position is calculated.
[0067]
The arithmetic processing unit 40 first calculates the distances n, m, and 1 from the pens 1 and 2 to the ultrasonic receiving elements 31a, 31b, and 31c based on the above-described equations (7) to (9).
[0068]
Then, based on the calculated distances n, m, and l and the equations (4) to (6), the pen on the three-dimensional coordinate system XYZ fixed to the ultrasonic receiving elements 31a, 31b, and 31c. The designated position (x, y, z) according to 1 and 2 is calculated. Next, the discriminating unit 43 specifies the positions (x, y, and x) indicated by the pens 1 and 2 on the three-dimensional coordinate system XYZ fixed to the ultrasonic receiving elements 31a, 31b, and 31c calculated by the calculating unit 42. Based on z), it is determined whether the position (x, y, z) indicated by the pens 1 and 2 belongs to the first input area 10 or the second input area 20.
[0069]
When the determination unit 43 determines that the position (x, y, z) indicated by the pen 1 or 2 belongs to the first input area 10, the first conversion unit 44 uses the three-dimensional coordinate system. The position (x, y, z) indicated by the pens 1 and 2 on XYZ is converted to the position (x1, y1,...) On the three-dimensional coordinate system X1-Y1-Z1 fixed to the first input area 10. z1).
[0070]
When the determination unit 43 determines that the position (x, y, z) indicated by the pen 1 or 2 belongs to the second input area 20, the second conversion unit 45 uses the three-dimensional coordinate system. The position (x, y, z) indicated by the pens 1 and 2 on XYZ is converted to the position (x2, y2, z2).
[0071]
In this case, the relative position of the three-dimensional coordinate system X1-Y1-Z1 fixed to the first input area 10 with respect to the three-dimensional coordinate system XYZ fixed to the ultrasonic receiving elements 31a, 31b, 31c. , And the relative position of the three-dimensional coordinate system X2-Y2-Z2 fixed to the second input area 20 is presupposed. If this is known, the above-described conversion is performed by a well-known coordinate conversion process. It can be done easily.
[0072]
The relative position of the three-dimensional coordinate system X1-Y1-Z1 fixed to the first input area 10 with respect to the three-dimensional coordinate system XYZ fixed to the ultrasonic receiving elements 31a, 31b, and 31c, and A specific method for obtaining the relative position of the three-dimensional coordinate system X2-Y2-Z2 fixed to the two input areas 20 will be described later in detail.
[0073]
Thereafter, in the display control unit, the pointing positions (x1, y1, z1) of the pens 1 and 2 converted by the first converting unit 44 and the pointing positions of the pens 1 and 2 converted by the second converting unit 45 ( x2, y2, z2) to control the display on the display unit 50.
[0074]
Here, in this embodiment, the three-dimensional designated positions (x1, y1, z1) and (x2, y2, z2) can be designated by the pens 1, 2, so that the display unit 50 displays the three-dimensional designated positions. Three-dimensional display corresponding to the indicated positions (x1, y1, z1) and (x2, y2, z2) is possible.
[0075]
If the display unit 50 is a display device capable of three-dimensional display, the three-dimensional display based on the three-dimensional designated position (x1, y1, z1) and (x2, y2, z2) may be performed as it is. When the display unit 50 is a two-dimensional display, the three-dimensional display based on the three-dimensional designated positions (x1, y1, z1) and (x2, y2, z2) is combined with gradation display or color display. May be performed.
[0076]
Further, it is possible to perform two-dimensional input from a space other than the input plane by using only the x and y values of the three-dimensional coordinate values calculated by the arithmetic processing unit 40. Can be improved.
[0077]
Next, a specific detailed configuration of the pens 1 and 2 and the ultrasonic receiving unit 30 and the arithmetic processing unit 40 shown in FIG. 1 will be described.
[0078]
FIG. 5 shows the appearance of the pen 1 used in this embodiment. The pen 1 shown in FIG. 5 has a first button 14a and a second button 14b in addition to having an ultrasonic transmitting unit inside. Here, the first button 14a is constituted by a simple push button, and the second button 14b is constituted by a push button with a latch mechanism having an ON state holding mechanism.
[0079]
As will be described later, the first button 14a is operated when drawing with the pen 1 or when executing a predetermined command, and the second button 14b uses the pen 1 to use the second input area. Sometimes operated.
[0080]
FIG. 6 shows an internal circuit configuration of the pen 1. 6, the pen 1 has a transmission timing control unit 11 for controlling the transmission timing of the ultrasonic wave from the pen 1 and an operational amplifier 16, and amplifies the ultrasonic drive clock output from the transmission timing control unit 11. It has an amplifier 15 and an ultrasonic transmitter 18, and has a transmitter 17 for transmitting ultrasonic waves based on an ultrasonic transmitter drive signal output from the amplifier 15.
[0081]
By the way, in this embodiment, since a multi-pen function that can simultaneously use a plurality of pens and a multi-mode function that can switch a plurality of modes, which will be described in detail later, are enabled, the transmission timing control unit 11 The state of the ultrasonic wave transmission timing control from the pen 1 according to the output of the button 14 composed of the first button 14a and the second button 14b and the basic clock from the oscillator (basic clock generating unit) 13 for generating the basic clock. It has a sequencer 12 for controlling transition. The details of the state transition control of the ultrasonic transmission timing control by the sequencer 12 will be described later.
[0082]
Although the pen 1 has been described with reference to FIGS. 5 and 6, the pen 2 has the same configuration as the pen 1.
[0083]
FIG. 7 shows a specific configuration of the ultrasonic receiving unit 30 and the arithmetic processing unit 40 shown in FIG.
[0084]
7, the ultrasonic receiving unit 30 includes a receiving sensor unit 31, a receiving processing unit 32, and a communication unit 33.
[0085]
Here, the receiving sensor unit 31 has the ultrasonic receiving elements 31a, 31b, and 31c shown in FIG.
[0086]
The reception processing unit 32 includes an amplifier unit 60 and a reception timing control unit 70. The amplifier unit 60 includes an operational amplifier 61. The reception timing control unit 70 includes a counter, a register 71, a sequencer 72, an oscillator 73, An SCC (serial communication control unit) initialization unit 74 is provided.
[0087]
Here, the counter and the register 71 correspond to the counters 321, 322 and 323 and the reception time holding circuits 325, 326 and 327 shown in FIG. 3, and the oscillator 73 generates the basic clock shown in FIG. This corresponds to the circuit 324.
[0088]
The sequencer 72 controls a transition state of the reception timing control of the reception timing control unit 70 based on the basic clock output from the oscillator 73. The sequencer 72 is reset by a synchronization signal (reset signal) from the synchronization circuit 35 of the pen holder 34 shown in FIG. 3, and controls the transition state of the reception timing control in the reception timing control unit 70. The details of the control of the transition state of the reception timing control by the sequencer 72 will be described later.
[0089]
The communication unit 33 includes an SCC (serial communication control unit) 331 and a 232C driver 332 for driving an RS232C interface.
[0090]
In FIG. 7, the arithmetic processing unit 40 includes a window processing unit (Win for Pen) that controls a display corresponding to the pointing position of the pens 1 and 2, a mouse driver, and the like. It is composed of a personal computer connected to the communication unit 33 of the ultrasonic receiving unit 30 via the interface.
[0091]
FIG. 8 is a state transition diagram showing the state transition of the ultrasonic wave transmission timing control by the sequencer 12 provided in the pen shown in FIG.
[0092]
By the way, in this embodiment, as described above, a multi-pen function capable of simultaneously using a plurality of pens is provided, and whether or not to select the multi-pen function and the number of pens to be used simultaneously are determined by a dip switch (not shown). Is switched.
[0093]
Now, the multi-pen function is selected by a dip switch (not shown) (MPen = 1), and the number of pens used simultaneously is PenNO = 0 (for example, corresponding to pen 1) and PenNO = 1 (for example, corresponding to pen 2). It is assumed that the two are set.
[0094]
In the state transition diagram shown in FIG. 8, the transition from one transition state to another transition state is performed by using the basic clock output from the oscillator 13 shown in FIG. 6 provided in the pen with PenNO = 0 or PenNO = 1. It is performed every time a predetermined number is counted.
[0095]
8, a state 142 (Init 0000 (0)) is a so-called initial state of the pen. When the pen is stored in the pen holder 34 shown in FIG. 3 and receives a synchronization signal from the synchronization circuit 35 of the pen holder 34 (ResetPen). = 1) from any state 141 (AnyState) to this state 142 (Init 0000).
(0)). In this state 142 (Init 0000 (0)), nothing is performed.
[0096]
By the way, in this case, since the multi-pen function is set to MPen = 1, the pen with PenNO = 0 transits to the state 143 (Trace 0001 (1)), and PenNO = 1. The pen changes to the state 151 (WaitMPen0 1100 (9)).
[0097]
The state 143 (Trace 0001 (1)) is a state in which the ultrasonic receiving unit 30 shown in FIG. 7 recognizes the position of the pen with PenNO = 0. In other words, this is a state in which the cursor displayed on the display unit 50 shown in FIG. 1 is moved in accordance with the position of the pen. Therefore, in this state, an ultrasonic wave is output from the pen with PenNO = 0.
[0098]
In the state 143 (Trace 0001 (1)), the second button 14b of the pen of PenNO = 0 shown in FIG. 5 is not pressed (ModeSync = 0), and the pen of PenNO = 0 in FIG. When the first button 14a is pressed (PenDownSync = 1), the state transits to the state 145 (Data0 0110 (6)), otherwise, the state 144 (Dummy0 0010 (2)) ).
[0099]
In the state 145 (Data0 0110 (6)), in order for the ultrasonic receiving unit 30 to recognize that the first button 14a of the pen of PenNO = 0 is pressed, ultrasonic waves are transmitted from the pen of PenNO = 0. Output.
[0100]
From this state 145 (Data0 0110 (6)), a transition is made to the state 147 (Dummy1 0101 (5)) unconditionally.
[0101]
In the state 144 (Dummy0 0010 (2)), nothing is performed. If the second button 14b is pressed in this state 144 (Dummy0 0010 (2)) (ModeSync = 1), the state 146 (Mode 0011) is not performed. The state transits to (3)), and if the second button 14b is not pressed (ModeSync = 0), the state transits to the state 147 (Dummy10101 (5)).
[0102]
In the state 146 (Mode 0011 (3)), in order to make the ultrasonic receiving unit 30 recognize that the second button 14b of the pen of PenNO = 0 is pressed, the ultrasonic wave is transmitted from the pen of PenNO = 0. Output.
[0103]
In the state 146 (Mode 0011 (3)), if the first button 14a of the pen with PenNO = 0 is pressed (PenDownSync = 1), the state 149 (Data20100 (8)) is set. When the first button 14a of the pen with PenNO = 0 is not pressed (PenDownSync = 0), the state transits to the state 150 (Dummy20100 (4)).
[0104]
In the state 147 (Dummy1 0101 (5)), nothing is performed. In this state 147 (Dummy1 0101 (5)), when the first button 14a of the pen with PenNO = 0 is pressed, (PenDownSync) is pressed. = 1), the state transits to the state 148 (Data1 0111 (7)). If the first button 14a of the pen with PenNO = 0 is not pressed (PenDownSync = 0), the state 150 (Data1 0111 (7)) is reached. Dummy20100 (4)).
[0105]
From the state 149 (Data2 0100 (8)), the state 150 (Dummy2 0100 (4)), and the state 148 (Data1 0111 (7)), when the multi-pen function is selected (MPen = 1), the state 151 ( The state transits to WaitMPen0 1100 (9). If the multi-pen function is not selected (MPen = 0), the state transits to the state 143 (Trace 0001 (1)).
[0106]
By the way, since it is assumed that the multi-pen function is currently selected, that is, (MPen = 1), here, the state 149 (Data2 0100 (8)), the state 150 (Dummy2 0100 (4)), and the state 148 (Data1 0111 (7)) to state 151 (WaitMPen0 1100 (9)).
[0107]
Further, the pen of PenNO = 1 that has transitioned from the state 142 (Init 0000 (0)) to the state 151 (WaitMPen0 1100 (9)) is unconditionally unconditionally set to the state 152 (WaitMPen1 1101 (A)) and the state 153 (WaitMPen2 1110). (B)), and transitions to the state 143 (Trace 0001 (1)) via the state 154 (WaitMPen3 1110 (C)).
[0108]
The pen of PenNO = 1 that has transited to the state 143 (Trace 0001 (1)) then performs the same state transition as the pen of PenNO = 0.
[0109]
Further, the pen of PenNO = 0 that has transitioned from the state 149 (Data2 0100 (8)), the state 150 (Dummy2 0100 (4)), or the state 148 (Data1 0111 (7)) to the state 151 (WaitMPen0 1100 (9)) is Similarly to the pen with PenNO = 1, the state is unconditionally passed through the state 152 (WaitMPen1 1101 (A)), the state 153 (WaitMPen2 1110 (B)), the state 154 (WaitMPen3 1110 (C)), and the state 143 (Trace 0001). Transition to (1)).
[0110]
Then, the pen of PenNO = 0 and the pen of PenNO = 1 repeat the above-mentioned state transition until these pens are stored in the pen holder 34 shown in FIG. 3 and receive a synchronization signal from the synchronization circuit 35 of the pen holder 34.
[0111]
FIG. 9 is a timing chart showing ultrasonic wave transmission timing control of the pen of PenNO = 0 and the pen of PenNO = 1 when the multi-pen function is selected (MPen = 1).
[0112]
As is clear from the state transition diagram shown in FIG. 8, the pen with PenNO = 0 and the pen with PenNO = 1 alternately transmit ultrasonic waves with four ultrasonic transmission timings as one unit.
[0113]
That is, as shown in FIG. 9, the pen with PenNO = 0, that is, the pen Pen # 0 transmits ultrasonic waves with four ultrasonic transmission timings as one block. Here, the ultrasonic transmission period at each ultrasonic transmission timing is Tsend, and the ultrasonic transmission interval is Twwait. At the first ultrasonic transmission timing of the four ultrasonic transmission timings, the cursor displayed on the display unit 50 shown in FIG. 1 is controlled in accordance with the position of the pen Pen # 0. Always transmit ultrasonic waves. Further, at the second ultrasonic transmission timing, the ultrasonic waves are transmitted only when the first button 14a is pressed with the pen Pen # 0. Further, at the third ultrasonic transmission timing, the ultrasonic waves are transmitted only when the second button 14b is pressed with the pen Pen # 0. Further, at the fourth ultrasonic transmission timing, similarly to the second ultrasonic transmission timing, ultrasonic waves are transmitted only when the first button 14a is pressed with the pen Pen # 0.
[0114]
Also, the pen with PenNO = 1, that is, the pen Pen # 1 transmits ultrasonic waves with four ultrasonic transmission timings as one block, similarly to the pen Pen # 0. That is, at the first ultrasonic transmission timing of the four ultrasonic transmission timings, the cursor displayed on the display unit 50 shown in FIG. 1 is controlled to follow the position of the pen Pen # 1. Always transmit ultrasonic waves. At the second ultrasonic transmission timing, the ultrasonic wave is transmitted only when the first button 14a is pressed with the pen Pen # 1. At the third ultrasonic transmission timing, ultrasonic waves are transmitted only when the second button 14b is pressed with the pen Pen # 1. Further, at the fourth ultrasonic transmission timing, similarly to the second ultrasonic transmission timing, ultrasonic waves are transmitted only when the first button 14a is pressed with the pen Pen # 1.
[0115]
Here, the pen Pen # 0 and Pen # 1 are configured to generate ultrasonic waves indicating that the first button 14a has been pressed at both the second ultrasonic transmission timing and the fourth ultrasonic transmission timing. The reason is that, in this embodiment, the drawing is performed while pressing the first button 14a when drawing with the pen, so that the detection density (sampling cycle) of the designated position related to this drawing is increased. .
[0116]
The ultrasonic driving signal (ultrasonic driving clock) generated at each ultrasonic transmission timing is, for example, an FHz signal, and the ultrasonic driving clock is transmitted to the transmitting unit 17 via the amplifier unit 15 shown in FIG. In addition, the transmission unit 17 transmits the FHz ultrasonic waves.
[0117]
In the above description, the case where the multi-pen function is selected (MPen = 1) has been described. If the pen is one of PenNO = 0 and the multi-pen function is not selected (MPen = 0), FIG. In the state transition diagram shown in FIG. 8, there is no transition from the state 142 (Init 0000 (0)) to the state 151 (WaitMPen0 1100 (9)), and the state 149 (Data2 0100 (8)) and the state 150 (Dummy2 0100) (4)), the state transits from the state 148 (Data1 0111 (7)) to the state 143 (Trace 0001 (1)), and this state transition is stored in the pen holder 34 shown in FIG. This is repeated until a synchronization signal is received from the synchronization circuit 35 of the pen holder 34.
[0118]
In this case, only the ultrasonic wave transmission timing control by the pen Pen # 0 shown in FIG. 9 is repeated.
[0119]
When the multi-pen function is selected (MPen = 1) and the number of pens to be used simultaneously is three or more, each pen transmits ultrasonic waves sequentially with four ultrasonic transmission timings as one unit. become.
[0120]
FIG. 10 is a state transition diagram showing the state transition of the reception timing control by the sequencer 72 shown in FIG.
[0121]
The state transition shown in FIG. 10 changes in synchronization with the state transition of the ultrasonic transmission timing control in the pen shown in FIG. 8. When the multi-pen function is selected in the pen (MPen = 1), the state transition is made. The ultrasonic waves received at the timings of 722 (Trace0 001 (1)), state 723 (Data0 010 (2)), state 724 (Mode0 011 (3)), and state 725 (Data1 100 (4)) are PenNO = 0. Processed as ultrasonic waves transmitted from the pen, state 726 (Trace 1 101 (5)), state 727 (Data 2 110 (2)), state 728 (Mode 1 111 (7)), state 729 (Data 3000 (0)) The ultrasonic wave received at the timing of (1) is processed as the ultrasonic wave transmitted from the pen of PenNO = 1.
[0122]
When the multi-pen function is not selected in the pen (MPen = 0), the state 722 (Trace0 001 (1)), the state 723 (Data0 010 (2)), the state 724 (Mode0 011 (3)), and the state 725 (Data1 100 (4)), state 726 (Trace1 101 (5)), state 727 (Data2 110 (2)), state 728 (Mode1 111 (7)), and state 729 (Data3000 (0)). Are processed as the ultrasonic waves transmitted from the pen with PenNO = 0.
[0123]
In FIG. 10, a state 729 (Data 3000 (0)) is an initial state of a transition state of the reception timing control in the ultrasonic receiving unit 30, and a hardware reset (ResetPen = 1) is performed on the ultrasonic receiving unit 30. Occurs, the state transits from any state 721 (AnyState) to this state 729 (Data3000 (0)).
[0124]
The designated position based on the ultrasonic wave received in this state 729 (Data 3000 (0)) is recognized as drawing data on the display unit 50 shown in FIG.
[0125]
From the state 729 (Data3000 (0)), a transition is made to the state 722 (Trace0 001 (1)) unconditionally.
[0126]
The designated position based on the ultrasonic wave received in the state 722 (Trace0 001 (1)) is recognized as position data in the display unit 50 shown in FIG.
[0127]
From the state 722 (Trace0 001 (1)), the state transits unconditionally to the state 723 (Data0 010 (2)).
[0128]
The designated position based on the ultrasonic wave received in this state 723 (Data0 010 (2)) is recognized as drawing data on the display unit 50 shown in FIG.
[0129]
From the state 723 (Data0 010 (2)), the state transits unconditionally to the state 724 (Mode0 011 (3)).
[0130]
The ultrasound received in this state 724 (Mode 0 011 (3)) is recognized as mode switching data for switching the pen input area from the first input area shown in FIG. 1 to the second input area.
[0131]
From the state 724 (Mode0 011 (3)), the state unconditionally transits to the state 725 (Data1 100 (4)).
[0132]
The designated position based on the ultrasonic wave received in this state 725 (Data1 100 (4)) is recognized as drawing data on the display unit 50 shown in FIG.
[0133]
From the state 725 (Data1 100 (4)), the state transits unconditionally to the state 726 (Trace1 101 (5)).
[0134]
The designated position based on the ultrasonic wave received in this state 726 (Trace1 101 (5)) is recognized as position data in the display unit 50 shown in FIG.
[0135]
From the state 726 (Trace1 101 (5)), the state transits unconditionally to the state 727 (Data2 110 (2)).
[0136]
In this state 727 (Data2 110 (2)), the designated position based on the ultrasonic wave received in is recognized as drawing data on the display unit 50 shown in FIG.
[0137]
From the state 727 (Data2 110 (2)), the state transits unconditionally to the state 728 (Mode1 111 (7)).
[0138]
The ultrasonic waves received in this state 728 (Mode 1 111 (7)) are recognized as mode switching data for switching the pen input area from the first input area to the second input area shown in FIG.
[0139]
From the state 728 (Mode1 111 (7)), the state transits unconditionally to the state 729 (Data3000 (0)).
[0140]
The above state transition is repeated until a hardware reset occurs in the ultrasonic receiving unit 30.
[0141]
FIG. 11 is a state transition diagram showing a state transition of data transmission control for transmitting data from the communication unit 33 shown in FIG. 7 to the arithmetic processing unit 40 via the RS232C interface.
[0142]
In FIG. 11, a state 802 (Init 000) is an initial state of this state transition, and when a hardware reset (ResetSync = 1) occurs in the communication unit 33, the state 802 (AnyState) changes from any state 801 (AnyState). The state transits to the state 802 (Init 000). In this state 802 (Init 000), nothing is performed.
[0143]
In this state 802 (Init 000), the mode is the initial setting mode for the SCC (serial communication control unit) 331 shown in FIG. 7 (SCCNotlnit = 1), and the setting permission (not shown) for the SCC (serial communication control unit) 331 If the DIP switches for use (PushSWSync and PushSWBSync) indicate that the setting is permitted (DataCount0 = 1, PushSWBSync = 1, DataCount0 = 1, PushSWASync = 1), the state transits to the state 803 (SetUp 001). In this case, the state remains at this state 802.
[0144]
From the state 803 (SetUp 001), the state transits in the order of the state 804 (Write 010), the state 805 (Hold 011), and the state 806 (CountUp 100).
[0145]
Here, the state 803 (SetUp 001), the state 804 (Write 010), and the state 805 (Hold 011) are provided for generating a bus cycle for writing data to the SCC 331. That is, after the hardware reset (ResetSync = 1) occurs, the initial setting value of 42 bytes is written to the SCC 331 during the initial setting mode for the SCC 331 (SCCNotlnit = 1).
[0146]
In the state 806 (CountUp 100), the following two processes are performed. 1) The initialization mode of the SCC 331 is determined, that is, the number of initialization data written to the SCC 331 is monitored.
[0147]
2) It is determined whether all of the data transferred from the reception timing control unit 70 has been written to the SCC 331.
[0148]
When all the above processes are completed, the state transits to the state 807 (WaitData 101).
[0149]
In the state 807 (WaitData 101), it is determined whether the reception sensor unit 31 shown in FIG. 7 has received an ultrasonic wave from a pen. If not received (RdySync = 0), the state remains at the state 807 (WaitData 101), but if received (RdySync = 1), the state transits to the state 808 (WaitLoad0 110).
[0150]
The state 808 (WaitLoad0 110) transits to the state 802 (Init 000) via the state 809 (WaitLoad1 111).
[0151]
Here, the state 808 (WaitLoad0 110) and the state 809 (WaitLoad1 111) are states in which time is taken to receive the data transferred from the reception timing control unit 70.
[0152]
FIG. 12 shows a schematic configuration of another embodiment of the information processing system configured by applying the pen input device according to the present invention.
[0153]
The embodiment shown in FIG. 12 uses the display screen 500 of the system main body 100 as a first input surface and uses the local operation paper placed on a table or the like provided at an arbitrary position away from the system main body 100. 21 is a second input surface.
[0154]
In this embodiment, by pointing an arbitrary position on the display screen 500 of the system main body 100 with the pen 1, the pointing position on the display screen 500 of the system main body 100 can be input, and the display of the system main body 100 A display based on the designated position on the screen 500 can be displayed on the display screen 500.
[0155]
In addition, by pointing an arbitrary position on the local operation paper 21 with the pen 1, an instruction position for the local operation paper 21 can be input, and a display based on the instruction position for the local operation paper 21 is displayed on the display screen 500. Can be displayed.
[0156]
Here, the pen that indicates an arbitrary position on the display screen 500 and the pen that indicates an arbitrary position on the local operation paper 21 may be the same pen, or the multi-pen function of the present invention may be used. Thus, a pen for designating an arbitrary position on the display screen 500 and a pen for designating an arbitrary position on the local operation paper 21 may be constituted by different pens.
[0157]
In the embodiment shown in FIG. 12, the first input area 10 in the embodiment shown in FIG. 1 is provided on the display 50, and the second input area 20 is provided on a table or the like remote from the display 50. It corresponds to the case where the display unit 50 is placed on the display screen 500 in FIG. 12 and the second input area 20 is the local operation paper 21 in FIG. In the configuration shown in FIG. 12, the configuration of the pen 1 and the configuration for detecting the position indicated by the pen 1 on the display screen 500 and the position indicated on the local operation paper 21 are basically the same as those shown in FIG. It is.
[0158]
That is, as shown in FIGS. 5 and 6, the pen 1 is constituted by a simple push button, and is constituted by a first button (drawing button) 14a for drawing or command input and a push button with a latch mechanism. It has a second button (local input switching button) 14b for switching which input surface on the display screen 500 or the local operation paper 21 is to be selected. It is configured to transmit an ultrasonic wave at a predetermined timing according to the state transition diagram shown.
[0159]
In addition, the ultrasonic receiving elements 31a, 31b, 31c three-dimensionally arranged in a predetermined relationship with the display screen 500 are attached to the system main body 100, and the ultrasonic waves transmitted from the tip of the pen 1 are attached. Are received by the ultrasonic receiving elements 31a, 31b, and 31c, and the pointing position on the display screen 500 and the pointing position on the local operation paper 21 by the pen 1 are detected from the reception timing.
[0160]
In the configuration shown in FIG. 12, the local operation paper 21 can be arranged at an arbitrary position away from the system main body 100. In this case, in order to detect the position indicated by the pen 1 on the local operation paper 21 in the system main body 100, the local operation paper relative to the arrangement position of the ultrasonic receiving elements 31a, 31b and 31c attached to the system main body 100 is detected. 21 need to be detected.
[0161]
In this embodiment, in order to detect the relative position of the local operation paper 21 with respect to the arrangement position of the ultrasonic receiving elements 31a, 31b, 31c, the local operation paper 21 is input before the position input using the local operation paper 21 is performed. The user performs an operation of instructing a plurality of positioning areas set in advance by using the pen 1.
[0162]
FIG. 13 shows a specific configuration of the local operation paper 21. The local operation paper 21 has areas R1 to R5 for selecting functions of the pen 1 and an area R6 to be a drawing area by the pen 1.
[0163]
Here, the region R1 is a region instructed to make the pen 1 function as a drawing pen. The region R2 is a region instructed to cause the pen 1 to function as an eraser, that is, an eraser for erasing a drawn image or the like.
[0164]
The regions R3 to R5 are regions instructed to select the thickness of the drawing line when the pen 1 functions as a drawing pen.
[0165]
For example, let pen 1 function as a drawing pen and change the thickness of the drawing line at that time.
In the case of “medium”, first, the tip of the pen 1 is matched with the region R1, the first button 14a of the pen 1 is pressed, and then the tip of the pen 1 is matched with the region R4, and An operation of pressing one button 14a is performed.
[0166]
Thereafter, when a predetermined image is drawn in the region R6 while the first button 14a of the pen 1 is pressed, a drawing line having a thickness of “medium” is displayed on the display screen 500 of the system main body 100. Become.
[0167]
The local operation paper 21 has four corners in order to notify the system main body 100 of the relative position of the local operation paper 21 with respect to the arrangement position of the ultrasonic receiving elements 31a, 31b, and 31c. Four positioning areas P1 to P4 are provided.
[0168]
In this embodiment, when the initial setting data is collected before the position input using the local operation paper 21, the four positioning areas P1 to P4 preset on the local operation paper 21 are sequentially designated by the pen 1. This notifies the system body 100 of the relative position of the local operation paper 21 with respect to the position of the ultrasonic receiving elements 31a, 31b, 31c.
[0169]
FIG. 14 is a flowchart showing the process of collecting the initial setting data.
[0170]
When the initial setting data collection is started (step 201), first, n is set to 1 (step 202), and "pointing the positioning area n with a pen" is displayed on the display, that is, the display screen 500 of the stem body 100. , Press the drawing button "is displayed (step 203).
[0171]
Next, it is checked whether the drawing button (first button 14a) has been pressed (step 204). If it has not been pressed (no in step 204), the process returns to step 204, but if it has been determined that the button has been pressed (step 204). In step 204, the pen coordinates at the time when the button is pressed are detected as (xn, yn, zn) (step 205).
[0172]
Next, n = n + 1 is set (step 206), and it is checked whether n = 5 (step 207). Here, if n = 5 is not satisfied (no in step 207), the detection of the four positioning areas P1 to P4 has not been completed yet, so the process returns to step 203, and the processing from step 203 to step 207 is repeated.
[0173]
If n = 5 is satisfied in step 207 (yes in step 207), the detection of the four positioning areas P1 to P4 has all been completed, and this initial setting data collection ends (step 208).
[0174]
When the coordinates (xn, yn, zn) (n = 1 to 4) of the four positioning areas P1 to P4 are obtained in this way, the coordinates of the areas R1 to R6 are calculated based on these coordinates.
[0175]
Calculation of the coordinates of the regions R1 to R6 can be performed as described below. Now, as shown in FIG. 15, the distances in the horizontal direction from the positioning area P1 to the point at the upper left corner of the area R1 and the point at the upper right corner of the area R1 are denoted by A1 and A2, respectively, and from the positioning area P1 to the upper left of the area R1. The distance in the vertical direction from the corner point to the point at the lower left corner of the region R1 is B1, B2, the distance from the positioning region P1 to the positioning region P2 is A, and the distance from the positioning region P1 to the positioning region P3 is B. As shown in FIG. 16, the coordinates of the positioning area P1 are (x1, y1, z1), the coordinates of the positioning area P2 are (x2, y2, z2), and the coordinates of the positioning area P3 are (x3, y3, z3). The coordinates of the positioning area P4 are (x4, y4, z4), the coordinates of the upper left corner of the area R1 are (x5, y5, z5), and the coordinates of the upper right corner of the area R1 are (x6, y6, z6). , Territory The coordinates of the point at the lower left corner of R1 are (x7, y7, z7), the coordinates of the point at the lower right corner of the area R1 are (x8, y8, z8), and an extension of the left side of the area R1 and this local operation paper. The coordinates of the intersection of the upper side and the lower side of 21 are respectively (xt1, yt1, zt1) and (xt3, yt3, zt3); Are respectively (xt2, yt2, zt2) and (xt4, yt4, zt4), and if this local operation paper 21 exists on a certain plane,
(Xt1, yt1, zt1)
= ([{(X2-x1) × A1} / A] + x1, [{(y2-y1) × A1} / A] + y1, [{(z2-z1) × A1} / A] + z1) (10) )
(Xt2, yt2, zt2)
= ([{(X2-x1) × A2} / A] + x1, [{(y2-y1) × A2} / A] + y1, [{(z2-z1) × A2} / A] + z1) (11) )
(Xt3, yt3, zt3)
= ([{(X4-x3) × A1} / A] + x3, [{(y4-y3) × A1} / A] + y1, [{(z4-z3) × A1} / A] + z3) (12) )
(Xt4, yt4, zt4)
= ([{(X4-x3) × A2} / A] + x3, [{(y4-y3) × A2} / A] + y1, [{(z4-z3) × A2} / A] + z3) (13) )
Holds. Therefore, from equations (10) to (13)
(X5, y5, z5)
= ([{(Xt3-xt1) × B1} / B] + xt1, [{(yt3-yt1) × B1} / B] + yt1, [{(zt3-zt1) × B1} / B] + zt1) (14) )
(X6, y6, z6)
= ([{(Xt4-xt2) × B1} / B] + xt2, [{(yt4-yt2) × B1} / B] + yt2, [{(zt4-zt2) × B1} / B] + zt2) (15) )
(X7, y7, z7)
= ([{(Xt3-xt1) × B2} / B] + xt1, [{(yt3-yt1) × B2} / B] + yt1, [{(zt3-zt1) × B2} / B] + zt1) (16) )
(X8, y8, z8)
= ([{(Xt4-xt2) × B2} / B] + xt2, [{(yt4-yt2) × B2} / B] + yt2, [{(zt4-zt2) × B2} / B] + zt2) (17) )
From the equations (14) to (17), the coordinates (x5, y5, z5), (x6, y6, z6), (x7, y7, z7), (x8, y8, z8) of the four corners of the region R1 are obtained. ) Can be calculated.
[0176]
Similarly, when the coordinates (xn, yn, zn) (n = 1 to 4) of the four positioning regions P1 to P4 are obtained, the coordinates of the four corners of the regions R2 to R6 can be calculated based on the coordinates. it can.
[0177]
As described above, in this embodiment, when collecting the initial setting data before the position input using the local operation paper 21, the four positioning areas P1 to P4 preset on the local operation paper 21 By sequentially instructing the system body 100, the system body 100 can be made to recognize the coordinates of the four corners of the command input areas R1 to R5 of the local operation paper 21 and the coordinates of the four corners of the drawing area R6. , The instruction in the command input areas R1 to R5 by the pen 1 and the drawing in the drawing area R6 can be detected.
[0178]
FIG. 17 is a flowchart showing an outline of processing on the system main body 100 side, that is, on the arithmetic processing unit 40 side shown in FIG.
[0179]
In FIG. 17, when the position coordinates of the pen are received from the communication unit 33 shown in FIG.
(Step 401) First, it is checked whether the local input switching button (the second button 14b shown in FIG. 5) is pressed (Step 402).
[0180]
If the local input switching button has not been pressed (NO in step 402), the cursor displayed on the display screen 500 shown in FIG. 12 is moved to a position corresponding to the position coordinates of the pen (step 404). .
[0181]
If the local input switching button is pressed in step 402 (YES in step 402), the cursor displayed on the display screen 500 shown in FIG. 12 at a position corresponding to the relative coordinates with the local operation paper 21 Is moved (step 403).
[0182]
Next, it is determined whether or not the pen drawing button (first button 14a) is pressed (step 405). If the first button 14a has not been pressed (NO in step 405), the process returns to step 401.
[0183]
If it is determined in step 405 that the first button 14a has been pressed (YES in step 405), it is checked whether the pen exists in the drawing area, that is, the area R6 shown in FIG. 13 (step 406). . If the pen is present in the drawing area, drawing is performed with the pen (step 407), and the process returns to step 401.
[0184]
When it is determined in step 406 that the pen does not exist in the drawing area (NO in step 406), it is checked whether the pen exists in the command input area, that is, the areas R1 to R5NI shown in FIG. Step 408).
[0185]
If the pen is present in the command input area (YES in step 408), a command corresponding to the position coordinates of the pen is recognized (step 409), the command is executed (step 410), and step 401 is performed. Return to
[0186]
If it is determined in step 408 that the pen does not exist in the command input area (NO in step 408), the process returns to step 401 without doing anything.
[0187]
FIG. 18 shows that the pen 1 designates the region R1 of the local operation paper 21 to give the pen 1 a function as a drawing pen, and then designates, for example, the region R4 and selects the thickness of the drawing line to "medium". 5 shows an operation example in the case where the operation is performed. In this case, as shown in FIG. 18, when a desired image is drawn on the drawing area R6 of the local operation paper 21 with the pen 1, the drawing pen is displayed on the display screen 500 of the system main body 100 correspondingly. Is displayed, and the same image as the image drawn with the pen 1 is drawn in the drawing area R6 of the local operation paper 21 by the cursor formed of the pencil image indicating that the function has been given. Is displayed.
[0188]
FIG. 19 shows an operation example in the case where the area R2 of the local operation paper 21 is designated by the pen 1 and the pen 1 is given an eraser, that is, a function as an eraser. In this case, as shown in FIG. 18, a cursor of an eraser image indicating that the pen 1 has been given an eraser function is displayed on the display screen 500 of the system body 100, and in this state, the first pen 1 When the button 14a is pressed and the image drawn on the drawing area R6 of the local operation paper 21 is traced, the image displayed on the display screen 500 of the system main body 100 is erased.
[0189]
In this embodiment, a writing implement capable of actually drawing an image on the drawing area R6 of the local operation paper 21 is attached to the tip of the pen 1, and the image drawn on the drawing area R6 of the local operation paper 21 with the pen 1 can be directly confirmed. It may be configured as follows.
[0190]
FIG. 20 shows a schematic configuration of still another embodiment of the information processing system configured by applying the pen input device according to the present invention.
[0191]
In this embodiment, as shown in FIGS. 20 and 21, the local operation paper 21 of the embodiment shown in FIG. 12 comprises a local operation plate 22 having a display 22a capable of displaying an image. Four ultrasonic transmitting elements Ua to Ud for notifying the system body 100 of the relative position of the local operation plate 22 with respect to the disposing positions of the ultrasonic receiving elements 31a, 31b, 31c at the four corners of 22. Is different from the embodiment shown in FIG.
[0192]
According to this configuration, the image drawn by the pen 1 on the local operation plate 22 can be displayed on the display 22a of the local operation plate 22, and the four ultrasonic transmission elements Ua to Ud are provided. In addition, the data collection processing for initialization which is required in the embodiment shown in FIG.
[0193]
Further, the system body 100 receives the ultrasonic waves transmitted from the four ultrasonic transmitting elements Ua to Ud, and thereby the relative position of the local operation plate 22 with respect to the arrangement position of the ultrasonic receiving elements 31a, 31b, 31c. Since the position can always be known, the position can be input while moving the local operation plate 22.
[0194]
Here, the ultrasonic waves transmitted from the four ultrasonic transmitting elements Ua to Ud are received by the ultrasonic receiving elements 31a, 31b, and 31c on the system body 100 side, and their positions are detected. The configuration for receiving the ultrasonic waves transmitted from the ultrasonic transmission elements Ua to Ud can be easily configured by applying the configuration for receiving the ultrasonic waves from a plurality of pens in the multi-pen function described above.
[0195]
For example, if one pen is used in this embodiment, the ultrasonic waves transmitted from the single pen from the outputs of the ultrasonic receiving elements 31a, 31b, 31c and the four ultrasonic transmitting elements Ua to Ud It is only necessary to receive the ultrasonic wave transmitted from the device and detect its position, respectively, so that it becomes equivalent to a multi-pen function using five pens, and in the state transition diagram described with reference to FIGS. Considering the multi-pen function using a pen, the positions of the four ultrasonic transmission elements Ua to Ud can be detected in the same manner as the pen position detection.
[0196]
Note that, unlike the pen, the four ultrasonic transmitting elements Ua to Ud do not have a configuration corresponding to the first button and the second button of the pen, and therefore, the four ultrasonic transmitting elements Ua to Ud are assigned to one pen. By using the transmission timing, it is possible to receive the ultrasonic waves from the four ultrasonic transmission elements Ua to Ud. With this configuration, the two ultrasonic waves described in the state transition diagrams of FIG. 8 and FIG. With a configuration similar to the state transition diagram in the case of using a pen, it is possible to detect the positions of one pen and four ultrasonic transmitting elements Ua to Ud.
[0197]
Also, considering that the local operation plate 22 is unlikely to be moved during drawing, the ultrasonic transmission timing from the four ultrasonic transmission elements Ua to Ud is completed in a longer cycle than the ultrasonic transmission timing from the pen. It may be constituted so that it may occur in a random manner.
[0198]
The display 22a of the local operation plate 22 may be configured to display only the image drawn by the local operation plate 22, but the display 22a is displayed on the display screen 500 of the system body 100 side. It is very convenient to display the same image as the displayed content, since it is possible to input an appropriate position by looking only at the display 22a of the local operation panel 22. In this case, it is necessary to receive a video signal for display control of the display 22a from the system main body 100 side using a wired or wireless transmission means.
[0199]
By the way, in this embodiment, if the positions of the four ultrasonic transmitting elements Ua to Ud, that is, the three-dimensional coordinates can be detected, the three-dimensional coordinates of each position on the local operation plate 22 can be calculated.
[0200]
That is, as shown in FIG. 22, the positions of the four ultrasonic transmission elements Ua to Ud at the four corners of the local operation plate 22 are (xa, ya, za), (xb, yb, zb), (xc, yc, zc), (xd, yd, zd), the three-dimensional coordinates of a certain position on the local operation plate 22 are (xp, yp, zp), and the horizontal position from the disposition position of the ultrasonic transmission element Ua to this certain position is set. The distance in the direction is a, the distance in the vertical direction is b, and the coordinates of the intersection of the vertical line segment passing through this point and the upper side and lower side of the local operation plate 22 are (xt5, yt5, zt5), (xt6, yt6, zt6), assuming that the horizontal length of the local operation plate 22 is A and the vertical length is B,
(Xt5, yt5, zt5)
= ([{(Xb−xa) × a} / A] + xa, [{(yb−ya) × a} / A] + ya, [{(zb−za) × a} / A] + za) (18) )
(Xt6, yt6, zt6)
= ([{(Xd−xc) × a} / A] + xc, [{(yd−yc) × a} / A] + yc, [{(zd−zc) × a} / A] + zc) (19) )
Holds. Therefore, from equations (18) to (19)
(Xp, yp, zp)
= ([{(Xt6-xt5) × b} / B] + x5, [{(yt6-yt5) × b} / B] + yt5, [{(zt6-zt5) × b} / B] + zt5) (20) )
From this equation (20), the three-dimensional coordinates (xp, yp, zp) of a certain position on the local operation plate 22 can be obtained.
[0201]
Therefore, the three-dimensional coordinates (xa, ya, za), (xb, yb, zb), (xc, yc, zc), (xd, xc, yb, zb) of the four ultrasonic transmission elements Ua to Ud at the four corners of the local operation plate 22 If the three-dimensional coordinates (x, y, z) of the pen are equal to the three-dimensional coordinates (xp, yp, zp) using yd, zd), it is determined that the pen exists on the operation area of the local operation plate 22. Can be recognized.
[0202]
The pen 1 used in this embodiment is composed of a simple push button as shown in FIGS. 5 and 6, and includes a first button (drawing button) 14a for drawing or position designation, and a push button with a latch mechanism. It has a second button (local input switching button) 14b for switching which input surface on the display screen 500 or the local operation plate 22 is selected. Is configured to transmit ultrasonic waves at a predetermined timing according to the state transition diagram shown in FIG.
[0203]
In addition, the ultrasonic receiving elements 31a, 31b, 31c three-dimensionally arranged in a predetermined relationship with the display screen 500 are attached to the system main body 100, and the ultrasonic waves transmitted from the tip of the pen 1 are attached. Are received by the ultrasonic receiving elements 31a, 31b, and 31c, the pointing position on the display screen 500 and the pointing position on the local operation plate 22 by the pen 1 are detected from the reception timing, and an image corresponding to the pointing position is displayed. It is displayed on the display screen 500 of the system main body 100 and on the display 22a of the local operation board 22.
[0204]
FIG. 23 shows an operation example using the local operation plate 22 in this embodiment. In this embodiment, when performing position input from the local operation plate 22, the second button (local input switching button) 14b of the pen 1 with a latch mechanism is turned on.
[0205]
Then, when a desired image is drawn on the local operation plate 22 using the pen 1 while the first button (drawing button) 14a of the pen 1 is pressed, as shown in FIG. A cursor made of a pencil image is displayed on the screen 500, and the same image as the image drawn with the pen 1 is drawn and displayed on the local operation plate 22 by the cursor made of the pencil image.
[0206]
At the same time, the same image as the image drawn and displayed on the display screen 500 of the system main body 100 is displayed on the display 22a of the local operation panel 22.
[0207]
FIG. 24 shows a configuration example of the pen 1 when the pen 1 also has a function as a writing instrument.
[0208]
In other words, the pen 1 shown in FIG. 24 has the ultrasonic transmitting element 6 for detecting the position of the pen 1 attached thereto, and has, at the tip thereof, for example, a drawing area of the local operation paper 21 shown in FIG. A writable pen core 3 capable of actually writing an image on R6 is mounted.
[0209]
When the pen 1 shown in FIG. 24 is used, for example, in the embodiment shown in FIG. 12, an image is actually drawn on the drawing area R6 of the local operation paper 21 by the pen core 3 of the pen 1 and the local operation paper is used. A display corresponding to the image actually drawn in the drawing area R6 of the 21 can be displayed on the display screen 500 of the system main body 100.
[0210]
In the pen 1 shown in FIG. 24, since the position of the writable pen core 3 of the pen 1 and the mounting position of the ultrasonic wave transmitting element 6 are distant from each other, the pen 1 The position where the sound wave transmitting element 6 is mounted is displaced from the position of the pen core 3, so that the figure drawn on the drawing area R <b> 6 or the like of the local operation paper 21 is accurately displayed on the display screen 500 of the system main body 100. May not be consistent.
[0211]
FIG. 25 shows another embodiment of the pen 1 for solving this problem.
[0212]
The pen 1 shown in FIG. 25 has an ultrasonic transmitting element 6 built therein. The ultrasonic transmission element 6 is driven by an ultrasonic drive signal from a control circuit 5 that operates by power supply from a battery 4 as a power supply, and generates ultrasonic waves. The ultrasonic wave generated from the ultrasonic wave transmitting element 6 is reflected by an ultrasonic reflecting section 8 provided at the tip of the pen 1, and passes through an ultrasonic wave passing window 7 provided at the tip of the pen 1 to the outside. Sent out. A writable pen core 3 capable of actually writing an image in the drawing area R6 of the local operation paper 21 shown in FIG.
[0213]
FIG. 26 is an enlarged view of a portion surrounded by a dotted line in FIG. As is clear from FIG. 26, the ultrasonic reflecting portion 8 provided at the tip of the pen 1 has a conical shape, and the ultrasonic wave generated from the ultrasonic transmitting element 6 and traveling in the axial direction of the pen 1 By being reflected by the ultrasonic reflecting section 8, the tip of the pen 1 is converted into an ultrasonic wave that spreads in a direction perpendicular to the axial direction of the pen 1 within a range of 360 degrees, and the ultrasonic wave that spreads in the range of 360 degrees is converted. It is generated from the tip of the pen 1. As shown in FIG. 27, a plurality of ultrasonic passage windows 7 are formed around the tip of the pen 1, and the ultrasonic waves reflected by the ultrasonic reflecting section 8 are used to transmit the ultrasonic waves. The sound is transmitted to the outside through the sound wave window 7.
[0214]
According to the configuration shown in FIGS. 25 to 27, the position of the writable pen core 3 disposed at the tip of the pen 1 and the transmission position of the ultrasonic wave transmitted from the pen 1, that is, the position of the ultrasonic passage window 7 The arrangement position can be made close to the arrangement position, so that the figure drawn on the drawing area R6 or the like of the local operation paper 21 and the display on the display screen 500 of the system main body 100 regardless of the direction or inclination of the pen 1 can be displayed. The figure to be drawn can be substantially matched.
[0215]
When the pen 1 shown in FIG. 27 is used, the position between the position of the ultrasonic wave transmitting element 6 and the position where the ultrasonic wave transmitted from the pen 1 is transmitted, that is, the position where the ultrasonic wave passing window 7 is provided, is not illustrated. As shown in FIG. 25, the pen is separated by the distance L, so that when the pen 1 is used, it is necessary to correct the distance by the distance L in order to detect the tip position of the pen 1.
[0216]
FIG. 28 shows a schematic configuration of another embodiment of the information processing system according to the present invention, which is configured by using the pen 1 shown in FIGS.
[0217]
In the configuration shown in FIG. 28, the pen 1 is provided with a writable pen core 3 in the drawing area 23 a of the local operation plate 23 at the tip thereof. When a desired image is actually drawn on the drawing area 23a, the position of the tip of the pen 1 is detected based on the ultrasonic reception outputs of the ultrasonic receiving elements 31a, 31b, 31c of the system main body 100, and the position of the pen 1 is detected. On the display screen 500, an image corresponding to an image actually drawn in the drawing area 23a of the local operation plate 23 is displayed together with a pen-shaped cursor.
[0218]
FIG. 29 shows another configuration example of the local operation plate used when performing local input in the pen input device of the present invention. The local operation plate 24 shown in FIG. 29 is configured such that a plurality of local input sheets 24a can be bound on the local operation plate 24 by the binder 250. Also, the local operation plate 24 has an ultrasonic element for notifying the system main body 100 of the relative position of the local operation plate 24 with respect to the arrangement position of the ultrasonic receiving elements 31a, 31b, 31c on the system main body 100 side. Ua to Ud are provided.
[0219]
In the configuration shown in FIG. 29, the configuration for notifying the system body 100 of the relative position of the local operation plate 24 by the ultrasonic elements Ua to Ud is the same as that of the ultrasonic elements Ua to Ud shown in FIG. In addition, a configuration similar to the configuration for receiving ultrasonic waves from a plurality of pens in the multi-pen function can be applied.
[0220]
In order to perform local input using the local operation plate 24, a pen 1 having a writable pen core 3 attached to the tip is used, and the local core bound by the binder 250 using the pen core 3 of the pen 1 is used. This is performed by drawing a desired image on the input paper 24a.
[0221]
FIG. 30 shows a detailed configuration of the binder 250 shown in FIG. In FIG. 30, the binder 250 includes a local input paper pressing plate 253 rotatably mounted on a shaft 251 fixed to the local operation plate 24, and latches the local input paper pressing plate 253 to the local operation plate 24. And a spring 253 for elastically supporting the local input paper pressing plate 253.
[0222]
Further, the binder 250 is provided with a detection switch 255 for detecting that the local input paper pressing plate 253 is rotated upward and opened. That is, as shown in FIG. 30, when the local input paper pressing plate 253 is latched by the latch mechanism 235 and closed, as shown in FIG. 30, the detection switch 255 outputs a low-level binder On / Off signal. I do.
[0223]
However, in order to turn over the page of the local input paper 24a bound by the binder, as shown in FIG. 31, the latch by the latch mechanism 235 with respect to the latch mechanism hole 253a provided in the local input paper pressing plate 253 is released. Then, the local input paper pressing plate 253 rotates upward by the elastic force of the spring 253, whereby the detection switch 255 is turned off, and the binder On / Off signal shown in FIG. 30 becomes a high level.
[0224]
In this embodiment, the system is configured to notify the system main body 100 of the binder On / Off signal as a page turning signal on the local operation plate 24. The notification of the page turning signal to the system main body 100 is for notifying the system main body 100 of the relative position of the local operation plate 24 with respect to the arrangement position of the ultrasonic receiving elements 31a, 31b, and 31c of the system main body 100. This is performed using any one of the ultrasonic elements Ua to Ud provided in.
[0225]
That is, the configuration for notifying the relative position of the local operation plate 24 by the ultrasonic elements Ua to Ud to the system main body 100 side employs the same configuration as the configuration for receiving ultrasonic waves from a plurality of pens in the multi-pen function. In this case, as shown in FIG. 9, four ultrasonic transmission timings are assigned to each of the ultrasonic elements Ua to Ud. If an ultrasonic transmission timing that is not used among the ultrasonic transmission timings is used, the binder On / Off signal can be notified to the system main body 100 as a page turning signal on the local operation panel 24.
[0226]
FIG. 32 shows still another configuration example of the local operation plate used when performing local input in the pen input device of the present invention. The local operation plate 25 shown in FIG. 32 is configured so that a plurality of local input papers 25a can be bound on the local operation plate 25 by the clips 260.
[0227]
Here, the clip 260 has an ultrasonic element for notifying the system main body 100 of the relative position of the local operation plate 25 with respect to the arrangement position of the ultrasonic receiving elements 31a, 31b, 31c on the system main body 100 side. 261 may be provided.
[0228]
In this case, if at least two positions other than the position of the ultrasonic element 261 provided on the clip 260 can be notified to the system main body 100, the position of the ultrasonic receiving elements 31 a, 31 b, and 31 c on the system main body 100 is determined. The relative position of the local operation plate 25 can be determined.
[0229]
Therefore, at least two positions other than the position of the ultrasonic element 261 provided on the clip 260 are notified to the system main body 100 by, for example, a method similar to the initial setting data collection processing shown in FIG.
[0230]
If the paper bound by the clip 260 has moved, it is considered that the position of the clip 260 is also likely to have moved. Therefore, the message “Paper has moved, Please do the setting. "
[0231]
By the way, in the pen input device of the present invention, as shown in FIG. 3, the ultrasonic transmission timing of the ultrasonic transmitting element provided on the pen 1 side and the ultrasonic transmission timing of the ultrasonic receiving unit 32 provided on the system main body side. Synchronization of the sound wave reception processing is performed by a synchronization signal from a synchronization circuit 35 provided in a pen holder 34 for storing a pen provided on the system body side.
[0232]
FIG. 33 shows a configuration for providing a synchronization signal to the pen 1 from a synchronization circuit 35 provided in the pen holder 34.
[0233]
That is, as shown in FIG. 34, the pen 1 is provided with a contact 1a for receiving a synchronization signal from a synchronization circuit 35 provided in the pen holder 34, and as shown in FIG. Is provided with a contact 34a for supplying a synchronization signal from the synchronization circuit 35 to the pen 1.
[0234]
Here, as shown in FIG. 33, when the pen 1 is accommodated in the pen holder 34, the contact 34a of the pen holder 34 and the contact 1a of the pen 1 come into contact with each other, whereby the synchronization signal from the synchronization circuit 35 is transmitted to the contact 34a , 1 a to the transmission timing control unit 11 of the pen 1.
[0235]
The transmission timing control unit 11 of the pen 1 controls the ultrasonic transmission timing of the ultrasonic transmission element provided in the pen 1 based on the synchronization signal from the synchronization circuit 35, and controls the ultrasonic reception unit 32 of the system body. Then, since the ultrasonic reception processing is controlled based on the synchronization signal from the synchronization circuit 35, as a result, the ultrasonic transmission timing of the ultrasonic transmission element provided on the pen 1 side and the ultrasonic transmission timing provided on the system body side Synchronization with the ultrasonic receiving process in the ultrasonic receiving unit 32 is established.
[0236]
Also, as shown in FIG. 21, the ultrasonic transmission timing of the ultrasonic elements Ua to Ud provided on the local operation plate 22 is synchronized with the ultrasonic reception processing in the ultrasonic receiving unit 32 provided on the system main body side. Need to be taken. Synchronization in this case is performed using a pen holder provided on the local operation plate 22 side.
[0237]
That is, as shown in FIG. 36, a pen holder 36 for accommodating the pen 1 is also provided on the local operation plate 22 side similarly to the system main body side, and when the pen 1 is accommodated in the pen holder 34 on the system main body side. The pen 1 synchronized with the ultrasonic receiving process in the ultrasonic receiving unit 32 of the system body is accommodated in the pen holder 36 of the local operation plate 22 so that the ultrasonic element Ua provided on the local operation plate 22 is accommodated. Synchronize the ultrasonic transmission timing of Ud to the ultrasonic reception processing in the ultrasonic receiving unit 32 provided on the system main body side.
[0238]
FIG. 37 is a diagram showing a configuration of the system main unit in order to synchronize the ultrasonic transmission timing of the ultrasonic elements Ua to Ud provided on the local operation plate 22 with the ultrasonic reception processing in the ultrasonic receiving unit 32 of the system main unit. The transmission timing for controlling the ultrasonic transmission timing of the ultrasonic elements Ua to Ud of the local operation plate 22 from the transmission timing control unit 11 of the pen 1 synchronized with the ultrasonic reception processing in the ultrasonic reception unit 32 This shows a configuration for providing a synchronization signal to the control unit 22b.
[0239]
That is, as shown in FIG. 38, the pen 1 is provided with a contact 1b for giving a synchronization signal from the transmission timing control unit 11 of the pen 1 to the local operation plate 22, and as shown in FIG. The local operation plate 22 is provided with a contact 36 a for receiving a synchronization signal from the transmission timing control unit 11 of the pen 1.
[0240]
Here, as shown in FIG. 37, when the pen 1 synchronized with the ultrasonic receiving process in the ultrasonic receiving unit 32 of the system main body is housed in the pen holder 36 of the local operation plate 22, the pen 1 The contact 1b and the contact 36a of the pen holder 36 of the local operation plate 22 come into contact with each other, whereby the synchronization signal from the transmission timing control unit 11 of the pen 1 is transmitted via the contacts 1b and 36a to the transmission timing control unit 22b of the local operation plate 22. Given to.
[0241]
The transmission timing control unit 22b of the local operation plate 22 controls the ultrasonic transmission timing of the ultrasonic transmission element provided on the pen 1 based on the synchronization signal from the transmission timing control unit 11 of the pen 1, and The ultrasonic receiver 32 on the side controls the ultrasonic transmission timing of the ultrasonic elements Ua to Ud provided on the local operation plate 22 based on the synchronization signal from the synchronization circuit 35. As a result, the local operation plate Synchronization between the ultrasonic transmission timing of the ultrasonic elements Ua to Ud provided in the unit 22 and the ultrasonic reception processing in the ultrasonic receiving unit 32 of the system main body is established.
[0242]
As described above, according to the first aspect, the input pen is provided with the ultrasonic transmitter, and the ultrasonic pen which receives the ultrasonic wave transmitted from the ultrasonic transmitter at a predetermined position in the three-dimensional space is provided. An ultrasonic receiving unit having an ultrasonic receiving element is provided, and an instruction is given by an input pen on a first coordinate fixed to an array position of the plural ultrasonic receiving elements based on reception outputs of the plural ultrasonic receiving elements. Calculating the position information and determining whether the designated position corresponding to the computed designated position is included in the first input region or included in the second input region distant from the first input region; According to the result of the determination, the designated position information is converted from a position indicating a position on the coordinates fixed to the first input area to a position on the coordinates fixed to the first position information or the second input area, This converted location information In response, the display means is configured to perform display control, so that a low-cost configuration enables handwriting pen input from a plurality of operators, as well as improved operability and diversification of usage patterns. There is an effect that a pen input device can be provided.
[0243]
Further, according to the second invention, there is provided an input pen for inputting position information, and a display means for forming a first input surface by the input pen and performing a display based on the position information input by the input pen. In the pen input device, an ultrasonic wave transmitting unit provided on the input pen is disposed in a predetermined positional relationship with respect to the first input surface, and receives an ultrasonic wave transmitted from the ultrasonic wave transmitting unit. Ultrasonic receiving means having a plurality of ultrasonic receiving elements, remote input means disposed at a predetermined distance from the first input surface and having a second input surface with the input pen, and the ultrasonic receiving means The input pen based on first information indicating the relative positional relationship of the first input surface with respect to the arrangement position of the plurality of ultrasonic receiving elements and the reception output of the plurality of ultrasonic receiving elements of the ultrasonic receiving means. Previous A first calculating means for calculating first designated position information with respect to a first input surface; and a relative positional relationship of the second input surface with respect to an arrangement position of a plurality of ultrasonic receiving elements of the ultrasonic receiving means. Second calculating means for calculating second pointing position information with respect to the second input surface by the input pen based on the second information shown and the reception outputs of the plurality of ultrasonic receiving elements of the ultrasonic receiving means, Display control means for controlling the display on the display means based on the first designated position information and the second designated position information. In addition to inputting information from the input surface, it becomes possible to input information from the second input surface of the remote input device arranged at a predetermined distance from the display device.
[0244]
According to the third invention, an input pen for inputting position information, and a first display for forming a first input surface by the input pen and performing a display based on the position information input by the input pen In the pen input device having means, an ultrasonic wave transmitting means provided on the input pen and an ultrasonic wave transmitted from the ultrasonic wave transmitting means are provided in a predetermined positional relationship with respect to the first input surface. And an ultrasonic receiving means having a plurality of ultrasonic receiving elements for receiving a signal, and a second input surface provided by the input pen arranged at a predetermined distance from the first input surface and inputting by the input pen. A remote input unit having a second display unit for performing a display based on the position information, and a relative positional relationship between the first input surface and an arrangement position of a plurality of ultrasonic receiving elements of the ultrasonic receiving unit. First First calculating means for calculating first pointing position information with respect to the first input surface by the input pen based on information and reception outputs of a plurality of ultrasonic receiving elements of the ultrasonic receiving means; The input pen based on second information indicating a relative positional relationship of the second input surface with respect to an arrangement position of the plurality of ultrasonic receiving elements of the means and reception outputs of the plurality of ultrasonic receiving elements of the ultrasonic receiving means; Computing means for computing second designated position information with respect to the second input surface, and first display means and the second designated position information based on the first designated position information and the second designated position information. Since the display device is provided with the display control device for controlling the display on the second display device, in addition to the above-mentioned effects, the display content displayed by the display device on the second input surface can be confirmed. .
[Brief description of the drawings]
FIG. 1 is a block diagram showing a schematic configuration of an embodiment of an information processing system configured by applying a pen input device according to the present invention.
FIG. 2 is a diagram illustrating a relationship between a position indicated by a pen and three ultrasonic receiving elements arranged three-dimensionally.
FIG. 3 is a block diagram showing a specific configuration of a reception processing unit in the ultrasonic receiving unit shown in FIG.
FIG. 4 is a timing chart showing an operation of detecting times Ta, Tb, and Tc by the counter shown in FIG. 3;
FIG. 5 is an external view showing the external appearance of a pen used in the information processing system of the embodiment shown in FIG. 1;
FIG. 6 is a block diagram showing an internal circuit configuration of a pen used in the information processing system of the embodiment shown in FIG. 1;
FIG. 7 is a block diagram showing a specific configuration of an ultrasonic receiving unit and an arithmetic processing unit shown in FIG. 1;
FIG. 8 is a state transition diagram showing state transition of ultrasonic transmission timing control by a sequencer provided in the pen shown in FIG. 6;
9 is a timing chart showing the ultrasonic transmission timing control of the pen of PenNO = 0 and the pen of PenNO = 1 when the multi-pen function is selected (MPen = 1) in the state transition diagram shown in FIG. 8;
FIG. 10 is a state transition diagram showing a state of reception timing control by the sequencer shown in FIG. 7;
11 is a state transition diagram showing a state transition of data transmission control for transmitting data from the communication unit shown in FIG. 7 to the arithmetic processing unit via the RS232C interface.
FIG. 12 is a system configuration diagram showing a schematic configuration of another embodiment of the information processing system configured by applying the pen input device according to the present invention.
FIG. 13 is a diagram showing a specific configuration of a local operation sheet shown in FIG. 12;
FIG. 14 is a flowchart showing a process of collecting initial setting data in the embodiment shown in FIG. 12;
FIG. 15 illustrates a process of calculating coordinates of each of regions R1 to R6 from coordinates (xn, yn, zn) (n = 1 to 4) of a plurality of positioning regions P1 to P4 in the embodiment shown in FIG. Figure for.
FIG. 16 illustrates a process of calculating the coordinates of each of the regions R1 to R6 from the coordinates (xn, yn, zn) (n = 1 to 4) of the plurality of positioning regions P1 to P4 in the embodiment shown in FIG. Figure for.
FIG. 17 is a flowchart showing an outline of processing on the system main body side in the embodiment shown in FIG. 12;
FIG. 18 is a diagram showing an operation example in the embodiment shown in FIG.
FIG. 19 is a view showing another operation example in the embodiment shown in FIG. 12;
FIG. 20 is a system configuration diagram showing a schematic configuration of still another embodiment of the information processing system configured by applying the pen input device according to the present invention.
FIG. 21 is a diagram showing a schematic configuration of a local operation board used in the information processing system of the embodiment shown in FIG. 20;
FIG. 22 is a view for explaining a process of calculating three-dimensional coordinates of each position on the local operation plate from the positions of four ultrasonic transmission elements Ua to Ud in the embodiment shown in FIG. 20;
FIG. 23 is a view showing an operation example in the embodiment shown in FIG. 20;
FIG. 24 is a diagram showing a configuration example of a pen employed in the present invention when the pen also has a function as a writing instrument.
FIG. 25 is a diagram showing another configuration example of the pen when the pen employed in the present invention also has a function as a writing instrument.
26 is an enlarged view showing a portion surrounded by a dotted line in FIG. 25 in an enlarged manner.
FIG. 27 is an enlarged view showing, in an enlarged manner, a portion of the ultrasonic passage window shown in FIG. 25;
FIG. 28 is a system configuration diagram showing a schematic configuration of another embodiment of the information processing system according to the present invention configured using the pens shown in FIGS. 25 to 27;
FIG. 29 is a diagram showing another configuration example of the local operation plate used when performing local input in the pen input device of the present invention.
FIG. 30 is a diagram showing a detailed configuration of a binder shown in FIG. 29.
FIG. 31 is a view showing a state where the binder shown in FIG. 29 is opened.
FIG. 32 is a diagram showing still another configuration example of the local operation plate used when performing local input in the pen input device of the present invention.
FIG. 33 is a diagram showing a configuration for providing a synchronization signal to a pen from a synchronization circuit provided in a pen holder in the pen input device of the present invention.
FIG. 34 is a view showing the configuration of the pen shown in FIG. 33.
FIG. 35 is a view showing the configuration of the pen holder shown in FIG. 33.
FIG. 36 is a view for explaining a configuration for providing a synchronization signal from the pen to the local operation board in the pen input device of the present invention.
FIG. 37 is a diagram showing a configuration for providing a synchronization signal from a pen to a local operation board in the pen input device of the present invention.
FIG. 38 is a view showing the configuration of the pen shown in FIG. 37.
FIG. 39 is a diagram showing a configuration of a pen holder of the local operation plate shown in FIG. 37.
[Explanation of symbols]
1, 2, pen, 10: first input area, 20: second input area, 30: ultrasonic receiving section, 31a, 31b, 31c: ultrasonic receiving element, 32: reception processing section, 33: communication section , 40 arithmetic processing unit, 41 communication unit, 42 arithmetic unit, 43 determination unit, 44 first conversion unit, 45 second conversion unit, 46 display control unit, 50 display unit

Claims (12)

In a pen input device for inputting a position indicated by an input pen,
Ultrasonic transmission means provided on the input pen,
Disposed at a predetermined position in the three-dimensional space, and ultrasonic receiving means having an ultrasonic receiving elements of multiple that will receive outgoing ultrasonic waves from said ultrasonic wave transmission unit,
First input means having a first input area;
A second input means having a second input area disposed at a predetermined distance from the input area of the first input means;
The pointing position of the input pen on the first coordinate system fixed to the array position of the plurality of ultrasonic receiving elements of the ultrasonic receiving means based on the reception outputs of the plurality of ultrasonic receiving elements of the ultrasonic receiving means. Calculating means for calculating the indicated position information to be indicated;
Determining means for determining whether a designated position corresponding to the designated position information calculated by the calculating means is included in the first input area or the second input area;
If it is determined by the determination unit that the designated position is included in the first input area, the designated position information is used to indicate a position on a second coordinate system fixed to the first input area. First conversion means for converting the position information into position information;
If it is determined by the determination unit that the designated position is included in the second input area, the designated position information is used to indicate a position on a third coordinate system fixed to the second input area. 2. A pen input device, comprising: second conversion means for converting the input information into position information. Display means for performing a display corresponding to a position indicated by the input pen with respect to a first input area of the first input means or a second input area of the second input means;
Display control means for performing display control on the display means based on the first position information converted by the first conversion means and the second position information converted by the second conversion means. The pen input device according to claim 1, wherein The ultrasonic transmitting means,
Transmits ultrasonic waves at a preset timing,
The calculating means includes:
Based on the ultrasonic transmission timing from the ultrasonic transmission means, a plurality of ultrasonic reception elements of the ultrasonic reception means detect the reception timing of the ultrasonic waves from the ultrasonic transmission means by the ultrasonic reception elements, and based on the reception timing, 2. The pen input device according to claim 1, wherein the operation of the designated position information is performed. The input pen is
Consists of multiple input pens,
The ultrasonic transmitting means,
Disposed in each of the plurality of input pens,
The preset timing is
Each is set corresponding to each input pen,
The calculating means includes:
The reception timing of the ultrasonic wave from each of the ultrasonic transmission units by the plurality of ultrasonic reception elements of the ultrasonic reception unit based on the ultrasonic transmission timing from each of the ultrasonic transmission units corresponding to each of the input pens. 4. The pen input device according to claim 3, wherein the pen input device detects the input pen and calculates indicated position information corresponding to each of the input pens based on the reception timing. The ultrasonic transmitting means,
4. The pen input device according to claim 3, wherein when the input pen is stored in a pen holder, timing information indicating the preset timing is received via the pen holder. An input pen for inputting position information, and a pen input device having a display unit configured to form a first input surface of the input pen and perform display based on the position information input by the input pen,
Ultrasonic transmission means provided on the input pen,
Are arranged in a predetermined positional relationship with respect to said first input surface, and ultrasonic receiving means having an ultrasonic receiving elements of multiple that will receive outgoing ultrasonic waves from said ultrasonic wave transmission unit,
Remote input means disposed at a predetermined distance from the first input surface and having a second input surface with the input pen;
The first information indicating the relative positional relationship of the first input surface with respect to the arrangement position of the plurality of ultrasonic receiving elements of the ultrasonic receiving means and the reception output of the plurality of ultrasonic receiving elements of the ultrasonic receiving means. First calculating means for calculating, based on the input pen, first designated position information with respect to the first input surface;
The second information indicating the relative positional relationship of the second input surface with respect to the arrangement position of the plurality of ultrasonic receiving elements of the ultrasonic receiving means and the reception output of the plurality of ultrasonic receiving elements of the ultrasonic receiving means Second calculating means for calculating, based on the input pen, second designated position information with respect to the second input surface,
A pen input device, comprising: display control means for controlling display on the display means based on the first designated position information and the second designated position information. The second input surface includes:
It consists of paper that can be written with a writing instrument,
The input pen is
The pen input device according to claim 6, wherein the pen input device is configured by attaching the ultrasonic transmitting unit to the writing instrument. The remote input means,
7. The input device according to claim 6, further comprising a notification unit configured to notify the second information to the second calculation unit. The notifying means,
The apparatus further comprises a position information notification ultrasonic transmitting unit disposed in a predetermined positional relationship with respect to the second input surface,
The second calculating means includes:
9. The pen according to claim 8, wherein the second information is calculated based on a reception output of ultrasonic waves from the ultrasonic wave transmitting means for notifying position information by a plurality of ultrasonic wave receiving elements of the ultrasonic wave receiving means. Input device. The second input surface includes:
It consists of paper that can be written with a writing instrument,
The position information notification ultrasonic transmission means,
The pen input device according to claim 9, wherein the pen input device is disposed on a clip that sandwiches the sheet. The second input surface includes:
It consists of a binder that binds multiple papers that can be written with a writing instrument,
The binder is
Detecting means for detecting page turning due to the separation of the sheet,
7. The pen input device according to claim 6, further comprising: a page turning information notifying unit that notifies the display control unit of page turning information based on a detection output of the detecting unit. A pen input device having an input pen for inputting position information, and a first display means for forming a first input surface of the input pen and performing display based on the position information input by the input pen;
Ultrasonic transmission means provided on the input pen,
Are arranged in a predetermined positional relationship with respect to said first input surface, and ultrasonic receiving means having an ultrasonic receiving elements of multiple that will receive outgoing ultrasonic waves from said ultrasonic wave transmission unit,
A remote which is disposed at a predetermined distance from the first input surface, has a second input surface with the input pen, and has a second display means for performing a display based on position information input by the input pen; Input means;
The first information indicating the relative positional relationship of the first input surface with respect to the arrangement position of the plurality of ultrasonic receiving elements of the ultrasonic receiving means and the reception output of the plurality of ultrasonic receiving elements of the ultrasonic receiving means. First calculating means for calculating, based on the input pen, first designated position information with respect to the first input surface;
The second information indicating the relative positional relationship of the second input surface with respect to the arrangement position of the plurality of ultrasonic receiving elements of the ultrasonic receiving means and the reception output of the plurality of ultrasonic receiving elements of the ultrasonic receiving means Second calculating means for calculating, based on the input pen, second designated position information with respect to the second input surface,
A pen input device comprising: display control means for controlling display on the first display means and the second display means based on the first designated position information and the second designated position information. .

Images