JP2002297308A - Input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an input device the operation mode of which can precisely and easily be switched and of which the handleability is good. SOLUTION: A wireless pen 2 is made to approach the recording paper 5 of a sound electronic notebook 5 in the direction of an arrow A and stopped for one second being a first prescribed time. After this, when the pen 2 is separated in the direction of an arrow B, the part of a handwritten character pointed out by the tip of the pen 2 is reproduced to be 'there is a memory of 128 MB'.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for inputting handwritten character data using a wireless or wired pen and tablet and for continuously reproducing information such as voice data in correspondence with the handwritten data of the handwritten characters. The present invention relates to an input device for storing and reproducing.

[0002]

2. Description of the Related Art Conventionally, there has been known a coordinate data input device for inputting XY coordinate position data with respect to a tablet using a wireless pen having a built-in electromagnetic wave signal generation circuit and a tablet having a coil. I have. Also, by combining this coordinate data input device with a device for recording and reproducing voices, a device for recording and reproducing voices in meetings and the like can be used to continuously record voices and also to write handwritten data as notes for creating minutes. There has been proposed an apparatus that stores data in association with data and instructs handwritten data after the meeting to reproduce the corresponding sound.

In the latter device, an instruction for switching operation modes other than the input of handwritten characters (such as a voice recording instruction and a voice reproduction instruction) is input by clicking a switch provided at a specific position on the tablet with a pen. (Hereinafter, referred to as “first method”). Further, there is also known a device in which a pointer on a tablet is moved to input an operation based on a gesture or a moving direction (hereinafter, referred to as a gesture).
This is referred to as a "second method." ). Further, there is also known a method in which an operation mode is determined by detecting a pen up / down time and a moving speed (hereinafter, referred to as a “third method”).

[0004]

However, the above-mentioned first method has a problem that an operation related to a writing stroke of an input handwritten character cannot be performed. That is, since the operation mode is switched by operating a switch provided at a specific position on the tablet, when writing handwritten characters while reproducing information associated with the writing stroke of the input handwritten characters, However, there is a problem that the pen must be frequently moved from the writing surface and the switch must be operated by the pen tip. Further, when the switch is switched, the reproduction is stopped, and it is necessary to write on the memory, which is inconvenient.

[0005] In the second method, when a gesture is performed by moving a pen and moving a pointer on paper placed on a tablet, a locus of the gesture is recorded on a previously written memo. There was a problem that it was added and it became difficult to read. In addition, when a gesture is performed in the air while the pen is separated from the tablet, there is a problem that it is difficult to determine whether the gesture is a gesture or whether the pen is merely floating during writing.

Furthermore, in the third method, since the pen up-down time and the moving speed are detected, it is possible to determine whether the pen is being written or not.
There is a problem that an error easily occurs in the determination of whether to switch the operation mode. In addition, it can handle simple on / off, cursor movement, and scrolling, but can support all kinds of playback control of continuous playback information that is continuously played back in time series such as audio and video. Did not.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and an object of the present invention is to provide an input device that can accurately and easily switch operation modes and that is easy to use.

[0008]

In order to solve the above-mentioned problems, an input device according to the first aspect of the present invention comprises a detection surface for detecting a position of a pen, and a first surface parallel to the detection surface of the pen. First detecting means for detecting movement in a direction, and second detecting means for detecting movement in a second direction parallel to the detection surface of the pen and orthogonal to the first direction. A third step of detecting a movement of the pen in a direction perpendicular to the detection surface;
Detecting means, a fourth detecting means for detecting a stationary time near a predetermined position of the detecting surface, and a detection result of at least two or more of the first to fourth detecting means. Identification means for identifying an operation mode instruction to the input device.

In the input device having this configuration, the first detecting means detects the movement in the first direction parallel to the detection surface of the pen,
The second detection means detects movement in a second direction parallel to the detection surface of the pen and perpendicular to the first direction, and the third detection means detects a movement in a direction perpendicular to the detection surface of the pen. Detect movement,
Fourth detecting means detects a stationary time near a predetermined position on the detecting surface, and identifying means detects an input device based on a detection result of at least two or more of the first to fourth detecting means. Identify the operation mode instruction for.

Further, the input device of the invention according to claim 2 is
In addition to the configuration of the invention according to claim 1, in addition to the stroke information input means for inputting stroke information of handwritten characters using the pen, continuous reproduction information such as audio and video is reproduced continuously in time series. Continuous playback information input means for inputting,
Continuous playback information storage means for storing the continuous playback information input from the continuous playback information input means; stroke information input from the stroke information input means; and the stroke information input from the continuous playback information input means. Stroke information storage means for storing association information with continuous playback information, playback means for playing back continuous playback information stored in the continuous playback information storage means, and association information for stroke information designated using the pen Information reading means for reading the continuous reproduction information from the continuous reproduction information storage means based on the association information read by the association information reading means. When the continuous reproduction information read by the reproduction information reading means is reproduced by the reproducing means, To the identification means and a reproduction control means for controlling the reproduction of the continuous reproduction information in a predetermined operation mode identified.

In the input device having this configuration, in addition to the function of the invention according to claim 1, stroke information of a handwritten character using a pen is input by the stroke information input means, and voice or video or the like is input by the continuous reproduction information input means. The continuous reproduction information which is continuously reproduced in time series is input, the continuous reproduction information storage means stores the continuous reproduction information input from the continuous reproduction information input means, and the stroke information storage means transmits from the stroke information input means. Input stroke information, and
The storage unit stores association information between the stroke information and the continuous reproduction information input from the continuous reproduction information input unit, the reproduction unit reproduces the continuous reproduction information stored in the continuous reproduction information storage unit, and the association information reading unit uses a pen. The continuous reproduction information reading means reads the continuous reproduction information from the continuous reproduction information storage means based on the association information read by the association information reading means, and performs reproduction control. When the reproducing means reproduces the continuous reproduction information read by the continuous reproduction information reading means, the reproduction means controls the reproduction of the continuous reproduction information in a predetermined operation mode identified by the identification means.

Further, the input device according to the third aspect of the present invention,
In addition to the configuration of the invention according to claim 2, the predetermined operation mode is configured to repeatedly reproduce a part of the continuous reproduction information stored in the continuous reproduction information storage unit.

[0013] In the input device having this configuration, in addition to the function of the invention according to claim 2, in a predetermined operation mode, a part of the continuous reproduction information stored in the continuous reproduction information storage means is repeatedly reproduced.

Further, the input device of the invention according to claim 4 is:
In addition to the configuration of the invention according to claim 2, the predetermined operation mode is characterized in that the reproduction is performed while skipping the continuous reproduction information stored in the continuous reproduction information storage means.

In the input device having this configuration, in addition to the operation of the invention according to claim 2, in a predetermined operation mode, the continuous reproduction information stored in the continuous reproduction information storage means is skipped and reproduced.

Further, the input device of the invention according to claim 5 is as follows.
In addition to the configuration of the invention according to claim 2, the predetermined operation mode is configured to reproduce only a part of the continuous reproduction information stored in the continuous reproduction information storage unit.

In the input device having this configuration, in addition to the function of the invention according to claim 2, in a predetermined operation mode, only a part of the continuous reproduction information stored in the continuous reproduction information storage means is reproduced.

The input device of the invention according to claim 6 is:
In addition to the configuration of the invention according to claim 1, on the detection surface, a recording medium in which a writing locus with a pen remains can be held, and in a state where the pen is close to the recording medium,
The identification unit is configured to identify an operation mode based on detection results of at least two or more of the first to fourth detection units.

In the input device having this configuration, in addition to the effect of the invention according to claim 1, a recording medium on which the writing locus of the pen remains can be held on the detection surface. In a state where the pen is in proximity, the identification unit identifies an operation mode based on detection results of at least two or more of the first to fourth detection units.

Further, the input device of the invention according to claim 7 is:
In addition to the configuration of the invention according to claim 3 or 5, a part of the continuous reproduction information is a part synchronized with a range of stroke information designated by using the pen. .

According to the input device having the above configuration, the present invention is applied to a third aspect of the present invention.
In addition to the effect of the invention according to
This is a part synchronized with the range of the stroke information specified using the pen.

[0022]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings.

First, the configuration of an input device 1 according to an embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a plan view showing an external configuration of a wireless pen 2 and a voice electronic organizer 3 constituting the input device 1, and FIG. 2 is a block diagram showing an electrical configuration of the voice electronic organizer 3.
FIG. 4 is a conceptual diagram of a storage area of a non-volatile memory such as a flash memory, and FIG.

As shown in FIG. 1, an input device 1 includes a wireless pen 2 for transmitting electromagnetic waves having a predetermined frequency from the tip.
And a voice electronic organizer 3 that receives the electromagnetic wave with a built-in coil. Inside the wireless pen 2, an electromagnetic wave transmission circuit (not shown) and a pen core are incorporated, and the tip of the pen core protrudes from the tip of the wireless pen 2.
It is possible to write on ordinary paper such as a pencil, a mechanical pencil, a ball-point pen, or a felt-tip pen, and to draw characters, figures, symbols, and the like on recording sheets 5 and 6 described later. In addition, a coil that emits an electromagnetic wave is built in the tip of the wireless pen 2.

The audio electronic organizer 3 has a substantially rectangular double-foldable housing 4, and has a plurality of pages held at the center of the surface of the housing 4 by six openable and closable rings 7. Sheets 5 and 6 are placed, and page detection devices 8 and 9 including page sensors that detect pages of the recording sheets 5 and 6 are provided at both upper ends of the housing 4.
A display device 10 composed of a liquid crystal display and displaying an operation mode and the like, a microphone 11 for inputting a sound, and a speaker 12 for emitting a reproduced sound
And a switch 13 are provided. Switch 1
3 is a pallet switch 13a and a recording switch 13b
, A stop switch 13c, a reproduction switch 13d, a speech speed switch 13e, a rewind switch 13f, and a fast forward switch 13g. Note that recording paper 5,
A coil for detecting an electromagnetic wave, which will be described later, is provided inside the portion where 6 is placed.

In this embodiment, the tip of the wireless pen 2 outputs an electromagnetic wave having a predetermined frequency which is different between the time when the tip is in contact with the recording sheets 5 and 6 and the time when the tip is not in contact. The audio electronic organizer 3 functions as a magnetically coupled tablet. Therefore, when the user uses the wireless pen 2 to write the characters by touching the tip of the wireless pen 2 with the recording papers 5 and 6, the coordinate data at the position designated by the tip is converted to the magnetically coupled voice electronic sound. It is configured to be recorded by the notebook 3. Further, when the voice / electronic notepad 3 is set to the recording mode and handwritten characters are inputted to the recording papers 5 and 6 using the wireless pen 2, the stroke data of the handwritten characters and the time data by the time stamp are associated with each other, 6 is digitally recorded. The time data may be given to each piece of coordinate data constituting a stroke (one continuous line written from when the pen comes into contact with the paper until it leaves), or may be given only at the beginning of the stroke. When the tip of the wireless pen 2 is brought close to or near the handwritten characters recorded on the recording papers 5 and 6, audio data corresponding to the stroke data of the handwritten characters is reproduced from the speaker 12. Has become. That is, the audio data position to start the reproduction is obtained based on the time data given to the stroke data including the coordinates closest to the coordinates of the tip of the wireless pen 2.

Next, an electric circuit configuration of the voice electronic organizer 3 will be described with reference to FIG. FIG. 2 is a block diagram showing an electric circuit configuration of the audio electronic organizer 3.

The voice electronic notebook 3 is provided below the recording sheets 5 and 6 shown in FIG. 1, and has a coordinate detector 40 for detecting the position of the tip of the wireless pen 2 as XY coordinate data by electromagnetic waves; It comprises a demodulation unit 41 and a control unit 42. The coordinate detection unit 40 includes the X-axis multiplexer 4
And a plurality of coils connected to the Y-axis multiplexer 4
3 and a plurality of coils connected thereto, so that the position of the tip of the pen core of the wireless pen 2 can be detected as XY coordinate data by electromagnetic waves.

The data demodulating section 41 is provided with a coordinate detecting section 4.
0 X-axis multiplexer 44 and Y-axis multiplexer 4
3, a multiplexer 45 to which the received signal is input, an amplifier circuit 46 for the received signal, a demodulator circuit 47 for demodulating (amplitude detection) the output signal from the amplifier circuit 46, and a demodulator circuit 47.
An A / D converter 48 for digitizing the demodulated signal output from the A / D converter and a limiter circuit 49 for amplifying the output signal from the amplifier circuit 46 into a pulse having a constant amplitude. The output of the limiter circuit 49 is input to the CPU 50 through the I / O interface 53,
The frequency is detected by counting the pulse period in the PU 50. Based on this frequency, it is determined whether or not the tip of the wireless pen 2 is in contact with the recording sheets 5 and 6.

Further, the control unit 42 has a CPU 50 for controlling the voice electronic notebook 3 and an R for temporarily storing data.
A ROM 52 storing a control program executed by the CPU 50, a threshold value, and the like, a non-volatile memory 54 including a flash memory storing stroke data and voice data of input handwritten characters, and a page detection device. 8, 9, display device 10 and switch 13,
An I / O interface 53 for mediating data with the CPU 50, an audio circuit 55 for converting the input voice from the microphone 11 into digital data, driving the speaker 12, and generating voice data, and an externally connected voice circuit 55 And a control terminal 56 for outputting control data for controlling the playback and storage of the video information.

Next, referring to FIG.
The storage area No. 4 will be described. This non-volatile memory 54
A flash memory or the like capable of electrically erasing stored contents is used. As shown in FIG. 3, the nonvolatile memory 54 includes a stroke information storage area 54a for storing stroke information of handwritten characters detected by the coordinate detection unit 40 together with time data based on a time stamp, and a microphone 1
1 is provided with a continuous reproduction information storage area 54b for storing the input audio data. Therefore, the recording sheets 5, 6
The stroke data written above with the wireless pen 2 is associated with time data by a time stamp.
The data is stored in the nonvolatile memory 54 in association with the audio data input to the microphone 6.

It is also possible to connect an external digital video information input device to the I / O interface 53 and store the video information in the continuous reproduction information storage area 54b.

Next, with reference to FIG. 4, a basic method of using the audio electronic organizer 3 will be described. As shown in the balloon of FIG. 4, the voice says, "We have developed a new PC. The CPU is Pentium III, the clock is 700 MHz, the memory is 128 MB. The DVD-ROM drive and the floppy drive are Built-in pointing device: touch pad, display: 1
It is a 5 inch TFT. The resolution is UXGA. And the microphone 1
1 and at the same time, on the recording paper 5 with the wireless pen 2 "new PC", "CPU Pentium", "memory", "pointing", "display is 15",
When handwritten as "resolution", the audio data is converted into digital data by the audio circuit 55, stored in the continuous reproduction information storage area 54b of the nonvolatile memory 54, and handwritten on the recording paper 5 with the wireless pen 2 The stroke data of the written character is stored in the stroke information storage area 5 of the nonvolatile memory 54 together with the time data of the time stamp.
4a.

Next, with reference to FIGS. 5 to 13, the details of the sound reproduction operation of the sound electronic notebook 3 will be described. FIGS. 5 to 7 are flowcharts of processing in the sound reproduction mode executed by the CPU 50 of the sound electronic organizer 3. FIG. 8 is a diagram showing the movement of the wireless pen 2 when continuous reproduction is started.
FIG. 9 is a diagram showing the movement of the wireless pen 2 in the continuous reproduction additional recording mode, FIG. 10 is a diagram showing the movement of the wireless pen 2 in the skip cue mode, and FIG.
FIG. 12 is a diagram illustrating the movement of the wireless pen 2 in the repeat playback mode. FIG. 12 illustrates the wireless pen 2 in the stop mode.
FIG. 13 is a diagram showing the movement of the wireless pen 2 in the spot reproduction additional recording mode. still,
The programs of the flowcharts shown in FIGS. 5 to 7 are stored in the ROM 52 of the control unit 42.

In the sound reproduction mode of the sound electronic notebook 3, the movement of the handwritten characters in the line direction (first direction) parallel to the surface of the recording sheets 5, 6 The movement of the wireless pen 2 in parallel and in the column direction of the handwritten characters (the second direction orthogonal to the first direction) and the up and down directions of the wireless pen 2 perpendicular to the surfaces of the recording papers 5 and 6 (the third direction) direction)
And the stationary time near a predetermined position close to (but not in contact with) the surfaces of the recording papers 5 and 6, and the reproduction of continuous reproduction information such as audio information is performed in accordance with the combination and order. An operation mode for controlling the recording state is identified. These movements and stillness are detected in a state where the wireless pen 2 is not in contact with the surfaces of the recording sheets 5 and 6.

In the audio electronic organizer 3, apart from the processing of the flowcharts shown in FIGS. 5 to 7, the distance that the wireless pen 2 is separated from the recording paper 5, 6 The detection of the coordinates when the wireless pen 2 is performed is performed, and based on the results, the sliding amount of the tip of the wireless pen 2 or the stationary state for a predetermined time (the amount of separation of the wireless pen 2 is less than a predetermined value, (Within the range). In addition, in the sound electronic notebook 3, when continuous reproduction of sound is started, the state is continuously reproduced until reproduction control by the next operation of the wireless pen 2 is performed. .

Hereinafter, the details of the sound reproducing operation of the sound electronic organizer 3 will be described with reference to the flowcharts of FIGS.
When performing the sound reproduction operation of the sound electronic notebook 3, first,
The reproduction mode is started by depressing the reproduction switch 13d provided on the housing 4. Even if the reproduction mode is started, the actual reproduction is not performed until the pen is instructed. Stop switch 13c for stopping sound reproduction
Is pressed (S1: YES), the reproduction mode ends (S2). If audio playback is not stopped (S
1: NO), and then, as shown in FIG.
Is directed in the direction of arrow A with the leading end of the recording paper 5 facing the recording paper 5. If the amount of separation of the tip of the wireless pen 2 from the recording paper 5 is equal to or less than the predetermined value of 3 mm (S3: YES), the timer for measuring the stationary time is cleared to zero and started (S4). Whether or not the amount of separation of the wireless pen 2 from the recording paper 5 is equal to or less than a predetermined value of 3 mm depends on the signal strength of the detected electromagnetic wave when the tip of the wireless pen 2 contacts the recording paper 5. The determination is made based on whether or not the signal intensity of the electromagnetic wave detected by the coordinate detection unit 40 is 0.7 times or more.

When the signal strength of the detected electromagnetic wave is brought into contact with the recording paper 5 by the tip of the wireless pen 2,
If the signal strength of the electromagnetic wave detected at 0 is 0.7 times or more (S3: YES), the timer is cleared to zero and started (S4), and if the tip of the wireless pen 2 is not in contact with the recording paper 5, (S5: NO) Next, it is determined whether or not the tip of the wireless pen 2 is stationary for at least one second, which is the first predetermined time (FIG. 6: S10). If the tip of the wireless pen 2 is stationary for 1 second or more as the first predetermined time (S10: YES), the tip of the wireless pen 2 is stationary for 3 seconds or more as the second predetermined time. It is determined whether or not there is (S30 in FIG. 7). Whether the tip of the wireless pen 2 is stationary or not is determined to be stationary when the coordinate position of the tip of the wireless pen 2 and the signal strength of the detected electromagnetic wave do not change.

If the tip of the wireless pen 2 is not stopped for 3 seconds or more, which is the second predetermined time (S30: NO),
If the operation of moving the tip of the wireless pen 2 in the forward direction (row direction) as shown by the arrow E in FIG. 12 and immediately returning to the original position is not performed (S33: NO), the tip of the wireless pen 2 The stroke data including the coordinates closest to the coordinates of the tip of the wireless pen 2 at the time of the approach is read from the stroke information storage area 54a of the nonvolatile memory 54. That is,
The stroke data of the handwritten character with the "memory" to which the tip of the wireless pen 2 approaches is read out from the stroke information storage area 54a of the nonvolatile memory 54, and the audio data at the time corresponding to the time data of the stroke data is continuously reproduced. The data is read from the information storage area 54b, converted into an audio signal by the audio circuit 55, and output from the speaker 12 (S35). For example, as shown in the balloon 21 in FIG. 8, the reproduction is performed as "there is 128 MB of memory". In this case, a continuous reproduction non-recording mode is set in which recording cannot be performed while reproduction is continued (S36). Then, the process returns to S1.

In the above example, the timer start (S
4) Later, when the tip of the wireless pen 2 comes into contact with the recording paper 5 (S5: YES) and is not in the additional recording mode (S6: NO), the reproduction of the sound is stopped (S7), and the writing mode is performed. As a result, a stroke handwritten on the recording paper 5 is detected (S8). Thereafter, when the tip of the wireless pen 2 is separated from the recording paper 5 (S9: YES), the process returns to S1.

In the above example, if the handset is still for 3 seconds or more, which is the second predetermined time (S30: YES), the handwritten character of the "memory" where the tip of the wireless pen 2 approaches is approached. The stroke data is read from the stroke information storage area 54a of the nonvolatile memory 54, and the audio data at the time corresponding to the time data of the stroke data is read from the continuous reproduction information storage area 54b.
5, the audio signal is converted into an audio signal and output from the speaker 12 (S31), and the mode is set to the additional recording mode (S32). Then, the process returns to S1. In this state, as shown in FIG.
In the continuous reproduction additional recording mode, handwritten characters can be additionally recorded on the recording paper 5 with the tip of the wireless pen 2 while listening to the reproduction sound (S1: YES, S3: YES, S4).
S5: YES, S6: YES, S8). The coordinates of the tip of the wireless pen 2 are also detected while the handwriting is being written, and the stroke data is also stored in the stroke information storage area 54 a of the nonvolatile memory 54.

Next, the skip search mode shown in FIG. 10 will be described. As shown in FIG.
Of the electromagnetic wave detected by the coordinate detecting unit 40 when the tip of the wireless pen 2 is brought into contact with the recording paper 5, the signal strength of the detected electromagnetic wave is 0. In the case of .times.7 or more (S3: YES), the timer is cleared to zero and started (S4), the tip of the wireless pen 2 is not in contact with the recording paper 5 (S5: NO), and the first predetermined time is set. When the tip of the wireless pen 2 is not stopped for more than 1 second (FIG. 6: S10: NO), the tip of the wireless pen 2 is moved forward (in the row direction) as indicated by an arrow C in FIG. ) (S11: YES),
The range of the handwritten character in the slid column direction is skip-reproduced (S15, S16: YES). In the skip reproduction, specifically, the stroke data of the handwritten characters in each row is stored in the stroke information storage area 54 of the nonvolatile memory 54.
Then, the audio data at the time corresponding to the time data of the stroke data is read from the continuous reproduction information storage area 54b, and is reproduced from the head, for example, every two seconds for each column (S15). For example, the balloon 21 in FIG.
"CPU", "Clock", "Memory",
"DVD", "point", and "display is" are reproduced. Then, the process returns to S1.

Next, the repeat reproduction mode shown in FIG. 11 will be described. As shown in FIG. 11, the tip of the wireless pen 2 is approached toward the recording paper 5, and the detected signal strength of the electromagnetic wave indicates that the coordinate detection unit is provided when the tip of the wireless pen 2 is brought into contact with the recording paper 5. If the signal strength of the electromagnetic wave detected at 40 is 0.7 times or more (S3: YES), the timer is cleared to zero and starts (S4), and the tip of the wireless pen 2 does not contact the recording paper 5. (S5: NO), first
When the tip of the wireless pen 2 is not stationary for more than one second, which is the predetermined time (FIG. 6: S10: NO), the tip of the wireless pen 2 moves in the horizontal direction as indicated by an arrow D in FIG. (S11: NO, S12: YE)
S), if the slide ends with a predetermined character (S17: NO), the range of the slid handwritten character is repeatedly reproduced (repeat reproduction) (S18). In the repeat reproduction, specifically, the stroke data of the handwritten character in the slid range is read from the stroke information storage area 54a of the non-volatile memory 54, and the audio data at the time corresponding to the time data of the stroke data is continuously read. Read from the reproduction information storage area 54b,
Playback is performed (S18). For example, as shown in the balloon 21 in FIG. 11, "the DVD-ROM drive and the floppy drive are built-in. The DVD-ROM drive and the floppy drive are built-in."
Repeat. In this state, even if writing is performed, the additional recording mode is set in which coordinate detection is performed in the reproduction state (S19).
Then, the process returns to S1.

Next, the stop mode shown in FIG. 12 will be described. As shown in FIG. 12, the tip of the wireless pen 2 is approached toward the recording paper 5, and the signal intensity of the detected electromagnetic wave indicates that the coordinate detection unit is provided when the tip of the wireless pen 2 is brought into contact with the recording paper 5. 40 of the signal strength of the electromagnetic wave detected at 40.
If it is 7 times or more (S3: YES), the timer is cleared to zero and started (S4), the tip of the wireless pen 2 is not in contact with the recording paper 5 (S5: NO), and the first time has elapsed. In the case where the tip of the wireless pen 2 is stationary for more than one second (FIG. 6: S10: YES) and not stationary for more than the second predetermined time of 3 seconds (FIG. 7: 30: NO), FIG.
When the tip of the wireless pen 2 moves to the front (in the row direction) and immediately returns to the original position, as indicated by an arrow E shown in FIG.
3: YES), the reproduction is stopped (S34), the non-append mode is set (S36), and the process returns to S1. With this stop mode, the continuous reproduction additional recording mode and the repeat mode can be stopped. If the determination in S33 is NO, the reproduction up to that point is stopped, and then the reproduction of the sound data corresponding to the stroke data at the position where the tip of the wireless pen 2 is newly approached is started (S35). Then, the mode is set to the non-append mode (S36), and the process returns to S1.

Next, the spot reproduction additional recording mode shown in FIG. 13 will be described. As shown in FIG. 13, the tip of the wireless pen 2 is attached to the handwritten character “display 1
When the operation of approaching “5 inches” and then separating is repeated twice within a predetermined time (for example, 2 seconds) (S3: YES, S4, S5: NO, FIG. 6:
S10: NO, S11: NO, S12: NO, S13:
YES, S20: NO, S21: NO, S20: YE
S) The stroke data of the handwritten character "display is 15 inches" with the tip of the wireless pen 2 approaching is read from the stroke information storage area 54a of the non-volatile memory 54 and corresponds to the time data of the stroke data. The audio data at the time to be read is read from the continuous reproduction information storage area 54b, converted into an audio signal by the audio circuit 55, reproduced from the speaker 12 for a predetermined time (eg, 10 seconds, etc.) (S22), and set to the additional recording mode. (S23). Then, the process returns to S1.

As described above, in the input device 1 of the above-described embodiment, various reproduction methods of audio information can be selected without operating the operation mode changeover switch. Further, it is possible to add a handwriting input by referring to the voice information while reproducing the voice information without operating the operation mode switch. Therefore, it is possible to provide an input device with greatly improved operability. In addition, it is also possible to very efficiently perform the work of completing the complete memo by supplementing the written part while listening to the reproduced sound while additionally writing the part.

Further, it goes without saying that the present invention can be variously modified without being limited to the above embodiment. For example, the emission from the wireless pen 2 is not limited to electromagnetic waves, and the light is emitted by modulating the light using an infrared light emitting diode or the like. The position and height of the pen 2 may be detected. In addition, ultrasonic waves may be emitted from the wireless pen 2, and a plurality of ultrasonic detectors are provided in the voice electronic notebook 3,
The three-dimensional coordinates of the wireless pen 2 may be detected. Further, the pen is not limited to the wireless type, and a wired type pen may be used. Further, a beep may be generated each time the operation mode is received.

Further, it is needless to say that the present invention can be applied to a video reproducing / editing apparatus 60 using video information as continuous reproduction information as in the modification shown in FIG. FIG. 14 is a drawing showing a modification of the present invention. Figure 1
As shown in FIG. 4, a time table sheet 57 used for editing video information is placed on a tablet 59 having the same electrical configuration as that of the audio electronic organizer 3, and the video is connected to a control terminal 56 of the tablet 59. Connect a playback and editing device,
The user operates the wireless pen 2 on the timetable sheet 57 to control video playback, insert captions and telops of the contents written on the timetable sheet 57, and display portions corresponding to lines drawn on the timetable sheet 57. It can be easily connected and edited.

It is needless to say that the present invention can be applied to an animation editing apparatus using animation information as continuous reproduction information. For example, a time table sheet used for editing an animation is placed on a tablet having the same electrical configuration as that of the audio electronic organizer 3 described above, and an animation editing device is connected to a control terminal of the tablet. By operating the wireless pen 2 on the paper of the above, animation control, cueing by a memo written on the paper of the timetable, editing by joining the portions of the line drawn on the paper of the timetable,
It is easy to change the speed at which the animation moves according to the speed at which the line is drawn.

It is needless to say that the present invention can be applied to a music reproducing apparatus using music information as continuous reproduction information. For example, a musical score sheet can be placed on a tablet having the same electrical configuration as that of the above-mentioned audio electronic organizer 3 to write musical scores and the like, and then the wireless pen 2 can be operated to control the performance. . For example, if the score is rewritten as a repeat reproduction, the sound there is also corrected during the repetition of the performance, and the performance is performed. It is possible to efficiently compose music and the like without playing a musical instrument. Further, in the present invention, time data may be used instead of time data.

[0051]

As described above, in the input device according to the first aspect of the present invention, the first detecting means detects the movement in the first direction parallel to the detecting surface of the pen, and the second detecting means. Detects movement in a second direction parallel to the detection surface of the pen and orthogonal to the first direction, and third detection means detects movement in a direction perpendicular to the detection surface of the pen. Fourth detecting means detects a stationary time near a predetermined position on the detecting surface, and identifying means detects an input device based on a detection result of at least two or more of the first to fourth detecting means. Of the operation mode can be identified. Therefore, the operation mode can be instructed to the input device without operating the operation mode switch or the like one by one.

The input device of the invention according to claim 2 is:
In addition to the effect of the invention according to claim 1, in addition to the stroke information input means, stroke information of a handwritten character using a pen is input, and the continuous reproduction information input means reproduces audio and video in a time series continuously. Continuous reproduction information is input, the continuous reproduction information storage means stores the continuous reproduction information input from the continuous reproduction information input means, and the stroke information storage means stores the stroke information and the stroke information input from the stroke information input means. And the continuous reproduction information input from the continuous reproduction information input means. The reproduction information reproduces the continuous reproduction information stored in the continuous reproduction information storage means, and the association information reading means designates using the pen. The associated information of the stroke information thus read is read from the stroke information storage means, and the continuous reproduction information reading means reads the associated information. Based on the read association information, the continuous reproduction information is read from the continuous reproduction information storage means. When the reproduction control means reproduces the continuous reproduction information read by the continuous reproduction information reading means by the reproduction means, the predetermined reproduction information is identified by the identification means. In the operation mode, the reproduction of the continuous reproduction information can be controlled. Therefore, the reproduction of the continuous reproduction information can be controlled without operating the operation mode switch or the like one by one.

The input device of the invention according to claim 3 is:
In addition to the effect of the invention according to claim 2, in the predetermined operation mode, a part of the continuous reproduction information stored in the continuous reproduction information storage means can be repeatedly reproduced.

The input device of the invention according to claim 4 is:
In addition to the effect of the invention according to claim 2, in the predetermined operation mode, the reproduction can be performed while skipping the continuous reproduction information stored in the continuous reproduction information storage means.

The input device of the invention according to claim 5 is:
In addition to the effect of the invention according to claim 2, in the predetermined operation mode, only a part of the continuous reproduction information stored in the continuous reproduction information storage means can be reproduced.

Further, the input device of the invention according to claim 6 is:
In addition to the effect of the invention according to claim 1, on the detection surface,
The recording medium on which the writing trajectory of the pen remains can be held, and in a state where the pen is brought close to the recording medium, the identification unit performs at least two or more of the first to fourth detection units. The operation mode can be identified based on the detection result of the detection means.

The input device of the invention according to claim 7 is:
In addition to the effect of the invention according to claim 3 or 5, a part of the continuous reproduction information can be a part synchronized with a range of stroke information designated using a pen. Therefore, unnecessary reproduction of undesired continuous reproduction information can be prevented.

[Brief description of the drawings]

FIG. 1 is a plan view showing an external configuration of a wireless pen 2 and a voice electronic organizer 3 constituting an input device 1. FIG.

FIG. 2 is a block diagram showing an electrical configuration of the voice electronic organizer 3.

FIG. 3 is a conceptual diagram of a storage area of a nonvolatile memory.

FIG. 4 is a diagram illustrating an example of a method of using the voice electronic organizer 3;

FIG. 5 is a flowchart of a process in a sound reproduction mode executed by a CPU 50 of the sound electronic organizer 3;

FIG. 6 is a flowchart of a process in a sound reproduction mode executed by the CPU 50 of the sound electronic organizer 3;

FIG. 7 is a flowchart of a process in a sound reproduction mode executed by the CPU 50 of the sound electronic organizer 3;

FIG. 8 is a diagram illustrating the movement of the wireless pen 2 when continuous reproduction is started.

FIG. 9 is a diagram showing the movement of the wireless pen 2 in the continuous reproduction additional recording mode.

FIG. 10 is a diagram showing the movement of the wireless pen 2 in the skip search mode.

FIG. 11 is a diagram showing the movement of the wireless pen 2 in the repeat playback mode.

FIG. 12 shows a wireless pen 2 in a stop mode.
FIG. 6 is a diagram showing the movement of the image.

FIG. 13 is a diagram illustrating the movement of the wireless pen 2 in the spot reproduction additional recording mode.

FIG. 14 is a drawing showing a modification of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Input device 2 Wireless pen 3 Voice electronic notebook 4 Case 5, 6 Recording paper 7 Ring 8, 9 Page detection device 10 Display device 11 Microphone 12 Speaker 13 Switch 13a Pallet switch 13b Recording switch 13c Stop switch 13d Reproduction switch 13e Talk Speed switch 13f Rewind switch 13g Fast-forward switch 40 Coordinate detection unit 41 Data demodulation unit 42 Control unit 50 CPU 51 RAM 52 ROM 53 I / O interface 54 Nonvolatile memory 54a Stroke information storage area 54b Continuous playback information storage area 55 Voice Circuit 56 control terminal

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] April 2, 2001 (2001.4.2)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Full text

[Correction method] Change

[Correction contents]

[Document Name] Statement

[Title of the Invention] Input device

[Claims]

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for inputting handwritten character data using a wireless or wired pen and tablet and for continuously reproducing information such as voice data in correspondence with the handwritten data of the handwritten characters. The present invention relates to an input device for storing and reproducing.

[0002]

2. Description of the Related Art Conventionally, there has been known a coordinate data input device for inputting XY coordinate position data with respect to a tablet using a wireless pen having a built-in electromagnetic wave signal generation circuit and a tablet having a coil. I have. Also, by combining this coordinate data input device with a device for recording and reproducing voices, a device for recording and reproducing voices in meetings and the like can be used to continuously record voices and also to write handwritten data as notes for creating minutes. There has been proposed an apparatus that stores data in association with data and instructs handwritten data after the meeting to reproduce the corresponding sound.

In the latter device, an instruction for switching operation modes other than the input of handwritten characters (such as a voice recording instruction and a voice reproduction instruction) is input by clicking a switch provided at a specific position on the tablet with a pen. (Hereinafter, referred to as “first method”). Further, there is also known a device in which a pointer on a tablet is moved to input an operation based on a gesture or a moving direction (hereinafter, referred to as a gesture).
This is referred to as a "second method." ). Further, there is also known a method in which an operation mode is determined by detecting a pen up / down time and a moving speed (hereinafter, referred to as a “third method”).

[0004]

However, the above-mentioned first method has a problem that an operation related to a writing stroke of an input handwritten character cannot be performed. That is, since the operation mode is switched by operating a switch provided at a specific position on the tablet, when writing handwritten characters while reproducing information associated with the writing stroke of the input handwritten characters, However, there is a problem that the pen must be frequently moved from the writing surface and the switch must be operated by the pen tip. Further, when the switch is switched, the reproduction is stopped, and it is necessary to write on the memory, which is inconvenient.

In the second method, when a gesture is performed by moving a pen and moving a pointer on paper placed on a tablet, a locus of the gesture is recorded on a previously written memo. There was a problem that it was added and it became difficult to read. In addition, when a gesture is performed in the air while the pen is separated from the tablet, there is a problem that it is difficult to determine whether the gesture is a gesture or whether the pen is merely floating during writing.

Further, in the third method, since the pen up / down time and the moving speed are detected, whether the pen is being written or not is determined.
There is a problem that an error easily occurs in the determination of whether to switch the operation mode. In addition, it can handle simple on / off, cursor movement, and scrolling, but can support all kinds of playback control of continuous playback information that is continuously played back in time series such as audio and video. Did not.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and an object of the present invention is to provide an input device that can accurately and easily switch operation modes and that is easy to use.

[0008]

In order to solve the above-mentioned problems, an input device according to the first aspect of the present invention comprises a detection surface for detecting a position of a pen, and a first surface parallel to the detection surface of the pen. First detecting means for detecting movement in a direction, and second detecting means for detecting movement in a second direction parallel to the detection surface of the pen and orthogonal to the first direction. A third step of detecting a movement of the pen in a direction perpendicular to the detection surface;
Detecting means, a fourth detecting means for detecting a stationary time near a predetermined position of the detecting surface, and a detection result of at least two or more of the first to fourth detecting means. Identification means for identifying an operation mode instruction to the input device.

In the input device having this configuration, the first detecting means detects the movement in the first direction parallel to the detection surface of the pen,
The second detection means detects movement in a second direction parallel to the detection surface of the pen and perpendicular to the first direction, and the third detection means detects a movement in a direction perpendicular to the detection surface of the pen. Detect movement,
Fourth detecting means detects a stationary time near a predetermined position on the detecting surface, and identifying means detects an input device based on a detection result of at least two or more of the first to fourth detecting means. Identify the operation mode instruction for.

Further, the input device of the invention according to claim 2 is
In addition to the configuration of the invention according to claim 1, in addition to the stroke information input means for inputting stroke information of handwritten characters using the pen, continuous reproduction information such as audio and video is reproduced continuously in time series. Continuous playback information input means for inputting,
Continuous playback information storage means for storing the continuous playback information input from the continuous playback information input means; stroke information input from the stroke information input means; and the stroke information input from the continuous playback information input means. Stroke information storage means for storing association information with continuous playback information, playback means for playing back continuous playback information stored in the continuous playback information storage means, and association information for stroke information designated using the pen Information reading means for reading the continuous reproduction information from the continuous reproduction information storage means based on the association information read by the association information reading means. When the continuous reproduction information read by the reproduction information reading means is reproduced by the reproducing means, To the identification means and a reproduction control means for controlling the reproduction of the continuous reproduction information in a predetermined operation mode identified.

In the input device having this configuration, in addition to the function of the invention according to claim 1, stroke information of a handwritten character using a pen is input by the stroke information input means, and voice or video or the like is input by the continuous reproduction information input means. The continuous reproduction information which is continuously reproduced in time series is input, the continuous reproduction information storage means stores the continuous reproduction information input from the continuous reproduction information input means, and the stroke information storage means transmits from the stroke information input means. Input stroke information, and
The storage unit stores association information between the stroke information and the continuous reproduction information input from the continuous reproduction information input unit, the reproduction unit reproduces the continuous reproduction information stored in the continuous reproduction information storage unit, and the association information reading unit uses a pen. The continuous reproduction information reading means reads the continuous reproduction information from the continuous reproduction information storage means based on the association information read by the association information reading means, and performs reproduction control. When the reproducing means reproduces the continuous reproduction information read by the continuous reproduction information reading means, the reproduction means controls the reproduction of the continuous reproduction information in a predetermined operation mode identified by the identification means.

Further, the input device according to the third aspect of the present invention,
In addition to the configuration of the invention according to claim 2, the predetermined operation mode is configured to repeatedly reproduce a part of the continuous reproduction information stored in the continuous reproduction information storage unit.

[0013] In the input device having this configuration, in addition to the function of the invention according to claim 2, in a predetermined operation mode, a part of the continuous reproduction information stored in the continuous reproduction information storage means is repeatedly reproduced.

Further, the input device of the invention according to claim 4 is:
In addition to the configuration of the invention according to claim 2, the predetermined operation mode is characterized in that the reproduction is performed while skipping the continuous reproduction information stored in the continuous reproduction information storage means.

In the input device having this configuration, in addition to the operation of the invention according to claim 2, in a predetermined operation mode, the continuous reproduction information stored in the continuous reproduction information storage means is skipped and reproduced.

Further, the input device of the invention according to claim 5 is as follows.
In addition to the configuration of the invention according to claim 2, the predetermined operation mode is configured to reproduce only a part of the continuous reproduction information stored in the continuous reproduction information storage unit.

In the input device having this configuration, in addition to the function of the invention according to claim 2, in a predetermined operation mode, only a part of the continuous reproduction information stored in the continuous reproduction information storage means is reproduced.

The input device of the invention according to claim 6 is:
In addition to the configuration of the invention according to claim 1, on the detection surface, a recording medium in which a writing locus with a pen remains can be held, and in a state where the pen is close to the recording medium,
The identification unit is configured to identify an operation mode based on detection results of at least two or more of the first to fourth detection units.

In the input device having this configuration, in addition to the effect of the invention according to claim 1, a recording medium on which the writing locus of the pen remains can be held on the detection surface. In a state where the pen is in proximity, the identification unit identifies an operation mode based on detection results of at least two or more of the first to fourth detection units.

Further, the input device of the invention according to claim 7 is:
In addition to the configuration of the invention according to claim 3 or 5, a part of the continuous reproduction information is a part synchronized with a range of stroke information designated by using the pen. .

According to the input device having the above configuration, the present invention is applied to a third aspect of the present invention.
In addition to the effect of the invention according to
This is a part synchronized with the range of the stroke information specified using the pen.

[0022]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings.

First, the configuration of an input device 1 according to an embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a plan view showing an external configuration of a wireless pen 2 and a voice electronic organizer 3 constituting the input device 1, and FIG. 2 is a block diagram showing an electrical configuration of the voice electronic organizer 3.
FIG. 4 is a conceptual diagram of a storage area of a non-volatile memory such as a flash memory, and FIG.

As shown in FIG. 1, an input device 1 includes a wireless pen 2 for transmitting electromagnetic waves having a predetermined frequency from the tip.
And a voice electronic organizer 3 that receives the electromagnetic wave with a built-in coil. Inside the wireless pen 2, an electromagnetic wave transmission circuit (not shown) and a pen core are incorporated, and the tip of the pen core protrudes from the tip of the wireless pen 2.
It is possible to write on ordinary paper such as a pencil, a mechanical pencil, a ball-point pen, or a felt-tip pen, and to draw characters, figures, symbols, and the like on recording sheets 5 and 6 described later. In addition, a coil that emits an electromagnetic wave is built in the tip of the wireless pen 2.

The audio electronic organizer 3 has a substantially rectangular double-foldable housing 4, and has a plurality of pages held at the center of the surface of the housing 4 by six openable and closable rings 7. Sheets 5 and 6 are placed, and page detection devices 8 and 9 including page sensors that detect pages of the recording sheets 5 and 6 are provided at both upper ends of the housing 4.
A display device 10 composed of a liquid crystal display and displaying an operation mode and the like, a microphone 11 for inputting a sound, and a speaker 12 for emitting a reproduced sound
And a switch 13 are provided. Switch 1
3 is a pallet switch 13a and a recording switch 13b
, A stop switch 13c, a reproduction switch 13d, a speech speed switch 13e, a rewind switch 13f, and a fast forward switch 13g. Note that recording paper 5,
A coil for detecting an electromagnetic wave, which will be described later, is provided inside the portion where 6 is placed.

In this embodiment, the tip of the wireless pen 2 outputs an electromagnetic wave having a predetermined frequency which is different between the time when the tip is in contact with the recording sheets 5 and 6 and the time when the tip is not in contact. The audio electronic organizer 3 functions as a magnetically coupled tablet. Therefore, when the user uses the wireless pen 2 to write the characters by touching the tip of the wireless pen 2 with the recording papers 5 and 6, the coordinate data at the position designated by the tip is converted to the magnetically coupled voice electronic sound. It is configured to be recorded by the notebook 3. Further, when the voice / electronic notepad 3 is set to the recording mode and handwritten characters are inputted to the recording papers 5 and 6 using the wireless pen 2, the stroke data of the handwritten characters and the time data by the time stamp are associated with each other, 6 is digitally recorded. The time data may be given to each piece of coordinate data constituting a stroke (one continuous line written from when the pen comes into contact with the paper until it leaves), or may be given only at the beginning of the stroke. When the tip of the wireless pen 2 is brought close to or near the handwritten characters recorded on the recording papers 5 and 6, audio data corresponding to the stroke data of the handwritten characters is reproduced from the speaker 12. Has become. That is, the audio data position to start the reproduction is obtained based on the time data given to the stroke data including the coordinates closest to the coordinates of the tip of the wireless pen 2.

Next, an electric circuit configuration of the voice electronic organizer 3 will be described with reference to FIG. FIG. 2 is a block diagram showing an electric circuit configuration of the audio electronic organizer 3.

The voice electronic notebook 3 is provided below the recording sheets 5 and 6 shown in FIG. 1, and has a coordinate detector 40 for detecting the position of the tip of the wireless pen 2 as XY coordinate data by electromagnetic waves; It comprises a demodulation unit 41 and a control unit 42. The coordinate detection unit 40 includes the X-axis multiplexer 4
And a plurality of coils connected to the Y-axis multiplexer 4
3 and a plurality of coils connected thereto, so that the position of the tip of the pen core of the wireless pen 2 can be detected as XY coordinate data by electromagnetic waves.

The data demodulating section 41 is provided with a coordinate detecting section 4.
0 X-axis multiplexer 44 and Y-axis multiplexer 4
3, a multiplexer 45 to which the received signal is input, an amplifier circuit 46 for the received signal, a demodulator circuit 47 for demodulating (amplitude detection) the output signal from the amplifier circuit 46, and a demodulator circuit 47.
An A / D converter 48 for digitizing the demodulated signal output from the A / D converter and a limiter circuit 49 for amplifying the output signal from the amplifier circuit 46 into a pulse having a constant amplitude. The output of the limiter circuit 49 is input to the CPU 50 through the I / O interface 53,
The frequency is detected by counting the pulse period in the PU 50. Based on this frequency, it is determined whether or not the tip of the wireless pen 2 is in contact with the recording sheets 5 and 6.

Further, the control unit 42 has a CPU 50 for controlling the voice electronic notebook 3 and an R for temporarily storing data.
A ROM 52 storing a control program executed by the CPU 50, a threshold value, and the like, a non-volatile memory 54 including a flash memory storing stroke data and voice data of input handwritten characters, and a page detection device. 8, 9, display device 10 and switch 13,
An I / O interface 53 for mediating data with the CPU 50, an audio circuit 55 for converting the input voice from the microphone 11 into digital data, driving the speaker 12, and generating voice data, and an externally connected voice circuit 55 And a control terminal 56 for outputting control data for controlling the playback and storage of the video information.

Next, referring to FIG.
The storage area No. 4 will be described. This non-volatile memory 54
A flash memory or the like capable of electrically erasing stored contents is used. As shown in FIG. 3, the nonvolatile memory 54 includes a stroke information storage area 54a for storing stroke information of handwritten characters detected by the coordinate detection unit 40 together with time data based on a time stamp, and a microphone 1
1 is provided with a continuous reproduction information storage area 54b for storing the input audio data. Therefore, the recording sheets 5, 6
The stroke data written above with the wireless pen 2 is correlated with the time data by the time stamp.
The data is stored in the nonvolatile memory 54 in association with the audio data input to the microphone 6.

It is also possible to connect an external digital video information input device to the I / O interface 53 and store the video information in the continuous reproduction information storage area 54b.

Next, with reference to FIG. 4, a basic method of using the audio electronic organizer 3 will be described. As shown in the balloon in FIG. 4, the voice says, "We have developed a new PC. The CPU is Pentium III, the clock is 700 MHz, and the memory is 128.
There is MB. DVD-ROM drive and floppy drive are built-in. The pointing device is a touch pad and the display is a 15 inch TFT. The resolution is UXGA. Is input to the microphone 11 of the audio electronic organizer 3, and at the same time,
"New PC", "CP" on the recording paper 5 with the wireless pen 2
U Pentium "," memory "," pointing "," display is 15 ", and" resolution "are handwritten, the audio data is converted into digital data by the audio circuit 55, and the continuous reproduction information in the nonvolatile memory 54 The stroke data of the character stored in the storage area 54b and handwritten on the recording paper 5 with the wireless pen 2 is stored in the nonvolatile memory 54 together with the time stamped time data.
Is stored in the stroke information storage area 54a.

Next, with reference to FIGS. 5 to 13, the details of the sound reproduction operation of the sound electronic notebook 3 will be described. FIGS. 5 to 7 are flowcharts of processing in the sound reproduction mode executed by the CPU 50 of the sound electronic organizer 3. FIG. 8 is a diagram showing the movement of the wireless pen 2 when continuous reproduction is started.
FIG. 9 is a diagram showing the movement of the wireless pen 2 in the continuous reproduction additional recording mode, FIG. 10 is a diagram showing the movement of the wireless pen 2 in the skip cue mode, and FIG.
FIG. 12 is a diagram illustrating the movement of the wireless pen 2 in the repeat playback mode. FIG. 12 illustrates the wireless pen 2 in the stop mode.
FIG. 13 is a diagram showing the movement of the wireless pen 2 in the spot reproduction additional recording mode. still,
The programs of the flowcharts shown in FIGS. 5 to 7 are stored in the ROM 52 of the control unit 42.

In the sound reproduction mode of the sound electronic notebook 3, the movement of the handwritten characters in the line direction (first direction) parallel to the surface of the recording sheets 5, 6 The movement of the wireless pen 2 in parallel and in the column direction of the handwritten characters (the second direction orthogonal to the first direction) and the up and down directions of the wireless pen 2 perpendicular to the surfaces of the recording papers 5 and 6 (the third direction) direction)
And the stationary time near a predetermined position close to (but not in contact with) the surfaces of the recording papers 5 and 6, and the reproduction of continuous reproduction information such as audio information is performed in accordance with the combination and order. An operation mode for controlling the recording state is identified. These movements and stillness are detected in a state where the wireless pen 2 is not in contact with the surfaces of the recording sheets 5 and 6.

In the audio electronic organizer 3, apart from the processing of the flowcharts shown in FIGS. 5 to 7, the distance that the wireless pen 2 is separated from the recording paper 5, 6 The detection of the coordinates when the wireless pen 2 is performed is performed, and based on the results, the sliding amount of the tip of the wireless pen 2 or the stationary state for a predetermined time (the amount of separation of the wireless pen 2 is less than a predetermined value, (Within the range). In addition, in the sound electronic notebook 3, when continuous reproduction of sound is started, the state is continuously reproduced until reproduction control by the next operation of the wireless pen 2 is performed. .

The details of the sound reproducing operation of the sound electronic organizer 3 will be described below with reference to the flowcharts of FIGS.
When performing the sound reproduction operation of the sound electronic notebook 3, first,
The reproduction mode is started by depressing the reproduction switch 13d provided on the housing 4. Even if the reproduction mode is started, the actual reproduction is not performed until the pen is instructed. Stop switch 13c for stopping sound reproduction
Is pressed (S1: YES), the reproduction mode ends (S2). If audio playback is not stopped (S
1: NO), and then, as shown in FIG.
Is directed in the direction of arrow A with the leading end of the recording paper 5 facing the recording paper 5. If the amount of separation of the tip of the wireless pen 2 from the recording paper 5 is equal to or less than the predetermined value of 3 mm (S3: YES), the timer for measuring the stationary time is cleared to zero and started (S4). Whether or not the amount of separation of the wireless pen 2 from the recording paper 5 is equal to or less than a predetermined value of 3 mm depends on the signal strength of the detected electromagnetic wave when the tip of the wireless pen 2 contacts the recording paper 5. The determination is made based on whether or not the signal intensity of the electromagnetic wave detected by the coordinate detection unit 40 is 0.7 times or more.

When the signal strength of the detected electromagnetic wave is brought into contact with the recording paper 5 by the tip of the wireless pen 2,
If the signal strength of the electromagnetic wave detected at 0 is 0.7 times or more (S3: YES), the timer is cleared to zero and started (S4), and if the tip of the wireless pen 2 is not in contact with the recording paper 5, (S5: NO) Next, it is determined whether or not the tip of the wireless pen 2 is stationary for at least one second, which is the first predetermined time (FIG. 6: S10). If the tip of the wireless pen 2 is stationary for 1 second or more as the first predetermined time (S10: YES), the tip of the wireless pen 2 is stationary for 3 seconds or more as the second predetermined time. It is determined whether or not there is (S30 in FIG. 7). Whether the tip of the wireless pen 2 is stationary or not is determined to be stationary when the coordinate position of the tip of the wireless pen 2 and the signal strength of the detected electromagnetic wave do not change.

If the tip of the wireless pen 2 is not stopped for 3 seconds or more, which is the second predetermined time (S30: NO),
If the operation of moving the tip of the wireless pen 2 in the forward direction (row direction) as shown by the arrow E in FIG. 12 and immediately returning to the original position is not performed (S33: NO), the tip of the wireless pen 2 The stroke data including the coordinates closest to the coordinates of the tip of the wireless pen 2 at the time of the approach is read from the stroke information storage area 54a of the nonvolatile memory 54. That is,
The stroke data of the handwritten character with the "memory" to which the tip of the wireless pen 2 approaches is read from the stroke information storage area 54a of the non-volatile memory 54, and the voice data at the time corresponding to the time data of the stroke data is continuously reproduced. The data is read from the information storage area 54b, converted into an audio signal by the audio circuit 55, and output from the speaker 12 (S35). For example, as shown in the balloon 21 in FIG. 8, the reproduction is performed as "there is 128 MB of memory". In this case, a continuous reproduction non-recording mode is set in which recording cannot be performed while reproduction is continued (S36). Then, the process returns to S1.

In the above example, the timer start (S
4) Later, when the tip of the wireless pen 2 comes into contact with the recording paper 5 (S5: YES) and is not in the additional recording mode (S6: NO), the reproduction of the sound is stopped (S7), and the writing mode is performed. As a result, a stroke handwritten on the recording paper 5 is detected (S8). Thereafter, when the tip of the wireless pen 2 is separated from the recording paper 5 (S9: YES), the process returns to S1.

In the above example, if the handset is still for 3 seconds or more, which is the second predetermined time (S30: YES), the handwritten character of the "memory" where the tip of the wireless pen 2 approaches is approached. The stroke data is read from the stroke information storage area 54a of the nonvolatile memory 54, and the audio data at the time corresponding to the time data of the stroke data is read from the continuous reproduction information storage area 54b.
5, the audio signal is converted into an audio signal and output from the speaker 12 (S31), and the mode is set to the additional recording mode (S32). Then, the process returns to S1. In this state, as shown in FIG.
In the continuous reproduction additional recording mode, handwritten characters can be additionally recorded on the recording paper 5 with the tip of the wireless pen 2 while listening to the reproduction sound (S1: YES, S3: YES, S4).
S5: YES, S6: YES, S8). The coordinates of the tip of the wireless pen 2 are also detected while the handwriting is being written, and the stroke data is also stored in the stroke information storage area 54 a of the nonvolatile memory 54.

Next, the skip search mode shown in FIG. 10 will be described. As shown in FIG.
Of the electromagnetic wave detected by the coordinate detecting unit 40 when the tip of the wireless pen 2 is brought into contact with the recording paper 5, the signal strength of the detected electromagnetic wave is 0. In the case of .times.7 or more (S3: YES), the timer is cleared to zero and started (S4), the tip of the wireless pen 2 is not in contact with the recording paper 5 (S5: NO), and the first predetermined time is set. When the tip of the wireless pen 2 is not stopped for more than 1 second (FIG. 6: S10: NO), the tip of the wireless pen 2 is moved forward (in the row direction) as indicated by an arrow C in FIG. ) (S11: YES),
The range of the handwritten character in the slid column direction is skip-reproduced (S15, S16: YES). In the skip reproduction, specifically, the stroke data of the handwritten characters in each row is stored in the stroke information storage area 54 of the nonvolatile memory 54.
Then, the audio data at the time corresponding to the time data of the stroke data is read from the continuous reproduction information storage area 54b, and is reproduced from the head, for example, every two seconds for each column (S15). For example, the balloon 21 in FIG.
"CPU", "Clock", "Memory",
"DVD", "point", and "display is" are reproduced. Then, the process returns to S1.

Next, the repeat reproduction mode shown in FIG. 11 will be described. As shown in FIG. 11, the tip of the wireless pen 2 is approached toward the recording paper 5, and the detected signal strength of the electromagnetic wave indicates that the coordinate detection unit is provided when the tip of the wireless pen 2 is brought into contact with the recording paper 5. If the signal strength of the electromagnetic wave detected at 40 is 0.7 times or more (S3: YES), the timer is cleared to zero and starts (S4), and the tip of the wireless pen 2 does not contact the recording paper 5. (S5: NO), first
When the tip of the wireless pen 2 is not stationary for more than one second, which is the predetermined time (FIG. 6: S10: NO), the tip of the wireless pen 2 moves in the horizontal direction as indicated by an arrow D in FIG. (S11: NO, S12: YE)
S), if the slide ends with a predetermined character (S17: NO), the range of the slid handwritten character is repeatedly reproduced (repeat reproduction) (S18). Specifically, in the repeat reproduction, the stroke data of the handwritten character in the slid range is read out from the stroke information storage area 54a of the nonvolatile memory 54, and the audio data at the time corresponding to the time data of the stroke data is continuously read. Read from the reproduction information storage area 54b,
Playback is performed (S18). For example, as shown in a balloon 21 in FIG. 11, "the DVD-ROM drive and the floppy drive are built-in. The DVD-ROM drive and the floppy drive are built-in."
Repeat. In this state, even if writing is performed, the additional recording mode is set in which coordinate detection is performed in the reproduction state (S19).
Then, the process returns to S1.

Next, the stop mode shown in FIG. 12 will be described. As shown in FIG. 12, the tip of the wireless pen 2 is approached toward the recording paper 5, and the signal intensity of the detected electromagnetic wave indicates that the coordinate detection unit is provided when the tip of the wireless pen 2 is brought into contact with the recording paper 5. 40 of the signal strength of the electromagnetic wave detected at 40.
If it is 7 times or more (S3: YES), the timer is cleared to zero and started (S4), the tip of the wireless pen 2 is not in contact with the recording paper 5 (S5: NO), and the first time has elapsed. In the case where the tip of the wireless pen 2 is stationary for more than one second (FIG. 6: S10: YES) and not stationary for more than the second predetermined time of 3 seconds (FIG. 7: 30: NO), FIG.
When the tip of the wireless pen 2 moves to the front (in the row direction) and immediately returns to the original position, as indicated by an arrow E shown in FIG.
3: YES), the reproduction is stopped (S34), the non-append mode is set (S36), and the process returns to S1. With this stop mode, the continuous reproduction additional recording mode and the repeat mode can be stopped. If the determination in S33 is NO, the reproduction up to that point is stopped, and then the reproduction of the sound data corresponding to the stroke data at the position where the tip of the wireless pen 2 is newly approached is started (S35). Then, the mode is set to the non-append mode (S36), and the process returns to S1.

Next, the spot reproduction additional recording mode shown in FIG. 13 will be described. As shown in FIG. 13, the tip of the wireless pen 2 is attached to the handwritten character “display 1
5 ” and then continue to release.
If it is repeated within a predetermined time (for example, 2 seconds) (S3: YES, S4, S5: NO, FIG. 6: S1)
0: NO, S11: NO, S12: NO, S13: YE
S, S20: NO, S21: NO, S20: YES),
The stroke data of the handwritten character "display 15" with the tip of the wireless pen 2 approaching is read from the stroke information storage area 54a of the nonvolatile memory 54, and the time corresponding to the time data of the stroke data is read. The audio data is read out from the continuous reproduction information storage area 54b, converted into an audio signal by the audio circuit 55, and is output from the speaker 12 for a predetermined time (for example, 10 seconds).
Second) (S22), and set to the additional recording mode (S22).
23). Then, the process returns to S1.

As described above, in the input device 1 of the above-described embodiment, various reproduction methods of audio information can be selected without operating the operation mode changeover switch. Further, it is possible to add a handwriting input by referring to the voice information while reproducing the voice information without operating the operation mode switch. Therefore, it is possible to provide an input device with greatly improved operability. In addition, it is also possible to very efficiently perform the work of completing the complete memo by supplementing the written part while listening to the reproduced sound while additionally writing the part.

Further, it goes without saying that the present invention can be variously modified without being limited to the above embodiment. For example, the emission from the wireless pen 2 is not limited to electromagnetic waves, and the light is emitted by modulating the light using an infrared light emitting diode or the like. The position and height of the pen 2 may be detected. In addition, ultrasonic waves may be emitted from the wireless pen 2, and a plurality of ultrasonic detectors are provided in the voice electronic notebook 3,
The three-dimensional coordinates of the wireless pen 2 may be detected. Further, the pen is not limited to the wireless type, and a wired type pen may be used. Further, a beep may be generated each time the operation mode is received.

Further, it is needless to say that the present invention can be applied to a video reproducing / editing apparatus 60 using video information as continuous reproduction information as in the modification shown in FIG. FIG. 14 is a drawing showing a modification of the present invention. Figure 1
As shown in FIG. 4, a time table sheet 57 used for editing video information is placed on a tablet 59 having the same electrical configuration as that of the audio electronic organizer 3, and the video is connected to a control terminal 56 of the tablet 59. Connect a playback and editing device,
The user operates the wireless pen 2 on the timetable sheet 57 to control video playback, insert captions and telops of the contents written on the timetable sheet 57, and display portions corresponding to lines drawn on the timetable sheet 57. It can be easily connected and edited.

It is needless to say that the present invention can be applied to an animation editing apparatus using animation information as continuous reproduction information. For example, a time table sheet used for editing an animation is placed on a tablet having the same electrical configuration as that of the audio electronic organizer 3 described above, and an animation editing device is connected to a control terminal of the tablet. By operating the wireless pen 2 on the paper of the above, animation control, cueing by a memo written on the paper of the timetable, editing by joining the portions of the line drawn on the paper of the timetable,
It is easy to change the speed at which the animation moves according to the speed at which the line is drawn.

It is needless to say that the present invention can be applied to a music reproducing apparatus using music information as continuous reproduction information. For example, a musical score sheet can be placed on a tablet having the same electrical configuration as that of the above-mentioned audio electronic organizer 3 to write musical scores and the like, and then the wireless pen 2 can be operated to control the performance. . For example, if the score is rewritten as a repeat reproduction, the sound there is also corrected during the repetition of the performance, and the performance is performed. It is possible to efficiently compose music and the like without playing a musical instrument. Further, in the present invention, time data may be used instead of time data.

[0051]

As described above, in the input device according to the first aspect of the present invention, the first detecting means detects the movement in the first direction parallel to the detecting surface of the pen, and the second detecting means. Detects movement in a second direction parallel to the detection surface of the pen and orthogonal to the first direction, and third detection means detects movement in a direction perpendicular to the detection surface of the pen. Fourth detecting means detects a stationary time near a predetermined position on the detecting surface, and identifying means detects an input device based on a detection result of at least two of the first to fourth detecting means. Of the operation mode can be identified. Therefore, the operation mode can be instructed to the input device without operating the operation mode switch or the like one by one.

The input device of the invention according to claim 2 is:
In addition to the effect of the invention according to claim 1, the stroke information of the handwritten character using the pen is input by the stroke information input means, and the continuous reproduction information input means reproduces the sound or the video continuously in time series. Continuous reproduction information is input, the continuous reproduction information storage means stores the continuous reproduction information input from the continuous reproduction information input means, and the stroke information storage means stores the stroke information and the stroke information input from the stroke information input means. And the continuous reproduction information input from the continuous reproduction information input means. The reproduction information reproduces the continuous reproduction information stored in the continuous reproduction information storage means, and the association information reading means designates using the pen. The associated information of the stroke information thus read is read from the stroke information storage means, and the continuous reproduction information reading means reads the associated information. Based on the read association information, the continuous reproduction information is read from the continuous reproduction information storage means. When the reproduction control means reproduces the continuous reproduction information read by the continuous reproduction information reading means by the reproduction means, the predetermined reproduction information is identified by the identification means. In the operation mode, the reproduction of the continuous reproduction information can be controlled. Therefore, the reproduction of the continuous reproduction information can be controlled without operating the operation mode switch or the like one by one.

The input device of the invention according to claim 3 is:
In addition to the effect of the invention according to claim 2, in the predetermined operation mode, a part of the continuous reproduction information stored in the continuous reproduction information storage means can be repeatedly reproduced.

The input device of the invention according to claim 4 is:
In addition to the effect of the invention according to claim 2, in the predetermined operation mode, the reproduction can be performed while skipping the continuous reproduction information stored in the continuous reproduction information storage means.

The input device of the invention according to claim 5 is:
In addition to the effect of the invention according to claim 2, in the predetermined operation mode, only a part of the continuous reproduction information stored in the continuous reproduction information storage means can be reproduced.

Further, the input device of the invention according to claim 6 is:
In addition to the effect of the invention according to claim 1, on the detection surface,
The recording medium on which the writing trajectory of the pen remains can be held, and in a state where the pen is brought close to the recording medium, the identification unit performs at least two or more of the first to fourth detection units. The operation mode can be identified based on the detection result of the detection means.

The input device of the invention according to claim 7 is:
In addition to the effect of the invention according to claim 3 or 5, a part of the continuous reproduction information can be a part synchronized with a range of stroke information designated using a pen. Therefore, unnecessary reproduction of undesired continuous reproduction information can be prevented.

[Brief description of the drawings]

FIG. 1 is a plan view showing an external configuration of a wireless pen 2 and a voice electronic organizer 3 constituting an input device 1. FIG.

FIG. 2 is a block diagram showing an electrical configuration of the voice electronic organizer 3.

FIG. 3 is a conceptual diagram of a storage area of a nonvolatile memory.

FIG. 4 is a diagram illustrating an example of a method of using the voice electronic organizer 3;

FIG. 5 is a flowchart of a process in a sound reproduction mode executed by a CPU 50 of the sound electronic organizer 3;

FIG. 6 is a flowchart of a process in a sound reproduction mode executed by the CPU 50 of the sound electronic organizer 3;

FIG. 7 is a flowchart of a process in a sound reproduction mode executed by the CPU 50 of the sound electronic organizer 3;

FIG. 8 is a diagram illustrating the movement of the wireless pen 2 when continuous reproduction is started.

FIG. 9 is a diagram showing the movement of the wireless pen 2 in the continuous reproduction additional recording mode.

FIG. 10 is a diagram showing the movement of the wireless pen 2 in the skip search mode.

FIG. 11 is a diagram showing the movement of the wireless pen 2 in the repeat playback mode.

FIG. 12 shows a wireless pen 2 in a stop mode.
FIG. 6 is a diagram showing the movement of the image.

FIG. 13 is a diagram illustrating the movement of the wireless pen 2 in the spot reproduction additional recording mode.

FIG. 14 is a drawing showing a modification of the present invention.

[Explanation of Signs] 1 Input device 2 Wireless pen 3 Voice electronic organizer 4 Case 5,6 Recording paper 7 Ring 8,9 Page detector 10 Display device 11 Microphone 12 Speaker 13 Switch 13a Palette switch 13b Recording switch 13c Stop switch 13d Reproduction switch 13e Speaking speed switch 13f Rewind switch 13g Fast-forward switch 40 Coordinate detection unit 41 Data demodulation unit 42 Control unit 50 CPU 51 RAM 52 ROM 53 I / O interface 54 Non-volatile memory 54a Stroke information storage area 54b Continuous reproduction Information storage area 55 Audio circuit 56 Control terminal

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B047 AA27 5B068 AA05 AA22 BD02 BD17 BD25 BE12 CC06 CC17 CD06

Claims (7)

[Claims] 1. A detection surface for detecting a position of a pen; a first detection means for detecting a movement of the pen in a first direction parallel to the detection surface; And second detection means for detecting movement in a second direction orthogonal to the first direction; and third detection means for detecting movement in a direction perpendicular to the detection surface of the pen. A fourth method for detecting a stationary time near a predetermined position on the detection surface;
And identification means for identifying an operation mode instruction for the input device based on detection results of at least two or more of the first to fourth detection means. Input device. 2. A stroke information input unit for inputting stroke information of a handwritten character using the pen, and a continuous reproduction information input unit for inputting continuous reproduction information which is reproduced continuously in time series such as audio and video. A continuous reproduction information storage unit that stores the continuous reproduction information input from the continuous reproduction information input unit; a stroke information input from the stroke information input unit; and the stroke information and the continuous reproduction information input unit. Stroke information storage means for storing information associated with the input continuous reproduction information; reproduction means for reproducing the continuous reproduction information stored in the continuous reproduction information storage means; and stroke information designated using the pen. Association information reading means for reading association information from the stroke information storage means; A continuous reproduction information reading unit that reads continuous reproduction information from the continuous reproduction information storage unit based on the output association information; and a reproduction unit that reproduces the continuous reproduction information read by the continuous reproduction information reading unit. 2. The input device according to claim 1, further comprising reproduction control means for controlling reproduction of continuous reproduction information in a predetermined operation mode identified by the identification means. 3. The input device according to claim 2, wherein the predetermined operation mode repeatedly reproduces a part of the continuous reproduction information stored in the continuous reproduction information storage unit. 4. The input device according to claim 2, wherein in the predetermined operation mode, the continuous reproduction information stored in the continuous reproduction information storage unit is skipped and reproduced. 5. The input device according to claim 2, wherein the predetermined operation mode reproduces only a part of the continuous reproduction information stored in the continuous reproduction information storage unit. 6. A recording medium on which a writing trajectory by a pen remains can be held on the detection surface. The input device according to claim 1, wherein the operation mode is identified based on detection results of at least two or more of the first to fourth detection units. 7. The input device according to claim 3, wherein a part of the continuous reproduction information is a part synchronized with a range of stroke information specified by using the pen.