JPH0773192A - Handwritten input device - Google Patents

Abstract

PURPOSE:To easily collate a recorded image and sound by attaining recording the handwritten image and sound by means of one device. CONSTITUTION:When a command recognition part 26 recognizes the handwritten image inputted by a coordinate input part 12 to be a sound command image, a sound processing part 30 starts the recording of the sound inputted from a microphone 32 in a sound recording memory 34. While this recording, the inputted handwritten image is set to be a key image and when finishing command image is entered, the sound recorded in the sound recording memory 34 is registered in a sound registering part 40 by talking correspondence with the key image. Then, when the same image as the registered key image is inputted, the sound processing part 30 reads out a sound corresponding to the key image from the file 40 to the sound recording memory 34 and a speaker 36 reproduces it.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a handwriting input device for recording and displaying an image input by handwriting.

[0002]

2. Description of the Related Art In meetings and lectures, the contents are often kept in a notebook as a memo. recent years,
For this purpose, a handwriting input device called a so-called electronic notebook has been developed which records an image input by handwriting on a tablet instead of a paper notebook.

At conferences and lectures, important remarks are recorded by a tape recorder and reproduced later to check the contents and to assist in creating minutes.

[0004]

Conventionally, in meetings and lectures, memos are taken with an electronic notebook and voices are recorded with a tape recorder. However, when both handwritten memos and voice recordings are required, You have to carry two devices.

Since the two devices are operated separately, it takes time to check the relationship between the handwritten memo and the recorded voice, and the contents of the meeting and the minutes can be confirmed quickly. I couldn't.

Also, it takes time and effort to operate the two devices, and it is not possible to concentrate on the contents of the conference or lecture, and it is only after confirming later the contents recorded by the device that should be used as an auxiliary device. It is used for the purpose of falling down so that the contents of meetings and lectures can be understood.

An object of the present invention is to make it possible to record not only a handwritten image but also a voice with a single device, and particularly to make it easy to compare the image recording and the voice recording. Is.

[0008]

The means of the present invention are as follows. The image input unit is configured by, for example, a touch panel tablet or a light emitting element and a light receiving element arranged vertically and horizontally, and detects the coordinate position of the pen tip to input an image handwritten by the pen. The voice input means includes, for example, a microphone and inputs voice. The voice storage unit stores the voice input by the voice input unit in association with the handwritten image input by the image input unit. When the handwriting image is input by the image inputting means, the voice reading means reads out the voice stored in association with the handwriting image from the voice storing means. The voice reproducing means reproduces the voice read by the voice reading means. Here, the voice storage unit stores the handwritten image input by the image input unit while storing the voice as a search key for the voice. Further, the voice storage means can store a plurality of voices for each of the plurality of handwritten images.

[0009]

The operation of the means of the present invention is as follows. When a voice is input from the voice input unit and a handwritten image is input from the image input unit, the voice storage unit associates the handwritten image input by the image input unit with the voice input by the voice input unit. Memorize When a handwritten image is input by the image input means, the voice reading means reads the voice stored in association with the handwritten image from the voice storage means and reproduces it by the voice reproducing means. Further, the voice storage means stores the handwritten image input by the image input means while storing the voice as a search key for the voice. The voice storage means stores a plurality of voices for each of the plurality of handwritten images.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to FIGS.

FIG. 1 is a block diagram showing the configuration of a handwriting input device according to an embodiment of the present invention. In FIG. 1, reference numeral 10 is a CPU for controlling the whole. Reference numeral 12 is a coordinate input unit, and 14 is a display unit for displaying the data expanded in the display memory 16. The coordinate input unit 12 is, for example,
As shown in FIG. 2, a touch panel tablet arranged on the display unit 14 or a pen tip of a pen 18 for handwriting input is configured by arranging light emitting elements and light receiving elements vertically and horizontally around the display unit 14. The coordinate position of is detected. In addition, the handwriting input device according to the present embodiment includes an A4 size coordinate input unit 12.
And a display unit 14, and the display unit 14 uses a liquid crystal display with a backlight.

Reference numeral 20 is a first image memory (I) for storing the image data generated by the CPU 10 from the handwritten coordinates detected by the coordinate input unit 12, and 22 is the already input image data for one page. It is a second image memory (II) for storing. Reference numeral 24 denotes an image analysis unit for analyzing the image stored in the first image memory 20, and 26 denotes an image analyzed by the image analysis unit 24 corresponding to the command corresponding image stored in the reserved command memory 28. It is a command recognition unit that determines whether or not there is.

Reference numeral 30 temporarily records the voice input from a microphone (microphone) 32 in a voice recording memory 34,
Further, it is a voice processing unit for controlling the voice recorded in the voice recording memory 34 to be output from the speaker 36.

Reference numeral 38 is a page file for storing image data of a plurality of pages, for example, maximum A4 paper 50.
Memorize images for pages. Reference numeral 40 is a voice registration file for registering voices temporarily recorded in the voice recording memory 34.

Next, the operation of this configuration will be described with reference to the flowchart of FIG.

First, when a handwriting operation is performed (step S1), image data is generated from the handwriting coordinates and stored in the first image memory 20 (step S2).
The data in the first image memory 20 and the data in the second image memory 22 are combined, written in the display memory 16 and displayed on the display unit 14 (step S3).

Then, the image analysis unit 24 analyzes the image just input (step S4), and the image analyzed by the image analysis unit 24 corresponds to a predetermined voice command image stored in the reserved command memory 28. The command recognition unit 26 determines whether or not the operation is performed (step S5).

When the input image does not correspond to the voice command image, the command recognition unit 26 further determines whether or not it corresponds to the predetermined end command image stored in the reserved command memory 28. (Step S6). When the input image does not correspond to the end command image, the state of a flag (not shown) formed inside or outside the CPU 10 is detected next (step S7). If the flag is off, details will be described later. Voice registration file 40
It is determined whether or not the image just input is registered as the key image (step S8). If the image just input is not key-registered, the contents of the first image memory 20 are combined and stored in the second image memory 22 (step S9), and then the first image is stored.
Clear the image memory 20 (see step S1
0), the process is repeated from step S1.

As a result, an arbitrary handwritten image is displayed on the display unit 14 (corresponding image data is stored in the second image memory 22 and the display memory 16).

In step S5, the input image corresponds to a voice command image (for example, an image in which "V" as indicated by reference numeral 14A in FIG. 4A is surrounded by "○"). (Hereafter, this is "V
() Is called), the voice processing unit 30 is instructed to start voice recording, and the voice input from the microphone 32, for example, “Watashi Hatanaka” is recorded in the voice recording memory 34 (step S11). 4B, the display memory 16 is controlled to display a “recording” message 14B indicating that the voice is being recorded, as shown in FIG. 4B.
Is displayed on the display unit 14 (step S11). Then, after the flag is turned on (step S13), the process proceeds to step S10 to clear the first image memory 20 (thus, as shown in FIG. 4B, the image "V ○" 14A is immediately Disappears), and the process is repeated from step S1.

Then, in step S7, it is determined that the flag is on, and the handwritten image written in step S1, for example, the image "Tanaka" 14C as shown in FIG. 4B is shown in FIG. Is set as a search key image (step S14). After that, the process proceeds to step S9, the contents of the first image memory 20 are combined and stored in the second image memory 22, and then the first image memory 20 is cleared (step S10).
The process is repeated from step S1.

Then, in step S6, the input image corresponds to the end command image (for example, an image in which "E" surrounded by reference numeral 14D in FIG. 4C is surrounded by "○"). (Hereafter, this is "E
When it is determined that the voice recording unit 30 has entered, the voice processing unit 30 is instructed to end voice recording, and recording of voice input from the microphone 32 in the voice recording memory 34 is finished (step At the same time as S15), the display memory 16 is controlled to cause the display section 14 to erase the "recording" message 14B (step S16). Then, the flag is turned off (step S17), and the recorded voice in the voice recording memory 34 (that is, "Watashi Hatanaka ...") is set to the key image ("Tanaka" set in step S14 as shown in FIG. It is registered in the voice registration file 40 in association with "14C" (step S18). After that, the voice recording memory 34 is cleared (step S1
9) Then, the procedure goes to the step S10 to clear the first image memory 20 (thus, the image "E ○" 14
(D will disappear immediately), and the process is repeated from step S1.

As described above, when the voice command image "V ○" 14B is written on the page during handwriting input, voice recording to the voice recording memory 34 is started, and the image entered in the voice recording is searched as a search key. Audio is registered as an image. And the end command image "E ○" 14
When D is written, the voice recorded in the voice recording memory 34 is registered in the voice file 40 in association with the search key image.

Of course, it is possible to enter a plurality of voice commands (register a plurality of voice information) on the same page.

Then, as shown in FIG. 4D, when an image "Tanaka" 14C 'which is the same as (or is similar to) the image already registered as the search key image ("Tanaka" 14C) is entered, In step S8, it is determined that the search key image stored in the voice registration file 40 includes the image just input.In this case, the registered voice corresponding to the key image is transferred to the voice recording memory 34. (Step S20), the audio processing unit 30 is instructed to start audio reproduction, and the audio recording memory 34
The voice inside ("Watashi Hatanaka ...") is reproduced by the speaker 36 (step S21). After that, the process proceeds to step S9, the contents of the first image memory 20 are combined and stored in the second image memory 22, and then the first image memory 20 is cleared (step S10). The process is repeated from.

In this way, when the same (similar) image as the key-registered image is entered, the voice registered in the voice registration file corresponding to this image is automatically reproduced.

As described above, an image input by handwriting can be registered as a key for recording voice, and by inputting this image by handwriting, the corresponding voice can be reproduced at any time.

The key image is not limited to the image filled in during voice recording, and the key image may be later associated with the recorded voice. The key image may be an image input immediately before the start of voice recording (image input immediately before the voice command image).

Further, the start and end of voice recording may be instructed not by handwriting but by a predetermined key operation or the like.

[0030]

According to the present invention, not only a handwritten image but also a voice can be recorded, so that it is excellent in portability and can be used for multiple purposes.

Further, since the voice can be registered in association with the image, the voice at the time when the image is written can be reproduced only by writing the image, and the comparison between the image and the voice can be easily performed.

Further, even if any page is opened, the voice can be reproduced anytime and anywhere simply by entering the corresponding image.

[Brief description of drawings]

FIG. 1 is a block configuration diagram of a handwriting input device according to an embodiment of the present invention.

FIG. 2 is a perspective view showing the external appearance of the handwriting input device according to the embodiment.

FIG. 3 is a flowchart for explaining the operation of the embodiment.

4A to 4D are diagrams showing display examples according to handwriting input for explaining the operation of the embodiment.

FIG. 5 is a diagram showing a structure of a voice registration file.

[Explanation of symbols]

10 ... CPU, 12 ... Coordinate input section, 14 ... Display section, 16
... Display memory, 18 ... Pen, 20 ... First image memory (I), 22 ... Second image memory (II), 24 ...
Image analysis unit, 26 ... Command identification unit, 28 ... Reserved command memory, 30 ... Voice processing unit, 32 ... Microphone (microphone), 34 ... Voice recording memory, 36 ... Speaker,
38 ... page file, 40 ... voice registration file.

Continuation of the front page (51) Int.Cl. ⁶ Identification number Reference number within the agency FI Technical indication location G06F 3/16 320 A 7165-5B 330 330 B 7165-5B G06K 9/62 G 8623-5L G06T 1/00

Claims (3)

[Claims] 1. An image input unit for inputting a handwritten image, a voice input unit for inputting voice, and a voice input unit associated with the handwritten image input by the image input unit. A voice storing means for storing a voice, a voice reading means for reading a voice stored in association with the handwritten image from the voice storing means when a handwritten image is inputted by the image inputting means, A handwriting input device comprising: a voice reproduction unit for reproducing the voice read by the reading unit. 2. The handwriting input device according to claim 1, wherein the voice storage unit stores a handwritten image input by the image input unit during voice storage as a search key for the voice. . 3. The handwriting input device according to claim 1, wherein the voice storage unit stores a plurality of voices for each of a plurality of handwritten images.