JP2002251280A - Electronic blackboard device and method for controlling the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic blackboard device capable of setting not only the display position of a character string obtained by inputting a voice but also the size or display direction of a character by a simple operation and a method for controlling the electronic blackboard device. SOLUTION: This electronic blackboard device for displaying information based on a plotted orbit plotted with a prescribed writing tool on a prescribed broad is provided with a voice inputting means for inputting a voice, a voice recognizing means for recognizing the inputted voice, an area designating means for designating the display area of a recognized result obtained by the voice recognizing means, a display configuration deciding means for deciding the display configuration of the recognized result according to the display area designated by the area designating means, and a display means for displaying the recognized result in the designated display area in the decided display configuration. The area designating means is allowed to detect the area including the orbit plotted with the wiring tool during the voice inputting period by the voice inputting means, and to designate the detected area as the display area of the voice recognized result.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic blackboard device in which a board device such as a blackboard, a whiteboard or the like is digitized, and a control method thereof, and more particularly, to an electronic blackboard device capable of inputting contents to be displayed by voice. About.

[0002]

2. Description of the Related Art In meetings, meetings, lectures, and the like,
Blackboards or whiteboards are widely used as a means of sharing information among participants.

In many cases, it is desired to save the contents described on a blackboard or the like. Until now, what is called an electronic blackboard that can electronically capture the contents written on a blackboard as image information and print, save, etc. Has been put to practical use.

Some electronic blackboards have a character recognition function.
Electronic blackboards that can be printed and stored in a well-formed format have also been proposed. As an example using the character recognition function, for example, an electronic blackboard apparatus that recognizes a character or a figure handwritten on an electronic blackboard with a pen by a recognition processing unit and records the recognition result on a recording paper is disclosed in It is disclosed in Japanese Patent Publication No. 204999.

Japanese Patent Laid-Open No. 1-125296 discloses an electronic blackboard having a voice recognition function and capable of writing on an electronic blackboard by voice input. According to the voice input using the voice recognition, it is possible to save the trouble of kanji having a large number of strokes and the length of writing on a long sentence, thereby improving the convenience of the electronic blackboard.

Further, according to the electronic blackboard device disclosed in Japanese Patent Application Laid-Open No. 6-085983, it is possible to specify a position at which a result of voice recognition is displayed.

[0007]

As described above, in the above-described conventional electronic blackboard device having a voice recognition function,
Although it is possible to specify the display position of the character string that is the result of speech recognition, there is also a problem that it is not possible to specify the character size and display direction when displaying on the electronic blackboard. Was. If the size and the display direction of the display characters can be specified, it is possible to make settings with a higher degree of freedom, and it will be possible to create a more legible board book.

That is, the object of the present invention is to
It is an object of the present invention to provide an electronic blackboard apparatus capable of setting not only a display position of a character string obtained by voice input but also a character size and a display direction by a simple operation, and a control method therefor.

[0009]

In order to achieve the above object, for example, an electronic blackboard device of the present invention has the following arrangement. That is, an electronic blackboard device for displaying information based on a drawing locus drawn by a predetermined writing instrument on a predetermined board, comprising: voice input means for inputting voice; and voice recognition means for recognizing the input voice. Area specifying means for specifying a display area of the recognition result obtained by the voice recognition means, display mode determining means for determining the display mode of the recognition result, and the recognition result in the specified display area, Display means for displaying in the determined display mode.

[0010]

Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram showing an example of an electronic blackboard device according to the embodiment. As shown in the drawing, the electronic blackboard device inputs an electronic blackboard 1 for describing and displaying characters, graphics, and the like, a pen 2 as a writing implement for writing characters, graphics, and the like on the electronic blackboard 1, and inputs voice. , A central processing unit 4 for processing data, and a storage device 5 such as a magnetic storage device or a memory.

The electronic blackboard 1 includes a trajectory detection unit 11 that detects handwriting (hereinafter, also referred to as a “trajectory” or simply “trajectory”) when a character, a figure, or the like is drawn by the pen 2 using various sensors, and a pen. The display unit 12 is configured to display two trajectories, characters, and graphics.

The central processing unit 4 includes a control unit 41 for controlling the overall processing, a voice detection unit 42 for detecting the presence or absence of voice input from the microphone 3, a voice recognition unit 43 for recognizing voice, and a trajectory detection unit 11. A trajectory data input unit 44 for inputting the trajectory data of the detected pen 2, a display data generation unit 45 for creating data for displaying the result of voice recognition by the voice recognition unit 43 on the display unit 12, and a display unit 12. And a display control unit 46 for controlling the display.

The storage device 5 stores a control program for controlling the entire processing, various data necessary for voice recognition processing, and data necessary for various processing steps.

The configuration of the electronic blackboard device in the embodiment is generally as described above. Hereinafter, the contents of the processing will be described in detail.

The electronic blackboard 1 in the locus detection unit 11
Known methods can be used for the method of detecting the positions and trajectories of the characters and figures drawn above and the voice recognition processing of the voice recognition unit 43, and thus detailed description thereof will be omitted.

FIG. 3 is a flowchart showing an outline of a process for drawing characters, figures, and the like on the board of the electronic blackboard 1 using the pen 2.

First, desired characters, figures and the like are described on the electronic blackboard 1 using the pen 2. At this time, the trajectory of the pen is detected by the trajectory detection unit 11 (step S201), converted into trajectory data including the described time, coordinates on the electronic blackboard and the like, input from the trajectory data input unit 44, and displayed by the display control unit. 46 (step S202). The input trajectory data is
It is temporarily stored in the storage device 5. Then, the display control unit 46 controls the display unit 12 to display characters, figures, and the like according to the input locus data, and displays the characters and graphics on the electronic blackboard (step S203).

Next, processing for displaying characters by voice input will be described.

When characters are displayed by voice input,
The user indicates the area to be displayed with the pen 2 while uttering the content to be displayed. At this time, the position can be designated by drawing an arbitrary character or graphic in the area to be displayed with the pen 2.

An example will be described. FIG. 5 shows a display example of the electronic blackboard 1. The example shown is already on the electronic blackboard, "Agenda:
A character string “Next year plan”, “Product A”, “Target sales volume:” is described, and the user is going to write “20,000 sets” to the right of the character string “Target sales volume:”. That is the situation. At this time, the user appropriately runs the pen 2 at the position on the right side of the description position “target sales volume:” while saying “20,000 sets”. The locus of the pen displayed as a result may be something like the locus T1. As soon as the voice input is completed, the voice recognition result is displayed at the position instead of the locus T1.

FIG. 2 is a flowchart showing a process for describing a character by voice input.

This processing is performed in parallel with the processing of steps S201 and S202 in the flowchart of FIG.

The voice detector 42 measures the input signal level and makes a predetermined threshold decision to determine the microphone 3
It detects that a voice has been input from. When a voice is detected, the input voice data is transmitted to the voice recognition unit 43 (step S101).

The voice recognition unit 43 performs a voice recognition process on the input voice data, and sends a recognition result to the display data generation unit 45 (step S102).

The display data generation unit 45 uses the following method based on the speech recognition result and the trajectory data described in the speech input time stored in the storage device 5 to display the speech recognition result in the following manner. Determine the size and direction of the character,
The display data to be passed to the display control unit 46 is generated (step S103).

Here, in step S103,
A method of determining the position, the size, and the direction of the character at which the recognition result is displayed will be described with reference to FIGS.

FIG. 4 is a flowchart showing an outline of the procedure for determining the position, character size, and orientation for displaying the speech recognition result in step S103.

First, as shown in FIG. 6A, the smallest rectangular area (hereinafter, referred to as "the area") surrounding the trajectory is obtained from the trajectory data described within the voice input time stored in the storage device 5, as shown in FIG.
It is called "description area". ) (Step S1)
03-1).

Next, as shown in FIG. 6B, the position, size,
The orientation is determined (step S103-2).

As a method of determining the display position, a method as shown in FIG. 11 can be considered. That is, (1) the horizontal position is left-aligned (a margin of a predetermined width is provided), and the height position is aligned with the center (FIG. 11).
(A)). (2) The position in the horizontal direction is left-aligned (a margin of a predetermined width is provided), and the position in the height direction is aligned with the lower side of the description area (FIG. 2B). (3) The position in the horizontal direction is left-aligned (a margin of a predetermined width is provided), and the position in the height direction is aligned with the upper side of the description area (FIG. 3C). (4) Center the horizontal position and align the height position with the center ((d) in the figure). (5) The position in the horizontal direction is left-aligned (no margin is provided), and the position in the height direction is aligned with the center ((e) in the figure). (6) The position in the horizontal direction is right-justified (no margin is provided), and the position in the height direction is aligned with the center ((f) in the figure).

There are many methods for determining the size of the display. For example, the following examples are given. (1) Fix to the character size set in advance. (2) The size is the same as the size of the character displayed immediately before. (3) Adjust the character aspect ratio so that the recognition result is displayed in the entire description area. One example is shown in FIG. (4) Determine the character size according to the height of the description area. One example is shown in FIG. (5) Determine the character size according to the width of the description area.
An example is shown in FIG.

The method for determining the display position and the method for determining the size of the display may be fixed to one method.
As shown in FIG. 12, a user setting unit 47 is provided in the central processing unit 4 of the electronic blackboard device shown in FIG. 1, and the user is allowed to select which method to display via the user setting unit 47. You may do so.

From the user setting section 47, for example, the font of the character, the color of the character, and the character decoration processing (for example, underline, bold, whiteout, shadowing) may be set.

Furthermore, by having a plurality of writing implement attributes (which can be stored in the storage device 5) and setting different attributes for the plurality of writing implements, the user setting section 47 allows the user to selectively use the writing implements according to the situation. It may be.

The display direction can be determined, for example, as vertical writing if the quadrangle indicating the description area is vertically long, and horizontal writing if the square is horizontal.

The description returns to the flowchart of FIG. The display control unit 46 controls the display unit 12 so as to erase the trajectory of the character / graphic described within the voice input time stored in the storage device 5 (step S104). Thereafter, the display unit 12 is controlled so as to display the character string of the voice recognition result according to the display data generated in step S103. As a result, a character string as a speech recognition result is displayed in the description area (step S105). In the case of the example shown in FIG. 5, the speech recognition result is displayed as shown in FIG.

Further, when the trajectory T2 as shown in FIG. 8 is drawn with the pen 2 while continuously saying "2000 units per month", the recognition result is displayed as shown in FIG. Will be done.

According to the embodiment described above, by writing an arbitrary character string, graphic, or the like using a pen in an area to be written on a board while uttering the contents to be written on the board, the uttered content is converted into a character string in the description area. An electronic blackboard device for displaying can be realized.

By providing a user setting unit,
An electronic blackboard device in which a user can select the size and position of a character to be displayed from a plurality of methods can be realized.

Further, not only the size and position of the character to be displayed but also the font of the character, the color of the character, the character decoration, and the like can be selected by the user setting section, thereby realizing an electronic blackboard device which is easier to use. can do.

By storing the size, position, font, character color, character decoration, and the like of the characters to be displayed as attributes of the pen, an electronic blackboard that can be selectively used according to the situation is realized. be able to.

[0043]

[Other Embodiments] As described above, an object of the present invention is to provide a storage medium (or a recording medium) in which software program codes for realizing the functions of the above-described embodiments are recorded.
This is also achieved by supplying the program or the program code stored in a storage medium to a computer or CPU (MPU or MPU) of the system or the apparatus. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. Also,
When the computer executes the readout program code, not only the functions of the above-described embodiments are realized, but also the operating system (O / O) running on the computer based on the instruction of the program code.
It goes without saying that S) and the like perform part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the program code is read based on the instruction of the program code. , The CPU provided in the function expansion card or the function expansion unit performs part or all of the actual processing,
It goes without saying that a case where the function of the above-described embodiment is realized by the processing is also included.

When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the flowcharts of FIGS. 2 to 4 described above.

[0046]

As described above, according to the present invention,
With a simple operation, it is possible to provide an electronic blackboard device capable of setting not only a display position of a character string obtained by voice input but also a character size, a display direction, and the like, and a control method thereof.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an example of an electronic blackboard device according to an embodiment.

FIG. 2 is a flowchart illustrating a process of describing a character by voice input in the embodiment.

FIG. 3 is a flowchart illustrating an outline of a process for drawing characters, graphics, and the like on the board of the electronic blackboard according to the embodiment.

FIG. 4 is a flowchart illustrating an outline of a procedure for determining a position, a character size, and an orientation for displaying a speech recognition result in the embodiment.

FIG. 5 is a diagram showing a display example of an electronic blackboard in the embodiment.

FIG. 6 is a diagram illustrating a method of determining a position, a character size, and an orientation for displaying a speech recognition result according to the embodiment.

FIG. 7 is a diagram showing a display example of an electronic blackboard in the embodiment.

FIG. 8 is a diagram showing a display example of an electronic blackboard in the embodiment.

FIG. 9 is a diagram illustrating a display example of an electronic blackboard according to the embodiment.

FIG. 10 is a diagram for describing a display mode of a speech recognition result in the embodiment.

FIG. 11 is a diagram for describing a display mode of a speech recognition result in the embodiment.

FIG. 12 is a block diagram showing another example of the electronic blackboard device in the embodiment.

Claims (9)

[Claims] 1. An electronic blackboard device for displaying information based on a drawing locus drawn on a predetermined board with a predetermined writing instrument, comprising: voice input means for inputting voice; and recognizing the input voice. Voice recognition means; area specifying means for specifying a display area of the recognition result obtained by the voice recognition means; and a display mode of the recognition result is determined according to the display area specified by the area specification means. An electronic blackboard device comprising: a display mode determining unit; and a display unit that displays the recognition result in a specified display area in the determined display mode. 2. The area designating means further comprises: detecting means for detecting an area including a drawing locus drawn by the writing implement during a voice input period by the voice input means, wherein the area detected by the detecting means is 2. The electronic blackboard device according to claim 1, wherein the electronic blackboard is designated as a display area of a recognition result obtained by the voice recognition unit. 3. The electronic whiteboard device according to claim 1, wherein the display mode includes at least one of a position, a size, an orientation, a font, a color, and a decoration in the display area. . 4. The display mode determining unit determines a display size of the recognition result according to a height and / or a width of the display area specified by the area specifying unit. The electronic blackboard device according to claim 1. 5. The display mode determination unit according to claim 2, wherein the display direction of the recognition result is determined in accordance with a ratio between a height and a width of the display area designated by the area designation unit. Item 5. The electronic blackboard device according to any one of Items 1 to 4. 6. A method for controlling an electronic blackboard device for displaying information based on a drawing locus drawn on a predetermined board with a predetermined writing instrument, comprising: a voice inputting step of inputting a voice; A speech recognition step of recognizing the speech, an area designation step of designating a display area of the recognition result obtained in the speech recognition step, and a display mode of the recognition result according to the display area designated in the area designation step And a display step of displaying the recognition result in a designated display area in the determined display mode. A method for controlling an electronic blackboard device, comprising: 7. The area specifying step includes a detecting step of detecting an area including a drawing trajectory drawn by the writing instrument during a voice input period in the voice input step, and detecting the area detected in the detecting step. 7. The method according to claim 6, wherein the display area is designated as a display area of a recognition result obtained in the voice recognition step. 8. A program for controlling an electronic blackboard device for displaying information based on a drawing locus drawn on a predetermined board with a predetermined writing instrument, comprising: a program code for a voice inputting step of inputting voice; A program code for a voice recognition step for recognizing the input voice, a program code for an area specifying step for specifying a display area of a recognition result obtained in the voice recognition step, and the display area specified in the area specifying step A program code of a display mode determining step of determining the display mode of the recognition result, and a program code of a display step of displaying the recognition result in the specified display area in the determined display mode. A program characterized by having. 9. A storage medium storing the program according to claim 8.