JP4632389B2 - Electronic blackboard apparatus and control method thereof - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an electronic blackboard device obtained by digitizing a board device such as a blackboard or a whiteboard and a control method thereof, and more particularly to an electronic blackboard device capable of inputting contents to be displayed by voice.
[0002]
[Prior art]
In meetings, meetings, lectures, etc., blackboards or whiteboards are widely used as a means of sharing information among participants.
[0003]
There are many cases where it is desired to preserve the contents written on the blackboard, etc., so far, so-called electronic blackboards have been put into practical use, which can electronically capture the contents written on the board as image information, and can be printed and stored. ing.
[0004]
Some electronic blackboards have a character recognition function and can be printed and stored in a formatted format. As an example of what uses the character recognition function, for example, an electronic blackboard device that recognizes characters and figures handwritten with a pen on an electronic blackboard by a recognition processing unit and records the recognition result on a recording paper is disclosed in JP-A-2- It is disclosed in No. 204999.
[0005]
Japanese Patent Laid-Open No. 1-125296 discloses an electronic blackboard having a voice recognition function and capable of writing on a blackboard by voice input. According to the voice input using voice recognition, it is possible to save the trouble of kanji having a large number of strokes and a long board, and the convenience of the electronic blackboard can be improved.
[0006]
Furthermore, according to the electronic blackboard device disclosed in Japanese Patent Laid-Open No. 6-085983, a position for displaying the result of speech recognition can be designated.
[0007]
[Problems to be solved by the invention]
As described above, in the electronic blackboard device having the above-described conventional voice recognition function, although it is possible to specify the display position of the character string that is the voice recognition result, it is also possible to display on the electronic blackboard. There was a problem that it was not possible to specify the size and display direction of characters. If the size of the display characters, the display direction, etc. can be specified, it will be possible to make settings with a higher degree of freedom, and it will be possible to create a more easy-to-read board.
[0008]
That is, an object of the present invention is to provide an electronic blackboard device capable of setting not only the display position of a character string obtained by voice input but also the size and display direction of characters by a simple operation, and its It is to provide a control method.
[0009]
[Means for Solving the Problems]
In order to achieve the above object, for example, an electronic blackboard device of the present invention has the following configuration. That is,
An electronic blackboard apparatus for displaying information on the basis of the drawing bounded the drawing path,
Voice detection means for detecting voice;
Voice recognition means for recognizing the voice detected by the voice detection means ;
Trajectory detection means for detecting a trajectory input on the electronic blackboard;
Display data generating means for generating voice recognition result data to be displayed on the electronic blackboard;
Display control means for controlling the display of the electronic blackboard;
Have
The display data generation means determines an area for displaying a character of a speech recognition result so as to surround the locus detected by the locus detection means within a time when the sound detected by the sound detection means is input. It is characterized by having .
[0010]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0011]
FIG. 1 is a block configuration diagram illustrating an example of an electronic blackboard device in the embodiment. As shown in the figure, this electronic blackboard apparatus inputs an electronic blackboard 1 that describes and displays characters, figures, etc., a pen 2 as a writing instrument for writing characters, figures, etc. on the electronic blackboard 1, and voice. A microphone 3 as a voice input device, a central processing unit 4 for processing data, and a storage device 5 such as a magnetic storage device or a memory.
[0012]
The electronic blackboard 1 includes a trajectory detection unit 11 that detects handwriting (hereinafter also referred to as “drawing trajectory” or simply “trajectory”) when a character, a figure, or the like is drawn with the pen 2, and the trajectory of the pen 2. And a display unit 12 for displaying characters and figures.
[0013]
The central processing unit 4 includes a control unit 41 that controls the overall processing, a voice detection unit 42 that detects the presence or absence of voice input from the microphone 3, a voice recognition unit 43 that recognizes voice, and a pen detected by the trajectory detection unit 11. 2, a trajectory data input unit 44 for inputting trajectory data of 2, a display data generating unit 45 for generating data for displaying the voice recognition result in the voice recognition unit 43 on the display unit 12, and a display for controlling the display unit 12 The control part 46 is comprised.
[0014]
In addition, the storage device 5 stores a control program for controlling the entire process and various data necessary for the speech recognition process, as well as data necessary for various processes.
[0015]
The configuration of the electronic blackboard device in the embodiment is generally as described above. Hereinafter, details of the processing will be described.
[0016]
In addition, since the method for detecting the position and locus of characters, figures, etc. drawn on the electronic blackboard 1 in the locus detection unit 11 and the speech recognition processing of the speech recognition unit 43 can use known techniques, Detailed description thereof is omitted.
[0017]
FIG. 3 is a flowchart showing an outline of processing when a pen 2 is used to draw characters, figures, etc. on the surface of the electronic blackboard 1.
[0018]
First, a desired character, figure, etc. are described on the electronic blackboard 1 using the pen 2. At this time, the locus of the pen is detected by the locus detector 11 (step S201), converted into locus data including the described time, coordinates on the electronic blackboard, etc., and input from the locus data input unit 44, and the display controller 46 (step S202). The input trajectory data is temporarily stored in the storage device 5. Then, the display control unit 46 controls the display unit 12 to display characters, graphics, and the like according to the input locus data, and displays them on the electronic blackboard (step S203).
[0019]
Next, processing for displaying characters by voice input will be described.
[0020]
When displaying characters by voice input, the user instructs the area to be displayed with the pen 2 while speaking the contents to be displayed. At this time, the position can be specified by drawing an arbitrary character or figure with the pen 2 in the area to be displayed.
[0021]
An example is shown. FIG. 5 shows a display example of the electronic blackboard 1. In the illustrated example, the character strings “Agenda: Next Year Plan”, “Product A”, and “Target Sales Volume:” are already described on the electronic blackboard, and the user is to the right of the character string “Target Sales Volume:”. The situation is that he is trying to describe “20,000 sets” next to it. At this time, the user appropriately runs the pen 2 at the position on the right side of the description position “target sales number:” while saying “20,000 sets”. The pen trajectory displayed as a result may be something like the trajectory T1. When the voice input is completed, the voice recognition result is displayed at the position instead of the locus T1.
[0022]
FIG. 2 is a flowchart showing processing for describing characters by voice input.
[0023]
This process is performed in parallel with the process of step S201 and step S202 in the flowchart of FIG. 3 described above.
[0024]
The sound detection unit 42 detects that sound is input from the microphone 3 by measuring the input signal level and performing a predetermined threshold determination. When the voice is detected, the inputted voice data is sent to the voice recognition unit 43 (step S101).
[0025]
The voice recognition unit 43 performs voice recognition processing on the input voice data, and sends a recognition result to the display data generation unit 45 (step S102).
[0026]
In the display data generation unit 45, based on the voice recognition result and the trajectory data described within the voice input time stored in the storage device 5, the position / character size for displaying the voice recognition result by the method described below is used. The height and direction are determined and display data to be passed to the display control unit 46 is generated (step S103).
[0027]
Here, the method of determining the position / size / orientation of displaying the recognition result in step S103 will be described with reference to FIGS.
[0028]
FIG. 4 is a flowchart showing an outline of the procedure for determining the position / size / orientation for displaying the speech recognition result in step S103.
[0029]
First, as shown in FIG. 6A, from the locus data described within the voice input time stored in the storage device 5, a minimum rectangular area surrounding the locus (hereinafter referred to as “description area”). .) Is obtained (step S103-1).
[0030]
Next, the position / size / orientation for displaying the characters as shown in FIG. 6B so as to fit within the determined description area is determined (step S103-2).
[0031]
As a method for determining the display position, the one shown in FIG. 11 can be considered. That is,
(1) The position in the horizontal direction is left-justified (a margin of a predetermined width is provided), and the position in the height direction is aligned with the center (FIG. 11 (a)).
(2) The position in the horizontal direction is left-justified (a margin of a predetermined width is provided), and the position in the height direction is aligned with the lower side of the description area ((b) in the figure).
(3) The horizontal position is left-justified (a margin of a predetermined width is provided), and the height direction position is aligned with the upper side of the description area ((c) in the figure).
(4) Center the position in the horizontal direction and align the position in the height direction at the center ((d) in the figure).
(5) The horizontal position is set to the left (no margin is provided), and the height position is aligned to the center ((e) in the figure).
(6) The horizontal position is right-justified (no margin is provided), and the height position is centered (figure (f)).
[0032]
There are many possible methods for determining the display size, and examples include the following.
(1) Fix to the preset character size.
(2) Same size as the character displayed immediately before.
(3) Adjust the aspect ratio of the characters so that the recognition result is displayed in the entire description area. An example is shown in FIG.
(4) Determine the character size according to the height of the description area. An example is shown in FIG.
(5) Determine the character size according to the width of the description area. An example is shown in FIG.
[0033]
The display position determining method and the display size determining method may be fixed to one method, respectively, but as shown in FIG. 12, the central processing unit 4 of the electronic blackboard apparatus shown in FIG. A user setting unit 47 may be provided, and the user may select which method to display via the user setting unit 47.
[0034]
From the user setting unit 47, for example, a character font, a character color, and a character decoration process (for example, underline, bold, outline, shadowing) may be set.
[0035]
Furthermore, by providing a plurality of writing tool attributes (which can be stored in the storage device 5) and setting different attributes for the plurality of writing tools, the user setting unit 47 can be used to properly use the writing tools depending on the situation. Good.
[0036]
As for the display direction, for example, vertical writing can be determined if the rectangle indicating the description area is vertically long, and horizontal writing can be determined if it is horizontally long.
[0037]
The description returns to the flowchart of FIG. The display control unit 46 controls the display unit 12 so as to erase the trajectory of characters / graphics described within the voice input time stored in the storage device 5 (step S104). Thereafter, the display unit 12 is controlled to display the character string of the speech recognition result according to the display data generated in step S103. As a result, the character string as the voice recognition result is displayed in the description area (step S105). In the case of the example shown in FIG. 5, the speech recognition result is displayed as shown in FIG.
[0038]
Furthermore, when the user traces the trajectory T2 as shown in FIG. 8 with the pen 2 while saying “2000 units a month” continuously, the recognition result is displayed as shown in FIG. become.
[0039]
According to the embodiment described above, if an arbitrary character string, a figure, or the like is described using a pen in an area to be written on a board while speaking the contents to be written on the board, the electronic content for displaying the utterance contents as a character string on the description area is displayed. A blackboard device can be realized.
[0040]
In addition, by providing the user setting unit, it is possible to realize an electronic blackboard device that allows the user to select the size and position of characters to be displayed from a plurality of methods.
[0041]
In addition, by enabling the user setting unit to select not only the size and position of the character to be displayed but also the character font, character color, character decoration, etc., it is possible to realize an electronic blackboard device that is easier to use. it can.
[0042]
Also, by storing the size, position, character font, character color, character decoration, etc. of the displayed characters as pen attributes, it is possible to realize an electronic blackboard that can be used properly according to the situation. .
[0043]
[Other Embodiments]
As described above, an object of the present invention is to supply a storage medium (or recording medium) that records a program code of software that implements the functions of the above-described embodiments to a system or apparatus, and to perform a computer ( Alternatively, it can be achieved by reading and executing the program code stored in the storage medium by the CPU or MPU. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an operating system (OS) running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.
[0044]
Furthermore, after the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion card or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.
[0045]
When the present invention is applied to the above-described storage medium, the program code corresponding to the flowcharts of FIGS. 2 to 4 described above is stored in the storage medium.
[0046]
【The invention's effect】
As described above, according to the present invention, an electronic blackboard device capable of setting not only the display position of a character string obtained by voice input but also the character size, display direction, and the like by a simple operation. The control method can be provided.
[Brief description of the drawings]
FIG. 1 is a block configuration diagram illustrating an example of an electronic blackboard device according to an embodiment.
FIG. 2 is a flowchart illustrating processing for describing a character by voice input according to the embodiment.
FIG. 3 is a flowchart showing an outline of processing when characters, figures, and the like are drawn on the board surface of the electronic blackboard in the embodiment.
FIG. 4 is a flowchart illustrating an outline of a procedure for determining a position / a character size / orientation for displaying a voice recognition result in the embodiment;
FIG. 5 is a diagram showing a display example of an electronic blackboard in the embodiment.
FIG. 6 is a diagram for explaining a method of determining a position / a character size / orientation for displaying a voice recognition result in the embodiment;
FIG. 7 is a diagram showing a display example of the electronic blackboard in the embodiment.
FIG. 8 is a diagram showing a display example of the electronic blackboard in the embodiment.
FIG. 9 is a diagram illustrating a display example of the electronic blackboard in the embodiment.
FIG. 10 is a diagram for explaining a display mode of a speech recognition result in the embodiment.
FIG. 11 is a diagram for explaining a display mode of a speech recognition result in the embodiment.
FIG. 12 is a block configuration diagram showing another example of the electronic blackboard device in the embodiment.

Claims (8)

An electronic blackboard apparatus for displaying information on the basis of the drawing bounded the drawing path,
Voice detection means for detecting voice;
Voice recognition means for recognizing the voice detected by the voice detection means ;
Trajectory detection means for detecting a trajectory input on the electronic blackboard;
Display data generating means for generating voice recognition result data to be displayed on the electronic blackboard;
Display control means for controlling the display of the electronic blackboard;
Have
The display data generation means determines an area for displaying a character of a speech recognition result so as to surround the locus detected by the locus detection means within a time when the sound detected by the sound detection means is input. An electronic blackboard device comprising: 2. The display control unit according to claim 1, wherein when displaying the display data of the voice recognition result generated by the display data generation unit, the display control unit erases a locus described within a time when the voice is input. The electronic blackboard device described. The display data generating means further includes a display mode determining means for determining the position, size, and orientation of the character of the voice recognition result to be displayed so that the character determined by the area determining means is included in the display area. The electronic blackboard device according to claim 1 or 2, characterized in that The display mode decision means, according to the height and / or width of the realm that is determine by the region decision means, to claim 3, characterized in that to determine the display size of the recognition result The electronic blackboard device described. The display mode decision means, in accordance with the ratio between the height and width of the realm that is determine by the region decision means, to claim 3, characterized in that determining a display orientation of the speech recognition result The electronic blackboard device described. A control method of an electronic blackboard apparatus for displaying information on the basis of the drawing bounded the drawing path,
A voice detection step in which the voice detection means detects the voice;
Speech recognition means, a speech recognition step of recognizing the speech detected by the speech detection step,
A locus detecting step for detecting a locus inputted on the electronic blackboard by the locus detecting means;
A display data generating step for generating data of a speech recognition result to be displayed on the electronic blackboard;
A display control means for controlling display of the electronic blackboard;
Have
In the display data generation step, a region for determining a region for displaying a voice recognition result character so as to surround the locus detected in the locus detection step within a time when the sound detected in the sound detection step is input. A control method for an electronic blackboard device, comprising a determining step . The computer program for functioning a computer as each means of the electronic blackboard apparatus of any one of Claims 1 thru | or 5. A computer-readable storage medium storing the computer program according to claim 7 .

Images