KR20130078391A - Method for making electronic documents by hybrid basis using direct inputs and voice commands, and computer-readable recording medium storing electronic documents making program by hybrid basis - Google Patents

Abstract

PURPOSE: An electronic document input method of a hybrid type capable of using a direct input and a voice command, and a recording medium which is readable with a computer which recorded an electronic document input program of the hybrid type are provided to automatically convert a shape, which is rapidly inputted by the direct input method, into an object corresponding to the desired voice command, thereby improving the quality of the electronic document. CONSTITUTION: A primitive shaped data, which is inputted by a direct input method, is received in an electronic document input window which is equipped with a user interface (UI) screen, and a voice signal is received from a user (S5). A correction effect is calculated by performing the voice recognition process of the voice signal. The content data is obtained by applying the correction effect to the primitive shaped data, and the content data is implemented as the UI screen (S7). The primitive shaped data includes the figure-shape data and the character-shape data, and the content data includes the figure data and the character data. [Reference numerals] (AA) Start; (BB) End; (S1) Input handwriting; (S2) End successive handwriting trials; (S3) Wait a voice input; (S4) Voice signal over a predetermined decibel; (S5) Voice input; (S6) End successive voice input trials?; (S7) Apply a correction effect depending on voice recognition

Description

Method for making electronic documents by hybrid basis using direct inputs and voice commands, and computer- readable recording medium storing electronic documents making program by hybrid basis}

The present invention relates to a hybrid electronic document input method using direct input and voice commands, and a computer-readable recording medium recording a hybrid electronic document input program. More specifically, the present invention provides a hybrid electronic document creation process of inputting various contents, such as figures or letters, into an electronic document through handwriting, a mouse, and a digitizer, and correcting the input contents through voice commands. Provide the technology to provide.

Due to the development of the mobile smart operating system, it is possible to execute an office program such as a power point or a word processor on a touch terminal having a touch screen such as a smartphone or a tablet terminal. As a result, when creating an electronic document using an office program on a touch terminal as in a personal computer, various contents such as letters or figures (eg, squares, triangles, and flowcharts) are frequently input. Such manipulation may be performed by touch, but may also be performed through a tool such as a mouse or a digitizer.

In this case, as in the case of operating a mouse input device in a personal computer, in the case of text input, a character input module that can be implemented as a UI screen such as a virtual keyboard is called on the screen to input characters, and in the case of figure input, a figure is input from a menu. The user selects a shape, takes a position on the UI screen implemented on the touch screen, and sets a property of the figure to input the figure.

Meanwhile, an input method of only a touch terminal based on a touch interface is a method of handwriting through a touch screen. In general, it has been widely used for drawing by using a tablet or the like. When drawing by handwriting by a user's touch on the electronic document implemented on the UI screen, the user touches the touch screen. The writing was recognized and saved as an image file.

It may be considered to input various contents into an electronic document by using such handwriting, but in this case, the accuracy of inputting the contents by handwriting is less accurate than when inputted by a selection button for a software menu or an icon. Frequently, the input is not recognized or input in a shape that is different from the intended content.

Also, in the case of a figure, a shape may be directly input into an electronic document by using an input device such as a mouse or a digitizer. Compared to setting the property, the quality is inevitably poor. In addition, in the conventional electronic document software, in the mode of directly inputting contents using handwriting, a mouse, a digitizer, and the like, the recognition rate is lowered, so that correction may be required after input or additional operations on the input contents may occur. It is difficult to edit together with this correction when writing.

[Related Technical Literature]

1. Keyboard keyboard layout design and character input method on touch screen to prevent typos (Patent Application No. 10-2010-0046193)

An object of the present invention is to directly input various contents (eg, figures, letters) on an electronic document by using a handwriting, a mouse, a digitizer, etc., and then correct the input contents based on a user's voice command. The present invention provides a hybrid electronic document input method using direct input and voice commands for calibrating, and a computer-readable recording medium recording a hybrid electronic document input program.

The present invention is to achieve the above technical problem, the hybrid electronic document input method using a direct input and a voice command according to the present invention, is input directly to the electronic document input window implemented as a UI screen A first step of receiving raw shape data; Receiving a voice signal from a user; A third step of performing a speech recognition process on the speech signal to calculate a correction effect; Applying a correction effect to convert raw shape data to obtain content data corresponding thereto; And a fifth step of implementing the content data obtained through the above conversion into the UI screen.

In this case, the step of calculating the correction effect in the electronic document input method of the present invention includes: determining whether the voice signal is a registered voice command (a); (B) calculating a correction effect according to the registered voice command when it corresponds to the registered voice command; (C) requesting a natural language analysis of a voice signal by accessing the command analysis server when the voice command does not correspond to the registered voice command; And (d) calculating a new correction effect corresponding to the voice signal when the natural language analysis result is provided from the command analysis server.

A computer-readable recording medium recording a hybrid type electronic document input program according to the present invention for achieving the above object receives raw shape data by a direct input method into an electronic document input window implemented as a UI screen, and a raw shape. A text editing-function stage 40 which controls to wait for input of a voice signal through the microphone 30 from the user when the continuous direct input for the data is cut off; A voice-input functional stage 51 which receives a voice signal to the microphone 30 when the input of the raw shape data is completed; A command-analysis function stage 52 for calculating a correction effect through a speech recognition process on the speech signal; An effect-applying function stage 53 for converting the raw shape data by applying the correction effect to obtain content data corresponding thereto, and for implementing the acquired content data as a UI screen.

At this time, in the present invention, the command-analysis function unit 52 determines whether the voice signal is a registered voice command, and calculates a correction effect according to the registered voice command while registering the voice signal. If it does not correspond to the voice command, it is preferable to calculate a new correction effect corresponding to the voice signal when the command analysis server is accessed to request a natural language analysis of the voice signal and the natural language analysis result is provided accordingly. On the other hand, in the present invention, the raw shape data includes figure-shape data and text-shape data, and the content data includes figure data and text data.

According to the present invention, by automatically converting a figure input by the user in a direct input method using a handwriting, a mouse, a digitizer, etc. into an object corresponding to a voice command desired by the user, thereby improving the shape input method when creating an electronic document. The quality of electronic documents created by direct input can be improved.

In other words, the user can input the figure more efficiently and accurately when creating electronic documents on various user terminals, and then correct the figure by using user-oriented voice commands instead of general handwriting, mouse, or digitizer. Can increase the availability.

1 is a document editing function for implementing a hybrid electronic document input method using a direct input and a voice command according to the present invention, and a document correction-function unit for correcting the input contents through a voice command. Drawing for.
2 is a view showing a state in which the touch terminal is connected to the command analysis server through a communication network in the present invention.
3 to 7 are views for explaining a process of directly inputting a figure as a UI screen implemented on a touch screen of a terminal.
8 and 9 are flowcharts illustrating a hybrid electronic document input method using direct input and voice commands according to the present invention.

Hereinafter, the present invention will be described in detail with reference to the drawings. In an embodiment of the present invention, the description will be focused on a case where a user inputs a figure shape by handwriting on a touch screen. However, the technical idea of the present invention is not limited to such a field, and even when a user inputs various contents, for example, a letter or a figure (eg, a square, a triangle, or a flowchart) by a direct input method using a mouse or a digitizer. It should be understood as applicable.

1 is a document editing-function stage 40 in which a hybrid electronic document input method using a direct input and a voice command according to an embodiment of the present invention is implemented, and the input contents are corrected through a voice command. It is a figure for demonstrating the document correction-function part 50 for it. 2 is a diagram illustrating a state in which the touch terminal 1 of the present invention is connected to the command analysis server 3 through a communication network 2.

The touch terminal 1 according to the present embodiment includes an input unit 10, a document editing function group 40, a document correction function unit 50, a control unit 60, a transceiver unit 70, a storage unit 80, and an effect. It comprises a storage unit 90, of which the input unit 10 is provided with a touch screen 20 and a microphone (30). The document correction-function unit 50 includes a voice-input function unit 51, a command-analysis function unit 52, and an effect-application function unit 53.

First, the touch screen 10 is a component that provides a touch input (handwriting input) by a user. When the electronic document program stored in the storage unit 80 is implemented by the controller 60, an electronic document (eg The input window (not shown) for inputting various contents on the PowerPoint is formed as a UI screen touch interface. As such, characters or figures can be thought of as the contents entered in the electronic document.

Next, the document editing function group 40 will be described. The document editing-function stage 40 receives the raw shape data, for example, by handwriting manipulation of the touch screen 20. The text editing-function stage 40 determines in real time whether successive inputs to each raw shape data are broken. More specifically, the document editing-functional unit 40 determines that the continuous handwriting is terminated when there is no input by the user of the touch terminal 1 for a preset time. In this case, the time used for determining whether the continuous handwriting is finished is preferably 1 second to 5 seconds, but is not limited thereto.

On the other hand, as for the technology of creating an electronic document by a direct input method, the applicant of the Republic of Korea Patent Application No. 10-2011-0099442 (filed September 29, 2011) "Direct input method of the electronic document input method, and direct input method electronic document A computer-readable recording medium recording an input program is described in detail, and the present invention does not directly follow the direct input process of the above patent application, but may be used for the purpose of understanding the technical matters of the present invention. In the specification, duplicate description thereof will be omitted.

As an example of inputting content into an electronic document by a direct input method, a concept of technology for inputting a figure is exemplarily disclosed in FIGS. 3 to 7. In general, when the user provides the figure-shape data by a direct input method such as handwriting, the document editing-function stage 40 stores the figure-shape data input as described above. When the correction effect is provided, the figure-shape data is converted into the content data accordingly, and preferably arranged to match the other figures around. Although not shown in FIGS. 3 to 7, in the present invention, a user may input text or other content directly on an electronic document.

If the document editing-function stage 40 determines that the continuous handwriting has been completed, the input content is temporarily stored in the storage unit 80. Then, the document editing-function unit 40 proceeds to the voice input mode by notifying the document correction-function unit 50 of this, wherein the document correction-function unit 50 is the microphone 30 of the terminal 1. Wait for the user's voice signal to enter.

Hereinafter, the document correction-function centering on the voice-input function stage 51, the command-analysis function stage 52, and the effect-applying function stage 53, which are the components constituting the document correction-function unit 50, will be described. The section 50 will be described.

First, referring to the voice-input function stage 51, the voice signal input is waited as the completion of continuous handwriting is notified from the document editing-function stage 40, and the voice signal is input to the microphone 30 by the user. It is determined whether the voice signal is equal to or greater than a predetermined decibel.

When the voice-input function terminal 51 receives a voice signal with a sufficiently loud sound that is greater than or equal to a predetermined decibel as a result of the above determination, the voice-input function unit 51 receives a user's voice signal through the microphone 30 and temporarily stores it in the storage unit 80. Ask 60. On the contrary, if the voice signal of more than the predetermined decibel is not inputted as a result of the above determination, the voice-input functional unit 51 requests the document editing-functional unit 40 to ignore the voice signal and resume the handwriting input mode. .

In addition, the voice-input function stage 51 determines in real time whether the continuous input to the user's voice through the microphone 30 is cut off. More specifically, the voice input unit 51 determines that the input of the voice command is terminated when there is no input of a voice signal through the user's microphone 30 for a preset time. In this case, the predetermined time determined to be the end of the continuous voice signal input is preferably set to 1 second to 3 seconds, but is not limited thereto.

Next, the command-analysis function stage 52 analyzes the input voice signal by the voice-input function stage 51 to recognize the voice command in accordance with the determination of the termination of the continuous voice signal input. In detail, the command-analyzing function unit 52 determines whether the voice command is registered by analyzing the contents of the recognized voice signal when the voice signal of the user is recognized through the microphone 30.

As a result of the determination, when the recognized voice signal does not correspond to the registered voice command, the command-analysis function unit 52 controls the transceiver 70 to perform network access to the command analysis server 3 through the communication network 2. The input voice data is transmitted to request natural language analysis. In the present invention, the natural language means a word extracted with the most matching voice command based on a vast database corresponding to various voice signals pre-built in the command analysis server 3.

On the other hand, the command-analysis function stage 52 receives the natural language and new correction effect data matched with the natural language derived from the command analysis server 3 through the communication network (2), the effect storage unit 90 Store in Unlike the storage unit 80, the effect storage unit 90 may be a storage space for temporary data, and data may be deleted according to a predetermined period. The effect storage unit 90 may be integrated with the storage unit 80.

The effect-application function stage 53 applies the correction effect derived according to the user speech recognition of the command-analysis function stage 52 to the raw shape data inputted by handwriting, and then applies the result of the application to the touch screen 20. Controls the output to the UI screen. The correction effect used here may be correction effect data previously stored in the effect storage unit 90, or may be new correction effect data received from the command analysis server 3 by the command-analysis function unit 52.

According to such a configuration, when a user inputs a figure or a character through handwriting in a touch screen-based device, it is possible to solve the inconvenience and suggest a new input method when the user needs to correct it through an additional operation. We can plan convenience.

8 and 9 are flowcharts illustrating a hybrid electronic document input method using direct input and a voice command according to the present invention. Since most technical configurations are common to those already described with reference to [FIGS. 1] to [FIG. 2], only the flow will be described sequentially below. The order of the processes is not limited to those shown in [Fig. 8] and [Fig. 9], and some steps may be configured in reverse order within the scope of the object of the invention.

First, referring to FIG. 8, the document editing function unit 40 performs content data (figure data, character data) according to a handwriting input through manipulation of the touch screen 20 by a user of the touch terminal 1. To receive the input (S1).

The document editing-function stage 40 determines whether the continuous input to the content data in step S1 is cut off (S2). More specifically, the document editing-functional unit 40 determines that continuous handwriting is terminated when there is no user input for a preset time.

If it is determined that the continuous handwriting is finished according to the determination of step S2, the document correction-function unit 50 waits for the user to input a voice signal for correction purpose through the microphone 30 of the terminal 1 (S3). ).

When the voice signal is input to the microphone 30 by the user in accordance with the waiting for the voice signal input in step S3, the document correction-function unit 50 first determines whether the voice signal is sufficiently loud than the predetermined decibel (S4). ).

If the voice signal of a sufficiently loud sound equal to or greater than a predetermined decibel is input as a result of the determination in step S4, the document correction-function unit 50 receives the user's voice signal through the microphone 30 and enters the storage unit 80. Save (S5). On the contrary, if the voice signal of the predetermined decibel or more is not input as a result of the determination in step S4, the document correction-function unit 50 returns to step S1 to resume the handwriting input mode. Ask 40.

On the other hand, after step S5, the document correction-function unit 50 determines whether the continuous input for the user's voice signal through the microphone 30 is terminated (S6). More specifically, the document correction function 50 determines that the input of the voice command provided by the user is completed when there is no input of the voice signal through the microphone 30 for a preset time (for example, 2 seconds).

After the step S6, the document correction-function unit 50 recognizes the voice signal stored in the storage unit 80, and according to the result of the voice recognition, on the content data previously inputted by handwriting in step S1. The control effect is applied to the touch screen 20 by applying a correction effect corresponding to the voice signal (S7).

In the present embodiment looks at an example of applying the correction effect. When the user inputs a circular-like shape as shown in [a] of FIG. 7 (a) on the touch screen 20 and pronounces "shape conversion" as a voice, the data is elliptical as shown in [b] of FIG. 7 through voice recognition. Processing is performed. When a user performs handwriting input by handwriting on the touch screen 20 and pronounces "text conversion" by voice, the text content corresponding to the handwriting is input to the electronic document through voice recognition. In addition, if a voice input of “black coloring” is provided, the inside of the obtained ellipse is colored in black as shown in FIG. 7 (b). Similarly, if a voice input of "erasing" is provided, the currently selected data is processed to be deleted from the electronic document, and for the voice input of "conversion", the elliptic data is changed into a circle and input into the electronic document. Similarly, the arrangement point of the figure or the character may be moved, for example, through pronunciation such as 'up', 'down', 'left', 'right' and the like.

Next, the process of applying the speech recognition and correction effect according to step S8 of FIG. 8 will be described in more detail with reference to FIG. 9. If the user's voice signal is recognized through the microphone 30 (S11), the document correction-function unit 50 determines whether the voice command is registered by analyzing the recognized voice signal (S12).

If the recognized voice signal corresponds to the registered voice command as a result of the determination in step S12, the document correction-function unit 50 may be configured according to the voice command to the content data (figure data and text data) input through handwriting. After applying the correction effect, the corrected result is output to the touch screen 20 (S13).

On the other hand, if the recognized speech signal does not correspond to the registered voice command as a result of the determination of step S12, the document correction-function unit 50 controls the transceiver 70 to control the command analysis server through the communication network (2) In step (3), the network access is performed, and through this, a natural language analysis of the voice signal is requested (S14).

After step S14, the document correction-function unit 50 receives new correction effect data for applying the correction effect from the command analysis server 3 according to the natural language analysis, and performs handwriting on the received new correction effect data. After applying to the input content data, and outputs through the touch screen (20) (S15).

The present invention can also be embodied in the form of computer readable code on a computer readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, including those implemented in the form of carrier waves (eg, transmission over the Internet). . The computer-readable recording medium can also be stored and executed by a computer-readable code in a distributed manner on a networked computer system. And functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers skilled in the art to which the present invention belongs.

As described above, the embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention. And is not intended to limit the scope of the invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

1: touch terminal
2: network
3: command analysis server
10: Input unit
20: touch screen
30: microphone
40: Edit text-functional group
50: Document Correction-Function
51: voice-input stage
52: command-analysis function
53: Effect-Apply Function
60:
70: transceiver
80: storage
90: effect storage unit

Claims (6)

A first step of receiving raw shape data input by a direct input method into an electronic document input window implemented as a UI screen;
Receiving a voice signal from a user;
A third step of performing a speech recognition process on the speech signal to calculate a correction effect;
A fourth step of applying the correction effect to convert the raw shape data to obtain content data corresponding thereto;
A fifth step of implementing content data obtained through the conversion into a UI screen;
Hybrid electronic document input method using a direct input and a voice command comprising a.
The method according to claim 1,
In the third step,
Determining whether the voice signal is a registered voice command (a);
(B) calculating a correction effect according to the registered voice command when it corresponds to a registered voice command;
(C) requesting a natural language analysis of the voice signal by accessing the command analysis server if it does not correspond to the registered voice command;
Calculating a new correction effect corresponding to the speech signal when the natural language analysis result is received from the command analysis server;
Hybrid input electronic document input method using a direct input and a voice command comprising a.
The method according to claim 2,
The raw shape data includes figure-shape data and text-shape data,
And the content data comprises figure data and text data.
When the raw shape data is input to the electronic document input window implemented as a UI screen by a direct input method and the continuous direct input for the raw shape data is cut off, the user waits for input of a voice signal through the microphone 30 from the user. A text editing-functionality step 40 to control such that;
A voice-input functional stage 51 for receiving a voice signal through the microphone 30 when the input of the raw shape data is completed;
A command-analyzing function stage 52 for calculating a correction effect through a speech recognition process on the speech signal;
An effect-applying function stage 53 for applying the correction effect to convert the raw shape data to obtain content data corresponding thereto, and to implement the obtained content data as a UI screen;
Computer-readable recording medium recording a hybrid type electronic document input program comprising a.
The method of claim 4,
The command-analysis function stage 52,
It is determined whether the voice signal is a registered voice command, and if the voice signal corresponds to a registered voice command, a correction effect according to the registered voice command is calculated. Requesting a natural language analysis of the speech signal and receiving a natural language analysis result to calculate a new correction effect corresponding to the speech signal. Record carrier.
The method according to claim 5,
The raw shape data includes figure-shape data and text-shape data,
And the content data includes figure data and text data.

Images