KR102305184B1 - Method and apparatus for displaying electronic documents by input mode transfer - Google Patents

Abstract

Disclosed is a method for displaying an electronic document, the method comprising: displaying an electronic document on a screen using electronic document data; displaying a plurality of identifiers corresponding to a plurality of interface modules on the screen; Activating a text interface module when a first identifier is selected, displaying an output on the electronic document based on a first input from the text interface module, and a voice interface module when a second identifier is selected by a user activating; updating the output based on a second input from the voice interface module.

Description

Electronic document display method and device through various input method conversion {METHOD AND APPARATUS FOR DISPLAYING ELECTRONIC DOCUMENTS BY INPUT MODE TRANSFER}

The present application relates to a method and apparatus for displaying an electronic document through various input method conversion.

In general, various types of documents are generated in the work area, and if these documents were conventionally written in printed form, electronic documents and electronic signature services that generate various documents in electronic form have been recently introduced and utilized. , is showing a rapid growth trend in line with the government's paperless policy.

In addition, with the popularization of smart devices, user experiences for various input means provided by smart devices have been continuously accumulated. Therefore, it is expected that the electronic document can be created more conveniently if the electronic document is prepared by providing a combination of touch, handwriting, gesture, and voice in writing the electronic document.

The technology that is the background of the present application is disclosed in Korean Patent Publication No. 10-1946235.

An object of the present application is to provide a method and apparatus for more easily creating an electronic document by converting various input methods such as touch, handwriting, gesture, and voice to solve the problems of the prior art.

However, the technical problems to be achieved by the embodiments of the present application are not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, the electronic document display method according to an embodiment of the present application includes displaying an electronic document on a screen using electronic document data, corresponding to a plurality of interface modules on the screen displaying a plurality of identifiers; activating a text interface module when a first identifier is selected from a user; displaying an output on the electronic document based on a first input from the text interface module; activating a voice interface module when two identifiers are selected, and updating the output based on a second input from the voice interface module.

According to an embodiment of the present application, the character interface module is a character pad interface module including at least one phoneme as an element of the character pad, and the step of displaying an output in the electronic document based on the first input includes the Displaying a first output for sequentially appearing the phonemes in the electronic document based on a first input, wherein the step of updating the output based on the second input includes the electronic document based on the second input It may be a step of displaying a second output for sequentially appearing the syllables of the second input in a document.

According to an embodiment of the present application, the character interface module is a character handwriting interface module for recognizing a character based on a touch movement of the screen, and the step of displaying an output on the electronic document based on the first input includes: Displaying an image in which a movement line of touch movement is reflected or text extracted based on the image, wherein the step of updating the output based on the second input includes the second input in the electronic document based on the second input. It may be a step of displaying the second output to sequentially appear the syllables of the input.

According to an embodiment of the present disclosure, the character interface module further includes a character writing interface module for recognizing a character based on a touch movement of the screen, and inactivating the character pad interface module when the character writing interface module is activated However, the step of displaying the output on the electronic document based on the first input may be a step of displaying an image in which a movement line of the touch movement is reflected or text extracted based on the image.

According to an embodiment of the present application, the step of activating the voice interface module may include activating the voice interface module when a specific spoken word is received and performing an operation registered in the specific spoken word.

According to an embodiment of the present application, the electronic document includes a plurality of writing items, and the displaying of the electronic document is a step of dividing the writing items into at least one or more groups so that one group is displayed on one page. can

According to an embodiment of the present application, the step of updating the output includes whether or not the written item is written, and when receiving a writing request input for an unwritten item among the written items, a page with the unwritten item is included. may include moving the

According to an embodiment of the present application, the displaying of the text extracted based on the image may include, when the extracted text is uncertain, activating a character pad interface module or a voice interface module to additionally input the uncertain text. may be receiving

According to an embodiment of the present application, the voice interface module may be deactivated when the second input is not received for a predetermined period of time, and the text interface module may be activated.

According to an embodiment of the present application, the voice interface module may include a conversational module.

As a technical means for achieving the above technical problem, the electronic document display device according to an embodiment of the present application includes an electronic document display unit for displaying an electronic document on a screen using electronic document data, and a plurality of interface modules on the screen. An identifier display unit displaying a plurality of corresponding identifiers, a character pad activation unit activating a character pad interface module when a first identifier is selected by a user, and outputting to the electronic document based on a first input from the character pad interface module a first output unit displaying can do.

According to an embodiment of the present application, the character interface module is a character pad interface module including at least one phoneme as an element of a character pad, and the first output unit displays the phoneme in the electronic document based on the first input. Display a first output to appear sequentially, the second output unit may be to display a second output for sequentially appearing the syllables of the second input in the electronic document based on the second input .

According to an embodiment of the present application, the character interface module is a character writing interface module for recognizing a character based on a touch movement of the screen, and the first output unit is an image reflecting a movement line of the touch movement or based on the image and displaying the extracted text, wherein the second output unit displays a second output for sequentially displaying the syllables of the second input in the electronic document based on the second input.

According to an embodiment of the present disclosure, the character interface module further includes a character writing interface module for recognizing a character based on a touch movement of the screen, and inactivating the character pad interface module when the character writing interface module is activated However, the output displayed by the first output unit may include an image in which a movement line of the touch movement is reflected or text extracted based on the image.

The above-described problem solving means are merely exemplary, and should not be construed as limiting the present application. In addition to the exemplary embodiments described above, additional embodiments may exist in the drawings and detailed description.

According to the above-described problem solving means of the present application, by providing an electronic document display method and apparatus for various input types, it is possible to provide an electronic document that is easy and convenient to prepare for each input type.

According to the above-described problem solving means of the present application, by providing a method and apparatus for displaying an electronic document in which it is easy to change an input form, a document can be easily created by changing the input form according to a situation.

1 is a schematic diagram showing an electronic document display system that can be input in various forms according to an embodiment of the present application.
2 to 7 are diagrams illustrating an output of an electronic document display device according to various embodiments of the present disclosure.
8 is a block diagram illustrating an electronic document display device according to an embodiment of the present application.
9 is a flowchart illustrating an electronic document display method according to an embodiment of the present application.

Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art to which the present application pertains can easily implement them. However, the present application may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present application in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout this specification, when a part is "connected" with another part, it is not only "directly connected" but also "electrically connected" or "indirectly connected" with another element interposed therebetween. "Including cases where

Throughout this specification, when it is said that a member is positioned "on", "on", "on", "under", "under", or "under" another member, this means that a member is positioned on the other member. It includes not only the case where they are in contact, but also the case where another member exists between two members.

Throughout this specification, when a part "includes" a component, it means that other components may be further included, rather than excluding other components, unless otherwise stated.

Hereinafter, an electronic document display apparatus and method of the present application will be described with reference to FIGS. 1 to 9 .

1 is a schematic diagram showing an electronic document display system that can be input in various forms according to an embodiment of the present application. Referring to FIG. 1 , an electronic document display system that can be input in various forms may include an electronic document display device 1 . The electronic document display device 1 may receive various types of inputs from the user. Various types of input may be, for example, a voice input, a handwriting input, and a gesture/touch input, but is not limited thereto.

The electronic document display device 1 may include a microphone to receive various types of inputs, and may additionally include a touch screen, a touch pad, a touch pen, a keyboard, a mouse, and the like.

The electronic document display device 1 may represent an electronic document stored in the electronic document display device 1 . In addition, although not shown in FIG. 1 , an electronic document stored in the document preparation server may be received and displayed. The document creation server stores various types of documents, and can store the platform, form, image, etc. of the document. In the present specification, the document creation server may be expressed differently as an external server.

The electronic document display device 1 and the document preparation server may be connected through a network. The network refers to a connection structure capable of exchanging information with each other, such as terminals and servers, and an example of such a network includes a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) network, 5G network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), wifi network , a Bluetooth (Bluetooth) network, a satellite broadcasting network, an analog broadcasting network, a Digital Multimedia Broadcasting (DMB) network, etc. are included, but are not limited thereto.

The electronic document display device 1 may receive a request to display the electronic document from the user. The method of receiving the request may be a method of receiving packet data, text data, graphic data, or receiving voice data. The voice data is based on the user's utterance, and may be a phrase such as "Open a new transaction application" or "Open a report that was made yesterday." The electronic document display device 1 may be linked with a natural language processing device that recognizes the user's intention through natural language processing for the user's utterance in order to determine an electronic document template to be written by the user based on the user's utterance.

The electronic document display device 1 may display an electronic document on the screen by using the electronic document data. The electronic document display device 1 may display a corresponding electronic document according to a user's request. The electronic document may be stored in the electronic document storage server or the electronic document display device 1 . The electronic document display device 1 may display the electronic document on the screen by editing the electronic document data. The electronic document display device 1 may determine a data range to be used for editing according to specifications, resolution, and the like of the electronic document display device 1 . The electronic document display device 1 may edit the electronic document data after determining the data range. Alternatively, the edited electronic document may be provided from the server.

The electronic document display device 1 may display a plurality of identifiers corresponding to the plurality of interface modules on the screen. The interface module may mean a module responsible for input and output of the electronic document, and the identifier may mean an icon corresponding to each interface module. The identifier may have a different shape for each interface module.

The electronic document display device 1 may activate the text interface module when the first identifier is selected by the user. The electronic document display device 1 may display an output on the electronic document based on a first input from the text interface module.

The electronic document display device 1 may activate the voice interface module when the second identifier is selected by the user. In this specification, a voice may be expressed as an utterance. The electronic document display device 1 may update the output based on the second input from the voice interface module. In this case, the electronic document display device 1 may display a second output for sequentially displaying the syllables of the second input in the electronic document based on the second input. The electronic document display device 1 may output the updated electronic document by voice.

The updated electronic document may be stored in the electronic document display device 1 and an external server.

2 is a diagram illustrating an output of the electronic document display device 1 according to various embodiments of the present disclosure. Specifically, it is a diagram showing an identifier corresponding to an interface module. Referring to FIG. 2A , the electronic document includes a plurality of writing items 11 , and the electronic document display device may display identifiers 21 , 22 , and 23 . The user may select the identifiers 21 , 22 , and 23 after determining an input type in order to write the writing item 11 . There may be more than one identifier (21, 22, 23) indicated by the electronic document display device. In this case, as for the method of making a selection, the selection can be made by touching the identifier or giving a command by voice. Giving a command by voice may be, for example, selecting the voice interface identifier 23 through an utterance "I will write by voice".

Also, as an example, the identifier 21 corresponding to the character pad interface module is an icon representing a character pad, the identifier 22 corresponding to the character handwriting interface module is a pen-shaped icon, and the identifier corresponding to the voice interface module ( 23) may be a microphone-shaped icon, and may be a letter-shaped icon as well as a picture-shaped icon.

The electronic document display device 1 may display a written item to be input by the user to be differentiated from other written items. For example, when a user calls a new electronic document, the border of the first written item of the electronic document may be displayed with a red line. Alternatively, when the user touches the first written item in the electronic document, the border of the first written item may be displayed with a red line.

Referring to FIG. 2B , when one of the plurality of identifiers 21 , 22 , and 23 is selected, the remaining identifiers may be continuously displayed on the screen. For example, when the voice interface identifier 23 is selected, the unselected character pad interface identifier 21 and the character handwriting interface identifier 22 may be displayed on a part of the screen.

3 is a diagram illustrating an output of an electronic document display device according to various embodiments of the present disclosure. Specifically, it is a diagram illustrating an input interface module and a writing method according to various embodiments of the present disclosure.

According to an embodiment of the present disclosure, the character interface module may be a character pad interface module including at least one phoneme as an element of the character pad. In this case, the electronic document display device may display a first output for sequentially appearing the phonemes in the electronic document based on the first input.

Referring to FIG. 3A , when the user selects the character pad interface identifier 21 , the character pad interface module may be activated. An input for the writing item 11 may be received through the character pad interface module. Phonemes input from the character pad interface module may be sequentially written in the writing item 11 and outputted.

The electronic document display device 1 includes an identifier for switching the currently written item to the next and previous items in the character pad interface module, and the user can move to the next written item 11 by touching the next item identifier. Alternatively, it is possible to return to the previously created item 11 by touching the previous item identifier.

When receiving a specific spoken word, the electronic document display device 1 may activate the voice interface module and perform an operation registered in the specific spoken word. For example, if the spoken word "next" is stored to perform an operation to move to the next written item, and when the spoken word "next" is received, the voice interface module is activated and the voice interface module is activated from the character pad interface module can be converted to Also, you can move on to the next entry. After performing the above operation, the voice interface module may be deactivated again.

Referring to FIG. 3B , when the user selects the voice interface identifier 23 , the voice interface module may be activated. When the voice interface module is activated, the voice guidance module may be activated. The voice guidance module may generate a question for inducing a user's response to write an electronic document, and output the generated question as a voice.

The voice interface module may include an interactive module. The interactive module may generate and output an interactive question necessary for creating an electronic document from a user, and may extract data necessary for creating an electronic document from the user's voice input.

The interactive question means receiving an answer corresponding to the first question from the user and generating a second question for the answer, and the subsequent question and the answer are related so that the document can be written smoothly.

For example, when the first written item 11 is an item in which 'name or company name' is written, the voice guidance module may provide voice guidance saying "Please tell me what to enter in your name or company name." At this time, the user may utter "Hong Gil-dong" as an input for 'name or company name'. The electronic document display device may display the recognized syllable for the utterance of “Hong Gil-dong” by inputting it into text in the writing item 11 corresponding to 'name or company name'.

The electronic document display device 1 may receive an input as a command for performing an operation on a specific spoken word. In this case, the electronic document display device 1 may recognize a specific utterance as an utterance that performs an operation, rather than recognizing it as input data to be written in a written item. For example, when voice data of "save the content in the middle" is received from the user, the user's utterance is analyzed and the input of 'intermediate storage' among the spoken words may be received as a command for document storage.

When the identifier for the voice guidance module is selected, the voice guidance module may be deactivated. Alternatively, the voice guidance module may be deactivated by receiving an utterance command for deactivation of the voice guidance module. Also, in a state in which the voice guidance module is deactivated, when an identifier for the voice guidance module is selected, the voice guidance module may be activated.

When the voice interface module is activated, there may be a plurality of identifiers corresponding to the activation of the voice interface module. Specifically, the identifier when receiving a voice input from the user may be different from the identifier when waiting without receiving a voice input from the user. By subdividing the identifier for the voice interface module, the user can check the current input/output state of the electronic document display device 1 . That is, by displaying the identifier when receiving a voice input, the user can recognize that the current user's utterance is being properly inputted into the electronic document display device 1 . In addition, by displaying the identifier when in standby without receiving a voice input, the user can confirm that the voice interface module is continuously activated.

In this case, if the waiting time without receiving a voice input exceeds a preset time, the voice interface module may be deactivated. For example, if the waiting time without receiving a voice input exceeds a preset time of 10 seconds, the voice interface module may be deactivated.

The voice interface module may be deactivated when the second input is not received for a predetermined period of time, and the text interface module may be activated. The voice interface module may include an interactive module.

4 is a diagram illustrating an output of an electronic document display device according to various embodiments of the present disclosure. Specifically, it is a diagram illustrating a character writing interface module and a writing method of the electronic document display device 1 according to various embodiments of the present disclosure.

According to an embodiment of the present disclosure, the text interface module may further include a text handwriting interface module for recognizing text based on a touch movement of the screen. The text interface module may be a text handwriting interface module that recognizes text based on a touch movement of the screen. In this case, the electronic document display device may display an image in which the movement line of the touch movement is reflected or text extracted based on the image.

Referring to FIG. 4A , when the character writing interface identifier is selected, the character writing interface module is activated so that the user can input the writing. The user may select the thickness, type, color, etc. of the handwriting line for handwriting input. For example, the type of the writing line may indicate the texture of a highlighter, a pencil, or a signature pen. In this case, an area for selecting the thickness, type, color, etc. of a handwriting line for handwriting input may be located at the top of the electronic document.

The input tool used for handwriting input may be, for example, a touch pen or a part of the body, but is not limited thereto. In addition, the touch method for the writing input may be a touch method using a resistive film (pressure-sensitive type), capacitance (capacitive type), infrared rays, and ultrasonic waves, but is not limited thereto.

The electronic document display device 1 may deactivate the character pad interface module when activating the character handwriting interface module. The electronic document display device 1 may allow the user to easily switch the input interface by continuously exposing the character writing interface identifier and the voice interface identifier to a part of the screen while the character writing interface module is activated.

Referring to FIG. 4B , the user can make a handwriting input for a written item by moving a touch on the screen of the electronic document display device 1 . The electronic document display device may recognize a character based on a touch movement.

For example, when the user inputs the character 'Hong' by moving the touch, the electronic document display device 1 may recognize the character 'Hong' using the letter form of 'Hong' and the writing order. can An element necessary for recognizing a character is not limited to a character shape and a writing order, and may be using coordinates of a touched position.

For example, when the touch method of the electronic document display device 1 is a capacitive method, a character may be recognized by calculating the coordinates of the user's touch movement.

The electronic document display device 1 may display the image itself in which the movement line of the touch movement is reflected. That is, it is possible to display the image as it is without extracting the characters handwritten by the user as text. For example, when the written item is a signature-related item, the user's signature may be input and displayed in the form of an image.

In addition, the written item may be written in an O/X form, written in a V-shape check method, or may be a form of selecting a suitable answer from among answer types preset for each item, but is not limited thereto.

When the extracted text is uncertain, the electronic document display device 1 may activate a character pad interface module or a voice interface module to receive additional input for the uncertain text. For example, if the user inputs 'yes' using the character handwriting interface module, but the candidate character recognized by the electronic document display device is determined as 'yes' and 'non', the user is provided with the character pad interface module and The text may be input again through the voice interface module. In addition, in the case of handwriting input with multiple candidates as in the above situation, a notification window for selecting a text candidate may be output or a question may be asked which character it is. Alternatively, the input may be received again by requesting the user for handwriting.

5 is a diagram illustrating an output of an electronic document display device according to various embodiments. Specifically, it is a diagram illustrating a method of erasing a handwriting input when the letter handwriting interface module is activated.

Referring to FIG. 5 , an image or text created by handwriting input may be deleted by additionally receiving a preset screen touch movement on the image or text. Touch movement of the preset screen may be, for example, drawing a line in a zigzag form or drawing a line in a straight line on an image or text inputted by handwriting. After that, the handwriting input can be performed again.

In addition, deletion of an image or text may be performed by selecting an identifier corresponding to the deletion, for example, an eraser icon, among the character handwriting interface modules. Specifically, the eraser can be deleted by selecting the eraser icon and touching the border of the writing item, moving the image or text to be deleted in a zigzag form, moving the touch along the shape of the text, or touching the image.

Alternatively, images or text can be deleted using a voice command. For example, if 'delete' is registered as a specific spoken word that activates the voice interface module, the voice interface module is activated and entered through the utterance of "Erase Erase" while using the character handwriting interface module. After deleting the Erase word, the character handwriting interface module may be activated again.

6 is a diagram illustrating an output of an electronic document display device according to various embodiments of the present disclosure; More specifically, it is a drawing for a simple mode that allows an electronic document to be easily created.

As described above, referring to FIG. 2 , the electronic document may include a plurality of writing items. The electronic document display device 1 may divide a plurality of writing items into at least one or more groups.

For example, you can divide 10 writing items into 5 groups. Each group can contain 2 entries. Alternatively, the number of writing items included in each group may be different. Specifically, the first to third groups may have two items, the fourth group may have three items, and the fifth group may have one item. In this case, the criterion for dividing each group may be a writing order, a correlation between writing items, and the like, but is not limited thereto.

When the user selects the simple mode, the electronic document display device 1 may display one group on one page of the electronic document. The method of selecting the simple mode may be selected by touching an icon for the simple mode or by uttering a command to change to the simple mode. The utterance may be, for example, "switch to a simple mode" or "show an electronic document easily".

Referring to FIG. 6A , the electronic document display device 1 may represent a group including one written item per page. When the electronic document is displayed in the simple mode, the electronic document display device 1 may output an icon in which initialization, previous, and next are displayed at the bottom of each written item. Alternatively, icons for initialization, previous, and next may be displayed at the bottom of each page. When the user selects the initialization icon, the input for the entire document may be deleted to initialize the input for the entire written item. Alternatively, the user may delete the input of one page rather than the entire document. Alternatively, the input of one writing item may be deleted.

Also, when the user selects the previous or next identifier, the page may be switched to the previous or next page, or the currently created item may be switched to the previous or next item.

When the user selects the voice interface identifier in the simple mode and the voice interface module is activated, the remaining identifiers 21 and 22 may be output on a part of the screen.

Referring to FIG. 6B , the electronic document display device may indicate a group including two writing items on one page.

The electronic document display device 1 includes whether or not to write a written item, and when receiving a writing request input for an unwritten item among the written items, the electronic document display device 1 may move a page to the unwritten item.

7 is a diagram illustrating an output of an electronic document display device according to various embodiments of the present disclosure. Specifically, it is a diagram showing the electronic document display device 1 for output including whether or not to create an electronic document creation item and a simple mode.

Referring to FIG. 7( a ), the electronic document display device 1 may display whether each writing item is written or not. In the present specification, whether or not to write may be expressed differently as whether to input. The name of each written item can be listed in one column, and whether or not each written item has been written can be indicated in a side-by-side column. Columns listing items and whether or not they are created can be listed as multiple columns.

Whether to write each item may be indicated by a symbol such as V/ X/ O. For example, an item that has not been written may be expressed as X, and an item that has been written may be expressed as V or O. In addition, the writing item currently being input may be displayed with a red dot or the like next to the item.

If you receive a write request input for an unwritten item, you can move the page to the unwritten item.

Referring to FIG. 7B , the electronic document display device 1 may output whether or not a written item is input and a page including a writing item currently being written. For example, it is possible to output whether or not a written item is input on the left side of the screen, and output a page including a writing item currently being written on the right side of the screen. In this case, the user may select an item to be written on the left screen, and the electronic document display device 1 may output a page including the selected item by the user on the right screen.

The electronic document display device 1 may activate the voice interface module by receiving a specific spoken word to perform an operation on the spoken word. For example, when the user inputs a writing item for a name and utters "next", the electronic document display device may output the next written item, date of birth, on the right screen. At this time, whether or not to write a name can be changed from X to V.

The electronic document display device 1 may divide the creation item into a mandatory item and an optional item. Required items may mean items that must be prepared in order to complete an electronic document. When the user selects the next creation item without inputting the required item, the electronic document display device 1 may make a writing request for the required item. The writing request may be in the form of a notification window, a notification sound, or the like. Alternatively, the electronic document display device may be to make a writing request for essential writing items that have not been written after writing up to the last writing item.

8 is a block diagram illustrating an electronic document display device according to an embodiment of the present application.

Referring to FIG. 8 , the electronic document display device 1 according to an embodiment of the present application includes an electronic document display unit 10 , an identifier display unit 20 , a character pad activation unit 30 , a first output unit 40 , It may include a voice activation unit 50 and a second output unit 60 .

The electronic document display device 1 may receive a request to display the electronic document from the user. The method of receiving the request may be a method of receiving packet data or receiving voice data. The voice data is based on the user's utterance, and may be a phrase such as "Open a new transaction application" or "Open a report that was made yesterday." The electronic document display device 1 may be linked with a natural language processing device that recognizes the user's intention through natural language processing for the user's utterance in order to determine an electronic document template to be written by the user based on the user's utterance.

The electronic document display unit 10 may display an electronic document on the screen by using the electronic document data. Specifically, the electronic document display device 1 may display the corresponding electronic document according to the user's request. The electronic document may be stored in the electronic document storage server or the electronic document display device 1 . The electronic document display device 1 may display the electronic document on the screen by editing the electronic document data. The electronic document display device 1 may determine a data range to be used for editing according to specifications, resolution, and the like of the electronic document display device 1 . The electronic document display device 1 may edit the electronic document data after determining the data range. Alternatively, the edited electronic document may be provided from the server.

In this case, the electronic document may include a plurality of writing items. The electronic document display unit 10 may divide the plurality of writing items into at least one or more groups. You can edit the original electronic document to display one group per page.

The identifier display unit 20 may display a plurality of identifiers corresponding to the plurality of interface modules on the screen. The interface module may mean a module responsible for input and output of the electronic document, and the identifier may mean an icon corresponding to each interface module. The identifier may have a different shape for each interface module. For example, the icon may be in the form of a picture or a letter, but is not limited thereto. Also, the identifier may be in the form of a voice describing each interface module.

The character pad activation unit 30 may activate the character pad interface module when the first identifier is selected by the user. The character interface module may be a character pad interface module including at least one phoneme as an element of the character pad. Alternatively, the character interface module may be a character handwriting interface module that recognizes a character based on a touch movement of the screen. In this case, when the character handwriting interface module is activated, the character pad interface module may be deactivated. The first identifier may be an icon in the form of a keyboard picture or a pen picture, but is not limited thereto.

The first output unit 40 may display an output on the electronic document based on a first input from the character pad interface module. When the character interface module is a character pad interface module including at least one phoneme as an element of the character pad, the first output unit 40 is configured to sequentially display the phonemes in the electronic document based on a first input. A first output may be displayed.

Alternatively, when the character interface module is a character handwriting interface module that recognizes characters based on the touch movement of the screen, the first output unit 40 may output an image in which the movement line of the touch movement is reflected or text extracted based on the image. can be displayed In this case, the image or text may be deleted by additionally receiving a preset touch movement on the image or text on the image or text.

In this case, if the image to which the movement line of the touch movement is reflected or the text extracted based on the image is uncertain, the character pad interface module or the voice interface module may be activated to receive an additional input for the uncertain text.

The voice activation unit 50 may activate the voice interface module when the second identifier is selected by the user. When a specific spoken word is received, the voice interface module may be activated and an operation registered in the specific spoken word may be performed. In addition, if the second input is not received for a certain period of time, it may be deactivated and the text interface module may be activated. In this case, the character interface module may be one of a character pad interface module and a character writing interface module. Alternatively, one of the character pad interface module or the character handwriting interface module may be provided, and the other may be displayed as an inactive identifier, and when the disabled identifier is selected by the user, the interface module may be switched.

The voice interface module may include an interactive module. The interactive module may generate and output an interactive question necessary for creating an electronic document from a user, and may extract data necessary for creating an electronic document from the user's voice input.

The interactive question means receiving an answer corresponding to the first question from the user and generating a second question for the answer, and the subsequent question and the answer are related so that the document can be written smoothly.

The second output unit 60 may update the output based on a second input from the voice interface module. The electronic document output from the second output unit 60 may include whether or not the writing item is written. The method may include moving a page to the unwritten item when receiving a writing request input for an unwritten item among the written items.

9 is a flowchart illustrating a method for displaying an electronic document according to an embodiment of the present application.

Referring to FIG. 9 , a step of displaying an electronic document on a screen using electronic document data (S100), a step of displaying a plurality of identifiers corresponding to a plurality of interface modules on the screen (S200), a first identifier from a user Activating the text interface module when selected (S300), displaying an output on the electronic document based on the first input from the text interface module (S400), and when the second identifier is selected from the user, the voice interface module It may include activating (S500) and updating the output based on a second input from the voice interface module (S600).

In step S100, the electronic document may include a plurality of writing items. The written items may be divided into at least one or more groups. You can edit the original electronic document to display one group per page.

In step S200, the interface module may mean a module responsible for input and output of the electronic document, and the identifier may mean an icon corresponding to each interface module. The identifier may have a different shape for each interface module. For example, the icon may be in the form of a picture or a letter, but is not limited thereto. Also, the identifier may be in the form of a voice describing each interface module.

In step S300 , the character interface module may be a character pad interface module including at least one phoneme as an element of the character pad. Alternatively, the character interface module may be a character handwriting interface module that recognizes a character based on a touch movement of the screen. In this case, when the character handwriting interface module is activated, the character pad interface module may be deactivated.

When the character interface module is a character pad interface module including at least one phoneme as an element of the character pad in step S400, a first output for sequentially appearing the phonemes in the electronic document based on the first input is displayed can do. Alternatively, when the character interface module is a character handwriting interface module that recognizes a character based on a touch movement of the screen, an image in which a movement line of the touch movement is reflected or a text extracted based on the image may be displayed. In this case, the image or text may be deleted by additionally receiving a preset touch movement on the image or text on the image or text.

In this case, if the image to which the movement line of the touch movement is reflected or the text extracted based on the image is uncertain, the character pad interface module or the voice interface module may be activated to receive an additional input for the uncertain text.

When receiving a specific spoken word in S500, the voice interface module may be activated and an operation registered in the specific spoken word may be performed. In addition, if the second input is not received for a certain period of time, it may be deactivated and the text interface module may be activated. In this case, the character interface module may be one of a character pad interface module and a character writing interface module. Alternatively, one of the character pad interface module or the character handwriting interface module may be provided, and the other may be displayed as an inactive identifier, and when the disabled identifier is selected by the user, the interface module may be switched.

The voice interface module may include an interactive module. The interactive module may generate and output a question required to create an electronic document from a user, and may extract data necessary for creating an electronic document from the user's voice input.

In S600, it may include whether or not the writing item is written. The method may include moving a page to the unwritten item when receiving a writing request input for an unwritten item among the written items.

In the above description, steps S100 to S600 may be further divided into additional steps or combined into fewer steps according to an embodiment of the present application. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

The electronic document display method according to an embodiment of the present application may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

In addition, the electronic document display method described above may be implemented in the form of a computer program or application executed by a computer stored in a recording medium.

The above description of the present application is for illustration, and those of ordinary skill in the art to which the present application pertains will understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The scope of the present application is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present application.

1: Electronic document display device
10: electronic document display unit
11: Filled out
20: identifier display unit
21: character pad interface identifier
22: handwriting interface identifier
23: voice interface identifier
30: character pad activation unit
40: first output unit
50: voice activation unit
60: second output unit

Claims (16)

In the electronic document display method performed by the electronic document display device,
displaying an electronic document on a screen using the electronic document data;
displaying a plurality of identifiers corresponding to a plurality of interface modules on the screen;
activating the text interface module when the first identifier is selected by the user;
displaying an output on the electronic document based on a first input from the text interface module;
activating the voice interface module when the second identifier is selected by the user; and
updating the output based on a second input from the voice interface module;
The electronic document includes a plurality of writing items classified into at least one or more groups based on the relation between the writing order of the electronic document and the writing items,
The step of displaying the electronic document includes:
In response to the user's input for selecting the simple mode, display the at least one or more groups as one group on one page,
An identifier for initializing previously inputted content for a corresponding group and an identifier for switching to a page corresponding to a group other than the corresponding group are displayed on the page. According to claim 1,
The character interface module is a character pad interface module including at least one phoneme as an element of the character pad,
The step of displaying the output on the electronic document based on the first input is a step of displaying a first output for sequentially appearing the phonemes in the electronic document based on the first input,
The step of updating the output based on the second input is a step of displaying a second output for sequentially appearing the syllables of the second input in the electronic document based on the second input. . According to claim 1,
The character interface module is a character handwriting interface module for recognizing characters based on the touch movement of the screen,
The step of displaying the output on the electronic document based on the first input is a step of displaying an image in which the movement line of the touch movement is reflected or text extracted based on the image,
The step of updating the output based on the second input is a step of displaying a second output for sequentially appearing the syllables of the second input in the electronic document based on the second input. . 3. The method of claim 2,
The character interface module further comprises a character writing interface module for recognizing characters based on the touch movement of the screen,
When the character handwriting interface module is activated, the character pad interface module is deactivated,
The step of displaying the output on the electronic document based on the first input is a step of displaying an image in which a movement line of the touch movement is reflected or text extracted based on the image. 4. The method of claim 3,
Activating the voice interface module comprises:
An electronic document display method of activating a voice interface module when receiving a specific spoken word and performing an operation registered in the specific spoken word. 4. The method of claim 3,
In the image or text, the image or text is deleted by additionally receiving a touch movement of a preset screen on the image or text. delete According to claim 1,
Updating the output includes:
The method of displaying an electronic document including whether to write the written item, and moving a page to the non-written item when receiving a writing request input for an unwritten item among the written items. 5. The method of claim 4,
Displaying the text extracted based on the image comprises:
When the extracted text is uncertain, a character pad interface module or a voice interface module is activated to receive an additional input for the uncertain text. 5. The method of claim 4,
The voice interface module,
If the second input is not received for a certain period of time, it is deactivated and the text interface module is activated. 11. The method of claim 10,
The voice interface module includes an interactive module, the electronic document display method. In the electronic document display device,
an electronic document display unit for displaying an electronic document on a screen by using the electronic document data;
an identifier display unit for displaying a plurality of identifiers corresponding to a plurality of interface modules on the screen;
a character pad activation unit activating a character interface module when a first identifier is selected by a user;
a first output unit configured to display an output on the electronic document based on a first input from the text interface module;
a voice activation unit activating the voice interface module when the second identifier is selected by the user; and
a second output for updating the output based on a second input from the voice interface module;
The electronic document includes a plurality of writing items classified into at least one or more groups based on the relation between the writing order of the electronic document and the writing items,
The electronic document display unit,
In response to the user's input for selecting the simple mode, display the at least one or more groups as one group on one page,
The electronic document display device, characterized in that the page displays an identifier for initializing previously inputted content for a corresponding group and an identifier for switching to a page corresponding to a group other than the corresponding group. 13. The method of claim 12,
The character interface module is a character pad interface module including at least one phoneme as an element of the character pad,
The first output unit displays a first output for sequentially appearing the phonemes in the electronic document based on the first input,
The second output unit will display a second output for sequentially appearing the syllables of the second input in the electronic document based on the second input, the electronic document display device. 13. The method of claim 12,
The character interface module is a character handwriting interface module for recognizing characters based on the touch movement of the screen,
The first output unit is a step of displaying an image in which the movement line of the touch movement is reflected or text extracted based on the image,
The second output unit will display a second output for sequentially appearing the syllables of the second input in the electronic document based on the second input, the electronic document display device. 14. The method of claim 13,
The character interface module further comprises a character writing interface module for recognizing characters based on the touch movement of the screen,
When the character handwriting interface module is activated, the character pad interface module is deactivated,
The output displayed by the first output unit will include an image in which the movement line of the touch movement is reflected or text extracted based on the image. A computer-readable recording medium in which a program for executing the method of any one of claims 1 to 6 and 8 to 11 in a computer is recorded.

Images