KR20210004400A - Method and apparatus for displaying electronic documents by input mode transfer - Google Patents

Abstract

Disclosed is an electronic document displaying method. The electronic document displaying method comprises the steps of: displaying an electronic document on a screen using electronic document data; displaying a plurality of identifiers corresponding to a plurality of interface modules on the screen; activating a character interface module when a first identifier is selected from a user; displaying an output on the electronic document based on a first input from the character interface module; activating a voice interface module when a second identifier is selected from the user; and updating the output based on a second input from the voice interface module.

Description

Electronic document display method and device through various input method switching {METHOD AND APPARATUS FOR DISPLAYING ELECTRONIC DOCUMENTS BY INPUT MODE TRANSFER}

The present application relates to a method and apparatus for displaying an electronic document through various input method switching.

In general, various forms of documents are generated in the business area, and if these documents were prepared in the form of printed on paper in the past, electronic documents and electronic signature services that generate various documents in electronic form have been recently introduced and utilized. , It is showing a rapid growth trend in line with the government's paperless policy.

In addition, smart devices have become popular, and user experiences have been continuously accumulated for various input means provided by smart devices. Therefore, when creating an electronic document by providing a combination of touch, handwriting, gesture, and voice to create an electronic document, it is expected that it will be possible to create an electronic document more conveniently.

The technology behind the present application is disclosed in Korean Patent Publication No. 10-1946235.

An object of the present application is to provide a method and an apparatus for making electronic documents easier by providing by switching various input methods such as touch, handwriting, gestures, and voice, as to solve the problems of the prior art described above.

However, the technical problem to be achieved by the embodiments of the present application is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, an electronic document display method according to an embodiment of the present application includes displaying an electronic document on a screen using electronic document data, corresponding to a plurality of interface modules on the screen. Displaying a plurality of identifiers, activating a character interface module when a first identifier is selected from a user, displaying an output in the electronic document based on a first input from the character interface module, 2 When the identifier is selected, activating the voice interface module, and updating the output based on a second input from the voice interface module.

According to an embodiment of the present application, the character interface module is a character pad interface module including at least one phoneme as an element of a character pad, and displaying an output on the electronic document based on the first input includes the Displaying a first output for sequentially displaying the phonemes in the electronic document based on a first input, and updating the output based on the second input comprises: It may be a step of displaying a second output to sequentially display the syllables of the second input in the document.

According to an embodiment of the present application, the character interface module is a character writing interface module that recognizes a character based on a touch movement of the screen, and displaying an output on the electronic document based on the first input includes the Displaying an image reflecting a moving line of a touch movement or text extracted based on the image, and updating the output based on the second input includes the second input in the electronic document based on the second input. It may be a step of displaying a second output to sequentially display the syllables of the input.

According to an embodiment of the present application, the character interface module further includes a character writing interface module that recognizes a character based on a touch movement of the screen, and when activating the character handwriting interface module, the character pad interface module is deactivated. However, displaying the output on the electronic document based on the first input may be a step of displaying an image in which the moving line of the touch movement is reflected or text extracted based on the image.

According to an embodiment of the present disclosure, the step of activating the voice interface module may include activating the voice interface module when receiving a specific spoken word, and performing an operation registered in the specific spoken word.

According to an embodiment of the present application, the electronic document includes a plurality of creation items, and the displaying of the electronic document is a step of dividing the creation item into at least one group and displaying one group on one page. I can.

According to an embodiment of the present application, the updating of the output includes whether or not to write the item to be written, and when receiving a request input for an item that has not been written among the items to be written, a page to the unwritten item It may include the step of moving.

According to an embodiment of the present application, the displaying of the extracted text based on the image comprises: when the extracted text is uncertain, a character pad interface module or a voice interface module is activated to additionally input the uncertain text. It may be to receive.

According to an exemplary embodiment of the present disclosure, the voice interface module may be deactivated when the second input is not received for a predetermined period of time, and the text interface module may be activated.

According to an embodiment of the present application, the voice interface module may include an interactive module.

As a technical means for achieving the above technical problem, an electronic document display device according to an embodiment of the present application includes an electronic document display unit that displays an electronic document on a screen using electronic document data, and a plurality of interface modules on the screen. An identifier display unit displaying a plurality of corresponding identifiers, a character pad activation unit activating a character pad interface module when a first identifier is selected by a user, and output to the electronic document based on a first input from the character pad interface module A first output unit displaying a, a voice activation unit activating a voice interface module when a second identifier is selected by a user, and a second output unit updating the output based on a second input from the voice interface module can do.

According to an embodiment of the present application, the character interface module is a character pad interface module including at least one phoneme as an element of a character pad, and the first output unit displays the phoneme in the electronic document based on the first input. A first output for sequentially appearing is displayed, and the second output unit may be to display a second output for sequentially appearing syllables of the second input in the electronic document based on the second input. .

According to an embodiment of the present application, the character interface module is a character writing interface module that recognizes a character based on a touch movement of the screen, and the first output unit is an image reflecting the movement line of the touch movement or the image Displaying the extracted text, wherein the second output unit may display a second output for sequentially displaying the syllables of the second input in the electronic document based on the second input.

According to an embodiment of the present application, the character interface module further includes a character writing interface module that recognizes a character based on a touch movement of the screen, and when activating the character handwriting interface module, the character pad interface module is deactivated. However, the output displayed by the first output unit may include an image reflecting the moving line of the touch movement or text extracted based on the image.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present application. In addition to the above-described exemplary embodiments, additional embodiments may exist in the drawings and detailed description of the invention.

According to the above-described problem solving means of the present application, by providing an electronic document display method and apparatus for varying input types, it is possible to provide an electronic document that is easy to prepare for each input type and is convenient.

According to the above-described problem solving means of the present application, by providing a method and apparatus for displaying an electronic document in which an input type can be easily converted, it is possible to easily create a document by switching the input type according to the situation.

1 is a schematic diagram showing an electronic document display system that can be input in various forms according to an embodiment of the present application.
2 to 7 are diagrams illustrating outputs of an electronic document display device according to various embodiments of the present disclosure.
8 is a block diagram illustrating an electronic document display device according to an embodiment of the present application.
9 is a flowchart illustrating a method of displaying an electronic document according to an embodiment of the present application.

Hereinafter, exemplary embodiments of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present application. However, the present application may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts not related to the description are omitted in order to clearly describe the present application, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the present specification, when a part is said to be "connected" with another part, it is not only "directly connected", but also "electrically connected" or "indirectly connected" with another element interposed therebetween. "Including the case.

Throughout this specification, when a member is positioned "on", "upper", "upper", "under", "lower", and "lower" of another member, this means that a member is located on another member. It includes not only the case where they are in contact but also the case where another member exists between the two members.

Throughout the specification of the present application, when a certain part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

Hereinafter, an electronic document display apparatus and method of the present application will be described with reference to FIGS. 1 to 9.

1 is a schematic diagram showing an electronic document display system that can be input in various forms according to an embodiment of the present application. Referring to FIG. 1, an electronic document display system capable of inputting in various forms may include an electronic document display device 1. The electronic document display device 1 may receive various types of input from a user. Various types of input may be, for example, voice input, handwriting input, gesture/touch input, but are not limited thereto.

The electronic document display device 1 includes a microphone to receive various types of input, and may additionally include a touch screen, a touch pad, a touch pen, a keyboard, and a mouse.

The electronic document display device 1 may represent an electronic document stored in the electronic document display device 1. In addition, although not shown in FIG. 1, an electronic document stored in a document creation server may be received and displayed. The document creation server stores various types of documents, and can store the platform, form, and image of the document. In the present specification, the document creation server may be expressed differently as an external server.

The electronic document display device 1 and the document creation server may be connected through a network. The network refers to a connection structure in which information exchange is possible between respective nodes such as terminals and servers, and examples of such networks include a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) network, 5G network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), wifi network , A Bluetooth network, a satellite broadcasting network, an analog broadcasting network, and a Digital Multimedia Broadcasting (DMB) network, but are not limited thereto.

The electronic document display device 1 may receive a request to display an electronic document from a user. The method of receiving the request may be a method of receiving packet data, text data, graphic data, or voice data. The voice data is based on the user's utterance, and may be a word such as "Open a new transaction application" or "Open a report created yesterday". The electronic document display device 1 may be linked with a natural language processing device that recognizes the user's intention through natural language processing on the user's utterance in order to determine an electronic document template to be created by the user based on the user's utterance.

The electronic document display device 1 may display an electronic document on a screen by using electronic document data. The electronic document display device 1 may display a corresponding electronic document according to a user's request. The electronic document may be stored in the electronic document storage server or the electronic document display device 1. The electronic document display device 1 may display the electronic document on a screen by editing electronic document data. The electronic document display device 1 may determine a data range to be used for editing according to the specification, resolution, and the like of the electronic document display device 1. The electronic document display device 1 may edit the electronic document data after determining the data range. Alternatively, the edited electronic document may be provided from the server.

The electronic document display device 1 may display a plurality of identifiers corresponding to a plurality of interface modules on a screen. The interface module may refer to a module in charge of inputting and outputting an electronic document, and the identifier may refer to an icon corresponding to each interface module. The identifier may have a different shape for each interface module.

The electronic document display device 1 may activate the character interface module when the first identifier is selected by the user. The electronic document display device 1 may display an output on the electronic document based on a first input from a character interface module.

The electronic document display device 1 may activate the voice interface module when the second identifier is selected by the user. In the present specification, speech may be expressed as speech. The electronic document display device 1 may update the output based on a second input from the voice interface module. In this case, the electronic document display device 1 may display a second output for sequentially displaying the syllables of the second input in the electronic document based on the second input. The electronic document display device 1 may output the updated electronic document by voice.

The updated electronic document may be stored in the internal and external servers of the electronic document display device 1.

2 is a diagram illustrating an output of an electronic document display device 1 according to various embodiments of the present disclosure. Specifically, it is a diagram showing an identifier corresponding to an interface module. Referring to FIG. 2A, the electronic document includes a plurality of creation items 11, and the electronic document display device may display the identifiers 21, 22, and 23. The user may select the identifiers 21, 22, and 23 after determining an input type to perform writing on the writing item 11. There may be one or more identifiers 21, 22, and 23 indicated by the electronic document display device. In this case, as a method of making a selection, the selection can be made by touching the identifier or by giving a voice command. Commanding by voice may be that the voice interface identifier 23 is selected through, for example, an utterance of "I will write by voice".

In addition, as an example, the identifier 21 corresponding to the character pad interface module is an icon representing a character pad, the identifier 22 corresponding to the character writing interface module is a pen-shaped icon, and an identifier corresponding to the voice interface module ( 23) may be a microphone-shaped icon, and may be a letter-shaped icon as well as a picture-shaped icon.

The electronic document display device 1 may display a written item to be input by a user to be differentiated from other written items. For example, when a user loads a new electronic document, a border of the first item to be created in the electronic document may be displayed with a red line. Alternatively, when the user touches the first item to be written in the electronic document, the border of the first item to be written may be displayed with a red line.

Referring to FIG. 2B, when one of the plurality of identifiers 21, 22, and 23 is selected, the remaining identifiers may be continuously displayed on the screen. For example, when the voice interface identifier 23 is selected, the character pad interface identifier 21 and the text handwriting interface identifier 22 that are not selected may be displayed on a part of the screen.

3 is a diagram illustrating an output of an electronic document display device according to various embodiments of the present disclosure. Specifically, it is a diagram illustrating an input interface module and a writing method according to various embodiments of the present disclosure.

According to an exemplary embodiment of the present disclosure, the character interface module may be a character pad interface module including at least one phoneme as an element of the character pad. In this case, the electronic document display device may display a first output to sequentially display the phonemes in the electronic document based on the first input.

Referring to FIG. 3A, when the user selects the character pad interface identifier 21, the character pad interface module may be activated. Input for the creation item 11 may be received through the character pad interface module. Phonemes input from the character pad interface module may be sequentially written in the writing items 11 and output.

The electronic document display device 1 includes an identifier for converting a current item to the next item and a previous item in the character pad interface module, and the user can move to the next item 11 by touching the next item identifier. Alternatively, it is possible to return to the previous item 11 by touching the previous item identifier.

When receiving a specific spoken language, the electronic document display device 1 may activate a voice interface module and perform an operation registered in the specific spoken word. For example, when the spoken word "next" is stored to perform an action to move to the next writing item, and when the spoken word "next" is received, the voice interface module is activated and the voice interface module in the character pad interface module Can be converted to You can also move on to the next item. After performing the above operation, the voice interface module may be deactivated again.

Referring to FIG. 3B, when the user selects the voice interface identifier 23, the voice interface module may be activated. When the voice interface module is activated, the voice guidance module may be activated. The voice guidance module may generate a question for inducing a user's response to create an electronic document and output the generated question as a voice.

The voice interface module may include an interactive module. The interactive module may generate and output an interactive question necessary for creating an electronic document from a user, and extract data necessary for creating an electronic document from the user's voice input.

The interactive question means receiving an answer corresponding to the first question from a user and generating a second question for the answer, and the subsequent question and the answer are correlated so that the document can be written smoothly.

For example, when the first item 11 to be written is an item in which'name or company name' is written, the voice guidance module may voice guidance by saying, "Please tell us what you want to input in your name or company name." In this case, the user may utter "Hong Gil-dong" as an input for "name or company name". The electronic document display device may convert the syllable recognized for the utterance “Hong Gil-dong” into text in the writing item 11 corresponding to the “name or company name”, and display the converted text.

The electronic document display device 1 may receive an input as a command for performing an operation on a specific spoken word. In this case, the electronic document display device 1 may not recognize the specific spoken word as input data to be written in the creation item, but recognize the spoken word for performing an operation. For example, when voice data "intermediate storage of the contents so far" is received from the user, the user's speech is analyzed and the input of "intermediate storage" among the spoken words may be received as a command for document storage.

When an identifier for the voice guide module is selected, the voice guide module can be deactivated. Alternatively, the voice guidance module may be deactivated by receiving a speech command for deactivation of the voice guidance module. In addition, when the voice guide module is deactivated, the voice guide module may be activated when an identifier for the voice guide module is selected.

When the voice interface module is activated, there may be a plurality of identifiers corresponding to the activation of the voice interface module. Specifically, an identifier when a voice input is received from a user may be different from an identifier when a user is in standby without receiving a voice input. By subdividing the identifier for the voice interface module, the user can check the current input/output status of the electronic document display device 1. That is, by displaying the identifier when receiving the voice input, the user can recognize that the current user's utterance content is properly inputted to the electronic document display device 1. In addition, by displaying an identifier while waiting without receiving a voice input, the user can confirm that the voice interface module is continuously activated.

At this time, if the waiting time without receiving a voice input exceeds a preset time, the voice interface module may be deactivated. For example, if the waiting time without receiving a voice input exceeds a preset time of 10 seconds, the voice interface module may be deactivated.

The voice interface module may be deactivated when the second input is not received for a predetermined period of time, and the text interface module may be activated. The voice interface module may include an interactive module.

4 is a diagram illustrating an output of an electronic document display device according to various embodiments of the present disclosure. Specifically, a diagram illustrating a text-writing interface module and a writing method of the electronic document display device 1 according to various embodiments of the present disclosure.

According to an exemplary embodiment of the present disclosure, the character interface module may further include a character writing interface module that recognizes characters based on a touch movement of a screen. The text interface module may be a text writing interface module that recognizes text based on a touch movement of the screen. In this case, the electronic document display device may display an image in which the moving line of the touch movement is reflected or text extracted based on the image.

Referring to FIG. 4A, when a text-writing interface identifier is selected, a text-writing interface module is activated so that a user can input handwriting. The user can select the thickness, type, and color of the handwriting line for handwriting input. For example, the type of the writing line may indicate the texture of a highlighter pen, a pencil, or a sign pen. In this case, an area for selecting the thickness, type, and color of the handwriting line for handwriting input may be located at the top of the electronic document.

The input tool used for handwriting input may be, for example, a touch pen or a part of a body, but is not limited thereto. In addition, the touch method for the handwriting input may be a touch method using a resistive film (pressure sensitive type), a capacitance (capacitive type), an infrared ray, and an ultrasonic wave, but is not limited thereto.

The electronic document display device 1 may deactivate the character pad interface module when activating the character writing interface module. While the electronic document display device 1 is activating the text-writing interface module, the user can easily switch the input interface by continuously exposing the text-written interface identifier and the voice interface identifier on a portion of the screen.

Referring to FIG. 4B, a user can perform a handwriting input for a written item by making a touch movement on the screen of the electronic document display device 1. The electronic document display device may recognize characters based on touch movement.

For example, when the user inputs the letter'Hong' by making a touch movement, the electronic document display device 1 may recognize the letter'Hong' by using the letter shape and handwriting order of the handwritten'Hong'. I can. An element necessary for recognizing a character is not limited to a character type and a handwriting order, and may be a coordinate of a touched position.

For example, when the touch method of the electronic document display device 1 is a capacitive type, a character may be recognized by calculating coordinates for a user's touch movement.

The electronic document display device 1 may display an image itself reflecting a moving line of a touch movement. In other words, it is possible to display the image as it is without extracting the character handwritten by the user as text. For example, when the created item is an item related to a signature, the user's signature may be received and displayed in the form of an image.

In addition, the written item may be written in O/X format, written in a manner of checking a V-shape, or a form in which a matching answer is selected from among answer types preset for each item, but is not limited thereto.

When the extracted text is uncertain, the electronic document display device 1 may activate a character pad interface module or a voice interface module to additionally receive input for the uncertain text. For example, if the user inputs'yes' using the text handwriting interface module, but the candidates for letters recognized by the electronic document display device are'yes' and'b', the user may receive the text pad interface module and Text can be input again through the voice interface module. In addition, as in the above situation, for handwriting input with multiple candidates, a notification window to be selected from among text candidates may be output or a question may be asked for a character by voice. Alternatively, it is possible to receive the input again by making a text writing request to the user.

5 is a diagram illustrating an output of an electronic document display device according to various embodiments. Specifically, it is a diagram showing a method of erasing a handwriting input when the text-writing interface module is activated.

Referring to FIG. 5, the image or text created by a handwriting input may be one in which the image or text is deleted by additionally receiving a touch movement of a preset screen on the image or text. The preset touch movement of the screen may be, for example, drawing a line in a zigzag shape on an image or text input by handwriting, or drawing a line in a straight line.The image or text input in the writing item is deleted by the touch movement as described above. After that, you can perform handwriting input again.

In addition, deletion of an image or text may be performed by selecting an identifier corresponding to the deletion, for example, an eraser icon, among the text handwriting interface modules. Specifically, it can be deleted by selecting the eraser icon and touching the border of the created item, by touching the image or text to be deleted in a zigzag form, by touching the text shape, or by touching the image.

Or, you can delete the image or text with a voice command. For example, if'delete' is registered as a specific spoken word that activates the voice interface module, the user uses the text interface module, and then the voice interface module is activated and inputted through the utterance of "delete the Erase word". After deleting the existing Erase word, the textwriting interface module may be activated again.

6 is a diagram illustrating an output of an electronic document display device according to various embodiments of the present disclosure. Specifically, it is a diagram of a simple mode that allows easy creation of an electronic document.

As described above, referring to FIG. 2, the electronic document may include a plurality of creation items. The electronic document display device 1 may divide a plurality of creation items into at least one group.

For example, 10 writing items can be divided into 5 groups. Each group can contain 2 entries. Alternatively, the number of items to be written in each group may be different. Specifically, the first to third groups may have two items, the fourth group may have three items, and the fifth group may have one item. In this case, the criteria for dividing each group may be the order of writing, the relationship between the items to be written, and the like, but are not limited thereto.

When the user selects the simple mode, the electronic document display device 1 may display one group on one page of the electronic document. The method of selecting the simple mode can be selected by touching an icon for the simple mode or by making a utterance commanding conversion to the simple mode. The utterance may be, for example, "switch to simple mode" or "show electronic document easily".

Referring to FIG. 6A, the electronic document display device 1 may represent a group including one item to be created on a page. When an electronic document is displayed in a simple mode, the electronic document display device 1 may output icons indicating initialization, previous, and next at the bottom of each created item. Alternatively, icons for initialization, previous, and next can be displayed at the bottom of each page. When the user selects the initialization icon, the input for all items to be created can be initialized by deleting the input for the entire document. Alternatively, it may be that the user deletes the input of one page, not the entire document. Alternatively, it may be to delete the input of one creation item.

In addition, when the user selects the previous or next identifier, the page may be switched to the previous page or the next page, or the currently created item may be switched to the previous or next item.

When the user selects the voice interface identifier in the simple mode to activate the voice interface module, the remaining identifiers 21 and 22 may be displayed on a part of the screen.

Referring to FIG. 6B, the electronic document display device may represent a group including two items to be written on one page.

The electronic document display device 1 includes whether or not to write an item to be written, and when receiving an input for a request to write an item that has not been written among items to be written, the electronic document display device 1 may move a page to an item that is not written.

7 is a diagram illustrating an output of an electronic document display device according to various embodiments of the present disclosure. Specifically, it is a diagram showing the electronic document display device 1 that outputs including whether or not to create an electronic document creation item and a simple mode.

Referring to FIG. 7A, the electronic document display device 1 may display each creation item including whether or not to write. In the present specification, whether to write or not may be expressed differently as whether to input. The name of each item to be written can be listed in one column, and whether or not to be written for each item to be written can be indicated in a side-by-side column. Columns listing items and whether they are created or not can be listed as multiple columns.

Whether or not to write each item can be indicated by symbols such as V/X/O. For example, an unwritten item may be expressed as X, and a completed item may be expressed as V or O. In addition, items currently being entered can be marked with a red dot next to the item.

If you receive a request to write an unwritten item, you can move the page to the unwritten item.

Referring to FIG. 7B, the electronic document display device 1 may output a page including whether or not a creation item is input and a creation item currently being created. For example, on the left side of the screen, whether to input the creation item is output, and on the right side of the screen, a page including the creation item currently being created may be output. In this case, the user selects an item to be created on the left screen, and the electronic document display device 1 may output a page including the item selected by the user on the right screen.

The electronic document display device 1 may activate a voice interface module by receiving a specific spoken word to perform an operation on the spoken word. When a user utters "next" after inputting, for example, a written item for a name, the electronic document display device may output the next written item, the date of birth, on the right screen. At this time, whether or not to write the name can be changed from X to V.

The electronic document display device 1 may divide the creation item into a required item and an optional item. Mandatory items may mean items that must be completed in order to complete an electronic document. When the user selects the next item to be created without entering the required item, the electronic document display device 1 may make a request to write the required item. The creation request may be in the form of a notification window or a notification sound. Alternatively, the electronic document display device may request to fill out essential items that have not been prepared after completing the preparation up to the last item.

8 is a block diagram illustrating an electronic document display device according to an embodiment of the present application.

Referring to FIG. 8, an electronic document display device 1 according to an embodiment of the present disclosure includes an electronic document display unit 10, an identifier display unit 20, a character pad activation unit 30, a first output unit 40, A voice activation unit 50 and a second output unit 60 may be included.

The electronic document display device 1 may receive a request to display an electronic document from a user. The method of receiving the request may be a method of receiving packet data or voice data. The voice data is based on the user's utterance, and may be a word such as "Open a new transaction application" or "Open a report created yesterday". The electronic document display device 1 may be linked with a natural language processing device that recognizes the user's intention through natural language processing on the user's utterance in order to determine an electronic document template to be created by the user based on the user's utterance.

The electronic document display unit 10 may display an electronic document on a screen using electronic document data. Specifically, the electronic document display device 1 may display a corresponding electronic document according to a user's request. The electronic document may be stored in the electronic document storage server or the electronic document display device 1. The electronic document display device 1 may display the electronic document on a screen by editing electronic document data. The electronic document display device 1 may determine a data range to be used for editing according to the specification, resolution, and the like of the electronic document display device 1. The electronic document display device 1 may edit the electronic document data after determining the data range. Alternatively, the edited electronic document may be provided from the server.

In this case, the electronic document may include a plurality of creation items. The electronic document display unit 10 may divide a plurality of creation items into at least one or more groups. You can edit the original electronic document so that one group is displayed on one page.

The identifier display unit 20 may display a plurality of identifiers corresponding to a plurality of interface modules on the screen. The interface module may refer to a module in charge of inputting and outputting an electronic document, and the identifier may refer to an icon corresponding to each interface module. The identifier may have a different shape for each interface module. For example, the icon may be in the form of a picture or text, but is not limited thereto. Also, the identifier may be in the form of a voice describing each interface module.

The character pad activation unit 30 may activate the character pad interface module when the first identifier is selected by the user. The character interface module may be a character pad interface module including at least one phoneme as an element of the character pad. Alternatively, the text interface module may be a text writing interface module that recognizes text based on a touch movement of the screen. In this case, when activating the character writing interface module, the character pad interface module may be deactivated. The first identifier may be an icon in the form of a keyboard picture or a pen picture, but is not limited thereto.

The first output unit 40 may display an output on the electronic document based on a first input from the character pad interface module. When the character interface module is a character pad interface module including at least one phoneme as an element of a character pad, the first output unit 40 allows the phonemes to appear sequentially in the electronic document based on a first input. The first output can be displayed.

Alternatively, the first output unit 40, when the character interface module is a character writing interface module that recognizes a character based on the touch movement of the screen, the image reflecting the movement line of the touch movement or the extracted text based on the image. Can be displayed. In this case, the image or text may be one in which the image or text is deleted by additionally receiving a touch movement of a preset screen on the image or text.

In this case, when the image in which the moving line of the touch movement is reflected or the text extracted based on the image is unclear, the character pad interface module or the voice interface module may be activated to receive additional input for the uncertain text.

The voice activation unit 50 may activate the voice interface module when the second identifier is selected by the user. When receiving a specific spoken word, a voice interface module may be activated and an operation registered in the specific spoken word may be performed. In addition, when the second input is not received for a certain period of time, it is deactivated, and the character interface module may be activated. In this case, the character interface module may be one of a character pad interface module and a character writing interface module. Alternatively, one of a character pad interface module or a character writing interface module may be provided, and the other may be displayed as a deactivated identifier, and when a deactivated identifier is selected by the user, the interface module may be switched.

The voice interface module may include an interactive module. The interactive module may generate and output an interactive question necessary for creating an electronic document from a user, and extract data necessary for creating an electronic document from the user's voice input.

The interactive question means receiving an answer corresponding to the first question from a user and generating a second question for the answer, and the subsequent question and the answer are correlated so that the document can be written smoothly.

The second output unit 60 may update the output based on a second input from the voice interface module. The electronic document output from the second output unit 60 may include whether or not to create a creation item. In the case of receiving a request input for an unwritten item among the items to be written, the step of moving a page to the unwritten item may be included.

9 is a flowchart illustrating a method of displaying an electronic document according to an embodiment of the present application.

Referring to FIG. 9, displaying an electronic document on a screen using electronic document data (S100), displaying a plurality of identifiers corresponding to a plurality of interface modules on the screen (S200), and a first identifier from a user If selected, activating a text interface module (S300), displaying an output on the electronic document based on a first input from the text interface module (S400), and when a second identifier is selected by the user, the voice interface module Activating (S500), updating the output based on a second input from the voice interface module (S600).

In step S100, the electronic document may include a plurality of creation items. The creation items may be divided into at least one or more groups. You can edit the original electronic document so that one group is displayed on one page.

In step S200, the interface module may refer to a module responsible for inputting and outputting an electronic document, and the identifier may refer to an icon corresponding to each interface module. The identifier may have a different shape for each interface module. For example, the icon may be in the form of a picture or text, but is not limited thereto. Also, the identifier may be in the form of a voice describing each interface module.

In step S300, the character interface module may be a character pad interface module including at least one phoneme as an element of the character pad. Alternatively, the text interface module may be a text writing interface module that recognizes text based on a touch movement of the screen. In this case, when activating the character writing interface module, the character pad interface module may be deactivated.

In step S400, if the character interface module is a character pad interface module including at least one phoneme as an element of the character pad, a first output is displayed to sequentially display the phonemes in the electronic document based on the first input. can do. Alternatively, when the character interface module is a character writing interface module that recognizes characters based on the touch movement of the screen, an image reflecting the movement line of the touch movement or the text extracted based on the image may be displayed. In this case, the image or text may be one in which the image or text is deleted by additionally receiving a touch movement of a preset screen on the image or text.

In this case, when the image in which the moving line of the touch movement is reflected or the text extracted based on the image is unclear, the character pad interface module or the voice interface module may be activated to receive additional input for the uncertain text.

When receiving a specific spoken word in S500, a voice interface module may be activated and an operation registered in the specific spoken word may be performed. In addition, when the second input is not received for a certain period of time, it is deactivated, and the character interface module may be activated. In this case, the character interface module may be one of a character pad interface module and a character writing interface module. Alternatively, one of a character pad interface module or a character writing interface module may be provided, and the other may be displayed as a deactivated identifier, and when a deactivated identifier is selected by the user, the interface module may be switched.

The voice interface module may include an interactive module. The interactive module may generate and output a question necessary for creating an electronic document from a user, and extract data necessary for creating an electronic document from the user's voice input.

It may include whether to write items to be written in S600. In the case of receiving a request input for an unwritten item among the items to be written, the step of moving a page to the unwritten item may be included.

In the above description, steps S100 to S600 may be further divided into additional steps or may be combined into fewer steps, according to an exemplary embodiment of the present disclosure. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

The electronic document display method according to the exemplary embodiment of the present disclosure may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like. The above-described hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

In addition, the above-described electronic document display method may be implemented in the form of a computer program or application executed by a computer stored in a recording medium.

The foregoing description of the present application is for illustrative purposes only, and those of ordinary skill in the art to which the present application pertains will be able to understand that it is possible to easily transform it into other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present application is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present application.

1: electronic document display device
10: electronic document display unit
11: Filling Items
20: identifier display
21: character pad interface identifier
22: handwritten interface identifier
23: voice interface identifier
30: character pad activation unit
40: first output unit
50: voice activation unit
60: second output unit

Claims (16)

In the electronic document display method,
Displaying an electronic document on a screen using the electronic document data;
Displaying a plurality of identifiers corresponding to a plurality of interface modules on the screen;
Activating the character interface module when the first identifier is selected by the user;
Displaying an output on the electronic document based on a first input from the character interface module;
Activating the voice interface module when the second identifier is selected by the user; And
And updating the output based on a second input from the voice interface module. The method of claim 1,
The character interface module is a character pad interface module including at least one phoneme as an element of a character pad,
Displaying the output on the electronic document based on the first input includes displaying a first output to sequentially display the phonemes in the electronic document based on the first input,
The updating of the output based on the second input is a step of displaying a second output to sequentially display the syllables of the second input in the electronic document based on the second input. . The method of claim 1,
The text interface module is a text writing interface module for recognizing text based on a touch movement of the screen,
Displaying the output on the electronic document based on the first input includes displaying an image in which the moving line of the touch movement is reflected or text extracted based on the image,
The updating of the output based on the second input is a step of displaying a second output to sequentially display the syllables of the second input in the electronic document based on the second input. . The method of claim 2,
The text interface module further includes a text writing interface module for recognizing text based on the touch movement of the screen,
In the case of activating the character writing interface module, deactivating the character pad interface module,
The displaying of the output on the electronic document based on the first input includes displaying an image reflecting the moving line of the touch movement or text extracted based on the image. The method of claim 3,
The step of activating the voice interface module,
An electronic document display method for activating a voice interface module when receiving a specific spoken word and performing an operation registered in the specific spoken word. The method of claim 3,
The image or text, wherein the image or text is deleted by additionally receiving a touch movement of a preset screen on the image or text. The method of claim 3,
The electronic document includes a plurality of items to be written,
The displaying of the electronic document is a step of dividing the creation items into at least one or more groups so that one group is displayed on one page. The method of claim 7,
Updating the output,
The electronic document display method comprising the step of moving a page to the unwritten item, including whether or not to create the item to be written, and when receiving an input for a request to write an item that has not been written among the items to be written. The method of claim 4,
Displaying the text extracted based on the image,
When the extracted text is uncertain, the character pad interface module or the voice interface module is activated to receive additional input for the uncertain text. The method of claim 4,
The voice interface module,
When the second input is not received for a certain period of time, it is deactivated, and the text interface module is activated. The method of claim 10,
The voice interface module includes an interactive module. In the electronic document display device,
An electronic document display unit that displays an electronic document on a screen by using the electronic document data;
An identifier display unit for displaying a plurality of identifiers corresponding to a plurality of interface modules on the screen;
A character pad activation unit activating a character pad interface module when a first identifier is selected by a user;
A first output unit configured to display an output on the electronic document based on a first input from the character pad interface module;
A voice activation unit that activates a voice interface module when a second identifier is selected by a user; And
An electronic document display device comprising a second output unit that updates the output based on a second input from the voice interface module. The method of claim 12,
The character interface module is a character pad interface module including at least one phoneme as an element of a character pad,
The first output unit displays a first output for sequentially appearing the phonemes in the electronic document based on the first input,
Wherein the second output unit displays a second output to sequentially display syllables of the second input in the electronic document based on the second input. The method of claim 12,
The text interface module is a text writing interface module for recognizing text based on a touch movement of the screen,
The first output unit is a step of displaying an image in which the moving line of the touch movement is reflected or text extracted based on the image,
The second output unit displays a second output for sequentially displaying the syllables of the second input in the electronic document based on the second input. The method of claim 13,
The text interface module further includes a text writing interface module for recognizing text based on the touch movement of the screen,
In the case of activating the character writing interface module, deactivating the character pad interface module,
The output displayed by the first output unit includes an image reflecting the moving line of the touch movement or text extracted based on the image. In the electronic document display device,
A computer-readable recording medium storing a program for executing the method of claim 1 on a computer.

Images