KR20200114357A - Method and apparatus for providing electronic document data through speaker identification - Google Patents

Abstract

Provided is a method for providing electronic document data, which comprises the steps of: receiving voice data of a speaker from an electronic document consuming device; identifying the speaker based on the voice data; generating electronic document data; updating the electronic document data so that the voice data is reflected in a first part of the electronic document when the speaker is a first user as a result of the identification, and updating the electronic document data so that the voice data is reflected in a second part of the electronic document when the speaker is a second user as a result of the identification; and transmitting the update result to the electronic document consuming device.

Description

Method and apparatus for providing electronic document data through speaker identification {METHOD AND APPARATUS FOR PROVIDING ELECTRONIC DOCUMENT DATA THROUGH SPEAKER IDENTIFICATION}

The present application relates to a method and apparatus for providing electronic document data through speaker identification.

In the case of smartphones or wearable devices, in most cases, one user uses a personal device. However, in the case of an artificial intelligence/smart speaker, it is often installed in a designated place so that a number of users use one device in common.

In creating an electronic document, since many users are often provided with services through a single artificial intelligence/smart speaker, it is necessary to provide electronic document data suitable for the user's role.

In particular, in the case of electronic document approval and request, since the content or form of the document varies according to the user's role, it is necessary to identify who the user is and provide electronic document data appropriate to the user.

The technology behind the present application is disclosed in Korean Patent Publication No. 10-1705228.

The present application is to solve the above-described problems of the prior art, and an object of the present invention is to identify a speaker who is speaking to a device, and to provide electronic document data corresponding to the role of the speaker.

However, the technical problem to be achieved by the embodiments of the present application is not limited to the technical problems as described above, and other technical problems may exist.

However, the technical problem to be achieved by the embodiments of the present application is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, an electronic document data providing method according to an embodiment of the present application includes the steps of receiving voice data of a talker from an electronic document consuming device, and identifying the talker based on the voice data. Generating electronic document data, updating the electronic document data so that the voice data is reflected in the first part of the electronic document when the speaker is a first user as a result of the identification, 2 If the user is a user, updating the electronic document data so that the voice data is reflected in the second part of the electronic document, and transmitting the update result to the electronic document consuming device.

According to an embodiment of the present application, the step of identifying the talker based on the voice data includes storing the plurality of user information, determining whether the talker is a user stored in the user information, the determination result According to the method, the voice data may be analyzed to identify information of the talker.

According to an embodiment of the present application, the user information stores personal information and group information including a position in a group to which the user belongs, and the step of identifying the talker comprises: the talker is a first user based on the position It may further include the step of determining authority information for distinguishing whether the user is the second user.

According to an exemplary embodiment of the present disclosure, when the talker is the first user as a result of determining the authorization information, the electronic document data may be updated by processing security data in a range accessible to the second user.

According to an embodiment of the present application, a boilerplate that is frequently input by a user is included, and the updating of the electronic document data may include replacing and updating the utterance content related to the boilerplate with the stored boilerplate. .

According to the exemplary embodiment of the present application, the user information may be updated based on the content spoken by the talker, classified based on the personal information and group information, and reflected in the boilerplate for each user.

According to an embodiment of the present application, the generating of the electronic document data includes storing a plurality of templates for each type of electronic document, and if there is an electronic document previously stored by the user, the corresponding electronic document is loaded and stored. If there is no electronic document, a new electronic document may be generated by applying the template according to a user request.

According to an embodiment of the present application, the first user includes a payer, and the update result is a list of electronic documents waiting to be processed for approval among the updated electronic documents, or a payment request to the first user. It may contain a list of requested payment requesters.

According to an embodiment of the present application, the step of receiving the voice data of the talker from the electronic document consuming device may be receiving an interactive input for the electronic document data from the talker in the form of voice data, text data, and packet data. .

As a technical means for achieving the above technical problem, an electronic document data providing apparatus according to an embodiment of the present application includes a talker voice receiver for receiving voice data of a talker from an electronic document consuming device, and the talker based on the voice data. A talker identification unit for identifying a, an electronic document data generation unit for generating electronic document data, and updating the electronic document data so that the voice data is reflected in a first portion of the electronic document when the identification result is the first user , An electronic document update unit for updating the electronic document data so that the voice data is reflected in a second portion of the electronic document when the identification result is the second user, and an electronic document transmitting the update result to the electronic document consuming device It may include a document result transmission unit.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present application. In addition to the above-described exemplary embodiments, additional embodiments may exist in the drawings and detailed description of the invention.

According to the above-described problem solving means of the present application, by identifying a talker and providing electronic document data, even a single device can provide electronic document data according to the roles of multiple users.

1 is a schematic diagram of a system for providing electronic document data according to an embodiment of the present application.
FIG. 2 is a diagram illustrating provision of electronic document data to which an individual boilerplate is applied by an electronic document data providing device according to an embodiment of the present application.
3 is a diagram illustrating provision of electronic document data according to a user request by an electronic document data providing apparatus according to an exemplary embodiment of the present disclosure.
4 is a flowchart illustrating a method of providing electronic document data according to an embodiment of the present application.
5 is a flowchart illustrating a method of identifying a talker according to an embodiment of the present disclosure.

Hereinafter, exemplary embodiments of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present application. However, the present application may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts not related to the description are omitted in order to clearly describe the present application, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the present specification, when a part is said to be "connected" with another part, it is not only "directly connected", but also "electrically connected" or "indirectly connected" with another element interposed therebetween. "Including the case.

Throughout this specification, when a member is positioned "on", "upper", "upper", "under", "lower", and "lower" of another member, this means that a member is located on another member. It includes not only the case where they are in contact but also the case where another member exists between the two members.

Throughout the specification of the present application, when a certain part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

Hereinafter, the electronic document data providing system 10 of the present application will be described with reference to FIGS. 1 to 5.

1 is a schematic diagram of a system for providing electronic document data according to an embodiment of the present application. Referring to FIG. 1, the electronic document data providing system 10 may include an electronic document consuming device 200 and an electronic document data providing device 100. In this specification, the electronic document consuming device 200 may be differently expressed as a user terminal.

The electronic document consuming device 200 receives a user input, requests the electronic document data providing device 100 to process the user input based on the user input, and sends the user input from the electronic document data providing device 100 You can receive the result of processing the input.

For example, the electronic document consuming device 200 includes a smartwatch, an artificial intelligence speaker, a smartphone, a smart pad, a tablet PC, and a personal communication system (PCS), a global system for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W- Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminals, and wired communication devices such as desktop computers and smart TVs.

In particular, the electronic document consuming device 200 is newly created such as a smart speaker, a smart car, a smart appliance, a wearable device, an augmented reality device (VR/MR), etc. May include various sound devices, driving devices, etc. using various communication technologies.

In addition, as an example, the electronic document consuming device 200 may include a voice recognition terminal capable of recognizing a user's voice and an interactive terminal through which the user can input the user input sentence through a separate input device. have.

In this case, the electronic document consuming device 200 may include an electronic document consuming application. The electronic document consuming application is installed on a device in connection with a document creation service, and may be executed according to a user request.

The electronic document data providing apparatus 100 is an electronic document consuming device 200, more specifically, a server device of a service provider providing an electronic document creation service in connection with an electronic document consuming application, and identifying a speaker to provide electronic document data. It can be provided differently.

The electronic document consuming device 200 and the electronic document data providing device 100 may communicate (transmitting/receiving a processing request and transmitting/receiving a processing result) through a network connected to each other.

The network refers to a wired and wireless connection structure capable of exchanging information between the electronic document consuming device 200 and the electronic document data providing device 100, and illustratively, 3GPP (3rd Generation Partnership Project) network, LTE (Long Term Evolution) network, 5G network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area) Network), a Bluetooth network, a satellite broadcasting network, an analog broadcasting network, a Digital Multimedia Broadcasting (DMB) network, and the like, but are not limited thereto.

According to the exemplary embodiment of the present disclosure, the electronic document data providing apparatus 100 may provide different forms of the electronic document according to the speaker. In other words, it is possible to identify the speaker and provide a different form of the electronic document according to the role and authority of the speaker. In this case, the talker may mean a user who is talking on the electronic document consuming device 200 among a plurality of users.

Multiple users may have different rights to electronic documents according to their position and role within the company. For example, an employee can classify the authority as an approval requester and a manager as an approver. Also, even in the same position, the authority can be classified differently according to the job. The position and role may be, but is not limited to, an applicant intermediate processor, an approver, or a receiver.

The electronic document data providing apparatus 100 includes a speaker voice receiving unit 110, a speaker identification unit 120, an electronic document data generation unit 130, an electronic document update unit 140, and an electronic document result transmission unit 150. can do.

The talker's voice receiving unit 110 may receive voice data of the talker from the electronic document consuming device 200. Additionally, it may receive interactive input in the form of text data and packet data in addition to voice data.

The talker's voice receiver 110 may recognize a voice uttered by a user and convert it into a text format. To this end, the talker speech receiver 110 may use at least one speech recognition algorithm well known in the art, and a speech-to-text (STT) technique may be used for conversion into the text format. .

The talker identification unit 120 may identify the talker based on the voice data. According to the exemplary embodiment of the present application, the talker identification unit 120 may store a plurality of user information. User information may be stored in a database and updated by receiving user feedback.

The database may receive the user's voice data and match and store authority information, personal information, group information, and the like. Voice data may be received from the electronic document consuming device 200, and the database may be for constructing a user-specific voice model by extracting features of the voice data. Authority information, personal information, and group information may be input from a user.

Also, the talker identification unit 120 may determine whether the talker is a user stored in the user information. It is possible to determine whether or not there is a matching voice model by comparing the voice models of a plurality of users stored in the database with voice data of a talker.

The talker identification unit 120 may analyze the voice data according to the determination result to identify the talker information. When it is determined that the talker is a user stored in the database, information of the talker may be identified based on information that is matched with voice data and stored in the database.

On the other hand, when it is determined that the talker is a user who is not stored in the database, information of the talker can be identified by analyzing the contents of the talker. In addition, it is possible to newly register by matching the speech data and analysis content of the talker in the database.

For example, when a talker who is not stored in the user information says "I am a new employee in team A, show me the list of our team", the electronic document data providing device can register the voice data of the talker as a new employee in team A. have.

The user information stores personal information and group information including the position in the group to which the user belongs, and the talker identification unit 120 identifies whether the talker is a first user or a second user based on the position. Can judge.

The personal information may further include a name, age, gender, and a preferred document template in addition to the position, and the group information may include a group name, a group layout, and a group contact network, but is not limited thereto.

In addition, the user information may be classified by determining a common category for a plurality of users. For example, a number of users within the same company may be classified and stored in categories by team. Authority information can be classified according to roles such as applicant, intermediate processor, approver, and receiver. The electronic document data providing apparatus 100 may disclose other contents according to the speaker's authority information.

The electronic document data generation unit 130 may generate electronic document data.

The electronic document data generation unit 130 according to the exemplary embodiment of the present application may store a plurality of templates for each type of electronic document, and if there is an electronic document previously stored by the user, the electronic document is loaded, but there is no stored electronic document. In this case, a new electronic document may be generated by applying the template according to a user request.

For example, a user can request electronic document data related to design A work, and if the user has an electronic document stored related to design A work, the corresponding electronic document can be called.

On the other hand, if there is no electronic document stored in relation to the design A task, a new electronic document can be created by applying an electronic document template applicable to the design task.

The template includes an item arrangement of a document, a graphic, a file format, and the like, and may be combined according to a user request. For example, in relation to the A design task, the user can combine the order and arrangement of items in the document. The user request may be input as voice data.

As a result of the identification, the electronic document update unit 140 updates the electronic document data so that the voice data is reflected in the first part of the electronic document when the speaker is a first user, and as a result of the identification, the speaker is a second user. In this case, the electronic document data may be updated so that the voice data is reflected in the second part of the electronic document.

For example, when the speaker is the approver, voice data of the speaker may be reflected in the payment portion of the electronic document. When the talker, who is the approver, utters "Sign me", the signature of the approver may be signed in the electronic document.

The electronic document updater 140 may interactively ask a question about an electronic document entry item. In the interactive mode, a document may be supplemented by receiving an input for a question from a user and additionally asking a related question for the input or by moving to the next item and asking a question.

Specifically, a question related to the electronic document entry item is transmitted to the electronic document consuming device 200 until the creation of the electronic document is completed (filling in all required entry items has been completed), and the question is responded to. The electronic document can be completed through a conversational method of receiving a user input including a response from a user to be received, analyzing it, and assigning an input value to a corresponding electronic document entry item.

The electronic document updater 140 may change the order of items that are not input by the user and configure them as the last item. If there are a number of items that have not been entered, questions can be asked again by arranging the order so that related items are located. Also, among the input items, items related to the items that are not inputted can be configured together and asked again.

As a result of determining the authority information, the electronic document update unit 140 may be updated by processing security data in a range accessible by the second user when the talker is the first user. The security data processing may be, for example, encryption.

For example, when a first user is an approval requester and a second user is an approver, when the electronic document data providing device provides electronic document data to the first user, the approver signature field may be processed and updated with security data. In this case, the talker may be provided with an electronic document excluding the signature column of the approver.

In addition, the electronic document update unit 140 may update the electronic document data by receiving an input for creating an electronic document as voice data from a user and analyzing the contents of the voice data.

The electronic document update unit 140 uses a speaker recognition technique to reconsider the validity and stability of the processing of the electronic document, and the user who has the processing authority for the electronic document It can be verified again whether the processing has been done.

The electronic document result transmission unit 150 may transmit an update result to the electronic document consuming device 200. Specifically, it may be transmitted through an application of the electronic document consuming device 200.

The electronic document consuming device 200 may transmit an electronic document update result and receive feedback from a user. The content of the feedback may be analyzed and transmitted to the electronic document update unit 140. The electronic document updater 140 may update the electronic document according to the feedback content.

FIG. 2 is a diagram illustrating provision of electronic document data to which an individual boilerplate is applied by an electronic document data providing device according to an embodiment of the present application.

Referring to FIG. 2, the user information includes a boilerplate frequently inputted by a user, and the electronic document update unit 140 may replace and update the utterance content related to the boilerplate with the stored boilerplate.

The boilerplate is stored differently for each user, and the content may be stored differently even with the same word. For example, in the boilerplate of the first user, the home address may be '123 Nonhyeon-ro, Gangnam-gu,' and the end may be'First User Dream'. On the other hand, in the boilerplate of the second user, the home address may be '456 Nonhyeon-ro, Gangnam-gu,' and the end may be'Thank you'.

The boilerplate may be that when a user sets and stores a boilerplate in relation to a specific spoken word, or when the user inputs a spoken word having the same meaning more than a certain number of times, the spoken word is registered as the user's boilerplate.

For example, if the user sets'Thank you' for the spoken word'Closed', the user utters "Please enter the closing" and the phrase'Thank you' can be entered at the end of the electronic document data. have.

When the user inputs the utterance “Thank you in closing” more than a certain number of times, it may be registered as the user's boilerplate. The predetermined number of times may be a number set by the user, and may be, for example, 15 times. The number of times may be set through an application of the electronic document consuming device.

In addition, the user information may be updated based on the content spoken by the talker, classified based on the personal information and group information, and reflected in the boilerplate for each user.

For example, when the user's group information is classified as team A, the boilerplate for the spoken word'our team' in the user's boilerplate may be registered as'team A'. In addition, when "please create a list of people on my team", a list of users classified as group A team in the user information database can be collected and provided as electronic document data.

3 is a diagram illustrating provision of payment document data by an electronic document data providing apparatus according to an embodiment of the present application.

Referring to FIG. 3, the electronic document result transmission unit 150 may transmit an electronic document data list requested by a user to the electronic document consuming device 200.

For example, the first user includes the approver, and the electronic document data update result is a list of electronic documents waiting for approval among the updated electronic documents or requesting approval from the first user when the speaker is the first user. It may include a list of applicants for payment.

Specifically, the electronic document data providing apparatus 100 according to an embodiment of the present application collects documents corresponding to the speaker's authority information, and generates a list of electronic documents requested by the speaker among the documents to consume the electronic document. It can be transmitted to 200.

In addition, it is possible to classify documents that have been processed for work and documents that have not been completed, create a list of document classifications requested by the user, and transmit them to the electronic document consuming device 200.

4 is a flowchart illustrating a method of providing electronic document data by an electronic document data providing apparatus according to an embodiment of the present application.

Referring to FIG. 4, in step S810, voice data of a talker may be received.

Additionally, it may receive interactive input in the form of text data and packet data in addition to voice data.

In step S820, the talker may be identified based on the voice data.

In this case, the electronic document data providing apparatus may store a plurality of user information. User information may be stored in a database and updated by receiving user feedback.

In step S830, electronic document data may be generated. In this case, the electronic document data related to the utterance content may be generated. The generated electronic document data may be updated differently depending on the case where the talker is the first user and the second user.

Step S840 indicates a case where the talker is a first user, and step S850 indicates a case where the talker is a second user.

In step S840, if the speaker is the first user as a result of identification, the electronic document data may be updated so that the voice data is reflected in the first part of the electronic document.

In step S850, when the speaker is a second user as a result of the identification, the electronic document data may be updated so that the voice data is reflected in the second part of the electronic document.

For example, when the speaker is the approver, voice data of the speaker may be reflected in the payment portion of the electronic document. When the talker, who is the approver, utters "Sign me", the signature of the approver may be signed in the electronic document.

In step S860, the update result may be transmitted to the electronic document consuming device. In this case, the electronic document update result may be transmitted and a feedback may be received from the user.

5 is a flowchart illustrating a method of identifying a talker according to an embodiment of the present disclosure.

Referring to FIG. 5, in step S821, a plurality of user information may be stored. User information may be stored in a database and updated by receiving user feedback.

In step S822, it may be determined whether the talker is a user stored in the user information. It is possible to determine whether or not there is a matching voice model by comparing the voice models of a plurality of users stored in the database with voice data of a talker.

In step S823, the information of the talker may be identified by analyzing the voice data according to the determination result. When it is determined that the talker is a user stored in the database, information of the talker may be identified based on information that is matched with voice data and stored in the database. In addition, the content of speech may be updated by matching the user's voice.

On the other hand, when it is determined that the talker is a user who is not stored in the database, information of the talker can be identified by analyzing the contents of the talker. In addition, it is possible to newly register by matching the speech data and analysis content of the talker in the database.

In the above description, steps S810 to S860 may be further divided into additional steps or may be combined into fewer steps, according to an exemplary embodiment of the present disclosure. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

The method of providing electronic document data according to an exemplary embodiment of the present disclosure may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The above-described hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

In addition, the above-described method of providing electronic document data may be implemented in the form of a computer program or application executed by a computer stored in a recording medium.

The foregoing description of the present application is for illustrative purposes only, and those of ordinary skill in the art to which the present application pertains will be able to understand that it is possible to easily transform it into other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present application is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present application.

10: Electronic document data provision system
100: electronic document data providing device
110: talker voice receiver
120: talker identification unit
130: electronic document data generation unit
140: electronic document update unit
150: electronic document result transmission unit
200: electronic document consumption device

Claims (11)

In the method of providing electronic document data,
Receiving voice data of a talker from an electronic document consuming device;
Identifying the talker based on the voice data;
Generating electronic document data;
As a result of the identification, if the talker is the first user, the electronic document data is updated so that the voice data is reflected in the first part of the electronic document. Updating the electronic document data to be reflected in a second part; And
And transmitting the update result to the electronic document consuming device. The method of claim 1,
Identifying the talker based on the voice data,
Storing the plurality of user information;
Determining whether the talker is a user stored in the user information; And
Analyzing voice data according to the determination result to determine information of the talker;
That includes, electronic document data providing method. The method of claim 2,
The user information stores personal information and group information including the position in the group to which the user belongs,
Identifying the talker,
Determining authority information for distinguishing whether the talker is a first user or a second user based on the position,
The electronic document processing method further comprising a. The method of claim 3,
When the user is the first user as a result of determining the authorization information, the electronic document data is updated by processing security data in a range accessible to the second user. The method of claim 3,
The user information,
Includes boilerplate frequently inputted by users,
The step of updating the electronic document data,
Comprising the step of replacing and updating the speech content related to the boilerplate text with the stored boilerplate text. The method of claim 5,
The user information is updated based on the content uttered by the talker, classified based on the personal information and group information, and reflected in the boilerplate for each user. The method of claim 1,
Generating the electronic document data,
Including; storing templates for each type of a plurality of electronic documents,
If there is an electronic document previously stored by the user, the electronic document is called, and if there is no electronic document stored, a new electronic document is generated by applying the template according to the user's request. The method of claim 1,
The first user includes a payer,
The update result is,
When the talker is the first user,
The electronic document data providing method comprising a list of electronic documents waiting for payment processing among the updated electronic documents or a list of payment requestors who have requested the first user for payment. The method of claim 1,
Receiving the voice data of the talker from the electronic document consuming device,
A method of providing electronic document data, receiving an interactive input for electronic document data from a talker in the form of voice data, text data, and packet data. In the electronic document data providing device,
A talker voice receiving unit for receiving voice data of the talker from the electronic document consuming device;
A talker identification unit for identifying the talker based on the voice data;
An electronic document data generator for generating electronic document data;
As a result of the identification, if the talker is the first user, the electronic document data is updated so that the voice data is reflected in the first part of the electronic document. An electronic document update unit for updating the electronic document data to be reflected in a second part; And
Electronic document data providing apparatus comprising an electronic document result transmission unit for transmitting the update result to the electronic document consuming device. A computer-readable recording medium recording a program for executing the method of claim 1 on a computer.

Images