KR20210145536A - Apparatus for managing minutes and method thereof - Google Patents

Abstract

A method and apparatus for managing minutes to map metadata to a word corresponding to a minimum recognition unit are provided. A method for managing minutes according to an embodiment of the present invention is a method performed by a computing device. The method may comprise the steps of: obtaining speech data including speech text; and mapping metadata to key words of the speech text.

Description

METHOD AND APPARATUS FOR MANAGING MINUTES AND METHOD THEREOF

The present invention relates to a method and apparatus for managing meeting minutes. More specifically, it relates to a method and apparatus for mapping metadata to a word corresponding to a minimum recognition unit.

The progress of meetings held at the National Assembly, regional councils, or basic local councils, and texts of speeches, etc. are recorded by the secretary. And, the minutes recorded in this way are generally open to the public.

The conventional method of recording the minutes is written based on the information the clerk hears, so there may be errors, and there are disadvantages in that excessive costs and manpower are consumed. In addition, the conventional method for managing meeting minutes has a problem in that it is difficult for ordinary people with relatively low legal knowledge to intuitively recognize the speaker's intention to speak from the minutes.

Korean Patent No. 10-1618084

SUMMARY The technical problem to be solved by the present invention is to provide a method and an apparatus for managing meeting minutes by mapping metadata to a word corresponding to a minimum recognition unit.

Another technical problem to be solved by the present invention is to provide a method and an apparatus for managing the minutes in an automated manner and capable of easily modifying the minutes.

Another technical problem to be solved by the present invention is to provide a meeting minutes management method and apparatus for providing an interface that can be more intuitively recognized by the general public who reads the meeting minutes.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

Meeting minutes management method according to an embodiment of the present invention for solving the above technical problem, in a method performed by a computing device, the step of obtaining speech data including speech text structured to enable identification of key words , mapping metadata to the key words and generating meeting minutes data using the metadata.

In an embodiment, the obtaining of the speech data includes converting speech-to-text data to speech-to-text (STT) processing, and the metadata includes the STT for the key word. It may contain data related to processing.

In one embodiment, the step of obtaining the speech data includes converting voice data recorded in a conference speech into the speech data and obtaining a conversion accuracy prediction rate of the main word included in the speech data, The metadata may include the obtained conversion accuracy prediction rate, and the generating of the meeting minutes data may include highlighting and displaying an adjustment target word having the conversion accuracy prediction rate equal to or less than a reference value.

In an embodiment, the metadata of the adjustment target word includes recorded voice data corresponding to the main word, and the generating of the meeting minutes data includes the voice included in the metadata of the adjustment target word. It may include the step of reproducing the data.

In one embodiment, the step of reproducing the speech data includes repeatedly performing, for each of the words to be adjusted, reproducing the speech data of the word to be adjusted and obtaining corrected text for the word to be adjusted. may include

In an embodiment, the reproducing of the audio data includes: reproducing the audio data of the adjustment target word for the adjustment target word selected by the user from among the adjustment target words; It may include the step of performing obtaining.

In an embodiment, the metadata includes a time required for pronunciation of the speech corresponding to the main word, and the generating of the meeting minutes data includes highlighting and displaying an accentuated word whose pronunciation required time is equal to or greater than a reference value. may include

In one embodiment, the generating of the meeting minutes data includes receiving a user input and modifying the speech data using the user input, wherein the step of modifying the speech data includes: When added to the utterance text, the method may include mapping metadata of a second word that is a key word closest to the first word to the first word.

In an embodiment, the generating of the meeting minutes data may include visualizing the speech data according to a template referring to the metadata.

In an embodiment, the step of visualizing the speech data may include searching for a first word that satisfies the metadata defined in the first item of the template, and using the first word as a word corresponding to the first item. It may include determining and displaying the first word in a region corresponding to the first item.

In one embodiment, the method further includes a meeting minutes search step of receiving a first keyword input through a search user interface and outputting a search result of the first keyword and a search result of a second keyword mapped to an abbreviation of the first keyword together and the first keyword may be a formal name of the second keyword.

In one embodiment, a meeting minutes search step of receiving a second keyword input through a search user interface and outputting the search result of the second keyword and the search result of the first keyword mapped to the official name of the second keyword is further performed. and the second keyword may be an abbreviation of the first keyword.

In one embodiment, the apparatus for managing meeting minutes includes a processor, a network interface, a memory, and a computer program loaded into the memory and executed by the processor, wherein the computer program is structured to enable identification of key words It may include an instruction for obtaining speech data including the spoken speech text, an instruction for mapping meta data to the key word, and an instruction for generating meeting minutes data using the meta data.

1 is a view for explaining an apparatus for managing meeting minutes according to an embodiment of the present invention.
2 is a flowchart of a meeting minutes management method according to an embodiment of the present invention.
3 is a diagram for explaining metadata mapping that may be referred to in some embodiments of the present invention.
FIG. 4 is a flowchart for explaining in more detail some operations of the method for managing meeting minutes described with reference to FIG. 2 .
FIG. 5 is a flowchart for explaining the operation of the method for managing meeting minutes described with reference to FIG. 4 in more detail.
6 is an exemplary diagram illustrating the method for managing the minutes described with reference to FIG. 5 .
7 is a flowchart for explaining in more detail the operation of the meeting minutes management method described with reference to FIG. 2 .
FIG. 8 is a flowchart for explaining the operation of the method for managing meeting minutes described with reference to FIG. 2 in more detail.
9 is an exemplary diagram illustrating the meeting minutes management method described with reference to FIG. 8 .
FIG. 10 is a flowchart for explaining the operation of the method for managing meeting minutes described with reference to FIG. 2 in more detail.
11 is a flowchart for explaining in more detail the operation of the method for managing meeting minutes described with reference to FIG. 2 .
12 is a diagram for describing an exemplary computing device capable of implementing the apparatus for managing meeting minutes according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the technical spirit of the present invention is not limited to the following embodiments, but may be implemented in various different forms, and only the following embodiments complete the technical spirit of the present invention, and in the technical field to which the present invention belongs It is provided to fully inform those of ordinary skill in the art of the scope of the present invention, and the technical spirit of the present invention is only defined by the scope of the claims.

In adding reference numerals to the components of each drawing, it should be noted that the same components are given the same reference numerals as much as possible even though they are indicated on different drawings. In addition, in describing the present invention, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless clearly defined in particular. The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. As used herein, the singular also includes the plural unless specifically stated otherwise in the phrase.

In addition, in describing the components of the present invention, terms such as first, second, A, B, (a), (b), etc. may be used. These terms are only for distinguishing the components from other components, and the essence, order, or order of the components are not limited by the terms. When a component is described as being “connected”, “coupled” or “connected” to another component, the component may be directly connected or connected to the other component, but another component is between each component. It should be understood that elements may be “connected,” “coupled,” or “connected.”

As used herein, "comprises" and/or "comprising" refers to the presence of one or more other components, steps, operations and/or elements mentioned. or addition is not excluded.

Prior to the description of the present specification, some terms used in the present specification will be clarified.

In the present specification, a conference is a procedure in which two or more participants exchange opinions and information and make decisions on one or more proposed agendas. The meeting according to an embodiment of the present invention may include, but is not limited to, a plenary session, the Legislative and Judiciary Committee, the relevant committee, a special committee, a standing committee, administrative affairs audit and investigation, state audit and investigation, and the like. In addition, the participants of the meeting according to an embodiment of the present invention may include, but is not limited to, a chairperson or a chairperson, a member of the council or a member of the committee.

Minutes are documents in which the progress of the meeting, speech texts of meeting participants, or meeting results are recorded. In the meeting minutes according to an embodiment of the present invention, the progress of the meeting, the speech text, or the meeting result may be recorded as text, but the present invention is not limited thereto.

Hereinafter, some embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining an apparatus 300 for managing meeting minutes according to an embodiment of the present invention. Each component of the meeting minutes management system disclosed in FIG. 1 represents functional elements that are functionally separated, and any one or more components may be implemented by being integrated with each other in an actual physical environment.

1, the meeting minutes management system according to an embodiment of the present invention includes a meeting recording device 100, a log management server 200, a meeting minutes management device 300, and meeting minutes viewing devices 400a, 400b, 400c or less; 400) may be included for convenience of description. Hereinafter, each component will be described in detail.

The meeting recording apparatus 100 may generate data regarding the meeting minutes and transmit the data to the meeting minutes management apparatus 300 . More specifically, the conference recording apparatus 100 may generate speech data. Here, the speech data refers to the first recorded or converted meeting minutes, and is string data including text-based speech text. The conference recording apparatus 100 may generate speech data based on the text data transcribed by the clerk of the conference. However, the present invention is not limited thereto, and the conference recording apparatus 100 may generate the speech data of the conference transmitted by the log management server 200 by performing Speech-To-Text (STT) conversion on the recorded audio data. . In addition, the conference recording apparatus 100 may transmit the generated speech data to the conference minutes management apparatus 300 .

In one embodiment, the conference recording apparatus 100 may generate speech data by performing STT conversion on the audio data of the conference transmitted by the log management server 200 in real time.

Next, the log management server 200 may generate log data generated according to the progress of the meeting and transmit it to the meeting minutes management apparatus 300 . More specifically, the log management server 200 may generate log data. Here, the log data is string data in which a log of an event generated in the course of a meeting is recorded. Such log data may include, but is not limited to, identifiers (IDs) of the plurality of microphones 201, 202, and 20n installed in the conference hall and activation times of the respective microphones 201, 202, and 20n.

The log management server 200 may generate recorded voice data from the plurality of microphones 201 , 202 , and 20n installed in the conference hall and transmit the generated voice data to the meeting minutes management apparatus 300 . However, the present invention is not limited thereto and may be transmitted to the conference recording apparatus 100 .

The plurality of microphones 201, 202, and 20n installed in the conference hall may be activated when a member or member participating in the conference presses the button of the microphones 201, 202, 20n to speak. In addition, when a voice exceeding the reference value is recognized, the microphone may be automatically activated. However, the present invention is not limited thereto. When the microphones 201, 202, and 20n of the members or members participating in the meeting are activated, the log management server 200 determines the identifiers of the activated microphones 201, 202, and 20n and the corresponding microphones 201, 202, and 20n. Log data can be generated by cumulatively recording the activation time. The microphone identifier included in the log data may consist of a character string of a predetermined size, but is not limited thereto. In addition, the activation time of the microphone may have a format of Universal Time Coordinated (UTC), but is not limited thereto.

Next, the meeting minutes management device 300 may manage the meeting minutes data based on the speech data and log data received from the meeting recording device 100 and the log management server 200 . In addition, the meeting minutes management apparatus 300 may generate a document for reading the meeting minutes based on the managed meeting minutes data and transmit it to the meeting minutes viewing device 400 . As described above, the meeting minutes management apparatus 300 according to some embodiments of the present invention will be described in detail later with reference to FIGS. 2 to 12 .

Next, the meeting minutes reading device 400 may receive and output a document for reading the meeting minutes from the meeting minutes management device 300 . More specifically, the meeting minutes viewing device 400 transmits a meeting minutes reading request to the meeting minutes management device 300 according to a user's input. In addition, the meeting minutes reading device 400 receives a reading document from the meeting minutes management device 300 .

Here, the reading document is a document generated by the meeting minutes management device 300 in response to the request of the meeting minutes reading device 400 . Such a reading document may include the progress of the meeting, the text of the speech, the time of the speech, and the results of the meeting. In particular, the reading document according to an embodiment of the present invention may additionally include speaker information, related keyword information, and the like, unlike the conventional meeting minutes. Such a reading document may be a web document in a format such as HyperText Markup Language (HTML) or eXtensible Markup Language (XML), but is not limited thereto, and may be a document in a Portable Document Format (PDF) format. Also, in the browsing document according to an embodiment, an interface for keyword search may be provided.

In addition, the meeting minutes reading apparatus 400 may output the received reading document to the screen. In the meeting minutes reading apparatus 400, a web browser or a dedicated application may be installed in order to output a reading document.

The apparatus 400 for viewing meeting minutes according to an embodiment of the present invention may be any device as long as it is a device capable of outputting a reading document received from the apparatus 300 for managing meeting minutes through a network. For example, the meeting minutes reading apparatus 400 according to an embodiment of the present invention includes a desktop, a workstation, a server, a laptop, a tablet, and a smart phone. ) or any one of phablets (Phablet), but is not limited thereto, and portable multimedia players (PMPs), personal digital assistants (PDAs), or e-book readers (E-Book Reader) ), etc., may be a type of device.

Hereinafter, a meeting minutes management method according to an embodiment of the present invention will be described in more detail with reference to FIGS. 2 to 11 . Hereinafter, steps to be described in some flowcharts may be understood to be performed by the meeting minutes management apparatus 300 unless otherwise specified.

2 is a flowchart of a meeting minutes management method according to an embodiment of the present invention.

In step S100, speech data including speech text is obtained. As described with reference to FIG. 1 , the speech data may be generated and transmitted by the conference recording apparatus 100 . However, the present invention is not limited thereto. A specific method related to the generation of speech data will be described in detail later with reference to FIG. 4 .

In step S200, the metadata is mapped to the main words of the speech text included in the speech data. According to an embodiment, the main word may mean all words included in the remark text. Also, according to an embodiment, the main word may mean a noun included in the remark text. Also, according to an embodiment, the main word may mean the beginning of a sentence. Also, according to an embodiment, the main word may mean the ending of a sentence. However, the present invention is not limited thereto, and all criteria for selecting a word according to a certain rule in the speech text may be included.

For a detailed description of the mapped metadata, refer to FIG. 3 . 3 is a diagram for explaining metadata mapping that may be referred to in some embodiments of the present invention.

Referring to FIG. 3 , a character string including speech text is described in the example speech data. The speech text includes key words 30 to which at least one or more metadata is mapped.

According to an embodiment, metadata may be mapped to at least one word among words of the speech text. By selectively mapping meta data to some of the words, which are the minimum recognition units, it is possible to reduce the computing load while having the effects of some embodiments to be described later.

In an embodiment, metadata may be mapped to every word of the speech text. By mapping metadata to all words, which are the minimum recognition units, it is possible to provide an interface that is easy to edit and search for meeting minutes creators, and provide a document that allows meeting minutes readers to more easily recognize the contents of meeting minutes.

3 illustrates a key word 30 to which metadata is mapped. In one embodiment, the mapped metadata may include a transformation accuracy prediction rate 31 . A detailed operation related thereto will be described in detail with reference to FIGS. 4 to 6 to be described later. In one embodiment, the mapped metadata may include voice data 32 . A detailed operation related thereto will be described in detail with reference to FIG. 5 to be described later. In one embodiment, the mapped metadata may include the duration of pronunciation required (33). A detailed operation related thereto will be described in detail with reference to FIGS. 8 and 9 to be described later. However, the present invention is not limited thereto, and the metadata may include a speaker, a meeting name, an agenda, a speech type, a speech start time, and original file information. In an embodiment, the metadata may include data related to STT processing for key words. For example, the conversion accuracy prediction rate of a key word corresponds to this. However, the present invention is not limited thereto, and all information for the convenience of the user of the meeting minutes management apparatus 300 may be included.

Referring back to FIG. 2 , meeting minutes data is generated in step S300 . By mapping the metadata to key words, the work efficiency of the minutes writer can be improved, and the usability of the meeting minutes readers can be improved. Step S300 is embodied in some embodiments to be described later.

The method for managing meeting minutes according to an embodiment of the present invention described with reference to FIGS. 2 to 3 provides an interface for easy editing and retrieval to the meeting minutes creator by mapping metadata to words corresponding to the minimum recognition unit, and meeting minutes The reader may be provided with a document that can more easily recognize the contents of the minutes.

The meeting minutes management method according to an embodiment of the present invention can provide an environment in which the STT-converted speech text can be modified for each word to the meeting minutes writer in some embodiments to be described later by mapping metadata to key words, and meeting minutes By providing the viewer with highlighted words, templates, keyword searches, etc., it is possible to provide more easily recognizable meeting minutes.

Hereinafter, an embodiment according to the present invention using the transformation accuracy prediction rate as meta data will be described in more detail with reference to FIGS. 4 to 6 . FIG. 4 is a flowchart for explaining in more detail some operations of the method for managing meeting minutes described with reference to FIG. 2 .

Referring to FIG. 4 , the step S100 of obtaining speech data including speech text is embodied. In step S110, the voice data recorded in the conference speech is converted. The operation of step S110 may be performed by the meeting recording apparatus 100 and transmitted to the meeting minutes management apparatus 300 as described above with reference to FIG. 1 . However, the present invention is not limited thereto, and step S110 may be performed by the meeting minutes management apparatus 300 . The meeting minutes management apparatus 300 may generate speech-to-text (STT) conversion on voice data in which the speech text of the meeting transmitted by the log management server 200 is recorded. In one embodiment, the meeting minutes management apparatus 300 may be generated by performing STT conversion on the voice data of the meeting transmitted by the log management server 200 in real time.

In step S130, a conversion accuracy prediction rate is obtained. The conversion accuracy prediction rate is an expression for predicting how accurately the character string data converted by STT conversion is converted from the original voice data. The algorithm for calculating the STT transform and the STT transform accuracy prediction rate is obvious to those skilled in the art and is omitted.

In an embodiment, by generating speech data based on the recorded voice data, speech data may be automatically generated without a stenographer's shorthand. The speech data prepared by the stenographer may have errors, and there are disadvantages in that excessive costs and manpower are consumed, so these disadvantages can be solved.

FIG. 5 is a flowchart for explaining the operation of the method for managing meeting minutes described with reference to FIG. 4 in more detail.

Referring to FIG. 5 , step S130 is embodied in step S131. In step S131, a conversion accuracy prediction rate of a word is obtained. The conversion accuracy prediction rate of the STT conversion described above with reference to FIG. 4 is obtained for each word. In step S210, step S200 is embodied. In step S210, the conversion accuracy prediction rate of the key word is mapped.

When the mapped conversion accuracy prediction rate is equal to or less than the reference value (S311), the adjustment target word is highlighted and displayed in step S313. By highlighting words with low conversion accuracy prediction rates, the minutes writer can easily recognize areas that need to be corrected.

The output of displaying the adjustment target word may be performed through an output means separately provided in the meeting minutes management apparatus 300 . Also, it may be performed through the conference recording device 100 . However, the present invention is not limited thereto.

In an embodiment, the reference value of the conversion accuracy prediction rate may be set to a plurality of sections. For example, if the conversion accuracy prediction rate is 80% or more, black may be assigned, if it is 50% or more but less than 80%, orange may be assigned, and if it is less than 50%, red may be assigned. . As it is set to a plurality of sections, the minutes that require further correction (red in this example) can be easily recognized by the minutes writer. However, it is not limited to this example.

In an embodiment, the conversion accuracy prediction rate may be obtained only for some words in the utterance text of the utterance data. As described above, it is possible to reduce the computing load by mapping metadata to some words, so that, similarly, only some words can obtain a conversion accuracy prediction rate to reduce the computing load.

In one embodiment, a translation accuracy prediction rate may be obtained for every word of the utterance text. In the case of a document requiring high accuracy for publication, a region marked with a low conversion accuracy prediction rate may be corrected by obtaining a conversion accuracy prediction rate for all words.

According to an embodiment, it may operate together with an embodiment in which voice data corresponding to a word to be described with reference to FIG. 7 is output. A detailed description thereof will be described later with reference to FIG. 7 .

6 is an exemplary diagram illustrating the method for managing the minutes described with reference to FIG. 5 .

Referring to FIG. 6 , words 61 and 63 having a low conversion accuracy prediction rate are displayed in a first color unlike other words in the speech text. As described above, by converting the color of the words 61 and 63 having a low conversion accuracy prediction rate to the first color, the minutes writer can easily recognize the part that needs to be corrected.

In an embodiment, a word whose conversion accuracy prediction rate is less than or equal to a reference value may be displayed by converting a letter format. For example, a font, thickness, italic degree, etc. may be converted. However, the present invention is not limited thereto, and any expression that displays a conversion that can be recognized by the recorder may be included in the highlighting.

7 is a flowchart for explaining in more detail the operation of the meeting minutes management method described with reference to FIG. 2 .

Referring to FIG. 7 , step S200 is embodied in step S230. In step S230, voice data corresponding to a word is mapped. That is, the voice data transmitted by the log management server 200 is divided, and a part of the voice data corresponding to a specific word is mapped.

For example, referring to FIG. 6 , the voice data source corresponding to "Expanding inter-Korean exchanges and preparing the foundation for railroads and roads for continental politics?" corresponding to the remark text is divided, Voice data is mapped to the word 'South and North', and the voice data corresponding to 'interaction' is mapped to the word 'interaction'.

Referring back to FIG. 7 , an input for selecting the first word is obtained in step S331. An input for selecting the first word may be obtained through an input unit separately provided in the meeting minutes management apparatus 300 . Also, it may be performed through the meeting minutes reading device 400 . However, the present invention is not limited thereto.

In response to the input of selecting the first word in step S333, first voice data mapped to the first word is output. The voice data may be reproduced through an output means separately provided in the meeting minutes management apparatus 300 . Also, it may be reproduced through the meeting minutes reading device 400 . However, the present invention is not limited thereto. By mapping the meta data to the word, there is an effect that voice data corresponding to the word can be reproduced.

In an embodiment, when the prediction rate of conversion accuracy of the word described with reference to FIGS. 4 to 6 is equal to or less than the reference value, the word selected in response to an input for selecting a word together with an embodiment of highlighting the adjustment target word An embodiment in which voice data mapped to . By selecting a word with a low conversion accuracy prediction rate, the voice data corresponding to the word is selected, and the minutes maker can revise the word. According to the present embodiment, by specifying a word to be corrected and reproducing voice data corresponding to the word, it is possible to provide a management interface that is easy to modify to a meeting minutes writer.

In an embodiment, the method may include reproducing voice data for each of the plurality of words to be adjusted and repeatedly performing correction text for the words to be adjusted. By continuously reproducing and correcting a plurality of words to be adjusted, it is possible to efficiently edit meeting minutes.

FIG. 8 is a flowchart for explaining the operation of the method for managing meeting minutes described with reference to FIG. 2 in more detail.

Referring to FIG. 8 , step S200 is embodied in step S250. In step S250, the time required for the pronunciation of the speech corresponding to the word is mapped. The pronunciation required time refers to the time taken for a word to be pronounced from the audio data. For example, referring to FIG. 9 , the duration for which 'South and North (91)' is pronounced is 1.22 seconds. The time for which 'interchange (92)' is pronounced is 1.19 seconds.

Referring again to FIG. 8 , the meeting start time is obtained in step S351. The meeting start time may be obtained through an input means separately provided in the meeting minutes management apparatus 300 . Also, an input may be received through the meeting recording device 100 and transmitted to the meeting minutes management device 300 . However, the present invention is not limited thereto.

In step S353 an input for selecting a first word is obtained. An input for selecting the first word may be obtained through an input unit separately provided in the meeting minutes management apparatus 300 . Also, an input may be received through the meeting recording device 100 and transmitted to the meeting minutes management device 300 . However, the present invention is not limited thereto.

In step S355-1, step S355 of outputting the start time of the first word utterance is embodied. In step S355-1, the sum of the pronunciation required time mapped to all words existing before the first word in the speech text is obtained.

In step S355-3, the sum of the time required for pronunciation is added to the meeting start time. If the pronunciation time is mapped to all words in the spoken text, the total pronunciation time of all words that exist before the selected first word is calculated, and the meeting start time is added to obtain the first word speech start time automatically. have.

In the present embodiment, the time at which the first word utterance started may be output using the conference start time and the pronunciation required time obtained by processing voice data without additional input for the speech start time itself.

For a specific example related thereto, refer to FIG. 9 . 9 is an exemplary diagram illustrating the meeting minutes management method described with reference to FIG. 8 .

Referring to FIG. 9 , words 91 , 92 , 93 , and 94 to which word speaking times are mapped are shown. For simplicity of explanation, only some of the words to which word utterance times are mapped are shown. In the example to be described with reference to FIG. 9 , the speech start time is displayed for each paragraph. The utterance start time 95 of the first paragraph shown is 15:08:01. The utterance start time 97 of the second paragraph shown is 15:09:21. The speech start time 95 of the first paragraph is added to the total pronunciation time required for all words written in the first paragraph to obtain the speech start time 97 of the second paragraph. That is, according to the table, the sum of the time required to pronounce all the words in the first paragraph corresponds to 80.02 seconds, so the speech start time 97 of the second paragraph is obtained by adding to the speech start time 95 of the first paragraph.

In an embodiment, when the speaker data is changed by additionally including speaker data in metadata mapped to words, a speech start time of the changed speaker may be output. The time at which the speech was performed may be automatically obtained for each speaker. In the meeting minutes capable of being automatically formatted to be provided according to some embodiments to be described later, the time at which a speech was made for each speaker is displayed without any additional input, so that the minutes reader can more easily recognize the minutes.

In an embodiment, when the agenda data is changed by additionally including the agenda data in metadata mapped to words, the speech start time of the changed agenda may be output. The time at which the speech was performed can be obtained automatically for each item. In the meeting minutes capable of being automatically formatted to be provided according to some embodiments to be described later, the time at which a remark was performed for each agenda item is displayed without any additional input, so that the minutes reader can more easily recognize the minutes.

In an embodiment, the metadata may include a time required for pronunciation in which a remark corresponding to the main word is performed, and may include highlighting and displaying an emphasized word having a time required for pronunciation equal to or greater than a reference value.

The output of displaying the highlighted word may be performed through an output means separately provided in the meeting minutes management apparatus 300 . Also, it may be performed through the meeting minutes management device 400 . However, the present invention is not limited thereto.

Referring to FIG. 9 , for example, the emphasized word 93 for which the pronunciation required time is 2 seconds or more, which is a reference value, is highlighted and displayed. In an embodiment, a word whose pronunciation required time is equal to or greater than the reference value may be displayed after converting the letter format. For example, a font, thickness, italic degree, etc. may be converted. However, the present invention is not limited thereto, and any expression that displays a conversion recognizable by a meeting minutes reader may be included in the highlighting.

The usability of the meeting minutes reader is improved by highlighting words that take more than the standard value to pronounce. Minutes readers can understand the context of the entire meeting, focusing on the highlighted words, without having to read every word in focus.

FIG. 10 is a flowchart for explaining the operation of the method for managing meeting minutes described with reference to FIG. 2 in more detail.

Referring to FIG. 10 , speech data is corrected in step S371. An input for correcting the speech data may be obtained through an input means separately provided in the meeting minutes management apparatus 300 . It may also be obtained by the conference recording apparatus 100 . However, the present invention is not limited thereto. With reference to some embodiments described above, the minutes writer may modify speech data.

Specifically, when a specific word is deleted from the speech text of the speech data, the mapped metadata of the deleted specific word is also deleted (S373).

When a specific word in the speech text of the speech data is replaced with another word, the mapped metadata of the replaced specific word is mapped to the replaced specific word and maintained ( S375 ).

When a specific word is added from the speech text of the speech data, metadata of a key word closest to the added specific word is mapped ( S377 ). The adjacent word may be the word immediately preceding it. Also, it may be a word immediately following. However, the present invention is not limited thereto, and metadata mapped to a word before or after is mapped to a specific word to be added according to the position, length, etc. of the specific word to be added.

11 is a flowchart for explaining in more detail the operation of the method for managing meeting minutes described with reference to FIG. 2 .

Referring to FIG. 11 , keywords are extracted from the speech text in step S391. A keyword means a word that can be used as an access point when searching for utterance text. In an embodiment, the keyword may correspond to the name of the agenda. However, the present invention is not limited thereto.

In step S393, the keyword is output according to the reference rule. The keyword may be output through an output means separately provided in the meeting minutes management apparatus 300 . In an embodiment, the reference rule may be an order of frequency of occurrence of keywords included in the remark text. However, the present invention is not limited thereto, and various rules for extracting keywords may be included. The meeting minutes reader can more easily recognize the minutes by viewing the output keywords and reading the minutes by focusing on the words with high importance.

In step S395, an interface for retrieving keywords is provided. The interface may be provided through an output means separately provided in the meeting minutes management apparatus 300 . In addition, it may be provided by the meeting minutes reading device 400 . However, the present invention is not limited thereto. The input of the meeting minutes reader may be obtained through an input means separately provided in the meeting minutes management apparatus 300 . Also, it may be obtained by the meeting minutes reading device 400 . However, the present invention is not limited thereto.

In an embodiment, a specific utterance including a keyword part among utterance texts may be searched for in order. In one embodiment, a specific utterance including a keyword portion may be searched for among utterance texts in other associated meetings. In an embodiment, a second keyword associated with the first keyword may be output. In an embodiment, specific utterances including the second keyword associated with the first keyword may be searched for in order.

That is, various output and search interfaces may be provided through speech data obtained at a specific meeting and keywords obtained by extracting speech text included in the speech data. Keywords with high importance may be listed in order, remarks including the listed keywords may be searched, and remarks included in other conferences related to a specific conference may be searched. In addition, other keywords related to a specific keyword may be output.

In step S397, a search result is output. The search result may be provided through an output means provided separately in the meeting minutes management apparatus 300 . In addition, it may be provided by the meeting minutes reading device 400 . However, the present invention is not limited thereto.

In an embodiment, the search result of the first keyword and the second keyword search result mapped to the abbreviation of the first keyword may be output together. Also, according to an embodiment, the search result of the second keyword and the first keyword search result mapped to the official name of the second keyword may be output together. In an embodiment, the search result may be a collection of utterances including the corresponding keyword. In an embodiment, the search result may be a collection of remarks in which the corresponding keyword is an agenda.

The method for managing meeting minutes according to an embodiment of the present invention may further include outputting a result value in which at least one or more of the mapped metadata is displayed. By displaying the mapped data on the speech data, it is possible to output a result value including speaker data, speech start time data, agenda data, and the like.

The meeting minutes reader can read the automatically formatted document with appropriate metadata applied to the meeting minutes, not just the minutes listed as a string. Accordingly, the meeting minutes reader can more easily recognize the meeting minutes.

In an embodiment, meeting minutes data may be generated by visualizing speech data according to a template referring to metadata. In an embodiment, a first word that satisfies the metadata defined in the first item of the template may be searched, and the first word determined as a word corresponding to the first item may be displayed. By arranging the first word according to the format of the template with reference to the metadata, the meeting minutes reader can easily recognize the contents of the meeting minutes.

In one embodiment, the document may be formatted by aggregating the remarks of a specific member. In one embodiment, the document may be formatted by aggregating remarks on a specific agenda. In an embodiment, the document may be formatted by synthesizing a question statement and a response statement corresponding thereto. However, the present invention is not limited thereto, and all methods that can be formatted based on the content included in the remark text are included.

So far, a meeting minutes management method according to an embodiment of the present invention and its application fields have been described with reference to FIGS. 1 to 11 . Hereinafter, an exemplary computing device 1500 capable of implementing the meeting minutes management device 300 according to an embodiment of the present invention will be described.

12 is a hardware configuration diagram illustrating an exemplary computing device 1500 capable of implementing the meeting minutes management device 300 according to an embodiment of the present invention.

12 , the computing device 1500 loads one or more processors 1510 , a bus 1550 , a communication interface 1570 , and a computer program 1591 executed by the processor 1510 . It may include a memory 1530 and a storage 1590 for storing the computer program 1591 . However, only the components related to the embodiment of the present invention are illustrated in FIG. 12 . Accordingly, one of ordinary skill in the art to which the present invention pertains can know that other general-purpose components other than the components shown in FIG. 12 may be further included.

The processor 1510 controls the overall operation of each component of the computing device 1500 . The processor 1510 includes a central processing unit (CPU), a micro processor unit (MPU), a micro controller unit (MCU), a graphic processing unit (GPU), or any type of processor well known in the art. can be In addition, the processor 1510 may perform an operation on at least one application or program for executing the method according to the embodiments of the present invention. The computing device 1500 may include one or more processors.

The memory 1530 stores various data, commands, and/or information. The memory 1530 may load one or more programs 1591 from the storage 1590 to execute a method according to embodiments of the present invention. The memory 1530 may be implemented as a volatile memory such as RAM, but the technical scope of the present invention is not limited thereto.

The bus 1550 provides communication functions between components of the computing device 1500 . The bus 1550 may be implemented as various types of buses, such as an address bus, a data bus, and a control bus.

The communication interface 1570 supports wired/wireless Internet communication of the computing device 1500 . Also, the communication interface 1570 may support various communication methods other than Internet communication. To this end, the communication interface 1570 may be configured to include a communication module well-known in the art.

According to some embodiments, the communication interface 1570 may be omitted.

The storage 1590 may non-temporarily store the one or more programs 1591 and various data.

The storage 1590 is a non-volatile memory such as a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, a hard disk, a removable disk, or well in the art to which the present invention pertains. It may be configured to include any known computer-readable recording medium.

The computer program 1591, when loaded into the memory 1530, may include one or more instructions that cause the processor 1510 to perform methods/operations according to various embodiments of the present invention. That is, the processor 1510 may perform the methods/operations according to various embodiments of the present disclosure by executing the one or more instructions.

In this case, the meeting minutes management apparatus 300 according to an embodiment of the present invention may be implemented through the computing device 1500 .

So far, various embodiments of the present invention and effects according to the embodiments have been described with reference to FIGS. 1 to 12 . Effects according to the technical spirit of the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

The technical idea of the present invention described with reference to FIGS. 1 to 12 may be implemented as computer-readable codes on a computer-readable medium. The computer-readable recording medium may be, for example, a removable recording medium (CD, DVD, Blu-ray disk, USB storage device, removable hard disk) or a fixed recording medium (ROM, RAM, computer-equipped hard disk). can The computer program recorded on the computer-readable recording medium may be transmitted to another computing device through a network such as the Internet and installed in the other computing device, thereby being used in the other computing device.

In the above, even though all the components constituting the embodiment of the present invention are described as being combined or operating in combination, the technical spirit of the present invention is not necessarily limited to this embodiment. That is, within the scope of the object of the present invention, all the components may operate by selectively combining one or more.

Although acts are shown in a particular order in the drawings, it should not be understood that the acts must be performed in the specific order or sequential order shown, or that all illustrated acts must be performed to obtain a desired result. In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of the various components in the embodiments described above should not be construed as necessarily requiring such separation, and the program components and systems described may generally be integrated together into a single software product or packaged into multiple software products. It should be understood that there is

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can practice the present invention in other specific forms without changing the technical spirit or essential features. can understand that there is Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent range should be interpreted as being included in the scope of the technical ideas defined by the present invention.

Claims (13)

A method performed by a computing device, comprising:
obtaining speech data including speech text structured to enable identification of key words;
mapping metadata to the key words; and
using the meta data to generate meeting minutes data,
How to manage minutes. According to claim 1,
The step of obtaining the speech data includes:
Including the step of converting speech data into speech text by STT (Speech-To-Text) processing,
The metadata includes data related to the STT processing for the key word,
How to manage minutes. According to claim 1,
The step of obtaining the speech data includes:
converting voice data recorded in a conference speech into the speech data; and
Comprising the step of obtaining a conversion accuracy prediction rate of the main word included in the speech data,
The metadata is
including the obtained conversion accuracy prediction rate,
The step of generating the meeting minutes data includes:
Comprising the step of highlighting and displaying the adjustment target word whose conversion accuracy prediction rate is less than or equal to a reference value,
How to manage minutes. 4. The method of claim 3,
The metadata of the word to be adjusted is,
Includes recorded voice data corresponding to the main word,
The step of generating the meeting minutes data includes:
Reproducing the voice data included in the metadata of the target word to be adjusted,
How to manage minutes. 5. The method of claim 4,
The step of reproducing the audio data includes:
for each of the words to be adjusted, the steps of repeatedly performing reproducing the voice data of the word to be adjusted and obtaining corrected text for the word to be adjusted,
How to manage minutes. 5. The method of claim 4,
The step of reproducing the audio data includes:
with respect to the adjustment target word selected by the user among the adjustment target words, reproducing the audio data of the adjustment target word and obtaining correction text for the adjustment target word;
How to manage minutes. According to claim 1,
The metadata is
Including the time required for pronunciation of the speech corresponding to the main word,
The step of generating the meeting minutes data includes:
Including the step of highlighting and displaying the highlighted word for which the pronunciation required time is equal to or greater than a reference value,
How to manage minutes. According to claim 1,
The step of generating the meeting minutes data includes:
receiving a user input and using the user input to correct the speech data,
The step of modifying the speech data is,
When a first word is added to the utterance text, the meta data of a second word that is the closest major word of the first word is mapped to the first word,
How to manage minutes. According to claim 1,
The step of generating the meeting minutes data includes:
Visualizing the speech data according to a template referencing the metadata,
How to manage minutes. 10. The method of claim 9,
The step of visualizing the speech data is,
retrieving a first word that satisfies the metadata defined in the first item of the template;
determining the first word as a word corresponding to the first item; and
displaying the first word in an area corresponding to the first item;
How to manage minutes. According to claim 1,
A meeting minutes search step of receiving a first keyword input through a search user interface and outputting a search result of the first keyword and a search result of a second keyword mapped to an abbreviation of the first keyword together;
The first keyword is the official name of the second keyword,
How to manage minutes. According to claim 1,
A meeting minutes search step of receiving a second keyword input through a search user interface and outputting a search result of the second keyword and a search result of the first keyword mapped to the official name of the second keyword together;
The second keyword is an abbreviation of the first keyword,
How to manage minutes. processor;
network interface;
Memory; and
A computer program loaded into the memory and executed by the processor,
The computer program is
an instruction for obtaining utterance data including utterance text structured to enable identification of key words;
instructions for mapping metadata to the key words; and
Using the metadata, including instructions for generating meeting minutes data,
meeting minutes management device.

Images