JP7183316B2 - Voice recording retrieval method, computer device and computer program - Google Patents

Description

The following description relates to techniques for retrieving words from speech-to-text audio recordings.

In general, mobile speech conversion is performed by recording speech on a mobile device, converting the recorded speech into text after the speech recording, and displaying the text on a display.

As an example of such voice conversion technology, Patent Document 1 (published on May 23, 2014) discloses a technology for performing voice recording and text conversion.

Korean Patent Publication No. 10-2014-0062217

To provide a method and system for retrieving words including words with similar pronunciation when retrieving words from voice recordings in which voice is converted into text.

A method and system are provided for filtering words included in pronunciation-based search results by search accuracy.

A method and system for differently displaying display elements of words included in pronunciation-based search results according to search accuracy are provided.

A method and system are provided for correcting words contained in pronunciation-based search results to other words.

A method of retrieving audio recordings performed by a computing device, said computing device including at least one processor configured to execute computer readable instructions contained in a memory, said method of retrieving audio recordings comprising said retrieving, by at least one processor, words corresponding to a search term from an audio recording produced by converting speech to text, said retrieving searching for words that are similar in pronunciation to the search term from the audio recording. To provide a method for retrieving voice recordings, characterized by retrieving including similar words that are words of .

According to one aspect, the searching step may search for a word having a degree of similarity above a predetermined percentage with the search word as the similar word by comparing words using a unit in which words are separated.

According to another aspect, the step of retrieving includes comparing words based on at least one of glyph units, stem units, and term units to find words that have a certain percentage or more of similarity to the search term. may be retrieved as the similar word.

According to yet another aspect, the method of retrieving voice recordings may further include correcting, by the at least one processor, at least one word included in the search result to another word.

According to another aspect, the correcting step uses a function of correcting all words included in the search result at once or a function of selectively correcting a part of the words included in the search result. may be modified to the other word.

According to another aspect, the searching may include displaying display elements of words included in the search result differently according to similarity to the search word.

According to another aspect, the searching may include filtering words included in search results based on similarity to the search term.

According to another aspect, the voice recording is managed by being matched with a memo created during recording or playback of the voice, and the searching includes the voice recording and the memo as search ranges. You can search for words.

According to yet another aspect, the method of retrieving audio recordings further includes providing, by the at least one processor, the audio recordings in conjunction with notes made during recording or playback of the audio. good.

According to yet another aspect, the providing step may include displaying both the voice recording and the note in a dual-view manner.

A computer-readable recording medium is provided in which a program for causing a computer to execute the voice recording retrieval method is recorded.

1. A computer apparatus comprising at least one processor configured to execute computer readable instructions contained in a memory, said at least one processor generating an audio recording produced by converting speech to text a voice recording search unit for searching for a word corresponding to the search term from the voice recording, wherein the voice recording search unit searches for similar words that are words with a similar pronunciation to the search term from the voice recording A computing device is provided.

According to an embodiment of the present invention, when searching for words from voice-to-text voice recordings, the performance of word retrieval of voice recordings can be improved by including words with similar pronunciations.

According to an embodiment of the present invention, a function of filtering words included in the pronunciation-based search results according to search accuracy, a function of correcting the words included in the pronunciation-based search results to other words, etc. are provided. Therefore, it is possible to enhance the user's convenience in using the service.

1 is a diagram showing an example of a network environment in one embodiment of the present invention; FIG. 1 is a block diagram illustrating an example of a computing device, in accordance with one embodiment of the present invention; FIG. FIG. 2 illustrates an example of components that a processor of a computing device may include in one embodiment of the present invention; 1 is a flowchart illustrating an example of a method that may be performed by a computing device in accordance with one embodiment of the present invention; FIG. 4 is a diagram showing an example of a user interface screen for audio recording management in one embodiment of the present invention; FIG. 4 is a diagram showing an example of a user interface screen for audio recording management in one embodiment of the present invention; FIG. 4 is a diagram showing an example of a user interface screen for audio recording management in one embodiment of the present invention; FIG. 4 is a diagram showing an example of a user interface screen for audio recording management in one embodiment of the present invention; FIG. 4 is a diagram showing an example of a user interface screen for audio recording management in one embodiment of the present invention; FIG. 4 is a diagram showing an example of a user interface screen for audio recording management in one embodiment of the present invention; FIG. 4 is a diagram showing an example of a user interface screen for audio recording management in one embodiment of the present invention;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

An audio recording management system according to an embodiment of the present invention may be implemented by at least one computer device, and an audio recording retrieval method according to an embodiment of the present invention may be implemented by at least one computer device included in the audio recording management system. may be executed. A computer program according to an embodiment of the present invention may be installed and executed in the computer device, and the computer device executes the voice recording retrieval method according to the embodiment of the present invention under the control of the executed computer program. You can The computer program described above may be recorded in a computer-readable recording medium to be coupled to a computer device and cause the computer to execute the voice recording retrieval method.

FIG. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment of FIG. 1 illustrates an example including multiple electronic devices 110 , 120 , 130 , 140 , multiple servers 150 , 160 , and a network 170 . Such FIG. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited as in FIG. Also, the network environment in FIG. 1 is merely an example of an environment applicable to this embodiment, and the environment applicable to this embodiment is not limited to the network environment in FIG.

The plurality of electronic devices 110, 120, 130, 140 may be fixed terminals or mobile terminals implemented by computing devices. Examples of the plurality of electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, PCs (personal computers), notebook PCs, digital broadcasting terminals, PDAs (Personal Digital Assistants), and PMPs (Portable Multimedia Players). ), tablets, etc. As an example, FIG. 1 shows a smart phone as an example of the electronic device 110, but in embodiments of the present invention, the electronic device 110 substantially utilizes a wireless or wired communication scheme and communicates with other devices via the network 170. may refer to one of a wide variety of physical computing devices capable of communicating with the electronic devices 120, 130, 140 and/or the servers 150, 160.

The communication method is not limited, and not only a communication method using a communication network that can be included in the network 170 (eg, mobile communication network, wired Internet, wireless Internet, broadcast network), but also short-range wireless communication between devices. may be included. For example, the network 170 includes a PAN (personal area network), a LAN (local area network), a CAN (campus area network), a MAN (metropolitan area network), a WAN (wide area network), a BBN (broadband network), and the Internet. Any one or more of the networks may be included. Additionally, network 170 may include any one or more of network topologies including, but not limited to, bus networks, star networks, ring networks, mesh networks, star-bus networks, tree or hierarchical networks, and the like. will not be

Each of servers 150, 160 is implemented by one or more computing devices that communicate with a plurality of electronic devices 110, 120, 130, 140 over network 170 to provide instructions, code, files, content, services, etc. good. For example, the server 150 provides services (eg, voice record management service (or minutes management service), content provision service, group call (or audio conferencing service), messaging service, email service, social network service, map service, translation service, financial service, payment service, search service, etc.).

FIG. 2 is a block diagram illustrating an example computing device, in accordance with one embodiment of the present invention. Each of the plurality of electronic devices 110, 120, 130 and 140 and each of the servers 150 and 160 described above may be realized by the computer device 200 shown in FIG.

Such a computing device 200 may include memory 210, processor 220, communication interface 230, and input/output interface 240, as shown in FIG. The memory 210 is a computer-readable storage medium and may include random access memory (RAM), read only memory (ROM), and permanent mass storage devices such as disk drives. Here, a permanent mass storage device such as a ROM or disk drive may be included in computer device 200 as a separate permanent storage device separate from memory 210 . Also stored in memory 210 may be an operating system and at least one program code. Such software components may be loaded into memory 210 from a computer-readable medium separate from memory 210 . Such other computer-readable recording media may include computer-readable recording media such as floppy drives, disks, tapes, DVD/CD-ROM drives, memory cards, and the like. In other embodiments, software components may be loaded into memory 210 through communication interface 230 that is not a computer-readable medium. For example, software components may be loaded into memory 210 of computing device 200 based on computer programs installed by files received over network 170 .

Processor 220 may be configured to process computer program instructions by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to processor 220 by memory 210 or communication interface 230 . For example, processor 220 may be configured to execute received instructions according to program code stored in a storage device, such as memory 210 .

Communication interface 230 may provide functionality for computer device 200 to communicate with other devices (eg, the recording device described above) via network 170 . As an example, processor 220 of computing device 200 can transmit requests, commands, data, files, etc. generated according to program code recorded in a recording device such as memory 210 to other devices via network 170 under the control of communication interface 230 . device. Conversely, signals, instructions, data, files, etc. from other devices may be received by computing device 200 through communication interface 230 of computing device 200 over network 170 . Signals, instructions, data, etc. received through the communication interface 230 may be transmitted to the processor 220 and the memory 210, and files may be stored in a recording medium (the permanent recording device described above) that the computing device 200 may further include. may be recorded.

Input/output interface 240 may be a means for interfacing with input/output device 250 . For example, input devices may include devices such as microphones, keyboards, mice, etc., and output devices may include devices such as displays, speakers, and the like. As another example, input/output interface 240 may be a means for interfacing with a device that integrates functionality for input and output, such as a touch screen. Input/output device 250 may be one device with computing device 200 .

Also, in other embodiments, computing device 200 may include fewer or more components than the components of FIG. However, most prior art components need not be explicitly shown in the figures. For example, computing device 200 may be implemented to include at least some of the input/output devices 250 described above, and may also include other components such as transceivers, databases, and the like.

Specific embodiments of methods and systems for searching speech-to-text audio recordings containing words with similar pronunciations are described below.

These days, many people use audio functions to record audio in a variety of environments, such as meetings. At this time, in addition to recording, it may be desired to record important contents or incidental contents as a memo.

In the conventional technology, since the voice recording function and the memo function are provided as separate functions, it is not always easy to check the voice recording file and the memo at the same time. rice field. In other words, the user has to check the voice and the memo separately, which makes it difficult to check the memo while grasping the overall flow of the recorded contents.

In order to solve such a problem, in this embodiment, the result of converting the recorded voice into text (hereinafter referred to as "voice recording") and the memo created in association with the recorded voice provides a voice record management service that matches and manages

The purpose of this embodiment is to provide a voice recording function including voice recording and text conversion and a memo function as one integrated function, and to match and manage the voice recording and the memo together.

In particular, this embodiment provides a search function that includes words with similar pronunciations from voice recordings, taking into consideration the case where inaccurate words are recognized due to voice recognition errors when converting voice to text. for the purpose.

FIG. 3 is a block diagram illustrating exemplary components that a processor of a computing device may include in accordance with one embodiment of the present invention, and FIG. 4 illustrates components executed by the computing device in accordance with one embodiment of the present invention. 4 is a flow chart illustrating an example of how this can be done.

The computing device 200 according to the present embodiment may provide voice recording management services for clients through a dedicated application installed on the client or by connecting to a web/mobile site associated with the computing device 200 . The computer device 200 may be configured with a computer-implemented voice recording management system.

The processor 220 of the computer device 200 includes a voice recording management unit 310, a voice recording searching unit 320, and a voice recording correcting unit 330 as shown in FIG. 3 as components for executing the voice recording retrieval method according to FIG. may contain Depending on the embodiment, components of processor 220 may be selectively included or excluded from processor 220 . Also, depending on the embodiment, the components of processor 220 may be separated or merged to represent the functionality of processor 220 .

Such processor 220 and components of processor 220 may control computing device 200 to perform steps 410-430 included in the voice recording retrieval method of FIG. For example, processor 220 and components of processor 220 may be implemented to execute instructions according to the code of an operating system and the code of at least one program contained in memory 210 .

Here, the components of processor 220 may represent different functions performed by processor 220 according to instructions provided by program code recorded in computing device 200 . For example, audio recording manager 310 may be utilized as a functional representation of processor 220 controlling computing device 200 according to the instructions described above such that computing device 200 provides audio recordings.

Processor 220 may read the necessary instructions from memory 210 loaded with instructions associated with the control of computing device 200 . In this case, the read instructions may include instructions for controlling processor 220 to perform steps 410-430 described below.

The steps 410-430 described below may be performed in a different order than shown in FIG. 4, some of the steps 410-430 may be omitted, or additional steps may be included. Sometimes.

The voice recording management unit 310 is responsible for managing voice recordings in which voice is converted into text for service provision. The voice recording manager 310 may generate the voice recording by converting the voice received from the client to text. The client-side device may transmit the audio file recorded by executing the recording function, or may transmit the audio file recorded on the device. The voice record manager 310 may use well-known voice recognition techniques to generate voice records that are the result of converting voice data corresponding to utterance segments by the speaker into text. At this time, the voice record manager 310 may apply a speaker diarization technique that divides the utterance period for each speaker in the process of generating the voice record. In the case of a voice file recorded in a situation such as a meeting, an interview, a transaction, a trial, etc., in which many speakers utter in random order, the voice recording management unit 310 automatically divides the utterance contents for each speaker. may be recorded.

In addition, the voice recording management unit 310 may receive a memo created by the client during voice recording or voice playback from the client, match the memo with the corresponding voice recording, and manage the memo. The voice recording manager 310 may match notes created during voice recording or recording based on the time the client recorded the voice. The voice record may include a time stamp indicating the starting point of the speaker's utterance section, and the voice record management unit 310 may manage notes created in the corresponding section based on the time stamp of the voice record. Similarly, the audio recording manager 310 matches memos created during audio recording and audio playback to audio files in which audio recordings exist, based on the time at which the client plays the audio. may be recorded. In other words, the voice recording management unit 310 may match a memo created in a vocalization period at a specific time with a voice recording at the corresponding time and manage the memo.

Referring to FIG. 4, in step 410, the voice record manager 310 may provide the corresponding voice record when receiving a selection command for a particular voice record from the client. At this time, the voice record manager 310 may arrange and display the text for each speaker's utterance section included in the voice record based on the time stamp.

When providing the voice record, the voice record manager 310 may provide the corresponding voice record in association with the matched memo. The voice recording manager 310 may display the voice recording and the memo side by side in a dual-view manner so that the memo created during voice recording or voice playback can be easily and conveniently checked together with the voice recording. The dual view method is a method in which voice recordings and memos are displayed side by side in two rows. It provides an interface that makes it easy to search for dialogue records by displaying them. The voice record management unit 310 can be realized by a method of displaying only one of the voice record and the memo according to the client's selection, in addition to the method of dually displaying the voice record and the memo.

At step 420 , the voice recording search unit 320 may provide a search function for the voice recordings provided at step 410 . At this time, the voice record search unit 320 may search the voice record for words corresponding to the search term and words with a similar pronunciation to the search term. In other words, the audio recording searcher 320 may provide the ability to jointly search for similar words based on pronunciation when attempting to retrieve a particular word from an audio recording.

For example, the voice record search unit 320 may search for synonyms that match the search word, as well as English synonyms and foreign words corresponding to the search word, among words included in the voice record. In particular, the speech record retrieval unit 320 retrieves words uttered with similar pronunciation to the search word by comparison between words based on word separation criteria, for example, glyph units, stem units, term units, and the like. You may search for synonyms that have a certain percentage or more of similarity with the word.

The voice recording search unit 320 may provide a filtering function according to the degree of accuracy indicating similarity to the search word in the search process. For example, the voice recording search unit 320 may set words with a similarity of 90% or more to the search term as search targets and provide search results according to the user's request. Words less than % may be excluded from search results.

The search range may include not only voice recordings but also memos matched with the corresponding voice recordings. You can search for words that

In addition, the voice recording search unit 320 may allow searching by combining words in the searching process. In other words, it may support searches using multiple words. It is possible to realize not only word-by-word retrieval but also sentence-by-sentence retrieval.

The voice record search unit 320 may provide search results for voice records, and at this time, in the voice records, words included in the search results may be displayed separately from other words. For example, the voice recording search unit 320 may display different display elements (eg, highlight color, etc.) of words included in the search result according to accuracy. For example, words with a degree of similarity of 90% or more to the search term are colored in blue, words with a degree of similarity of less than 90% to 70% or more to the search term are colored in light blue, and words with a degree of similarity of less than 70% to the search term are colored in blue. More than 50% of words may be highlighted in gray.

At step 430, the voice recording modifier 330 may modify at least one word included in the search result to another word. For example, the voice record correction unit 330 may correct the words included in the search results to the words input as the search words or new words input by the user. At this time, the voice record correction unit 330 may collectively correct the entire words included in the search results or selectively correct a part of the words included in the search results according to the user's selection. may

Therefore, the processor 220 can provide a search function including words uttered with a pronunciation similar to the search word from the voice record converted from voice to text, and correct the searched word to another word. A modification function that can be used can also be provided.

5-11 show examples of user interface screens for voice recording management in one embodiment of the present invention.

5-11 show an example of a voice recording management screen 500, which is an interface screen on a web/mobile site associated with a dedicated application installed on a client or computing device 200. FIG.

5-9 show an example of an audio recording management screen 500 for explaining the process of creating an audio recording.

Referring to FIG. 5, the voice recording management screen 500 is a home screen configuration of the voice recording management service, and may include a main menu list for providing the service. may include a folder list 501 for The audio recording management screen 500 may also include a "create new note" menu 502 for creating a new audio recording.

Processor 220 may provide voice recording generation screen 610, as shown in FIG. Audio recording generation screen 610 includes a "title" input field 611 for entering the title of the audio recording, a "participant" input field 612 for entering participant information, and a "start recording" menu for audio recording. 613, a "file upload" menu 614 for uploading audio files, and the like. In other words, processor 220 may provide recording functionality and file upload functionality for generating audio recordings.

Processor 220 may provide voice recording screen 720, as shown in FIG. The voice recording screen 720 is a basic recording interface, and may include time information when recording was performed, a pause button for pausing the recording, an end button for ending the recording, and the like.

In particular, voice recording screen 720 may include a notes interface 721 that allows notes to be made while recording, and a bookmark interface 722 that allows bookmarks to be recorded while recording. At this time, the memo interface 721 may include not only a text input function, but also a photograph and video shooting function, a file attachment function, and the like. By using the memo interface 721, the user can create a memo of important contents related to the corresponding voice or contents to be attached during recording as a memo. Thus, a bookmark can be recorded at the recording point of the important section. Memos and bookmarks input during recording may be recorded based on the recording execution time. For example, the recording execution time at the time when the creation of the memo started may be recorded as the memo creation time, and the time when the bookmark was input. may be recorded as the bookmark designated time.

Manual setting using the bookmark interface 722 has been described as a bookmark for an audio recording, but it is not limited to this, and realization by an automatic setting function is also possible. For example, a bookmark may be automatically recorded in a section in which a predetermined main keyword (for example, the title or tag of an audio recording) is uttered.

Processor 220 provides a file search screen to allow the client to search for an audio file when the "file upload" menu 614 is selected from the audio record generation screen 610, and a particular file is selected from the file selection screen. If so, as shown in FIG. 8, a file upload screen 830 may be provided for uploading the selected files. File upload screen 830 may include information about the selected file (eg, file name, file length, etc.) as well as a progress bar 831 that indicates the progress of the file upload.

The processor 220 displays the progress 915 of the voice-to-text generation process of converting voice to text as shown in FIG. It may be displayed on the voice recording generation screen 610 . In the case of recording, the audio file may be uploaded in real time while recording is in progress, or the entire recorded audio file may be uploaded at once upon completion of the recording.

The processor 220 may provide time-matched audio recordings and notes (and bookmarks) together for audio files that have completed the audio recording generation process.

10-11 show an example of a voice recording management screen 500 for explaining the process of providing voice recordings.

When a specific voice record is selected from the file list provided on the voice record management screen 500, the processor 220 provides a voice record detail screen 1000 corresponding to the view mode for the corresponding voice record, as shown in FIG. You can

Processor 220 may display audio recording area 1040 and notes area 1050 on audio recording details screen 1000 . A title 1041 and participant information 1042 input during the process of creating a voice recording may be provided together on the voice recording details screen 1000 .

The processor 220 may provide the voice recording area 1040 and the memo area 1050 as separate tap pages divided on one screen. As another example, both the voice recording area 1040 and the memo area 1050 may be displayed in a dual-view manner according to the screen ratio of the client device.

In the voice recording area 1040, text obtained by converting the voice of the corresponding segment may be displayed for each utterance segment, and a time stamp may be displayed based on the time when the text is uttered in the voice file. The memo area 1050 may display memos created during the recording of the audio file, and each memo may display the recording execution time when the memo creation began as the time stamp of the memo.

When the voice recording area 1040 and the memo area 1050 are provided by a dual view method, the voice recording area 1040 and the memo area 1050 may be displayed in two rows. At this time, the voice recording area 1040 and the memo area 1050 may be matched and displayed based on the time stamp. For example, a memo created at 00 minutes and 02 seconds when speaker 1 uttered may be displayed on the same line as the text of the corresponding utterance section.

When the voice recording area 1040 and the memo area 1050 are provided as separate tap pages, the voice recording area 1040 and the memo area 1050 are simply displayed in chronological order instead of being displayed on the same line based on the time stamp. Therefore, alignment is also possible.

Audio recording details screen 1000 may include a "Search" menu 1001 for searching. When the "search" menu 1001 is selected from the audio recording details screen 1000, the processor 220 may provide a search screen 1160 for the corresponding audio recording, as shown in FIG.

The search screen 1160 may include a search term input field 1161 for entering a search term, and the processor 220 extracts words corresponding to the search term from the voice recording on the voice recording details screen 1000 and words similar to the search term. You may search for pronunciation words and display the search results.

When converting speech to text, words may be recognized as different words depending on their pronunciation, which makes retrieval difficult. For example, even if two people utter the same word ``demo site'', ``demo site'' is accurately recognized in one person's voice, while ``face-to-face site'' (reading in Korean: Daemyung site) may be recognized. When 'demosite' is input as a search term, the processor 220 may provide not only 'demosite' but also a similar-sounding word 'face-to-face site' from the voice recording as a search result.

Processor 220 may highlight words included in search results for the search term in search screen 1160 . At this time, each word may be highlighted in a different color depending on the accuracy of the words included in the search results. Among the search results, words that exactly match the search term are highlighted in a first color (eg, blue), and words that do not match the search term but have similar pronunciations are highlighted in a second color different from the first color. A color (eg, light blue) highlight 1163 may be applied and displayed.

If a filtering condition for the search result is set, for example, if a word with a degree of similarity of 90% or more to the search term is set as the search condition, the processor 220 selects only the word that satisfies the condition as the search result. may be displayed.

Processor 220 may search both voice recording area 1040 and notes area 1050 for a search term, or alternatively, search one of voice recording area 1040 and notes area 1050 according to user settings. Only one may be selectively retrieved.

The processor 220 may provide a search function for search terms as well as a function for correcting words included in search results to search terms. After searching for "face-to-face site" that has a similar pronunciation to the search term "demo site", "face-to-face site" may be corrected to "demo site." The correction function provides an interface for correcting all words in the search results at once or selectively correcting only some words according to the user's selection when correcting the searched word to another word. you can

In this way, according to the embodiment of the present invention, when searching for words from voice-to-text voice recordings, words with similar pronunciations are included in the search, thereby improving the performance of word retrieval of voice recordings. be able to. In addition, according to an embodiment of the present invention, a function of filtering words included in the search results based on pronunciation according to search accuracy, a function of correcting words included in the search results based on pronunciation to other words, etc. are provided. By doing so, the user's convenience in using the service can be enhanced.

The apparatus described above may be realized by hardware components, software components, and/or a combination of hardware and software components. For example, the devices and components described in the embodiments include processors, controllers, arithmetic logic units (ALUs), digital signal processors, microcomputers, field programmable gate arrays (FPGAs), programmable logic units (PLUs), microprocessors, Or may be implemented using one or more general purpose or special purpose computers, such as various devices capable of executing and responding to instructions. The processing unit may run an operating system (OS) and one or more software applications that run on the OS. The processor may also access, record, manipulate, process, and generate data in response to executing software. For convenience of understanding, one processing device may be described as being used, but those skilled in the art will appreciate that a processing device may include multiple processing elements and/or multiple types of processing elements. You can understand that. For example, a processing unit may include multiple processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

Software may include computer programs, code, instructions, or a combination of one or more of these, to configure a processor to operate at its discretion or to independently or collectively instruct a processor. You can Software and/or data may be embodied in any kind of machine, component, physical device, computer storage medium, or device for interpretation by, or for providing instructions or data to, a processing device. good. The software may be stored and executed in a distributed fashion over computer systems linked by a network. Software and data may be recorded on one or more computer-readable recording media.

The method according to the embodiments may be embodied in the form of program instructions executable by various computer means and recorded on a computer-readable medium. Here, the medium may record the computer-executable program continuously or temporarily record it for execution or download. In addition, the medium may be various recording means or storage means in the form of a combination of single or multiple hardware, and is not limited to a medium that is directly connected to a computer system, but is distributed over a network. It may exist in Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROM, RAM, flash memory, etc., and may be configured to store program instructions. Other examples of media include recording media or storage media managed by application stores that distribute applications, sites that supply or distribute various software, and servers.

As described above, the embodiments have been described based on the limited embodiments and drawings, but those skilled in the art will be able to make various modifications and variations based on the above description. For example, the techniques described may be performed in a different order than in the manner described and/or components such as systems, structures, devices, circuits, etc. described may be performed in a manner different from the manner described. Appropriate results may be achieved when combined or combined, opposed or substituted by other elements or equivalents.

Accordingly, different embodiments that are equivalent to the claims should still fall within the scope of the appended claims.

220: Processor 310: Voice Record Manager 320: Voice Record Retrieval Unit 330: Voice Record Modifier

Claims (20)

An audio recording retrieval method performed by a computer device, comprising:
The computing device includes at least one processor configured to execute computer readable instructions contained in memory;
The voice recording retrieval method comprises:
retrieving words corresponding to a search term from an audio recording generated by converting speech to text by the at least one processor , and displaying search results , wherein the retrieving is performed from the audio recording. A voice record retrieval method , comprising: performing retrieval including similar words that are words having a similar pronunciation to the retrieval word, and displaying retrieval results in which the similar words are modified to the retrieval word . The searching step includes:
2. The speech record retrieval according to claim 1, wherein a word having a degree of similarity equal to or greater than a certain percentage with the retrieval word is retrieved as the similar word by comparing words based on a unit in which words are separated. Method. The searching step includes:
retrieving words having a degree of similarity equal to or higher than a certain percentage with the search word as the similar words by comparing words based on at least one of units of letter units, stem units, and term units. A method for retrieving voice recordings according to claim 1. The voice recording retrieval method comprises:
2. The method of claim 1, further comprising: modifying, by the at least one processor, at least one word included in search results to another word. The modifying step includes:
using a function of correcting all words included in the search results at once or a function of selecting and correcting a part of the words included in the search results to correct the other words. 5. The voice recording retrieval method of claim 4, wherein: The searching step includes:
2. The method of claim 1, further comprising: displaying display elements of words included in search results differently according to similarity to the search word. The searching step includes:
2. The method of claim 1, comprising filtering words included in search results based on similarity to the search term. the voice recording is managed by matching notes made during recording or playback of the voice;
The searching step includes:
2. The voice recording retrieval method according to claim 1, wherein said similar words are retrieved using said voice recording and said memo as a retrieval range. The voice recording retrieval method comprises:
2. The method of claim 1, further comprising: providing, by the at least one processor, the audio recording in conjunction with notes made during recording or playback of the audio. The providing step includes:
10. The audio recording retrieval method of claim 9, comprising displaying both the audio recording and the note in a dual-view manner. A computer program for causing a computer to execute the voice recording retrieval method according to any one of claims 1 to 10. A computer device,
at least one processor configured to execute computer readable instructions contained in memory;
The at least one processor
an audio recording retrieval unit for retrieving words corresponding to a search term from an audio recording generated by converting speech to text , and displaying search results , wherein the audio recording retrieval unit retrieves the search term from the audio recording. searching including a similar word that is a word with a similar pronunciation to and displaying a search result in which the similar word is corrected to the search word . The voice recording search unit
13. The computer apparatus according to claim 12, wherein a word having a degree of similarity equal to or higher than a certain percentage with the search word is retrieved as the similar word by comparing words using units in which words are separated. . The voice recording search unit
retrieving words having a degree of similarity equal to or higher than a certain percentage with the search word as the similar words by comparing words based on at least one of units of letter units, stem units, and term units. 13. The computer apparatus of claim 12. The at least one processor
13. The computing device of claim 12, further comprising: a voice recording modifier for modifying at least one word included in the search results to another word. The voice recording correction unit
using a function of correcting all words included in the search results at once or a function of selecting and correcting a part of the words included in the search results to correct the other words. 16. The computer device of claim 15, wherein: The voice recording search unit
13. The computer apparatus of claim 12, wherein display elements of words included in search results are displayed differently according to similarity to the search word. The voice recording search unit
13. The computer apparatus according to claim 12, wherein words included in search results are filtered based on similarity to said search term. the voice recording is managed by matching notes made during recording or playback of the voice;
The voice recording search unit
13. The computer apparatus according to claim 12, wherein the similar word is searched using the voice recording and the memo as a search range. The at least one processor
an audio recording manager that provides the audio recording in conjunction with notes made during recording or playback of the audio;
The voice recording management unit
13. The computer device of claim 12, wherein the audio recording and the notes are provided together in a dual-view manner.

Images