JP2022052695A - Method, system, and computer-readable recording medium for managing text-converted record and memo for voice file together - Google Patents

Abstract

To provide a method and system that can conveniently search for voice record and a memo for a voice file by matching and associatively managing text-converted record and memo, and thus improve convenience in service use to a user.SOLUTION: A voice record management method includes the stages of converting a voice into a text to generate voice record; matching and managing a memo generated in recording or reproduction of the voice; and associatively providing the voice record and the memo.SELECTED DRAWING: Figure 4

Description

The following description relates to a technique for managing voice recordings in which voice is converted into text.

As a flow of mobile voice conversion technology, it is common to record voice with a mobile device, and when the voice recording is completed, convert the voice of the recorded section into text and display it on a display.

As an example of such a voice conversion technique, Patent Document 1 (publication date: May 23, 2014) discloses a technique for performing voice recording and text conversion.

Korean Publication No. 10-2014-0062217

It provides a method and system for matching and managing a recording in which a recorded voice is converted into text and a memo created in connection with the recorded voice.

It provides a method and system for displaying both audio recordings and memos by a dual view method.

It provides a method and system for grouping voice recordings and memos according to various filtering criteria such as speakers and keywords.

A voice recording management method performed by a computer device, wherein the computer device includes at least one processor configured to execute a computer-readable instruction contained in a memory, and the voice recording management method is described above. At the stage where the voice is converted into text by at least one processor to generate a voice recording, the memo created during the recording or playback of the voice by the at least one processor is managed by matching with the voice recording. Provided is a voice recording management method including a step and a step of linking and providing the voice recording and the memo by the at least one processor.

According to one aspect, the provided step may include displaying both the audio recording and the memo by a dual view scheme.

According to another aspect, the provided step may include a step of temporally matching and displaying the voice recording and the memo based on the time stamp.

According to another aspect, the provided stage is, in the case of the voice recording, a stage of displaying a time stamp indicating the base point of the corresponding section for each text of the speaker vocalization section, and in the case of the memo. Each memo may include a step of displaying a time stamp indicating the audio recording time or audio reproduction time at the time of memo creation.

According to another aspect, the provided stage is a stage in which a memo tag is displayed depending on the presence or absence of a memo created in the corresponding section with respect to the text of the speaker utterance section included in the voice recording, and the memo tag is When selected, it may include the step of displaying the full text of the memo created in the vocalization section of the text.

Further, according to another aspect, the generation step may include a step of receiving a voice file recorded by the client or a voice file uploaded by the client and converting the voice data corresponding to the speaker vocalization section into text. ..

Further, according to another aspect, in the management step, the memo created during the recording or reproduction of the voice may be matched and managed based on the time stamp of the voice recording.

Further, according to another aspect, in the management stage, the memo created in the speaker vocalization section of the voice and the voice recording of the speaker vocalization section may be matched and managed.

According to another aspect, the voice recording management method further includes the step of recording a bookmark in at least one speaker vocalization section by the at least one processor during recording or reproduction of the voice. The step may include a step of providing an editing function for the text of the speaker vocalization section in which the bookmark is recorded among the texts included in the voice recording.

According to yet another aspect, the providing step may include the step of grouping and providing at least one of the voice recording and the memo by utilizing the speaker or the keyword.

Provided is a computer-readable recording medium in which a program for causing a computer to execute the voice recording management method is recorded.

A computer device that includes at least one processor configured to execute a computer-readable instruction contained in memory, said at least one processor that converts speech into text to produce a speech recording. A recording generation unit, a memo matching management unit that manages a memo created during recording or playback of the voice by matching with the voice recording, and a voice recording providing unit that links the voice recording and the memo. Provides computer equipment, including.

According to the embodiment of the present invention, the recorded voice converted into text and the memo created in connection with the recorded voice are matched and displayed by the dual view, thereby making the voice recording and the memo convenient. You can explore.

According to the embodiment of the present invention, by providing a filtering function for grouping voice recordings and memos by speaker or keyword, it is possible to improve the convenience of the user for using the service.

It is a figure which showed the example of the network environment in one Embodiment of this invention. It is a block diagram which showed the example of the computer apparatus in one Embodiment of this invention. It is a figure which showed the example of the component which can include the processor of the computer apparatus in one Embodiment of this invention. It is a flowchart which showed the example of the method which a computer apparatus can execute in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention. It is a figure which showed the example of the user interface screen for voice recording management in one Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The voice recording management system according to the embodiment of the present invention may be realized by at least one computer device, and the voice recording management method according to the embodiment of the present invention is realized by at least one computer device included in the voice recording management system. May be executed. At this time, in the computer device, the computer program according to the embodiment of the present invention may be installed and executed, and the computer device may control the computer program to be executed and the voice recording management method according to the embodiment of the present invention. May be executed. The computer program described above may be coupled to a computer device and recorded on a computer-readable recording medium for the computer to perform a voice recording management method.

FIG. 1 is a diagram showing an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Such FIG. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited as in FIG. Further, the network environment of FIG. 1 is merely an example of an environment applicable to the present embodiment, and the environment applicable to the present embodiment is not limited to the network environment of FIG.

The plurality of electronic devices 110, 120, 130, 140 may be fixed terminals or mobile terminals realized by a computer device. Examples of a plurality of electronic devices 110, 120, 130, 140 include smartphones, mobile phones, navigation systems, PCs (personal computers), notebook PCs, digital broadcasting terminals, PDAs (Personal Digital Assistants), and PMPs (Portable Multimedia Players). ), Tablets, etc. As an example, FIG. 1 shows a smartphone as an example of the electronic device 110, but in the embodiment of the present invention, the electronic device 110 substantially utilizes a wireless or wired communication method, and another via the network 170. It may mean one of a variety of physical computer devices capable of communicating with the electronic devices 120, 130, 140 and / or the servers 150, 160.

The communication method is not limited, and not only the communication method using the communication network (for example, mobile communication network, wired Internet, wireless Internet, broadcasting network) that can be included in the network 170, but also the short distance between devices. Wireless communication may be included. For example, the network 170 includes a PAN (personal area network), a LAN (local area network), a CAN (campus area network), a MAN (metropolitan area network), a WAN (wise Internet) network, etc. It may include any one or more of the networks. Further, network 170 may include, but is limited to, any one or more of network topologies, including bus networks, star networks, ring networks, mesh networks, star-bus networks, tree or hierarchical networks, and the like. Will not be done.

Each of the servers 150, 160 is realized by one or more computer devices that communicate with a plurality of electronic devices 110, 120, 130, 140 via a network 170 to provide instructions, codes, files, contents, services, and the like. good. For example, the server 150 provides services to a plurality of electronic devices 110, 120, 130, 140 connected via the network 170 (for example, a voice recording management service (or minutes management service), a content providing service, and a group call service. (Or voice conferencing service), messaging service, mail service, social network service, map service, translation service, financial service, payment service, search service, etc.) may be provided.

FIG. 2 is a block diagram showing an example of a computer device according to an embodiment of the present invention. Each of the plurality of electronic devices 110, 120, 130, 140 and the servers 150, 160 described above may be realized by the computer device 200 shown in FIG.

Such a computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input / output interface 240, as shown in FIG. The memory 210 is a computer-readable recording medium and may include a permanent mass recording device such as a RAM (random access memory), a ROM (read only memory), and a disk drive. Here, a permanent large-capacity recording device such as a ROM or a disk drive may be included in the computer device 200 as a permanent recording device separate from the memory 210. Further, the memory 210 may record an operating system and at least one program code. Such software components may be loaded into memory 210 from a computer-readable recording medium separate from memory 210. Such other computer-readable recording media may include computer-readable recording media such as floppy (registered trademark) drives, discs, tapes, DVD / CD-ROM drives, and memory cards. In other embodiments, software components may be loaded into memory 210 through a communication interface 230 that is not a computer-readable recording medium. For example, software components may be loaded into memory 210 of computer equipment 200 based on a computer program installed by a file received over network 170.

Processor 220 may be configured to process instructions in a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to processor 220 by memory 210 or communication interface 230. For example, the processor 220 may be configured to execute instructions received according to program code recorded in a recording device such as memory 210.

The communication interface 230 may provide a function for the computer device 200 to communicate with another device (for example, the recording device described above) via the network 170. As an example, requests, instructions, data, files, etc. generated by the processor 220 of the computer device 200 according to the program code recorded in the recording device such as the memory 210 are sent via the network 170 under the control of the communication interface 230. May be transmitted to the device of. On the contrary, signals, instructions, data, files and the like from other devices may be received by the computer device 200 via the communication interface 230 of the computer device 200 via the network 170. Signals, instructions, data and the like received through the communication interface 230 may be transmitted to the processor 220 and the memory 210, and the files and the like may be further contained in a recording medium (the above-mentioned permanent recording device) that can be included in the computer device 200. May be recorded.

The input / output interface 240 may be a means for an interface with the input / output device 250. For example, the input device may include a device such as a microphone, keyboard, mouse, and the output device may include a device such as a display, speaker, and the like. As another example, the input / output interface 240 may be a means for an interface with a device that integrates functions for input and output, such as a touch screen. The input / output device 250 may be composed of a computer device 200 and one device.

Also, in other embodiments, the computer device 200 may include fewer or more components than the components of FIG. However, most prior art components need not be clearly shown in the figure. For example, the computer device 200 may be implemented to include at least a portion of the input / output devices 250 described above, or may further include other components such as transceivers, databases, and the like.

In the following, a method of providing both recording and memo for an audio file and a specific embodiment of the system will be described.

Recent mobile devices provide voice recording and memo functions, and many people have come to utilize the recording function in various situations such as meetings. At this time, apart from the recording, it is often the case that individual notes are taken regarding important contents and attached contents.

In the conventional technology, since the voice recording function and the memo function are provided as individual functions, it is difficult to check the voice recording file and the memo at the same time, and it is often the case that the contents are guessed while looking at the memo. In other words, there was no choice but to check the voice and the memo separately, which made it difficult to check the memo while grasping the overall flow of the recorded content.

In order to solve such a problem, in the present embodiment, the result of converting the recorded voice into text (hereinafter referred to as "voice recording") and the memo created in connection with the recorded voice are used. Provides a voice recording management service that matches and manages.

The present embodiment provides a voice recording function including voice recording and text conversion and a memo function as one integrated function, and an object thereof is to match and manage voice recording and memo together.

FIG. 3 is a block diagram showing an example of components that can be included in a processor of a computer device according to an embodiment of the present invention, and FIG. 4 is a block diagram performed by the computer device according to the embodiment of the present invention. It is a flowchart which showed the example of the possible method.

The computer device 200 according to the present embodiment may provide a voice recording management service to a client by connecting to a dedicated application installed on the client or a web / mobile site related to the computer device 200. The computer device 200 may be configured with a voice recording management system realized by a computer.

As shown in FIG. 3, the processor 220 of the computer device 200 has a voice recording generation unit 310, a memo matching management unit 320, and a voice recording providing unit 330 as components for executing the voice recording management method according to FIG. May include. Depending on the embodiment, the components of the processor 220 may be selectively included or excluded from the processor 220. Also, depending on the embodiment, the components of the processor 220 may be separated or merged to represent the functionality of the processor 220.

Such a processor 220 and components of the processor 220 may control the computer apparatus 200 to perform steps 410 to 430 included in the audio recording management method of FIG. For example, the processor 220 and the components of the processor 220 may be implemented to execute an instruction by the code of the operating system included in the memory 210 and the code of at least one program.

Here, the components of the processor 220 may be representations of different functions that are executed by the processor 220 according to the instructions provided by the program code recorded in the computer apparatus 200. For example, the audio recording generator 310 may be used as a functional representation of the processor 220 that controls the computer apparatus 200 in accordance with the instructions described above so that the computer apparatus 200 generates audio recordings.

The processor 220 may read the necessary instructions from the memory 210 in which the instructions related to the control of the computer device 200 are loaded. In this case, the read instruction may include an instruction for controlling the processor 220 to execute steps 410 to 430 described below.

Steps 410-430, described below, may be performed in a different order than that shown in FIG. 4, and some of steps 410-430 may be omitted or include additional steps. Sometimes.

Referring to FIG. 4, at step 410, the voice recording generation unit 310 may convert the voice received from the client into text to generate a voice recording. On the client-side device, the recording function may be executed to transmit the recorded audio file, or the audio file recorded on the device may be transmitted. The voice recording generation unit 310 may generate a voice recording as a result of converting the voice data corresponding to the voiced section by the speaker into text by using a well-known voice recognition technique. At this time, the voice recording generation unit 310 may apply the speaker division technique for dividing the utterance section for each speaker in the process of generating the voice recording. The voice recording generation unit 310 automatically divides the utterance content for each speaker in the case of a voice file recorded in a situation where many speakers utter in no particular order, such as a conference, an interview, a transaction, or a trial. You may record it.

At step 420, the memo matching management unit 320 may receive a memo created by the client during voice recording or voice reproduction from the client and manage it by matching it with the voice recording generated in step 410. The memo matching management unit 320 may match the memos created during the voice recording and the recording execution based on the time when the client recorded the voice. The voice recording may include a time stamp indicating the base point of the speaker vocalization section, and the memo matching management unit 320 may manage the memos created in the corresponding section based on the time stamp of the voice recording. Similarly, the memo matching management unit 320 matches the memo created during the voice recording and the voice playback with the voice file in which the voice recording exists, based on the time when the client plays the voice. You may record it. In other words, the memo matching management unit 320 can manage the memo created in the utterance section at a specific time point by matching it with the voice recording at the time point.

At step 430, when the voice recording providing unit 330 receives the selection command for the voice recording from the client, the voice recording providing unit 330 may provide the corresponding voice recording in association with the memo matched with the voice recording. The voice recording provider 330 displays the voice recording and the memo side by side by the dual view method so that the memo created during the voice recording or the memo created during the voice reproduction can be easily and conveniently confirmed together with the voice recording. good. The dual view method is a method of displaying a voice recording and a memo side by side in two columns. In this method, a voice recording in which voice is converted into text and a memo created at the recording time and playback time of the corresponding voice are arranged side by side. It provides an interface that makes it easy to search dialogue records by displaying them. The voice recording providing unit 330 can be realized by a method of displaying one of the voice recording and the memo independently according to the client's selection, in addition to the method of dual-displaying the voice recording and the memo. ..

5 to 15 are diagrams showing an example of a user interface screen for voice recording management in the embodiment of the present invention.

5 to 15 are interface screens on a web / mobile site related to a dedicated application installed on a client or a computer device 200, and show an example of a voice recording management screen 500.

5 to 9 show an example of a voice recording management screen 500 for explaining a process of generating a voice recording.

Referring to FIG. 5, the voice recording management screen 500 is a home screen configuration of the voice recording management service, and may include a main menu list for providing the service. As an example, the voice recording is managed in folder units. Folder list 501 for this may be included. Further, the voice recording management screen 500 may include a "new note creation" menu 502 for generating a new voice recording.

The processor 220 may provide the voice recording generation screen 610, as shown in FIG. 6, when the "new note creation" menu 502 is selected from the voice recording management screen 500. The voice recording generation screen 610 has a "title" input field 611 for inputting a voice recording title, a "participant" input field 612 for inputting participant information, and a "recording start" menu for voice recording. 613, a "file upload" menu 614 for uploading audio files, and the like may be included. In other words, the processor 220 may provide recording and file uploading capabilities to generate audio recordings.

The processor 220 may provide a voice recording screen 720, as shown in FIG. 7, when the "recording start" menu 613 is selected from the voice recording generation screen 610. The voice recording screen 720 is a basic recording interface, and may include information on the time when the recording was executed, a pause button for pausing the recording, an end button for ending the recording, and the like.

In particular, the voice recording screen 720 may include a memo interface 721 that allows a memo to be created during recording and a bookmark interface 722 that allows bookmarks to be recorded during recording. At this time, the memo interface 721 may include not only text input but also a photo and moving image shooting function, a file attachment function, and the like. By using the memo interface 721, the user can create important contents and attached contents related to the corresponding voice as a memo during recording, and uses the bookmark interface 722 in addition to the memo. Therefore, the bookmark can be recorded at the time of recording the important section. The memo or bookmark entered during recording may be recorded based on the recording execution time. For example, the recording execution time at the time when the memo creation starts may be recorded in the memo creation time, and the time when the bookmark is input. The recording execution time of is recorded as the bookmark specified time.

As the bookmark for voice recording, the manual setting using the bookmark interface 722 is described, but the setting is not limited to this, and the bookmark can be realized by the automatic setting function. For example, a bookmark may be automatically recorded in a section in which a predetermined main keyword (for example, a title or tag of a voice recording) is uttered.

The processor 220 provides a file search screen for allowing the client to search for a voice file when the "file upload" menu 614 is selected from the voice record generation screen 610, and a specific file is selected from the file search screen. If so, as shown in FIG. 8, a file upload screen 830 for uploading the selected file may be provided. The file upload screen 830 may include a progress bar 831 indicating the progress of the file upload, along with information about the selected file (eg, file name, file length, etc.).

When the voice recording by the voice recording screen 720 is completed or the file upload by the file upload screen 830 is completed, the processor 220 determines the progress 915 of the voice recording generation process for converting the voice into text, as shown in FIG. It may be displayed on the voice recording generation screen 610. In the case of recording, the audio file may be uploaded in real time at the same time as the recording, or the entire recorded audio file may be uploaded at once when the recording is completed.

The processor 220 may provide the voice recording and the memo (and the bookmark) together with the voice file for which the voice recording generation process has been completed, matching in time.

10 to 15 are diagrams showing an example of a voice recording management screen 500 for explaining a process of providing voice recording.

Referring to FIG. 10, when a specific audio recording is selected from the file list provided on the audio recording management screen 500, the processor 220 and the audio recording area 1040 by the dual view method for the audio recording of the corresponding title. The memo area 1050 may be displayed together. The voice recording management screen 500 may be provided with the title 1041 and the participant information 1042 input in the voice recording generation process, and may include a controller area 1060 for controlling the reproduction of the voice file.

In the voice recording area 1040, the text obtained by converting the voice of each section may be displayed for each utterance section. At this time, the time stamp may be displayed based on the time when the text is displayed in the audio file. In the memo area 1050, a memo created during the recording of the audio file may be displayed, and the recording execution time at the time when the memo creation starts may be displayed as a time stamp of the corresponding memo in each memo.

The processor 220 may display the voice recording area 1040 and the memo area 1050 side by side in two columns. At this time, the voice recording area 1040 and the memo area 1050 may be displayed by matching with each other based on the time stamp. For example, the memo created at 00:02 seconds when the speaker 1 utters may be displayed on the same line as the text of the utterance section.

Instead of displaying the voice recording area 1040 and the memo area 1050 on the same line based on the time stamp, it is also possible to simply arrange them in the respective time order. In addition to this, the method of arranging the voice recording area 1040 and the memo area 1050 can be changed as long as it is within the range of the dual view method.

The controller area 1060 may include a progress bar, a play / pause button, a fast forward button, a rewind button, a volume control button, etc., and a memo indicator 1061 indicating the section in which the memo was created and a section in which the bookmark is recorded. A bookmark indicator 1062 may be displayed on the progress bar.

Display elements of the indicator (eg, color, shape, etc.) may be applied differently from each other so that the memo indicator 1061 and the bookmark indicator 1062 can be distinguished at a glance.

When the user selects the text of a specific utterance section from the voice recording area 1040, the processor 220 may reproduce the voice of the section. Similarly, when selecting a specific memo from the memo area 1050, the voice of the section in which the corresponding memo is created may be reproduced.

The processor 220 may synchronize the selection area between the voice recording area 1040 and the memo area 1050. For example, when the user selects text in a specific vocalization section from the voice recording area 1040, the memo in the memo area 1050 created in the corresponding section may be highlighted.

The user can check the voice recording area 1040 and the memo area 1050 at the same time, and the memo indicator 1061 and the bookmark indicator 1062 on the progress bar in the controller area 1060 enable a simple and convenient search. It is possible to grasp at a glance.

Referring to FIG. 11, the processor 220 may display the text of the vocalization section for which the bookmark is specified in the voice recording area 1040 separately from the text of the other section, for example, the bookmark icon for the text of the corresponding section. 1171 may be displayed. In addition to displaying the bookmark icon 1171, it is also possible to apply highlights to the text of the vocalization section to which the bookmark is specified.

Further, the processor 220 may provide an "edit" menu 1172 for the text in the vocalized section for which the bookmark is designated in the voice recording area 1040, and may guide the text editing in the bookmarked section.

When the "Edit" menu 1172 is selected for the text of the vocalized section for which the bookmark is specified in the voice recording area 1040, the processor 220 enables the text of the section to be edited as shown in FIG. The edit screen 1270 may be provided. The text of the vocalization section for which the bookmark is specified in the voice recording area 1040 may be updated with the text edited on the edit screen 1270.

The processor 220 may provide an editing function for each of the texts in the utterance section in addition to the bookmark section included in the voice recording area 1040, so that the memo included in the memo area 1050 can be edited. Functions may be provided.

Further, the processor 220 may provide a filtering function by grouping using a speaker, a keyword, or the like for the voice recording area 1040 and the memo area 1050.

When a specific speaker is selected from the voice recording area 1040, the processor 220 may group and display at least one of the voice recording and the memo for the vocalization section of the speaker. In other words, the voice recording of the section uttered by a specific speaker and the memo created for the utterance section of the corresponding speaker may be displayed together.

Further, the processor 220 can also group and display at least one of the voice recording and the memo including the keyword based on the keyword input by the user. In the case of memo grouping using keywords, memos containing the relevant keyword or memos created in the vocalization section containing the relevant keyword may be grouped. In addition to speakers and keywords, various criteria that can classify voice recordings and memos may be used for filtering.

In addition to the dual view system that displays both the voice recording area 1040 and the memo area 1050, the processor 220 selectively displays one of the voice recording area 1040 and the memo area 1050 according to the user's selection. Modes may be provided.

Referring to FIG. 13, the processor 220 may display only the memo area 1050 without displaying the voice recording area 1040. At this time, a controller area 1060 for controlling the reproduction of the audio file may be provided together.

The user can check the memo contained in the memo area 1050 while listening to the voice, and the processor 220 may further provide an interface that allows additional memos to be created during voice reproduction.

Referring to FIG. 14, the processor 220 may display only the voice recording area 1040 without displaying the memo area 1050. At this time, a controller area 1060 for controlling the reproduction of the audio file may be provided together.

In the view mode in which only the voice recording area 1040 is displayed, the text of the vocalization section in which the memo is created in the voice recording area 1040 may be displayed separately from the texts of other sections. The memo icon 1441 may be displayed as a tag indicating that the created memo exists.

When the memo icon 1441 of a specific text is selected from the voice recording area 1040, the processor 220 may display the full text 1580 of the memo created in the vocalization section of the text, as shown in FIG.

Not only the dual view mode that displays both the voice recording area 1040 and the memo area 1050, but also the view mode that selectively displays one of the voice recording area 1040 and the memo area 1050 enables mutual search and confirmation. Interfaces may be provided.

As described above, according to the embodiment of the present invention, the recording of the recorded voice converted into text and the memo created in connection with the recorded voice are matched and displayed as a dual view to perform voice recording. You can conveniently search for notes.

Further, according to the embodiment of the present invention, it is possible to improve the convenience of the user for using the service by providing the filtering function for grouping the voice recording and the memo for each speaker or keyword.

The devices described above may be implemented by hardware components, software components, and / or combinations of hardware components and software components. For example, the apparatus and components described in the embodiments include a processor, a controller, an ALU (arithmetic logic unit), a digital signal processor, a microcomputer, an FPGA (field programgable gate array), a PLU (programmable log unit), a microprocessor, and the like. Alternatively, it may be implemented using one or more general purpose computers or special purpose computers, such as various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also respond to the execution of the software, access the data, and record, manipulate, process, and generate the data. For convenience of understanding, one processing device may be described as being used, but those skilled in the art may include a plurality of processing elements and / or a plurality of types of processing elements. You can understand that. For example, the processing device may include multiple processors or one processor and one controller. Also, other processing configurations such as parallel processors are possible.

The software may include computer programs, codes, instructions, or a combination of one or more of these, configuring the processing equipment to operate at will, or instructing the processing equipment independently or collectively. You may do it. The software and / or data is embodied in any type of machine, component, physical device, computer recording medium or device to be interpreted based on the processing device or to provide instructions or data to the processing device. good. The software is distributed on a computer system connected by a network and may be recorded or executed in a distributed state. The software and data may be recorded on one or more computer-readable recording media.

The method according to the embodiment may be realized in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. Here, the medium may be a continuous recording of a computer-executable program or a temporary recording for execution or download. Further, the medium may be various recording means or storage means in the form of a combination of a single piece of hardware or a plurality of pieces of hardware, and is not limited to a medium directly connected to a certain computer system, but is distributed over a network. It may exist. Examples of media include hard disks, floppy (registered trademark) disks, magnetic media such as magnetic tapes, optical media such as CD-ROMs and DVDs, optical magnetic media such as floptic discs, and the like. And may include ROM, RAM, flash memory, etc., and may be configured to record program instructions. Other examples of media include recording media or storage media managed by application stores that distribute applications, sites that supply or distribute various other software, servers, and the like.

As described above, the embodiments have been described based on the limited embodiments and drawings, but those skilled in the art will be able to make various modifications and modifications from the above description. For example, the techniques described may be performed in a different order than the methods described, and / or components such as the systems, structures, devices, circuits described may be in a different form than the methods described. Appropriate results can be achieved even if they are combined or combined, and confronted or replaced by other components or equivalents.

Therefore, even if it is a different embodiment, if it is equivalent to the claims, it belongs to the attached claims.

222: Processor 310: Voice recording generation unit 320: Memo matching management unit 330: Voice recording providing unit

Claims (20)

A voice recording management method performed by a computer device.
The computer device comprises at least one processor configured to execute a computer-readable instruction contained in memory.
The voice recording management method is
The step of converting speech into text by the at least one processor to generate a speech recording,
A step of matching and managing a memo created during recording or playback of the voice by the at least one processor, and linking the voice recording and the memo by the at least one processor. Audio recording management methods, including the steps to provide. The above-mentioned stage of provision is
The voice recording management method according to claim 1, further comprising displaying both the voice recording and the memo by a dual view method. The above-mentioned stage of provision is
The voice recording management method according to claim 1, further comprising a step of temporally matching and displaying the voice recording and the memo based on a time stamp. The above-mentioned stage of provision is
For the voice recording, the stage of displaying a time stamp indicating the base point of the corresponding section for each text of the speaker vocalization section, and for each memo, the voice recording time or voice reproduction time at the time of memo creation is shown. The audio recording management method according to claim 1, which comprises a step of displaying a time stamp. The above-mentioned stage of provision is
For the text of the speaker vocalization section included in the voice recording, the stage of displaying the memo tag depending on the presence or absence of the memo created in the corresponding section, and when the memo tag is selected, it is created in the vocalization section of the corresponding text. The voice recording management method according to claim 1, which comprises a step of displaying the full text of the memo. The generation stage is
The voice recording management method according to claim 1, further comprising a step of receiving a voice file recorded by a client or a voice file uploaded by the client and converting voice data corresponding to a speaker vocalization section into text. The management stage is
The voice recording management method according to claim 1, wherein the memos created during recording or reproduction of the voice are matched and managed based on the time stamp of the voice recording. The stage of managing the memo created in the speaker vocalization section of the voice by matching with the voice recording of the speaker vocalization section is
The voice recording management method according to claim 1, wherein the created memo is managed by matching with the voice recording of the speaker vocalization section for each speaker vocalization section of the voice. The voice recording management method is
Further including the step of recording a bookmark in at least one speaker vocalization section by the at least one processor during recording or reproduction of the voice.
The above-mentioned stage of provision is
The voice recording management method according to claim 1, further comprising a step of providing an editing function for the text of the speaker vocalization section in which the bookmark is recorded among the texts included in the voice recording. The above-mentioned stage of provision is
The voice recording management method according to claim 1, further comprising a step of grouping and providing at least one of the voice recording and the memo by using a speaker or a keyword. A computer-readable recording medium in which a program for causing a computer to execute the voice recording management method according to any one of claims 1 to 10 is recorded. It ’s a computer device,
Contains at least one processor configured to execute computer-readable instructions contained in memory.
The at least one processor
Voice recording generator, which converts voice to text and generates voice recording
A computer device including a memo matching management unit that matches and manages a memo created during recording or playback of the voice with the voice recording, and a voice recording providing unit that links the voice recording with the memo and manages the memo. .. The voice recording providing unit is
The computer device according to claim 12, wherein both the voice recording and the memo are displayed by the dual view method. The voice recording providing unit is
The computer device according to claim 12, wherein the voice recording and the memo are temporally matched and displayed with reference to a time stamp. The voice recording providing unit is
In the case of the voice recording, a time stamp indicating the base point of the corresponding section is displayed for each text of the speaker vocalization section.
The computer device according to claim 12, wherein in the case of the memo, a time stamp indicating a voice recording time or a voice reproduction time at the time of creating the memo is displayed for each memo. The voice recording providing unit is
For the text of the speaker utterance section included in the voice recording, a memo tag is displayed depending on the presence or absence of the memo created in the corresponding section.
12. The computer device according to claim 12, wherein when the memo tag is selected, the full text of the memo created in the vocalization section of the corresponding text is displayed. The voice recording generation unit is
The computer device according to claim 12, wherein the computer device according to claim 12, receives a voice file recorded by a client or a voice file uploaded by the client, and converts voice data corresponding to a speaker vocalization section into text. The memo matching management unit
The computer device according to claim 12, wherein the memos created during the recording or reproduction of the voice are matched and managed based on the time stamp of the voice recording. The memo matching management unit
A bookmark is recorded in at least one speaker vocalization section during recording or playback of the voice.
The voice recording providing unit is
The computer device according to claim 12, wherein among the texts included in the voice recording, an editing function is provided for the text of the speaker vocalization section in which the bookmark is recorded. The voice recording providing unit is
12. The computer device according to claim 12, wherein at least one of the voice recording and the memo is grouped and provided by using a speaker or a keyword.

Images