KR20190097924A - Terminal apparatus and method for providing recording service thereby - Google Patents

Abstract

According to one embodiment of the present invention, disclosed is a method for providing a recording service. The method comprises the steps of: executing a voice recording function; storing integrated content including voice content generated according to the voice recording function; obtaining text content converted from the voice content according to a user request; and displaying the text content on a screen.

Description

Terminal device and method of providing recording service by the same {TERMINAL APPARATUS AND METHOD FOR PROVIDING RECORDING SERVICE THEREBY}

The present invention relates to the field of service provision. More specifically, the present invention relates to a terminal device and a recording service providing method thereof.

In an environment of meetings, seminars, lectures, and consultations (hereinafter referred to as speech environment), users communicate through conversations, and it is not easy to remember the conversations made in the speech environment unless the conversations are recorded separately.

Users may consider a method of recording a conversation using a recorder or the like, but since the recorded content is a voice file, the user has no choice but to play and listen to it. In addition, even if you want to share the contents of the conversation in the speech environment to other users can only be delivered to the voice file, it can be difficult to write the minutes.

As another method, a method of directly recording a conversation content in a document during a conversation in a speech environment may be considered. In this case, it is difficult to participate in the conversation.

Accordingly, there is a need for a method for generating a text content of a conversation made in a speech environment so that a user can easily review and share with other users smoothly.

According to an aspect of the present invention, a terminal device and a method of providing a recording service according to the present invention have a technical problem of converting a conversation content in a speech environment into text content.

In addition, the terminal device according to an embodiment of the present invention and the recording service providing method according to the present invention to enable the recording of various information related to the speech environment in addition to the text conversion function.

Method for providing a recording service according to an embodiment of the present invention,

Executing a voice recording function; Storing integrated content including voice content generated according to the voice recording function; Acquiring the converted text content from the voice content according to a user's request; And displaying the text content on the screen.

The recording service providing method may further include executing a recording function according to the user's operation while executing the voice recording function, and storing the integrated content may be performed according to the recording function together with the audio content. The method may include storing the generated image content in the integrated content.

The acquiring of the text content may include acquiring the text content according to the payment confirmation of the user.

The displaying may include setting at least one word selected from the text content as a tag; And displaying the set tag on the screen.

The recording service providing method may further include displaying, on the screen, an area to which a word corresponding to a tag selected by the user belongs among the text contents as one tag among the tags displayed on the screen is selected by the user. It may include.

The integrated content may further include information on at least one of a place, a time, and an attendant associated with the integrated content.

The recording service providing method may further include obtaining location information of the terminal device when the voice recording function is executed, and storing the integrated content may include location information of the terminal device for the place. It may further include the step of including in the integrated content as information.

The recording service providing method may further include receiving schedule information from a user, and the executing of the voice recording function may include automatically executing the voice recording function based on the schedule information. have.

Automatically executing the voice recording function may include automatically executing the voice recording function when a current situation corresponds to the schedule information.

The recording service providing method may further include acquiring information about another terminal communicating with the terminal device during a predetermined time interval before the voice recording function is executed. The storing of the integrated content may include: And including user information of another terminal in the integrated content as attendee information.

The storing of the integrated content may include determining attendee information according to an analysis result of the voice content; And including the determined attendee information in the integrated content.

The displaying may include mapping the identification information of the participant determined as a result of analyzing the voice content to sentences included in the text content and displaying the same.

The recording service providing method may further include transmitting the voice content to a management server according to a shorthand request of the user; And acquiring the shortened text content from the management server or the shorthand terminal based on the voice content.

The shorthand text content may be shorthand notarized by a shorthand.

Terminal device according to another embodiment of the present invention,

A controller for executing a voice recording function; A memory for storing integrated content including voice content generated according to the voice recording function; And a display for displaying the text content converted from the voice content on the screen according to a user's request.

The terminal device and the recording service providing method according to an embodiment of the present invention may convert the conversation contents in the speech environment into text contents.

In addition, the terminal device and the recording service providing method according to an embodiment of the present invention enable to record various information related to the speech environment in addition to the text conversion function.

However, the effects achievable by the terminal device and the recording service providing method according to an embodiment of the present invention are not limited to those mentioned above, and other effects not mentioned are not described in the following description. Will be clearly understood by those of ordinary skill in the art.

BRIEF DESCRIPTION OF THE DRAWINGS In order to better understand the drawings referred to herein, a brief description of each drawing is provided.
1 is an exemplary diagram illustrating a terminal device and a management server according to an embodiment of the present invention.
2 is a flowchart illustrating a recording service providing method according to an embodiment of the present invention.
3A to 3F are exemplary diagrams illustrating screens displayed on a terminal device according to use of a recording service.
4 is a flowchart for describing operation S210 of FIG. 2 in detail.
5 is a block diagram illustrating a configuration of a terminal device according to an embodiment of the present invention.

The present invention may be variously modified and have various embodiments, and specific embodiments are illustrated in the drawings and described in detail with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, it should be understood that the present invention includes all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

In describing the present invention, when it is determined that the detailed description of the related known technology may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, the numbers (eg, first, second, etc.) used in the description process of the present specification are merely identification symbols for distinguishing one component from another component.

In addition, in the present specification, when one component is referred to as "connected" or "connected" with another component, the one component may be directly connected or directly connected to the other component, but in particular It is to be understood that, unless there is an opposite substrate, it may be connected or connected via another component in the middle.

In addition, in the present specification, the components represented by '~ unit (unit)', 'module', etc., two or more components are combined into one component or two or more components for each functionalized function May be differentiated into In addition, each component to be described below may additionally perform some or all of the functions of other components in addition to the main functions of which they are responsible, and some of the main functions of each of the components may be different. Of course, it may be carried out exclusively by the component.

Hereinafter, embodiments according to the spirit of the present invention will be described in detail.

1 is an exemplary diagram illustrating a terminal device 100 and a management server 200 according to an embodiment of the present invention.

Referring to FIG. 1, the terminal device 100 according to an embodiment of the present invention may communicate with the management server 200 through a network. Here, the network may include a wired network and a wireless network. Specifically, the network may include various types such as a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), and the like. It may include a network. The network may also include a known World Wide Web (WWW). However, the network according to the present invention is not limited to the networks listed above, and may include at least a part of a known wireless data network, a known telephone network, and a known wired and wireless television network.

The terminal device 100 may download and execute an application (hereinafter, referred to as a recording application) for using a recording service from the management server 200 or an app server (for example, Google's Play Store, Apple's App Store, etc.). .

The terminal device 100 may provide a recording service to a user by executing a recording application. 1 illustrates a smart phone as a terminal device 100 according to an embodiment of the present invention, this is only one embodiment, and in addition to the smart phone as long as the device has a communication function through a network and a function of installing and executing an application. Various mobile devices such as laptops, tablet PCs, and smart watches may be included.

After executing the recording application, the terminal device 100 may provide a recording service alone (that is, stand alone method) without communication with the management server 200 or through communication with the management server 200 (that is, client-server method) You can also provide a recording service.

The terminal device 100 according to an embodiment of the present invention not only provides a recording function, but also improves user convenience by recording not only speech contents generated in a user's speech environment but also various additional information related to the speech environment. can do.

Hereinafter, an operation of the terminal device 100 will be described in detail with reference to FIG. 2.

2 is a flowchart illustrating a recording service providing method according to an embodiment of the present invention.

In operation S210, the terminal device 100 executes a voice recording function. The terminal device 100 may execute a voice recording function manually or automatically in a specific situation according to a user's operation.

As the voice recording function is executed, voice generated in the speech environment is recorded as a voice file.

In operation S220, the terminal device 100 stores the integrated content including the voice content generated by the voice recording function (for example, the voice file itself or metadata indicating the same).

According to an embodiment of the present invention, the integrated content may further include image content as well as voice content, and may further include at least one additional content among place information, time information, and attendee information.

In detail, when the voice recording function is being executed, the terminal device 100 may execute a shooting function according to a user's request, and store the image content generated according to the shooting function in the integrated content. Here, the image may include a still image and / or a moving image.

The recording function may be included in the recording application. In this case, when the recording application is executing the voice recording function, the user may take an image by selecting the shooting button displayed on the screen of the recording application. Alternatively, when the recording application is executing the voice recording function, the user may execute another application installed in the terminal device 100, for example, a camera application to take an image.

The terminal device 100 according to an embodiment of the present invention stores the newly generated image during the voice recording as the integrated content together with the voice content, so that the user can easily recognize a situation occurring in a speech environment such as a meeting. .

In operation S230, the terminal device 100 obtains the text content converted from the voice content according to a user's request.

The terminal device 100 may convert a voice included in voice content into text by embedding a speech to text (STT) module. According to the embodiment, in order to reduce the load on the terminal device 100, the terminal device 100 transmits the voice content to the management server 200 according to a user's request, and the text generated by the management server 200. It may also receive content.

According to an exemplary embodiment, the terminal device 100 may correct a misspelling sentence or word in the text content, for example, a misspelling of a word or an error in spacing according to a previously stored spelling rule.

The terminal device 100 may obtain the text content converted from the voice content only when the user completes payment of a predetermined amount or points.

In operation S240, the terminal device 100 displays the obtained text content on the screen. The text content displayed on the screen may be shared by email, text, etc. under the control of the user.

The user can check the speech contents generated in a speech environment such as a meeting in voice content and at the same time as a text content, so that the user does not need to spend extra time in the meeting minutes and can concentrate more on meetings.

3A to 3F are exemplary views illustrating screens 300a to 300f displayed on the display of the terminal device 100 according to the use of the recording service.

FIG. 3A illustrates a screen 300a displayed on the display of the terminal device 100 before the voice recording function is executed. When the user selects the voice recording button 310, as shown in FIG. 3B, the voice recording is performed. The function can be executed.

When the voice recording is completed, as shown in FIG. 3C, a screen 300c for inputting the title of the integrated content is displayed, and the user may set the title of the integrated content through a keyboard input.

3D illustrates a screen 300d for displaying a list of integrated contents stored in the terminal device 100.

Looking at the integrated content 320 with the title 322 of the puma meeting, the screen 300d includes a title 322 of the integrated content, date information 321 related to the integrated content, time information 323, and location information 324. ) And attendee information 325 may be displayed.

The date information 321 may be generated by confirming a date when the integrated content 320 is generated or confirming a date when the voice recording function is started or completed. For example, when the date when the integrated content 320 is generated or when the voice recording function is completed is December 18, 2017, the terminal device 100 may use the date information 321 of the integrated content 320 as 2017. You can set December 18,

The time information 323 may be generated by checking a time interval in which execution of the voice recording function is maintained. For example, when the voice recording function starts at 14:00 and is completed at 15:30, the terminal device 100 may set 14:00 to 15:30 as time information 323 of the integrated content 320. .

The location information 324 may be generated by confirming the location of the terminal device 100 when the voice recording function is executed or when the voice recording function is completed. For example, the position when the voice recording function is executed through the GPS information of the terminal device 100 may be checked, and the determined position may be set as the position information 324 of the integrated content 320.

The participant information 325 indicates identification information of users who participated in a meeting, a meeting, or the like. The terminal device 100 communicates with the terminal device 100 for a predetermined time interval (for example, 30 minutes) before the voice recording function is executed. The identification information of the users of the other terminal may be set as the attendee information 325. For example, 30 minutes before the voice recording function is executed, the user of other terminals who have made a phone call with the terminal device 100, transmits or receives a text message, or sends or receives an instant message through a call list, a message list, and the like are checked. In addition, identification information (eg, a name) of the identified users may be set as the attendee information 325. This takes into account that the participants often send or receive calls or texts before the meeting or the like begins.

Depending on the implementation, the participant information 325 may be determined through analysis of the voice content. For example, the terminal device 100 analyzes voices of voice content to classify attendees having different voices, and assigns arbitrary identification information (for example, A, B, C, etc.) to the classified attendees. The assigned identification information may be set as the attendee information 325. Specifically, when there are three attendees in the meeting, the terminal device 100 analyzes the voice content to identify three attendees having different voices, and for each attendee, different identification information, for example, A After allocating B, C, A, B, and C may be displayed on the screen as the attendee information 325.

Participant information 325 related to the integrated content 320 may be added, changed or deleted by the user. For example, if a person named Hong Gil-dong did not attend the actual meeting, the user may delete Hong-Kil-Dong from the attendee information 325 and the identification information of a new person who was not included in the attendee information 325 may be referred to as the attendee information 325. You can also add In addition, the user may change identification information of the person included in the attendee information 325.

Referring to FIG. 3D, a screen 300d of the terminal device 100 may include a search box 334. A user inputs a search word in the search box 334 to search integrated content related to the search word 334. Can be. For example, when a user inputs another user's name into the search box 334, the terminal device 100 may display information of the integrated content in which another user participates as an attendee, and the user displays the title of the search box ( In the case of inputting in step 334, the terminal device 100 may display information of integrated content of a corresponding title.

FIG. 3D illustrates a screen 300d before the voice content of the integrated content is converted into the text content. When the user selects the payment menu 332 and pays a predetermined cost or point, the terminal device 100 The text content converted from the voice content may be obtained and displayed on the screen.

As illustrated in FIG. 3E, when payment of the user is confirmed, text content 340 corresponding to voice content may be displayed on the screen 300e.

The text content 340 may be shared with other users through a shared web page under the control of the user. In detail, the text content 340 may be uploaded to the shared web page according to the user's selection, and may be viewed by another user who accesses the shared web page. In addition, another user accessing the shared web page may exchange opinions with a user of the terminal device 100 by chatting, inputting a comment, or the like, and the other user may edit the text content 340 uploaded to the shared web page. It may be.

In addition, as illustrated, the terminal device 100 may further display a tag 345, which may correspond to at least one word included in the text content 340. In detail, the terminal device 100 may determine at least one word in the text content 340 according to a frequency, and display the determined at least one word on the screen 300e as the tag 345.

The user can easily look at the tag 345 to see what conversations come and go in the meeting.

As described above, when the participant information 325 is determined through analysis of the voice content, when the terminal device 100 displays the text content 340, the participant who has spoken the sentences included in the text content 340. May be included in the text content 340 and displayed.

For example, if it is determined through analysis of the voice content that A, B, and C participated in the meeting, it is checked who of A, B, and C spoke each sentence included in the text content 340, You can include A, B, or C adjacent to each sentence. For example, when the text content 340 includes the sentence "hello", and it is confirmed that the participant A talks about the "hello" sentence, the terminal device 100 displays the text content 340. , "A: Hello."

When the user changes A, B, and C, which are identification information of the participant, to a real name, each sentence of the text content 340 may be displayed mapped to the real name of the participant.

When the identification information of the participant is mapped to each sentence of the text content 340, the terminal device 100 extracts only the sentences spoken by the specific participant (for example, A) selected by the user and displays them on the screen. It may be.

A screen 300f when the user selects the title 322 or the like of the integrated content in order to confirm detailed information of the integrated content is illustrated in FIG. 3F.

As shown in FIG. 3F, the screen 300f may include a button menu 350 for playing or stopping the voice content, and further, the text content 340, the tag 345, and the attendee information 325. May be further displayed.

When the user selects any one of the tags 345, the terminal device 100 may display a portion of the text content 340 including a word corresponding to the tag selected by the user on the screen. For example, when the user selects a tag of the ledger, the terminal device 100 displays a portion of the text content 340 including the word of the ledger on the screen so that the user can easily check the related content. When a plurality of words corresponding to the ledger tag selected by the user exist in the text content 340, when the user first selects the ledger tag, the portion in which the text of the ledger word first appears in the text content 340 is displayed. When the user selects the transaction ledger tag again, the second portion of the text contents 340 may be displayed. That is, corresponding parts may be sequentially displayed according to the user's continuous selection of the same tag.

According to the exemplary embodiment, the part of the voice content corresponding to the tag selected by the user may be played according to the user's tag selection, and the corresponding sections may be sequentially selected according to the user's continuous selection of the same tag. A section in which a word corresponding to the selected tag appears may be sequentially played. Specifically, when the user selects the ledger tag and selects the play button in the button menu 350, the section in which the ledger first appears in the voice content is played, and when the user selects the ledger tag again, the voice content The section in which the ledger of the transaction appears for the second time may be played.

Depending on the implementation, the user may select the Export menu to share the integrated content via email, text, or the like. For example, a user may select the Export menu and then enter his or her email address to have text content delivered to his or her email account.

Further, according to the embodiment, the user selects the Export menu to upload the integrated content or the text content 340 to the shared web page, and the contact information (eg, a telephone call) of another user to share the content through the shared web page. Number, email address, etc.) to invite other users to the shared web page. Other users accessing the shared web page can view the uploaded content, exchange opinions with the user of the terminal device 100 by chatting, input a comment, or edit the uploaded content.

Although not shown, the recording service providing method according to an embodiment of the present invention may provide a shorthand service for voice content.

In detail, when the user requests a shorthand service, the terminal device 100 transmits the voice content to the management server 200. The management server 200 transmits the voice content to the stewardship terminal, and the text content created by the stewardship may be transferred from the management server 200 or the stewardship terminal to the terminal device 100.

Since the text content shortened by the shorthand may be shorthand notarized by the shorthand, the user of the terminal device 100 may use the shorthand text content as verified evidence.

4 is a flowchart for describing operation S210 of FIG. 2 in detail.

As described above, the voice recording function of the terminal device 100 may be manually executed according to a user's selection. Depending on the embodiment, the voice recording function may be automatically performed according to the current situation. The automatic execution of the voice recording function is for when the user forgets the meeting schedule and does not record.

In operation S410, the terminal device 100 obtains schedule information. The schedule information is schedule information such as lectures, meetings, seminars, and the like, and may include information on at least one of a date, a time, and a location.

The terminal device 100 may receive schedule information from a user through a recording application, or obtain schedule information of the user from a schedule application other than the recording application.

In operation S420, the terminal device 100 determines whether the current situation corresponds to schedule information. In detail, the terminal device 100 may determine whether the current date and time correspond to the date and time included in the schedule information. Alternatively, the terminal device 100 may further determine whether the current location of the terminal device 100 corresponds to a location included in the schedule information.

In operation S430, when the current situation corresponds to the schedule information, the terminal device 100 automatically executes a voice recording function. In detail, when the current date, time, and location correspond to the date, time, and location included in the schedule information, the terminal device 100 may recognize that the scheduled meeting is to be started and execute a voice recording function.

5 is a block diagram illustrating a configuration of a terminal device 100 according to an embodiment of the present invention.

Referring to FIG. 5, the terminal device 100 according to an embodiment of the present invention may include a memory 112, a communication unit 114, a control unit 116, and a display 118. The memory 112, the communication unit 114, and the control unit 116 may be implemented with at least one processor, and may operate according to the recording application described above.

The memory 112 stores the integrated content generated by the recording application. As described above, the integrated content may include voice content, image content, and additional information.

The communication unit 114 communicates with the management server 200 and the like through a network. The communication unit 114 may receive a recording application from the management server 200 or the app server.

The controller 116 executes a voice recording function to generate voice content with voice recorded therein, and stores the integrated content including the voice content in the memory 112. In addition, the controller 116 converts the voice content according to a user's request to generate the text content, or transmits the voice content to the management server 200 through the communication unit 114, the text content from the management server 200 May be received.

In addition, the controller 116 may include the image data obtained during the execution of the voice recording function in the integrated content, and additional information related to the integrated content, for example, information on at least one of a date, a time, a location, and an attendee. May be obtained.

The display 118 displays the text content converted from the voice content on the screen. In addition, the display 118 may display various UI screens as illustrated with reference to FIGS. 3A through 3F.

Meanwhile, the above-described embodiments of the present invention can be written as a program that can be executed in a computer, and the written program can be stored in a medium.

The medium may be to continue to store a computer executable program, or to temporarily store for execution or download. In addition, the medium may be a variety of recording means or storage means in the form of a single or several hardware combined, not limited to a medium directly connected to any computer system, it may be distributed on the network. Examples of the medium include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, And ROM, RAM, flash memory, and the like, configured to store program instructions. In addition, examples of another medium may include a recording medium or a storage medium managed by an app store that distributes an application, a site that supplies or distributes various software, a server, or the like.

As mentioned above, although the technical idea of the present invention has been described in detail with reference to a preferred embodiment, the technical idea of the present invention is not limited to the above embodiments, and having ordinary skill in the art within the scope of the technical idea of the present invention. Many modifications and variations are possible.

100: terminal device
112: memory
114: communication unit
116: control unit
118: display
200: management server

Claims (16)

Executing a voice recording function;
Storing integrated content including voice content generated according to the voice recording function;
Acquiring the converted text content from the voice content according to a user's request; And
And displaying the text content on a screen.
The method of claim 1,
The recording service providing method,
Executing a recording function according to the user's operation during the execution of the voice recording function;
The storing of the integrated content may include:
And including the voice content and the image content generated according to the photographing function in the integrated content.
The method of claim 1,
Acquiring the text content,
And obtaining the text content according to the payment confirmation of the user.
The method of claim 1,
The displaying step,
Setting at least one word selected from the text content as a tag; And
And displaying the set tag on the screen.
The method of claim 4, wherein
The recording service providing method,
And displaying, on the screen, an area to which a word corresponding to the tag selected by the user belongs in the text content as one tag among the tags displayed on the screen is selected by the user. How we deliver the service.
The method of claim 1,
The integrated content,
And at least one of information about at least one of a place, a time, and an attendant associated with the integrated content.
The method of claim 6,
The recording service providing method,
Acquiring location information of the terminal device when the voice recording function is executed;
The storing of the integrated content may include:
And including location information of the terminal device in the integrated content as information about the place.
The method of claim 1,
The recording service providing method,
The method may further include receiving schedule information from a user.
The step of executing the voice recording function,
And automatically executing the voice recording function based on the schedule information.
The method of claim 8,
The step of automatically executing the voice recording function,
And if the current situation corresponds to the schedule information, automatically executing the voice recording function.
The method of claim 1,
The recording service providing method,
Acquiring information about another terminal communicating with the terminal device during a predetermined time interval before the voice recording function is executed;
The storing of the integrated content may include:
And including the user information of the other terminal as the participant information in the integrated content.
The method of claim 1,
The storing of the integrated content may include:
Determining attendee information according to an analysis result of the voice content; And
And including the determined attendee information in the integrated content.
The method of claim 11,
The displaying step,
And mapping the identification information of the participant determined as a result of the analysis of the voice content to the sentences included in the text content.
The method of claim 1,
The recording service providing method,
Transmitting the voice content to a management server according to the shorthand request of the user; And
And obtaining the shortened text content from the management server or the quick report terminal based on the voice content.
The method of claim 13,
The shortened text content is,
Method of providing a recording service characterized in that notarized by the shorthand notary.
A program stored in a medium in combination with hardware for executing the method of providing a recording service according to any one of claims 1 to 14.
A controller for executing a voice recording function;
A memory for storing integrated content including voice content generated according to the voice recording function; And
And a display for displaying the text content converted from the voice content on a screen according to a user's request.

Images