KR20210027982A - E-book service method and device for providing sound effect - Google Patents

Abstract

Disclosed is a method and device for an e-book service providing sound effects. The method for an e-book service performed in a server device according to one aspect of the present invention comprises the steps of: analyzing content of an e-book provided to a user terminal in a preset unit; determining a sound type corresponding to an analysis result; selecting a background sound source corresponding to the sound type; and applying the background sound source to a TTS sound source for the e-book and providing the e-book to the user terminal.

Description

E-book service method and device for providing sound effect {E-book service method and device for providing sound effect}

The present invention relates to an e-book service, and more particularly, to an e-book service method and apparatus for providing sound effects as background sound.

In recent years, as the Internet and mobile environments develop, users who use e-books as well as general offline books are increasing. An e-book is a book produced in the form of content that can be used using a computing device such as a smartphone or a tablet PC, and may be used in the form of a file, or may be provided as a service method through real-time streaming from a specific server.

Conventional e-book services simply view the contents of a book, and thus, there is a problem that reading easily becomes boring. As a result, a technology that allows users to listen to music while reading the contents of a book being viewed through the device was implemented, but the contents of the book being viewed and the music being played are not related to each other, so imagination according to the contents of the book by the music being played. There was a problem that hindered the change of emotion or emotion.

Republic of Korea Patent Publication No. 10-2012-0110652 (published date October 10, 2012) Electronic book printing system

Accordingly, the present invention has been conceived to solve the above-described problems, and is to provide an e-book service method and apparatus that provides sound effects suitable for the contents of a book.

In addition, the present invention is to provide an e-book service method and apparatus that provides sound effects in consideration of the propensity of the reader.

Other objects of the present invention will become more apparent through preferred embodiments described below.

According to an aspect of the present invention, there is provided an e-book service method performed in a server device, the method comprising: analyzing contents of an e-book being provided to a user terminal in a preset unit; Determining a sound type corresponding to the analysis result; Selecting a background sound source corresponding to the sound type; And applying the background sound source to a TTS sound source for the e-book and providing it to a user terminal. An e-book service method for providing sound effects and a recording medium on which a program for executing the method is recorded are provided.

Here, the selecting of the background sound source may include: when the sound type is related to a region, selecting a region corresponding to the sound type; And selecting another user terminal located in the area, and an external sound source received in real time from the other user terminal may be used as the background sound source.

In addition, the other user terminal is one of the terminals currently using the e-book service, and the other user terminal can use the external sound recorded in real time using the provided sound source input means as the external sound source.

In addition, the selecting of the background sound source may include: when the sound type is related to music, checking a music list having a history played back in the user terminal; And selecting one or more of the sound sources according to the music list corresponding to the sound type as the background sound source.

In addition, the selecting of the background sound source may include: when the sound type is related to a sound effect, checking a preferred movie preset by a user member of the user terminal; And selecting a movie background sound source corresponding to the sound type and the preferred movie from a movie background sound DB provided as the background sound source.

In addition, as an interface screen displayed on a display provided in the user terminal, an interface for adjusting the sound level of only the background sound source may be provided.

Also, as the interface screen, image information corresponding to the background sound source may be displayed on one side.

According to another aspect of the present invention, the e-book DB for storing information on the e-book; A TTS processing unit for providing a TTS sound source according to an e-book to a connected user terminal; A background sound selection unit for determining a sound type by analyzing contents of an e-book provided to a user terminal in a preset unit, and selecting a background sound source corresponding to the sound type; And a service processing unit that applies the background sound source to the TTS sound source and provides it to a user terminal.

Here, the background sound selection unit may extract the background sound source from the provided background sound DB or use an external sound source received in real time from another user terminal located in an area corresponding to the sound type as the background sound source.

In addition, the background sound selection unit, when the sound type is related to music, checks a music list having a history played on the user terminal, and selects at least one of the sound sources according to the music list corresponding to the sound type as the background sound source. When the sound type is related to sound effect, a preferred movie preset by a user member of the user terminal and a movie background sound source corresponding to the sound type may be selected from a movie background sound DB provided as the background sound source.

In addition, as an interface screen displayed on a display provided in the user terminal, it may further include an interface unit that provides an interface for adjusting the sound level of only the background sound source.

According to the present invention, it is possible to provide a sound effect suitable for the contents of a book.

In addition, according to the present invention, it is possible to deliver more realistic and vividness by using the external field sound generated in real time as a background sound source, and also to provide a customized service by using the effect sound of a user's favorite music or movie as a background sound source. Can be

1 is a block diagram schematically showing an entire system for an e-book service providing sound effects according to an embodiment of the present invention.
Figure 2 is a functional block diagram showing the configuration of the e-book server according to an embodiment of the present invention.
3 is a flowchart illustrating a process of providing an e-book service providing sound effects according to an embodiment of the present invention.
4 and 5 are flow charts illustrating a processing procedure for a regional related sound type according to each embodiment of the present invention.
6 is a flowchart illustrating a process of providing an e-book service for each sound type according to another embodiment of the present invention.
7 is an exemplary view showing a sound type obtained by analyzing the contents of a book according to an embodiment of the present invention.
8 is an exemplary view showing a user interface screen of an e-book service according to an embodiment of the present invention.

In the present invention, various modifications may be made and various embodiments may be provided, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include all changes, equivalents, or substitutes included in the spirit and scope of the present invention.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. It should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

Terms such as first and second may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another component. For example, terms such as a first threshold value and a second threshold value, which will be described later, may be pre-designated as threshold values that are substantially different or some of the same values. There is room, so for the convenience of classification, terms such as first and second will be added together.

The terms used in the present specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present specification, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof does not preclude in advance.

In addition, components of the embodiments described with reference to each drawing are not limited to the corresponding embodiments, and may be implemented to be included in other embodiments within the scope of the technical spirit of the present invention. Even if the description is omitted, it is natural that a plurality of embodiments may be implemented again as an integrated embodiment.

In addition, in the description with reference to the accompanying drawings, the same components are assigned the same or related reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted. In describing the present invention, when it is determined that a detailed description of a related known technology may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted.

1 is a block diagram schematically showing an entire system for an e-book service providing sound effects according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating the configuration of an e-book server according to an embodiment of the present invention. It is a functional block diagram.

Referring to FIG. 1, the entire system according to the present embodiment includes a user terminal 10, an e-book server 20, and a background sound DB 30.

The user terminal 10 is a terminal device of a user for receiving an e-book service by accessing the e-book server 20 through a communication network, and may be an e-book dedicated terminal or a mobile device such as a smartphone or a tablet PC.

The e-book server 20 provides an e-book file according to an e-book service to the user terminal 10 or provides e-book information in real time through a streaming method. Hereinafter, a description will be made mainly on performing an e-book service in a streaming method.

In particular, the e-book server 20 provides an e-book by converting text into speech using a text-to-speech (TTS) technology. Hereinafter, e-book information provided by voice will be referred to as a TTS sound source.

In addition, the e-book server 20 not only provides the text of the e-book as a voice, but also additionally provides a background sound corresponding to the text. For example, if the keyword [footprint sound] is present in the text, the background sound to which the tag [footprint sound] is set is extracted from the background sound DB 30 and provided together with the TTS sound source. Therefore, the reader can listen to the text of the e-book as a voice while listening to the actual footstep sound as a background sound, so that the degree of concentration increases and the reader can feel more interesting.

Various background sound sources may be stored in the background sound DB 30, for example, not only specific sounds such as frog cry and bird sound, but also background music such as OST, footstep sound, and sound effects such as raining sound as background sound sources. Is saved.

Referring to FIG. 2 showing the configuration of the e-book server 20, the e-book server 20 includes a TTS processing unit 210, a service processing unit 220, an interface unit 230, an e-book DB 240, and a control unit. Including 250, the control unit 250 may include a background sound selection unit 251.

The TTS processing unit 210 generates a sound source by converting the text of the e-book into speech. Since TTS technology will be apparent to those skilled in the art, a more detailed description will be omitted.

The service processing unit 220 is for applying a background sound source to a TTS sound source and providing it to the user terminal 10, and may be in the form of synthesizing the background sound source at a time required for the TTS sound source. For example, if the background sound source is [wave sound], time sync is synthesized so that the background sound source is output at the time when the sound of [wave is hitting] among the TTS sound sources is output.

The interface unit 230 processes an interface screen provided to the user terminal 10. In the user terminal 10, the voice according to the e-book service is output through a speaker or the like, and an interface screen (UI) may be output through a display (eg, a touch screen, etc.) provided at the same time. The user interface will be described later with reference to related drawings (FIG. 8).

The e-book DB 240 stores managed e-book information (e-book content, author information, tag information, purchase cost information, etc.).

The controller 250 performs an overall control function of each component, and in particular, selects a background sound source for a sound effect corresponding to an e-book to be provided.

The background sound selection unit 251 of the control unit 250 analyzes the contents of the e-book being provided to the user terminal 10 in preset units (eg, paragraphs, pages, chapters, etc.) to determine the sound type, Select the background sound source corresponding to the sound type. In addition, the background sound selection unit 251 may use the categories of the e-book itself (fairy tales, novels, essays, poetry collections, etc.) to select a background sound source.

As for the type of sound, it can be classified into, for example, regional relevance, music, and sound effects. As for regional relevance, [Rainy Sound] is the sound of a rainy area, and [Wave Sound] is the sound of a wave, so in this case, the sound collected in real time is used. An embodiment of this will be described later.

In the case of music, as background music, background music is inserted into a voice reading an e-book, such as a movie OST, and, for example, music that a user enjoys can be used as a background sound source. According to an example, a music sound source (such as an MP3 file) stored in the user terminal 10 itself or a sound source having a history played back in the user terminal 10 (such as a sound source provided by a streaming method from a specific server) may be used. In this case, the e-book server 20 may be in the form of acquiring a playlist of a corresponding user from a server (not shown) that provides a music streaming service.

The sound effect is the same as [footprint sound] and [glass cracking sound], and a background sound source previously stored in the background sound DB 30 may be used. Alternatively, it can be extracted from the movie background sound DB (not shown) included in the background sound DB 30 or managed separately. In other words, the background sound source used in the movie is converted into a database and used as a sound effect for an e-book service. According to an example, when a user registers information about a movie that the user prefers (movie title, favorite genre, etc.) in advance, the e-book server 20 extracts a background sound source from the movie background sound DB based on the favorite movie. For example, if the preferred movie is movie A, one or more of the movie background sound sources used in movie A corresponding to the determined sound type is selected and used as a background sound source for the e-book service.

Hereinafter, a process of providing an e-book service providing sound effects will be described in detail.

3 is a flowchart illustrating a process of providing an e-book service providing sound effects according to an embodiment of the present invention.

Referring to FIG. 3, the e-book server 20 analyzes the contents of the e-book being provided to the user terminal 10 in a preset unit, and determines a sound type (S310 and S320). In other words, when the e-book server 20 starts the e-book service to the connected user terminal 10, the unit (page, paragraph, or page) set in advance for the content to be read (ie, content to be provided by voice using TTS) Chapters, etc.). The analysis method selects a keyword (hereinafter referred to as an effect keyword) capable of providing a sound effect among texts. Selected as an effect keyword, for example, the effect sound of a specific sound irrelevant to the region, such as [raining], [waves], [birds crying], and [the sound of breaking a cup] It may be grafted, if the dialogue is more than a certain word (in this case, background music is used as a background sound source).

As described above, the sound type can be classified into regional association, music, and sound effects.

A background sound source corresponding to the determined sound type is selected (S330), and the selected background sound source is applied to the TTS sound source for the e-book and provided to the user terminal 10 (S340).

4 and 5 are flowcharts illustrating a processing procedure for a type of local-related sound according to each embodiment of the present invention.

Referring to FIG. 4 showing the processing process performed by the e-book server 20, the e-book server 20 recognizes that the sound type according to the analyzed book content is regionally related (S410), Another user terminal (not shown) is selected (S420). For example, when it is necessary to provide a sound effect of [It is raining], the e-book server 20 checks an area where it is currently raining, and selects another user terminal located in the area. If there is no current raining area, the sound source previously stored in the background sound DB 30 is used. According to an example, the user terminal 10 connected to the e-book server 20 to receive an e-book service provides its location information (eg, GPS information, etc.) to the e-book server 20, thereby Therefore, the e-book server 20 can search for a user terminal 10 located in a required area.

Then, an external sound source is received in real time from the selected other user terminal (S430). That is, other user terminals record external sound using a sound source input means (for example, a microphone, etc.), and transmit the recorded sound source (hereinafter referred to as an external sound source) to the e-book server 20 in a streaming manner. do. For example, when it is necessary to acquire the sound of rain, it is to acquire the sound of rain recorded by the user terminal currently located in the raining area.

The e-book server 20 uses an external sound source acquired from another user terminal as a background sound source and provides it to the user terminal 10 (S440).

According to the present embodiment, the user can listen to the sound of the scene recorded at another location as a background sound, so that the user can experience a more vivid sense of reality. In this case, the e-book server 20 may provide information on an area in which the provided background sound source is acquired to the user terminal 10 to be displayed on the screen.

Referring to FIG. 5, when the e-book server 20 starts the e-book service to the user terminal 10 (S510), the e-book server 20 provides a TTS service (a service for reading a book by voice) for an e-book according to a user's request. It starts (S520), and accordingly transmits the TTS sound source to the user terminal 10 (S530).

Here, according to an example, when a background sound service is requested from the user terminal 10, the e-book server 20 starts a background sound service (that is, a service provided by applying a background sound source to the TTS sound source) to the user terminal 10, and (S540), in exchange for this, an agreement to provide an external sound source is received from the user terminal 10 (S550).

Then, the user terminal 10 records an external sound source according to a request from the e-book server 20 and provides it to the e-book server 20 (S560).

That is, according to the present embodiment, in order to receive a service using an area-based real-time external sound source as a background sound source, the user must also agree to provide an external sound source, and provide an external sound source when necessary between the user terminals 10 agreed in this way. It is to receive or provide.

6 is a flowchart illustrating a process of providing an e-book service for each sound type according to another embodiment of the present invention.

6, the sound type is analyzed and the result is checked (S610 and S620).

As a result of the confirmation, when the sound type is music (for example, when a dialogue is long or a content describing a background, a specific condition can be set), a music list with a playback history in the user terminal 10 is checked (S630). ), the sound type (sadness, joy, joy, fast tempo, slow tempo, etc.) among the music in the music list are analyzed together as sound types, which can be analyzed using the propensity of words included in the contents of the book. At least one corresponding one is selected as the background sound source (S640).

On the contrary, when the sound type is sound effect, the user terminal 10 checks information on the preferred movie registered by the user member in advance (S635), and determines the preferred movie and sound type (analysis of information on which sound effect sound). A corresponding movie background sound source is selected as the background sound source (S645).

7 is an exemplary diagram showing sound types acquired by analyzing the contents of a book according to an embodiment of the present invention.

Referring to FIG. 7, as a result of analyzing the contents of the e-book 710, a sound type such as 720 may be derived.

Among the contents of the e-book, [Raining] and [Human Footprints] are analyzed as background sound sources, and [Raining] is an area-based and raining area, and [Human Footprints] is an effect sound for the sound of footsteps It is extracted from the horror movie, which is the user's favorite movie.

According to the present embodiment, it is possible to deliver more realistic and vividness by using the external field sound generated in real time as a background sound source, and to provide a customized service by using the sound effect of the user's favorite music and the favorite movie. have.

8 is an exemplary view showing a user interface screen of an e-book service according to an embodiment of the present invention.

Referring to FIG. 8, as an interface screen displayed on a display provided in the user terminal 10, an interface 810 for adjusting the volume of the sound of only a background sound source is provided. Accordingly, the user can conveniently adjust the loudness of the background sound source separate from the TTS sound source.

In addition, on the other side of the interface screen, an interface 820 for selecting a style for a background sound source is provided, and the e-book server 20 preferentially selects a background sound source suitable for the style selected by the user.

Also, as an interface screen, image information corresponding to a background sound source may be displayed 830 on one side. For example, if the sound of the footsteps as a sound effect is extracted from the movie A, the poster screen for the movie A or the scene of the movie from which the actual footstep sound is extracted may be displayed as a moving picture. Alternatively, as described above, if the region is based, an image of the region may be displayed.

Although the above has been described with reference to preferred embodiments of the present invention, those of ordinary skill in the relevant technical field can variously modify the present invention within the scope not departing from the spirit and scope of the present invention described in the following claims. It will be appreciated that it can be modified and changed.

10: User terminal
20: e-book server
30: background sound DB

Claims (12)

In the e-book service method performed in a server device,
Analyzing the contents of the e-book being provided to the user terminal in a preset unit;
Determining a sound type corresponding to the analysis result;
Selecting a background sound source corresponding to the sound type; And
And applying the background sound source to a TTS sound source for the e-book and providing it to a user terminal.
The method according to claim 1,
The step of selecting the background sound source,
If the sound type is related to a region, selecting a region corresponding to the sound type; And
Including the step of selecting another user terminal located in the area,
An e-book service method for providing sound effects, using an external sound source received in real time from the other user terminal as the background sound source.
The method according to claim 2,
The other user terminal is one of the terminals currently using the e-book service, and the other user terminal uses the external sound recorded in real time using the provided sound source input means as the external sound source, and provides sound effects. Way.
The method according to claim 1,
Selecting the background sound source,
If the sound type is related to music, checking a music list having a history played back by the user terminal; And
And selecting one or more of the sound sources according to the music list corresponding to the sound type as the background sound source.
The method according to claim 1,
The step of selecting the background sound source,
If the sound type is related to sound effect, checking a preferred movie preset by a user member of the user terminal; And
And selecting a movie background sound source corresponding to the sound type and the preferred movie from a movie background sound DB provided as the background sound source.
The method according to claim 1,
An e-book service method for providing sound effects, providing an interface for adjusting the volume of the background sound source as an interface screen displayed on a display provided in the user terminal.
The method of claim 6,
An e-book service method for providing a sound effect by displaying image information corresponding to the background sound source as the interface screen on one side.
A computer-readable recording medium comprising computer-executable instructions such as an application or program module executed by a computer for performing the method of any one of claims 1 to 7.
E-book DB for storing information on e-books;
A TTS processing unit for providing a TTS sound source according to an e-book to a connected user terminal;
A background sound selection unit that analyzes contents of an e-book provided to a user terminal in a preset unit, determines a sound type, and selects a background sound source corresponding to the sound type; And
An e-book service device that provides sound effects, including a service processing unit that applies the background sound source to the TTS sound source and provides it to a user terminal.
The method of claim 9,
The background sound selection unit extracts the background sound source from the provided background sound DB, or uses an external sound source received in real time from another user terminal located in an area corresponding to the sound type as the background sound source, and provides sound effects. Device.
The method of claim 10,
The background sound selection unit,
When the sound type is related to music, a music list having a history played back on the user terminal is checked, and one or more of sound sources according to the music list corresponding to the sound type are selected as the background sound source,
When the sound type is related to the sound effect, the user member of the user terminal selects a preferred movie preset and a movie background sound source corresponding to the sound type from a movie background sound DB provided as the background sound source. Book service device.
The method of claim 9,
An e-book service device that provides sound effects, further comprising an interface unit that provides an interface for adjusting the volume of the background sound source as an interface screen displayed on a display provided in the user terminal.

Images