KR100992509B1 - Method and apparatus for realistically providing iptv service based on voice modulation with character/avatar of study/education contents in iptv system - Google Patents

Abstract

PURPOSE: A method and a device for servicing a lifelike IPTV based on voice modulation base through character/avatar appearing in IPTV system are provided to supply lifelike by altering voice or motion/gesture of acquaintance such as parents, sibling who can feel comfortable and warn feeling for a IPTV viewer, thereby improving the learning ability. CONSTITUTION: A voice alteration unit performs alteration in way which replaces the patterned voice of relevant frequency band unit. A pattern storing unit stores each patterned voice about a plurality of users. A user selection unit selects patterned voice about one user in the pattern storing unit. A frequency analyzing unit receives input of a voice of relevant user in other point to update the patterned voice into each frequency band unit.

Description

Method and Apparatus for Realistically Providing IPTV Service Based on Voice Modulation with Character / Avatar of Study / Education Contents in IPTV in Character / Avatar Appeared in Educational / Education Content in IPTV System System}

The present invention relates to a system for providing an Internet Protocol Television (IPTV) service, and more particularly, to a voice or an action of a character or avatar (third mediator) of content in which a character, such as learning or educational content provided by the IPTV service, appears. The facial expression can be provided by modulating the voice or gesture / action of acquaintances such as parents and siblings that IPTV viewers (for example, children) can feel comfortable and warm emotions. Through the health instructions such as maintaining a certain distance through the child can guide the child's watching IPTV with a warm emotion, and to improve the learning ability by passing other instructions or controlling the content playback through time measurement, etc. The present invention relates to a modulation-based IPTV service method and apparatus.

Recently, a user having an IPTV terminal can use a video related and interactive service provided from an IPTV server through a network such as the Internet. Legitimate clients, i.e. viewers or users, who are authorized for the IPTV service can use various multimedia contents provided by the IPTV server at home.

The user can not only watch general TV broadcasts or radio broadcasts that are currently being broadcast through the IPTV terminal, but also request the corresponding content managed by the server even after the broadcast time has elapsed and download or stream any time at any time. You can enjoy even when. In addition, the user may request and enjoy a movie, music, game, cable TV broadcast, DMB broadcast, overseas broadcast, and the like, which are managed by the IPTV server.

Such an IPTV service may be provided through a set-top box for relaying a service between an IPTV terminal and an IPTV server. However, the existing set-top box is connected to the IPTV terminal and relays user authentication and communication with the IPTV server to perform a simple exchange of bidirectional data.

Accordingly, when a child, who is an IPTV viewer, watches content in which characters appear, such as learning or educational content, for example, a fairy tale, the IPTV terminal receives and reproduces the video and audio of the content provided unilaterally from the IPTV server. It was only. At this time, the parent can directly explain the fairy tale content while watching the child, but if the parent cannot watch with the child, the child should only watch the video and audio of the content as it is. Since children who watch IPTV alone do not feel the warm emotions of their parents, they may be bored with the content or lose interest in the unilateral voice of the content being played, which may cause a drop in learning ability. In addition, there is a problem that it is not easy for the remote parents to explain the fairy tale contents while monitoring the child's IPTV viewing situation.

Accordingly, an object of the present invention is to solve the above-described problems, and an object of the present invention is to provide an IPTV viewer (eg For example, the present invention provides a voice modulation-based IPTV service method and apparatus that can improve learning ability by modulating the voice or gesture / action of acquaintances such as parents and siblings that can feel comfortable and warm emotion. To provide.

In addition, another object of the present invention, by using such a modulation method can lead to learning interest by instructing children to watch the IPTV with health instructions, such as maintaining a certain distance with a warm emotion through the avatar at a remote location, In the present invention, there is provided a method and apparatus for voice modulation based realistic IPTV service that can perform content control and the like to improve learning ability.

First, to summarize the features of the present invention, a method for providing a voice modulation-based realistic IPTV service according to an aspect of the present invention for achieving the object of the present invention, the user's voice input to analyze the frequency Patterning the user's language pronunciation habits in units of frequency bands to store the patterned voice, and modulating the original voice of the content character or avatar (third mediator) played on the terminal into the patterned voice Characterized in that provided to the terminal.

And further storing information analyzing the user's motion or facial expression from the camera image of the user, and modulating the original motion or facial expression of the character or avatar of the content played on the terminal according to the analyzed information. It may be provided to the terminal.

The patterned voice includes a voice pattern for each band obtained by dividing an audible frequency band (for example, 20 to 20 kHz) into predetermined units.

The stored patterned voice may be selected, and the patterned voice may be updated in units of frequency bands by receiving the user's voice at different time points.

When a plurality of characters or avatars are included in the content played in the terminal, the modulation may be performed on the corresponding sound source after selecting any one of the plurality of characters or avatars through the terminal.

The voice may store a patterned voice for a plurality of users through the storing process, select one of the plurality of users through the terminal, and perform the modulation on the sound source with the corresponding patterned voice.

The modulation separates the standard sound source of the character or avatar of the content into the frequency band unit and moves to the frequency distribution band of the patterned voice, thereby patterning the pattern for each frequency band unit of the moved original standard sound source. Alternatives may be made for the corresponding frequency band units.

While playing the content on the terminal, a monitoring image of a person watching the content in front of the terminal using a camera is generated and transmitted to a predetermined terminal, and instructions input through the predetermined terminal are displayed on the content. The avatar may be output through the patterned voice.

The terminal may measure the time for playing the content and output an instruction in the patterned voice through the avatar on the content or stop playing the content after a predetermined time elapses.

According to another aspect of the present invention, in a realistic service providing apparatus for digital multimedia contents, the voice of the user is inputted and the frequency is analyzed to pattern the user's language pronunciation habit in a predetermined frequency band unit to pattern the voice Pronunciation patterning unit for storing the; And a voice modulator for modulating the original voice of the character or avatar of the content played in the terminal into the patterned voice and providing the same to the terminal.

The sensory service providing apparatus stores information analyzing the user's motion or facial expression from a camera image of the user, and displays the original motion or facial expression of the character or avatar of the content reproduced in the terminal according to the analyzed information. It may further include an operation / expression analysis unit provided to the terminal by modulating the operation or facial expression of the.

The realistic service providing apparatus may be used to provide an IPTV service.

The pronunciation patterning unit may include: a pattern storage unit storing each patterned voice for a plurality of users; A user selector which selects a patterned voice for a user in the pattern storage; And a frequency analyzer configured to receive a voice of a corresponding user at a different time point with respect to the selected patterned voice and update the patterned voice in units of frequency bands.

The voice modulator includes a character selector configured to select any one of the plurality of characters or avatars through the terminal when a plurality of characters or avatars are included in the content played by the terminal. The modulation may be performed on the corresponding sound source of.

The voice modulator may include a pronunciation pattern selector configured to select one of the plurality of patterned voices through the terminal when a voice patterned for a plurality of users is stored through the pronunciation patterner. The modulation may be performed on the sound source with the selected patterned voice.

The voice modulator may include: a character sound source extracting unit extracting an original voice of the character or avatar; And a character sound source modulator for modulating the extracted voice into the patterned voice.

The voice modulator separates the standard sound source of the character or avatar of the content into the frequency band unit, moves to the frequency distribution band of the patterned voice, and transmits the pad to each frequency band unit of the moved standard sound source. A method of replacing the turned voice by the corresponding frequency band unit may be used.

According to the method and apparatus for a realistic IPTV service according to the present invention, a parent or child who feels a comfortable and warm emotion of an IPTV viewer, such as a child, with a voice or an action / expression of a character or an avatar whose content comes from a character such as learning or education Can improve the learning ability by providing them with realism by altering them with the voices, gestures and expressions of acquaintances such as brothers and sisters.

In addition, according to the method and apparatus for an immersive IPTV service according to the present invention, it is interesting to instruct a child to watch IPTV with a warm emotion through an avatar at a remote place through the modulation of the voice or motion / expression of the character or avatar of the content. In addition, it is possible to improve the learning ability through the control of content playback even at a remote location.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. Like reference numerals in the drawings denote like elements.

1 is a view for explaining the usage environment of the IPTV system 100 according to an embodiment of the present invention.

Referring to FIG. 1, user information input means such as an electronic payment card, for example, an IC card, a smart card, an RFID card, or a USIM card, is provided through a set top box (STB) relay of the IPTV terminal 110. When user information is read from and authenticated in a content server 120 connected to a network such as the Internet or a mobile service provider network, multimedia data such as a video, an e-book, music, a broadcast program, or, in particular, educational / educational content is provided. You can watch IPTV. In particular, in the present invention, the patterned voice according to the language pronunciation habits, such as the parent or the like, that the user has previously learned the original voice or gesture / action of another third medium such as a character or avatar of the content played on the IPTV terminal 110, or Modulation to an action or a facial expression to provide realistically to the IPTV terminal 110. The parent or the like can learn and store the voice or gesture / action of the parent using the sensory service providing device (see 330 of FIG. 3 or 440 of FIG. 4) operated by the STB or the content server 120 and use it at any time. have.

The IPTV content that can be viewed on the IPTV terminal 110 may be educational / educational content such as children's fairy tales including a character or an avatar as shown in FIG. 2. The parent may read or explain the program contents, for example, the contents of a fairy tale book to his child, but in the present invention, the frequency of receiving a voice of a user (parent, sibling, relative, etc.) is input through a microphone connected to the STB. By analyzing the user's language pronunciation habits in units of frequency bands and storing the patterned voices in the STB or the content server 120, thereby reconstructing the original voices of the characters or avatars of the content played on the IPTV terminal 110. The same patterned voice may be modulated and provided to the IPTV terminal 110. In addition, it stores information analyzing the user's motion or facial expression from the camera image of the user, and according to the analysis information to the original motion or facial expression of the character or avatar of the content to be played on the IPTV terminal 110 Alternatively, it may be provided to the IPTV terminal 110 by modulating the expression.

In addition, in the present invention, while playing the content in the IPTV terminal 110, a person (for example, a child) watching the content in front of the IPTV terminal 110 using a camera (for example, a web camera). The monitoring image is generated and transmitted to a predetermined terminal (for example, the parent's IPTV terminal or the mobile communication terminal), and thus the parent monitors the child's viewing situation while the parent (IPTV terminal or the mobile communication terminal) is monitored. Etc.), you can enter instructions (says and content you want your parents to say, such as keeping your distance from the TV). In this way, the input instruction may be output as a patterned voice of a parent (or a reflection of a previously stored parent's action / expression) through an avatar on the content being played in the IPTV terminal 110.

On the other hand, in the present invention, it is also possible to measure the time to play the content in the IPTV terminal 110 to reflect the patterned voice of the parent (or, previously stored parent's motion / expression through the avatar on the content after a certain time elapsed). ) To print instructions or to stop the playback of content by printing instructions or to stop watching content. Do.

3 is a view for explaining the IPTV relay device 300 according to an embodiment of the present invention. The IPTV relay device 300 corresponds to STB, and relays the above authentication and communication of digital multimedia data between the IPTV terminal 110 and the content server 120.

Referring to FIG. 3, the IPTV relay device 300 includes a control unit 310, a reader port 311, a TV port 312, an Ethernet port 313, a camera 314, a microphone 315, and an authentication unit 320. ), A realistic service provider 330, and an image transmitter 340. The controller 310 is responsible for the overall control of the above components of the IPTV relay device 300.

The reader port 511 is connected to a card reader that reads user information from an electronic payment card, and the authentication unit 320 transmits the read user information to the content server 120 to relay user authentication. The TV port 312 is connected to the IPTV terminal 110 to transmit content data provided from the content server 120 to the IPTV terminal 110. The Ethernet port 313 is connected to a communication line such as the Internet so as to be connected to the content server 120, and exchanges data necessary for communication with the content server 120, such as content data.

The realistic service provider 330 may receive the voice of the user through the microphone 315, and analyze the frequency of the input voice of the user, thereby patterning the user's language pronunciation habit in units of frequency bands and patterning the voice. Can be stored. Accordingly, the sensory service provider 330 may provide the IPTV terminal 110 by modulating the original voice of the character or avatar of the content played in the IPTV terminal 110 into a patterned voice as described above. In addition, the sensory service provider 330 may receive an image of the user through the camera 314, store information analyzing the user's motion or facial expression from the camera image of the user, and analyze the information. Accordingly, the original motion or facial expression of the character or avatar of the content played in the IPTV terminal 110 may be modulated into the motion or facial expression of the corresponding user and provided to the IPTV terminal 110.

The image transmitting unit 340 may monitor the image of the person (eg, a child) who watches the content in front of the IPTV terminal 110 using the camera 314 while the content is played in the IPTV terminal 110. It may be generated and transmitted to a predetermined terminal (for example, the parent's IPTV terminal or a mobile communication terminal). Accordingly, the parents can input instructions (words or contents that the parents want to maintain such as distance from the TV) through their terminals (such as an IPTV terminal or a mobile communication terminal) while monitoring the viewing state of the child. In this way, the instructions input from the remote location may be delivered to the realistic service provider 330 through the Internet or a mobile communication network, and the realistic service provider 330 plays the received instructions on the IPTV terminal 110. The avatar may be output as a patterned voice of a parent (or a reflection of a previously stored parent's motion / expression) through the avatar on the content.

In addition, the controller 310 may store the start time of playing the content in the IPTV terminal 110, and then measure the time at which the content is played from the start time to generate an alarm signal after a predetermined time elapses. At this time, in response to the alarm signal, the sensory service provider 330 pre-stores the instructions stored in the parent's patterned voice (or may reflect the previously stored parent's motion / expression) through the avatar on the content (for a while, and then rests). You can print out what you want to say or watch. Alternatively, the controller 310 may stop playing the content according to the alarm signal.

4 is a view for explaining a content server 400 according to an embodiment of the present invention. 4, the content server 400 according to an embodiment of the present invention is the control unit 410, member information DB 411, content DB 412, authentication unit 420, content providing unit 430 , And a realistic service provider 440. The controller 410 is responsible for the overall control of the above components of the content server 600.

First, in FIG. 3, when a card number read from a user card is received through the reader port 311 using a card reader connected to the reader port 311 and a password is input, the authentication unit 320 receives a card number, a password, and the like. The included user information may be transmitted to the content server 400 through the Ethernet port 313 to request authentication of the user.

Accordingly, the authentication unit 420 of the content server 400 compares the received user information with the corresponding information of the member subscribers stored and managed in the member information DB 411 to process an authentication process for checking whether or not they match. Can be. If it is authenticated as a member subscriber through the above authentication process, the IPTV relay device 300 of FIG. 3 receiving the user's content request input requests the corresponding content to the content server 400, and thus the content provider 430. ) May search for the corresponding content information among many contents stored and managed in the content DB 412 and transmit the matched content information to the IPTV relay device 300. In this case, regarding the provision of the content, the content provider 430 may process the payment for the corresponding card based on the user information.

Accordingly, the control unit 310 of the IPTV relay device 300 may output to the IPTV terminal 110 through the TV port 312 to view the corresponding content information received from the content server through the Ethernet port 313. .

Meanwhile, although the sensory service provider 330 may be provided in the IPTV relay device 300 of FIG. 3 to perform a function as described above, the sensory service provider 330 of FIG. The realistic service provider 440 may perform a similar function.

For example, in FIG. 4, the sensory service provider 440 may receive a voice of a user through the microphone 315 of FIG. 3, and analyze the frequency of the input voice of the user to determine the user's language pronunciation habit. Patterned voices can be stored by patterning them in frequency band units. Accordingly, the sensory service provider 400 modulates the original voice of the character or avatar of the content to be reproduced and provided to the IPTV terminal 110 through the content provider 430 into a patterned voice as described above. 110 may be provided. In addition, the sensory service provider 440 may receive an image of the user through the camera 314, store information analyzing the user's motion or facial expression from the camera image of the user, and analyze the information. Accordingly, the original motion or facial expression of the character or avatar of the content played in the IPTV terminal 110 may be modulated into the motion or facial expression of the corresponding user and provided to the IPTV terminal 110.

While the content is being played on the IPTV terminal 110, the image transmitter 340 of FIG. 3 uses a camera 314 for a person (eg, a child) watching the content in front of the IPTV terminal 110. When a monitoring image is generated and transmitted to a predetermined terminal (for example, a parent's IPTV terminal or a mobile communication terminal), the parent monitors the child's viewing situation accordingly and thus the parent (IPTV terminal or mobile communication). You can enter instructions (words or content you want to say to your parents, such as keeping your distance from the TV) through your terminal, etc.). In this case, the instructions input by the parent from the remote location may be delivered to the realistic service provider 440 through the Internet or a mobile communication network, and the realistic service provider 440 may transmit the received instructions to the IPTV terminal. The avatar may be output as a patterned voice of a parent through an avatar on the content being played at 110. In this case, the tangible service provider 440 may reflect the pre-stored motion / expression of the parent as the output / action of the avatar.

In addition, the controller 410 may store the start time of playing the content in the IPTV terminal 110, and then measure the time at which the content is played from the start time to generate an alarm signal after a predetermined time elapses. At this time, in response to the alarm signal, the realistic service provider 440 outputs the pre-stored instructions (words or contents desired by the parents, such as pause and watch) through the patterned voice of the parent through the avatar on the content. Can be. In this case, the sensory service provider 440 may reflect the pre-stored motion / expression of the parent as the avatar motion / expression. Alternatively, the controller 410 may stop the playback of the content according to the above alarm signal.

5 is a block diagram of an apparatus 400 for a more detailed description of the realistic service provider 330 of FIG. 3 or the realistic service provider 440 of FIG. 4.

FIG. 5 is a diagram for describing a realistic service providing apparatus 500 according to an embodiment of the present invention. The realistic service providing apparatus 500 according to an embodiment of the present invention is a device capable of realizing the functions of the realistic service providing unit 330 of FIG. 3 or the realistic service providing unit 440 of FIG. 4. The operation will be described in more detail.

Referring to FIG. 5, the sensory service providing apparatus 500 according to an embodiment of the present invention includes a pronunciation patterning unit 510, a voice modulator 520, and an operation / expression analyzer 530. The pronunciation patterner 510 includes a user selector 511, a pattern storage 512, and a frequency analyzer 513. The voice modulator 520 includes a character selector 521 and a pronunciation pattern selector ( 522, a character sound source extractor 523, and a character sound source modulator 524.

The pronunciation patterner 510 may analyze the frequency by receiving the user's voice and pattern the language pronunciation habit of the user in a predetermined frequency band to store the patterned voice in the pattern storage unit 512. The voice modulator 520 may modulate the original voice of the character or avatar of the content played in the terminal into the patterned voice and provide the same to the corresponding terminal.

Referring to the flowchart of FIG. 6 for more detailed operation of the voice modulation providing apparatus 500 according to an embodiment of the present invention.

First, when a person watching the IPTV terminal 110 wants to learn and store a language pronunciation habit, the user selector 511 selects a user to pattern pronunciation through a predetermined menu provided to the IPTV terminal 110. It can be set newly (S610). When the user to select a pronunciation pattern is selected, the user reads a document prepared in advance through the microphone 315, or reads a voice from the content, or pronounces a material for learning his / her pronunciation habit (S620). The voice of the user input through the microphone 315 is analyzed by the frequency analyzer 513. The frequency analyzer 513 may receive the voice of the user, analyze the frequency, and pattern the user's language pronunciation habit in a predetermined frequency band unit to store the patterned voice in the pattern storage unit 512 (S630). .

)을 생성할 수 있다. 이때, 사용자가 아직 학습시키지 않은(발음하지 않은) 음소나 문장도 생성할 수 있는데, 이들은 기 이루어진 패턴화된 목소리들의 평균 주파수에 해당 음소나 문장이 대응되어 저장되도록 할 수 있다. The frequency analyzer 513 divides the audible frequency band (for example, 20 to 20 kHz) into predetermined units, for example, 10 Hz units, 100 Hz units, and the like, and divides a voice pattern for each band into a corresponding patterned pattern. You can save your voice. For example, the frequency analyzer 513 separates a user's voice input into a word or a sentence into consonants and vowels, and combines them into phonemes ("I", """," hak ") as shown in FIG. Etc. or the English alphabet) or sentence-by-sentence ("I go" etc. or English sentences) can be patterned, and the patterned phonemes or sentences are stored in correspondence with the corresponding frequency band, thereby patterning each unit Vectors corresponding to the voice of

) Can be created. In this case, the phoneme or sentence that the user has not yet learned (pronounced) may also be generated, which may allow the corresponding phoneme or sentence to be stored in correspondence with the average frequency of the predetermined patterned voices.

The pattern storage unit 512 may store each patterned voice corresponding to the corresponding user by dividing each person, and the user selector 511 may store the patterned voice for any one user among the plurality of users stored as described above. You can choose. When the user wants to learn the language pronunciation habit again, the user may select his or her own patterned voice according to the operation of the user selection unit 511, thereby re-learning his pronunciation habit as described above. have. Accordingly, the frequency analyzer 513 updates the patterned voice in each frequency band unit and stores the pattern when the user's voice is input at a different time as described above with respect to the previously stored corresponding patterned voice. It can be stored in the unit 512. Accordingly, new patterned voices for phrases, intonations, phonemes (including the English alphabet), etc., which the user has not previously pronounced may be added.

Meanwhile, the voice modulator 520 may modulate the original voice of the character or avatar of the content played in the terminal into the corresponding patterned voice reflecting the user's language pronunciation habit, and provide the same to the corresponding terminal.

For example, the character selector 521 selects any one of the plurality of characters or avatars through the IPTV terminal 110 when the plurality of characters or avatars are included in the content played by the IPTV terminal 110. It can be supported to (S640). In the “Snow White” fairy tale as shown in FIG. 2, various characters appear, and in some cases, an avatar is additionally inserted due to the nature of educational or educational content to describe the current situation in a voice or a text or a necessary instruction in a voice or a text. Although the voice of the person or avatar at this time is already provided as a standard sound source to the content, in the present invention, as described above, the menu is provided to the IPTV terminal 110 by the character selector 521 as described above. If one of a plurality of characters or avatars is selected, the character sound source modulator 524 may modulate and output the patterned voice with respect to the corresponding sound source of the selected character or avatar as described above.

At this time, the patterned voice as described above can be selected and output as a voice that can make the viewers, such as parents, siblings, relatives, children feel friendly or warm emotion. For example, when a patterned voice for a plurality of users is stored in the pattern storage unit 512 through the pronunciation patterning unit 510, the pronunciation pattern selection unit 522 may transmit the plurality of voices through the IPTV terminal 110. The user may provide one of the patterned voices to be selected and receive the corresponding selection (S650). Accordingly, the character sound source modulator 524 may modulate and output the corresponding sound source of the character or avatar selected by the character selector 521 to the patterned voice selected by the pronunciation pattern selector 522 as described above. .

The sound source extractor 523 may extract the original voice of the character or avatar selected by the character selector 521 from the sound source of the content played in the IPTV terminal 110 (S660).

)로 대체하여 변조된 목소리를 생성함으로써, IPTV 단말(110)로 제공할 수 있다. 즉, 각 주파수 대역별로 해당 사용자의 특색있는 톤이 저장된 패턴 저장부(512)의 패턴화된 목소리의 주파수 분포에 따라 사람마다 특색있는 톤으로 음성이 출력되므로, 이를 이용하여 스탠더드 음원의 전체적인 주파수 분포 대역을 해당 패턴화된 목소리의 주파수 분포 대역으로 이동시켜 각 주파수대역 단위 마다 패턴화된 목소리의 해당 주파수대역 단위로 대체하여 패턴화된 목소리와 유사한 음성 출력을 얻을 수 있다. 예를 들어, 패턴화된 목소리의 주파수 분포가 일정 중심 주파수에 많이 분포하고 나머지가 중심 주파수 좌우로 퍼져 있는 경우에, 스탠더드 음원의 주파수 분포의 중심을 패턴화된 목소리의 중심 주파수와 일치 시켜 같은 주파수 이동만큼 스탠더드 음원의 나머지 주파수 대역의 음원도 주파수 이동시킴으로써, 스탠더드 음원의 주파수 분포를 패턴화된 목소리의 주파수 분포와 유사하게 만들 수 있다. 이와 같이 중심 주파수를 일치시킨 후 스탠더드 음원(각각의 음소나 문장 단위의 음원)의 각 주파수대역 단위 마다 패턴화된 목소리의 해당 주파수대역 단위로 대체하여 패턴화된 목소리와 유사한 음성 출력을 얻을 수 있다. 예를 들어, 패턴화된 목소리 중 음소 '가'가 0~100Hz 대역에 속하면 스탠더드 음원의 해당 음소 '가'는 0~100Hz 대역의 소리로 대체될 수 있다.Accordingly, the sound source modulator 524 may modulate the corresponding voice extracted by the sound source extractor 523 into a patterned voice selected by the pronunciation pattern selector 522 (S670). The sound source modulator 524 separates the original standard sound source (sound source of each phoneme or sentence unit) which is already provided according to the behavior of the character or avatar of the content as shown in FIG. The patterned voice is shifted to each frequency band unit of the original standard sound source shifted to the frequency distribution band of the normalized voice and shifted using a MUX (multiplexer).

By generating a modulated voice by replacing with), it can be provided to the IPTV terminal 110. That is, according to the frequency distribution of the patterned voice of the pattern storage unit 512 in which the user's characteristic tone is stored for each frequency band, the voice is output as the characteristic tone for each person, thereby using the overall frequency distribution of the standard sound source. By shifting the band to the frequency distribution band of the corresponding patterned voice, the voice output similar to the patterned voice can be obtained by replacing the band with the corresponding frequency band unit of the patterned voice for each frequency band unit. For example, if the frequency distribution of the patterned voice is distributed at a constant center frequency, and the remainder is spread to the left and right of the center frequency, the center of the frequency distribution of the standard sound source is matched with the center frequency of the patterned voice. By shifting the frequency of the sound source in the remaining frequency bands of the standard sound source by the shift, the frequency distribution of the standard sound source can be made similar to the frequency distribution of the patterned voice. In this way, after matching the center frequency, each frequency band unit of the standard sound source (each phoneme or sentence unit) can be replaced with the corresponding frequency band unit of the patterned voice to obtain a voice output similar to the patterned voice. . For example, if the phoneme 'ga' of the patterned voice belongs to the 0 to 100Hz band, the corresponding phoneme 'ga' of the standard sound source may be replaced with a sound of the 0 to 100Hz band.

According to such a voice modulation method, the original voice of the character or avatar of the content played on the terminal is output in a patterned voice, so that a viewer such as a child can watch the content in a voice of parents, siblings, or relatives, thereby making the user feel friendly or warm. Emotion can be felt, thereby inducing learning interests, thereby increasing the learning effect.

)의 해당 벡터값도 포함시켜 위와 같이 변조된 목소리를 네트워크로 전송할 수 있고 이에 따라 STB에서 수신하는 변조된 목소리가 디코딩되어 IPTV 단말(110)에서 재생될 수 있다.Meanwhile, although the sensory service provider 330 may be provided in the IPTV relay device 300 of FIG. 3 to perform a function as described above, the sensory service provider 500 as described above may be realized. When applied to the type service providing unit 440, as shown in FIG. 7 after the tag and the transmission header (data) indicating the patterned voice according to the transmission method of the network encoded by encoding according to a predetermined encoding method In the payload of the

The modulated voice received by the STB may be decoded and reproduced by the IPTV terminal 110 by transmitting the modulated voice to the network as described above.

Similarly, through the relaying of the IPTV relay apparatus 300 of FIG. 3 or the content server 400 of FIG. 4, the parent instructs through his terminal (such as an IPTV terminal or a mobile communication terminal) while monitoring the viewing situation of the child. In the case of receiving an item (word or content that the parent wants to maintain such as keeping distance from the TV), or measuring the playing time of the content and generating an alarm signal after a certain time elapses, according to the above modulation method, The sound source modulator 524 may not only output the instruction received from the parent's terminal through the avatar on the content being played on the IPTV terminal 110, but also output the patterned voice of the parent through the avatar on the content. You can also print out pre-stored instructions (what you want to say to your parents, like taking a break and watching) in your parents' patterned voice. The.

On the other hand, the motion / expression analysis unit 530 may receive an image of the user through the camera 314, and stores information analyzing the user's motion or facial expression from the camera image of the user in a predetermined storage means, According to the analyzed information, the original motion or facial expression of the character or avatar of the content played on the IPTV terminal 110 may be modulated into the motion or facial expression of the corresponding user and provided to the IPTV terminal 110. The motion / expression analysis unit 530 may analyze the camera image of the user to learn and store the motion or facial expression and store the information by patterning a plurality of repeated motions and analyze the facial expression of the user's face. Not only the appearance but also the expression can be analyzed and classified into several patterns to store relevant information. The motion / face analysis unit 530 may output the information instead of the original motion or expression of the character or avatar of the content by using the information on the motion / face of the user stored as described above. Accordingly, viewers, such as children, can feel more friendly or warmer emotions by watching the contents by watching not only the voices of parents, siblings, relatives, etc. but also movements and expressions of the characters or avatars of the contents. Can be triggered.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

1 is a view for explaining the usage environment of the IPTV system according to an embodiment of the present invention.

2 is a view for explaining an example of IPTV content according to an embodiment of the present invention.

3 is a diagram illustrating an IPTV relay apparatus according to an embodiment of the present invention.

4 is a view for explaining a content server according to an embodiment of the present invention.

FIG. 5 is a diagram for describing a realistic service providing apparatus according to an embodiment of the present invention.

6 is a flowchart for describing an operation of the sensory service providing apparatus of FIG. 5.

7 is a view for explaining a modulation process of the character sound source according to an embodiment of the present invention.

Claims (17)

In the IPTV service method, The user's voice is input to analyze the frequency and pattern the user's language pronunciation habits in units of frequency bands to store the patterned voice, and the user's voice is patterned by phonemes or sentences to pattern the phonemes or sentences. Store corresponding to the frequency band, and relearn the stored patterned voices so that new patterned voices for phrases, intonations, or phonemes (including the English alphabet) are added, While playing the content on the terminal, the original voice of the character or third media of the content to be reproduced is modulated into the patterned voice and provided to the terminal, but the original sound source of the character of the content or the third media is provided. The modulation is separated in the frequency band unit and shifted to the frequency distribution band of the patterned voice, and replaced by the corresponding frequency band unit of the patterned voice for each frequency band unit of the moved original standard sound source. Performing, Generates a monitoring image of a person watching the content in front of the terminal using a camera and transmits the monitoring image to a predetermined terminal, and receives instructions on the content inputted through the predetermined terminal on the content. And outputting the patterned voice through the third medium. The method of claim 1, further comprising storing information analyzing the user's motion or facial expression from the camera image of the user, IPTV service method, characterized in that by modulating the original operation or facial expression of the character or the third medium of the content reproduced in the terminal according to the analyzed information to the user's operation or facial expression. The method of claim 1, The patterned voice includes a voice pattern for each band obtained by dividing an audible frequency band into predetermined units. The method of claim 1, Selecting the stored patterned voice and receiving the user's voice at a different time to update the patterned voice in units of frequency bands. The sound source of claim 1, wherein when the content to be played on the terminal includes a plurality of characters or a third medium, the selected sound source is selected through the terminal. IPTV service method, characterized in that for performing the modulation. 6. The method of claim 5, wherein the storage process stores a patterned voice for a plurality of users, selects one of the plurality of users through the terminal, and modulates the sound source with the patterned voice. IPTV service method, characterized in that for performing. delete delete The method of claim 1, An IPTV service characterized by measuring a time for playing the content in the terminal and outputting an instruction to the person watching the content with the patterned voice through a third medium on the content after a predetermined time elapses; Way. In the realistic service providing apparatus for digital multimedia content, The user's voice is input to analyze the frequency and pattern the user's language pronunciation habit in a predetermined frequency band unit to store the patterned voice. A pronunciation patterning unit for storing a sentence corresponding to the frequency band and re-learning the stored patterned voice to update a new patterned voice for a phrase, intonation, or a phoneme (including the English alphabet) to be added; And While playing the content on the terminal, the original voice of the character or third media of the content to be reproduced is modulated into the patterned voice and provided to the terminal, but the original sound source of the character of the content or the third media is provided. The modulation is separated in the frequency band unit and shifted to the frequency distribution band of the patterned voice, and replaced by the corresponding frequency band unit of the patterned voice for each frequency band unit of the moved original standard sound source. A voice modulator to perform, When a monitoring image of a person watching the content is generated in front of the terminal through a camera and transmitted to a predetermined terminal, the voice modulator is input through the predetermined terminal, the instruction for the person watching the content. And outputting, as the patterned voice, through the third medium on the content. The method of claim 10, further comprising storing information analyzing the user's motion or facial expression from a camera image of the user, and recalling the original motion or facial expression of a character or a third medium of content reproduced on the terminal according to the analyzed information. Motion / expression analysis unit provided to the terminal by modulating the user's motion or facial expression Realistic service providing apparatus further comprising a. The apparatus of claim 10, wherein the apparatus for providing a realistic service is to provide an IPTV service. The method of claim 10, wherein the pronunciation patterning unit, A pattern storage unit for storing each patterned voice for a plurality of users; A user selector which selects a patterned voice for a user in the pattern storage; And A frequency analyzer for receiving the user's voice at a different point in time for the selected patterned voice and updating the patterned voice in units of frequency bands. Realistic service providing device comprising a. The method of claim 10, wherein the voice modulator, When the content to be played in the terminal includes a plurality of characters or a third medium, including a character selection unit for selecting any one of the plurality of characters or a third medium through the terminal, And the modulation is performed on a corresponding sound source of the selected character or a third medium. The method of claim 10, wherein the voice modulator, If the voice patterned for a plurality of users is stored through the pronunciation patterning unit, and includes a pronunciation pattern selection unit for selecting any one of the plurality of the patterned voice through the terminal, Realistic service providing apparatus characterized in that for performing the modulation on the corresponding sound source with the selected patterned voice. The method of claim 10, wherein the voice modulator, A character sound source extracting unit extracting an original voice of the character or a third medium; And Character sound source modulator for modulating the extracted voice into the patterned voice Realistic service providing device comprising a. delete

Images