KR20160093292A - Contents offer method and the method perfoming contents offer server, commentator apparatus - Google Patents

Abstract

The present invention relates to a contents supply method, to a contents supply server performing the method, and to a commentator terminal. Specifically, the content supply method is to execute game contents though the contents supply server and to make the game content mixed with the game contents stream to a user terminal through the contents supply server in real time after collecting commentary information which comments the screen of the executed game contents.

Description

TECHNICAL FIELD [0001] The present invention relates to a contents providing server, a contents providing server, a content providing server, a commentator terminal,

The following description relates to a content providing method and a content providing server and a narrator terminal for carrying out the method, and relates to a content providing method for broadcasting game contents on the Internet in real time while driving game contents on a content providing server.

As the diffusion of the Internet has spread as a part of the information and communication industry, the culture led by individuals and broadcasting through the Internet has become common in everyday life. Recently, personal broadcasting sites that can relay contents in real time via YouTube, Africa TV, etc. have become popular, and a lot of individuals broadcast video and watch the broadcasted video.

The personal broadcasting site provides a personal channel for anyone to broadcast, and not only images such as music, movies, drama, etc., but also broadcasts information about specific topics according to the user's interest. Among them, an internet platform for broadcasting a game screen as a subject of a game is gaining popularity.

Here, the game requires a high-end graphics card depending on the character of the game itself, the background, and the quality of the graphic expressing the item. Further, the computer of the narrator who performs the progress related to the game, In order to broadcast, it should be equipped with a suitable specification for game and broadcasting.

That is, only a narrator having a computer such as a high-end graphics card, memory, etc., executes and broadcasts the corresponding game, thereby causing the user to be unable to execute or broadcast the game.

Recently, a cloud game service is provided in which a game is run on a cloud server and a screen and sound are transmitted to a terminal so that an individual can play the game without having a high-end graphics card. However, such a cloud game service does not yet provide a technology for broadcasting a game screen in real time over the Internet while playing a cloud game.

Therefore, there is a need for a technique of broadcasting a game screen over the Internet while playing a cloud game.

The present invention can execute a game content selected from a commentary terminal using a cloud-based content providing server and stream the game content to a user terminal requesting viewing of the executed game content.

The present invention can collect commentary information for explaining screens of game contents from a commenter terminal and generate game contents in which commentary information is mixed by mixing game contents and commentary information streamed to a narrator terminal.

The present invention can provide captions for commentary information and commentary information based on state information of a user terminal requesting viewing of game contents in which commentary information is mixed.

According to an embodiment of the present invention, there is provided a content providing method, comprising: executing a selected game content by selecting a game content to be executed and commented out of a plurality of game contents from a commenter terminal; Streaming the executed game content to a narrator terminal; Collecting commentary information of a commentator for commenting on a screen of the game content streamed from the commenter terminal; Mixing the streamed game content and commentary information of the collected commentary; And streaming the game contents mixed with the commentary information to a user terminal.

The step of streaming to the narrator terminal according to an embodiment may include streaming audio and video related to the executed game content to the narrator terminal.

The commentator's commentary information according to an embodiment may include a voice for commenting on the motion of the commentator and the screen of the game content according to the point of time corresponding to the point of time when the game content is streamed.

The mixing step may mix the motion of the video and commentary information of the streamed game content and mix the audio of the streamed game content and the audio of the commentary information.

The mixing according to an embodiment of the present invention may include mixing the game content streamed according to the collection order of the commentary information and the commentary information of the collected commentator with the commentary information collected from the plurality of commentator terminals with respect to the executed game contents can do.

The executed game content according to an embodiment may be interpreted through a plurality of narrator terminals in consideration of at least one of the number of narrators, the comment time, and the commentary rating evaluated by the narrator in accordance with the information disclosed in the content providing server.

The step of streaming to a user terminal according to an exemplary embodiment may include a step of displaying commentary information translated through speech recognition so as to understand the commentary information in consideration of status information of a user terminal requesting viewing of mixed game contents Subtitles can be provided.

The step of streaming to the user terminal according to an exemplary embodiment may express emotional information of the narrator highlighted in the subtitles in consideration of the voice strength or voice speed of the narrator expressed through the voice included in the narrative information.

The content providing server according to an embodiment may provide a ranking list of game contents, commentary information, and commentators evaluated from a plurality of user terminals streaming game contents in which the commentary information is mixed.

The content providing server according to an exemplary embodiment may provide a compensation service for the narrator terminal based on the number of times streamed to the user terminal according to the ranking list.

According to an embodiment of the present invention, there is provided a content providing method performed by a narrator terminal, comprising: selecting a game content for execution and commentary among a plurality of game contents included in a content providing server; Receiving game content selected from the content providing server; Receiving commentary information of a narrator describing a screen of the game content; And transmitting the commentary information of the commentator to the content providing server, wherein the content providing server mixes the game content streamed to the commentator terminal and the commentary information explaining the screen of the game content, It can be streamed to the terminal.

The commentator's commentary information according to an embodiment may include a voice for commenting on the motion of the commentator and the screen of the game content according to the point of time corresponding to the point of time when the game content is streamed.

The motion of the narrator according to an embodiment may include an operation for operating the game content and an image of a narrator using a peripheral device that is interlocked with the narrator terminal.

In the receiving step according to an embodiment, the commentary information may be input to provide the caption through the speech recognition in consideration of the status information of the user terminal requesting the viewing of the mixed game content.

A content providing server according to an embodiment includes a game content executing unit that selects a game content to be executed and commented out from a plurality of game contents from the commentator terminal and executes the selected game content; A narrator terminal streaming unit for streaming the executed game contents to a narrator terminal; A commentary information collecting unit for collecting commentary information of a commentator for commenting on the screen of the game content streamed from the commenter terminal; A commentary information mixing unit for mixing the streamed game contents and commentary information of the collected commentary; And a user terminal streaming unit for streaming the game contents in which the commentary information is mixed to a user terminal.

The mixing step may mix the motion of the video and commentary information of the streamed game content and mix the audio of the streamed game content and the audio of the commentary information.

The user terminal streaming unit according to an embodiment provides a subtitle indicating translated commentary information through voice recognition so that the commentary information can be understood in consideration of the state information of the user terminal requesting viewing of the mixed game contents can do.

The user terminal streaming unit according to an exemplary embodiment may express emotional information of the narrator on the subtitle in consideration of the voice strength or voice speed of the narrator expressed through the voice included in the narrative information.

The narrator terminal according to an embodiment includes a game content selection unit for selecting a game content to be executed and commented out among a plurality of game contents included in the content providing server; A game content receiving unit for receiving the game content selected from the content providing server; A commentary information input unit for inputting commentary information of a commentator explaining a screen of the game content; And a commentary information delivery unit for delivering the commentary information of the commentator to the content providing server, wherein the content providing server is configured to mix the commentary information describing the game content streamed to the commentator terminal and the screen of the game content And can be streamed to the user terminal.

The commentary information input unit according to the embodiment may receive the commentary information to provide the caption through the speech recognition in consideration of the status information of the user terminal requesting the viewing of the mixed game content.

The content providing method according to an embodiment of the present invention is a method of providing a content by streaming the game content to a user terminal requesting viewing of the game content executed through the cloud-based content providing server, It is possible to view game contents with complex or precise graphics.

The content providing method according to an embodiment of the present invention can adjust the focus between the game content and the commentary information by mixing the streamed game content and the commentary information with the commentary terminal to generate the game content in which commentary information is mixed.

The contents providing method according to an embodiment of the present invention can provide captions that can be understood by users living abroad or persons with hearing impairments by providing captions for commentary information and commentary information based on the status information of the user terminal .

FIG. 1 is an overall configuration diagram of a content providing server and a commentary terminal for generating game contents in which commentary information is mixed according to an embodiment.
2 is a diagram illustrating a detailed configuration of a content providing server and a narrator terminal according to an embodiment.
FIG. 3 is a detailed configuration of a content providing server and a narrator terminal according to an actual implementation according to an embodiment.
FIG. 4 is a diagram for explaining an operation of generating game contents in which commentary information according to another embodiment is mixed.
FIG. 5 is a diagram for explaining an operation of transferring game contents to a user terminal, including subtitles for commentary information according to an embodiment.
FIG. 6 is a diagram for explaining an operation of transferring game contents to a user terminal, including subtitles for commentary information according to another embodiment.
FIG. 7 is a diagram for explaining an operation of generating a caption for commentary information according to an embodiment.
8 is a flowchart related to a content providing method according to an embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is an overall configuration diagram of a content providing server and a commentary terminal for generating game contents in which commentary information is mixed according to an embodiment.

Referring to FIG. 1, the content providing server 101 may include a plurality of game contents, and may provide a service for streaming the game contents according to a narrator or a user's request. For example, the content providing server 101 may remotely run game content to a server providing a cloud game service and stream audio / video of the captured game content in real time, thereby allowing the gamer to play a game It is possible to provide the same image as driving.

Also, the plurality of game contents may be driven by the narrator or the user, and may include RPG, strategy simulation, racing, FPS, etc., in which a high-end graphics card is required.

To this end, the content providing server 101 can select the game content 102 to be executed and commented out of the plurality of game contents from the commenter terminal 103. [ The content providing server 101 can execute the selected game content 102 and stream the executed game content 102 to the commenter terminal 103. [ At this time, the content providing server 101 may encode the audio and video related to the executed game content 102 and stream it to the narrator terminal 103.

The commenter terminal 103 may be a terminal for explaining and broadcasting at least one game content 102 selected from a plurality of game contents included in the content providing server 101. [ The narrator terminal 103 can receive the game content 102 from the content providing server 101 and decode and display the received game content 102. [ The narrator terminal 103 can receive commentary information of the narrator 104 describing the screen of the displayed game content 102. [ The commentary information may be information expressed in voice on the image based on the current progress, battle plan, etc., based on the screen of the game content 102. [

The narrator terminal 103 can also receive commentary information related to the motion of the narrator 104, the voice of the narrator 104, and the operation keys of the narrator 104. For example, the commenter terminal 103 can receive commentary information in cooperation with a peripheral device such as a camera, a webcam, a microphone, a keyboard, and a mouse.

The narrator terminal 103 can transmit the commentary information of the entered commentator 104 to the content providing server 101. [ The content providing server 101 can collect commentary information of the narrator 104 that interprets the screen of the game content 102 streamed from the narrator terminal 103. [

Thereafter, the content providing server 101 may mix the streamed game content 102 and the commentary information of the collected commentary 104 to stream the game content in which the commentary information is mixed to the user terminal 105. That is, the content providing server 101 not only provides the streaming service provided by the existing cloud game, but also mixes commentary information about the game content 102 streamed to the narrator terminal 103 with the game content 102 To provide additional functionality. At this time, the content providing server 101 mixes the video / audio of the game content 102 and the motion / voice of commentary information corresponding to the viewpoint in response to the viewpoint of the game content 102 streamed to the narrator terminal 103 It is possible to adjust the focus between the game content 102 and the commentary information.

The content providing server 101 performs an operation for providing a service for broadcasting a game content driven by the commentator terminal 103 and commentary information about the game content to a user who wants to watch the game content in which commentary information is mixed can do. As a result, the content providing server 101 can simultaneously provide a streaming service and a broadcast-based broadcast service related to execution / operation / capture / provision of the game content 102.

In addition, the content providing server 101 separates and processes the process of driving the game content 102 and the process of providing the broadcast service, so that when the commentator executes and broadcasts the game content 102, The delay time can be minimized.

2 is a diagram illustrating a detailed configuration of a content providing server and a narrator terminal according to an embodiment.

2, the content providing server 201 includes a game content executing unit 202, a commenter terminal streaming unit 203, a commentary information collecting unit 204, a commentary information mixing unit 205, and a user terminal streaming unit 206). Here, the game content execution unit 202 and the commenter terminal streaming unit 203 may perform an operation for providing a streaming service for game contents. The commentary information collecting unit 204, the commentary information mixing unit 205, and the user terminal streaming unit 206 may perform an operation for providing a broadcast-based broadcast service.

Specifically, the game content execution unit 202 can select the game contents for commentary and broadcasting from among the plurality of game contents from the commenter terminal 207 and execute the selected game contents.

The narrator terminal streaming unit 203 can stream the executed content to the narrator terminal 207. Here, the narrator terminal streaming unit 203 may capture audio and video related to the executed game content in real time, encode the captured audio and video, and stream the encoded game content to the narrator terminal 207.

The commentary information collecting unit 204 can collect commentary information of the commentator who interprets the screen of the game content streamed from the commentator terminal 207. [ In other words, the commentary information collecting unit 204 collects commentary information including a motion of the commentator, a voice for commenting on the screen of the game content according to the viewpoint, and an operation key for the commentator 104, can do.

For example, the commentary information collecting unit 204 collects the narrator's voice, which is expressed by speech, on the motion of the narrator captured through the webcam in correspondence with the screen of the game content streamed to the narrator terminal 207, And the operation key related to the next operation or plan, etc.

Here, the commentary information collecting unit 204 may collect commentary information for broadcasting the game contents from the commentator terminal 207 by providing a loadcast-based broadcast service separately from the streaming service for the game contents .

The commentary information mixing unit 205 may mix the streamed game contents and the commentary information of the collected commentary. In detail, the commentary information mixing unit 205 may mix the motion of the video and commentary information of the streamed game contents, and mix the audio of the streamed game contents and the commentary information. In other words, the commentary information mixing unit 205 may mix each of the video, motion, audio, and voice according to the form to adjust the focus between the game content and the commentary information.

Here, when the commentary information is collected from the plurality of commentator terminals for the executed game contents, the commentary information mixing unit 205 mixes the streamed game contents and the commentary information of the commentary gathered in accordance with the collection order of the commentary information can do. In other words, the commentary information collection unit 204 collects commentary information through a plurality of commentator terminals in consideration of at least one of the number of commentators, the commentary time, and the commentary grade evaluated by the commentator, in accordance with the information disclosed in the content providing server . The commentary information mixing unit 205 may generate a game content in which a plurality of commentary information is mixed by adjusting a focus between the collected commentary information and the game content.

The user terminal streaming unit 206 may stream the game content in which commentary information is mixed to the user terminal. Here, the user terminal streaming unit 206 provides a caption indicating translated commentary information through voice recognition so as to understand the commentary information in consideration of status information of a user terminal requesting viewing of mixed game contents can do.

Here, the caption can recognize the speech included in the commentary information and display the result converted into text. The subtitles can be expressed in the caption by highlighting the emotional information of the narrator in consideration of the voice strength or the voice speed of the narrator expressed through the voice included in the commentary information. The detailed configuration will be described with reference to FIG.

Also, the content providing server 201 can provide a ranking list of game contents, commentary information, and commentators evaluated from a plurality of user terminals streaming the game content in which commentary information is mixed. The content providing server 201 may provide a compensation service for the narrator terminal 207 based on the number of times streamed to the user terminal according to the ranking list.

In other words, the content providing server 201 may perform the evaluation of the narrator in order to stream game contents of a higher quality to a large number of users in providing the game contents in which the commentary information is mixed as a broadcasting service. That is, the content providing server 201 can evaluate the commentator based on the commentator's commentary information, game contents, etc. from a user who has previously viewed the game content in which commentary information is mixed. Then, the content providing server 201 can generate a ranking list sorted on the basis of the game contents according to the rating of the narrator evaluated.

Then, the content providing server 201 can provide a compensation service for the narrator terminal 207 based on the number of times streaming based on the ranking value of the ranking list, the link, and the like.

For example, the content providing server 201 may receive ratings from a plurality of commentators providing commentary information on game contents based on RPG-based game contents such as Dungeon & Fighter, Maple Story, and Lineage . Then, the content providing server 201 can prioritize the narrator for each game content evaluated by the user, and provide a ranking list corresponding thereto.

Here, the exponent may be provided with a different compensation service for each game content as the priority is selected for each game content. The reward service may be used to extend the usage rights of the narrator using the content providing server 201, to provide a certain amount of money in accordance with the number of streaming times, or to add and / It is possible to provide a convenient environment.

The commenter terminal 207 may include a game content selection unit 208, a game content reception unit 209, an explanation information input unit 210 and an explanation information transmission unit 211.

The game content selection unit 208 can select a game content for commentary and broadcasting from a plurality of game contents included in the content providing server 201. [ Here, the commentator can select, through the game content selection unit 208, one game content to be driven among the plurality of game contents which can be logged in to the content providing server 201 with his or her account.

The game content receiving unit 209 can receive the game content selected from the content providing server 201. [ The game content receiving unit 209 can receive video and audio related to the game content encoded from the content providing server 201. [

The commentary information inputting unit 210 can receive commentary information of the commentator explaining the screen of the game contents. In other words, the commentary information input unit 210 can receive commentary information of the commentator as additional information that can understand the game contents such as the status, status, and progress rules displayed on the screen of the game content. In addition, the commentary information input unit 210 may receive the commentary information to provide the caption through the speech recognition in consideration of the state information of the user terminal requesting the viewing of the mixed game content.

The commentary information transmitting unit 211 can transmit the commentary information of the commentator to the content providing server.

FIG. 3 is a detailed configuration of a content providing server and a narrator terminal according to an actual implementation according to an embodiment.

3, the content providing server 301 includes an input data receiving unit 302, a game execution engine 303, a game AV encoder 304, a game AV streamer 305, a video mixer 306, an audio mixer 307, a broadcast AV encoder 308, and a broadcast AV streamer 309.

Specifically, the input data receiving unit 302 and the game execution engine 303 may correspond to the game content executing unit 202 or the commentary information collecting unit 204 in FIG. The input data receiving unit 302 may receive an execution request for the selected game content to be explained and broadcasted from the narrator terminal 310. [ The input data receiving unit 302 can receive commentary information of the narrator describing the game content from the narrator terminal 310. [ At this time, the input data receiving unit 302 can receive the commentary information including the motion, voice, and operation keys of the narrator inputted through the peripheral device connected to the narrator terminal 310. For example, the input data receiving unit 302 may receive commentary information including operation keys for controlling components of webcam video data, microphone voice data, and game contents.

When receiving the received execution request or the operation key, the input data receiving unit 302 can transmit the received information to the game execution engine 303. The game execution engine 303 may correspond to an engine or an application that actually drives game contents. Accordingly, the game execution engine 303 can drive the game contents in response to the execution request or the operation key received from the input data receiving unit 302. [

The game AV encoder 304 and the game AV streamer 305 may correspond to the narrator terminal streaming unit 203 of FIG. The game AV encoder 304 can capture the video / audio of the game content driven by the game execution engine 303 in real time and encode and mux the video / audio of the captured game content. For example, the game AV encoder 304 may encode and mux the resulting screens and sounds of the game content driven through the game execution engine 303.

The game AV streamer 305 may stream the encoded game content to the narrator terminal 310. [ Thereafter, when the input data receiver 302 receives the motion and voice of the narrator from the narrator terminal 310, the input data receiver 302 may transmit the narrator's motion to the video mixer 306 and the narrator's voice to the audio mixer 307 have.

Here, the video mixer 306, the audio mixer 307, and the broadcast AV encoder 308 may correspond to the commentary information mixing unit 205 of FIG. The video mixer 306 may perform an operation of mixing the motion of the received commentary with the result associated with the video of the game content driven through the game execution engine 303. [ In one example, the video mixer 306 may mix the resultant screen of the game content and the webcam video data.

The audio mixer 207 may perform an operation of mixing the audio of the received commentary with the result related to the audio of the game content driven through the game execution engine 303. [ For example, the audio mixer 207 may mix the sound and microphone voice data of the game content.

The broadcast AV encoder 308 may encode and mux the respective results mixed in the video mixer 306 and the audio mixer 307. [ In other words, the broadcast AV encoder 308 may encode video and audio associated with the game content encoded through the video mixer 306 and the audio mixer 307, thereby generating game content including commentary information.

The broadcast AV streamer 309 may correspond to the user terminal streaming unit 206 of FIG. The broadcast AV streamer 309 may stream the game content including the commentary information to the user terminal requesting viewing of the game content including the commentary information.

The narrator terminal 310 may include a video encoder 311, an audio encoder 312, a control signal processor 313, an input data transmitter 314, and a moving picture reproducer 315. The narrator terminal 310 can operate in conjunction with the peripheral device 316 including the web cap 317, the microphone 318, and the control device 319.

The video playback unit 315 may correspond to the game content selection unit 208 and the game content reception unit 209 of FIG. The moving picture reproducing unit 315 can select the game contents to be operated by the contents providing server 301. [ In addition, the moving image playback section 315 can stream the game content driven by the content providing server 301 and display the streamed game content. At this time, the moving picture playback unit 315 may decode the video and audio related to the game content and provide the decoded video and audio to the commentator. For example, the video playback unit 315 may provide audio such as a character constituting the game content, a video for the background, background music provided in the game content, and a notification sound according to an action through the screen and the speaker.

In addition, the moving picture playback unit 315 can provide a result of mixing the game content streamed from the content providing server 301 and commentary information on the game content. In other words, the moving picture reproducing unit 315 can provide a result of the streaming service and the broadcasting service to the commentator. Here, the content providing server 301 may divide and process the configuration of each of the game AV encoder 304 and the broadcast AV encode 308 to provide a streaming service and a broadcast service. Therefore, the moving picture reproducing unit 315 can provide a result screen of the game contents more quickly and accurately in executing and broadcasting the game contents.

The video encoder 311, the audio encoder 312, and the control signal processing unit 313 may correspond to the commentary information input unit 210 of FIG. The video encoder 311 may encode the motion of the narrator input from the webcam 317 of the peripheral device 316. [ For example, the video encoder 311 can encode a motion image according to motion in which the commentator operates while commenting on the game contents.

The audio encoder 312 may encode the audio of the narrator input from the microphone 314 of the peripheral device 316. For example, the video encoder 312 may encode a voice represented by an audio frequency in correspondence with an image of a game content by the narrator.

The control signal processing unit 313 can recognize a signal according to the operation key of the commentator inputted from the control device 319 of the peripheral device 316 and process the signal. The control signal processing unit 313 can recognize a signal according to the operation key input from the control device 319 including a keyboard, a mouse, a game pad, and the like. For example, the control signal processing unit 313 can recognize a signal corresponding to an operation key such as a direction key, a defense key, and an attack key

The input data transmitting unit 314 may correspond to the commentary information transmitting unit 211 of FIG. The input data transmitting unit 314 transmits commentary information of the commentator including the motion, voice and operation keys of the narrator encoded or recognized from the video encoder 311, the audio encoder 312 and the control signal processing unit 313, (301).

FIG. 4 is a diagram for explaining an operation of generating game contents in which commentary information according to another embodiment is mixed.

4, the content providing server 401 acquires commentary information 404 and 406 from a plurality of narrator terminals 403 and 407 with respect to any one of the plurality of game contents 402 . In other words, the content providing server 401 can receive commentary information on the game content through an individual commentator or a plurality of commentators, depending on the type of channel using the game content.

According to the first embodiment, the content providing server 401 can receive commentary information on game contents over a single channel.

In other words, the content providing server 401 may use a method that is universally used for broadcasting the game content in which commentary information is mixed. That is, the content providing server 401 may provide the commentary information related to the game content using the game content driven by the individual through the single channel, and may stream the game content in which the commentary information is mixed to the user terminal.

For example, the content providing server 401 receives the commentary information provided by the commentator terminal A 403 on a single channel corresponding to the game content A, and the commentary information 404 of the commentator terminal A 403 is mixed The game content A can be generated.

According to the second embodiment, the content providing server 401 can receive commentary information on game contents over multiple channels.

In other words, the content providing server 401 may use multiple channels to receive commentary information on one game content from a plurality of commentators. In other words, the content providing server 401 can start notifying a narrator before recruiting a broadcast service for at least one of the plurality of game contents. An example, and a notice may include a game content name, game content identification information, a commentary level, a number of people to be recruited, a time to provide a broadcast service, etc., interpreted through multiple channels.

The content providing server 401 can designate a plurality of narrators for commenting on the game contents in the order of first-come-first-served or reservation, in accordance with the previously disclosed information. The content providing server 401 may provide a in-process communication function for driving the game content so that communication can be performed between a plurality of commentators commenting on the game content.

For example, the content providing server 401 can either: i) link a webcam connected to the narrator terminal A 403 with a webcam connected to the narrator terminal B 407, or ii) provide a phone / chat room with a communication function included in the processor have.

The plurality of narrators designated can explain the screen of the game content through the method provided by the content providing server 401. [ The content providing server 401 can receive the commentary information 404 or 406 input from the commentator terminal A 403 or the commentator terminal B 407. [

At this time, the content providing server 401 collects commentary information 404 and 406 input from the commentator terminal A 403 or the commentator terminal B 407 according to the time flow of the game content 402 being executed The game content 402 and the commentary information 404, 406 may be mixed in order. Here, when the commentary information 404 of the commentator terminal A 403 and the commentary information 406 of the commentator terminal B 407 are collected at a similar time, the content providing server 401 receives the commentator terminal A 403 and the commentator 407, The terminal B 407 can determine the priority using the score evaluated by the user.

The content providing server 401 may generate the game content in which the plurality of comment information is mixed by mixing the commentary information 404 or 406 with the game content according to the priority order.

FIG. 5 is a diagram for explaining an operation of transferring game contents to a user terminal, including subtitles for commentary information according to an embodiment.

Referring to FIG. 5, the content providing server 501 may mix the commentary information collected from the narrator terminal 502 with the streamed game content to generate game content in which commentary information is mixed. The content providing server 501 may stream the game content in which the commentary information is mixed to the user terminal 503 that wants to view the game content in which commentary information is mixed.

At this time, the content providing server 501 may further include the subtitles expressed in text with respect to the commentary information and commentary information with respect to the game contents in consideration of the state information of the user terminal 503, thereby streaming the game contents.

In other words, the content providing server 501 can receive the commentary information expressed in different languages according to the commentator commenting on the game contents. For example, the content providing server 501 may receive different commentary information corresponding to the game contents B according to the language used by the commentator who interprets it, such as Korean, Japanese, Chinese, American, and Australians. In other words, when the American commentator explains the game content B, the content providing server 501 can express the commentary information on the game content B in English.

In such a case, users of other countries or users who do not speak a foreign language, except in the case of a national or a foreign language speaker, are unable to obtain accurate information on game content B based on commentary information expressed in different languages . Accordingly, the content providing server 501 can classify the language of the commentary information of the game content requested by the user terminal 503 to be viewed according to the status information of the user terminal 503, and provide the corresponding subtitles.

For example, the content providing server 501 can determine that the commentary information includes position information in Japan as the status information of the user terminal 503 that wants to view the mixed game content. Then, the content providing server 501 can determine whether commentary information of the game content to be viewed by the user terminal 503 located in Japan is expressed in Korean. Thereafter, the content providing server 501 can automatically convert the commentary information expressed in Korean into text by recognizing the food. When the translation is completed, the content providing server 501 can stream the game content and the commentary information expressed in Korean and the automatically translated Japanese subtitles to the user terminal 503 located in Japan.

As a result, the content providing server 501 may provide additional additional information based on the status information of the user terminal as well as the operation of broadcasting and broadcasting the game content based on the cloud.

FIG. 6 is a diagram for explaining an operation of transferring game contents to a user terminal, including subtitles for commentary information according to another embodiment.

Referring to FIG. 6, the content providing server 601 may mix the commentary information collected from the narrator terminal 602 with the streamed game content to generate game content in which commentary information is mixed. The content providing server 601 may stream the game content in which the commentary information is mixed to the user terminal 603 that wants to view the game content in which commentary information is mixed.

Here, the content providing server 601 may include the subtitles in which the commentary information is automatically translated based on the status information of the user terminal 603, so that the game content having the commentary information mixed with the user terminal 603 may be streamed.

The content providing server 601 may stream the automatically translated subtitles when a request for subtitles is transmitted from the user terminal 603 that wants to view the game content in which the commentary information is mixed.

For example, when the user operating the user terminal 603 is a hearing-impaired person, the content providing server 601 may receive a request for caption from the user terminal 603. [ Accordingly, the content providing server 601 can reconstruct the commentary information into a caption and stream the game contents including the commentary information or the caption to the user terminal 603.

At this time, the content providing server 601 can stream the caption with the highlight to the user terminal 603 so that the emotion information of the commentator can be included as the caption.

FIG. 7 is a diagram for explaining an operation of generating a caption for commentary information according to an embodiment.

Referring to FIG. 7, the content providing server may generate the translated subtitles through voice recognition so as to understand the commentary information in consideration of the status information of the user terminal requesting viewing of the mixed game content.

Referring to FIG. 7 (a), the content providing server can recognize the voice of the narrator according to the audible frequency displayed by the narrator. At this time, in describing the game contents, the voice of the narrator may change the size or wavelength of the frequency as the emotion of the user is introduced.

Referring to FIG. 7B, the content providing server can recognize the voice of the narrator expressed through (a) in FIG. 7 to derive the text information about the voice. At this time, the content providing server can display a highlight on the subtitle centered on a section where the size or wavelength of the dominant wave is changed as the emotion of the user is incorporated.

For example, the content providing server can extract a section in which the voice of the commentator is increased or increased in response to the sudden attack in the game content state progressed slowly. Then, the content providing server can display a highlight on the sentence expressed corresponding to the extracted section.

As a result, in generating the caption for the commentary information provided by the commentator, the content providing server does not transmit only the contents to be transmitted to the commentary information, but rather displays a highlighting so that the commentator can express the sentiment in interpreting the situation can do.

8 is a flowchart related to a content providing method according to an embodiment.

At step 801, the narrator terminal 103 can select commentary and game contents for broadcasting from a plurality of game contents included in the contents providing server.

In step 802, the contents providing server 101 can select the game contents for commentary and broadcasting from among the plurality of game contents from the narrator terminal and execute the selected game contents. Then, the content providing server 101 can stream the executed game content to the commentator terminal.

In step 803, the narrator terminal 103 can receive the game content selected from the content providing server. Then, the narrator terminal 103 can receive commentary information of the narrator explaining the screen of the game content. The commentator's commentary information may include a commentary motion corresponding to the time point at which the game content is streamed and a voice for commenting on the screen of the game content according to the time point. Then, the narrator terminal 103 can transmit the commentary information of the commentator to the content providing server.

In step 804, the content providing server 101 can collect commentary information of the commentator that interprets the screen of the game content streamed from the commentator terminal.

In step 805, the content providing server 101 may mix the streamed game content and commentary information of the collected commentary. The content providing server 101 may mix the motion of the video and commentary information of the streamed game content and the audio of the streamed game content and the audio of the commentary information. When the commentary information is collected from a plurality of commentator terminals with respect to the executed game contents, the content providing server 101 mixes the streamed game contents with the commentary information of the commentator collected in accordance with the collection order of the commentary information .

Then, the content providing server 101 can stream the game content in which commentary information is mixed to the user terminal. At this time, the content providing server 101 can provide the translated subtitles through voice recognition so as to understand the commentary information according to the status information of the user terminal 105. The subtitles can be expressed in the caption by highlighting the emotional information of the narrator in consideration of the voice strength or voice speed of the narrator expressed through the voice included in the commentary information.

In step 806, the user terminal 105 may receive the game content in which at least one of the commentary information or the caption is mixed from the content providing server 101. [

The methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

101: Content providing server
102: Game contents
103: narrator terminal
104: Narrator
105: User terminal

Claims (20)

A content providing method performed by a content providing server,
Selecting and commenting out a plurality of game contents from the commenter terminal and executing the selected game contents;
Streaming the executed game content to a narrator terminal;
Collecting commentary information of a commentator for commenting on a screen of the game content streamed from the commenter terminal;
Mixing the streamed game content and commentary information of the collected commentary; And
Streaming the game content in which the commentary information is mixed to the user terminal
The content providing method comprising the steps of: The method according to claim 1,
Wherein the step of streaming to the narrator terminal comprises:
And streaming the audio and video related to the executed game content to the narrator terminal. The method according to claim 1,
The commentary information of the commentator is,
And a voice for announcing the motion of the narrator and the screen of the game content according to the time point corresponding to the time of streaming the game content. The method according to claim 1,
Wherein the mixing comprises:
Mixing the motion of the video and commentary information of the streamed game content and mixing the audio of the streamed game content and the audio of the commentary information. The method according to claim 1,
Wherein the mixing comprises:
And when the commentary information is collected from the plurality of narrator terminals with respect to the executed game content, the game content streamed according to the collection order of the commentary information is mixed with the commentary information of the collected commentary. 6. The method of claim 5,
The executed game content may include:
Wherein the content providing server is interpreted through a plurality of narrator terminals in consideration of at least one of the number of narrators, the commentary time, and the commentary grade evaluated by the narrator in accordance with the information disclosed in the content providing server. The method according to claim 1,
Wherein the streaming to the user terminal comprises:
And providing the translated subtitles through voice recognition so as to understand the commentary information in consideration of the status information of the user terminal requesting viewing of the mixed game contents. 8. The method of claim 7,
Wherein the streaming to the user terminal comprises:
Wherein the emotional information of the narrator is highlighted in the caption by considering the voice strength or voice speed of the narrator expressed through the voice included in the commentary information. The method according to claim 1,
The content providing server,
And a ranking list of commentators, commentary information, and commentators evaluated from a plurality of user terminals streaming the game content in which the commentary information is mixed. 10. The method of claim 9,
The content providing server,
And providing a compensation service for the narrator terminal based on the number of times streamed to the user terminal according to the ranking list. A content providing method performed by a narrator terminal,
Selecting a game content for commentary and broadcasting from a plurality of game contents included in the content providing server;
Receiving game content selected from the content providing server;
Receiving commentary information of a narrator describing a screen of the game content; And
And transmitting the commentary information of the commentator to the content providing server
Lt; / RTI >
The content providing server,
Wherein the game content streamed to the commenter terminal and the commentary information explaining the screen of the game content are mixed and streamed to the user terminal. 12. The method of claim 11,
The commentary information of the commentator is,
And a voice for explaining the motion of the narrator and the screen of the game content according to the time point corresponding to the time point of streaming the game content. 13. The method of claim 12,
The motion of the narrator includes:
And an operation for operating the executed game content using a peripheral device interlocked with the narrator terminal and an image of a narrator. 12. The method of claim 11,
The method of claim 1,
And the commentary information is input to provide the caption through speech recognition in consideration of the status information of the user terminal requesting the viewing of the game content in which the commentary information is mixed. A game content executing section for selecting a game content to be executed and commented out from a plurality of game contents from the commenter terminal and executing the selected game content;
A narrator terminal streaming unit for streaming the executed game contents to a narrator terminal;
A commentary information collecting unit for collecting commentary information of a commentator for commenting on the screen of the game content streamed from the commenter terminal;
A commentary information mixing unit for mixing the streamed game contents and commentary information of the collected commentary; And
A user terminal streaming section for streaming the game content in which the commentary information is mixed to a user terminal,
And a content server. 16. The method of claim 15,
The commentary information mixing unit,
Mixes the motion of the video and commentary information of the streamed game content, and mixes the audio of the streamed game content and the audio of the commentary information. 16. The method of claim 15,
The user terminal streaming unit may include:
And providing the translated subtitles through voice recognition so as to understand the commentary information in consideration of the status information of the user terminal requesting viewing of the mixed game content. 18. The method of claim 17,
The user terminal streaming unit may include:
Wherein the emotional information of the narrator is highlighted in the caption by considering the voice strength or the voice speed of the narrator expressed through the voice included in the commentary information. A game content selection unit for selecting a game content to be executed and commented out among a plurality of game contents included in the content providing server;
A game content receiving unit for receiving the game content selected from the content providing server;
A commentary information input unit for inputting commentary information of a commentator explaining a screen of the game content; And
A commentary information delivery unit for delivering the commentary information of the commentator to the content providing server,
Lt; / RTI >
The content providing server,
Wherein the commenter terminal mixes the game content streamed to the commenter terminal and the commentary information explaining the screen of the game content and streams the commentary information to the user terminal. 20. The method of claim 19,
The commentary information input unit,
Wherein the commentary information is input to provide the caption through the speech recognition in consideration of the status information of the user terminal requesting the viewing of the game content in which the commentary information is mixed.

Images