KR20230110885A - Appatus for providing real-time online contents capable of interacting with user - Google Patents

Abstract

An apparatus for providing real-time online contents capable of interacting with a user according to the present invention includes a contents providing unit providing predefined real-time online contents to a user terminal connected through a network; a response information generation unit that analyzes user input information received from the user terminal in the process of providing the real-time online content and generates response information corresponding thereto; and a user interaction unit providing the generated response information to the user terminal.
Here, the user interaction unit may output the response information through an interactive object displayed together with the real-time online content.

Description

Real-time online content providing device capable of interacting with users {APPATUS FOR PROVIDING REAL-TIME ONLINE CONTENTS CAPABLE OF INTERACTING WITH USER}

The present invention relates to a technology for providing content capable of interacting with a user through a virtual object output during a process of providing real-time online content.

As the speed of wired/wireless networks and the performance of computing devices are greatly improved, various online contents that can be enjoyed in real time are being provided. Various online contents that require large amount of data transmission, such as online game contents that can be accessed and played by multiple users at the same time and streaming broadcast contents that streamers broadcast with a specific concept, can be easily accessed from personal computers or mobile terminals.

In general, users consume real-time online content by manipulating game characters to play games or watch broadcast content. Meanwhile, most online content services provide a function for users to communicate with broadcasters or other users through text or voice messages. However, these functions currently being provided are limited to conversation functions between users or between users and moderators, and have limitations in providing new interest in the content consumption process. Currently, if an interaction technology is developed that can induce new users to enter and improve the loyalty of users by inducing new interest in the process of providing online contents, it will be a new revenue model for providing online contents services.

Domestic Publication No. Publication Patent No. 10-2015-0098083

An object of the present invention is to propose a real-time online content providing device capable of interacting with a user, which can provide new interest to the user by supporting communication with the user through an interactive object displayed together with the real-time online content.

In order to achieve the above object, an apparatus for providing real-time online content capable of interacting with a user according to the present invention includes a content providing unit providing predefined real-time online content to a user terminal connected through a network; a response information generation unit that analyzes user input information received from the user terminal in the process of providing the real-time online content and generates response information corresponding thereto; and a user interaction unit providing the generated response information to the user terminal.

Here, the user interaction unit may output the response information through an interactive object displayed together with the real-time online content.

In one embodiment, the interactive object may be implemented as a virtual character having a predefined shape.

In one embodiment, the virtual character operates as a virtual streamer character who broadcasts while the real-time online content is provided, or is displayed independently of the streamer and supports the streamer's broadcasting.

In one embodiment, the virtual character may be implemented as at least one Non-Player Character (NPC) disposed in a virtual environment of game content while real-time game content is provided.

In one embodiment, the response information generator may input message information received from the user terminal into a predefined dialog model, generate response information output from the dialog model as response information, and the user interaction unit may control the virtual character so that the virtual character outputs the response information as a voice.

In an embodiment, the response information generator may input message information received from the user terminal into a predefined deliberation model, and generate response information based on deliberation result information output from the deliberation model.

In an embodiment, the user interaction unit may cause the NPC to output game guide information including at least one of general game information, game mission information, and game strategy information while providing the real-time game content.

According to the present invention, it is possible to provide a new interest to the user by supporting communication with the user through an interactive object displayed together with real-time online content, thereby inducing the entry of new users and improving the loyalty of the introduced users.

1 is a block diagram illustrating an apparatus for providing real-time online contents capable of interacting with a user according to the present invention.
2 to 4 are reference diagrams for explaining a method of providing streaming broadcasting content through an apparatus for providing real-time online content according to the present invention.
5 and 6 are reference diagrams for explaining a method of providing online game contents through an apparatus for providing real-time online contents according to the present invention.

Hereinafter, with reference to the accompanying drawings, an embodiment of the present invention will be described in detail so that those skilled in the art can easily practice it. In the following description, the same components are given the same names and the same reference numerals for convenience of description.

The terms used in the present invention have been selected from general terms that are currently widely used as much as possible, but in certain cases, there are also terms arbitrarily selected by the applicant, and in this case, the meaning is described in detail in the description of the invention.

1 is a block diagram illustrating a real-time online content providing apparatus 100 (hereinafter referred to as a content providing apparatus) capable of interacting with a user according to the present invention.

The content providing device 100 is a computing device connected to a user terminal (eg, personal computer, smart phone, tablet PC, etc.) through a network, and as shown in FIG. Here, the content providing device 100 may be implemented by being included in a server or personal computing device that can be managed by an online content service provider.

The content providing unit 110 provides predefined real-time online content to a user terminal.

In one embodiment, real-time online content may include at least one of streaming broadcast content, streaming video content, streaming music content, and online game content. For example, the content providing unit 110 may provide streaming broadcasting content to a user terminal in real time by interworking with a streaming broadcasting service server. For another example, the content providing unit 110 may provide online game content to a user terminal in real time by interworking with an online game service server.

The response information generation unit 120 analyzes user input information received from a user terminal in the process of providing real-time online content, and generates response information for this analysis.

In one embodiment, the user input information may correspond to message information input from the user. For example, the user input information may correspond to a chatting message input by the user while streaming broadcasting content is provided. In this embodiment, the response information generating unit 120 may generate response information corresponding to corresponding message information (chatting message) using a predefined (or pre-learned) dialog model as response information to user input information.

In another embodiment, the user input information may correspond to game operation information or message information input from the user. For example, the user input information may correspond to a character manipulation signal or a question message input by the user while online game content is provided. Here, the response information generating unit 120 is response information to user input information, and game guide information (eg, game strategy information according to game progress) corresponding to the corresponding user input information (character manipulation signal or question message) can be generated.

Meanwhile, various embodiments of user input information and response information according to the present invention will be described later.

The user interaction unit 130 provides the response information generated by the response information generation unit 120 to the user terminal. Here, the user interaction unit 130 may output response information through an interactive object displayed together with real-time online content.

An interactive object according to the present invention is a visualized object output to a user terminal, and is recognized as an object that outputs response information corresponding to the user's input information from the user's point of view.

In one embodiment, the interactive object may be implemented as a virtual character having a predefined shape. For example, the interactive object may be implemented as a virtual streamer character displayed while streaming broadcasting content is reproduced, or may be implemented as an auxiliary progressing character displayed independently of the virtual streamer character. For another example, the interactive object may be implemented as at least one Non-Player Character (NPC) disposed in a virtual environment of the game content while the online game content is provided.

Hereinafter, operations of the content providing device 100 according to various embodiments of the present invention will be described in detail.

1. Example of Implementation in Streaming Broadcasting Content

2 to 4 are reference diagrams for explaining a method of providing streaming broadcasting content through the content providing device 100 according to the present invention.

According to this implementation example, the content providing device 100 may provide an interaction function with a user in the process of providing streaming broadcasting content.

In one embodiment, a virtual character functioning as an interactive object may be implemented as a virtual streamer character performing a broadcast while streaming broadcasting content is provided. For example, referring to FIG. 2, a virtual streamer character 210 visualized as a female character may be output to the user terminal together in the process of providing streaming broadcasting content in which a game video is played and the streamer provides commentary on the progress of the game, explanation of strategy, and the like. At this time, the virtual streamer character 210 may operate to broadcast (commentary on the progress of the game, explain strategy, etc.) using a predefined (or previously learned) voice output model or conversation model. When message information (eg, today's broadcast is so fun~) is input from the user terminal during the broadcasting process, the response information generation unit 120 inputs the message to a predefined (or pre-learned) dialogue model, and generates response information (eg, thank you) output from the dialogue model as response information. Here, the user interaction unit 130 may control the streamer character 210 so that the streamer character 210 outputs the answer information generated by the response information generator 120 as a voice. For example, the user interaction unit 130 may control the streamer character 210 to output the corresponding answer text as voice by using a TTS (Text-to-SPEECH) module that converts text into voice and a speech animation engine that renders the character's expression and mouth shape in response to pronunciation.

In another embodiment, a virtual character functioning as an interactive object is displayed independently of the streamer (or virtual streamer character) and supports the broadcast progress of the streamer (or virtual streamer character). It can be implemented as a virtual auxiliary progress character. For example, referring to FIG. 2 , in the process of providing streaming broadcasting content, a virtual auxiliary progressing character 220 visualized as a specific animal (eg, bird) may be output together to the user terminal. At this time, the virtual auxiliary progressing character 220 assists in the progress of the broadcast (explanation of game functions, description of items, humor, provision of general information, etc.) using a predefined (or prelearned) voice output model or conversation model. Can operate. As in the previous embodiment, the response information generating unit 120 may generate response information corresponding to a user's chatting message as response information using a predefined (or pre-learned) conversation model, and the user interaction unit 130 may control the virtual auxiliary progressing character 220 to output the generated answer information as a voice.

In an embodiment, the response information generating unit 120 may input message information received from the user terminal into a predefined deliberation model and generate response information based on deliberation result information output from the deliberation model. For example, referring to FIG. 3 , when message information is input from a plurality of user terminals (USER1 to 5) in the course of providing streaming broadcasting content, the response information generation unit 120 may input the message information to a predefined (or pre-learned) conversation deliberation model, and generate deliberation result information output from the conversation deliberation model (e.g., USER1 profanity, USER2 profanity, and USER3 profanity) as response information. Here, the user interaction unit 130 may take a disciplinary measure against a specific user based on the deliberation result information generated by the response information generation unit 120 . For example, the user interaction unit 130 may manage a user who inputs an inappropriate message (eg, profanity) as a black list as a result of deliberation. In addition, the user interaction unit 130 may filter and output inappropriate messages (eg, profanity) as a result of the deliberation, or may not display the corresponding message on the screen. Meanwhile, the user interaction unit 130 may perform a compensation action for a specific user based on the deliberation result information generated by the response information generation unit 120 . For example, as a result of deliberation, the user interaction unit 130 may manage users who input good messages (eg, cheering messages) a predetermined number of times or more as a white list. Also, the user interaction unit 130 may perform a compensation action such as providing a specific item to a user included in the white list.

4 is an example of implementing the detailed configuration of the response information generating unit 120 according to this implementation example. Referring to FIG. 4 , a text answer may be generated by inputting a text question input from a user of the response information generator 120 into at least one dialog model (a search-based dialog model, a machine reading-based dialog model, and a generated dialog model). Here, each dialogue model can be interlocked with a pre-stored DB (consultation, commercial classification DB, wiki document DB, broadcast script DB), and in the case of a generated dialogue model, a final text answer can be output through a dialogue deliberation model for deliberation on output text answers. On the other hand, the example shown in FIG. 4 is not intended to limit the scope of the present invention, and unlike a combination of the detailed components shown in FIG. 4, it goes without saying that some components may be omitted or added.

2. Examples of implementation in online game contents

5 and 6 are reference diagrams for explaining a method of providing online game content through the content providing device 100 according to the present invention.

According to this implementation example, the content providing device 100 may provide an interaction function with a user while providing online game content. On the other hand, the redundant content among the embodiments described in 1. above is omitted, but it is of course applicable to this implementation example.

In one embodiment, a virtual character functioning as an interactive object may be implemented as at least one Non-Player Character (NPC) disposed in a virtual environment of game content while online game content is provided. For example, referring to FIG. 5 , in the process of providing online game content (e.g., MMO RPG), NPCs (eg, pets, guide characters, enemy characters, etc.) defined to perform predefined actions according to the progress of the game other than game characters operated by the user may be provided. At this time, the NPC 230 may operate to interact with the user using a predefined (or pre-learned) voice output model or conversation model. When game manipulation information (eg, character manipulation signals) is input from the user terminal during the game progress, the response information generating unit 120 determines the game progress according to the game manipulation information, and generates game guide information corresponding to the game progress (eg, general game information, game mission information, game strategy information, etc.) as response information. Here, the user interaction unit 130 may control the NPC 230 so that the NPC 230 outputs the game guide information generated by the response information generation unit 120 as a voice.

In one embodiment, the game guide information may include at least one of game general information, game mission information, and game strategy information. For example, the response information generation unit 120 may generate game general information (eg, company, game introduction, character control method, character characteristics, etc.), game mission information (eg, a list of missions to be performed until mission completion, detailed description of a specific mission, etc.), game strategy information (eg, play strategy in a specific situation, items used for a specific enemy, movement route, attack method, etc.) in response to a game progress or a user's question. 30) can control the NPC 230 to output as a voice. On the other hand, it goes without saying that the conversation function and conversation deliberation function described in 1 above can also be applied in this implementation example.

6 is an example of implementing the detailed configuration of the response information generation unit 120 according to this implementation example. Referring to FIG. 6 , a text answer may be generated by inputting a text question input from a user of the response information generation unit 120 into at least one dialog model (a search-based dialog model, a machine reading-based dialog model, and a generated dialog model). Here, each dialogue model may be linked with a pre-stored DB (game dialogue DB, game guide DB, dialogue DB), and in the case of a generated dialogue model, a final text answer may be output through a dialogue deliberative model for deliberation on output text answers. On the other hand, the example shown in FIG. 6 is not intended to limit the scope of the present invention, and unlike the combination of the detailed components shown in FIG. 6, of course, some components may be omitted or added.

The present invention as described above can be performed as program instructions for implementing it, and a computer-readable recording medium on which these program instructions are recorded is, for example, ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical media storage device, etc.

In addition, the computer-readable recording medium on which the above-described program is recorded is distributed to computer devices connected through a network, so that computer-readable codes can be stored and executed in a distributed manner. In this case, any one or more computers among the plurality of distributed computers may execute some of the functions presented above and transmit the execution results to one or more of the other distributed computers, and the computer receiving the results may also execute some of the functions presented above and provide the results to other distributed computers as well.

In the above, even though all components constituting the embodiment of the present invention have been described as being combined or operated as one, the present invention is not necessarily limited to these embodiments. That is, within the scope of the object of the present invention, all of the components may be selectively combined with one or more to operate. In addition, all of the components may be implemented as one independent hardware, but some or all of the components are selectively combined to perform some or all of the combined functions in one or a plurality of hardware. It may also be implemented as a computer program having a program module. Codes and code segments constituting the computer program may be easily inferred by a person skilled in the art. Such a computer program may implement an embodiment of the present invention by being stored in a computer readable storage medium, read and executed by a computer. A storage medium of a computer program may include a magnetic recording medium, an optical recording medium, and the like.

In addition, terms such as "comprise", "comprise" or "having" described above mean that the corresponding component may be inherent unless otherwise stated, and thus exclude other components. It should be interpreted as being able to further include other components. All terms, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs, unless defined otherwise. Commonly used terms, such as terms defined in a dictionary, should be interpreted as consistent with the meaning in the context of the related art, and unless explicitly defined in the present invention, they are not interpreted in an ideal or excessively formal meaning.

The above description is merely an example of the technical idea of the present invention, and various modifications and variations can be made to those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be construed according to the following claims, and all technical ideas within the equivalent range should be construed as being included in the scope of the present invention.

100: real-time online content providing device
110: content provision unit
120: response information generation unit
130: user interaction unit
210: virtual streamer character
220: virtual auxiliary progress character
230: NPCs

Claims (7)

A device for providing real-time online content capable of interacting with a user,
a content providing unit providing predefined real-time online content to a user terminal connected through a network;
a response information generation unit that analyzes user input information received from the user terminal in the process of providing the real-time online content and generates response information corresponding thereto; and
A user interaction unit providing the generated response information to the user terminal;
Characterized in that the user interaction unit outputs the response information through an interactive object displayed together with the real-time online content.
Real-time online content delivery device.
The method of claim 1, wherein the interactive object,
Characterized in that it is implemented as a virtual character of a predefined shape,
Real-time online content delivery device.
The method of claim 2, wherein the virtual character,
Characterized in that it operates as a virtual streamer character who broadcasts in the process of providing the real-time online content, or as a virtual auxiliary character that is displayed independently of the streamer and supports the streamer's broadcast progress,
Real-time online content delivery device.
The method of claim 2, wherein the virtual character,
Characterized in that it is implemented as at least one NPC (Non-Player Character) placed in the virtual environment of the game content in the process of providing real-time game content,
Real-time online content delivery device.
According to claim 3 or 4,
The response information generating unit inputs message information received from the user terminal into a predefined dialog model, and generates response information output from the dialog model as response information;
Characterized in that the user interaction unit controls the virtual character so that the virtual character outputs the response information as a voice.
Real-time online content delivery device.
The method of claim 5, wherein the response information generator,
Characterized in that message information received from the user terminal is input into a predefined deliberation model, and response information is generated based on deliberation result information output from the deliberation model.
Real-time online content delivery device.
The method of claim 4, wherein the user interaction unit,
Characterized in that the NPC outputs game guide information including at least one of game general information, game mission information, and game strategy information in the process of providing the real-time game content.
Real-time online content delivery device.