KR102641088B1 - Appatus for providing real-time online contents capable of interacting with user - Google Patents

Abstract

A real-time online content providing device capable of interacting with a user according to the present invention includes a content providing unit that provides predefined real-time online content to a user terminal connected through a network; a response information generator that analyzes user input information received from the user terminal in the process of providing the real-time online content and generates response information corresponding thereto; and a user interaction unit providing the generated response information to the user terminal.
Here, the user interaction unit may cause the response information to be output through an interactive object displayed together with the real-time online content.

Description

Real-time online content provision device capable of interacting with users {APPATUS FOR PROVIDING REAL-TIME ONLINE CONTENTS CAPABLE OF INTERACTING WITH USER}

The present invention relates to content provision technology that allows interaction with users through virtual objects output in the process of providing real-time online content.

As the speed of wired and wireless networks and the performance of computing devices have greatly improved, a variety of online content that can be enjoyed in real time is becoming available. A variety of online content that requires large-capacity data transmission, such as online game content that multiple users can access and play simultaneously, and streaming broadcast content that a streamer broadcasts with a specific concept, can be easily accessed on personal computers or mobile devices.

In general, users consume real-time online content by manipulating game characters to play games or watching broadcast content. Meanwhile, most online content services provide the ability for users to communicate with broadcasters or other users through text or voice messages. However, these functions currently provided are limited to conversation functions between users or between users and hosts, and have limitations in providing new interest in the content consumption process. Currently, if interaction technology is developed that can induce new users to enter and improve the loyalty of new users by arousing new interest in users in the process of providing online content, it could become a new profit model for providing online content services. .

Domestic Publication No. Publication Patent No. 10-2015-0098083

The present invention seeks to propose a real-time online content providing device capable of interacting with users, which can provide new interest to users by supporting communication with users through interactive objects displayed together with real-time online content.

In order to achieve the above object, a real-time online content providing device capable of interacting with a user according to the present invention includes a content providing unit that provides predefined real-time online content to a user terminal connected through a network; a response information generator that analyzes user input information received from the user terminal in the process of providing the real-time online content and generates response information corresponding thereto; and a user interaction unit providing the generated response information to the user terminal.

Here, the user interaction unit may cause the response information to be output through an interactive object displayed together with the real-time online content.

In one embodiment, the interactive object may be implemented as a virtual character with a predefined shape.

In one embodiment, the virtual character operates as a virtual streamer character that broadcasts during the process of providing the real-time online content, or is displayed independently of the streamer and supports the broadcasting progress of the streamer. It can act as a virtual auxiliary character.

In one embodiment, the virtual character may be implemented as at least one Non-Player Character (NPC) placed in the virtual environment of the game content during the process of providing real-time game content.

In one embodiment, the response information generation unit inputs message information received from the user terminal into a predefined conversation model and generates response information output from the conversation model as response information, and the user interaction unit includes the The virtual character can be controlled so that the virtual character outputs the response information as a voice.

In one embodiment, the response information generator may input message information received from the user terminal into a predefined deliberation model and generate response information based on deliberation result information output from the deliberation model.

In one embodiment, the user interaction unit may cause the NPC to output game guide information including at least one of general game information, game mission information, and game strategy information while the real-time game content is provided.

According to the present invention, it is possible to provide new interest to users by supporting communication with users through interactive objects displayed together with real-time online content, thereby encouraging the entry of new users and improving the loyalty of introduced users. There is a possible effect.

1 is a block diagram illustrating a real-time online content providing device capable of interacting with a user according to the present invention.
2 to 4 are reference diagrams for explaining a method of providing streaming broadcast content through a real-time online content providing device according to the present invention.
5 and 6 are reference diagrams for explaining a method of providing online game content through a real-time online content providing device according to the present invention.

Hereinafter, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily practice it. In the following description, identical components are given the same names and symbols for convenience of explanation.

The terms used in the present invention are general terms that are currently widely used as much as possible, but in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning is described in detail in the description of the relevant invention, so the simple terms The present invention must be understood in terms of the meaning of the term, not the name.

Figure 1 is a block diagram illustrating a real-time online content providing device 100 (hereinafter referred to as a content providing device) capable of interacting with a user according to the present invention.

The content providing device 100 is a computing device connected to a user terminal (e.g., personal computer, smartphone, tablet PC, etc.) through a network. As shown in FIG. 1, the content providing unit 110 generates response information. It is configured to include a unit 120 and a user interaction unit 130. Here, the content providing device 100 may be implemented by being included in a server or personal computing device that can be managed by an online content service provider.

The content provider 110 provides predefined real-time online content to the user terminal.

In one embodiment, real-time online content may include at least one of streaming broadcast content, streaming video content, streaming music content, and online game content. For example, the content provider 110 may provide streaming broadcast content to a user terminal in real time in conjunction with a streaming broadcast service server. For another example, the content provider 110 may provide online game content to the user terminal in real time by linking with an online game service server.

The response information generator 120 analyzes user input information received from the user terminal in the process of providing real-time online content and generates response information therefor.

In one embodiment, user input information may correspond to message information input from the user. For example, the user input information may correspond to a chat message entered by the user while streaming broadcast content is provided. In this embodiment, the response information generator 120 generates response information corresponding to the message information (chat message) using a predefined (or pre-learned) conversation model as response information to user input information. You can.

In another embodiment, the user input information may correspond to game operation information or message information input from the user. For example, user input information may correspond to a character manipulation signal or question message input by the user in the process of providing online game content. Here, the response information generator 120 is response information to user input information, and provides game guide information (e.g., game strategy information according to the game progress, etc.) corresponding to the user input information (character manipulation signal or question message). ) can be created.

Meanwhile, various embodiments of user input information and response information according to the present invention will be described later.

The user interaction unit 130 provides response information generated by the response information generation unit 120 to the user terminal. Here, the user interaction unit 130 can output response information through an interactive object displayed along with real-time online content.

The interactive object according to the present invention is a visualized object output to a user terminal, and is recognized by the user as an object that outputs response information corresponding to the user's input information.

In one embodiment, the interactive object may be implemented as a virtual character with a predefined shape. For example, the interactive object may be implemented as a virtual streamer character displayed while streaming broadcast content is played, or may be implemented as an auxiliary progress character displayed independently from the virtual streamer character. For another example, the interactive object may be implemented as at least one Non-Player Character (NPC) placed in the virtual environment of the game content during the process of providing online game content.

Hereinafter, the operation of the content providing device 100 according to various embodiments of the present invention will be described in detail.

1. Example of implementation in streaming broadcast content

2 to 4 are reference diagrams for explaining a method of providing streaming broadcast content through the content providing device 100 according to the present invention.

According to this implementation example, the content providing device 100 can provide an interaction function with the user in the process of providing streaming broadcast content.

In one embodiment, a virtual character that functions as an interactive object may be implemented as a virtual streamer character that conducts broadcasting while streaming broadcast content is provided. For example, referring to Figure 2, in the process of providing streaming broadcast content in which a game video is played and a streamer provides commentary on the game progress, strategy explanation, etc., a virtual streamer character visualized as a female character ( 210) may be output together on the user terminal. At this time, the virtual streamer character 210 may operate to broadcast (commentary on the game progress, explanation of strategy, etc.) using a predefined (or pre-learned) voice output model or conversation model. During the broadcast process, when message information (e.g., today's broadcast is so interesting~) is input from the user terminal, the response information generator 120 inputs it into a predefined (or pre-learned) conversation model, and from the conversation model The output response information (e.g., thank you) can be created as response information. Here, the user interaction unit 130 may control the streamer character 210 to output the answer information generated by the response information generator 120 as a voice. For example, the user interaction unit 130 uses a TTS (TEXT-TO-SPEECH) module that converts text into speech, and a speech animation engine that renders the character's facial expression and mouth shape in response to pronunciation, to create a streamer character. (210) can be controlled to output the corresponding answer text as a voice.

In another embodiment, a virtual character that functions as an interactive object is displayed independently of the streamer (or virtual streamer character) and is a virtual assistant that supports the broadcast progress of the streamer (or virtual streamer character). It can be implemented as a progression character. For example, referring to FIG. 2, in the process of providing streaming broadcast content, a virtual auxiliary character 220 visualized as a specific animal (eg, a bird) may be output to the user terminal. At this time, the virtual assistant host character 220 uses a predefined (or pre-learned) voice output model or conversation model to assist in broadcasting (description of game functions, description of items, humor, provision of general information, etc.) It can work. As in the previous embodiment, the response information generation unit 120 may generate response information corresponding to the user's chat message as response information using a predefined (or pre-learned) conversation model, and the user interaction unit 130 ) can control the virtual auxiliary progress character 220 so that the virtual auxiliary progress character 220 outputs the generated answer information as a voice.

In one embodiment, the response information generator 120 may input message information received from the user terminal into a predefined deliberation model and generate response information based on deliberation result information output from the deliberation model. For example, referring to FIG. 3, in the process of providing streaming broadcast content, when message information is input from a plurality of user terminals (USER1 to 5), the response information generator 120 generates a predefined (or predefined) message information. learned) conversation deliberation model, and deliberation result information output from the conversation deliberation model (e.g., USER1 profanity, USER2 profanity, USER3 profanity) can be generated as response information. Here, the user interaction unit 130 may carry out sanctions against a specific user based on the deliberation result information generated by the response information generation unit 120. For example, the user interaction unit 130 may manage a blacklist of users who entered inappropriate messages (e.g., profanity) as a result of deliberation. Additionally, the user interaction unit 130 may filter inappropriate messages (e.g., profanity) as a result of deliberation, highlight them, and output them, or may not output the messages on the screen. Meanwhile, the user interaction unit 130 may perform compensation measures for a specific user based on the deliberation result information generated by the response information generation unit 120. For example, the user interaction unit 130 may manage a white list of users who have entered good messages (e.g., cheering messages) more than a predefined number of times as a result of deliberation. Additionally, the user interaction unit 130 may perform compensation measures such as providing specific items to users included in the white list.

Figure 4 is an example of the detailed configuration of the response information generator 120 according to this implementation example. Referring to FIG. 4, the response information generator 120 can generate a text answer by inputting a text question input from the user into at least one conversation model (search-based conversation model, machine reading-based conversation model, generation conversation model). there is. Here, each conversation model can be linked to a pre-stored DB (consultation, commercial category DB, wiki document DB, broadcast script DB), and in the case of a generated conversation model, the output text answer is reviewed through the conversation deliberation model. It may be configured to output a final text answer. Meanwhile, the example shown in FIG. 4 is not intended to limit the scope of the present invention, and of course, unlike the combination of detailed configurations shown in FIG. 4, some configurations may be omitted or added.

2. Example of implementation in online game content

5 and 6 are reference diagrams for explaining a method of providing online game content through the content providing device 100 according to the present invention.

According to this implementation example, the content providing device 100 can provide an interaction function with the user in the process of providing online game content. Meanwhile, overlapping content among the embodiments described in 1. above will be omitted, but it is of course applicable to this implementation example as well.

In one embodiment, a virtual character functioning as an interactive object may be implemented as at least one Non-Player Character (NPC) placed in the virtual environment of the game content during the process of providing online game content. For example, referring to FIG. 5, in the process of providing online game content (e.g., MMO RPG), an NPC (230) defined to perform predefined actions according to the game progress other than the game character manipulated by the user , e.g. pets, guide characters, enemy characters, etc.) may be provided. At this time, the NPC 230 may operate to interact with the user using a predefined (or previously learned) voice output model or conversation model. When game operation information (e.g., character operation signal) is input from the user terminal during the game progress, the response information generator 120 determines the game progress status according to the game operation information and provides game guide information corresponding to the game progress status. (Example: game general information, game mission information, game strategy information, etc.) can be generated as response information. Here, the user interaction unit 130 may control the NPC 230 so that the NPC 230 outputs the game guide information generated by the response information generation unit 120 as a voice.

In one embodiment, the game guide information may include at least one of game general information, game mission information, and game strategy information. For example, the response information generator 120 responds to the game progress or the user's questions, and provides game general information (e.g., company, game introduction, character operation method, character characteristics, etc.), game mission information (e.g., mission completion) You can create a list of missions to be performed, detailed descriptions of specific missions, etc.), game strategy information (e.g. play strategies in specific situations, items to use against specific enemies, movement paths, attack methods, etc.), and user interaction. The unit 130 may control the NPC 230 so that the NPC 230 outputs the generated game guide information as a voice. Meanwhile, of course, the conversation function and conversation deliberation function described above in 1. can also be applied in this implementation example.

Figure 6 is an example of the detailed configuration of the response information generator 120 according to this implementation example. Referring to FIG. 6, the response information generator 120 can generate a text answer by inputting a text question input from the user into at least one conversation model (search-based conversation model, machine reading-based conversation model, generation conversation model). there is. Here, each dialogue model can be linked to a pre-stored DB (game dialogue DB, game guide DB, dialogue DB), and in the case of a generated dialogue model, the final text answer is provided through a dialogue deliberation model to deliberate on the output text answer. It can be configured to output. Meanwhile, the example shown in FIG. 6 is not intended to limit the scope of the present invention, and of course, unlike the combination of detailed configurations shown in FIG. 6, some configurations may be omitted or added.

The present invention as described above can be implemented as program instructions for implementing the same, and recording media that can be read by a computer recording these program instructions include, for example, ROM, RAM, CD-ROM, magnetic tape, and floppy disk. These include disks and optical media storage devices.

In addition, a computer-readable recording medium recording the above-described program can be distributed to computer devices connected to a network, so that computer-readable code can be stored and executed in a distributed manner. In this case, any one or more of the multiple distributed computers may execute some of the functions presented above, transmit the execution results to one or more of the other distributed computers, and receive the results. A computer can also execute some of the functions presented above and provide the results to other distributed computers as well.

In the above, even though all the components constituting the embodiment of the present invention are described as being combined or operating in combination, the present invention is not necessarily limited to this embodiment. That is, as long as it is within the scope of the purpose of the present invention, all of the components may be operated by selectively combining one or more of them. In addition, although all of the components may be implemented as a single independent hardware, a program module in which some or all of the components are selectively combined to perform some or all of the functions of one or more pieces of hardware. It may also be implemented as a computer program having. The codes and code segments that make up the computer program can be easily deduced by a person skilled in the art of the present invention. Such a computer program can be stored in a computer-readable storage medium and read and executed by a computer, thereby implementing embodiments of the present invention. Storage media for computer programs may include magnetic recording media, optical recording media, and the like.

In addition, terms such as “include,” “comprise,” or “have” as used above mean that the corresponding component may be included, unless specifically stated to the contrary, and thus do not exclude other components. Rather, it should be interpreted as being able to include other components. All terms, including technical or scientific terms, unless otherwise defined, have the same meaning as generally understood by a person of ordinary skill in the technical field to which the present invention pertains. Commonly used terms, such as terms defined in a dictionary, should be interpreted as consistent with the meaning in the context of the related technology, and should not be interpreted in an idealized or overly formal sense unless explicitly defined in the present invention.

The above description is merely an illustrative explanation of the technical idea of the present invention, and various modifications and variations will be possible to those skilled in the art without departing from the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but are for illustrative purposes, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of rights of the present invention.

100: Real-time online content provision device
110: Content provision department
120: Response information generation unit
130: User interaction unit
210: Virtual streamer character
220: Virtual auxiliary progress character
230 : NPC

Claims (7)

In a real-time online content provision device capable of interacting with users,
a content provider that provides predefined real-time online content to a user terminal connected through a network;
a response information generator that inputs message information received from the user terminal in the process of providing the real-time online content into a predefined conversation model and generates response information output from the conversation model as response information; and
Including a user interaction unit that outputs the response information through the voice of an interactive object displayed together with the real-time online content,
The interactive object is,
Characterized in that it is implemented as a virtual character of a predefined shape, outputs the response information through the voice of the virtual character, and determines the facial expression and mouth shape of the virtual character according to the text content of the response information.
A real-time online content delivery device.
delete The method of claim 1, wherein the virtual character is:
In the process of providing the real-time online content, it operates as a virtual streamer character that conducts broadcasting, or is displayed independently of the streamer and operates as a virtual auxiliary character that supports the broadcasting progress of the streamer. to,
A real-time online content delivery device.
The method of claim 1, wherein the virtual character is:
Characterized by being implemented as at least one NPC (Non-Player Character) placed in the virtual environment of the game content in the process of providing real-time game content,
A real-time online content delivery device.
delete The method of claim 1, wherein the response information generator,
Characterized by inputting message information received from the user terminal into a predefined deliberation model and generating response information based on deliberation result information output from the deliberation model,
A real-time online content delivery device.
The method of claim 4, wherein the user interaction unit,
Characterized in that the NPC outputs game guide information including at least one of game general information, game mission information, and game strategy information in the process of providing the real-time game content.
A real-time online content delivery device.