KR20210142515A - Method, apparatus and computer program for providing bidirectional interaction broadcasting service with viewer participation - Google Patents

Abstract

A method, apparatus, and computer program for providing a viewer-participating bidirectional interaction broadcast service are provided. The method for providing a viewer-participating bidirectional interaction broadcast service in accordance with various embodiments of the present invention, the viewer-participating bidirectional interaction broadcast service executed by a computing apparatus, comprises the steps of: collecting broadcast streaming data from a terminal of a broadcaster; and providing the collected broadcast streaming data to terminals of one or more viewers connected to a broadcast channel of the broadcaster. The step of providing the broadcast streaming data includes: processing the broadcast streaming data so that a viewer image corresponding to the one or more viewers is displayed on a broadcast screen, wherein properties of the viewer image to be displayed on the broadcast screen are determined based on a broadcaster input obtained from the terminal of the broadcaster; and providing the processed broadcast streaming data to the terminal of the broadcaster and the terminals of the one or more viewers.

Description

Method, apparatus and computer program for providing audience participation interactive interactive broadcasting service

Various embodiments of the present invention relate to a method, apparatus, and computer program for providing a viewer-participating interactive broadcast service.

As Internet technology develops, technology for providing content in the form of text, image, and video through the Internet is rapidly developing, and video platforms (eg, YouTube) and Internet broadcasting platforms (eg, Afreeca TV, Twitch) TV and Daumpot) and portal site platforms (eg Daum, Google, etc.) are provided through the Internet, and platforms where you can check and enjoy various contents are increasing.

With the increase of these platforms, an environment has been created where viewers can consume the content they want at the time and place they want, and in line with this trend, anyone can create and provide content or communicate with viewers in real time. Live broadcasting platforms are growing explosively.

The most popular category for personal live broadcasting is entertainment, and the most important value is fun. In particular, it is the participation of viewers that can give the greatest fun in a live broadcast conducted in real time.

However, in the case of the conventional personal live broadcasting platform, there is a limited form of participation, such as generally viewing only broadcasting contents provided by broadcasters, or participating in broadcasting contents only through messages and chatting services through sponsorship. It is difficult to make more interactions with the trimmer.

In addition, although broadcasters induce active participation of viewers in the conventional personal live broadcasting platform, the majority of viewers can induce active participation due to the characteristics of viewers who are reluctant to reveal their identities in live broadcasting in which an unspecified majority participate. There is a problem that there is no

Korean Patent Laid-Open Patent No. 10-2012-0079272 (2012.07.12)

The problem to be solved by the present invention is to display a viewer image corresponding to a viewer connected to a broadcast channel on a broadcast screen, and allow viewers to participate actively in broadcast content provided by the broadcaster through the viewer image. It is to provide a method, apparatus and computer program for providing a viewer participatory interactive interactive broadcasting service that can provide

Another problem to be solved by the present invention is to display the viewer image corresponding to the viewer on the broadcast screen, but to reveal the identity of the viewer by determining the output form through the viewer image according to the degree of face exposure desired by the viewer An object of the present invention is to provide a method, apparatus, and computer program for providing a viewer-participating interactive interactive broadcasting service that enables even reluctant viewers to actively participate.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

A viewer participation type interactive interactive broadcast service providing method according to an embodiment of the present invention for solving the above problems, in the viewer participation type interactive interactive broadcast service providing method performed by a computing device, broadcast streaming data from a terminal of a broadcaster and providing the collected broadcast streaming data to terminals of one or more viewers connected to a broadcast channel of the broadcaster, wherein the step of providing the broadcast streaming data includes a viewer corresponding to the one or more viewers. Processing the broadcast streaming data so that an image is displayed on a broadcast screen, based on a broadcaster input obtained from a terminal of the broadcaster, determining a property of the viewer image displayed on the broadcast screen, and the processed broadcast streaming It may include providing data to the terminal of the broadcaster and the terminal of the one or more viewers.

In various embodiments, the determining of the attribute of the viewer image includes: obtaining a request for participation in the broadcast content provided by the broadcaster from the terminal of the one or more viewers; At least one of the one or more viewers requesting participation from the broadcaster It may include receiving a selection of one viewer and processing the broadcast streaming data so that a viewer image corresponding to the selected at least one viewer is displayed on the broadcast screen.

In various embodiments, the determining of the properties of the viewer image may include, based on the broadcaster's input and properties of broadcast content provided by the broadcaster, among the location, size, and shape of the viewer image displayed on the broadcast screen. determining at least one.

In various embodiments, the providing of the broadcast streaming data may include, when receiving a broadcaster input requesting to display a specific object on the broadcast screen from the terminal of the broadcaster, the specific object is displayed on the broadcast screen In response to obtaining a first viewer input for selecting a specific object displayed on the broadcast screen N times from a terminal of a first viewer, based on the processed broadcast streaming data, processing and providing the broadcast streaming data The method may include performing an interaction between the first viewer and the specific object, and processing and providing the broadcast streaming data so that a viewer interaction result derived by performing the interaction is displayed on the broadcast screen.

In various embodiments, the method may further include providing a broadcast channel list including a plurality of broadcast channels being broadcast through the viewer participatory interactive interactive broadcast service, wherein the providing of the broadcast channel list includes: the plurality of broadcast channels Based on the result of viewer interaction through a plurality of broadcast contents carried out in each, a total interaction result score for each of the plurality of broadcast channels is calculated, and the calculated total interaction result score is sequentially arranged from the highest broadcast channel. may include the step of

In various embodiments, the determining of the attribute of the viewer image, the providing of the broadcast streaming data, includes removing the background area of the broadcaster from the broadcast screen, and removing the background area of the viewer from the viewer image It may include processing and providing the broadcast streaming data as possible.

In various embodiments, the determining of the attribute of the viewer image includes receiving, from each of the one or more viewers, an exposure degree of a viewer's face exposed through the viewer image, and exposure through the viewer image according to the set exposure degree. and determining the shape of the viewer's face to become determining not to expose the face of the first viewer through the first viewer image, or determining that the character image selected from the first viewer is exposed through the first viewer image, the exposure degree set by the first viewer being the second grade In response, determining that a result of synthesizing a face image uploaded from the first viewer and an object selected by the first viewer based on a deepfake is exposed through the first viewer image, and the first viewer The method may include outputting the face image uploaded from the first viewer through the first viewer image as it is in response to the exposure degree set from the third grade.

In various embodiments, the determining of the property of the viewer image includes adjusting the number of viewer images displayed on the broadcast screen according to the property of the broadcast screen, and adjusting the number of viewer images In the step, when it is determined that the number of viewer images displayed on the broadcast screen needs to be reduced, the broadcast screen sequentially starts with a viewer image corresponding to a viewer having a low score as a result of interaction through broadcast content provided from the broadcaster. It may include removing from the phase.

In various embodiments, the determining of the attribute of the viewer image includes: obtaining a first viewer input indicating a display position of the first viewer image on the broadcast screen from a first viewer; determining whether a first display position is located within a movable area preset by the broadcaster; and when it is determined that the first display position is located within the movable area, setting the first viewer image to the first moving to a display position, wherein moving to the first display position comprises: when obtaining a plurality of first viewer inputs pointing to the first display position from a plurality of viewers, the first one of the plurality of viewers Moving a viewer image corresponding to any one of a viewer who first inputted a first viewer input indicating a display location and a viewer having the highest viewer interaction result score through broadcast content to the first display location can

In various embodiments, the determining of the attribute of the viewer image may include displaying text and emoticons corresponding to the second viewer input on the broadcast screen based on obtaining second viewer input from the one or more viewers. and displaying the text and the emoticon on the broadcast screen, wherein the broadcasting content provided by the broadcaster, a preset rule from the broadcaster, the number of viewers connected to the broadcaster's broadcast channel, and and determining a position, size, shape, and display holding time of the text and the emoticon on the broadcast screen in consideration of at least one of the number of second viewer inputs input from the one or more viewers. .

In various embodiments, the determining of the properties of the viewer image may include: based on a preset viewer image template for each broadcast content, the viewer image displayed on a pre-broadcast screen according to the type of broadcast content that the broadcaster proceeds with. determining the location, size and shape.

In various embodiments, the determining of the attribute of the viewer image may include at least one of the number of viewers connected to the broadcast channel, the type of broadcast content of the broadcaster, and the number of participating viewers preset by the broadcaster. It may include determining the number, size, and shape of the viewer images displayed on the broadcast screen based on the.

An apparatus for providing a viewer-participating interactive interactive broadcast service according to another embodiment of the present invention for solving the above problems includes a memory for storing one or more instructions and a processor for executing the one or more instructions stored in the memory, By executing the one or more instructions, the processor may perform the method for providing a viewer-participating interactive interactive broadcast service according to an embodiment of the present invention.

A computer program according to another embodiment of the present invention for solving the above-described problems is combined with a computer that is hardware, so that the computer can perform the method for providing a viewer-participating interactive interactive broadcasting service according to an embodiment of the present invention. It may be stored in a readable recording medium.

Other specific details of the invention are included in the detailed description and drawings.

According to various embodiments of the present invention, by displaying a viewer image corresponding to a viewer connected to a broadcast channel on a broadcast screen and allowing the viewer to participate in broadcast content provided by the broadcaster through the viewer image, viewers can actively participate It is possible to provide a viewer-participating interactive interactive broadcasting service that can give fun.

In addition, the viewer image corresponding to the viewer is displayed on the broadcast screen, but by determining the output format through the viewer image according to the degree of face exposure desired by the viewer, viewers who are reluctant to reveal their identity can also actively participate. It is possible to provide a viewer participatory interactive interactive broadcasting service.

In addition, for users who feel burdened by exposing their faces as well as their voices, participants participating in broadcast content are allowed to participate in broadcast content through chatting, but chatting and broadcast content input from viewers who watch broadcast content By differentiating the output form and method of chatting input from participants who participate directly in can provide

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram illustrating a system for providing a viewer-participating interactive interactive broadcasting service according to an embodiment of the present invention.
2 is a hardware configuration diagram of an apparatus for providing a viewer-participating interactive interactive broadcast service according to another embodiment of the present invention.
3 is a flowchart of a method for providing a viewer participatory interactive interactive broadcast service according to another embodiment of the present invention.
4 is a flowchart of a method of processing broadcast streaming data, in various embodiments.
5 is a flowchart of a method of performing an interaction between a user and an object according to broadcast content, according to various embodiments of the present disclosure;
6 to 10 are diagrams exemplarily illustrating a user interface (UI) of a viewer participation type interactive interactive broadcast service provided by an apparatus for providing a viewer participation type interactive interactive broadcast service, according to various embodiments.
11 to 18 are diagrams exemplarily showing a broadcast screen of a viewer participatory interactive broadcast service UI applicable to various embodiments.
19 is a diagram exemplarily showing a home screen of a viewer participation type interactive interactive broadcasting service UI applicable to various embodiments.
20 is a diagram exemplarily showing a more screen of a viewer participatory interactive interactive broadcasting service UI applicable to various embodiments.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and those of ordinary skill in the art to which the present invention pertains. It is provided to fully understand the scope of the present invention to those skilled in the art, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. As used herein, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein will have the meaning commonly understood by those of ordinary skill in the art to which this invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

As used herein, the term “unit” or “module” refers to a hardware component such as software, FPGA, or ASIC, and “unit” or “module” performs certain roles. However, “part” or “module” is not meant to be limited to software or hardware. A “unit” or “module” may be configured to reside on an addressable storage medium or to reproduce one or more processors. Thus, by way of example, “part” or “module” refers to components such as software components, object-oriented software components, class components and task components, processes, functions, properties, Includes procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables. Components and functionality provided within “parts” or “modules” may be combined into a smaller number of components and “parts” or “modules” or as additional components and “parts” or “modules”. can be further separated.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc. It can be used to easily describe the correlation between a component and other components. A spatially relative term should be understood as a term that includes different directions of components during use or operation in addition to the directions shown in the drawings. For example, when a component shown in the drawing is turned over, a component described as “beneath” or “beneath” of another component may be placed “above” of the other component. can Accordingly, the exemplary term “below” may include both directions below and above. Components may also be oriented in other orientations, and thus spatially relative terms may be interpreted according to orientation.

In this specification, a computer means all types of hardware devices including at least one processor, and may be understood as encompassing software configurations operating in the corresponding hardware device according to embodiments. For example, a computer may be understood to include a smartphone, a tablet PC, a desktop, a notebook computer, and a user client and an application running on each device, but is not limited thereto.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Each step described in this specification is described as being performed by a computer, but the subject of each step is not limited thereto, and at least a portion of each step may be performed in different devices according to embodiments.

1 is a diagram illustrating a system for providing a viewer-participating interactive interactive broadcasting service according to an embodiment of the present invention.

Referring to FIG. 1 , a viewer participation type interactive interactive broadcast service providing system according to an embodiment of the present invention includes a viewer participation type interactive interactive broadcast service providing apparatus 100 , a broadcaster terminal 200 , a viewer terminal 300 and an external device. The server 400 may be included.

Here, the viewer participation type interactive interactive broadcasting service providing system shown in FIG. 1 is according to an embodiment, and its components are not limited to the embodiment shown in FIG. 1, and may be added, changed, or deleted as necessary. have.

In an embodiment, the viewer participation type interactive interactive broadcast service providing apparatus 100 provides a viewer participation type interactive broadcast service to a broadcaster terminal 200 corresponding to a plurality of broadcasters and a viewer terminal 300 corresponding to a plurality of viewers. can provide

Here, the viewer-participating interactive interactive broadcasting service allows a broadcaster to use specific broadcast content (eg, various game content (eg, FIG. 6 ), quiz content (eg, FIG. 7 ), and talk content (eg, FIG. 7 ) through the broadcaster terminal 200 . 8 and 9), broadcast streaming data generated by processing and shooting blind date content (eg, FIG. 10), etc.) It may mean a service that provides broadcast streaming data collected from a user.

In addition, the viewer participation type interactive interactive broadcast service may refer to a service that provides various functions that allow the viewer to directly participate in the broadcast content by providing content that can interact with the viewer according to the request of the broadcaster. However, the present invention is not limited thereto.

Also, here, the broadcast content is not limited to a specific form such as audio or video.

In various embodiments, the viewer participation type interactive interactive broadcast service providing apparatus 100 processes broadcast streaming data collected from a broadcaster to display a viewer accessing a corresponding broadcast channel on a broadcast screen (eg, display a viewer image); It is possible to display the result of interaction with the viewer. However, the present invention is not limited thereto.

In one embodiment, the broadcaster terminal 200 may be connected to the viewer-participating interactive broadcast service providing apparatus 100 through a network (not shown), and various A service (eg, a viewer-participating interactive interactive broadcasting service) may be provided to proceed with broadcasting content.

For example, the broadcaster terminal 200 may include a separate camera module therein, or may be connected to an external camera module to shoot broadcast content, and broadcast streaming data generated by shooting broadcast content to a viewer participation type interactive broadcast. It can be provided to the service providing device 100 so that its own broadcast can be transmitted to a plurality of viewers.

In addition, the broadcaster terminal 200 may include at least one of a smartphone, a tablet PC, a desktop, and a laptop having a display on at least a portion of the broadcaster terminal 200 , and a viewer-participating interactive broadcast service through the display By receiving the viewer participation type interactive interactive broadcast service user interface (User Interface, UI) (eg, 10 in FIGS. 6 to 10 ) provided by the providing device 100 , it is possible to check the broadcast screen of the broadcast streaming data taken by the user in real time. have. However, the present invention is not limited thereto.

In an embodiment, the user terminal 200 may be connected to the viewer-participating interactive broadcast service providing apparatus 100 through a network, and various services (eg, viewers) provided by the viewer-participating interactive interactive broadcast service providing apparatus 100 . By receiving and executing broadcast streaming data provided by a specific broadcaster among a plurality of broadcasters through a participatory interactive broadcast service), it is possible to monitor and view broadcast content of a specific broadcaster in real time.

For example, the user terminal 200 may be the same device as the broadcaster terminal 200 (eg, at least one of a smartphone, a tablet PC, a desktop, and a laptop having a display on at least part of it), and a viewer through the display The viewer participation type interactive interactive broadcast service UI (eg, 10 of FIGS. 6 to 10 ) provided by the participatory interactive interactive broadcast service providing apparatus 100 may be provided and broadcast streaming data collected from a broadcaster may be output. However, the present invention is not limited thereto.

In an embodiment, the external server 400 may be connected to the viewer participation type interactive interactive broadcast service providing apparatus 100 through a network, and the viewer participation type interactive interactive broadcast service providing apparatus 100 provides a viewer participation type interactive interactive broadcast service We can provide various data and information necessary to do this.

Also, the external server 400 may receive and store various data and information generated by providing the viewer participation type interactive interactive broadcast service from the viewer participation type interactive interactive broadcast service providing apparatus 100 . For example, the external server 400 may be a storage server separately provided outside the viewer-participating interactive interactive broadcast service providing apparatus 100 . However, the present invention is not limited thereto. Hereinafter, a hardware configuration of the viewer participation type interactive interactive broadcast service providing apparatus 100 will be described with reference to FIG. 2 .

2 is a hardware configuration diagram of an apparatus for providing a viewer-participating interactive interactive broadcast service according to another embodiment of the present invention.

Referring to FIG. 2 , an apparatus 100 (hereinafter, “computing device 100”) for providing a viewer-participating interactive broadcast service according to another embodiment of the present invention is provided by one or more processors 110 and processors 110 . It may include a memory 120 for loading the computer program 151 to be executed, a bus 130 , a communication interface 140 , and a storage 150 for storing the computer program 151 .

Here, only the components related to the embodiment of the present invention are shown in FIG. 2 . Accordingly, those skilled in the art to which the present invention pertains can see that other general-purpose components other than the components shown in FIG. 2 may be further included.

The processor 110 controls the overall operation of each component of the computing device 100 . The processor 110 includes a central processing unit (CPU), a micro processor unit (MPU), a micro controller unit (MCU), a graphic processing unit (GPU), or any type of processor well known in the art. can be

In addition, the processor 110 may perform an operation for at least one application or program for executing the method according to the embodiments of the present invention, and the computing device 100 may include one or more processors.

In various embodiments, the processor 110 temporarily and/or permanently stores a signal (or data) processed inside the processor 110 , a random access memory (RAM) and a read access memory (ROM). -Only Memory, not shown) may be further included. In addition, the processor 110 may be implemented in the form of a system on chip (SoC) including at least one of a graphic processing unit, a RAM, and a ROM.

The memory 120 stores various data, commands and/or information. The memory 120 may load the computer program 151 from the storage 150 to execute methods/operations according to various embodiments of the present disclosure. When the computer program 151 is loaded into the memory 120 , the processor 110 may perform the method/operation by executing one or more instructions constituting the computer program 151 . The memory 120 may be implemented as a volatile memory such as RAM, but the technical scope of the present disclosure is not limited thereto.

The bus 130 provides a communication function between components of the computing device 100 . The bus 130 may be implemented as various types of buses, such as an address bus, a data bus, and a control bus.

The communication interface 140 supports wired/wireless Internet communication of the computing device 100 . In addition, the communication interface 140 may support various communication methods other than Internet communication. To this end, the communication interface 140 may be configured to include a communication module well known in the technical field of the present invention. In some embodiments, the communication interface 140 may be omitted.

The storage 150 may non-temporarily store the computer program 151 . When the computing device 100 provides the viewer participatory interactive interactive broadcast service, the storage 150 may store various types of information (eg, broadcast streaming data) required to provide the viewer participatory interactive interactive broadcast service.

The storage 150 is a non-volatile memory such as a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, a hard disk, a removable disk, or well in the art to which the present invention pertains. It may be configured to include any known computer-readable recording medium.

The computer program 151 may include one or more instructions that, when loaded into the memory 120 , cause the processor 110 to perform methods/operations according to various embodiments of the present invention. That is, the processor 110 may perform the method/operation according to various embodiments of the present invention by executing the one or more instructions.

In one embodiment, the computer program 151 includes the steps of collecting broadcast streaming data from a terminal of a broadcaster and providing the collected broadcast streaming data to terminals of one or more viewers connected to a broadcast channel of the broadcaster, to one or more viewers Processing the broadcast streaming data so that the corresponding viewer image is displayed on the broadcast screen, based on the broadcaster input obtained from the broadcaster's terminal, determining the properties of the viewer image displayed on the broadcast screen and processing the broadcast streaming data It may include one or more instructions for performing a method of providing a viewer-participating interactive interactive broadcast service, which includes providing to a terminal of a broadcaster and one or more terminals of a viewer. However, the present invention is not limited thereto.

The steps of a method or algorithm described in relation to an embodiment of the present invention may be implemented directly in hardware, as a software module executed by hardware, or by a combination thereof. A software module may contain random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present invention pertains.

The components of the present invention may be implemented as a program (or application) to be executed in combination with a computer, which is hardware, and stored in a medium. The components of the present invention may be implemented as software programming or software components, and similarly, embodiments may include various algorithms implemented as data structures, processes, routines, or combinations of other programming constructs, including C, C++ , Java, assembler, etc. may be implemented in a programming or scripting language. Functional aspects may be implemented in an algorithm running on one or more processors. Hereinafter, with reference to FIG. 3 , a method for the computing device 100 to provide a viewer-participating interactive broadcast service will be described.

3 is a flowchart of a method for providing a viewer participatory interactive interactive broadcast service according to another embodiment of the present invention.

Referring to FIG. 3 , in step S110 , the computing device 100 may collect broadcast streaming data from the broadcaster terminal 200 .

For example, the computing device 100 provides a viewer to a broadcaster who has previously subscribed to a viewer-participating interactive interactive broadcast service (eg, a broadcaster who has completed a viewer-participating interactive interactive broadcast service subscription process provided by the computing device 100). It is possible to provide a participatory interactive interactive broadcasting service UI, and in response to obtaining a broadcast request from a broadcaster through the viewer participatory interactive interactive broadcasting service UI, it is possible to provide a real-time broadcasting platform in which a broadcaster can conduct real-time broadcasting. Thereafter, the computing device 100 may collect broadcast streaming data generated by shooting broadcast content through a real-time broadcast platform.

In step S120 , the computing device 100 may process the broadcast streaming data collected in step S110 in response to one or more viewers accessing a broadcast channel of a broadcaster.

In various embodiments, the computing device 100 may provide a broadcast channel list including a plurality of broadcast channels being broadcast through a viewer-participating interactive interactive broadcast service, and may provide any one of a plurality of broadcast channels included in the broadcast channel list. In response to being selected, the broadcast channel of may process broadcast streaming data for the selected broadcast channel.

In various embodiments, the computing device 100 may process broadcast streaming data so that viewer images corresponding to one or more viewers are displayed on a broadcast screen.

In this case, the computing device 100 processes broadcast streaming data so that only a viewer image corresponding to a viewer who has previously subscribed to a viewer participation type interactive interactive broadcast service among a plurality of viewers accessing the corresponding broadcast channel is displayed on the broadcast screen, or a viewer image Broadcast streaming data can be processed so that only the viewer image corresponding to the viewer whose display is permitted is displayed on the broadcast screen. Hereinafter, it will be described with reference to FIG.

4 is a flowchart of a method of processing broadcast streaming data, in various embodiments.

Referring to FIG. 4 , in step S210 , the computing device 100 may obtain a request to participate in broadcast content provided by a broadcaster from one or more viewer terminals 300 .

Here, the request for participation in broadcast content satisfies the separate participation request condition prepared by the broadcaster (eg, by posting a request for participation in chat windows and bulletin boards requesting participation in broadcast content, or by selecting a button to request participation in broadcast content, a separate signal is transmitted. transmission, etc.), but is not limited thereto, and access to a broadcast channel of a broadcaster who conducts broadcast content may be recognized as a request for participation in broadcast content.

In various embodiments, the computing device 100 may obtain a participation request from a viewer who has previously subscribed to a viewer participation type interactive interactive broadcast service among a plurality of viewers.

In step S220, the computing device 100 may receive selection of at least one viewer from among the one or more viewers who have requested participation through step S210 from the broadcaster. For example, the computing device 100 generates a viewer list including information on one or more viewers who have requested participation through step S210, and provides the generated viewer list to the broadcaster, so that the viewer list is included in the viewer list from the broadcaster. At least one viewer may be selected from among the one or more viewers.

In various embodiments, the computing device 100 may automatically select at least one viewer from among one or more viewers who have requested participation through step S210 according to a condition preset by the broadcaster.

For example, when the condition preset by the broadcaster is the time for requesting participation, the computing device 100 determines that the amount of donation provided to the broadcaster among a plurality of viewers who requested to participate is increased in the order of increasing the time of access to the broadcasting channel. and N viewers to sequentially participate in the broadcast content according to at least one of a higher priority order according to a priority preset by the broadcaster.

In various embodiments, when the number of viewers accessing the broadcast channel is smaller than the number of broadcast content participants preset by the broadcaster, the computing device 100 automatically allows all viewers accessing the broadcast channel to participate in the broadcast content. can be selected. However, the present invention is not limited thereto.

In step S230, the computing device 100 may process the broadcast streaming data so that a viewer image corresponding to the at least one viewer selected in step S220 is displayed on the broadcast screen. Hereinafter, it will be described with reference to FIGS. 6 to 10 .

6 to 10 , in various embodiments, the computing device 100 receives an exposure degree of a viewer's face exposed through the viewer image 11 from each of one or more viewers, and according to the set exposure degree, the viewer image ( 11), it is possible to determine the shape of the viewer's face to be exposed.

For example, in response to the exposure degree set from the first viewer being the first grade (eg, the minimum grade), the computing device 100 may display the face of the first viewer through the first viewer image 11 as the first viewer image. It may be determined to not be exposed through ( 11 ) or to expose a character image (eg, an avatar image) selected by the first viewer through the first viewer image ( 11 ).

In addition, in response to the exposure degree set by the first viewer being a second grade (eg, intermediate grade), the computing device 100 uploads a face image from the first viewer based on a face synthesis technology such as Deepfake. and a result of synthesizing a target selected by the first viewer may be determined to be exposed through the first viewer image 11 .

To this end, the computing device 100 uploads the viewer's face image and simultaneously receives a selection of a specific target to be synthesized, and a UI capable of synthesizing the selected specific target and the uploaded face image (eg, FIG. 9 ) can provide

In addition, in response to the exposure degree set by the first viewer being the third grade (eg, the maximum grade), the computing device 100 converts the facial image uploaded from the first viewer through the first viewer image 11 as it is. can be printed out.

In various embodiments, the computing device 100 may determine the degree of exposure of the viewer's face exposed through the viewer image 11 according to the properties of broadcast content conducted by the broadcaster. For example, as shown in FIG. 10 , when the broadcast content conducted by the broadcaster is blind date content, the computing device 100 may output face images of viewers participating in the blind date content as it is in order to smoothly proceed with the blind date content. have. In this case, the computing device 100 may set a relatively large viewer image for a viewer who directly performs a blind date among viewers participating in the blind date content, and set a relatively small viewer image for a viewer who watches the blind date. Also, the computing device 100 may change the position of a viewer participating in the blind date content through a broadcaster input according to the progress of the blind date content, or display an arrow or a heart between viewers who are a couple.

In various embodiments, the computing device 100 may process the broadcast streaming data so that the background area of the broadcaster is removed from the broadcast screen and the background area of the viewer is removed from the viewer image 11 . For example, the computing device 100 may identify a background area of a broadcaster and a background area of a viewer on a viewer image by using the image analysis and processing model, and may delete the identified background area.

A technique for deleting a background image in image data is not limited, and various known techniques applicable to those skilled in the art may be applied.

In various embodiments, the computing device 100 may remove the background area of the broadcaster and the viewer from the broadcast screen, and set the background area of the broadcaster as an image or video selected by the broadcaster and the viewer. In this process, even if there is no facility for chroma key in the background of the broadcaster, AI-based image processing method recognizes the outline of the broadcaster, removes the background, and places another image or video in the corresponding location. can be made to change. The same can be applied to viewers as well.

In various embodiments, the computing device 100 calculates the properties (eg, location, size, shape, etc.) of the viewer image 11 displayed on the broadcast screen based on the broadcaster input obtained from the broadcaster terminal 200 . can decide

In various embodiments, the computing device 100 may determine at least one of the position, size, and shape of the viewer image 11 displayed on the broadcast screen, based on the broadcaster's input and the broadcast content provided by the broadcaster. have.

For example, when the attribute of the content conducted by the broadcaster is content in which a large number of viewers participate, such as OX quiz content or game content shown in FIGS. 6 and 7, if the viewer image 11 is set somewhat large, many viewers There is a problem in that it may not be possible to participate, and in some cases, the appearance of the broadcaster is not properly identified due to the participation of many viewers, so that the viewer cannot know whether he or she is participating properly.

In consideration of this point, the computing device 100 may set the viewer image 11 relatively small in the case of content in which a large number of viewers participate, such as OX quiz content or game content.

In particular, when there is a possibility that viewers drop out as the content progresses, such as an OX quiz or a survival game, all viewers can participate, but only some viewer images 11 are displayed on the broadcast screen according to the priority set by the broadcaster. display, and when a viewer corresponding to the viewer image 11 displayed on the broadcast screen is eliminated, the viewer image 11 of the viewer is deleted from the broadcast screen, and the viewer image 11 for the viewer of the next rank is sequentially can be displayed on the broadcast screen.

Also, when the broadcast content conducted by the broadcaster is the quiz content (eg, the OX quiz content of FIG. 7 ), the computing device 100 may set the position of the viewer image 11 to a position designated by the viewer.

For example, the computing device 100 may obtain a first viewer input indicating a display position (eg, region O or region X) of the first viewer image 11 on the broadcast screen from the first viewer, and The first viewer image 11 may be moved to a first display position corresponding to the viewer input.

At this time, the computing device 100 determines whether the first display position corresponding to the first viewer input is a non-movable area (eg, 12 in FIG. 6 ) or a movable area (eg, 13 in FIG. 6 ), and The first viewer image 11 may be moved to the first display position only when it is determined that the first display position is located within the movable area 13 .

Also, when the first display position corresponding to the first viewer input is located in the non-movable region 12 or the display position corresponding to the first viewer input is not recognized correctly, the computing device 100 accurately determines the display position. A guide message for guiding input may be provided (eg, a pop-up, a push bar, etc.) to the corresponding viewer terminal 300 .

Through this, it is possible to prevent the broadcast content from being interrupted by the movement of the viewer image 11 when the broadcaster proceeds with the broadcast content.

In various embodiments, when obtaining a plurality of first viewer inputs indicating a first display position from a plurality of viewers, the computing device 100 may first input a first viewer input indicating a first display position among a plurality of viewers. A viewer image corresponding to any one of the viewers having the highest score as a result of viewer interaction through the viewer and the broadcast content may be moved to the first display position.

In various embodiments, the computing device 100 may adjust the number of viewer images 11 displayed on the broadcast screen according to the properties of the broadcast screen. For example, the computing device 100 may adjust the number of viewer images 11 displayed on the broadcast screen when the type of broadcast content conducted by the broadcaster is changed from the first broadcast content to the second broadcast content. .

At this time, when it is determined that the computing device 100 needs to adjust the number of viewer images 11 displayed on the broadcast screen (eg, game content or quiz content is changed to talk content or blind date content, the viewer image 11 ) )), the viewer image 11 corresponding to the viewer having a low score as a result of interaction through the broadcast content provided from the broadcaster may be sequentially removed from the broadcast screen. However, the present invention is not limited thereto, and the computing device 100 selects one of the lower priorities according to the order in which the size of the donation provided to the broadcaster is small, the time of access to the broadcast channel is late, and the priority preset by the broadcaster. The display of any one viewer image 11 among the plurality of viewer images 11 displayed on the broadcast screen according to at least one order may be deleted.

In various embodiments, the computing device 100 may analyze a broadcast screen output based on broadcast streaming data to identify a broadcaster's motion, and determine a property of a viewer image based on the identified broadcaster's motion.

For example, the computing device 100 may identify a broadcaster output on a broadcast screen using an image analysis model, and based on the identified broadcaster, a plurality of viewer images within a range that does not cover the body part of the broadcaster can be displayed on the broadcast screen.

Thereafter, the computing device 100 may identify the movement of the broadcaster, and when it is determined that the broadcaster's body part is covered from the plurality of viewer images displayed on the broadcast screen by the broadcaster's movement, the broadcaster's body part is covered The positions and sizes of the plurality of viewer images displayed on the broadcast screen may be moved so as not to be lost.

In various embodiments, the computing device 100 adjusts the size of the viewer image based on the movement of the broadcaster, but when the size of the viewer image falls below the preset size, broadcasts the viewer image so that the viewer image becomes greater than or equal to the preset size. It is possible to reduce the number of viewer images displayed on the screen.

In various embodiments, the computing device 100 may process broadcast streaming data to display text and emoticons corresponding to the second viewer input on a broadcast screen, based on obtaining the second viewer input from one or more viewers. .

For example, as shown in FIG. 8 , the computing device 100 includes an input bar 14 capable of inputting text or emoticons 14a and 14b to a plurality of viewer terminals 300 in a viewer-participatory interactive manner. The interactive broadcast service UI 10 may be provided, and in response to selecting and receiving specific text or emoticons 14a and 14b through the input bar 14 , the corresponding text or emoticons 14a and 14b are displayed on the broadcast screen. Broadcast streaming data can be processed to be displayed in

In this case, the computing device 100 is configured to at least one of a type of broadcast content provided by the broadcaster, a rule preset by the broadcaster, the number of viewers accessing the broadcast channel of the broadcaster, and the number of second viewer inputs input from one or more viewers. It is possible to determine the position, size, shape, and display holding time of the text and emoticons 14a and 14b on the broadcast screen in consideration of the above.

In various embodiments, the computing device 100 may receive payments for the texts and emoticons 14a and 14b from a viewer who wants to input the texts and emoticons 14a and 14b through a payment service, and the cost is paid. By displaying only the texts and emoticons 14a and 14b on the broadcast screen, it is possible to prevent a plurality of viewers from inputting the texts and emoticons 14a and 14b to the extent of causing inconvenience to the broadcast.

In various embodiments, the computing device 100 may set whether to deliver a voice, a volume, or mute for each viewer whose viewer image is displayed on a broadcast screen among a plurality of viewers. In this case, the settings for whether to deliver voice to each viewer, volume, or mute may be adjusted by the broadcaster, but the present invention is not limited thereto.

Referring back to FIG. 3 , in step S130 , the computing device 100 may provide the processed broadcast streaming data to the broadcaster terminal 200 and one or more viewer terminals 300 .

In various embodiments, the computing device 100 may interact with a plurality of viewers participating in the corresponding broadcast content based on the broadcast content provided by the broadcaster.

In this case, the computing device 100 may reprocess the broadcast streaming data so that the viewer interaction result derived by performing the interaction for each of the plurality of viewers is displayed on the broadcast screen, and may provide the reprocessed broadcast streaming data. have. Hereinafter, it will be described with reference to FIG. 5 .

5 is a flowchart of a method of performing an interaction between a user and an object according to broadcast content, according to various embodiments of the present disclosure;

Referring to FIG. 5 , in step S310 , the computing device 100 obtains a broadcaster input requesting to display a specific object (eg, an icon such as a balloon or fruit) on the broadcast screen from the broadcaster terminal 200 . can

Here, the broadcaster input may be an input based on a direct input method (eg, a touch input) through the broadcaster terminal 200 and the broadcaster's motion sensing, but is not limited thereto.

In step S320, the computing device 100 may process the broadcast streaming data so that a specific object is displayed on the broadcast screen, based on the broadcaster input obtained in step S310, and transmit the processed broadcast streaming data to the broadcaster of the broadcaster. It may be provided to the viewer terminal 300 for a plurality of viewers connected to the channel. However, the broadcast streaming data is not limited thereto, and the processed broadcast streaming data may be provided to all users including the broadcaster, or may be provided only to a specific viewer designated by the broadcaster.

In various embodiments, the computing device 100 provides broadcast streaming data processed to display a first object on a broadcast screen to a plurality of viewers included in the first group based on the broadcaster input obtained in step S310, The broadcast streaming data processed to display the second object on the broadcast screen may be provided to a plurality of viewers included in the second group.

In step S330 , the computing device 100 selects a specific object displayed on the broadcast screen from the plurality of viewer terminals 300 N times (eg, one or more times) based on the broadcast streaming data processed in step S320 . A first viewer input (eg, a touch input for selecting a specific object through a display provided in the viewer terminal 300 ) may be obtained.

In operation S340 , the computing device 100 may perform an interaction between a viewer and a specific object based on the first viewer input obtained in operation S330 .

For example, whenever a viewer inputs a first viewer input for selecting a specific object, the computing device 100 generates a preset effect (eg, the specific object shakes, the size of the specific object increases, A visual effect such as exploding a specific object or erasing it on the screen and an auditory effect for outputting a preset voice) may be output on the broadcast screen.

Also, the computing device 100 may calculate an interaction result (eg, a score that a viewer may obtain by selecting a specific object, etc.) in response to a viewer inputting a first viewer input for selecting a specific object.

In step S350 , the computing device 100 may process and provide broadcast streaming data so that a viewer interaction result derived by performing an interaction between a plurality of viewers is displayed on a broadcast screen.

At this time, since the viewer interaction result (eg, score) of each of the plurality of viewers is different from each other, the computing device 100 may display the viewer interaction result with respect to the viewer's input for each viewer on the broadcast screen, The broadcast streaming data may be processed, and the processed broadcast streaming data may be provided to the corresponding viewer terminal 300 .

In addition, the computing device 100 aggregates the viewer interaction results for a plurality of viewers derived through a specific object generated according to the broadcaster input and displays them on the broadcast screen (eg, total viewer interaction result score, viewer interaction result ranking). etc.), and by providing the processed broadcast streaming data to the broadcaster terminal 200, the broadcaster can check how many viewers actively participated in their broadcast content.

Here, the broadcaster may provide content capable of competing not only within one broadcast channel but also between different broadcast channels through the computing device 100 . For example, the broadcaster may convert the points or energy of the broadcast channel by adding up the number or speed of touch screens by viewers participating in the broadcast channel through the computing device 100, and based on this, different broadcast channels It is possible to provide game content that enables competition between players (eg, running, rowing, accumulating points, etc.).

In various embodiments, the computing device 100 may calculate a total interaction result score for the corresponding broadcast based on the viewer interaction result through the broadcast content (eg, content that quickly touches a specific object) performed in the corresponding broadcast, and , it is possible to determine the position of the corresponding channel in the broadcast channel list by using the calculated total interaction result score.

For example, the computing device 100 calculates a total interaction result score for each of a plurality of broadcast channels based on a result of a viewer interaction through a plurality of broadcast contents conducted in each of the plurality of broadcast channels, and calculates the calculated total interaction By sequentially arranging the broadcasting channels with the high result scores and providing them to the viewers, it is possible to prioritize broadcasts with high viewer participation scores to be placed on the list.

Through this, there is an advantage in that it is possible to induce active viewer participation so that viewers who watch the corresponding broadcast content can participate more actively in order to promote the broadcast content they watch.

The above-described method for providing a viewer-participating interactive interactive broadcasting service has been described with reference to the flowchart shown in the drawings. For the sake of simplicity, the method of providing a viewer-participating interactive broadcast service has been described with a series of blocks, but the present invention is not limited to the order of the blocks, and some blocks are performed in an order different from that shown and operated in this specification. or may be performed simultaneously. In addition, new blocks not described in this specification and drawings may be added, or some blocks may be deleted or changed. Hereinafter, various screens of a viewer participation type interactive interactive broadcasting service UI applicable to various embodiments will be described with reference to FIGS. 11 to 20 .

11 to 18 are views exemplarily showing a broadcast screen of a viewer participation type interactive interactive broadcasting service UI applicable to various embodiments, and FIG. 19 is a home screen of a viewer participation type interactive interactive broadcasting service UI applicable to various embodiments. is an exemplary view, and FIG. 20 is a view illustrating an example view of a viewer-participating interactive interactive broadcasting service UI applicable to various embodiments.

11 to 20 , in various embodiments, the computing device 100 responds to obtaining a request for provision of a viewer participatory interactive interactive broadcast service from a user (viewer), a broadcast screen 20 of a viewer participatory interactive interactive broadcast service , a home screen 30 and a more screen 40 may be provided.

In various embodiments, the broadcast screen 20 provided by the computing device 100 may include a video broadcast mode and a studio mode. Here, in the case of the video broadcasting mode, it may consist of a video broadcaster (one person) or a video broadcaster and a participating guest (a viewer selected from a host or manager), and in the studio mode, a studio broadcaster (one person) or a studio broadcaster and a participating guest can be configured.

The computing device 100 may expose information about a participant who participated in the broadcast content through the broadcast screen 20 . For example, the computing device 100 may expose the participant image, the participant's level and nickname, and text chatting input from the participant through the broadcast screen 20 .

Here, the participant image may be set in a form in which a general image (picture, video), a chroma key image is exposed, a profile image and audio are exposed together, or a profile image and a text chat input from the participant are exposed together.

In addition, it may be set to expose the participant's status information (eg, voice transmission possible, voice transmission, mute, text transmission, etc.) on the broadcast screen 20 .

In addition, the size at which information about the participant is exposed on the broadcast screen 20 may be adjusted by the broadcaster (host), but is not limited thereto.

In various embodiments, the computing device 100 may output a list for a plurality of viewers in response to receiving a selection of the viewer list area 21 on the broadcast screen 20 from the viewer. At this time, the viewer nickname, viewer profile thumbnail, various badges (eg, couple ranking badge, viewer role placement, etc.) and invitation button (set to be exposed only to the host, manager and guest, and if there is an empty guest slot 22, invite You can output a list of viewers including button activation).

In various embodiments, the computing device 100 may output a participating area including a guest slot setting UI in response to receiving a selection of the guest slot add button 22 on the broadcast screen 20 . Here, the guest slot setting through the guest slot setting UI may be exposed only to the host, and in response to receiving the input of the add guest slot button 22 , a guest slot may be created on the broadcast screen 20 . In this case, the computing device 100 may generate a guest slot with a preset size (minimum size), but may automatically create it in an empty space (a space that does not overlap with other guest slots) on the broadcast screen 20 .

In various embodiments, the computing device 100 exposes a guest invitation list through the guest slot setting UI in response to receiving a selection of the guest slot add button 22 on the broadcast screen 20, but as shown in FIG. Similarly, when the manager of the broadcast is placed in the guest slot and the manager's profile image is not exposed through the guest slot, the manager may be positioned at the top of the guest invitation list. In this case, an entry button, not an invitation button, may be exposed on the broadcast screen 20 output on the manager's terminal, and when clicked, the manager may directly enter the slot.

Here, the manager is not granted permission to set guest slots (eg, permission to open, convert invitation mode, delete slot, or change slot attributes (eg, size and location)), but is not limited thereto.

In various embodiments, the guest slot add button 22 may be displayed in different forms according to the state of the guest slot. For example, when the guest slot is in an open mode and there is no guest, as shown in FIG. 11 , a “+” form (state 1) may be displayed so that a viewer can directly participate as a guest when clicking.

Here, when the guest slot is in the open mode and there is a guest, an image of the guest may be displayed on the guest slot (state 2). In this case, when the guest leaves the slot, the display method of the state of the guest slot may be changed to the same form as that of state 1.

In addition, when the guest slot is in the invitation mode and there is no guest, text or phrases in the form of "lock (or key)" may be displayed (state 3) so that the viewer can participate as a guest when clicking directly.

Here, when the guest slot is in the invitation mode and there is a guest, an image of the guest may be displayed on the guest slot (state 4). At this time, when the guest leaves the slot, the state of the guest slot may be displayed in the form of state 3 .

In various embodiments, as shown in FIG. 14 , when the guest slot is in the open mode, it is possible to directly enter the guest slot according to a participation request directly input from the guest. On the other hand, in invitation mode, if only invited guests are allowed to participate, but if a request to join is received from an uninvited guest, an alert in the form of "Only invited viewers can participate as a guest" may be generated. .

In various embodiments, as shown in FIG. 15 , the computing device 100 receives a forced invitation for a specific viewer from the host and manager of the broadcast, a separate procedure (eg, a procedure for receiving acceptance from the viewer) It is possible to forcibly place a specific viewer on the guest slot without

Referring to FIG. 15 , the broadcast screen 20 may include a chat area 24 for receiving chatting input from a plurality of viewers and outputting the input chatting.

Here, the chat area 24 may include a chat input area including an input window, a send button, and a keyboard, and a chat feed area including a role badge, fan ranking, rank badge, team badge, sender's nickname, message, and speech bubble. have.

In various embodiments, the chat area 24 outputs a first chat area for outputting chatting input from a guest participating in the broadcast content and a host who conducts the broadcast content, and a chatting input from viewers who do not directly participate in the broadcast content It may be divided into a second chatting area.

In various embodiments, the computing device 100 provides not only chat content input from a plurality of viewers through the chat area 24 , but also platform announcement guidance (automatic exposure to a user who entered when entering a specific broadcast), status guidance (eg, : Broadcast entry, follow, manager appointment, dismissal, guest participation notification, etc.) can be further output.

In various embodiments, if there is no text input for a certain time after a specific user enters the broadcast through the chatting area 24 , the computing device 100 outputs a message inducing chatting to be seen only by the corresponding user, or If the broadcast host is not in the follow status, a comment inducing the user to follow may be output to be seen only by the corresponding user to induce the viewer's participation.

In addition, when a gift to the host is sent from a specific viewer, the computing device 100 may output a message guiding the sending of the gift to be displayed to all viewers at the time the viewer sends the gift through the chat area 24 . have.

Also, when a specific viewer enters the broadcast, the computing device 100 may output a message welcoming the entry so that it is visible only to the viewer who has entered through the chatting area 24 .

Referring to FIGS. 16 and 17 , when a chat is input from a guest placed in a guest slot, the computing device 100 exposes the chat content input to at least a portion 25 adjacent to the guest slot as well as the chat area 24 . can do. At this time, the computing device 100 exposes the chat content 25 input to at least a portion of the guest slot, and sequentially exposes the chat content input for each preset unit time (eg, 1 second), a preset unit time It can give the same effect that the chat contents entered by the guest are displayed in real time every time.

In various embodiments, the computing device 100 is a specific object (eg, text, emoticons, images (images, videos, etc.) such as Hangul, English, number symbols, etc. ), voice, etc.), the object input by the guest can be displayed in real time by displaying the input object on the screen at the same time the guest inputs a specific object. For example, if the guest inputs "hello", the computing device 100 may respond to "no", "hello", "ha", "three", and "yo" respectively when the guest inputs "hello". "," "nyeong", "ha", "three" and "yo" may be sequentially displayed on the screen.

In this case, the computing device 100 may not only show a specific object input from the guest in real time, but also display and show on the screen in real time that an object is modified by an operation of erasing or modifying a previously input object. For example, if the guest inputs "hello" and then deletes "hello" from among them, the computing device 100 may be configured to allow the guest to input "hello", "hello", "ha", "three", and "yo", respectively. In response to entering "an", "nyeong", "ha", "three" and "yo" sequentially on the screen, in response to erasing each of "yo", "three" and "ha" Thus, "Yo", "Se" and "Ha" can be sequentially erased on the screen. However, the present invention is not limited thereto, and in some cases, after the guest completely inputs the chatting content, the inputted chatting content may be displayed collectively. For example, when the computing device 100 does not display chat contents on the screen while receiving "hello" from the guest, and no additional object is input for a predetermined time after "hello" is input , it is determined that the chatting input operation is completed, so that "Hello" can be output at once.

In various embodiments, the computing device 100 displays the chat content input from the guest on at least a portion of the guest slot, but the length of the input chat content exceeds a certain length so that the entire chat content input from the guest on the screen is displayed. When it is difficult to display at once, by displaying the chatting content inputted from the guest to slide from left to right, the entire chatting content inputted from the guest can be displayed.

In various embodiments, when the length of the chat content input from the guest exceeds a certain length and it is difficult to display the entire chat content inputted from the guest on the screen at once, the computing device 100 may display the entire chat content inputted from the guest. It may be divided into a plurality of unit chats, and each unit chat may be sequentially displayed on the screen according to the input order.

In various embodiments, when the guest completes the chat input operation (eg, after the guest inputs a specific object, the computing device 100 does not additionally input another object while a predetermined time elapses or the guest chats separately set up) When the input completion button is selected), the chat content input through the chat input operation is displayed on the screen for a preset time (eg, 1 to 2 seconds), and the chat content disappears from the screen after the preset time. can

In various embodiments, when there are a plurality of guest slots displayed on the screen (when a plurality of guests participate in broadcast content), the computing device 100 transmits chat contents input from each of the plurality of guests to each of the plurality of guests. Correspondingly, but displayed in a position adjacent to the guest slot displayed on the screen, each of a plurality of guests may determine a position where the input chatting content is output so that the chatting content input from each of the plurality of guests is not overlapped. In this case, the location, size, and shape of the chatting content input from the guest may be determined according to the number of guests participating in the broadcast content.

Referring to FIG. 18 , the computing device 100 may set the layer of the broadcast screen 20 according to an input of the broadcast host. For example, the computing device 100 may set various modes (eg, a chatting mode, a voice mode, an image mode, and a chroma key mode) according to an input of a broadcast host.

Also, the computing device 100 may set background properties (eg, an image, template, and color to be output to the background) of the broadcast screen 20 according to an input of the broadcast host.

In addition, the computing device 100 may set various items for broadcast content (eg, an introduction, interest tags, greeting messages, announcements, etc. to be exposed to viewers participating in the broadcast) according to an input of the broadcast host.

Also, the computing device 100 may set properties (eg, location, size, color, shape, etc.) of a guest slot output to the broadcast screen 20 according to an input of the broadcast host.

Referring to FIG. 19 , the home screen 30 provided by the computing device 100 includes a poster card area 31 , a preview list card (small) area 32 , and a preview list card (large) area 33 . ) and a categorical list area 34 .

Here, the poster card area 31 includes a poster background image, a poster main image, a poster effect, a room title (text), a nickname, a badge (eg, a live badge or broadcast time guide badge, etc.), a button (eg, entering (broadcasting) time), notification setting and notification completion (non-broadcast time) button).

In various embodiments, the computing device 100 exposes a plurality of posters through the poster card area 31 so that a preset number of posters are exposed (eg, a minimum of 1 to a maximum of 5 big banners can be set). , a preset number of posters may be set to be rolled in a preset unit.

Here, the poster cards exposed through the poster card area 31 are arranged and exposed in the order of currently live broadcasts, broadcasts with a broadcast start time imminent within one hour, and broadcasts not followed by the user receiving the home screen 30 , or , may be exposed according to an exposure order preset by the computing device 100 . However, the present invention is not limited thereto.

The preview list card (small) area 32 contains a profile image (if the broadcast is live or the host is in video mode, the host video is played after a preset time (eg 3 seconds) after the profile image is loaded), badges (Online - Live Badge, Offline - No Badge), Room Title (Text), Profile Image (Small), Gender and Nickname, Accumulated Number of Items Received from Viewers, and Cumulative Number of Viewers for a Predetermined Period (eg, Last 24 Hours) can do.

Here, the computing device 100 exposes the list of friend cards being accessed through the preview list card (small) area 32 , but the currently live broadcast, the mutually followed (followed) broadcast, the broadcast with a large number of accumulated items, and the accumulation It can be displayed by sorting in the order of broadcasting with the largest number of viewers. At this time, if there is no one connected friend, the card itself may not be exposed.

The preview list card (large) area 33 includes a profile image (large) (the image stored in the computing device 100 is played after a preset time (eg, 3 seconds) after the profile image is loaded), badges (online- Live badge, offline - no badge), room title (text), profile image (small), gender and nickname, cumulative number of items received from viewers, cumulative number of viewers over a predetermined period (eg, last 24 hours) .

Here, the computing device 100 exposes the host card recommended by the manager (producer) through the preview list card (large) area 33, in the order of a currently live broadcast and a broadcast not followed by a recommended user. The display may be arranged and exposed, or the host cards may be sequentially arranged and exposed according to an order preset by the computing device 100 .

The categorical list area 34 contains category filters, room title (text), profile image (small), badge (online- live badge, offline- no badge), room title (text), profile image (small), gender and The nickname, the accumulated number of items received from the viewer, and the accumulated number of viewers over a predetermined period (eg, the last 24 hours) may be included.

Here, the computing device 100 may determine the order of the host cards output through the categorical list area 34 according to the set value of the category filter. In addition, when the set value of a separate category filter is not set, the broadcast currently live through the categorical list area 34, the broadcast mutually followed by the user and the host, the broadcast followed by the user, the highest cumulative number of items, and It can be displayed by sequentially sorting in the order of broadcasting with the largest number of cumulative viewers.

Referring to FIG. 20 , the computing device 100 includes host information, follower information, following information, item store, currency exchange application function, setting function, block list information, various regulatory information (eg, legal notice) according to a user input, It is possible to output a more screen 40 that provides various information and functions such as an inquiry function through the customer center.

As mentioned above, although embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains can realize that the present invention can be embodied in other specific forms without changing its technical spirit or essential features. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

100: viewer participation type interactive interactive broadcast service providing device (or computing device)
200: broadcaster terminal
300: viewer terminal
400 : external server

Claims (12)

A method for providing a viewer participatory interactive interactive broadcast service performed by a computing device, the method comprising:
collecting broadcast streaming data from a broadcaster's terminal; and
providing the collected broadcast streaming data to terminals of one or more viewers connected to the broadcast channel of the broadcaster;
The step of providing the broadcast streaming data,
The broadcast streaming data is processed so that a viewer image corresponding to the one or more viewers is displayed on a broadcast screen, and a property of the viewer image displayed on the broadcast screen is determined based on a broadcaster input obtained from the broadcaster's terminal. to do; and
Comprising the step of providing the processed broadcast streaming data to the terminal of the broadcaster and the terminal of the one or more viewers,
A method of providing a viewer-participating interactive interactive broadcasting service. According to claim 1,
The step of determining the attributes of the viewer image,
obtaining a request to participate in broadcast content provided by the broadcaster from the terminals of the one or more viewers;
receiving a selection of at least one viewer from among the one or more viewers who have requested the participation from the broadcaster; and
and processing the broadcast streaming data so that a viewer image corresponding to the selected at least one viewer is displayed on the broadcast screen.
A method of providing a viewer-participating interactive interactive broadcasting service. According to claim 1,
The step of determining the attributes of the viewer image,
determining at least one of a position, a size, and a shape of a viewer image displayed on the broadcast screen based on the broadcaster's input and properties of broadcast content provided by the broadcaster;
A method of providing a viewer-participating interactive interactive broadcasting service. According to claim 1,
The step of providing the broadcast streaming data,
when receiving a broadcaster input requesting to display a specific object on the broadcast screen from the broadcaster's terminal, processing and providing the broadcast streaming data so that the specific object is displayed on the broadcast screen;
Interaction between the first viewer and the specific object is performed in response to obtaining a first viewer input for selecting the specific object displayed on the broadcast screen N times from the terminal of the first viewer based on the processed broadcast streaming data to do; and
Processing and providing the broadcast streaming data so that the viewer interaction result derived by performing the interaction is displayed on the broadcast screen,
A method of providing a viewer-participating interactive interactive broadcasting service. According to claim 1,
The method further comprising the step of providing a broadcast channel list including a plurality of broadcast channels being broadcast through the viewer participation type interactive interactive broadcast service,
The step of providing the broadcast channel list comprises:
Based on the result of viewer interaction through the plurality of broadcast contents conducted in each of the plurality of broadcast channels, a total interaction result score for each of the plurality of broadcast channels is calculated, and the calculated total interaction result score is high from the broadcast channel Including the step of providing in sequential order,
A method of providing a viewer-participating interactive interactive broadcasting service. According to claim 1,
The step of determining the attributes of the viewer image,
The step of providing the broadcast streaming data,
Processing and providing the broadcast streaming data so that the background area of the broadcaster is removed from the broadcast screen and the background area of the viewer is removed from the viewer image,
A method of providing a viewer-participating interactive interactive broadcasting service. According to claim 1,
The step of determining the attributes of the viewer image,
receiving the exposure degree of the viewer's face exposed through the viewer image from each of the one or more viewers, and determining the shape of the viewer's face exposed through the viewer image according to the set exposure degree,
The step of determining the shape of the viewer's face,
In response to the exposure degree set by the first viewer being the first grade, the face of the first viewer is not exposed through the first viewer image through the first viewer image, or the character image selected from the first viewer is determining to be exposed through the first viewer image;
In response to the exposure degree set by the first viewer being the second grade, a result of synthesizing the face image uploaded from the first viewer and the object selected by the first viewer based on a deepfake is combined with the first viewer determining to be exposed through the image; and
In response to the exposure degree set by the first viewer being the third grade, outputting the face image uploaded from the first viewer through the first viewer image as it is,
A method of providing a viewer-participating interactive interactive broadcasting service. According to claim 1,
The step of determining the attributes of the viewer image,
Adjusting the number of viewer images displayed on the broadcast screen according to the properties of the broadcast screen,
The step of adjusting the number of viewer images includes:
When it is determined that the number of viewer images displayed on the broadcast screen needs to be reduced, the viewer image corresponding to the viewer having a low score as a result of interaction through the broadcast content provided from the broadcaster is sequentially removed from the broadcast screen. comprising steps,
A method of providing a viewer-participating interactive interactive broadcasting service. According to claim 1,
The step of determining the attributes of the viewer image,
obtaining a first viewer input indicating a display position of a first viewer image on the broadcast screen from a first viewer;
determining whether a first display position corresponding to the first viewer input is located within a movable area preset by the broadcaster; and
moving the first viewer image to the first display position when it is determined that the first display position is located within the movable area;
The step of moving to the first display position comprises:
When a plurality of first viewer inputs indicating the first display position are obtained from a plurality of viewers, a viewer who first input a first viewer input indicating the first display position among the plurality of viewers and a viewer interaction through broadcast content moving a viewer image corresponding to any one of the viewers with the highest result score to the first display position;
A method of providing a viewer-participating interactive interactive broadcasting service. According to claim 1,
The step of determining the attributes of the viewer image,
based on obtaining a second viewer input from the one or more viewers, displaying text and emoticons corresponding to the second viewer input on the broadcast screen,
Displaying the text and emoticons on the broadcasting screen comprises:
In consideration of at least one of a type of broadcast content provided by the broadcaster, a rule preset by the broadcaster, the number of viewers connected to the broadcast channel of the broadcaster, and the number of second viewer inputs input from the one or more viewers, the Comprising the step of determining the position, size, shape and display holding time of the text and the emoticon displayed on the broadcast screen,
A method of providing a viewer-participating interactive interactive broadcasting service. a memory storing one or more instructions; and
a processor executing the one or more instructions stored in the memory;
The processor by executing the one or more instructions,
An apparatus for performing the method of claim 1 . A computer program stored in a computer-readable recording medium in combination with a computer, which is hardware, to perform the method of claim 1.

Images