KR102144336B1 - Broadcasting system for integrating graphic with video based on cloud computing network - Google Patents

Abstract

The present invention relates to a cloud-based graphic image integrated broadcasting system, and the original broadcasting image is to increase the efficiency of information transmission for the original broadcasting image by adding at least one graphic including subtitles, text, figures, images, etc. When editing a broadcast image, a design template for the graphic and a thumbnail image for the broadcast image are provided to the user, and the user edits the thumbnail image using the provided design template and then transmits editing information. Then, by using the editing information, the editing of the actual broadcast image can be automatically performed in the integrated broadcasting system on the cloud, so that the graphic is displayed while overcoming network traffic even without a separate specialized equipment for the editing. It relates to a cloud-based graphic video integrated broadcasting system that can be easily integrated into a broadcast video and delivered to viewers.

Description

Cloud-based graphic video integrated broadcasting system {BROADCASTING SYSTEM FOR INTEGRATING GRAPHIC WITH VIDEO BASED ON CLOUD COMPUTING NETWORK}

The present invention relates to a cloud-based graphic image integrated broadcasting system, and more particularly, by adding at least one graphic including subtitles, texts, figures, images, etc. to the broadcast image, the efficiency of information transmission for the original broadcast image is improved. When editing the original broadcast image for enhancement, a design template for the graphic and a thumbnail image for the broadcast image are provided to the user, and the user edits the thumbnail image using the provided design template. When the editing information is transmitted, the editing of the actual broadcasting image using the editing information can be automatically performed in the integrated broadcasting system on the cloud, thereby overcoming network traffic even without a separate specialized equipment for the editing. The present invention relates to a cloud-based graphic image integrated broadcasting system that allows the graphic to be easily integrated into the broadcast image and transmitted to a viewer.

Due to the recent industrial development and the rapid development of video and broadcasting technology, the technology for an internet broadcasting platform that enables streaming of various broadcasting images through the Internet and providing it to a plurality of viewers is rapidly developing.

In particular, companies are creating corporate profits by developing their own internet broadcasting platform that includes simple interaction functions (e.g. chat function) between users (i.e. individuals or broadcasters performing broadcasting) and viewers and providing them to individuals or broadcasters. .

Accordingly, users perform streaming broadcasting using the Internet broadcasting platform, and provide various broadcasting images they have produced to viewers around the world.

In particular, when transmitting a broadcast image through the Internet broadcasting platform, if at least one graphic including a caption, text, figure, image, etc. for the broadcast image is provided by overlaying the broadcast image, viewers may It is possible to easily understand the information about and more informatively watch the broadcast video.

However, the conventional internet broadcasting platform merely provides a function of transmitting a user's broadcasting image to viewers who have connected to the broadcasting platform, and overlaying a specific graphic on the broadcasting image is left entirely to the user area.

That is, a user creates a separate design template for a graphic, overlays the graphic on his or her broadcast image through the created design template, and performs streaming broadcasting through the Internet broadcasting platform.

This is because high-resolution broadcast images (e.g., UHD broadcast images) must be directly edited, so the user must have a separate high-performance graphic equipment, and expertise to produce the design template is also required, or the design template It requires a separate professional manpower to produce.

If a design template suitable for the user's needs is provided, and the user receives the editing information for editing the broadcast video using the design template, the at least one graphic is transferred to the broadcast video based on the received edit information on the cloud. If it is overlaid, it is possible to reduce network traffic between the user device and the broadcasting platform due to transmission and reception of high-definition broadcasting images including at least one graphic, and at the same time, broadcasting images that are beneficial to viewers without additional equipment or professional manpower. Will be able to provide.

Accordingly, the present invention provides a design template suitable for the user's needs and a thumbnail image of the user's broadcast image through a machine learning method including deep learning, and allows the user to edit the thumbnail to overlay the user's desired graphic. And, by receiving only the edited edit information from the user and using the received edit information to perform actual editing of the original broadcast video on the cloud, network traffic for high-quality broadcast video An object of the present invention is to provide a cloud-based graphic video integrated broadcasting system that minimizes and enables efficient streaming broadcasting in which the graphic and the broadcast image are integrated without additional equipment or manpower.

Next, the prior art existing in the technical field of the present invention will be briefly described, and then the technical matters that the present invention intends to achieve differentiated from the prior art will be described.

First, Korean Patent Registration No. 1537547 (2015.07.13) relates to an online live broadcasting advertisement system and method using overlay streaming. While having a broadcasting streaming server and an advertisement server, online broadcasting contents are transmitted through the broadcasting streaming server. In the meantime, when an online advertisement is received from an advertiser in real time in the advertisement server, the received online advertisement is overlaid on the transmitted online broadcasting content, and the online advertisement is provided to viewers in real time. It relates to a live online advertising system and method.

However, the prior art merely describes the extent to which an online advertisement is provided by overlaying it on currently broadcast online broadcasting content, and does not describe a technical configuration of overlaying a user's desired graphic on the user's broadcast image.

On the other hand, the present invention provides the user with a design template suitable for the user's needs by analyzing a thumbnail image of the broadcast image and the user's propensity when a user wants to edit a specific broadcast image, and the user provides the When the thumbnail image is edited by overlaying at least one graphic based on a design template, only the editing information for this is transmitted from the user, and the specific broadcast image is substantially automatically edited on the cloud using the transmitted editing information As a result, the graphic can be easily overlaid on the broadcast image without additional equipment or manpower, and the prior art does not describe or suggest such a technical feature of the present invention.

In addition, Korean Patent Publication No. 2018-0092873 (2018.08.20.) relates to a method and apparatus for generating a live streaming image, a method and apparatus for providing a live service, and a live streaming system. A first streaming image photographed by a camera is recorded. Generates and generates a second streaming image including a specific sticker and effect for covering the first streaming image on the generated first streaming image, and broadcasts the generated second streaming image live It relates to a method and apparatus for generating a live streaming image, a method and apparatus for providing a live service, and a live streaming system provided to a terminal of a viewer watching TV.

The prior art describes a technical configuration in which a second streaming image including the sticker and effect is generated in a user's device to be broadcast and transmitted to the live streaming system.

On the other hand, the present invention receives only editing information for overlaying at least one graphic on a broadcast image from a user terminal, and provides at least one graphic to the broadcast image based on the transmitted edit information in a cloud-based graphic image integrated broadcasting system. It is clear that the prior art has no description, suggestion or suggestion of the technical features of the present invention as being able to be overlaid.

As a result of reviewing the prior arts above, most of the prior arts describe only the basic concept of inserting advertisements, stickers, or effects into broadcast images streamed in real time, and at least one including subtitles, texts, images, figures, etc. By using the design template for the graphic above, it is possible to edit based on the thumbnail for the broadcast image, and only the editing information for this is received from the user terminal, so that the editing of the actual broadcast image is performed by cloud-based graphic image integrated broadcasting. Regarding the configuration that enables the system to automatically perform real-time streaming, the user can conveniently perform real-time streaming broadcasting incorporating graphics and images without having separate equipment or specialized personnel for design templates or editing. The technical difference between the present invention and the prior art is obvious because there is no specific description or any suggestion or suggestion.

The present invention was created to solve the above problems, and when a graphic including subtitles, images, texts, figures, and graphs is to be overlaid on a specific broadcast image, a design template for the graphic and the corresponding broadcast image By providing a thumbnail image to a user terminal, the graphic can be easily overlaid on the specific broadcast image based on the thumbnail image using the design template, and the graphic can be integrated on the specific broadcast image and provided to a plurality of viewers. Its purpose is to provide a cloud-based integrated graphic video broadcasting system.

In addition, the present invention, when the user performs editing for overlaying a graphic on the broadcast image based on a thumbnail image, only the editing information for the edit is provided from the user terminal, and the provided cloud-based Provides a cloud-based graphic video integrated broadcasting system that can minimize network traffic between the user terminal and the cloud-based graphic video integrated broadcasting system by substantially editing the broadcast image in the integrated graphic video broadcasting system It has another purpose.

In addition, the present invention analyzes the user's preference for each graphic through a machine learning algorithm including deep learning, and automatically recommends a new design template suitable for the user's needs based on the analyzed user's taste. Another object is to provide a cloud-based graphic image integrated broadcasting system that enables streaming broadcasting using more diverse design templates.

In the cloud-based integrated graphic image broadcasting system according to an embodiment of the present invention, when a device for editing a broadcast image intends to perform editing to overlay a graphic including a caption, text, figure, and graph on a specific broadcast image , A thumbnail image providing unit that generates a thumbnail image for a corresponding broadcast image and provides the broadcast image editing device, a design template providing unit that provides at least one design template for the graphic to the broadcast image editing device, the broadcast And an editing information receiving unit configured to receive the edited information performed by the video editing device and a graphic overlay unit configured to edit the broadcast image in real time based on the received editing information.

In addition, the editing performed by the broadcast image editing device is performed based on the thumbnail image using the provided design template, and the editing performed by the graphic overlay unit is performed based on the original for the specific broadcasting image. It is performed, and is performed by overlaying the graphic on the specific broadcast image based on the received editing information.

In addition, the editing information includes a graphic overlaid on the thumbnail image using the design template, a position, size, color (RGB), transparency (alpha, A), font, duration, effect information, or these It characterized in that it comprises a combination of.

In addition, the cloud-based graphic image integrated broadcasting system learns the mapping relationship between the broadcast image types collected from a plurality of users, preference information including the preferred design style and effect effect for each graphic, and the design template used by each user. Thus, further comprising a design template recommendation learning model generation unit for each graphic to generate a design template recommendation learning model for each graphic in order to recommend at least one design template to a specific user, the learning models for each design template recommendation, It is characterized in that learning is performed to output a design template selected by the most users according to the user preference information or a design template used in a broadcast image having a number of viewers equal to or greater than a preset value.

In addition, the cloud-based graphic image integrated broadcasting system transmits the broadcast image edited through the graphic overlay unit to a broadcast channel set by the user, thereby performing a streaming broadcast in which the graphic and the specific broadcast image are integrated. Further comprising an image output unit, wherein the design template providing unit, by applying each graphic taste information for the specific user to the generated design template recommendation learning model, at least one output from the learning model for each design template recommendation Among the above design templates, a design template having a probability value equal to or greater than a preset threshold is selected and recommended as a device for editing a broadcast image of the user, and a design template previously used by the user is provided to the device for editing a broadcast image. To do.

In addition, the broadcast image editing device according to an embodiment of the present invention, when a user wants to edit a specific broadcast image through a cloud-based graphic image integrated broadcasting system using the broadcast image editing device, the cloud-based A thumbnail image receiving unit for receiving a thumbnail image for a corresponding broadcast image from a graphic image integrated broadcasting system, and a design template for overlaying a graphic including a caption, text, figure, or graph on the thumbnail image, and the cloud-based graphic image integrated broadcasting A design template receiving unit receiving at least one design template from the system, a thumbnail image editing unit editing the thumbnail image using the received design template, and editing information obtained by editing the thumbnail image into the cloud-based graphic image integrated broadcasting system It includes an editing information providing unit provided as, by providing the editing information edited the thumbnail image to the cloud-based graphic image integrated broadcasting system, the actual editing of the broadcast image is performed in the cloud-based graphic image integrated broadcasting system It is characterized in that it can be performed automatically.

In addition, the thumbnail image editing unit, when editing the graphic in the thumbnail image using the received design template, the position, size, color, transparency, text, effect time, in-out of the graphic in the thumbnail image It characterized in that it enables to perform editing including a.

In addition, a broadcast image editing method through a cloud-based graphic image integrated broadcasting system according to an embodiment of the present invention is for overlaying graphics including captions, texts, figures, and images on a specific broadcast image in a broadcast image editing device. When editing is to be performed, a thumbnail image providing step of providing a thumbnail image for a corresponding broadcast image in a cloud-based graphic image integrated broadcasting system, and at least one design template for the graphic in the cloud-based graphic image integrated broadcasting system Providing a design template provided to the broadcast image editing device, in the broadcast image editing device, after editing the thumbnail image using the provided design template, the editing information is transmitted to the cloud-based graphic image integrated broadcasting system And a graphic overlay step of overlaying the graphic on the specific broadcast image in real time using the received edit information in the cloud-based graphic image integrated broadcasting system.

In addition, the editing method includes learning the mapping relationship between the taste information including the type of broadcast video collected from a plurality of users, the preferred design style and effect effect for each graphic, and the design template used by each user, Further comprising the step of creating a design template recommendation learning model for each of the graphics to recommend one or more design templates, wherein each of the design template recommendation learning models is included in the user preference information. Accordingly, it is characterized in that learning is performed to output a design template selected by the most users or a design template used in a broadcast image having a number of viewers equal to or greater than a preset value.

In addition, the broadcast image editing method includes a broadcast image output step of transmitting a broadcast image edited through the graphic overlay step to a broadcast channel set by a user, thereby performing a streaming broadcast in which the graphic and the specific broadcast image are integrated. It further includes, wherein the providing of the design template comprises presetting a design template previously used by the user and at least one design template extracted by applying taste information for the user to the generated design template recommendation learning model. At least one design template is provided by selecting a design template having a probability value of at least one threshold value and recommending it to the user's broadcast image editing device.

As described above, the cloud-based graphic image integrated broadcasting system of the present invention includes a design template for a graphic including a caption, text, image, figure, or a combination thereof for overlaying a broadcast image and a thumbnail for the broadcast image. By providing the provided thumbnail and the design template, the graphic for the broadcast image can be easily overlaid, so that the user can conveniently display the graphic without having expertise in design or having additional equipment or manpower. There is an effect of being able to overlay the broadcast image.

In addition, in the present invention, when the user performs editing for overlaying a graphic on the broadcast image based on the thumbnail and the design template, only the editing information for the edit is received from the user terminal, and the actual overlane operation is By allowing the cloud-based integrated graphic video broadcasting system to automatically perform it, there is an effect of minimizing network traffic between the user terminal and the cloud-based integrated graphic video broadcasting system.

In addition, the present invention provides a design template suitable for the user's needs by analyzing the user's propensity through a machine learning method including deep learning, so that more diverse and beneficial broadcast images can be produced and provided to viewers. There is.

1 is a conceptual diagram schematically illustrating a cloud-based integrated graphic video broadcasting system according to an embodiment of the present invention.
2 is a diagram illustrating a process of editing a broadcast image for streaming broadcasting according to an embodiment of the present invention.
3 is a block diagram showing the configuration of a broadcast video editing device according to an embodiment of the present invention.
4 is a block diagram showing the configuration of a cloud-based integrated graphic video broadcasting system according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating a learning process for recommending a design template to a user according to an embodiment of the present invention.
6 is a flowchart illustrating a procedure for recommending at least one design template to a user according to an embodiment of the present invention.
7 is a flowchart illustrating a procedure for performing streaming broadcasting by integrating graphics and broadcast images based on a cloud according to an embodiment of the present invention.
8 is a flowchart illustrating a procedure for editing a thumbnail image performed in the device for editing a broadcast image according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same reference numerals in each drawing indicate the same member. In addition, specific structural or functional descriptions of the embodiments of the present invention are exemplified only for the purpose of describing the embodiments according to the present invention, and unless otherwise defined, all of the technical or scientific terms used herein The terms have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in this specification. It is desirable not to.

1 is a conceptual diagram schematically illustrating a cloud-based integrated graphic video broadcasting system according to an embodiment of the present invention.

As shown in FIG. 1, the cloud-based graphic image integrated broadcasting system 100 according to an embodiment of the present invention receives a user's broadcast image from a broadcast image editing device 200 provided by the user and By transmitting to the viewer's terminal, it supports a function that enables streaming broadcasting.

That is, the cloud-based graphic image integrated broadcasting system 100 is to enable streaming broadcasting by streaming a broadcasting image received from a user and providing it to a plurality of viewers, and is built on a cloud basis, and Through this, the broadcast image can be efficiently edited, so that the streaming broadcast can be effectively performed.

The broadcast image editing device 200 is installed in various smart terminals equipped by users such as desktop PCs, smart phones, notebook PCs, etc. in the form of an integrated broadcasting application program, and by executing the integrated broadcasting application program, the smart It becomes a broadcasting image editing device 200 that enables a terminal to edit a specific broadcasting image through the cloud-based integrated graphic image broadcasting system 100 and perform streaming broadcasting on the edited specific broadcasting image.

The user can use the smart terminal as the device 200 for editing broadcast images by downloading and installing an integrated broadcasting application program provided from the cloud-based graphic image integrated broadcasting system 100 on various smart terminals equipped with the user. have.

That is, the user can perform streaming broadcasting using a specific broadcast image through the cloud-based graphic image integrated broadcasting system 100 by executing an integrated broadcasting application program installed in the broadcasting image editing device 200.

When a user runs an integrated broadcasting application program installed in the broadcasting image editing device 200 to perform the broadcasting, the user is automatically logged in to the user cloud account of the cloud-based integrated graphic image broadcasting system 100 to start broadcasting. To be able to carry out the preparation for it.

Meanwhile, the user cloud account provides user account information including a user ID and password to the cloud-based graphic image integrated broadcasting system 100 in order for the user to edit and broadcast his or her broadcast image. , Is created through membership registration performed.

In this case, the cloud-based integrated graphic video broadcasting system 100 stores and manages the provided user account information for each of the created user cloud accounts.

In addition, the cloud-based graphic image integrated broadcasting system 100 receives a broadcast image for broadcasting from the user device 200 and stores and manages the generated user cloud account.

In addition, when the user selects at least one broadcast image and wants to perform streaming broadcast through the selected at least one or more broadcast images, the cloud-based graphic image integrated broadcasting system 100 By streaming and providing the broadcast video editing device 200, the streaming broadcasted broadcast video can be monitored.

That is, at least one broadcast image selected by the user is streamed and loaded from the cloud-based graphic image integrated broadcasting system 100 on a display (not shown) of the user device 200.

Meanwhile, main image information such as HDR, HD, Full-HD, etc. may be displayed on each of the broadcast images, and the cloud-based graphic image integrated broadcasting system 100 includes meta data of each of the broadcast images. ) Is analyzed to allow the main image information to be displayed on the user device 200.

In addition, the cloud-based graphic image integrated broadcasting system 100 is an editing for overlaying a graphic including a caption, an image, a figure, a text, or a combination thereof on the broadcast image so as to increase the efficiency of information transmission for the broadcast image. Support function.

In addition, the cloud-based graphic image integrated broadcasting system 100 provides a design template for overlaying the graphic including the caption, image, figure, text, or a combination thereof on the broadcast image, so that the user It is possible to edit the broadcast image simply without having a specialty for or a separate equipment for processing the graphic.

In this case, the cloud-based graphic image integrated broadcasting system 100 generates a thumbnail image reduced to a very small size of the broadcasting image and provides it to the user, and the broadcasting using the design template based on the thumbnail image Make the video editable.

That is, the editing performed by the broadcast image editing device 200 is performed based on the thumbnail image, and a description thereof will be described in detail with reference to FIG. 2.

In addition, the cloud-based integrated graphic video broadcasting system 100 provides at least one design template previously used by the user, analyzes the user's taste at the same time, and creates a new design template that meets the user's needs. By recommending at least one or more, the design template can be provided.

In addition, the design template may be registered in the cloud-based integrated graphic video broadcasting system 100 by a maker who produces a design template, and may be provided to the user for a fee or for free.

In addition, when the cloud-based integrated graphic video broadcasting system 100 selects a design template provided for a fee, the user device 200 provides a payment interface to pay the cost applied in advance to the design template, Make the template available.

Meanwhile, the design template for which the cost is paid is automatically duplicated and registered in the user's user cloud account, and then the user can use the design template repeatedly.

In addition, when the user selects the design template and edits at least one graphic based on the thumbnail image, the cloud-based graphic image integrated broadcasting system 100 provides the user with the editing information. It is received from the device 200 in real time.

On the other hand, the editing information includes a graphic overlaid on the thumbnail image using the design template, a position at which the graphic is overlaid on the thumbnail image, size, color (RGB), transparency (alpha, A), font, effect time, It includes effect information or a combination thereof, and is converted into a metadata format in the broadcast image editing device 200 and transmitted to the cloud-based integrated graphic image broadcasting system 100.

Thereafter, the cloud-based graphic image integrated broadcasting system 100 overlays at least one graphic edited by the user on the original of the broadcast image based on the received edit information on a corresponding position, so that the graphic is Overlaid broadcast video is generated.

Meanwhile, the overlay is performed by blending the graphic to the original of the broadcast image through transparency included in the editing information.

That is, the overlay in the present invention means not simply displaying a specific graphic on a specific image, but integrating the graphic into the broadcast image through the blending.

In addition, in the blending, the cloud-based graphic image integrated broadcasting system 100 sets the broadcast image and the graphic as a background and a foreground, respectively, and a pixel value for a broadcast image at a location where the graphic is overlaid according to the transparency. And the ratio of the pixel value for the graphic to be adjusted, and applying the adjusted pixel value as the pixel value of the broadcast image.

For example, when the transparency is 50%, a pixel value for the broadcast image and an intermediate value for the graphic pixel value are respectively calculated, and the calculated result is applied as a pixel value for the broadcast image. , To perform the blending.

In addition, editing of a broadcast image is substantially automatically performed by the cloud-based graphic image integrated broadcasting system 100, and the broadcast image editing device 200 simply uses only editing information to the cloud-based graphic image integrated broadcasting system ( 100). Through this, the user can conveniently edit the broadcast image without having a separate graphic device or switcher for graphic editing.

In addition, the user performs the editing on the broadcast image stored in advance through the cloud-based graphic image integrated broadcasting system 100, and then performs streaming broadcasting using the edited broadcast image, or By performing the editing in real time while broadcasting is being performed, more useful broadcasting images can be provided to viewers.

That is, the cloud-based graphic image integrated broadcasting system 100 of the present invention generates a new broadcast image by integrating a real broadcast image and a graphic through the editing, and performs streaming broadcast on the generated broadcast image by itself. Make it possible.

Meanwhile, the cloud-based graphic image integrated broadcasting system 100, in conjunction with at least one or more other Internet broadcasting platforms, streams the broadcasting image to the user account (ie, broadcasting channel) of the corresponding user for each Internet broadcasting platform. By transmitting, it can be implemented to perform broadcasting through the Internet broadcasting platform. At this time, the broadcast channel is directly set by the user.

As described above, the cloud-based graphic image integrated broadcasting system 100 of the present invention includes a thumbnail image of a broadcast image and a design template for overlaying at least one graphic on the broadcast image. ) By providing only the editing information for editing the thumbnail in the broadcasting image editing device 200, and performing actual editing on the original of the broadcasting image on the cloud based on the provided editing information. , It is possible to provide a more beneficial broadcast image to viewers by allowing the user to conveniently perform the above editing without having to have a separate equipment or professional manpower for graphics.

Meanwhile, when the thumbnail image is edited, the broadcast image editing device 200 does not provide corresponding editing information, but provides the edited thumbnail image to the cloud-based graphic image integrated broadcasting system 100. I can.

In this case, the private cloud-based graphic image integrated broadcasting system 100 may be implemented to extract the edit information from the provided thumbnail image and edit the broadcast image using the extracted edit information.

Hereinafter, a process of editing the broadcast image will be described in more detail with reference to FIG. 2.

2 is a diagram illustrating a process of editing a broadcast image for streaming broadcasting according to an embodiment of the present invention.

As shown in FIG. 2, the process of editing a broadcast image for streaming broadcasting according to an embodiment of the present invention includes, first, in order to perform streaming broadcasting using a specific broadcast image in the broadcast image editing device 200. Install and execute a broadcasting application program from the cloud-based graphic image integrated broadcasting system 100 (①).

The broadcast image editing device 200 refers to various wired/wireless communication terminals provided by a user, and by installing and executing the integrated broadcasting application program on the wired/wireless communication terminal, the wired/wireless communication terminal is a broadcast image editing device 200 ) Is as described above.

In addition, the user executes the integrated broadcasting application program and selects at least one or more broadcasting images stored in the user's user cloud account in the cloud-based graphic image integrated broadcasting system 100, or the broadcasting image editing device ( By providing a broadcast image captured from a camera (not shown) provided in 200) to the cloud-based graphic image integrated broadcast system 100, streaming broadcast can be performed.

In this case, when the user wants to edit the selected broadcast image, the cloud-based graphic image integrated broadcast system 100 provides a thumbnail image for the broadcast image and graphics such as captions, texts, figures, and images on the broadcast image. Provides at least one design template for overlaying.

Meanwhile, the broadcast image means a high-definition image of UHD level, and the thumbnail image is generated by the cloud-based graphic image integrated broadcasting system 100, and the UHD-class broadcast image is resized to a preset size ( That is, reduced) transmitted to the broadcast video editing device 200.

In addition, the thumbnail images are generated and provided for each of at least one or more broadcast images according to the user's selection.

In this case, the broadcast image editing device 200 performs a function of displaying at least one thumbnail image and the design template provided from the cloud-based graphic image integrated broadcasting system 100 through a user interface, and the user Allows the thumbnail image and design template to be visually recognized.

In addition, the cloud-based integrated graphic video broadcasting system 100 uses a design template and a machine learning algorithm stored in the user's user cloud account as the user previously used. , Images, figures, graphs, etc.) by extracting a design template and recommending the extracted design template, the at least one design template may be provided to the broadcast video editing device 200.

Meanwhile, a process of recommending a design template suitable for a user's needs through the machine learning algorithm will be described in detail with reference to FIG. 6.

Next, when the user wants to edit the thumbnail image, which is the basis for overlaying a graphic on the broadcast image, the broadcast image editing device 200 converts the thumbnail image to a predetermined size with an editing unit (editing window). Display enlarged.

Thereafter, when the user performs editing of the thumbnail image for the broadcast image by overlaying the at least one graphic on the thumbnail image using the provided at least one design template (③), the broadcast image editing The device 200 provides editing information on the edited to the cloud-based integrated graphic video broadcasting system 100 (④).

In this case, the design template has a design style (eg, a speech balloon) and a design property (eg, 3D) for each graphic, and the user can edit various graphics on the thumbnail image by using the design template.

For example, when the user wants to overlay a specific text using a specific design template, when the design style of the corresponding design template is a speech balloon and the design property is 3D, when typing the specific text in the speech balloon, corresponding Text is represented in 3D format.

Meanwhile, the design style refers to the shape (shape) of the overlaid graphic, and includes figures, speech balloons, particles, lens-flare, god ray, and level meters. ), text box, graph, etc., and the design attribute refers to an effect (effect) applied when overlaying the graphic, and includes shadow, 2D, 3D, Includes scroll, wipe, animation, etc.

It is natural that the design style and design attributes may be additionally set by the design template creator or the administrator of the cloud-based graphic video integrated broadcasting system 100.

In this case, the editing information includes a target graphic (i.e., subtitle, text, image, graph, figure, etc.) overlaid on the thumbnail image, a position, size, color (RGB), and transparency ( Includes alpha, A), font, duration, effect information, or combinations thereof.

Next, the cloud-based integrated graphic video broadcasting system 100 performs a function of editing the original video for the broadcast video in real time based on the received edit information (⑤).

At this time, the cloud-based graphic image integrated broadcasting system 100 generates and provides a thumbnail image reduced to a preset size based on the original broadcast image, so that the graphic overlayed on the corresponding thumbnail image based on the reduced ratio You can easily see the location and size.

Therefore, the cloud-based graphic image integrated broadcasting system 100 provides a function of transmitting a broadcast image incorporating the graphic by overlaying the graphic included in the edit information on an actual broadcast image in real time by reflecting the edit information. Will be performed (⑥).

Through this, a user can easily integrate at least one or more graphics into the broadcast image and provide a more informative broadcast image to the viewer.

3 is a block diagram showing the configuration of a broadcast video editing device according to an embodiment of the present invention.

As shown in FIG. 3, the device 200 for editing a broadcast image according to an embodiment of the present invention includes a user interface unit 210 and a cloud-based graphic image integrated broadcast system 100 A broadcast image providing unit 220 provided as a service, a thumbnail image receiving unit 230 receiving a thumbnail image for the broadcast image from the cloud-based graphic image integrated broadcasting system 100, and the cloud-based graphic image integrated broadcasting system A design template receiving unit 240 for receiving at least one design template from 100, a thumbnail image editing unit 250 for editing the thumbnail image, and editing information for editing the thumbnail image in the cloud-based graphic image integrated broadcasting system It is configured to include an editing information providing unit 260 provided to (100).

The user interface unit 210 is implemented to provide various functions for performing broadcasting by manipulating the broadcasting image editing device 200, such as editing the thumbnail image, displaying the thumbnail image, and displaying a design template. do.

In addition, the broadcast image providing unit 220 provides a broadcast image to the cloud-based graphic image integrated broadcast system 100 to store the broadcast image or perform streaming broadcast.

The broadcast image may be produced in advance, or may be photographed in real time through a photographing device such as a camera (not shown) and provided to the cloud-based graphic image integrated broadcasting system 100.

That is, the cloud-based graphic image integrated broadcasting system 100 stores at least one or more broadcasting images for each user cloud account, and enables streaming broadcasting of the corresponding broadcasting image according to the user's selection, or the user It is possible to perform the streaming broadcast by receiving a broadcast image from the device in real time.

In addition, when the user wants to edit (i.e., overlay) at least one graphic such as a caption, text, figure, graph, etc. of the stored broadcast video or broadcast video broadcast in real time, the thumbnail image receiving unit 230 A thumbnail image for a corresponding broadcast image is received from the based graphic image integrated broadcasting system 100.

In addition, the thumbnail image receiving unit 230 performs a function of displaying the received thumbnail image on the display of the broadcast image editing device 200 through the user interface unit 210.

The thumbnail image is resized to a very small size according to a preset size of the broadcast image and transmitted to the thumbnail image receiving unit 230.

Meanwhile, the thumbnail image becomes a basis for overlaying the graphic on the broadcast image.

In addition, the design template receiving unit 240 receives at least one design template for editing from the cloud-based graphic image integrated broadcasting system 100 and displays it on the display of the broadcasting image editing device 200 Perform.

The design template may be provided for each graphic (ie, caption, text, figure, graph, etc.) according to the user's selection.

In this case, the design template receiving unit 240 may display only a design template according to the graphic on the display according to a user's selection.

For example, when the user sets to display only the design template for the subtitle, the design template receiving unit 240 displays at least one design template for the subtitle on the display.

In addition, when the user desires to receive only the design template for the caption from the cloud-based integrated graphic video broadcasting system 100, it may be set to receive only the design template for the caption.

The thumbnail image editing unit 250 provides an editing function for overlaying the graphic onto the thumbnail image using the design template based on the received thumbnail image.

That is, the thumbnail image editing unit 250 provides an editing function that allows the graphic to be overlaid on the thumbnail image rather than the original broadcast image.

In this case, when the user selects a thumbnail image to be edited, the thumbnail image editing unit 250 generates an editing window for editing the thumbnail image, and enlarges the thumbnail image to a preset size and displays it.

Thereafter, when the user selects the displayed design template and loads it into the editing window, the editing unit 250 receives the corresponding design template decoded in real time by the cloud-based graphic image integrated broadcasting system 100 Thus, the received design template is displayed in the editing window.

In addition, the user performs editing for overlaying at least one graphic on the enlarged and displayed thumbnail image at an arbitrary position using the design template displayed on the editing window.

In addition, when the user edits the thumbnail image, the editing information providing unit 260 generates editing information for the thumbnail image and transmits the generated editing information to the cloud-based graphic image integrated broadcasting system 100. , In the cloud-based graphic image integrated broadcasting system 100, the graphic may be overlaid on an actual broadcast image based on the edit information.

That is, the user edits the thumbnail image of the broadcast image through the broadcast image editing device 200, and the editing of the actual broadcast image is performed by the cloud-based graphic image integrated broadcasting system 100. will be.

Through this, network traffic between the broadcasting image editing device 200 and the cloud-based integrated graphic image broadcasting system 100 can be minimized, and the user does not need additional editing equipment or specialized knowledge about design templates. The above editing can be performed easily.

4 is a block diagram showing the configuration of a cloud-based integrated graphic video broadcasting system according to an embodiment of the present invention.

As shown in FIG. 4, the cloud-based graphic image integrated broadcasting system 100 according to an embodiment of the present invention includes a broadcast for receiving broadcast images for each user from at least one or more broadcast image editing devices 200. The image receiving unit 110, when the user wants to edit at least one broadcast image through the broadcast image editing device 200, provides a thumbnail image of the broadcast image to the broadcast image editing device 200 A thumbnail image providing unit, a design template recommendation learning model generation unit 130 that generates a design template recommendation learning model for each graphic to recommend the design template for editing to the user, and provides a design template for the editing A design template providing unit 140 to perform, an editing information receiving unit 150 receiving editing information from the broadcast image editing device 200, overlaying at least one graphic on an actual broadcast image in real time based on the received edit information And a graphic overlay unit 160 for transmitting the overlayed broadcast image, a broadcast image transmitting unit 170 for transmitting the overlaid broadcast image, and a user cloud account management unit 180 for managing cloud accounts for each user.

The broadcast image receiving unit 110 may receive pre-produced broadcast images from a plurality of users and store them for each user's cloud account, or receive broadcast images from each of the users in real time, and the broadcast image transmission unit 170 ) To perform streaming broadcasting.

In addition, when the user selects the stored specific broadcasting image or the specific broadcasting image currently performing streaming broadcasting through the broadcasting image editing device 200 and wants to edit the corresponding broadcasting image, the thumbnail image providing unit ( 120) generates a thumbnail image for the selected specific broadcast image, and provides the generated thumbnail image to the broadcast image editing device 200 of the corresponding user.

The thumbnail image is a reduction of the high-definition broadcast image to a preset size, and serves as a basis for editing the broadcast image through the broadcast image editing device 200.

In addition, the design template recommendation learning model generation unit 130 learns the mapping relationship between graphic preference information for a plurality of users stored in advance and the design template used by each user, and recommends a design template suitable for the user's needs. A learning model for recommending a design template is generated and stored in the database 400.

On the other hand, the taste information for each graphic is collected from a plurality of users through the cloud-based graphic image integrated broadcasting system 100, and the broadcast image type, the graphic design style and design effect effect that each user prefers are determined. The cloud-based graphic image integrated broadcasting system 100 maps the collected taste information for each graphic and the design template used by each user, thereby generating a mapping table in which the taste information and the design template are mapped. It is stored in the database 400.

At this time, mapping of the design template used by each user to the preference information for each graphic is performed by referring to the design template stored in the user's user cloud account.

That is, the design template recommendation learning model generation unit 150 refers to the stored mapping table and learns a mapping relationship between graphic preference information for the plurality of users and design templates used by each user, The learning model for recommending the design template is generated for each graphic (ie, subtitle, text, figure, graph).

In addition, the cloud-based graphic video integrated broadcasting system 100 classifies and stores the plurality of design templates according to design style and effect effect for the learning, and the generated learning model for recommending design templates for each graphic, By learning the mapping relationship, it is learned to recommend a design template selected to the most users based on the classified plurality of design templates or a design template used in a broadcast image having a high number of viewers (ie, the number of views).

In addition, the learning model for design template recommendation is learned to recommend a design template suitable for the specific user's needs for each graphic through a design template recommendation learning network.

Meanwhile, the structure of the design template recommendation learning network will be described in detail with reference to FIG. 5.

In addition, the design template providing unit 140 recommends at least one design template for each graphic using a design template previously used by the user and the generated design template recommendation learning model, thereby providing at least one design template to the user. Performs the functions provided.

The design template providing unit 140, when recommending the at least one design template to a specific user, loads the learning model for design template recommendation generated for each graphic from the database 400, and is input from a specific user , The preference information for each graphic of the specific user stored in advance is applied to the loaded learning model for recommending a design template, and a design template for each graphic is output.

Thereafter, the design template providing unit 140 performs the recommendation by selecting at least one design template having a probability value equal to or greater than a preset threshold from among the output design templates, and providing the selected design template to the user. Is done.

On the other hand, when the user desires to receive a design template for a subtitle, the design template providing unit 140 provides user preference information including a broadcast image type, a preferred design style and effect effect for the subtitle from the user. It is possible to recommend only a design template for subtitles to a corresponding user by applying the taste information inputted from the user and applied to the generated design template recommendation learning model (ie, a subtitle design template recommendation learning model).

On the other hand, recommending the design template is performed when the user wants to edit a specific broadcast video, and is preferably provided automatically for each graphic, but when the user wants to recommend a design template for a specific graphic according to the user's selection. , The design template providing unit 140 may recommend only a design template for a corresponding graphic to the user.

Accordingly, the cloud-based graphic image integrated broadcasting system 100 allows a user to separately produce or not create a separate graphic and overlay various graphics on the broadcast image using the recommended design template. .

In addition, the editing information receiving unit 150 performs editing for overlaying a specific graphic on the selected broadcasting image by the user using the thumbnail image and the provided design template through the broadcasting image editing device 200. In the case of execution, a function of receiving editing information for a corresponding edit from the broadcast image editing device 200 in real time and providing it to the graphic overlay unit 160 is performed.

That is, in order to overlay at least one graphic on the broadcast image selected by the user, the user performs the editing based on the thumbnail image for the broadcast image through the broadcast image editing device 200. Substantial editing in which the graphic is overlaid on the broadcast image is performed by the cloud-based graphic image integrated broadcasting system 100.

Accordingly, the cloud-based integrated graphic image broadcasting system 100 supports a function of allowing a user to overlay the graphic on the broadcast image without having additional equipment such as a high-performance graphic device.

In addition, the graphic overlay unit 160 performs a function of integrating the graphic into the broadcast image by overlaying at least one graphic to be overlaid by the user on an actual broadcast image using the received edit information.

The editing information includes a target graphic overlaid on a thumbnail image for a corresponding broadcast image, a position, size, color, transparency, font, duration, and effect information at which the graphic is overlaid on the thumbnail image, and the graphic overlay The unit 160 overlays the target graphic on an actual broadcast image by reflecting the editing information.

At this time, since the thumbnail image is a reduction of the actual broadcast image to a preset size, the graphic overlay unit 160, based on the reduced ratio, the graphic overlay unit 160 according to the position and size of the graphic overlaid on the thumbnail image. It is easy to know where to place the graphic on the actual broadcast image and what size to overlay.

In addition, the broadcast image transmission unit 170 routes and transmits the broadcast image overlaid on the graphic to a broadcast channel set by the user, so that the streaming broadcast in which the graphic and the broadcast image are integrated can be performed, or Enables streaming broadcasting.

Meanwhile, the broadcast channel refers to a user account for an Internet broadcasting platform, and by routing the broadcast video to a corresponding user account, viewers who access the corresponding user account can view the broadcast video.

In addition, the broadcast image transmission unit 170 streams and provides the transmitted broadcast image to the user's broadcast image editing device 200 in real time, so that the user can monitor the broadcast image in real time.

In this case, when there are two or more broadcast images transmitted through the broadcast channel, the cloud-based graphic image integrated broadcast system 100 generates a multiview for each broadcast image, and the broadcast image editing device 200 By providing as, it can be implemented to monitor the two or more transmitted images at the same time.

In addition, the user cloud instrumentation management unit 180 manages a cloud account subscribed by a user to each user in order to use the cloud-based graphic image integrated broadcasting system 100.

In this case, in the cloud account for each user, a broadcast image for each user and a design template used by each user are stored.

FIG. 5 is a diagram illustrating a learning process for recommending a design template to a user according to an embodiment of the present invention.

As shown in FIG. 5, the learning model generation unit 130 for recommending a design template according to an embodiment of the present invention includes a broadcast image type collected from a plurality of users, a preferred design style and effect effect for each graphic, and the Recalling a learning model for recommending design templates to recommend design templates for graphics including subtitles, texts, figures, graphs, etc. by learning the mapping relationship between design templates used by each user through a design template recommendation learning network It is created for each graphic.

Meanwhile, the design template recommendation learning network for learning the mapping relationship includes an input layer including at least one input node into which the broadcast image type, a preferred design style and effect effect for each graphic type are input, and at least one hidden node. It may be configured to include an output layer including at least one or more output nodes for outputting a hidden layer including and a design template.

That is, the input layer receives taste information for each of the plurality of users, and the hidden layer is connected to the input layer and the output layer through a link having a specific weight.

Meanwhile, the design template recommendation learning network is trained to output a design template selected by the most users for a given input or a design template used in a broadcast video with a high number of viewers while adjusting the weight of the link.

In addition, taste information on the collected plurality of users may be periodically collected, and by accumulating and updating the taste information, the performance of the learning model for recommending the design template may be enhanced.

In addition, the output layer outputs at least one design template, and the output design template has a probability value between 0 and 1, and in this case, when the probability values for each of the design templates are added together, it becomes 1.

That is, the input to the learning model for design template recommendation generated for each graphic through the design template recommendation learning network becomes preference information for each graphic for a specific user, and the output becomes at least one design template having the probability value. .

Thereafter, the design template providing unit 140 applies the user's taste information provided in advance from the user to the generated design template recommendation learning model, and a plurality of design templates extracted from the corresponding design template recommendation learning model By selecting at least one design template having a probability value equal to or greater than a preset threshold and providing the selected design template to the broadcast video editing device 200, a new design template suitable for the user's needs can be recommended. .

In this case, the user can conveniently edit various graphics on a corresponding broadcast image based on a thumbnail image using the provided design template.

Meanwhile, the design template recommendation learning network may be implemented using various machine learning networks such as an artificial neural network (ANN) and a convolutional neural network (CNN).

6 is a flowchart illustrating a procedure for recommending at least one design template to a user according to an embodiment of the present invention.

As shown in FIG. 6, in order to recommend at least one design template according to an embodiment of the present invention to a user, the cloud-based graphic image integrated broadcasting system 100 preferentially includes a graphic taste collected from a plurality of users. A mapping relationship between the information and the design template used by each user is learned (S110), and a learning model for recommending a design template for recommending a design template through the learning is generated (S120).

The learning model for recommending the design template is generated for each graphic. That is, the cloud-based graphic image integrated broadcasting system 100 periodically collects taste information for each graphic from a plurality of users, and maps the design template used by each user and the collected taste information for each graphic. A table is created and the created mapping table is stored.

Thereafter, the cloud-based graphic image integrated broadcasting system 100 recommends a design template by learning a mapping relationship between taste information for the plurality of users and a design template used by each user by referring to the stored mapping table. A learning model for recommending a design template for each graphic is generated.

Meanwhile, as described above, the taste information includes broadcast image types, graphic design styles, and effect effects.

Next, the cloud-based graphic image integrated broadcasting system 100, when a specific user wants to edit a specific broadcast image using the broadcast image editing device 200 (S130), for recommending the created graphic-specific design template Each learning model is loaded (S140).

Thereafter, the cloud-based graphic image integrated broadcasting system 100 receives pre-stored preference information for each graphic of a specific user or preference information for each graphic from the user, and applies each of the loaded design template recommendation learning models (S150). Thus, design templates for each graphic can be output.

That is, the cloud-based graphic video integrated broadcasting system 100 includes the generated subtitle design template recommendation learning model, graphic design template recommendation learning model, graph design template recommendation learning model, text design template recommendation learning model, By loading the subtitle design template recommendation learning model, etc., from the database 400, respectively, and inputting each of the user's preference information for each graphic into a learning model for recommending a design template, at least one from the learning model for recommending each design template. Each of the above design templates can be output.

Next, the cloud-based graphic video integrated broadcasting system 100 selects at least one design template having a probability value equal to or greater than a preset threshold among at least one design template output from the learning model for each design template recommendation ( In S160), the selected at least one design template is recommended as the broadcast image editing device 200 of the corresponding user (S170).

Meanwhile, the recommendation is automatically performed when the user edits a specific broadcast image, and design templates for at least one graphic may be respectively recommended according to the user's selection.

That is, when the user wants to recommend a design template for a specific graphic, the broadcast video editing device 200 sets (selects) only the design template for the specific graphic to be recommended, and A design template may be recommended from the cloud-based integrated graphic video broadcasting system 100.

Of course, it is natural that the recommendation function can be turned off so that only design templates used in the past can be provided.

7 is a flowchart illustrating a procedure for performing streaming broadcasting by integrating graphics and broadcast images based on a cloud according to an embodiment of the present invention.

As shown in FIG. 7, the procedure for performing streaming broadcasting by integrating graphics and broadcast images based on a cloud according to an embodiment of the present invention is, first, for editing by a user through the broadcast image editing device 200. The broadcast video is selected (S210).

In this case, the selected broadcast image may be a broadcast image previously stored in the cloud-based graphic image integrated broadcast system 100 or may be a broadcast image currently being transmitted through a broadcast channel.

Next, the cloud-based graphic image integrated broadcasting system 100 generates a thumbnail image for the selected broadcast image and provides it to the user's broadcast image editing device 200 (S220), and at the same time, the graphic image A design template for is provided to the broadcast video editing device (S230).

The thumbnail image is reduced to a size previously set for the broadcast image, and the provided design template includes a design template previously used by the user and a design template recommended through a design recommendation learning model.

Thereafter, when the user receives the editing information in which the graphic is overlaid on the thumbnail image using the provided design template through the broadcast image editing device 200 from the broadcast image editing device 200 (S240) ), the cloud-based graphic image integrated broadcasting system 100 performs a function of editing the broadcast image in real time by overlaying the graphic on the actual broadcast image selected by the user based on the received edit information (S250 ).

That is, the editing of the broadcast image is not performed by the broadcast image editing device 200, but is actually performed on a cloud having a great computing power.

Next, the cloud-based graphic image integrated broadcasting system 100 overlays the graphic and transmits it to a broadcasting channel selected by the user, so that the cloud-based integrated graphic image broadcasting system 100 performs streaming broadcasting by itself. Alternatively, the streaming broadcasting can be performed through an Internet broadcasting platform corresponding to the broadcasting channel (S260).

In addition, in a broadcasting channel performing streaming broadcasting, when switching the broadcasting image currently being transmitted to a broadcasting image related to the broadcasting image or another broadcasting image including a new broadcasting image, the user When the other broadcasting image is selected by operating 200 and a switching command for the selected other broadcasting image is executed, the cloud-based graphic image integrated broadcasting system 100 transmits the currently streamed broadcasting image to the other broadcasting image. Switch to

At this time, the cloud-based integrated graphic video broadcasting system 100 may apply a preset transition effect when the switching is performed. That is, the cloud-based graphic image integrated broadcasting system 100 converts the other broadcasting image to be switched into a texture in real time and applies a 2D or 3D effect to naturally switch the currently streamed broadcasting image to the other broadcasting image. Make it possible.

Hereinafter, a process of editing a thumbnail image performed by the broadcast image editing device 200 will be described.

8 is a flowchart illustrating a procedure for editing a thumbnail image performed in the device for editing a broadcast image according to an embodiment of the present invention.

As shown in FIG. 8, the procedure for editing a thumbnail image performed in the device for editing a broadcast image according to an embodiment of the present invention is, first, a cloud-based graphic image by a user using the device 200 for editing a broadcast image. When selecting to edit a specific broadcast image on the integrated broadcasting system 100, the broadcast image editing device 200 includes a thumbnail image for the broadcast image from the cloud-based graphic image integrated broadcasting system 100 and At least one design template is provided and displayed on the display of the broadcast image editing device 200 through a user interface.

Thereafter, when the user selects (touches or clicks) the thumbnail image for editing, the broadcast image editing device 200 creates an editing window and loads the selected thumbnail image into the created editing window ( S310).

The thumbnail image is a simplified specific broadcast image selected by the user to be edited, and refers to an image in which the specific broadcast image is reduced to a preset size.

Next, the user manipulates the broadcast image editing device 200 to select a design template to edit the thumbnail image (S310).

At this time, the broadcast video editing device 200 enlarges the design template selected by the user to a preset size, so that the user can reconfirm the design template, so that a design template that he likes can be finally selected. do.

At this time, when the selected design template is paid, the cloud-based graphic image integrated broadcasting system 100 provides a payment interface for the design template to the user through the broadcast image editing device 200 in real time to provide the corresponding design template. So that you can pay for it right away.

When the payment is completed, the cloud-based graphic video integrated broadcasting system 100 duplicates the design template and stores it in the user's cloud account, so that the design template can be repeatedly used.

Next, the broadcast image editing device 200 may edit graphics including subtitles, texts, figures, graphs, etc. in the thumbnail image by loading the finally selected design template into the editing window (S330). To be.

Next, the broadcast image editing device 200 overlays a graphic on the thumbnail image using the loaded design template, and allows the property of the overlaid graphic to be edited (S340).

Here, the property of the graphic means the position, size, color, transparency, text, duration, in-out, etc. of the graphic overlaid on the thumbnail image, and the broadcast image editing device 200 By providing a function to edit the properties of the graphic, it is possible to edit the desired size, color, and transparency of the graphic at various locations of the thumbnail image.

Next, when the editing is completed (S350), the broadcast image editing device 200 transmits the editing information thereto to the cloud-based graphic image integrated broadcasting system 100 (S360), and the cloud-based graphic image It is possible to perform graphic overlay on an actual broadcast image through the integrated broadcast system 100.

Meanwhile, the broadcast image editing device 200 may transmit the edited thumbnail image to the cloud-based graphic image integrated broadcasting system 100 instead of the editing information, and the cloud-based graphic image integrated broadcasting system 100 ), it may be implemented to perform the graphic overlay by extracting editing information from the thumbnail image as described above.

As described above, in the cloud-based integrated graphic image broadcasting system according to an embodiment of the present invention, a graphic image including a thumbnail image and a caption, image, text, figure, graphic, or a combination of a specific broadcast image By providing a design template, allowing the thumbnail image to be edited on a broadcast image editing device by using the design template, and editing the actual broadcast image on the cloud based on the editing information for the edit. , There is an effect of minimizing network traffic between a device for editing a broadcast image and a cloud-based graphic image integrated broadcasting system, and allowing a user to conveniently perform the editing without having a separate graphic device or professional manpower.

In the above, the preferred embodiment according to the present invention has been described above, but the technical idea of the present invention is not limited thereto, and each component of the present invention is changed or modified within the technical scope of the present invention in order to achieve the same object and effect. Can be.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. Various modifications may be possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

100: Cloud-based graphic video integrated broadcasting system
110: broadcast image receiving unit 120: thumbnail image providing unit
130: learning model generation unit for design template recommendation 140: design template providing unit
150: editing information receiving unit 160: graphic overlay unit
170: broadcast video transmission unit 180: user cloud account management unit
200: broadcast image editing device 210: user interface unit
220: broadcast image providing unit 230: thumbnail image receiving unit
240: design template receiving unit 250: thumbnail image editing unit
260: editing information providing unit 300: viewer terminal
400: Database 500: Internet Broadcasting Platform

Claims (10)

In the cloud-based graphic video integrated broadcasting system,
To perform editing for overlaying graphics including subtitles, texts, figures, images, graphs, or a combination thereof on a specific broadcast video, the cloud-based graphic video integrated broadcast system generates a thumbnail image for the broadcast video A thumbnail image providing unit for providing a device for editing broadcast images;
A design template providing unit that provides at least one design template for the graphic to the broadcast video editing device;
An editing information receiving unit configured to receive the edited editing information by applying the design template to the thumbnail image of the broadcast image from the broadcast image editing device; And
Includes; a graphic overlay unit for editing the broadcast image based on the received edit information,
Editing performed in the broadcast image editing device is performed based on the thumbnail image of the specific broadcast image using the design template,
The editing of the specific broadcasting image performed by the graphic overlay unit is performed based on the original for the specific broadcasting image, and is performed by overlaying the graphic on the specific broadcasting image based on the received editing information. ,
The editing information includes a graphic overlaying the original broadcast image at a reduced ratio on the thumbnail image reduced to a preset size using the design template, a position, a size, and color (RGB) at which the graphic is overlaid, Transparency (alpha, A), font, duration, effect information, or a combination thereof,
When the broadcast image editing device applies the design template to the thumbnail image for the broadcast image and transmits the edited editing information to the graphic image integrated broadcasting system, the received editing by the graphic image integrated broadcasting system A cloud-based graphic video integrated broadcast system, characterized in that the broadcast video is edited in real time based on information. delete delete The method according to claim 1,
The cloud-based graphic image integrated broadcasting system,
At least one design template is provided to a specific user by learning the mapping relationship between taste information including the type of broadcast video collected from a plurality of users, a preferred design style for each graphic, and effect effect, and the design template used by each user. Further comprising; a design template recommendation learning model generation unit that generates a design template recommendation learning model for each graphic for recommendation,
The learning model for recommending a design template is a cloud-based learning model, characterized in that it is learned to output a design template selected by the most users according to user preference information or a design template used in a broadcast image with a number of viewers equal to or greater than a preset value Graphic video integrated broadcasting system. The method of claim 4,
The cloud-based graphic video integrated broadcasting system,
A broadcast video output unit for streaming and transmitting the edited broadcast video through a preset broadcast channel; and
The design template providing unit,
A design having a probability value equal to or greater than a preset threshold among at least one design template output from the learning model for recommending each design template by applying taste information for each graphic for a specific user to the generated design template recommendation learning model A cloud-based integrated graphic video broadcasting system comprising: selecting a template and recommending it to the device for editing broadcast video. In a cloud-based broadcasting image editing device for editing a specific broadcasting image through a cloud-based graphic image integrated broadcasting system,
A thumbnail image receiver configured to receive a thumbnail image for a corresponding broadcast image from the cloud-based graphic image integrated broadcasting system;
A design template receiving unit for receiving at least one design template for overlaying a graphic including a subtitle, text, figure, image, graph, or a combination thereof on the thumbnail image from the cloud-based graphic image integrated broadcasting system; And
A thumbnail image editing unit that edits the thumbnail image using the received design template; And
Including; an editing information providing unit for providing the editing information by editing the thumbnail image to the cloud-based graphic image integrated broadcasting system,
Editing performed in the broadcast image editing device is performed based on the thumbnail image of the specific broadcast image using the design template,
The editing of the specific broadcast image is performed in the cloud-based graphic image integrated broadcasting system based on the original for the specific broadcast image, and is performed by overlaying the graphic on the specific broadcast image based on the editing information. Will,
Broadcasting, characterized in that by providing the editing information obtained by editing the thumbnail image to the cloud-based graphic image integrated broadcasting system, the actual editing of the corresponding broadcasting image is automatically performed by the cloud-based graphic image integrated broadcasting system. Device for video editing. The method of claim 6,
The thumbnail image editing unit,
When editing the graphic overlaid at the reduced ratio on the thumbnail image reduced to a preset size by using the received design template, overlaying the graphic at the reduced ratio in the thumbnail image A device for editing broadcast video, characterized in that it enables editing including position, size, color, transparency, text, effect time, and in-out for a graphic. To perform editing for overlaying graphics including subtitles, texts, figures, images, graphs, or combinations thereof on a specific broadcast video, in the cloud-based graphic video integrated broadcast system, a thumbnail image for the broadcast video is generated and broadcast video Providing a thumbnail image provided to an editing device;
A design template providing step of providing at least one design template for the graphic to the broadcast image editing device in the cloud-based graphic image integrated broadcasting system;
Editing the thumbnail image using the provided design template by the broadcast image editing device, and then transmitting the editing information to the cloud-based graphic image integrated broadcasting system; And
In the cloud-based graphic image integrated broadcasting system, a graphic overlay step of overlaying the graphic on the specific broadcast image using the received edit information; includes,
Editing performed in the broadcast image editing device is performed based on the thumbnail image of the specific broadcast image using the design template,
The editing of the specific broadcasting image performed by the graphic overlay unit is performed based on the original for the specific broadcasting image, and is performed by overlaying the graphic on the specific broadcasting image based on the received editing information,
The editing information includes a graphic overlaying the original broadcast image at a reduced ratio on the thumbnail image reduced to a preset size using the design template, a position, a size, and color (RGB) at which the graphic is overlaid, Transparency (alpha, A), font, duration, effect information, or a combination thereof,
When the broadcast image editing device applies the design template to the thumbnail image of the broadcast image and transmits the edited editing information to the graphic image integrated broadcasting system, the received editing by the graphic image integrated broadcasting system Broadcast image editing method through a cloud-based graphic image integrated broadcasting system, characterized in that the broadcasting image is edited in real time based on information. The method of claim 8,
The broadcast video editing method,
At least one design template is recommended to a specific user by learning the mapping relationship between the broadcasting image types collected from a plurality of users, preference information including the preferred design style and effect effect for each graphic, and the design template used by each user. Further comprising; a design template recommendation learning model generation step of each generating a learning model for design template recommendation for each graphic in order to do so,
The learning model for recommending a design template is a cloud-based graphic, characterized in that it is learned to output a design template selected by the most users according to user preference information or a design template used in a broadcast image with a number of viewers equal to or greater than a preset value. Broadcast video editing method through video integrated broadcasting system. The method of claim 9,
The broadcast video editing method,
A broadcast video output step of streaming and transmitting the edited broadcast video to a preset broadcast channel; further comprising,
The step of providing the design template,
A design having a probability value equal to or greater than a preset threshold among at least one design template output from the learning model for recommending each design template by applying taste information for each graphic for a specific user to the generated design template recommendation learning model A method for editing a broadcast video through a cloud-based graphic video integrated broadcast system, comprising: selecting a template and recommending it to the broadcast video editing device.

Images