KR102040723B1 - Method and apparatus for transmiting multiple video - Google Patents

Abstract

The present invention relates to a multiple broadcast transmission method and apparatus, and the multiple broadcast transmission method according to an embodiment of the present invention is a method for transmitting multiple broadcasts in a device including a display unit and a processor, and includes a plurality of captured images. Requesting streaming, displaying a plurality of image windows displaying each of the plurality of captured images in response to the request through a display unit, receiving a selection of at least one viewer providing image of the plurality of captured images; Displaying the selected at least one viewer providing image on the transmission video window, receiving a control signal for the at least one viewer providing image displayed on the transmission video window, and at least one displayed on the transmission video window corresponding to the control signal. Fluctuation of the viewer-provided image of the, and transmits from the plurality of captured images By providing an interface that can control the video, the broadcast producer has an effect that can easily produce a plural broadcast for a plurality of videos.

Description

METHOD AND APPARATUS FOR TRANSMITING MULTIPLE VIDEO}

The present invention relates to a multiple broadcast transmission method and apparatus, and more particularly, to a multiple broadcast transmission method and apparatus for selecting an image to be transmitted from among a plurality of images photographed in another space and controlling the selected image to provide to a viewer. will be.

In the case of shooting a broadcast video in a plurality of places, in contrast to the conventional need for expensive professional equipment, such as a field relay car for transmitting a broadcast video with a large number of professional personnel, recently, the camera is embedded in the processing terminal for everyday use It is possible to shoot and transmit broadcast video through the processing terminal. In addition, the development of robots and drones equipped with cameras has made automation of photography possible.

Accordingly, there is a need for a platform that makes it easier for non-broadcasting professionals to produce broadcasts and to edit and transmit images shot in multiple locations without additional personnel even in one-person media broadcasts. It is becoming.

[Related Technical Documents]

Web camera for personal broadcasting, and a method of providing personal broadcasting service in the Internet device accordingly (registered patent 10-0887899)

In a single broadcasting environment, a single broadcasting content that may utilize a plurality of images photographed in another space may be produced. In this case, the plurality of images are captured by an automated photographing device such as a robot or drone equipped with a camera. However, there are limitations of environment and limitations in controlling a plurality of images while one person broadcasts. Accordingly, there is a need for a method in which a single broadcast content producer can more easily control multiple broadcasts, and the inventor of the present invention devises an invention in which a single broadcast content producer can control and produce multiple broadcasts. It was.

Accordingly, the problem to be solved by the present invention is to provide an interface that can control the image to be transmitted among a plurality of captured images, the broadcast producer can easily produce a multi-way broadcast for a plurality of images, To provide a device.

Another problem to be solved by the present invention is to transmit a control instruction for the image to be sent to the photographing device in real time, so that the broadcast producer can easily shoot other places different from the broadcast progress place while performing the broadcast without shooting directly It is to provide a broadcast transmission method and apparatus.

The objects of the present invention are not limited to the above-mentioned objects, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to solve the above-mentioned problems, the multiple broadcast transmission method according to an embodiment of the present invention is a method for transmitting multiple broadcasts in a device including a display unit and a processor, the plurality of captured images from a plurality of broadcast recording devices Receiving a selection, displaying a plurality of image windows displaying each of a plurality of captured images through a display unit, receiving a selection of at least one viewer providing image among the plurality of captured images, and at least one viewer selected Displaying the providing image on the transmitting video window, receiving a control signal for the at least one viewer providing image displayed on the transmitting video window, and at least one viewer providing image displayed on the transmitting video window corresponding to the control signal. Fluctuation.

According to another feature of the present invention, the plurality of captured images may include at least one of an image of a broadcast producer, an image captured by an unmanned photographing apparatus, or a viewer captured image.

According to another feature of the present invention, the multiple broadcast transmission method further includes transmitting an instruction corresponding to a control signal to the unmanned photographing apparatus when the at least one viewer providing image is captured by the unmanned photographing apparatus.

According to another feature of the present invention, the plurality of captured images may be images of a plurality of broadcast producers and images captured by an unmanned photographing device controlled by the plurality of broadcast producers.

According to another feature of the present invention, the multiple broadcast transmission method may further include transmitting an image to be provided to a viewer in response to a request of at least one broadcast producer from among a plurality of broadcast producers.

According to another feature of the present invention, the step of receiving the control signal may be a step of receiving a control signal varying at least one of a size or a viewpoint with respect to the at least one viewer-provided image displayed on the transmission video window.

According to another feature of the present invention, the multiple broadcast transmission method may further include receiving a control signal for a captured image different from at least one viewer providing image among a plurality of captured images.

According to another feature of the present invention, the multiple broadcast transmission method may further include displaying a control element in an overlay form on the plurality of video windows.

According to another feature of the invention, the step of receiving the control signal may be a step of receiving the control signal to the touch input device or the pointing input device through the control element.

According to another feature of the present invention, the multiple broadcast transmission method may further include displaying a control window for receiving a control signal through a display unit.

According to another feature of the present invention, the step of receiving the control signal through the control window may be a step of receiving a control signal including text.

According to still another aspect of the present invention, the multiple broadcast transmission method further includes a step of processing a natural language of text, and the step of varying a plurality of displayed images displayed comprises: a plurality of captured images displayed on a transmission image window according to a natural language processing result. It may be a step of varying.

According to another feature of the invention, the multiple broadcast transmission method may further comprise the step of displaying the text input by the viewer.

In order to solve the above-mentioned problems, the multiple broadcast transmission device according to an embodiment of the present invention comprises a communication unit, a processor and a display unit, the processor, the processor, through the communication unit from a plurality of broadcast recording devices Receives a plurality of captured images, displays a plurality of video windows for displaying each of the plurality of captured images through the display unit, receives a selection of at least one viewer-provided image of the plurality of captured images through the communication unit, the display unit Displaying at least one viewer providing image selected through the display on the transmission video window, receiving a control signal for the at least one viewer providing image displayed on the transmission video window through the communication unit, and corresponding to the control signal to the transmission video window. And change the displayed at least one viewer providing image.

According to another feature of the present invention, the plurality of captured images includes at least one of an image of a broadcast director, an image captured by an unmanned photographing apparatus, or a viewer captured image.

According to another feature of the invention, when at least one viewer-provided image is captured by the unmanned photographing device, the processor is configured to transmit an instruction corresponding to the control signal to the unmanned photographing device through the communication unit.

According to another feature of the present disclosure, the processor may be configured to receive a control signal for a captured image different from at least one viewer providing image of the plurality of captured images through the communication unit.

Specific details of other embodiments are included in the detailed description and drawings.

The present invention provides an interface capable of controlling an image to be transmitted among a plurality of captured images, thereby providing a method and apparatus for transmitting a multi-way broadcast that enables a broadcast producer to easily produce a multi-way broadcast for a plurality of images. There is.

The present invention provides a method and apparatus for plural broadcasting transmission, which transmits a control instruction for an image to be transmitted to a photographing device in real time, so that a broadcast producer can easily photograph another place different from the broadcast progress place without performing a direct recording. There is an effect that can be provided.

The effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the present specification.

1 is a schematic diagram illustrating a relationship between a broadcast production device, a broadcast photographing device, a multiple broadcast providing device, and a broadcast viewing device according to an embodiment of the present invention.
2A is a block diagram illustrating a schematic configuration of a broadcast production apparatus according to an embodiment of the present invention.
2B is a block diagram illustrating a schematic configuration of a broadcast recording device according to an embodiment of the present invention.
2C is a block diagram illustrating a schematic configuration of an apparatus for providing a multi-way broadcast according to an embodiment of the present invention.
2D is a block diagram illustrating a schematic configuration of a broadcast viewing device according to an embodiment of the present invention.
3 is a flowchart illustrating a procedure of transmitting a plural broadcast generated by a broadcast producer to a viewer according to a method of transmitting a plural broadcast according to an embodiment of the present invention.
4A to 4E illustrate screens for controlling a plurality of captured images through control elements displayed in an overlay form on a plurality of image windows according to an embodiment of the present invention.
5 illustrates a screen for controlling a captured image different from an image to be provided to a viewer according to an embodiment of the present invention.
6 illustrates a screen for controlling a plurality of captured images in a control window for receiving a control signal according to another embodiment of the present invention.
FIG. 7 illustrates a screen for controlling a plurality of broadcast director images and images for a plurality of unmanned photographing apparatuses according to another exemplary embodiment of the present invention.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms. It is provided to fully convey the scope of the invention to those skilled in the art, and the present invention is defined only by the scope of the claims.

Shapes, sizes, ratios, angles, numbers, and the like disclosed in the drawings for describing the embodiments of the present invention are exemplary, and the present invention is not limited to the illustrated items. In addition, in describing the present invention, if it is determined that the detailed description of the related known technology may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. When 'comprises', 'haves', 'consists of' and the like mentioned in the present specification are used, other parts may be added unless 'only' is used. In case of singular reference, the plural number includes the plural unless specifically stated otherwise.

In interpreting a component, it is interpreted to include an error range even if there is no separate description.

Although the first, second, etc. are used to describe various components, these components are not limited by these terms. These terms are only used to distinguish one component from another. Therefore, the first component mentioned below may be a second component within the technical spirit of the present invention.

Like reference numerals refer to like elements throughout the specification unless otherwise specified.

Each of the features of the various embodiments of the present invention may be combined or combined with each other in part or in whole, various technically interlocking and driving as can be understood by those skilled in the art, each of the embodiments may be implemented independently of each other It may be possible to carry out together in an association.

1 is a schematic diagram illustrating a relationship between a broadcast production device, a broadcast photographing device, a multiple broadcast providing device, and a broadcast viewing device according to an embodiment of the present invention.

Referring to FIG. 1, the multiple broadcast transmission system 1000 is a system in which a broadcast producer controls an image photographed in various spaces and provides the viewer in various forms. In this case, the multi-way broadcast delivery system 1000 includes a broadcast production device 100, a broadcast photographing device 200, a multi-way broadcast providing device 300, and a broadcast viewing device 400.

The broadcast production device 100 is a device for producing a multiple broadcast for a broadcast producer to provide to a viewer. In detail, the broadcast production device 100 captures a broadcast producer through a mounted camera, controls an image captured by the broadcast producer, and images captured using the broadcast recording device 200, that is, a plurality of captured images. It is a device for producing a multi-way broadcast to provide to. The broadcast production device 100 includes various electronic devices. For example, the broadcast production device 100 may be a desktop including a webcam, a notebook, a smartphone, a tablet PC, etc. in which a camera is embedded, but is not limited thereto.

The broadcast photographing device 200 is a device for capturing an image different from an image photographing a broadcast producer. That is, the broadcast photographing device 200 captures an image of a space where the broadcast producer is not located. For example, the broadcast photographing device 200 captures an image of another space that is difficult for a broadcast producer to simultaneously capture a video of a broadcast producer, such as a fair, a meeting site, and a conference room. Therefore, the broadcast photographing device 200 may be an unmanned photographing device or a terminal of a broadcast production participant who is not a broadcast producer. The unmanned photographing device may be a robot equipped with a camera, a drone equipped with a camera, or the like, but is not limited thereto. In addition, the terminal of the broadcast production participant may be a smartphone, a tablet PC, etc., but is not limited thereto.

The plural broadcast providing device 300 is a device for processing and providing data necessary for plural broadcasting production. Device Broadcast Production Device Specifically, the multi-way broadcast providing device 300 provides a viewer with a multi-way broadcast produced by the broadcast production device 100. In this case, the multi-way broadcast providing device 300 may transmit the image photographed by the broadcast photographing device 200 to the broadcast production device 100. Accordingly, the multi-way broadcast providing device 300 may communicate with the broadcast production device 100, the broadcast recording device 200, and the broadcast viewing device 400. For example, as illustrated in FIG. 1, the apparatus for providing multiple broadcasts 300 may be connected to the broadcast production device 100, the broadcast recording device 200, and the broadcast viewing device 400 by a network. Here, the apparatus for providing a multi-way broadcast 300 may be a co-location server, a cloud device, or the like, but is not limited thereto.

The broadcast viewing device 400 is a device for broadcast viewers, and is a device for watching multiple broadcasts. That is, the broadcast viewing device 400 receives a multi-way broadcast produced by the broadcast production device 100 from the multi-way broadcast providing device 300. In this case, the broadcast viewing device 400 may be a desktop, a laptop, a tablet PC or a smartphone, but is not limited thereto.

In FIG. 1, for convenience of description, the broadcast production device 100 and the multiple broadcast providing device 300 are illustrated as one, but the present invention is not limited thereto, and a plurality of broadcast production devices and a plurality of multiple broadcast providing devices may exist. .

Hereinafter, a description will be given of a broadcast production device and a user interface implemented in a broadcast production device provided to a broadcast producer producing a multi-way broadcast. The plural broadcasting may be a format in which the controlled captured image is provided to the viewer by controlling the plurality of captured images captured by the plurality of photographing apparatuses. By controlling a plurality of captured images and providing them in multiple broadcasts, viewers can simultaneously view not only images of broadcast producers photographed in a single broadcast environment but also images captured elsewhere. In providing such multiple broadcasts, how to easily control a plurality of photographed images taken by a plurality of photographing apparatuses and what user experience may be very important. Controlled captured images, that is, multiple broadcasts, are commonly displayed on the broadcaster and the viewer's user interface.

2A is a block diagram illustrating a schematic configuration of a broadcast production apparatus according to an embodiment of the present invention. For convenience of explanation, it will be described with reference to FIG. 1.

Referring to FIG. 2A, the broadcast production device 100 includes a communication unit 110, a photographing unit 120, a processor 130, and a display unit 140.

The communication unit 110 of the broadcast production device 100 receives and transmits data necessary for plural broadcasting. In detail, the communication unit 110 receives a plurality of captured images captured by the broadcast photographing device 200. In this case, the communicator 110 may receive a plurality of captured images captured by the broadcast photographing apparatus 200 directly from the broadcast photographing apparatus 200, and may be received through another server or may be provided through a plurality of broadcast providing apparatuses. It may be received through the (300).

In addition, the communicator 110 transmits the at least one viewer providing image selected from the plurality of captured images to the multiplex broadcast providing apparatus 300 to provide the viewer. In this case, the at least one viewer providing image may be at least one of a plurality of captured images captured by the broadcast photographing device 200 as well as an image for the broadcast producer, and may be a controlled image.

The photographing unit 120 of the broadcast production device 100 photographs the broadcast producer. That is, the photographing unit 120 captures an image of the broadcast producer. In this case, the image for the broadcast producer may be an image captured by the broadcast producer for explaining or guiding a captured image different from the image for the broadcast producer. The photographing unit 120 may be a camera built in the broadcast production device 100 or may be a camera mounted separately.

The input unit 130 of the broadcast production device 100 receives a selection of at least one viewer-provided image among a plurality of captured images and a control signal for the plurality of captured images. In this case, the input unit 130 may be a touch input device or a pointing input device.

The processor 140 of the broadcast production device 100 processes data necessary for multiple broadcast. In detail, the processor 140 configures the plural broadcast according to the selection of the at least one viewer-provided image among the plurality of captured images, and varies the plural broadcast in response to the received control signal.

The display unit 150 of the broadcast production device 100 displays a plurality of streamed captured images and at least one viewer providing image. Furthermore, the display unit 150 may display the control element in the form of an overlay on the control window for receiving the control signal and the plurality of image windows displaying the plurality of captured images.

2B is a block diagram illustrating a schematic configuration of a broadcast recording device according to an embodiment of the present invention.

Referring to FIG. 2B, the broadcast photographing device 200 includes a photographing unit 210 and a communication unit 220.

The photographing unit 210 of the broadcast photographing device 200 photographs an image to be provided to a viewer. At this time, the video being photographed is different from the video for the broadcast producer. Furthermore, the photographing unit 210 may photograph an image according to a control signal transmitted from the broadcast production device 100.

The communication unit 220 of the broadcast recording device 200 may receive a control signal from the broadcast production device 100. At this time, the received control signal is applied to the photographing unit 210. When the broadcast photographing device 200 is implemented as an unmanned photographing device, the broadcast photographing device 200 transmits a control signal to a body part for mounting a part for moving, such as a wheel or a motor, and a moving or photographing part 210. And a controller for controlling the motor or the photographing unit 210 accordingly.

2C is a block diagram illustrating a schematic configuration of an apparatus for providing a multi-way broadcast according to an embodiment of the present invention.

Referring to FIG. 2C, the multiplex broadcast providing device 300 includes a communication unit 310, a processor 320, and a storage unit 330.

The communication unit 310 of the plural broadcast providing device 300 may receive a captured image from the broadcast photographing device 200 according to a request of the broadcast production device 100. In addition, the communicator 310 may transmit at least one viewer providing image to the broadcast viewing device 400. In this case, the communication unit 310 may receive a control signal from the broadcast production device 100 and transmit the at least one viewer-provided image, which is changed in response to the received control signal, to the broadcast viewing device 400.

The processor 320 of the plural broadcast providing device 300 processes data necessary for plural broadcast. For example, the processor 320 may apply the received control signal to at least one viewer-provided image.

The storage unit 330 of the plural broadcast providing device 300 stores data necessary for plural broadcasting. In detail, the storage unit 330 stores a plurality of streamed captured images and at least one viewer providing image. Furthermore, the storage unit 330 may also store a control signal received from the broadcast production device 100.

2D is a block diagram illustrating a schematic configuration of a broadcast viewing device according to an embodiment of the present invention.

Referring to FIG. 2D, the broadcast viewing device 400 includes a display unit 410, an input unit 420, and a communication unit 430.

The display unit 410 of the broadcast viewing device 400 displays a selected image among a plurality of captured images. Here, the selected image is at least one viewer providing image selected from the plurality of captured images in the broadcast production device 100. In addition, the display unit 410 displays at least one viewer-provided image that is changed in response to the control signal.

The input unit 420 of the broadcast viewing device 400 may receive a comment on the displayed image and a control signal for the image. Thus, the input unit 420 may be a touch input device, a point input device, a keyboard, or the like.

The communication unit 430 of the broadcast viewing device 400 receives at least one viewer providing image. In addition, the communicator 430 may transmit the received comment on the displayed image to the multiplex broadcast providing device 300 to provide the broadcast production device 100. In addition, the communication unit 430 may transmit the control signal to the multiplex broadcast providing apparatus 300 to apply the control signal to the displayed image.

3 is a flowchart illustrating a procedure of transmitting a plural broadcast generated by a broadcast producer to a viewer according to a method of transmitting a plural broadcast according to an embodiment of the present invention. For convenience of description, the components of FIGS. 1 and 2A through 2D and the reference numerals will be described with reference to the accompanying drawings.

The communication unit 110 of the broadcast production device 100 receives a plurality of captured images from a plurality of broadcast recording devices (S310).

In detail, the communication unit 110 receives a plurality of captured images captured by the broadcast photographing device 200. In this case, the communication unit 110 may receive a plurality of captured images directly from the broadcast photographing device 200, and the server or multiple broadcast providing device 300 may display the plurality of captured images photographed from the broadcast photographing device 200. Can also be received via. The broadcast photographing device 200 may capture an image by being located in a place where the broadcast production device 100 is difficult to photograph, that is, in a different space from the broadcast production device 100. A plurality of broadcast photographing devices 200 exist, and each broadcast photographing device 200 may photograph each of a plurality of captured images. In addition, one broadcast photographing device 200 may capture a plurality of captured images having different viewpoints. Therefore, the received plurality of captured images may be at least one of an image captured by an unmanned photographing device or a viewer captured image. In this case, the photographing unit 120 of the broadcast production device 100 may capture an image of the broadcast producer.

Subsequently, the display unit 150 of the broadcast production device 100 displays a plurality of video windows displaying each of the plurality of captured images (S320).

That is, the display unit 150 displays a plurality of video windows including each of the plurality of captured images. In this case, the plurality of captured images may be an image of a broadcast producer photographed from the photographing unit 120 of the broadcast production device 100, or may be an image captured by an unmanned photographing device or an image captured by a viewer.

Subsequently, the input unit 130 of the broadcast production device 100 receives a selection for at least one viewer providing image from among the plurality of captured images (S330).

In this case, the input unit 130 may receive a selection input from a plurality of image windows displaying a plurality of captured images, or may receive a selection input from a control window for receiving a control signal. At this time, the number of images to be provided to the selected viewer is not limited.

Subsequently, the display unit 150 of the broadcast production device 100 displays the selected at least one viewer providing image on the transmission video window (S340).

That is, the display unit 150 displays at least one viewer providing image selected from the plurality of captured images in the transmission image window. The number of images displayed on the transmission video window is not limited. In this case, the display unit 150 may simultaneously display the transmission video window and the plurality of video windows.

Next, the input unit 130 of the broadcast production device 100 receives a control signal for at least one viewer-provided image displayed on the transmission video window (S350).

In detail, the input unit 130 receives a control signal that varies at least one of a size and a viewpoint with respect to the at least one viewer providing image displayed on the transmission video window. In this case, the input unit 130 may receive a control signal input to the control element displayed in the form of an overlay on the plurality of image windows. That is, the input unit 130 may receive a control signal that varies in size and viewpoint in the plurality of image windows. In this case, the input unit 130 may be a touch input device or a pointing input device and may receive a control signal through control elements displayed on the plurality of image windows. A description of the screen for changing the size or the viewpoint of the at least one viewer-provided image in the plurality of image windows will be described later with reference to FIGS. 4A to 4E. In addition, the input unit 130 may receive a control signal input to a control window displayed to receive a control signal. In this case, the input unit 130 may receive a control signal including a text or a selection for changing the size and the viewpoint. For example, when two images, the first image and the second image, are displayed in the transmission image window, the input unit 130 may receive a selection for an item such as 1: 1 ratio, 2: 1 ratio, or the like. It may also receive a text of 90 degree direction shooting of one image. At this time, the control signal including the text may be natural language processing. Therefore, the plurality of captured images displayed on the transmission image window may vary according to the natural language processing result.

Also, in another embodiment, the input unit 130 may receive a control signal for a captured image that is different from at least one viewer-provided image of the plurality of captured images. That is, the input unit 130 may receive a control signal for a captured image different from the image displayed on the transmission image window. In this case, a control signal for a captured image different from the image displayed in the transmission image window may be input through a control element displayed in the image window in which the different captured image is displayed. A screen for receiving a control signal for a captured image different from at least one viewer-provided image will be described later with reference to FIG. 5.

Meanwhile, in another embodiment, when at least one viewer-provided image is captured by the unmanned photographing device, the communication unit 110 transmits an instruction corresponding to the control signal to the unmanned photographing device. For example, when a control signal of a viewpoint change to shoot in a 90 degree direction is received through the input unit 130, the communication unit 110 transmits an instruction corresponding to the control signal of the viewpoint change to an unmanned photographing apparatus that captures the corresponding image. Can be. In addition, when a control signal for photographing in response to a movement of a specific person is received through the input unit 130, the communication unit 110 may transmit an instruction corresponding to the control signal to continue photographing the specific person to the unmanned photographing device.

Subsequently, the processor 140 of the broadcast production device 100 varies the at least one viewer providing image displayed on the transmission video window in response to the control signal (S360).

In detail, the processor 140 changes the at least one viewer-provided image displayed on the transmission video window in response to the control signal for the size or viewpoint change. At this time, the changed image is displayed on the transmission video window and transmitted to the broadcast viewing device 400.

In some embodiments, the display unit 150 may display text input by the viewer. Accordingly, the broadcast producer may control the video by grasping the opinion of the viewer.

According to various embodiments of the present disclosure, images of a plurality of broadcast producers and images captured by an unmanned imaging apparatus controlled by a plurality of broadcast producers may be displayed in the plurality of video windows. That is, the image of the broadcast producer and the captured image controlled by the broadcast producer may be one set image, and a plurality of set images may be displayed in the plurality of image windows, respectively. The transmission video window displays a video window currently being provided to the viewer. In this case, the communication unit 110 may transmit an image to be provided to the viewer in response to a request of at least one broadcast producer from among the broadcast producers. For example, when a video produced by broadcaster A is being broadcasted, broadcaster B may transmit a request for transmitting the video produced by broadcaster C, and the communication unit 110 provides the viewer in response to the request. You can send a video to play.

Accordingly, the broadcast production device 100 selects an image to be provided to the viewer among a plurality of captured images photographed by the unmanned photographing apparatus, and provides a user interface for changing the size or viewpoint of the selected image. Through this, broadcast producers can produce various types of broadcasts, and they can easily change the size and viewpoint of an image during broadcast.

4A to 4E illustrate screens for controlling a plurality of captured images through control elements displayed in an overlay form on a plurality of image windows according to an embodiment of the present invention.

Referring to FIG. 4A, the display unit 150 of the broadcast production device 100 displays a user interface screen for controlling a plurality of captured images. In this case, the user interface screen may include a first video window 510, a second video window 520, a third video window 530 and a fourth video window 540, a transmission video window 550, and a chat window 560. ) For example, the display unit 150 displays a first image, which is an image of a broadcast producer, on the first image window 510, and displays different views on the second image windows 520 to 540, respectively. The second to fourth images, which are soccer relay images, are displayed. In addition, the display unit 150 displays the third image and the first image, which are the transmission images, on the transmission image window 550. The third image and the first image displayed on the transmission video window 550 are images provided to the viewer. In this case, the size of the first image may be smaller than the size of the third image. Furthermore, the display unit 150 displays the viewer's chat window 560. The viewer's comment on the broadcast video is displayed on the viewer's chat window 560.

Referring to FIG. 4B, the input unit 130 of the broadcast production device 100 receives a selection signal for an image to be transmitted. In detail, the input unit 130 receives the selection signal 521 input to the second image window 520. In this case, the input unit 130 may be a touch input device and receive a touch signal. Accordingly, the display unit 150 displays the selected second image and the first image on the transmission video window 550 according to the selection signal 521.

Referring to FIG. 4C, the input unit 130 of the broadcast production device 100 receives a first viewpoint change signal 522 for an image being transmitted. The first viewpoint change signal 522 is a drag signal for changing the viewpoint input from the video window. In detail, the input unit 130 receives the first viewpoint change signal 522 input to the second image window 520. In this case, the first viewpoint change signal 522 may be a viewpoint change signal to the left. Therefore, the display unit 150 displays the second image changed to the left view in response to the first view change signal 522 on the transmission image window 550.

Referring to FIG. 4D, the input unit 130 of the broadcast production device 100 receives a second viewpoint change signal 523 for an image being transmitted. The second viewpoint change signal is a viewpoint change signal received from a control element displayed in an overlay form on the second video window 520. In detail, the input unit 130 receives the second viewpoint change signal 523 input to the viewpoint change control element displayed on the second image window 520. In this case, the second viewpoint change signal 523 may be a viewpoint change signal zooming out backward. Therefore, the display unit 150 displays the second image changed to the point of time zoomed out according to the second time change signal 523 on the transmission video window 550.

Referring to FIG. 4E, the input unit 130 of the broadcast production device 100 receives a magnitude change signal 524 for an image being transmitted. The magnitude change signal is a signal for varying the magnitude of at least one of the plurality of images being transmitted. In detail, the input unit 130 receives the magnitude change signal 524 for the second image from the transmission image window 550. In this case, the magnitude change signal 524 may be a signal for enlarging the size of the second image. Accordingly, the display unit 150 displays the second image whose size is enlarged according to the size change signal 524 on the transmission image window 550.

Accordingly, the broadcast production device 100 selects an image to be transmitted from a provided user interface, and changes a size and a viewpoint so that the broadcast producer can easily manipulate the image even while broadcasting.

5 illustrates a screen for controlling a captured image different from an image to be provided to a viewer according to an embodiment of the present invention.

Referring to FIG. 5, the display unit 150 of the broadcast production device 100 displays a first image, which is an image of a broadcast producer, on the first video window 510, and displays the second video window 520 to the fourth video. In the window 540, the second to fourth images, which are the exhibition site relay images of different viewpoints, are displayed. In addition, the display unit 150 displays the second image and the first image, which are the transmission images, on the transmission image window 550. At this time, the input unit 130 may receive a control signal for the third image and the fourth image different from the image being transmitted. In detail, the input unit 130 may receive the third viewpoint change signal 531 to the right in the third image window 530. Furthermore, the input unit 130 may receive the photographing person selection signal 532 in the third image window 530. Here, the photographing person selection signal 532 is a signal that the broadcast photographing device 200 implemented as the unmanned photographing device selects for a specific person to be photographed continuously. Therefore, the broadcast photographing device 200 may photograph a person corresponding to the photographing person selection signal 532, and may photograph while moving along the moving line of the person. In addition, the input unit 130 receives a fourth viewpoint change signal 541 that is zoomed in from a control element displayed in the form of an overlay on the fourth image window 540. Therefore, the display unit 150 may display the third image having the viewpoint changed to the right in the third image window 530 according to the third viewpoint change signal 531. In addition, the display unit 150 may display a fourth image zoomed in according to the fourth viewpoint change signal 441. At this time, the third image and the fourth image whose viewpoints are changed are not transmitted until the selection signal is received.

Accordingly, the broadcast production device 100 receives and applies a control signal for an image different from the image being transmitted to the image, so that the broadcast producer controls the image different from the image being transmitted even while the image is being transmitted, thereby preliminarily Be prepared to send.

6 illustrates a screen for controlling a plurality of captured images in a control window for receiving a control signal according to another embodiment of the present invention.

Referring to FIG. 6, the display unit 150 of the broadcast production device 100 displays a user interface screen including a control window for controlling a plurality of captured images. Accordingly, the user interface screen includes the first video window 510, the second video window 520, the third video window 530, and the fourth video window 540, the transmission video window 550, and the chat window 560. And a control window 570. At this time, the control window 570 includes a selection for the image to be transmitted and a transmission control input item. For example, the input unit 130 may receive a transmission selection 571 for the first image displayed on the first image window 510 and the second image displayed on the second image window 520. In addition, the input unit 130 may receive the transmission control 572 as text. For example, when the input unit 130 receives a transmission control 572 called transmission in a 1: 1 size, natural language processing may be performed to change the size of the first image and the second image by 1: 1. In addition, when the input unit 130 receives the transmission control 572 called the second image zoom-out, natural language processing may be performed to zoom out and transmit the second image. At this time, the image to which the transmission control 572 is applied is displayed on the transmission video window 550. In addition, the fourth image displayed on the fourth image window 540 may be an image captured by the viewer.

Accordingly, the broadcast production device 100 provides a control window for the user to select the transmission image as a click signal and control the image by text, so that the user can control the image to be transmitted more accurately and easily. do.

FIG. 7 illustrates a screen for controlling a plurality of broadcast director images and images for a plurality of unmanned photographing apparatuses according to another exemplary embodiment of the present invention.

Referring to FIG. 7, the display unit 150 of the broadcast production device 100 includes a first video window 510 to a fourth video window including an image of a broadcast producer and an image of an assembly site controlled by the broadcast producer. 540 is displayed. That is, each of the first video window 510 to the fourth video window 540 includes an image of a different broadcast producer and an image of an assembly site controlled by the corresponding broadcast producer. For example, when the first image is displayed on the transmission image window 550, the first image is transmitted. Broadcast producers may request the transmission of a different image from the image being transmitted. For example, the OOO broadcast producer may request the transmission of the third image. At this time, the display unit 150 may display a text on the transmission status in the chat window 560. In detail, the display unit 150 may display a chat window 560 including information on an image requested to be transmitted and an estimated time of transmission. In addition, the display unit 150 may also display information on the shooting schedule image of the broadcast producer. The authority for the transmitted video may be owned by a specific broadcast producer or may be owned by a plurality of broadcast producers.

Accordingly, the broadcast production device 100 requests transmission so that a plurality of broadcast producers can jointly produce a broadcast, and provides an interface for displaying a broadcast scheduled situation, thereby providing a single broadcast content in which a plurality of broadcast producers participate. Make it easy to manufacture.

In this specification, each block or each step may represent a portion of a module, segment or code containing one or more executable instructions for executing a specified logical function (s). It should also be noted that in some alternative embodiments the functions noted in the blocks or steps may occur out of order. For example, the two blocks or steps shown in succession may in fact be executed substantially concurrently or the blocks or steps may sometimes be performed in the reverse order, depending on the functionality involved.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be implemented directly in hardware, a software module or a combination of the two executed by a processor. The software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM or any other form of storage medium known in the art. An example storage medium is coupled to the processor, which can read information from and write information to the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside within an application specific integrated circuit (ASIC). The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.

Although the embodiments of the present invention have been described in more detail with reference to the accompanying drawings, the present invention is not necessarily limited to these embodiments, and various modifications can be made without departing from the spirit of the present invention. . Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

100: broadcast production device
110: communication unit
120: the photographing unit
130: input unit
140: processor
150: display unit
200: broadcast recording device
210: photographing unit
220: communication unit
300: a multi-way broadcast providing device
310: communication unit
320: processor
330: storage unit
400: broadcast viewing device
410: display unit
420: input unit
430: communication unit
510: first video window
520: the second video window
521: selection signal
522: the first viewpoint change signal
523: the second viewpoint change signal
524: magnitude change signal
530: third image window
531: third viewpoint change signal
540: fourth video window
541: fourth viewpoint change signal
550: transmission video window
560: chat window
570: control window
571: Outgoing selection
572: outgoing control
1000: multi-way broadcasting system

Claims (17)

In the method for transmitting a multiple broadcast in a device including a display unit and a processor,
A broadcaster receives a video of the broadcaster who photographed the broadcaster from a broadcaster for a one-man media broadcast that appears on a broadcast screen simultaneously with the broadcaster, and is controlled by the broadcaster and equipped with a camera. And receiving a plurality of captured images having different viewpoints photographed through any one of the robot and the drone from any one of the drones.
Displaying a plurality of image windows displaying the images of the broadcast producer and the plurality of captured images through the display unit;
Receiving a selection of an image for the broadcast producer and at least one viewer providing image among the plurality of captured images;
Displaying the selected at least one viewer providing image on a transmission video window;
Receiving a control signal for the at least one viewer providing image displayed on the transmission video window;
Changing the at least one viewer providing image displayed on the transmission video window in response to the control signal;
Receiving a photographing person selection signal for selecting a person to be photographed in at least one of the plurality of image windows; And
Receiving, from one of the robot and the drone, a person image of the person while the one of the robot and the drone continues to move according to the movement line of the person in response to the photographing person selection signal; And
And displaying the at least one image window displaying the received person image through the display unit. The method of claim 1,
And receiving a viewer-captured image captured by the broadcast viewer. The method of claim 1,
When the at least one viewer providing image is photographed by any one of the robot and the drone,
And transmitting an instruction corresponding to the control signal to any one of the robot and the drone. delete delete The method of claim 1,
Receiving the control signal,
And receiving the control signal varying at least one of a size and a viewpoint with respect to the at least one viewer-provided image displayed on the transmission video window. The method of claim 1,
And receiving the control signal for a captured image different from the at least one viewer providing image among the plurality of captured images. The method of claim 1,
And displaying a control element in an overlay form on the plurality of video windows. The method of claim 8,
Receiving the control signal,
Receiving the control signal through a control element to a touch input device or a pointing input device. The method of claim 1,
And displaying a control window for receiving the control signal through the display unit. The method of claim 10,
Receiving the control signal through the control window,
And receiving the control signal including text. The method of claim 11,
Natural language processing the text;
The changing of the plurality of shot images displayed may include:
And varying the plurality of captured images displayed on the transmission video window according to a natural language processing result. The method of claim 1,
And displaying the text input by the viewer. In the multiple broadcast transmitting device comprising a communication unit, a processor and a display unit,
The processor,
Receive an image of the broadcast producer photographing the broadcast producer from the broadcast production device through the communication unit,
Receive a plurality of captured images having different viewpoints, which are controlled by the broadcast producer and have been photographed through any one of the robot and the drone from any one of the robot and drone equipped with a camera,
Displaying through the display unit a plurality of image windows displaying images of the broadcast producer and the plurality of captured images,
Receive a selection of the image for the broadcast producer and the at least one viewer providing image of the plurality of captured images through the communication unit,
Displaying the at least one viewer providing image selected through the display unit on a transmission video window,
Receives a control signal for the at least one viewer providing image displayed on the transmission video window through the communication unit,
Varying the at least one viewer providing image displayed on the transmission video window in response to the control signal;
Receiving a photographing person selection signal for selecting a person to be photographed in at least one of the plurality of image windows;
Receiving a person image of the person while the one of the robot and the drone continues to move according to the movement line of the person in response to the photographing person selection signal from one of the robot and the drone,
And display the at least one video window displaying the received person image through the display unit. The method of claim 14, wherein the processor,
A multiple broadcast transmission device that receives a viewer photographed image photographed by a broadcast viewer. The method of claim 15,
When the at least one viewer providing image is photographed by any one of the robot and the drone,
The processor,
And transmitting an instruction corresponding to the control signal to any one of the robot and the drone through the communication unit. delete

Images