KR102184339B1 - Real-time Broadcasting Content Delivery System and Method Based on Hologram - Google Patents

Abstract

The present invention provides a hologram-based real-time broadcasting content providing system and method for transmitting holographic content in real time using a floating hologram technology and receiving a feedback image of the viewer in real time, so that the reaction of the viewer can be checked in real time. It is characterized in that the control to transmit a feedback signal photographed by the photographing unit of the viewing system to the display unit and the broadcasting speaker of the broadcasting system.

Description

Real-time Broadcasting Content Delivery System and Method Based on Hologram}

The present invention relates to a system and method for providing real-time broadcasting contents based on hologram, and more particularly, by using a floating hologram technology to transmit holographic contents in real time and to receive a feedback image of the viewer in real time, the reaction of the viewer It provides a hologram-based real-time broadcasting content providing system and method for checking in real time.

In general, a 3D stereoscopic video service is a service that provides a sense of distance, a sense of depth, and a sense of presence of objects appearing in an image, unlike a 2D video that provides a simple two-dimensional scene, and is attracting attention as a favorite of next-generation information and communication services. The 3D stereoscopic video service technology has a wide variety of application fields such as information and communication, broadcasting, medical care, education and training, military, game, animation, virtual reality, CAD, and industrial technology. have.

3D stereoscopic video can be classified into binocular, multi-view, IP (Integral Photography), omni, panorama, multi-view, and hologram, depending on the expression method. Holographic video includes not only light intensity but also phase information. It is the most ideal three-dimensional visual system that can accurately reproduce the three-dimensional three-dimensional image in space. Therefore, the final goal of 3D stereoscopic video processing technology is a hologram service of complete stereoscopic vision, and this technology has been recognized as the ultimate video information communication service. Currently, the development of 3D broadcasting technology using digital holography is underway.

In order to implement such a holography technology, more than thousands of spatial light modulators (SLMs) that convert light into an information signal by putting light into space are required, and a display device of ultra high resolution is required to create a real-time holographic image. In addition, there is a need for a spatial light modulator (SLM) and an ultra-high-performance processor for processing data input/output to a display device. Due to such difficulties, as an alternative technology for implementing a hologram, a technology for implementing a floating hologram image is in the spotlight. The floating hologram technology reflects an image output from a specific display device with a half mirror, so that the output image is displayed together with a background image.

Meanwhile, due to the expansion and spread of the Internet, it has become possible to carry out various tasks while always carrying a smart phone, and various businesses using this environment are emerging. For example, many media contents are produced on the Internet, and users can view these media contents using a smartphone. In addition, due to the development of technology, in the case of Internet broadcasting, not only recorded broadcasting but also live broadcasting are relayed to users. However, in the case of such media content, since it is produced as a general 2D video, there is a problem of reducing the interest of the user in half.

Korean Patent Publication No. 10-2019-0009661 Korean Patent Publication No. 10-2017-0057713 Korean Patent Publication No. 10-2018-0017821

An object of the present invention for solving the problems of the prior art as described above is to transmit holographic content in real time using a floating hologram technology and to receive a feedback image of the viewer in real time, so that the reaction of the viewer can be checked in real time. It is to provide a hologram-based real-time broadcasting content providing system and method.

In order to achieve the above object, the present invention is to generate sound information from a studio in which an object is located, a plurality of broadcasting cameras arranged in the studio to photograph the object from different angles, and sound generated in the studio. A broadcasting microphone, a display unit disposed in the studio and displaying an image in the direction of the object, a broadcasting speaker disposed in the studio and outputting sound in the direction of the object, image information photographed by the broadcasting camera, and the broadcasting microphone A broadcasting system having a broadcasting communication unit that transmits the sound information generated by the device to the outside; And a viewing communication unit that is connected to the broadcasting communication unit through wireless communication or wired communication and receives image information and sound information from the broadcasting communication unit, a hologram body having a projection space therein, and the projection space inside the hologram body. A plurality of projection units that are arranged to face and are formed to be inclined, and an image output for projecting a holographic image onto the projection space by irradiating image information in the direction of each of the projection units while being positioned above or below the hologram body A viewing unit having a viewer, a viewing speaker that outputs sound information to the outside while positioned in the hologram body, and a photographing unit that photographs a viewer viewing a holographic image while being positioned outside the hologram body and generates a feedback signal A system, wherein the viewing control unit of the viewing system controls to transmit a feedback signal photographed by the photographing unit to the broadcasting communication unit through the viewing communication unit, and the broadcasting control unit of the broadcasting system receives a feedback signal received by the broadcasting communication unit. It provides a hologram-based real-time broadcasting content providing system, characterized in that the control is transmitted to the display unit and the broadcasting speaker.

In addition, the image information photographed by the broadcasting camera includes an object image photographing an object located inside the studio, and a background image photographing a background image located inside the border of the studio, and the broadcasting system, A background removal unit for generating an object image by removing a background image from the image information captured by the broadcasting camera, wherein the broadcast control unit transmits the object image generated by the background removal unit to the viewing and communication unit as image information. It provides a hologram-based real-time broadcasting content providing system, characterized in that the transmission is controlled.

In addition, the studio includes a first face portion, a second face portion positioned opposite to the first face portion, a third face portion positioned on one side between the first face portion and the second face portion, and the first face portion and the second face portion Including a fourth surface portion positioned on the other side between the object, the object is disposed in a space formed between the first to the fourth surface portion, the broadcast camera, a first broadcast camera disposed on the first surface portion, A hologram-based real-time broadcast content providing system comprising a second broadcast camera disposed on the second side, a third broadcast camera disposed on the third side, and a fourth broadcast camera disposed on the fourth side. Provides.

In addition, a first hole is formed through the center of the first surface portion, a second hole is formed through the center of the second surface portion, and a third hole is formed through the center of the third surface portion, and the fourth A fourth hole is formed through the center of the surface portion, the first broadcasting camera is positioned outside the first surface portion, and is configured to photograph the front surface of the object through the first hole, and the second broadcasting camera It is located on the outside of the second surface and is configured to photograph the rear surface of the object through the second hole, and the third broadcasting camera is located outside the third surface and to photograph the left surface of the object through the third hole. And the fourth broadcast camera is positioned outside the fourth surface portion and is configured to photograph a right side of the object through the fourth hole. A hologram-based real-time broadcast content providing system is provided.

In addition, the hologram body includes a first plate and a second plate fixed in a state spaced apart from the first plate, wherein the projection space is provided between the first plate and the second plate, and the The projection unit is composed of four, and is arranged in the form of a pyramid or an inverted pyramid between the first plate and the second plate based on the projection space, and the image output unit is composed of four, and each of the projection units irradiates image information. It provides a hologram-based real-time broadcasting content providing system, characterized in that.

In addition, the projection unit includes a first projection unit, a second projection unit, a third projection unit, and a fourth projection unit, and the image output unit outputs image information photographed by the first broadcasting camera to the first projection unit. A first image output unit configured to output image information captured by the second broadcasting camera to the second projection unit, and a second image output unit configured to output image information captured by the third broadcasting camera to the third projection unit It provides a hologram-based real-time broadcasting content providing system, comprising: a third image output unit and a fourth image output unit that outputs image information captured by the fourth broadcasting camera to the fourth projection unit.

In addition, a 1-1 surface part, a 1-2 surface part, a 1-3 surface part, and a 1-4 surface part are provided along the edge of the first plate, and the photographing part is located on the 1-1 surface part. A first photographing unit for photographing a viewer facing the 1-1 surface portion, a second photographing unit positioned on the 1-2 surface portion to photograph a viewer facing the 1-2 surface portion, the 1-3 A third photographing unit positioned on the face portion and photographing a viewer facing the face 1-3, and a fourth photographing portion positioned on the face 1-4 and photographing a viewer facing the face 1-4, , The second plate includes four second surface portions along the rim, and the viewing speaker is positioned on each of the second surface portions to output sound information to the outside. Provides.

In addition, the display unit may include a first display unit positioned above the first surface unit, a second display unit positioned above the second surface unit, a third display unit positioned above the third surface unit, and the third display unit. A fourth display unit positioned above the four surface portion, the first display unit displaying a first feedback signal photographed by the first photographing unit in an object direction, and the second display unit 2 The feedback signal is displayed in the object direction, the third display unit displays a third feedback signal photographed by the third photographing unit in the object direction, and the fourth display unit displays a fourth feedback signal photographed by the fourth photographing unit. It provides a hologram-based real-time broadcasting content providing system characterized by displaying in the direction of an object.

In addition, the broadcast control unit is configured to collect video signals and feedback signals exchanged between the broadcast communication unit and the viewing and communication unit to produce a video, and provide the video to a terminal connected to the broadcast communication unit through wireless communication. Provides a system for providing based real-time broadcasting contents.

In addition, the present invention is an image capturing process in which a plurality of broadcasting cameras photograph an object located inside a studio from different angles; A sound generation process in which a broadcasting microphone generates sound information from sound generated in the studio; An image transmission process in which the broadcast control unit receiving the image information photographed by the broadcast camera transmits the image information to the outside through wireless communication or wired communication through a broadcast communication unit; A sound transmission process in which the broadcast control unit receives the sound information generated by the broadcast microphone and transmits sound information to the outside through the broadcast communication unit; A receiving process in which a viewing communication unit receiving image information and sound information from the broadcast communication unit transmits the image information and sound information to a viewing control unit; The viewing control unit controls the image output unit located inside the hologram body to irradiate image information to a plurality of projection units formed inclined inside the hologram body, so that the hologram image is projected into the projection space inside the hologram body. process; The viewing control unit includes a sound output process of controlling a viewing speaker located in the hologram body to output sound information to the outside; A feedback photographing process in which a photographing unit located outside the hologram body captures an image of a viewer viewing a holographic image, generates a feedback signal, and transmits the generated feedback signal to the viewing control unit; A feedback transmission process in which the viewing control unit receiving the feedback signal transmits a feedback signal to the broadcasting communication unit through the viewing communication unit; And a feedback output process of transmitting a feedback signal to a display unit for displaying an image in the direction of the object by the broadcast control unit receiving a feedback signal from the broadcast communication unit and a broadcast speaker for outputting sound in the direction of the object. It provides a hologram-based real-time broadcasting content providing method.

In addition, the image transmission process includes: transmitting, by the broadcast control unit, image information photographed by the broadcast camera to a background removal unit; Generating an object image by removing the background image from the image information by the background removal unit; And controlling the broadcast communication unit to transmit the object image generated by the background removal unit as image information to the viewing and communication unit as the image information.

In addition, in the image capturing process, the four broadcasting cameras respectively disposed on the first, second, third and fourth surfaces of the studio capture different angles of the object. Provides a method of providing real-time broadcasting contents of

In addition, the image irradiation process includes: controlling the viewing control unit to irradiate the image information to the four projection units arranged in the shape of a pyramid or an inverted pyramid in the hologram body; And projecting the front, rear, left and right sides of the object into a projection space inside the hologram body as a hologram image. It provides a hologram-based real-time broadcasting content providing method.

In addition, the feedback photographing process includes four different feedback signals by photographing images of a viewer watching a holographic image from different angles by the four photographing units respectively positioned on four surface portions positioned along the outer side of the hologram body. It provides a hologram-based real-time broadcast content providing method, characterized in that generating.

In the present invention, by using a plurality of broadcasting cameras, it is possible to photograph not only the front view of the object, but also the side view and the rear view, so that the holographic image implemented by the viewing system, as well as the front view of the actual object, as well as the side view and the rear view can be realized at once. have.

In addition, the viewer can see all the front, rear, left and right sides of the object through the hologram body, so if you change the angle of viewing the hologram image while moving from place to place, you can see all directions of the object. It is possible to feel a three-dimensional feeling as if actually seeing an object, so you can feel a more intimate feeling, and there is an effect of maximizing promotional and advertising effects.

In addition, since the viewing speaker is provided in all directions of the second plate, the viewer can hear the same-sized voice and background sound generated by the object regardless of which direction of the hologram body.

In addition, since the feedback image and sound of the viewer is transmitted to the object in real time through a plurality of displays and broadcasting speakers, the object is curious about what reactions the viewers in which direction of the current plate body reacts, what more they want, and what It has the effect of being able to check and give feedback in real time.

In addition, since the plurality of display units display different screens, the object has an effect of enabling 1:1 communication with each viewer displayed on each display unit.

1 is a diagram schematically showing a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention.
2 is a diagram schematically showing a studio of a broadcasting system of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention.
3 is a block diagram of a broadcasting system of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention.
4 is a diagram illustrating a process of removing a background image by a background removal unit of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention.
5 is a diagram schematically illustrating a hologram body of a viewing system of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention.
FIG. 6 is a view showing a hologram main body of a viewing system of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention as viewed from the side.
7 is a block diagram showing a viewing system of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention.
FIG. 8 is a diagram illustrating a hologram-based real-time broadcasting content providing method according to an exemplary embodiment of the present invention.

Hereinafter, a hologram-based real-time broadcasting content providing system and method according to a preferred embodiment of the present invention will be described in more detail with reference to the accompanying drawings.

1 is a diagram schematically showing a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention.

Referring to FIG. 1, a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention includes a broadcasting system 100 and a viewing system 200.

The broadcasting system 100 provides various broadcasting contents produced by the studio 110 to viewers. For example, a public event to present a new product or performance to the viewer or a site of a new album announcement of singers is presented to the viewer. The showcase event is produced in the studio 110 and provided to viewers in a holographic manner.

The viewing system 200 outputs various broadcasting contents provided by the broadcasting system 100 as a hologram image, and provides the viewer reaction to the broadcasting contents to the broadcasting system 100 in real time. Recognize and feed back the reaction in real time to enable interactive communication.

Hereinafter, detailed configurations of the broadcasting system 100 and the viewing system 200 will be described.

2 is a diagram schematically showing a studio of a broadcasting system of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention, and FIG. 3 is a hologram-based real-time broadcasting content provision according to a preferred embodiment of the present invention. A block diagram of the broadcasting system of the system, and FIG. 4 is a diagram illustrating a process of removing a background image by a background removal unit of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention.

2 and 3, the broadcasting system 100 includes a studio 110 in which an object O is located, a broadcasting camera 120, a background removal unit 130, a broadcasting microphone 140, and a display unit. 150, a broadcast speaker 160, a broadcast communication unit 170, and a broadcast control unit 180.

The object O is for various promotions or showcases, for example, and may be composed of a real person, a model, a singer, a girl group, a new product, and an exhibit. Hereinafter, the object (O) will be described as a new album announcement site, that is, a singer of a girl group conducting a showcase, but it is natural that the present invention is not limited thereto.

The studio 110 is composed of, for example, a shooting set provided indoors or outdoors so that a space is provided therein. The studio 110 may be provided in a broadcasting station, or may be provided with an entertainment agency for promoting singers, a promotional agency for promoting new products, an advertisement company, and the like. The studio 110 has a single color, for example, a first surface part 111 of a blue screen, and a second surface part 112 spaced apart to face the first surface part 111 in order to remove a background image along the edge, that is, along the border. ), the third face portion 113 positioned to be connected to one side between the first face portion 111 and the second face portion 112 and the position to be connected to the other side between the first face portion 111 and the second face portion 112 It includes a fourth surface portion 114 to be. And a first hole (111a) is formed through the center of the first surface portion 111, the second hole (112a) is formed through the center of the second surface portion 112, and the center of the third surface portion 113 The third hole 113a is formed through, and the fourth hole 114a is formed through the center of the fourth surface portion 114. In addition, an object O for photographing is disposed in a space formed between the first surface portion 111 to the fourth surface portion 114. In addition, the studio 110 may be provided with an illumination set (not shown) for illuminating the object O, or a prompter (not shown) for dialogue or live.

A plurality of broadcasting cameras 120 are disposed in the studio 110 so as to photograph the object O from a different angle. The image information captured by the broadcasting camera 120 includes an object (O) image photographing images of different surfaces of an object (O) located inside the studio 110, and the first, second, and second images of the studio 110 It includes a blue screen, that is, a background image photographing a background image, which is located inside the 3 and 4 surface portions 111, 112, 113, and 114. The broadcast camera 120 is composed of a plurality, and includes a first broadcast camera 121, a second broadcast camera 122, a third broadcast camera 123, and a fourth broadcast camera 124. The first broadcast camera 121 is located outside the first surface portion 111 of the studio 110 and is configured to photograph the front surface of the object O through the first hole 111a. The second broadcasting camera 122 is located outside the second surface part 112 and is configured to photograph the rear surface of the object O through the second hole 112a, and the third broadcasting camera 123 is the third surface part. Doedoe located on the outside of (113) is configured to photograph the left side of the object (O) through the third hole (113a), the fourth broadcasting camera 124 is located outside the fourth surface portion 114, but the fourth It is configured to photograph the right side of the object O through the hole 114a. As described above, since the present invention includes a plurality of broadcasting cameras 120, it is possible to photograph an object O, that is, a front view of a singer's favorite singer, as well as a side view and a rear view, and a viewing system 200 (shown in FIG. 5) is implemented. In addition, the holographic image of the singer has the effect of being able to realize not only the front view of the singer, but also the side view and the back view at once.

As shown in FIG. 4, the background removal unit 130 removes the pixel value corresponding to the background image from the image information captured by each broadcasting camera 120, that is, the object (O) image and the background image. O) It is configured to generate only images. In addition, the 1st, 2nd, 3rd, 4th broadcasting cameras 121, 122, 123, 124 are configured to photograph the object O through the 1st, 2nd, 3rd, 4th holes 111a, 112a, 113a, 114a Therefore, the 1st, 2nd, 3rd, 4th broadcasting cameras 121, 122, 123, 124 are not photographed on the image information, so that the background removal unit 130 removes the background image, 4 There is an effect that the broadcasting cameras 121, 122, 123, 124 do not have any other influence.

The broadcasting microphone 140 is provided on one side of the upper part of the studio 110 and generates sound information from the object O of the studio 110, that is, the voice that the singer speaks or sings, and music output to the studio 110. do. The broadcast speaker 160 is disposed on the other side of the upper part of the studio 110 and outputs sound in the direction of the object O so that the object O can hear the sound.

The display unit 150 is disposed in the studio 110 to display an image in the direction of an object (O). LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diodes), PDP (Plasma) capable of outputting various images Display Panel), etc. The display unit 150 includes a first display unit 151 positioned above the first surface portion 111, a second display unit 152 positioned above the second surface portion 112, and a third surface portion 113. ) And a fourth display unit 154 positioned above the fourth surface portion 114 and a third display unit 153 positioned on the upper side of the ). The display unit 150 displays an image of a viewer photographed by a photographing unit 240 (shown in FIG. 7 ), which will be described later, on an object O, for example, a singer who is conducting an event, so that the singer and the viewer Feedback can be done.

The broadcast communication unit 170 transmits image information captured by the broadcast camera 120 and sound information generated by the broadcast microphone 140 to the outside. The broadcast communication unit 170 may be connected to the viewing communication unit 250 to be described later through wired communication or wireless communication. Wired communication and wireless communication are common configurations for sending and receiving various data wirelessly or wired. Wireless communication, for example, wireless communication, includes, for example, Bluetooth, WLAN, Zigbee, Wi-Fi, 3G, 4G, and 5G.

The broadcast control unit 180 controls the background removal unit 130 to generate an object (O) image by transmitting the image information captured by the broadcasting camera 120 to the background removal unit 130, and the background removal unit 130 The object (O) image generated by is collected as image information and transmitted to the viewing and communication unit 250 through the broadcast communication unit 170.

5 is a diagram schematically showing a hologram body of a viewing system of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention, and FIG. 6 is a hologram-based real-time broadcasting content according to a preferred embodiment of the present invention. It is a view showing a state as viewed from the side of the hologram body of the viewing system of the providing system, and FIG. 7 is a block diagram illustrating a viewing system of a hologram-based real-time broadcasting content providing system according to a preferred embodiment of the present invention.

5 to 7, the viewing system 200 includes a viewing communication unit 250, a hologram body 210, an image output unit 220, a viewing speaker 230, a photographing unit 240, and a viewing control unit 260. ).

The viewing and communication unit 250 is connected to the broadcasting communication unit 170 through wireless or wired communication, receives image information and sound information from the broadcasting communication unit 170, and transmits a feedback signal to the broadcasting communication unit 170.

The hologram body 210 may be formed in a small size suitable for viewing by 10 or less people, for example, or may be formed in a large size suitable for viewing by a large number of 100 or more people. This hologram body 210 is provided with a projection space therein, the first plate 212, the second plate 214 and the hologram body 210 fixed in a state spaced apart from the lower side of the first plate 212 It includes a plurality of projection units 216 disposed to face the projection space in the interior and formed to be inclined. In addition, a support (not shown) may be further provided to fix the first plate 212 and the second plate 214 to each other. The first plate 212 is formed in a plate-shaped hexahedron, and along the edge of the first plate 212, the 1-1 surface portion 212a, the 1-2 surface portion 212b, and the 1-3 surface portion 212c And a 1-4th surface portion 212d. The second plate 214 is also formed in a plate-shaped hexahedron, and four second surface portions 112 are provided along the rim of the second plate 214. In addition, a projection space is provided between the first plate 212 and the second plate 214.

The projection part 216 is formed in a transparent panel shape, for example, in a triangular shape. The projection unit 216 is composed of a plurality, and is arranged in the form of a pyramid or an inverted pyramid between the first plate 212 and the second plate 214 based on the projection space. In one embodiment of the present invention, there are four projection units 216, that is, a first projection unit 216a, a second projection unit 216b, a third projection unit 216c, and a fourth projection unit 216d. It is arranged in a pyramid shape while inclined at a preset angle. In addition, a projection space for displaying a holographic image to be described later is provided in an internal space between the first projection unit 216a to the fourth projection unit 216d.

The image output unit 220 is positioned above or below the hologram body 210 and irradiates the image information in the direction of each projection unit 216 so that the holographic image is projected onto the projection space, for example, It is mounted on the lower surface of the first plate 212. The image output unit 220 includes a first image output unit 221 and a second broadcast camera outputting front image information of the object O photographed by the first broadcast camera 121 to the first projection unit 216a. The second image output unit 222 outputs the rear image information of the object O photographed by 122 to the second projection unit 216b, and the left side of the object O photographed by the third broadcasting camera 123 The image information of the right side of the object O photographed by the third image output unit 223 and the fourth broadcasting camera 124 outputting the surface image information to the third projection unit 216c is transferred to the fourth projection unit 216d. It includes a fourth image output unit 224 to output. In addition, the image information of the front, rear, left and right surfaces of the object O output from the first to fourth image output units 221 to 224 is converted into the first to fourth projection units 216a to 4 When projected on (216d) and then reflected to the viewer, the viewer appears as if the object O is floating in the projection space as a holographic image. This holographic image is called a floating hologram.

In this way, the viewer can see all of the front, rear, left and right sides of the object O through the hologram body 210. For example, in the case of a viewer watching a showcase of a favorite singer, the hologram If you change the angle of viewing the video, you can see all directions of the singer, so you can feel as if you are actually seeing the singer, so you can feel more intimate with the singer, and maximize the promotional effect and advertising effect. Has the effect of being.

The viewing speaker 230 outputs sound information to the outside while being positioned on the hologram body 210, and is positioned on each second surface portion 112 of the second plate 214. Accordingly, the viewer can hear the same-sized voice and background sound generated by the object O regardless of which direction of the hologram body 210.

The photographing unit 240 photographs a viewer watching a holographic image and generates a feedback signal. The first photographing unit 241 and the first second surface part 212 are located at the outer center of the first surface part 212a. 212b) in the outer center of the second photographing portion 242, the third photographing portion 243 positioned in the outer center of the 1-3th surface portion 212c, and the outer center of the 1-4th surface portion 212d It includes a fourth photographing unit 244 positioned.

The first photographing unit 241 generates a first camera 241a for photographing a viewer facing the 1-1 face portion 212a and the voice of the viewer facing the 1-1 face portion 212a as a sound signal It includes a first microphone (241b). The second photographing unit 242 generates a second camera 242a for photographing a viewer facing the 1-2nd surface portion 212b, and the voice of the viewer facing the 1-2nd surface portion 212b as sound signals It includes a second microphone (242b). The third photographing unit 243 generates a third camera 243a photographing a viewer facing the 1-3th surface portion 212c, and the voice of the viewer facing the 1-3th surface portion 212c as sound signals It includes a third microphone (243b). The fourth photographing unit 244 generates a fourth camera 244a for photographing a viewer facing the 1-4 face portion 212d and the voice of the viewer facing the 1-4 face portion 212d as a sound signal It includes a fourth microphone (244b).

The viewing control unit 260 generates an image signal captured by the first camera 241a and a sound signal generated by the first microphone 241b as a first feedback signal, and a video signal captured by the second camera 242a and The sound signal generated by the second microphone 242b is generated as a second feedback signal, and an image signal photographed by the third camera 243a and a sound signal generated by the third microphone 243b are generated as a third feedback signal. Then, an image signal photographed by the fourth camera 244a and a sound signal generated by the fourth microphone 244b are generated as a fourth feedback signal. In addition, the viewing control unit 260 transmits the first, second, third, and fourth feedback signals to the broadcasting communication unit 170 through the viewing communication unit 250.

The broadcast control unit 180 transmits the first, second, third, and fourth feedback signals received by the broadcast communication unit 170 to the display unit 150 and the broadcast speaker 160. Then, the first display unit 151 displays the first feedback signal photographed by the first photographing unit 241 in the object (O) direction, and the second display unit 152 is photographed by the second photographing unit 242 The second feedback signal is displayed in the direction of the object O, and the third display unit 153 displays the third feedback signal photographed by the third photographing unit 243 in the direction of the object O, and the fourth display The unit 154 displays the fourth feedback signal photographed by the fourth photographing unit 244 in the direction of the object (O), and the object (O) indicates how the viewer located in the direction of the current plate body reacts. It has the effect of being able to check and feedback in real time whether you want more or what you are curious about. In addition, since the plurality of display units 150 respectively display different screens, the object O has an effect of enabling 1:1 communication with each viewer displayed on each display unit 150.

Meanwhile, the broadcast control unit 180 may collect various data exchanged between the broadcast communication unit 170 and the viewing and communication unit 250, ie, various image signals, feedback signals, etc., and produce a video. 170) may be provided to a user terminal on which a related application is installed wirelessly, and a predetermined fee may be charged.

Hereinafter, a hologram-based real-time broadcast content providing method according to a preferred embodiment of the present invention will be described.

FIG. 8 is a diagram illustrating a hologram-based real-time broadcasting content providing method according to an exemplary embodiment of the present invention.

1 to 8, first, a plurality of broadcasting cameras 120 photograph an object O located inside the studio 110 from different angles, and the broadcasting microphone 140 is the studio 110 Sound information is generated from the sound generated in (S100). At this time, four broadcasting cameras 120 disposed on the first side 111, the second side 112, the third side 113, and the fourth side 114 of the studio 110 are objects (O). Image information is generated by photographing each of the different angles.

In addition, the broadcast control unit 180 receiving the image information captured by the broadcast camera 120 and the sound information generated by the broadcast microphone 140 transmits the image information and sound information to the viewing and communication unit 250 through the broadcast communication unit 170. It is transmitted to (S110). At this time, the broadcast control unit 180 transmits the image information photographed by the broadcasting camera 120 to the background removal unit 130, and the background removal unit 130 removes the background image from the image information to create an object (O) image. After creation, the broadcast control unit 180 may control the broadcast communication unit 170 to transmit the object (O) image generated by the background removal unit 130 to the viewing and communication unit 250 as image information.

In addition, when the viewing communication unit 250, which has received the image information and sound information from the broadcasting communication unit 170, transmits the image information and sound information to the viewing control unit 260 (S120), the viewing control unit 260 returns the hologram body 210 ), the image output unit 220 positioned inside the hologram body 210 is controlled to irradiate the image information with the first, second, third, and fourth projection units 216a, 216b, 216c, 216d formed obliquely inside the hologram body 210 Thus, the hologram image is projected onto the projection space inside the hologram body 210. In this case, the viewing control unit 260 controls the four image output units 220 to irradiate the image information to the four projection units 216 arranged in the shape of a pyramid or an inverted pyramid inside the hologram body 210. Then, the front, rear, left and right rooms of the object O are projected as holographic images in the projection space inside the hologram body 210. In addition, the viewing control unit 260 controls the viewing speaker 230 located in the hologram body 210 to output sound information to the outside (S130).

Thereafter, the photographing unit 240 located outside the hologram body 210 photographs an image of a viewer watching the holographic image, generates a feedback signal, and transmits the generated feedback signal to the viewing control unit 260 (S140). ). At this time, the four photographing units 240, each positioned on the four face portions along the outer side of the hologram body 210, capture images of viewers watching the holographic image from different angles, thereby generating four different feedback signals. Generate.

Then, the viewing control unit 260 receiving the feedback signal transmits the feedback signal to the broadcast communication unit 170 through the viewing communication unit 250 (S150). After that, the broadcast control unit 180 receiving the feedback signal from the broadcast communication unit 170 displays an image in the direction of the object O and the broadcast speaker 160 outputs sound in the direction of the object O. ), and the display unit 150 and the broadcasting speaker 160 output the feedback signal as an image and sound (S160).

Although the present invention has been described in detail in the above embodiments, it is natural that the present invention is not limited thereto, and it is obvious to those skilled in the art that various modifications and modifications are possible within the scope of the technical idea of the present invention, and such modifications and modifications are attached. If it falls within the scope of the claims, the technical idea should also be regarded as belonging to the present invention.

100: broadcasting system
110: studio
111, 112, 113, 114: 1st, 2nd, 3rd left, 4th right side
111a, 112b, 113c, 114d: holes 1, 2, 3, 4
120: broadcast camera
121, 122, 123, 124: 1st, 2nd, 3rd, 4th broadcast camera
130: background removal unit
140: broadcast microphone
150: display unit
151, 152, 153, 154: 1st, 2nd, 3rd, 4th display
160: broadcast speaker
170: Ministry of Broadcasting and Communications
180: broadcast control unit
200: viewing system
210: hologram body
212: first plate
212a, 212b, 212c, 212d: face 1-1, face 1-2, face 1-3, face 1-4
214: second plate
216: projection
216a, 216b, 216c, 216d: 1st, 2nd, 3rd, 4th projection
220: image output unit
221, 222, 223, 224: 1st, 2nd, 3rd, 4th image output unit
230: viewing speaker
240: photographing department
241, 242, 243, 244: 1st, 2nd, 3rd, 4th filming department
241a, 242a, 243a, 244a: 1st, 2nd, 3rd, 4th camera
241b, 242b, 243b, 244b: 1st, 2nd, 3rd, 4th microphone
250: City Hall and Communication Department
260: viewing control unit

Claims (14)

A studio in which an object is located, a plurality of broadcasting cameras arranged in the studio to photograph the object from different angles, a broadcasting microphone that generates sound information from sound generated in the studio, and is arranged in the studio A display unit for displaying an image in the direction of the object, a broadcasting speaker disposed in the studio and outputting sound in the direction of the object, and image information photographed by the broadcasting camera and sound information generated by the broadcasting microphone are transmitted to the outside. A broadcasting system having a broadcasting communication unit; And
A viewing communication unit that is connected to the broadcasting communication unit by wireless communication or wired communication and receives image information and sound information from the broadcasting communication unit, a hologram body having a projection space therein, and the projection space inside the hologram body A plurality of projection units arranged to be opposed to each other and formed to be inclined, and an image output unit that irradiates image information in the direction of each of the projection units while being positioned above or below the hologram body to project a holographic image onto the projection space Wow, a viewing system having a viewing speaker positioned in the hologram body and outputting sound information to the outside, and a photographing unit that photographs a viewer viewing a holographic image while being positioned outside the hologram body and generates a feedback signal Including,
The viewing control unit of the viewing system controls to transmit a feedback signal photographed by the photographing unit to the broadcasting communication unit through the viewing communication unit,
The broadcasting control unit of the broadcasting system controls to transmit the feedback signal received by the broadcasting communication unit to the display unit and the broadcasting speaker,
The studio includes a first surface portion, a second surface portion opposite to the first surface portion, a third surface portion positioned on one side between the first surface portion and the second surface portion, and between the first surface portion and the second surface portion. Including a fourth surface portion positioned on the other side, the object is disposed in a space formed between the first surface portion to the fourth surface portion,
The broadcasting camera may include a first broadcasting camera disposed on the first surface, a second broadcasting camera disposed on the second surface, a third broadcasting camera disposed on the third surface, and a fourth broadcasting camera disposed on the fourth surface. Including a broadcast camera,
The hologram body includes a first plate and a second plate fixed in a state spaced apart from the first plate, wherein the projection space is provided between the first plate and the second plate,
The projection unit is composed of four and is arranged in the form of a pyramid or an inverted pyramid between the first plate and the second plate based on the projection space,
The image output unit is composed of four, and each of the projection unit irradiates the image information,
A 1-1 surface portion, a 1-2 surface portion, a 1-3 surface portion, and a 1-4 surface portion are provided along the edge of the first plate,
The photographing unit may include a first photographing unit positioned on the first surface portion and photographing a viewer facing the first surface portion 1-1, and a viewer positioned on the first surface portion 1-2 and facing the first surface portion A second photographing unit for photographing, a third photographing unit for photographing a viewer facing the first-third surface portion, the first-third surface portion, and the first-fourth surface portion Including a fourth photographing unit for photographing a viewer opposite to,
The second plate includes four second surface portions along the rim,
The viewing speaker is a hologram-based real-time broadcasting content providing system, characterized in that positioned on each of the second surface to output sound information to the outside.
The method of claim 1,
The image information photographed by the broadcasting camera includes an object image photographing an object located inside the studio, and a background image photographing a background image located inside the border of the studio,
The broadcasting system further includes a background removal unit for generating an object image by removing a background image from image information captured by the broadcasting camera,
The broadcast control unit controls the broadcast communication unit to transmit the object image generated by the background removal unit to the viewing and communication unit as image information.
delete The method of claim 1,
A first hole is formed through the center of the first surface portion, a second hole is formed through the center of the second surface portion, and a third hole is formed through the center of the third surface portion, and the fourth surface portion A fourth hole is formed through the center,
The first broadcasting camera is located outside the first surface part, and is configured to photograph the front surface of the object through the first hole, and the second broadcasting camera is located outside the second surface part, the second hole The third broadcast camera is configured to photograph the rear surface of the object through the third side, and the third broadcast camera is configured to photograph the left side of the object through the third hole, and the fourth broadcast camera is the fourth A hologram-based real-time broadcasting content providing system, characterized in that positioned outside the surface portion and configured to photograph the right side of the object through the fourth hole.
delete The method of claim 1,
The projection unit includes a first projection unit, a second projection unit, a third projection unit, and a fourth projection unit,
The image output unit may include a first image output unit that outputs image information captured by the first broadcasting camera to the first projection unit, and a second image outputs image information captured by the second broadcasting camera to the second projection unit An output unit, a third image output unit that outputs image information captured by the third broadcasting camera to the third projection unit, and a fourth image output unit that outputs image information captured by the fourth broadcasting camera to the fourth projection unit A hologram-based real-time broadcasting content providing system comprising: a.
delete The method of claim 1,
The display unit may include a first display unit positioned above the first surface unit, a second display unit positioned above the second surface unit, a third display unit positioned above the third surface unit, and the fourth surface unit Including a fourth display unit located on the top of,
The first display unit displays a first feedback signal photographed by the first photographing unit in an object direction,
The second display unit displays a second feedback signal photographed by the second photographing unit in an object direction,
The third display unit displays a third feedback signal photographed by the third photographing unit in an object direction,
The fourth display unit displays a fourth feedback signal photographed by the fourth photographing unit in a direction of an object.
The method of claim 1,
The broadcast control unit is configured to collect video signals and feedback signals exchanged between the broadcast communication unit and the viewing communication unit to produce a video, and to provide the video to a terminal connected to the broadcast communication unit through wireless communication. Real-time broadcasting content providing system.
An image capturing process in which a plurality of broadcasting cameras shoot objects located inside the studio from different angles;
A sound generation process in which a broadcasting microphone generates sound information from sound generated in the studio;
An image transmission process in which the broadcast control unit receiving the image information photographed by the broadcast camera transmits the image information to the outside through wireless communication or wired communication through a broadcast communication unit;
A sound transmission process in which the broadcast control unit receives the sound information generated by the broadcast microphone and transmits sound information to the outside through the broadcast communication unit;
A receiving process in which a viewing communication unit receiving image information and sound information from the broadcast communication unit transmits the image information and sound information to a viewing control unit;
The viewing control unit controls the image output unit located inside the hologram body to irradiate image information to a plurality of projection units formed inclined inside the hologram body, so that the hologram image is projected into the projection space inside the hologram body. process;
The viewing control unit includes a sound output process of controlling a viewing speaker located in the hologram body to output sound information to the outside;
A feedback photographing process in which a photographing unit located outside the hologram body captures an image of a viewer viewing a holographic image, generates a feedback signal, and transmits the generated feedback signal to the viewing control unit;
A feedback transmission process in which the viewing control unit receiving the feedback signal transmits a feedback signal to the broadcasting communication unit through the viewing communication unit; And
A feedback output process of transmitting a feedback signal to a display unit for displaying an image in the direction of the object by the broadcast control unit receiving a feedback signal from the broadcast communication unit and a broadcast speaker for outputting sound in the direction of the object,
The feedback photographing process,
The hologram, characterized in that the four photographing units respectively positioned on four face portions along the outer side of the hologram body capture an image of a viewer watching the holographic image from different angles to generate four different feedback signals. Based on real-time broadcasting contents provision method.
The method of claim 10,
The video transmission process is:
Transmitting, by the broadcasting control unit, image information photographed by the broadcasting camera to a background removal unit;
Generating an object image by removing the background image from the image information by the background removal unit; And
And controlling the broadcast communication unit to transmit the object image generated by the background removal unit to the viewing and communication unit as image information.
The method of claim 10,
In the image capturing process, the four broadcasting cameras respectively disposed on the first, second, third, and fourth surfaces of the studio capture different angles of the object. How to provide broadcast content.
The method of claim 12,
The image survey process is:
The viewing control unit controlling the four image output units to irradiate the image information to the four projection units arranged in the shape of a pyramid or an inverted pyramid inside the hologram body; And
And projecting the front, rear, left and right sides of the object into a projection space inside the hologram body as a hologram image.
delete

Images