KR101900470B1 - Automatic broadcasting system - Google Patents

Abstract

The present invention relates to an automatic broadcasting system which generates a camera selection event when a specific reaction is detected by analyzing a reaction of broadcasters or audience in real time, and selects and switches a specific stage photographing camera or a specific auditorium photographing camera to transmit broadcast according to the generated camera selection event, thereby obtaining and transmitting a dynamic broadcasting screen.

Description

[0001] The present invention relates to an automatic broadcasting system,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a broadcast transmission technology, and more particularly to an automatic broadcast system.

A camera photographing sequence, camera photographing position, camera pan / tilt / focus / zoom and camera moving speed, recording and other control operations of peripheral devices previously registered in Korean Patent Laid-Open No. 10-2002-0048334 (2002.06.22) And automatically broadcasts the broadcast according to the broadcast program.

The present inventors have developed a technique of real-time analyzing the reactions of broadcasters or audiences to generate a camera selection event when a specific response is detected, and to select and switch a specific stage camera or a seat camera to transmit a broadcast according to the generated camera selection event In this paper, we propose a technique to acquire live broadcasting screen and transmit it.

Korean Patent Publication No. 10-2002-0048334 (2002.06.22)

SUMMARY OF THE INVENTION The present invention has been made under the above-mentioned circumstances, and it is an object of the present invention to provide a method and apparatus for generating a camera selection event when a specific reaction is detected by analyzing reactions of broadcasters or audiences in real time, And an automatic broadcasting system capable of acquiring and transmitting a live broadcasting screen by selecting and switching an audience photographing camera.

According to an aspect of the present invention, an automatic broadcasting system includes at least one stage photographing camera for photographing a broadcasting stage; At least one seat photographing camera for photographing a spectator seat; When a specific reaction is detected by analyzing the visual response of the audience included in the broadcast stage photographed image taken by the stage photographed camera or the audience included in the photographed image taken by the audience photographed camera, An image analyzer for generating an image; A camera selector for selecting and switching a specific stage photographing camera or an audience photographing camera to transmit a broadcast according to a camera selection event generated by the image analyzer; A video image processor for processing a broadcast stage photographed image or an audience photographed image photographed by a stage photographed camera or an audience photographed camera selected by the camera selector and broadcasting it; And the like.

According to a further aspect of the present invention, the automatic broadcasting system includes at least one microphone for receiving the voice of the broadcasters or audiences; A voice analyzer for real-time analyzing auditory responses of the broadcasters or audiences from the voice input by the microphone and generating a camera selection event when a specific response is detected; And further comprising:

According to a further aspect of the present invention, the camera selector selects and switches a specific stage camera or a seat camera for transmitting a real-time broadcast according to a preset priority, And selects a specific stage shooting camera or an audience shooting camera corresponding to the camera selection event.

According to a further aspect of the present invention, when the camera selector has elapsed a predetermined time after the generation of the camera selection event, the camera selection is resumed according to the priority.

According to a further aspect of the present invention, when the camera selector repeatedly generates the same camera selection event, the camera selection event of a predetermined number or more is ignored.

According to a further aspect of the present invention, there is provided an image analyzing apparatus, comprising: an image analyzer for analyzing an image captured by a scene photographing camera or an audience photographing camera selected by the camera selector in response to a camera selecting event generated by the image analyzer; And the center of the screen is moved to an area of interest of the photographed image.

According to a further aspect of the present invention, the image processor zooms in on a region of interest of a broadcast stage photographed image or a photographed spectacle image moved to the center of the screen to close up.

According to a further aspect of the present invention, the image processor is characterized by close-ups of interested broadcasters or interested audiences in a particular area of interest.

According to a further aspect of the present invention, the image processor may close up interested interested broadcasters in a region of interest in a specific response to a specific broadcaster of the audience.

According to a further aspect of the present invention, the image processor may close up interested interested persons in a region of interest in a specific response to a specific audience of broadcasters.

According to a further aspect of the present invention, the image processor is configured to limit exposure to non-interested audiences other than interested audiences in the area of interest of the spectator seated image.

According to a further aspect of the present invention, the image processor is characterized by moving the screen center to a region of interest of a broadcast stage photographed image or an audience photographed image through software screen scrolling control or hardware camera pan / tilt control .

In the present invention, when a specific reaction is detected, a camera selection event is generated by analyzing the reaction of the broadcasters or audiences in real time, and a specific stage shooting camera or a seat shooting camera to transmit a broadcast according to the generated camera selection event is selected and switched It is possible to acquire and transmit a live broadcasting screen, and thus the broadcasting viewing rate can be improved.

In addition, since broadcasting screens are automatically acquired and transmitted through automatic selection of broadcasting cameras adaptive to the responses of broadcasters or audiences, it is possible to minimize the manpower of camera control and broadcasting transmission control, thereby assisting low-cost small-scale commodity broadcasting and personal broadcasting There is an effect that can be.

1 is a block diagram showing the configuration of an automatic broadcasting system according to an embodiment of the present invention.
2 is a flowchart illustrating an example of a broadcast transmission operation of the automatic broadcasting system according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

The terms used throughout the specification of the present invention have been defined in consideration of the functions of the embodiments of the present invention and can be sufficiently modified according to the intentions and customs of the user or operator. It should be based on the contents of.

1 is a block diagram showing the configuration of an automatic broadcasting system according to an embodiment of the present invention. 1, the automatic broadcasting system according to this embodiment includes at least one stage photographing camera 100, at least one seat photographing camera 200, an image analyzer 300, a camera selector 400 , And an image processor 500. [

The stage photographing camera 100 photographs a broadcasting stage. For example, the stage photographing camera 100 may be a camera having at least one stage viewing side and a viewing angle in the direction of the broadcasting stage. In this case, the stage shooting camera 100 may be a wide angle camera or a camera capable of pan / tilt control.

The seat photographing camera 200 photographs an audience. For example, at least one seat photographing camera 200 may be installed on the broadcasting stage side to be a camera having a viewing angle in the direction of a spectator's seat. At this time, the seat photographing camera 200 may be a wide angle camera or a camera capable of pan / tilt control.

The image analyzer 300 analyzes the visual response of audiences included in the broadcast stage photographs photographed by the stage photographing camera 100 or photographs taken by the audience photographing camera 200 And generates a camera selection event when a specific reaction is detected.

At this time, the recognition of the broadcasters included in the broadcast stage photographed image and the audience included in the spectacle image can be recognized by the object recognition technology. On the other hand, the visual response may be facial expression such as laughter, gaze direction, mouth shape change, and the like, and can be detected by a facial motion estimation technique through recognition of feature point change.

The camera selection event is a process of selecting a stage photographing camera 100 or an audience photographing camera 200 in which a broadcast stage photograph or a visitor's seat photographing image including a broadcaster or an audience with a specific reaction is detected, 100) or an instruction to send a broadcast stage shot image or a spectacle seated image shot by the audience shooting camera 200 to a broadcast screen.

For example, unique stage identification information may be given to each stage imaging camera 100 and the seat imaging camera 200, and the camera selection event may be implemented to include unique camera identification information for camera selection.

Meanwhile, the image analyzer 300 is connected to the stage photographing camera 100 and the seat photographing camera 200 through a network to receive a broadcasting stage photographing image or a viewing seat photographing image, and executes object recognition software and facial motion estimation software And may be implemented in a PC form that generates a camera selection event by analyzing the visual response of the broadcast person or the audience included in the broadcast stage shot image or the sightseeing audience image in real time.

The camera selector 400 selects and switches a specific stage photographing camera 100 or a seat photographing camera 200 to transmit a broadcast according to a camera selection event generated by the image analyzer 300.

For example, the camera selector 400 may be implemented in the form of a switch matrix, which is switched to the stage photographing camera 100 or the seat photographing camera 200 corresponding to the camera identification information included in the camera identification information, have.

The image processor 500 processes and broadcasts a broadcast stage photographed image or a spectator image photographed by the stage photographed camera or the audience photographed camera selected by the camera selector 400.

For example, when the image processor 500 receives a moving stage photographed image or a spectacle viewing photographed by a stage photographing camera or an audience photographing camera selected by the camera selector 400 as an MPEG-2 TS (transport stream), an MMT And the like, and transmitting the converted broadcasting data to a broadcasting network or an Internet network.

According to the present invention, the present invention can be realized by analyzing the visual response of broadcasters or audiences in real time, generating a camera selection event when a specific response is detected, and transmitting a specific stage camera or a seat By selecting and switching a photographing camera, it is possible to acquire and broadcast a live broadcast screen, so that a live broadcast can be viewed from the viewpoint of a broadcast viewer, contributing to the improvement of the broadcast viewing rate.

In addition, since broadcasting screens are automatically acquired and transmitted through automatic selection of broadcasting cameras adaptive to the responses of broadcasters or audiences, it is possible to minimize the manpower of camera control and broadcasting transmission control from the viewpoint of the broadcasting provider, This is possible.

According to a further aspect of the present invention, the automatic broadcasting system may further include at least one microphone 600 and a voice analyzer 700. The microphone 600 receives voice of broadcasters or audiences.

For example, the microphone 600 may be provided for each of the broadcasters to receive the voice of each of the broadcasters and be installed at a plurality of positions of the audience to receive the voice of the surrounding audiences.

The voice analyzer 700 real-time analyzes the auditory responses of the broadcasters or audiences from the voice input by the microphone 600 and generates a camera selection event when a specific response is detected. At this time, the auditory response may be laughter, exclamation, etc., and voice frequency patterns such as laughter and exclamation may be detected through voice frequency analysis, voice size analysis, and sound field analysis.

The camera selection event is a process of selecting a stage photographing camera 100 or an audience photographing camera 200 in which a broadcast stage photograph or a visitor's seat photographing image including a broadcaster or an audience with a specific reaction is detected, 100) or an instruction to send a broadcast stage shot image or a spectacle seated image shot by the audience shooting camera 200 to a broadcast screen.

For example, unique stage identification information may be given to each stage imaging camera 100 and the seat imaging camera 200, and the camera selection event may be implemented to include unique camera identification information for camera selection.

The voice analyzer 700 is connected to at least one microphone 600 to receive a voice inputted through a microphone 600 by a broadcaster or an audience, and is provided with voice frequency analysis software, voice size analysis software, sound field analysis software Or the like, to analyze the auditory response of the broadcaster or the audience in real time and to generate a camera selection event.

At this time, the camera selection event may be generated by the visual response by the image analyzer 300 and the auditory response by the audio analyzer 700, and the visual response by the image analyzer 300 And the auditory response by the speech analyzer 700. [0064] FIG.

According to the present invention, the present invention can be applied to a specific stage photographing camera for generating a camera selection event when a specific reaction is detected by real-time analysis of auditory responses of broadcasters or audiences, It is possible to acquire and send a live broadcast screen by selecting and switching the seat photographing camera, so that a live broadcast can be viewed from the viewpoint of a broadcast viewer, which contributes to the improvement of the broadcast viewing rate.

In addition, since broadcasting screens are automatically acquired and transmitted through automatic selection of broadcasting cameras adaptive to the responses of broadcasters or audiences, it is possible to minimize the manpower of camera control and broadcasting transmission control from the viewpoint of the broadcasting provider, This is possible.

According to a further aspect of the present invention, the camera selector 400 selects and switches a specific stage camera or a seat camera to transmit a real-time broadcast according to a predetermined priority, And to select a specific stage or camera camera corresponding to the camera selection event.

At this time, when the camera selector 400 has elapsed a specific time after the camera selection event has occurred, the camera selector 400 may resume camera selection according to the priority. On the other hand, when the camera selector 400 repeatedly generates the same camera selection event, the camera selection event may be ignored for a predetermined number of times or more.

That is, in this embodiment, when a camera selection event is not generated, such as when a broadcast is started for the first time, a specific stage shooting camera or a seat shooting camera to which a broadcast is to be transmitted is selected and switched according to a preset priority, So that it can be transmitted.

In addition, when the same specific reaction continues to occur, the camera selection event is ignored for a predetermined number of times or more and the camera switching is not performed, so that the broadcaster or the audience continuing the specific reaction is not kept on the broadcast screen.

According to a further aspect of the present invention, the image processor 500 may further include a stepping camera or a seat photographing camera selected by the camera selector 400 in response to a camera selection event generated by the image analyzer 300 Or to move the center of the screen to a region of interest of the photographed image of the spectator.

For example, the image processor 500 can move the screen center to a region of interest of a broadcast stage shot image or a spectacle view image through software screen scroll control or hardware camera pan / tilt control.

At this time, the image processor 500 may zoom-in and close up a region of interest of a broadcast stage photographed image or a photographed spectacle image moved to the center of the screen.

For example, the image processor 500 may be implemented to close up interested or interested audiences in a particular area of interest that responds. A stage photographing camera or a spectacle photographing apparatus for photographing a stage photographing scene or a spectacle viewing scene in which a broadcasting person or an audience who has a specific reaction such as laughing or being very surprised by the image analyzer 300 is detected and the corresponding broadcaster or audience is included, When a camera selection event for selecting a photographing camera is generated, the camera selector 400 selects and switches the corresponding stage photographing camera or an audience photographing camera.

Then, the image processor 500 displays an area of interest (such as a scene of a broadcast stage photographed by a selected stage photographing camera or an audience photographing camera, And closes up the interested broadcaster or interested audience (a broadcaster or audience member who smiles greatly in the area of interest, or shows a specific reaction such as being very surprised).

For example, the image processor 500 may be configured to close up interested interested broadcasters in a region of interest in response to specific responses of a specific broadcaster to the audience. A specific response to a specific broadcaster of the audience such as the attention of the audiences is focused on a specific broadcaster by the image analyzer 300 and a camera selection event for selecting a stage shooting camera for shooting a stage photographed image including the broadcaster The camera selector 400 selects and switches the corresponding stage photographing camera.

Then, the image processor 500 moves the screen center to a region of interest (a screen region where a broadcaster whose eyes are crowded) of a broadcast stage photographed image is photographed by a selected stage photographing camera, (Broadcasters whose attention is focused on audiences).

For example, the image processor 500 may be configured to close up interested parties in a region of interest in response to a specific audience of the broadcasters. A camera selection event in which a specific reaction to a specific audience of a broadcaster such as the concentration of the viewers of the broadcasters to the specific audience is detected by the video analyzer 300 and the audience photographing camera for photographing the audience- The camera selector 400 selects and switches the seat photographing camera.

Then, the image processor 500 moves the center of the screen to a region of interest (a screen region in which the audience of the broadcasters is located) of the spectator's photographed image photographed by the selected audience photographing camera, (Listeners whose attention is concentrated on broadcasters).

By implementing such a method, by moving the center of the screen to a region of interest of a broadcast stage photographing image or a photograph of a spectator's seat photographed by a selected stage photographed camera or an audience photographed camera detected by a specific reaction, A live broadcasting screen can be obtained.

According to a further aspect of the invention, the image processor 500 may be configured to limit exposure to non-interested audiences, other than interested audiences, in the area of interest of the viewing session. This embodiment is intended to protect privacy by limiting the exposure of uninvited audience members who are unintentionally included in the area of interest screen of the spectator's photograph.

For example, the image processor 500 can limit the exposure to the uninvited audience by masking, blurring, mosaicing, and so on to the non-interested audiences in the area of interest of the spectator seated image.

The broadcast transmission operation of the automatic broadcasting system according to the present invention as described above will be described with reference to FIG. 2 is a flowchart illustrating an example of a broadcast transmission operation of the automatic broadcasting system according to the present invention.

First, in step 810, the automatic broadcasting system receives through the image analyzer at least one stage photographing camera and at least one stage photographing scene and a spectacle photographing scene taken by the at least one seating photographing camera.

At this time, in step 810, the automatic broadcasting system may be implemented to receive the voice of the broadcaster or listener input by the at least one microphone through the voice analyzer.

Then, in step 820, the automatic broadcasting system analyzes the visual responses of the broadcast persons or audience members included in the broadcast stage shot image and the guest seat shot image received through the image analyzer in real time and generates a camera selection event when a specific response is detected .

At this time, in step 320, the automatic broadcasting system may analyze the auditory responses of the broadcasters or audiences included in the voice received through the voice analyzer in real time and generate a camera selection event when a specific response is detected.

On the other hand, it is possible to detect a specific reaction by simultaneously considering visual and auditory responses of broadcasters or audiences, and to generate a camera selection event when a specific reaction is detected.

Then, in step 830, the automatic broadcasting system selects and switches a specific stage camera or a seat camera to transmit the broadcast according to the camera selection event generated by the step 820. [

Next, in step 840, the automatic broadcasting system processes and broadcasts a broadcast stage shot image or a spectacle view shot image shot by the stage shot camera or the audience shot camera selected in step 830.

According to the present invention, the present invention can be realized by real-time analyzing the reactions of broadcasters or audiences, generating a camera selection event when a specific response is detected, and transmitting a specific stage camera or a seat capture By selecting and switching the camera, a live broadcast screen can be obtained and transmitted, which contributes to the improvement of the broadcast viewing rate.

In addition, since broadcasting screens are automatically acquired and transmitted through automatic selection of broadcasting cameras adaptive to the responses of broadcasters or audiences, it is possible to minimize the manpower of camera control and broadcasting transmission control, thereby assisting low-cost small-scale commodity broadcasting and personal broadcasting Therefore, the object of the present invention can be achieved.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. .

INDUSTRIAL APPLICABILITY The present invention is industrially applicable in the fields of broadcasting transmission technology and its application technology.

100: Stage shooting camera
200: Seat camera
300: Image analyzer
400: camera selector
500: Image processor
600: microphone
700: Speech Analyzer

Claims (12)

At least one stage photographing camera for photographing a broadcast stage;
At least one seat photographing camera for photographing a spectator seat;
When a specific reaction is detected by analyzing the visual response of the audience included in the broadcast stage photographed image taken by the stage photographed camera or the audience included in the photographed image taken by the audience photographed camera, An image analyzer for generating an image;
A camera selector for automatically selecting a stage photographing camera or a seat photographing camera in response to a camera selection event generated by the image analyzer, with a camera to transmit a broadcast;
An image processor for processing a broadcast stage photographed image or an audience photographed image photographed by a stage photographed camera or an audience photographed camera selected by the camera selector and transmitting a broadcast adaptively to the responses of broadcasters or audiences;
And an automatic broadcasting system. The method according to claim 1,
Wherein the automatic broadcasting system comprises:
At least one microphone for receiving voices of broadcasters or audiences;
A voice analyzer for real-time analyzing auditory responses of the broadcasters or audiences from the voice input by the microphone and generating a camera selection event when a specific response is detected;
Further comprising: 3. The method according to claim 1 or 2,
Wherein the camera selector comprises:
A specific stage photographing camera or a seat photographing camera to be selected for transmission of a real-time broadcast according to a preset priority, and switches a camera selection according to a priority order when a camera selecting event occurs, And a camera or an audience photographing camera is selected. The method of claim 3,
Wherein the camera selector comprises:
And resumes the camera selection according to the priority when a specific time elapses after the occurrence of the camera selection event. The method of claim 3,
Wherein the camera selector comprises:
Wherein when the same camera selection event occurs repeatedly, the camera selection event over a predetermined number of times is ignored. 3. The method according to claim 1 or 2,
Wherein the image processor comprises:
The center of gravity of the screen is moved to a region of interest of a broadcast stage photographed image or an audience photographed image photographed by a stage photographed camera or an audience photographed camera selected by the camera selector in response to a camera selection event generated by the image analyzer . The method according to claim 6,
Wherein the image processor comprises:
And zooming in on a region of interest of the broadcast stage photographed image moved to the center of the screen or the photographed image of the spectator's seat. 8. The method of claim 7,
Wherein the image processor comprises:
And closes up the interested broadcaster or interested audience in the area of interest that is performing the specific response. 8. The method of claim 7,
Wherein the image processor comprises:
And closes up the interested broadcasters in the area of interest in response to specific responses of the specific broadcasters to the audience. 8. The method of claim 7,
Wherein the image processor comprises:
And closes up the concerned interested audience in the area of interest in response to a specific response of the broadcasters to the specific audience. The method according to claim 6,
Wherein the image processor comprises:
And limits the exposure to the non-interested audience other than the interested audience in the area of interest of the spectator's photographed image. The method according to claim 6,
Wherein the image processor comprises:
Wherein the center of the screen is moved to a region of interest of a broadcast stage image or an audience image through a software screen scroll control or a hardware camera pan / tilt control.

Images