KR20030013012A - Unmanned remote module for internet live broadcasting system and remote control apparatus thereof - Google Patents

Abstract

PURPOSE: An unmanned remote module for an Internet live broadcasting and a device for remotely controlling the same are provided to mount an unmanned remote module which is a voice capture device capable of being controlled in a remote place at a live broadcasting area, look and listen to a video and a voice transmitted by the remote module through a wire/wireless Internet in a control center, control the remote module, and perform a live broadcasting to each subscriber. CONSTITUTION: A video signal and a voice signal photographed and received in an actual spot by a camera(41) and a mike(42) are converted into a digital signal by an A/D converter in a circuit block of an encoding board. The video signal and the voice signal are mixed by an encoder, and the mixed video signal and voice signal is compressed and encoded as an ASF or MPEG-1,2,4 signal which is a real time stream file and transmitted to a main board(44). A communication LAN card, a VGA card, and a sound card are stored in the main board(44), and a framing of a signal mixed in the main board(44) is performed in accordance with an Internet protocol, and the mixed signal is transmitted to a control center or an Internet data center(IDC) for a live broadcasting by a wire/wireless network line through a CPU(45) and a memory(46) or stored in a hard disk(47) for a filmed TV broadcast. The CPU(45) performs a rendering of the video and voice signal by a control of a remote program, manufactures the final file, and the memory(46) is used for a rendering of an edited video and voice signal. A remote program interlocked with a remote control program is loaded in the hard disk(47).

Description

Unmanned remote module for internet live broadcasting system and remote control apparatus

The present invention relates to an unmanned remote module for internet live broadcasting and a remote control device. In particular, an unmanned remote module, which is a video and audio capturing device that can be controlled remotely, is installed in a live broadcasting area to remotely transmit video and audio transmitted therefrom via wired or wireless Internet. The present invention provides an unattended remote module for internet live broadcasting and its remote control device, which allows the operator to simultaneously control and watch in real time and transmit the video and audio to each subscriber.

Generally speaking, broadcasting can be considered as an over-the-air broadcasting. The problem with the existing over-the-air broadcasting is that it is difficult to produce a program that meets the needs of various viewers due to the enormous cost of limited channels and broadcasting programs. However, technically, it is impossible to produce programs that can interact with viewers because of one-way communication, and there has been a problem of biasing toward a uniform program that ignores the audience and an entertainment-oriented entertainment program that is conscious of viewership.

However, with the development of computer-based internet technology, a technology that can replace the existing airwaves has emerged.

In the early days, high-speed transmission technology using optical communication was limited to subscriber networks in some business buildings, including backbone networks and large corporations, and was limited to services requiring small transmission capacity such as still pictures and data retrieval.

However, in recent years, high-speed optical communication technology and data communication technology have been developed, along with advances in optical high-speed router technology, image compression technology, and optical fiber such as FTTC (Fiber To The Curb) and FFTZ (Fiber To The Zone). With the beginning of subscriber network construction, it is now diversified into video service that enables general subscribers to benefit from high-speed transmission network as well as business area of big city.

In particular, the demand for multimedia services by subscribers over the Internet has increased rapidly thanks to the recent ADSL transmission technology applied to the domestic subscriber network and the revival of the Internet, which is the largest number of multimedia services before and after the construction of high-speed subscriber networks using ADSL and optical transmission. The difference is that after the establishment of high-speed subscriber network, multimedia service using video is available to the general public although it is still limited.

Accordingly, the number and type of companies that provide various multimedia services have increased significantly.

However, the video service through the internet is still limited to video chatting or internet broadcasting through internet chatting or low quality transmission and video quality through some PC rooms, unlike over-the-air broadcasting providing various programs.

One of the major factors that the video service using the Internet does not increase dramatically unlike the air broadcasting is that even the broadcasting company that has the in-depth and innovative program planning ability is expensive and the equipment used for producing various broadcasting programs is expensive. In addition, a large number of skilled personnel are required to operate the equipment, which requires a huge amount of money, so the new small Internet broadcasters cannot afford the cost of producing such expensive programs.

Therefore, in order to activate the Internet multimedia service through video, it is urgent to develop internet broadcasting equipment which has good image and transmission quality, is easy to use and low cost.

In order to broadcast using the Internet, it is necessary to acquire images and audio. Therefore, a digital transmission apparatus capable of converting and transmitting images and audio signals obtained from a camera and a microphone in accordance with the Internet protocol is basically required.

In addition, in order to produce a full-fledged Internet broadcast program, the digital transmission device must have good transmission quality, be convenient to use, and low cost.

As a digital transmission device, firstly, a CCD camera and a codec device are mainly used for video conferencing service or Internet broadcasting. Secondly, a small web camera belonging to a personal computer and some video conferencing hardware and software connected thereto are used. There is an internet broadcasting device.

However, first, the codec / decoder equipment, which is hardware, is a problem on the equipment, and its price is very expensive and difficult to operate. As a result, small broadcast program makers are burdened. In addition, a power unit is required for the operation of the codec equipment because the power consumption is large, and since the enormous heat is generated in the power unit, a cooling device is required. Therefore, due to the power unit and the cooling device, there was a problem that the codec equipment is bulky and heavy, and also because the power consumption is large and heavy, it is difficult to secure power when making outdoor live broadcasting and documentary production such as field coverage, and moving and installing There was a problem that it is not easy to interfere with the instantaneous broadcasting.

In addition, there is a problem that the transmission quality is significantly reduced, such as the frame is frequently cut off when there is a lot of traffic during the real-time broadcasting through the Internet because it requires a lot of transmission capacity.

On the other hand, as a problem outside of the equipment, manpower for camera operation is entirely required when producing internet live broadcasting programs, and when the distance between the cameraman and the codec equipment operator is far away, it is difficult to communicate with them. There was a problem.

Second, the web camera method has a problem in that the quality of the frames per second is reduced to 1 to 15 frames, and above all, it is impossible to capture a voice, and it is practically used for internet broadcasting because it cannot be compressed and only real time transmission is possible with JPEG. There was a problem. In addition, the web camera used here was not zoom in / out and pan / tilt, so it could not be called for broadcasting.

The present invention has been made to solve the above problems, in particular, while installing an unmanned remote module, which is a remotely controllable video and audio capture equipment in a live broadcasting area, the operator transmits the remote module via the wired / wireless Internet in a remote control center. By watching the video and audio in real time and controlling the remote module at the same time, it is possible to live broadcast to each subscriber in real time, providing low-cost broadcasting equipment that is easy to operate and has excellent video and transmission quality, and eliminates on-site relay manpower to reduce program production costs. An object of the present invention is to provide an unmanned remote module for internet live broadcasting and a remote control device thereof.

Such an object of the present invention includes a control center comprising a streaming server and a VOD server for receiving video and audio data through a network line and storing the same in a buffer; A control subscriber and a service center communicating with a real time communication protocol through a subscriber network line; In the Internet broadcasting system consisting of a subscriber computer with a program for displaying the video and audio data, a graphic user interface method by receiving the video and audio data transmitted from the remote module through a wired / wireless control network in real time. A display unit for displaying an image, an encoder control unit for controlling an encoding board and a camera control remote program of the remote module while encoding the video and audio by the encoding board, and zooming in / out, pan / A control server with a built-in remote control program that consists of a tiltable camera control unit to display a graphic;

A control servomotor remotely controlled by the operation of the control interface is installed and a camera for capturing an image, a microphone for capturing sound, a sound card for converting the sound signal into digital data, and the video signal as digital data. Encoder comprising a converter for converting, an encoding unit for encoding the digital data, and a memory unit having a buffer function of the digital data to mix the converted video and audio data, and encode the mixed video and audio data into a real-time stream file. A board, a communication card, a video card, a memory, and a microprocessor are installed and receive the encoded stream file and convert it according to a real-time protocol, and receive camera and encoder control signals of a remote control program of the control server. Encoding board and camera It outputs a control signal, and the control server is composed of a hard disk with a built-in remote program consisting of a camera control and an encoding program for outputting the output signal to the encoder and the camera through the internal bus of the main board, the control server is a network line for wired and wireless control It is achieved by including a plurality of remote modules having individual IP addresses so that they can be controlled via the Internet protocol and controlled by each.

1 is an overall configuration diagram of an internet live broadcast including the present invention

Figure 2 is a circuit block diagram showing the configuration and signal flow of the remote module of the present invention

3 is a circuit block diagram showing an encoding board according to the present invention.

4 is a flow chart of the Internet live broadcasting operation according to the configuration of the present invention

-Explanation of symbols for the main parts of the drawings-

10: control server 20: streaming server

30: VOD server 40: Remote module

41: camera 42: microphone

43: encoding board 44: main board

45: CPI 46: Memory

47: hard disk 50: subscriber computer

Hereinafter, the configuration and operation of the present invention will be described in detail with reference to the accompanying drawings.

Figure 1 shows the overall configuration of the Internet live broadcasting including the present invention, Figure 2 is a circuit block diagram showing the configuration and signal flow of the remote module of the present invention, Figure 3 is a circuit showing an encoding board according to the present invention Figure 4 shows a block diagram, Figure 4 shows the flow diagram of the Internet live broadcast operation according to the configuration of the present invention.

According to the present invention, a streaming server (real-time transmission server) 20 and a VOD (Video On Demand) which communicate with an Internet protocol through a network line (communication network such as the Internet) to receive and store video and audio data in a buffer. A control center consisting of a server (on-demand video server) 30; A control subscriber and a service center communicating with a real time communication protocol through a subscriber network line; In the Internet broadcasting system consisting of a subscriber computer (50) equipped with a program for displaying the video and audio data, the video and audio data transmitted from the remote module (40) through a wired / wireless control network line in real time to receive graphics A display unit for displaying a user interface method (GUI), and an encoding board 43 of the remote module 40 and a camera control remote program while controlling the display unit to encode video and audio by the encoding board 43. (ASF, MPEG-1, 2, 4) encoder control unit and a camera control unit that can zoom in / out (Pan / Tilt) the camera 41, the graphical user interface A control server 10 equipped with a remote control program for displaying in a GUI method;

A control servomotor (not shown) remotely controlled by the operation of the control interface is installed and a camera 41 for capturing an image, a microphone 42 for capturing voice, and a sound for converting the voice signal into digital data. A card, an A / D converter 43a for converting the video signal into digital data, an encoder 43b for encoding the digital data, and a memory 43c having a buffer function of the digital data. Encoding board 43 for mixing audio data, encoding the mixed video and audio data into a real-time stream file, and outputting to the main board 44 via an internal bus 43d, and a communication card (LAN). , PCMCIA, etc.), video (VGA) card, memory, and microprocessor are installed, and the encoded stream file is input and framed according to real-time protocol. Receives the camera and encoder control signals of the main board 44 and the remote control program of the control server 10 to convert and outputs a signal for controlling the encoding board 43 and the camera 41, the output signal is The control server 10 includes a hard disk 47 mounted with a remote program consisting of an encoder 43b and a camera control and an encoding program which are output to the encoder 43b and the camera 41 through an internal bus. It is configured to include a plurality of remote modules 40 having a separate IP address to be communicated by the Internet protocol over the network line, thereby controlling each.

To control the camera 41 in the remote module 40 in real time, such as zoom in / out, pan / tilt, a control interface such as a joystick is connected to the camera controller of the remote control program in a graphical user interface. .

The hard disk 47 is preferably a SCSI hard disk, the camera 41 is a CD camera, and the subscriber computer 50 has a real time stream such as a streaming player or a media player. It is preferable to install a program for processing files ASF, MPEG-1, 2, and 4, and the wired network lines of the control center and the remote module 40 are preferably T1 or E1 level.

All data input / output into the remote module 40 are serially transferred by the serial input / output controller 48.

In addition, the streaming server 20 and the VOD (VOD) server 30 may be installed in a separate place such as an Internet data center that can be separated from the control server 10 and controlled through a network, Only the (VOD) server 30 may be installed in a separate place. In addition, the camera 41 and the microphone 42 may also be configured separately from the remote module 40.

The streaming server 20 and the VOD server 30 are provided with a web server 70 and a DB server 80 to which a service subscriber is connected.

On the other hand, the remote control program consisting of a display unit, encoder control unit, the camera control unit is displayed in the graphic screen so that the three components to process the video and audio data transmitted from the remote module 40 in real time.

The remote program consisting of a camera control program and an encoding program controls and encodes the camera according to the control signal of the remote control program.

Referring to the operation of the present invention configured as described above in detail.

Figure 1 shows the overall configuration of the Internet live broadcasting, including the configuration of the present invention, as shown in the remote module 40 installed at the remote site of the coverage / shooting and live broadcasting, control center and wired and wireless network lines (xDSL, LAN, etc.) Are connected to each other through internet protocol (IP / ICMP / ARP / RARP) to send and receive signals to each other, and the control center and service subscribers are subscriber network lines such as ATM, xDSL, CABLE, and wireless (satellite). It is connected through the real-time protocol such as HTTP / RSTP / RTP / TCP / UDP.

The remote module 40 is installed directly at the coverage site to collect the video and audio collected in each site, encode it, and then digitally signalize the control server 10 and connected to each other in the control center through the Internet network and Real-time transmission to the streaming server 20.

Through the streaming server 20 and the VOD server 30 of the control center, the subscriber can enjoy live broadcasts of video and audio data transmitted from the remote module 40 by software such as a streaming player or a media player on a computer. Will be.

That is, the present invention is to enable unmanned live broadcasting by centralized monitoring and control.

Figure 2 is a circuit block diagram showing the configuration and signal flow of the remote module of the present invention, the remote module 40 of the present invention is permanently installed, such as events, sports scenes, natural documentary production and long-term flora and fauna research field Temporarily installed.

The video and audio signals captured and received in the field by the camera 41 and the microphone 42 are captured by the A / D converter 43a as shown in the circuit block diagram of the encoding board shown in FIG. The video and audio signals are converted into digital signals, and the video and audio signals are mixed by the encoder 43b, and the mixed video and audio signals are compressed and encoded into ASF or MPEG-1, 2, 4 signals which are real-time stream files, and the main board (Main) board) (44).

The main board 44 has a built-in communication LAN card (such as an Ethernet card), a VGA card, and a sound card. Here, the mixed signals are framed according to the Internet protocol, and then the CPU 45 and the memory ( 46) is transmitted to a control center or Internet data center (IDC) for live broadcasting by a wired or wireless network line (xDSL, LAN, etc.) or stored in a hard disk (HDD) 47 for recording broadcasting.

The CAPI 45 renders video and audio signals into a final file by controlling a remote program, and the memory 46 is used when rendering the edited video and audio signals.

On the other hand, the hard disk 47 is equipped with a remote program linked to the remote control program.

This remote program basically runs in MS-Window environment (or Linux, X-window) which is OS, and integrates camera control program and encoding program. The remote program receives the encoder board 43 and the camera control signal transmitted from the control server 10 through the network line in the IP format (Internet protocol) to generate a signal for directly controlling the encoder 43b and the camera 41. This signal is transmitted to the encoder 43b and the camera 41 through the internal bus of the main board 44, respectively.

The camera control program is connected to the camera control unit of the remote control program to control the camera 41 by the remote control signal, and the encoding program is connected to the encoder control unit of the remote control program and the image of the scene by the remote control signal. And compressing the audio signal into a real time stream file.

In other words it is possible to control the CODEC (Co mpression / Dec ompression) type and the frame, the screen size and sound-related settings by remote control from a remote program.

The difference between the invention and prior art is configured as a codec (Co der / oder Dec) of the conventional hardware to the hardware encoding board 43 and a software codec (Co mpression / Dec ompression).

Figure 4 is a flow chart of the Internet live broadcast operation according to the configuration of the present invention, including the above-described details in detail the overall implementation flow of the Internet live broadcast including the present invention as follows.

The operator in the control center is mounted on the control server 10 to control the remote module 40 of the remote location while viewing the display unit graphical screen by the remote control program having a display unit, encoder control unit, camera control unit.

This process is as follows.

The control signal generated by the real time operation of the joystick, which is a control interface connected to the camera control unit of the graphic screen, is transmitted in real time to the remote module 40 located at a remote place through the Internet network. In this case, each remote module 40 installed at different live broadcasting sites has a respective IP so that an operator can control a specific remote module 40 at a remote location through an Internet protocol.

The camera control signal transmitted from the control server 10 controls the CPU 45 of the corresponding remote module and is directly transmitted to the control servomotor (not shown) inside the camera 41 by the CPU 45. According to the control signal, the camera 41 performs zoom in / out and pan / tilt operations to capture an image of a covering site to every corner.

And the microphone 42 receives the voice of the coverage site.

In this way, the operator views the captured video and audio signals captured in real time on the graphic screen by the display unit, and controls the encoder 43b of the encoding board 43 by the operation of the encoder control unit by the joystick. Compression encoding is done with ASF, MPEG-1, 2, and 4. This stream file is transmitted to the service subscriber.

Meanwhile, the streaming server 20 and the VOD server 30 may be configured together with the control server 10 in the control center, but FIG. 4 shows that the streaming server 20 and the V audio server 30 are separately configured in the Internet data center (IDC).

Here, the video and audio signals captured by the remote module 40 and transmitted through the Internet are simultaneously transmitted to the streaming server 20 as well as the control server 10 in real time. The streaming server 20 stores this in a buffer and transmits it to the connected subscriber.

In this way, the service subscriber can access the real-time stream file transmitted from the remote module 40 and stored in the streaming server 20 and the VOD server 30 and download the file.

First of all, the service subscriber receives the subscriber's request (Reply), that is, the subscriber's confirmation through the subscriber network such as ATM, xDSL, CABLE, wireless (satellite), etc. .

Then, the streaming server 20 and the VOD server 30 are connected to the web server 70, and the video and audio data provided in the form of recording or live broadcast are transmitted to a real-time protocol such as HTTP / RSTP / RTP / TCP / UDP. By receiving the real time from the DB server (80) by the service subscriber will be able to watch live video and audio of the field through the software such as streaming player or media player.

In addition, even in the case of a television set 60 having a set-top box instead of a computer, the set-top box receives and decodes a real-time stream file that has been encoded so that a service subscriber can watch a video.

As described above, the present invention enables unmanned live broadcasting without a field relay agent by remotely controlling a camera and encoding a remote control program of a control server and a remote program of a remote module.

As described above, in the present invention, first, an operator installs an encoding board integrated with a camera at a shooting / covering site without using a bulky and expensive codec, which is conventional hardware, and mounts an encoding program on a hard disk. Video and audio signals can be encoded remotely by the encoder and encoder of the encoding board, minimizing the cost of the equipment. Also, by adopting the unmanned remote control method, it is easy to operate and requires little manpower. It can drastically shorten the cost and time for producing a broadcast program. In addition, the Internet broadcasting equipment can be drastically reduced.

Therefore, the internet service companies, which are soaring recently, are able to produce and supply various interactive internet broadcasting programs at low cost by using the present invention, thus contributing greatly to opening up a high information age. You can do it.

Second, although the conventional web camera did not capture sound, the present invention can capture video and audio by making the camera and microphone integrally, and the conventional web camera can compress only with JPEG, but the present invention provides a real time stream. Compression encoding is possible with files ASF, MPEG-1, 2, 4, and the conventional web camera does not have a zoom in / out and pan / tilt function. It is.

In addition, it is possible to build a remote multi-party video conferencing and video chat system using the present invention. That is, it is possible to configure a real-time video conferencing and video chat system having a high quality video and transmission quality, wherein the remote modules are installed around the video conference participants remotely separated from each other, so that each remote module has the appearance of each meeting attendee. It acquires the voice and transmits it to the video conferencing server located remotely through the Internet. Each meeting participant can connect to the video conferencing server and talk in real time.

And by selecting and installing a number of remote modules in the studio, exhibition, and event site, live broadcasting of events is possible without on-site relay personnel, and by operating remote modules for natural documentary, plant and animal ecological research observation, which requires a long time for production. Compared to this, the program can be easily produced.

Claims (4)

A control center consisting of a streaming server and a VOD server for receiving video and audio data and storing them in a buffer by communicating through an internet protocol through a network line; A control subscriber and a service center communicating with a real time communication protocol through a subscriber network line; In the Internet broadcasting system consisting of a subscriber computer equipped with a program for displaying the video and audio data, A display unit for receiving in real time video and audio data transmitted from a remote module through a wired / wireless control network line, and displaying in a graphical user interface method (GUI), and a remote program for controlling an encoding board and a camera of the remote module while viewing the display unit. Control server is equipped with an encoder control unit for controlling the video and audio encoding by the encoding board to control the camera, and a camera control unit that can zoom in / out, pan / tilt the camera to display in a graphical user interface method Wow; A control servomotor remotely controlled by the operation of the control interface is installed and a camera for capturing an image, a microphone for capturing sound, a sound card for converting the sound signal into digital data, and the video signal as digital data. A / D converter to convert, the encoder to encode the digital data and the memory having a buffer function of the digital data to mix the converted video and audio data, and encode the mixed video and audio data into a real-time stream file And an encoding board for outputting to the main board through an internal bus, and a communication card, a video card, a memory, and a microprocessor are installed. The main board converts the frame file into a real-time protocol and receives the encoded stream file. And a remote control program of the control server Receives a camera and encoder control signal of the camera and outputs a signal to control the encoding board and the camera, the remote program consisting of a camera control and encoding program for outputting this output signal to the encoder and the camera through the main board internal bus Unattended remote module for internet live broadcasting, comprising a plurality of remote modules having individual IP addresses so that the control server can communicate with the Internet protocol through a wired / wireless control network line and control each by the hard disk. And its remote control device. The control interface of claim 1, wherein the control interface is connected to the remote control program of the control server in a graphic user interface to enable real-time operation of the camera in the remote module such as zoom in / out, pan / tilt, and the like. Internet unmanned remote module for live broadcasting and its remote control device, characterized in that configured by connecting. The unattended remote module for live broadcasting of the Internet and the remote control apparatus of claim 2, wherein the control interface comprises a joystick. 2. The unmanned remote module for internet live broadcasting and remote control apparatus according to claim 1, wherein the camera and the microphone are separated from the remote module.