WO2011052960A2

WO2011052960A2 - Real-time data transmission control system and control method thereof

Info

Publication number: WO2011052960A2
Application number: PCT/KR2010/007361
Authority: WO
Inventors: 김대원; 한상훈; 신성문; 진선영
Original assignee: 주식회사 인비전트
Priority date: 2009-10-28
Filing date: 2010-10-26
Publication date: 2011-05-05
Also published as: WO2011052960A3; KR100968266B1

Abstract

The present invention relates to a real-time data transmission control system and a control method thereof, and more specifically, to a system and a control method for controlling the size of data per second in a multimedia stream transmitted according to the state of a varied communication network. The system comprises: an interface unit which receives an image signal from an external image acquisition device; an encoding unit which encodes the received image signal on the basis of a plurality of encoding parameters; a communication unit which transmits the encoded image signal to an external device through the communication network; and a controller which confirms the communication environment of the communication network, and performs at least one control operation among first and second control operations so that the data size of the transmitted image signal which has been encoded may be adjusted in real time according to the confirmed communication environment, wherein the first control operation controls the encoding unit by controlling at least one of the plurality of encoding parameters, and the second control operation controls the communication unit by controlling the number of frames that constitute the transmitted image signal which has been encoded, so that some of the frames that constitute the encoded image signal may be transmitted to the external device.

Description

Real time data transmission control system and its control method

The present invention relates to a real-time data transmission control system and a control method thereof, and more particularly, to a system and a control method for controlling the data size per second of a multimedia stream transmitted according to the state of a variable communication network.

In general, in the case of a live broadcast service for transmitting a multimedia stream including video and audio in real time through a communication network, a method using a relay car, a method using wired communication, and a method using wireless communication are used. In this case, the multimedia stream is a form of data capable of reproducing video and / or audio in real time.

However, when a real time multimedia stream must be transmitted to a broadcasting station at a coverage site using a relay car, it was difficult to deal with an urgent live broadcast due to lack of maneuverability and lack of maneuverability when there is a coverage site in an area where the relay car cannot enter. . In addition, the wired network is limited to use wired communication at the coverage site, which is inappropriate for handling live broadcasting.

Therefore, as the wireless communication network technology has been recently developed, a method of transmitting a multimedia stream in real time using a wireless communication network is used. However, bandwidth problems, transmission instability due to jitter, and connection state change due to radio wave shading are still solved. It remains a problem to be done.

An object of the present invention is to control the size of data to be transmitted so that data can be transmitted without delay in the case of transmitting data in real time under a communication environment of a variable communication network.

An object of the present invention is to ensure the quality of data to be transmitted even if the size of the data is small.

Another object of the present invention is to allow the user to remotely control the data transmission of the terminal.

In order to achieve the above object, the terminal of the present invention, the interface unit for receiving a video signal from an external image acquisition device; An encoding unit encoding the received video signal based on a plurality of encoding parameters; A communication unit for transmitting the encoded video signal to an external device through a communication network; And confirming a communication environment of the communication network and performing at least one of a first control operation and a second control operation so that the data size of the encoded and transmitted video signal is adjusted in real time according to the identified communication environment. And a control unit, wherein the first control operation controls the encoding unit by controlling at least one of the plurality of encoding parameters, and the second control operation includes only some of the frames constituting the encoded video signal. And controlling the communication unit by controlling the number of frames constituting the encoded and transmitted video signal to be transmitted to the external device.

In order to achieve the above object, the video signal receiving apparatus of the present invention comprises: a communication unit for receiving the encoded video signal from a terminal for encoding a video signal based on a plurality of encoding parameters through a communication network; And identifying at least one control signal of the first control signal and the second control signal so that the data size of the encoded and transmitted video signal is adjusted from the terminal according to the identified communication environment. And a controller for generating and transmitting the generated at least one control signal to the terminal through the communication unit, wherein the first control signal controls at least one of the plurality of encoding parameters, and the second control signal. The control signal may be configured to control the number of frames constituting the encoded and transmitted video signal such that the terminal transmits only some of the frames constituting the encoded and transmitted video signal.

In addition, in order to achieve the above object, the video signal communication system of the present invention includes a video signal communication system, the communication system including a terminal and a video signal receiving device, wherein the terminal receives a video signal from an external video acquisition device. An interface unit for receiving; An encoding unit encoding the received video signal based on a plurality of encoding parameters; A first communication unit which transmits the encoded video signal to the video signal receiving apparatus through a communication network; And confirming a communication environment of the communication network and performing at least one of a first control operation and a second control operation so that the data size of the encoded and transmitted video signal is adjusted in real time according to the confirmed communication environment. And a first control unit, wherein the video signal receiving apparatus comprises: a second communication unit receiving the encoded and transmitted video signal from the first communication unit; And a second control unit, wherein the first control operation controls the encoding unit by controlling at least one of the plurality of encoding parameters, and the second control operation comprises: a frame constituting the encoded video signal. The first communication unit is controlled by controlling the number of frames constituting the encoded and transmitted video signal such that only a part of them is transmitted to the video signal receiving apparatus.

According to the present invention, it provides the effect that data can be transmitted without delay even when the communication environment of the communication network is deteriorated.

According to the present invention, it provides an effect of protecting the image quality even if the size of the transmitted data is reduced.

According to the present invention, it provides the effect that the user can remotely set the quality of the transmitted data.

1 illustrates a system associated with one embodiment of the present invention.

2 illustrates a system associated with one embodiment of the present invention.

3 is a diagram illustrating a terminal and a connection device of the present invention.

4 and 5 are side views illustrating the terminal of the present invention.

6 is a block diagram of a terminal related to an embodiment of the present invention.

7 is a block diagram of a server related to an embodiment of the present invention.

8 is a block diagram illustrating a user terminal associated with one embodiment of the present invention.

9 is a flowchart illustrating a video signal transmission method according to an embodiment of the present invention.

10 is a flowchart illustrating a video signal transmission control method according to an embodiment of the present invention.

11 is a flowchart illustrating a video signal transmission control method according to another embodiment of the present invention.

12 is a view for explaining a video signal transmission control method of the present invention.

13 is a view for explaining a video signal transmission control method of the present invention.

14, 15, 16, and 17 are flowcharts of a video signal transmission remote control method according to an embodiment of the present invention.

18, 19, and 20 illustrate a communication environment display unit and an input unit of a terminal.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like numbers refer to like elements throughout. In addition, when it is determined that the detailed description of the known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

First, referring to Figures 1 and 2, a schematic configuration of a live broadcast system according to an embodiment of the present invention will be described. 1 illustrates a system associated with one embodiment of the present invention.

As shown in FIG. 1, the live broadcasting system 1 may include an image acquisition device 10, a terminal 100, a server 200, and a user terminal 300.

The image acquisition device 10 may include a device used to acquire a general video such as a camcorder and a camera. The image acquisition apparatus 10 may not only acquire a video, but also obtain audio information.

The server 200 may be configured as a general server capable of receiving, storing, and transmitting data. The data may include both video and audio signals.

The image acquisition apparatus 10 and the server 100 are connected by a communication network. The network is, for example, Ethernet or WIMAX (provided by IEEE 802.16), WIBRO (provided by IEEE 802.16e) (also referred to as 'mobile WIMAX'), WIFI (provided by IEEE 802.11), and high-speed packets that extend WCDMA. It may be connected to a wired or wireless communication network including communication standards HSDPA, EVDO rev.A, and HSUPA (High Speed Uplink Packet Access). In addition, it is a matter of course that the technical idea of the present invention can be applied to any wired or wireless communication network used in the future.

The server 200 and the user terminal may be connected to the communication network described above.

The user terminal 300 may receive, store, transmit and play data from the server 200. In addition, the user terminal 300 may receive data directly from the terminal 100, not from the server 200. The user terminal 300 may include, for example, a PC, a PDA, a mobile phone, a PMP, a navigation device, a TV, a DTV, a broadcast station, and an IPTV. The user terminal 300 may be connected to another user terminal 300.

Each configuration of the live broadcast system 1 may be connected as follows.

The image acquisition apparatus 10 may obtain an image and / or an audio signal and transmit the image and / or audio signal to the terminal 100.

The terminal 100 may encode video and audio signals. The terminal 100 may transmit the encoded video and / or audio signal to the server 200 through a communication network.

The server 200 may generate a control signal for controlling the operation of the terminal 100 as necessary. The server 200 may transmit the transmitted video and / or audio signal to the user terminal 300 through a communication network. The server 200 may store the transmitted video and / or audio signal.

The terminal 100, the server 200, and the user terminal 300 may include a modem for data communication through the communication network. The modem may be built in the terminal 100, the server 200, and the user terminal 300, or may be connected by a connection terminal provided in each terminal.

The user terminal 300 may decode and play the transmitted video and / or audio signal. In addition, a control signal for controlling the operation of the terminal 100 may be generated as necessary. In this case, the control signal generated by the user terminal 300 may be transmitted by the server 200 to the corresponding terminal 100, and may be transmitted directly from the user terminal 300 to the terminal 100.

2 illustrates a system associated with one embodiment of the present invention.

The live broadcasting system 1 may include a plurality of image acquisition apparatuses 1, a terminal 100, a server 200, and a user terminal 300, respectively. Since the plurality of image acquisition apparatuses 1 and the terminal 100 are included, a plurality of live broadcasts may be simultaneously provided to the server 200. By providing a plurality of the server 200, it is possible to distribute the reception, storage, and transmission functions.

The components shown in FIGS. 1 and 2 are not essential, such that a multimedia transmission system having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

3 is a diagram illustrating a terminal and a connection device of the present invention. Referring to FIG. 3, various external devices may be connected to the terminal 100. For example, the image acquisition device 10, the Internet, a modem, a laptop and an external battery may be connected.

4 and 5 are side views illustrating a terminal 100 according to an embodiment of the present invention. A display unit 104, an interface unit 130, and an input unit 170 that can be connected to the terminal 100 are illustrated.

For example, the display unit 104 displays various information about the terminal 100.

The interface unit 130 has a USB port 102, a charging adapter connection unit 110, an SD card connection unit 118, an Internet connection unit 120, an A / V input unit 112, and an A / V output unit 114. May be included. The USB port 102 supports a connection to an external device through a USB interface. For example, it is used to connect WiFi modem, WIBRO modem, GPS device. The charging adapter connection unit 110 is an example of the power supply unit 160. The charging adapter connection unit 110 is connected to the charging adapter to supply power to the terminal 100. The SD card connection unit 118 is a slot to which an external SD memory can be connected. Internet connection 120 is a slot to connect the RJ45 Ethernet cable. The AV input unit 112 is a terminal for connecting an AV (audio / video) input cable, and the AV output unit 114 is a terminal for connecting an AV output cable.

The input unit 170 provides a function for setting the terminal 100 and includes a key input unit.

The key input unit includes a reset unit 106 for turning the terminal 100 off and on, and a switch 108 as a button for controlling the terminal 100. The switch 108 may be configured, for example, of a wheel type.

6 is a block diagram of a terminal 100 according to an embodiment of the present invention.

The terminal 100 may include a display unit 104, an interface unit 130, an encoding unit 140, a communication unit 150, a power supply unit 160, an input unit 170, and a controller 190.

The display unit 104 may display various types of information related to the operation of the terminal. For example, the display unit 104 may determine the parameters such as the bit rate, the number of frames per second, the resolution, the length of the image set and other terminal states, whether to compress audio, the audio bit rate, the sample rate, and the network connection state. Can be represented.

The interface unit 130 receives a video signal consisting of one or both of video and audio from the image acquisition apparatus 10 through the S-Video and RCA terminals, the NTSC (National Television System (s) Committee) method and the PAL ( Phase-Alternating Line, Phase Alternation by Line, or Phase Alternation Line). There are many other ways to support it.

Audio is received via the RCA jack, with analog (stereo) audio using two RCAs and analog (mono) audio using one RCA. In addition to RCA, an additional optical cable may be used. The video may be received by a composite method of receiving an image signal with one RCA strand, a component method consisting of three RCA strands, and S-Video, HDMI, component, SDI, etc., which are called S terminals or S-VHS.

The encoder 140 converts the analog data received from the image acquisition apparatus 10 into a digital signal and compresses the converted digital data. For example, an image may use an H.264 (Advanced Video Coding) codec, and voice may be compressed using an AAC (Advanced Audio Coding) codec.

Parameters used when encoding may include a bitrate associated with an image, a frame per second (fps), a resolution, and a length of a group of picture (GOP). It may also include sample rates, bitrates, and channels associated with speech. The parameters are examples only and other parameter values may be added.

The bit rate may be defined as the number of bits processed for each specific time unit (seconds). The number of frames per second may be defined as the number of screens displayed for one second. The resolution may be defined as the number of pixels used to represent one frame, which is usually expressed in the form of multiplying the number of pixels by the number of pixels by the number of pixels by the width. The length of the image set may be expressed as an interval between an I frame and an I frame, which is an anchor frame.

The parameters may be set in advance, by the controller 190 of the terminal 100 according to the environment of the communication network, or by remote control in the server 200 or the user terminal 300.

The communicator 150 may include a memory 152, a wired communication module 154, and a wireless communication module 156.

The memory 152 may be, for example, a buffer in which encoded data is temporarily stored before being transmitted to the server 200. The memory 152 is not limited to being located in the communication unit 150. For example, the memory 152 may constitute the terminal as an independent component of the communication unit 150.

The wired communication module 154 and the wireless communication module 156 may have a function of transmitting encoded data to the outside of the terminal 100 and receiving a signal from the outside. In this case, the encoded data is a Real Time Streaming Protocol (RTSP, RFC 2326) and a Real-time Transport Protocol (RTP) or Real Time Messaging protocol. Protocol (RTMP), and to the server 200 via its own protocol.

The power supply unit 160 supplies power to the terminal 100. The terminal 100 may itself have a built-in battery.

The input unit 170 may make settings related to the parameters and the other terminal 100. The controller 190 described below through the input setting value may generate a control operation for controlling each component.

The controller 190 includes all components including the interface unit 130, the encoding unit 140, the communication unit 150, the display unit 104, the power supply unit 160, and the input unit 170 of the terminal 100. And control the overall operation. In particular, the encoding unit 140 and the communication unit 150 may be controlled according to the communication environment of the communication network.

7 is a block diagram of a server 200 related to an embodiment of the present invention.

The server 200 may include a communication unit 210, a control unit 250, and a storage unit 260.

The communication unit 210 may include a wired communication module 212 and a wireless communication module 214.

The communication unit 210 performs a reception and transmission function. That is, based on a plurality of parameters, encoded data is received from the terminal 100. The communication unit 210 may transmit a control signal to the terminal 100 and may transmit the multimedia stream to the user terminal 300. The multimedia stream here refers to encoded video and / or audio signals.

The controller 250 may control all components of the server 200 and may control a control signal to be transmitted to the terminal 100. In this case, accessing the terminal 100 may be performed anywhere if a public IP is assigned. However, it may be convenient to connect through a virtual private network (VPN) because the private IP is required in an environment such as EVDO or WIFI.

The controller 250 may also convert the received data into various protocols. For example, the received data may be converted into RTSP and RTP protocols for an IPTV service, and converted into RTSP and HTTP protocols for a mobile service and transmitted to the user terminal 300 through the communication unit 210.

The storage unit 260 may store the multimedia stream transmitted from the terminal 100 in the form of a media file. The stored multimedia stream can be directly played online through a VOD server without a separate format conversion. Also, the played multimedia stream may be stored in a format that can be played in a general media player.

In addition, the server 200 may further include an input unit 240 and an output unit 230 to control the terminal 100 and / or the server 200.

The components of the server 200 described above are not essential components in this case, may be omitted as necessary, and another component may be added.

The user terminal 300 may include a communication unit 310, a decoding unit 320, an output unit 330, an input unit 340, a control unit 350, and a storage unit 360.

The user terminal 300 may be connected to the server 200 through a communication network.

The communication unit 310 may access the server 200 and receive a multimedia stream through the RTSP / RTP protocol. In addition, a control signal generated by the controller 350 may be transmitted to the terminal 100 through the server 200. Herein, the control unit 250 of the server 200 may perform a function of finding and transmitting a corresponding terminal 100.

The decoder 320 may receive the multimedia stream from the communication unit 310, decode the received data through a codec filter, and convert the received data into data that can be processed by a renderer (not shown).

The output unit 330 may include a playback unit.

The playback unit may play the decoded multimedia stream video and audio through a renderer. At this time, the synchronization is performed so that the video and audio do not deviate so that a delay does not occur. Through this, the multimedia stream can be reproduced optimally even in a deteriorated communication network.

The output unit 330 transmits the reproduced multimedia stream to the outside of the workstation through the DVI-D port, and the transmitted multimedia stream can be broadcasted through a scan converter (SD-SDI, HD-). SDI).

The input unit 340 may control the user terminal 300 and generate a control signal necessary for controlling the terminal 100.

The storage unit 360 may store the transmitted multimedia stream.

Hereinafter, an operation method of a live broadcasting system according to an embodiment of the present invention will be described in detail. The operating method of the live broadcasting system according to an embodiment of the present invention may be implemented in the live broadcasting system according to the embodiment of the present invention described above, or may be implemented by a system having a different configuration. However, for convenience of description, in describing the operation method, reference is made to the configuration shown in FIGS. 1 to 8. The video signal receiver or external device described below may include the server 200 and the user terminal 300.

In the video signal transmission method according to the present invention, the interface unit 130 of the terminal 100 receives a video signal from the image acquisition apparatus 10 (S810), and the encoding unit 140 encodes the received video signal. In step S820, the communication unit 150 transmits the converted multimedia stream to an external device.

10 is a flowchart illustrating a video signal transmission control method according to an embodiment of the present invention. The communication environment of the communication network between the terminal 100 and the

external devices

200 and 300 is variable. Therefore, in order to transmit / receive a multimedia stream without interruption, it is necessary to control the data size per second according to the state of the communication network. The embodiment of FIG. 10 further includes a control method in the flowchart of FIG. 9.

First, the communication environment of the communication network between the terminal 100 and the

external devices

200 and 300 is checked (S910).

The communication environment may be calculated by the data size of the multimedia stream waiting to be stored in the memory 152 of the terminal 100 or the signal strength of the communication network, and the calculated result may be monitored in real time.

That is, the multimedia stream is temporarily stored in the memory 152 according to the transmission state, and the goodness of the communication environment can be known through the data size of the stored multimedia stream or the empty memory 152.

The signal strength may also be known through round trip time or Received Signal Strength Indication (RSSI). The communication environment may be confirmed by the display unit 104 of the terminal and the

output units

230 and 330 of the

external devices

200 and 300.

The next process is to set the parameters in real time (S920). This is to set the parameters to a predetermined value corresponding to the communication environment. That is, the bitrate, resolution, length of the image set, and frames per second optimized for each communication environment are prepared in advance. The bitrate and resolution may adjust the data size of the multimedia stream per second, and the length of the image set and the number of frames per second may provide a function for protecting image quality even if the data size per second is reduced.

The controller 190 performs a first control operation for controlling the size of data required for playing the multimedia stream 1 second. The first control operation can be, for example, reducing or increasing the bit rate and resolution. The controller 190 may control the encoder 140 to set the parameter value.

If the bitrate and resolution are reduced when the communication environment is deteriorated, the image quality is deteriorated. To compensate for this, the controller 190 may control the encoding unit 140 to adjust the length of the image set and the number of frames per second. .

That is, by shortening the length of the image set, it is possible to reduce the number of frames not transmitted among the frames constituting the multimedia stream. This can prevent the image from being excessively cut off by dropping the frame.

In addition, by reducing the number of frames per second, it is possible to improve the image quality per frame in which transmission is successful at the same bit rate. Therefore, when setting the bitrate and resolution, it is possible to appropriately control the length of the image set and the number of frames per second to reduce the size of data transmitted per second and to improve the image quality at the same time.

The parameter values may be automatically generated by the controller 190 or directly input through the input unit 170. For example, you can do The bit rate can be set from 64kbps to 10000kbps and can be adjusted in 50kbps units, and resolution is divided into 320x240, 320x480, 352x240, 352x288, 352x480, 426x240, 480x320, 640x240, 640x480, 720x240, 720x480 It can be adjusted, the number of frames per second can be adjusted to 10 fps, 15 fps, 25 fps, 30 fps, for example, and the length of the image set can be set from 15 to 600, for example.

Each of the parameters may be sequentially controlled according to various combination orders. For example, when the communication state deteriorates, the parameter values may be controlled in order of controlling the bit rate first and then controlling the resolution. Conversely, it is also possible to control the resolution first and then control the bit rate.

The image signal received by the image acquisition apparatus 10 may be encoded by the changed parameter value (S930).

The next process is to perform frame dropping (S940). Frame dropping is for responding to a worsened communication environment by not transmitting P frames or B frames of a multimedia stream waiting to be transmitted. In the case of dropping frames, B frames may be dropped first and P frames may be dropped. I frames can also be dropped. However, the drop order between B, P, and I frames is not limited to the above-described order, and may be based on another example.

A concept of frame dropping will be described in detail with reference to FIG. 12. When the length of the image set is 10, it shows that all the frames are transmitted from the terminal 100 to the server 200 before the frame dropping. However, when frame dropping is performed, all P frames after the dropped P frame are dropped, thereby reducing the size of data required for playing the multimedia stream 1 second. Therefore, even if the communication state deteriorates, the multimedia stream can be transmitted without delay. On the other hand, since the image quality may deteriorate when the data size is reduced by frame dropping, the length of the image set and the number of frames per second may be controlled to compensate for this.

The controller 190 controls the communication unit 150 through a second control operation for performing frame dropping.

Through this, the encoded multimedia stream may be transmitted to the external devices 200 and 300 (S950).

After checking the communication environment, the parameter setting step S920 and the frame dropping S940 may be selectively performed. The second control operation may be performed first, and the first control operation may be performed. Detailed description thereof will be described with reference to FIG. 13.

FIG. 13 shows an example of parameter values and frame dropping set according to the confirmed communication state.

First, the case in which the communication state is displayed as an image may be regarded as a case where the maximum data size is transmitted. In this case, the second control operation for dropping the frame is not necessary. In this case, after the communication environment checking step (S910), the intermediate process may be omitted and the process may be immediately proceeded to the transmitting step (S950).

Next, when the confirmed communication state is severely damaged, only the frame dropping may be executed with the parameter value as it is. In this case, it may be regarded as proceeding to the frame dropping step S94 without performing the parameter setting step S920 and the video signal encoding step S930 after the communication environment checking step S910. Conversely, you can use a method of changing only parameter values without dropping frames.

Next, when the confirmed communication state becomes medium, the bit rate and the resolution of the parameter values may be lowered. Where a2 and b2 are smaller than a1 and b1, respectively. Perform frame dropping at the same time. As another example, while the frame dropping is performed, the length of the image set and the number of frames per second may be reduced from c1 and d1 to c2 and d2 without changing the bit rate and resolution. In this case, image quality may be improved.

Next, when the confirmed communication state is lowered, all the parameter values, the bit rate resolution, the length of the image set, and the number of frames per second, can be made smaller than when the communication state is higher. It also performs frame dropping. That is, even if image quality is degraded due to the bit rate and resolution being dropped and frame dropping is performed, the image quality can be appropriately protected by setting the length of the image set and the number of frames per second.

The above process describes a case in which the communication environment deteriorates downward from the top. On the contrary, when the communication environment improves in phase below, the reverse process may be performed in real time to correspond to a changing communication environment.

In the transmitted video signal control method, although not described, an audio signal may also be controlled at the time of encoding. For example, channel control consisting of sample rate, bit rate, and stereo (STEREO) or mono (MONO) is possible.

11 is a flowchart illustrating a video signal transmission control method according to another embodiment of the present invention. Although the embodiment of FIG. 10 prepares a predetermined parameter value and a degree of frame dropping according to a communication environment, the embodiment of FIG. 11 compares a parameter value and a frame in real time by comparing a data size per second of a multimedia stream transmitted with a communication environment in real time. The difference is that the degree of dropping varies.

Between the embodiment of FIG. 10 and the communication environment checking step (S1010) and the parameter setting step (S1040), a step of calculating a transmission speed (S1020) and a step of comparing the transmission speed and the data size per second of the encoded video signal (S1030) are further performed. Including is different.

The controller 190 checks the communication environment and calculates a transmission speed of the communication network (S1020).

The controller 190 compares the calculated transmission rate with the data size per second of the encoded video signal (S1030). The data size per second of the encoded video signal refers to the size of data required to reproduce one second of the multimedia stream.

First, when the communication environment of the communication network is deteriorated and the data size required to play the multi-media stream for one second is larger than the transmission speed of the communication network and thus cannot be reproduced in real time, the control unit 190 is connected to the encoding unit 140 as follows. The communication unit 150 may be controlled.

In other words, by reducing the bit rate and resolution among the encoding parameter values and increasing the amount of frame dropping, it is possible to reduce the data size required to play one second of the multimedia stream. In addition, image quality deteriorated by decreasing data size can be compensated by reducing the length of the image set and the frames per second. Each parameter value setting and frame dropping may be performed separately, and may be superimposed according to the transmission speed of the communication network.

Meanwhile, when the communication environment is improved and the data size per second of the transmitted multimedia stream may be increased, the control unit 190 may control the encoding unit 140 to increase the bit rate and resolution. In addition, the number of frames dropped by the communicator 150 may be reduced.

When the data size per second of the current multimedia stream is appropriate, the controller 190 controls the encoder 140 to maintain the set parameter value, and the controller 190 controls the communicator 150 to maintain the degree of dropping the frame. ) Can be controlled.

14, 15, 16, and 17 are flowcharts of a video signal transmission remote control method according to an embodiment of the present invention. Instead of automatically performing the above-described video signal control method in the terminal 100 or through the input unit 170 of the terminal 100, the multimedia stream receiver can conveniently control the video signal transmission from a long distance.

14 illustrates a terminal 100 and a server 200 that control the terminal 100 through the server 200.

First, the communication unit 150 of the terminal transmits the encoded multimedia stream, the state information displayed on the display unit 104 of the terminal, and information on the terminal communication environment (S1310), and the communication unit 210 of the server receives it. (S1312).

The next process is to determine the communication environment (S1314). The communication environment may be confirmed through information on the communication environment of the transmitted terminal. An IP address assigned to each terminal 100 may be input to the input unit 240 of the server to access information about a communication environment of the corresponding terminal 100.

The user generates a first control signal and a second control signal through the input unit 240 of the server. The first control signal is a signal capable of controlling a plurality of parameter values used when encoding analog data received by the encoding unit 140 of the terminal. The second control signal is a signal capable of controlling frame dropping in the communication unit 150 of the terminal. In generating the first control signal and the second control signal, the user may generate the control signal as described above to correspond to the case where the communication environment is deteriorated and the case where the communication environment is improved. Only the first control signal may be generated or only the second control signal may be generated.

The generated control signal is transmitted to the communication unit 150 of the terminal through the communication unit 210 of the server (S1316). In this case, the controller 250 of the server controls the communication unit 210 of the server so that the first and / or second control signals can be transmitted to a corresponding terminal through an IP address among a plurality of terminals.

The control unit 150 of the terminal controls the encoding unit 140 and the communication unit 150 based on the received control signal (S1318, S1320). The encoding unit 140 performs a first control operation of controlling a plurality of parameter values used in encoding based on the first control signal, and the communication unit 150 drops the number of dropped frames based on the second control signal. Perform a second control operation to control.

The next step is to encode the received analog data with the reset encoding parameter values and send them to the server. Steps S1310 to S1320 may be repeated in real time.

By performing the remote control, it is possible to actively respond to the environment of the variable communication network.

FIG. 15 illustrates a terminal 100 and a user terminal 300 that control the terminal 100 through the user terminal 300. The difference from FIG. 14 is that the encoded video signal is transmitted from the terminal 100 directly to the user terminal 300. Therefore, although the subject was the server 200 in FIG. 14, in the embodiment of FIG. 15, the subject is changed to the user terminal 300, and each step for implementing remote control is the same. Hereinafter, the difference steps will be described.

The encoded video signal and the terminal communication environment information are received through the communication unit 310 of the user terminal (S1332). The output unit 330 reproduces the received video signal (S1334). Therefore, the communication environment may be determined by reproducing the received communication environment information and the image signal. Other steps are the same as the embodiment described with reference to FIG.

FIG. 16 illustrates a terminal 100, a server 200, and a user terminal 300, which controls the terminal 100 through the user terminal 300. The basic configuration is the same as the embodiment in FIG. 14 and FIG. 15.

That is, the encoded video signal and information on the terminal communication environment may be transmitted from the terminal 100 to the user terminal 300 through the server 200.

The user terminal 300 may output the received video signal and generate a control signal based on information on the terminal communication environment. The generated control signal is transmitted to the server 200. The controller 250 of the server may transmit the received control signal to the terminal 100. The controller of the terminal 100 controls the encoding parameter value and the number of dropped frames based on the received control signal. Thereafter, the first step (S1350) can be repeated to perform in real time.

FIG. 17 illustrates a terminal 100, a server 200, and a user terminal 300, which controls the terminal 100 through the server 200. The basic configuration is the same as the embodiment in FIG. 14, FIG. 15, and FIG.

The video signal encoded from the terminal 100 and terminal communication environment information may be transmitted to the server 200. The received video signal may be transmitted to the user terminal 300. The server 200 may generate a control signal and transmit the control signal to the terminal 100. The controller 150 of the terminal may control the encoding parameter value and the number of dropped frames based on the received control signal. Thereafter, the first step (S1370) can be repeated again.

According to the embodiments described with reference to FIGS. 14 to 17, it is possible to directly control the user remotely according to the environment of the communication network, and more efficient when the environment change of the communication network can be predicted. In addition, although the above embodiments deal with video signals, encoding parameter values may also be controlled for audio signals when necessary.

18, 19, and 20 illustrate a communication environment display unit and an input unit of a terminal. 18 to 20 are only examples of information that can be confirmed and expressed through the display unit 104 of the terminal, the output unit 230 of the server, and the output unit 330 of the user terminal.

Referring to FIG. 18, the above table expressed as video includes image selection whether to compress video, resolution expressed in frame size, frames per second expressed in frame rate, bit rate, length of picture set expressed in GOP size, and video timing. It can be seen that the information can be provided, and the user can directly set the above values. The following table, which consists of audio, provides information on voice signal compression selection, bit rate, channel, and sample rate, and can be configured by the user.

Referring to FIG. 19, it can be seen that information about a network, such as a network search order, an IP address, and the like is provided.

Referring to FIG. 20, it can be seen that information about a terminal, such as terminal ID information, a memory, a battery, and an operating system, is provided.

The screens shown in FIGS. 18 to 20 are only examples, and any other information necessary for implementing an embodiment of the present invention may be added.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those of ordinary skill in the art to which the present invention pertains, as described above and the accompanying examples. It is not limited by the drawings. In addition, the embodiments described in this document may not be limitedly applied, but may be configured by selectively combining all or part of the embodiments so that various modifications may be made.

According to the present invention, by adjusting the size of the data transmitted in the communication environment of the variable communication network, a real-time data transmission control system and control method capable of transmitting the data without delay even when the communication environment of the communication network deteriorates. Can be.

Claims

An interface unit for receiving an image signal from an external image acquisition device;

An encoding unit encoding the received video signal based on a plurality of encoding parameters;

A communication unit for transmitting the encoded video signal to an external device through a communication network; And

Verifying a communication environment of the communication network and performing at least one control operation of the first control operation and the second control operation so that the data size of the encoded and transmitted video signal is adjusted in real time according to the confirmed communication environment; Including a control unit,

The first control operation,

Controlling the encoding unit by controlling at least one of the plurality of encoding parameters,

The second control operation,

And controlling the communication unit by controlling the number of frames constituting the encoded and transmitted video signal such that only some of the frames constituting the encoded video signal are transmitted to the external device.
The method of claim 1,

Before the encoded video signal is transmitted, a buffer for temporarily storing the encoded video signal

More,

The control unit,

In order to confirm the communication environment,

Monitoring at least one of a storage state of the buffer and a signal strength of the communication network

terminal.
The method of claim 1, wherein the control unit,

The degree of variability of the plurality of parameters and the number of frames is set to predefined settings according to the goodness of the communication environment.

terminal.
The method of claim 1, wherein the control unit,

Based on the goodness of the confirmed communication environment, sequentially performing the first and second control operations in a predetermined order;

terminal.
The method of claim 1,

The plurality of encoding parameters include at least one of bitrate, resolution, group of pictures length, and frame per second.

terminal.
The method of claim 1,

The video signal includes an audio signal and includes a sample rate and an audio bit rate in the plurality of encoding parameters.

terminal.
The method of claim 5, wherein the control unit,

A terminal for controlling at least one of the length of the image set and the number of frames per second in order to adjust in real time the video quality of the video signal encoded and transmitted.
The method of claim 5, wherein the control unit,

If the communication environment deteriorates,

The first control operation includes reducing the size of at least one of the bitrate, the resolution, the length of the image set, and the number of frames per second;

The second control operation includes reducing the number of frames that make up the encoded and transmitted video signal.
The method of claim 5, wherein the control unit,

When the communication environment is restored,

The first control operation includes increasing at least one of the bit rate, the resolution, the length of the image set, and the number of frames per second;

The second control operation includes increasing the number of frames that make up the encoded and transmitted video signal.
The method of claim 5, wherein the control unit,

Based on the goodness of the confirmed communication environment, sequentially controlling at least one of the bit rate, the resolution, the number of frames per second, and the length of the image set in a predetermined order;

terminal.
A communication unit for receiving the encoded video signal from a terminal encoding a video signal based on a plurality of encoding parameters through a communication network; And

Generating a control signal of at least one of a first control signal and a second control signal to identify a communication environment of the communication network and to adjust a data size of the encoded and transmitted video signal from the terminal according to the identified communication environment; And a control unit for transmitting the generated at least one control signal to the terminal through the communication unit.

The first control signal,

Allow the terminal to control at least one of the plurality of encoding parameters,

The second control signal,

Characterized in that the terminal controls the number of frames constituting the encoded and transmitted video signal so that the terminal transmits only some of the frames constituting the encoded and transmitted video signal,

Video signal receiver.
The method of claim 11,

Further comprising a user input unit,

The control unit,

Generating at least one of the first control signal and the second control signal according to values input through the user input unit;

Video signal receiver.
The method of claim 11,

The communication unit receives information on at least one of the storage state of the buffer provided in the terminal and the signal strength of the communication network,

The controller checks a communication environment of the communication network based on the received information.

Video signal receiver.
In a video signal communication system,

The communication system includes a terminal and a video signal receiving device,

The terminal,

An interface unit for receiving an image signal from an external image acquisition device;

An encoding unit encoding the received video signal based on a plurality of encoding parameters;

A first communication unit which transmits the encoded video signal to the video signal receiving apparatus through a communication network; And

Confirming a communication environment of the communication network and performing at least one control operation of the first control operation and the second control operation so that the data size of the encoded and transmitted video signal is adjusted in real time according to the confirmed communication environment; A first control unit,

The video signal receiver,

A second communication unit receiving the encoded and transmitted video signal from the first communication unit; And

A second control unit;

The first control operation,

Controlling the encoding unit by controlling at least one of the plurality of encoding parameters,

The second control operation,

And controlling the first communication unit by controlling the number of frames constituting the encoded and transmitted video signal such that only some of the frames constituting the encoded video signal are transmitted to the video signal receiving apparatus.

Video signal communication system.
The method of claim 14, wherein the second control unit,

Identifying a communication environment of the communication network, generating at least one of a first control signal for controlling the first control operation and a second control signal for controlling the second control operation, and generating the generated control signal, Transmitted to the terminal through the second communication unit

Video signal communication system.
The method of claim 15, wherein the first control unit,

Performing the first control operation based on the first control signal, and performing the second control operation based on the second control signal.

Video signal communication system.
In the control method for controlling a terminal for encoding and transmitting a video signal,

Receiving an image signal from an external image acquisition device;

Encoding the received video signal based on a plurality of encoding parameters;

Transmitting the encoded video signal to an external device through a communication network;

Confirming a communication environment of the communication network; And

And performing at least one of a first control operation and a second control operation so that the data size of the encoded and transmitted video signal is adjusted in real time according to the identified communication environment.

The first control operation,

Control at least one of the plurality of encoding parameters,

The second control operation,

And controlling the number of frames constituting the encoded and transmitted video signal such that only some of the frames constituting the encoded video signal are transmitted to the external device through the communication network.
In the method of remotely controlling a terminal for encoding and transmitting a video signal,

Receiving a video signal encoded based on a plurality of encoding parameters from the terminal through a communication network;

Confirming a communication environment of the communication network;

Generating at least one control signal of a first control signal and a second control signal such that the data size of the encoded video signal transmitted from the terminal is adjusted according to the identified communication environment; And

And transmitting the generated at least one control signal to the terminal through the communication network.

The first control signal,

Control at least one of the plurality of encoding parameters,

The second control signal,

And controlling the number of the frames such that only some of the frames constituting the encoded video signal are transmitted from the terminal through the communication network.
In the video signal communication control method between a terminal and a video signal receiving apparatus,

Receiving, by the terminal, a video signal from an external image acquisition device;

Encoding, by the terminal, the received video signal based on a plurality of encoding parameters;

Transmitting, by the terminal, the encoded video signal to the video signal receiving apparatus through a communication network;

At least one of a first control operation and a second control operation so that the terminal identifies the communication environment of the communication network and adjusts the data size of the encoded and transmitted video signal in real time according to the identified communication environment Performing an operation; And

And receiving, by the apparatus for receiving video signals, the video signals that are encoded and transmitted.

The first control operation,

Control at least one of the plurality of encoding parameters,

The second control operation,

And controlling the number of frames constituting the encoded and transmitted video signal such that only some of the frames constituting the encoded and transmitted video signal are transmitted to the video signal receiver through the communication network. .