KR101373414B1 - Packet-level video streaming prioritization scheme and system enhancing quality of h.264/avc over mpeg-2 transport stream - Google Patents

Abstract

The present invention relates to a packet-based prioritization transmission method and a system thereof for overcoming problems of a frame-based video streaming prioritization transmission technique and compensating the weak point of an error recovery method when decoding an H.264/AVC. The packet-based video streaming prioritization transmission method includes the following steps of: determining that a transmission packet is not a PAT nor a PMT through a PID about all MPEG-2 TS packets in the transmission packet of a server; identifying whether the transmission packet is an initial packet of a frame or not through PUSI information of a TS packet header; determining the type of the frame based on NRI payload information of an NAL header; and giving a high transmission priority of 0x38 for the WMM wireless transmission of the transmission packet and controlling the PDR value of a PFH according to settings if the frame is determined as a P and B frame which includes the PFH depending on a payload value. [Reference numerals] (AA) Start; (BB) End; (S310) Determine whether it is a PAT and a PMT or not about all MPEG-2 TS packets in a transmission packet; (S320) Identify whether the transmission packet is the first packet of a frame or not through PVSI information of a TS packet header; (S330) Determine the type of the frame based on NRI payload information of an NAL header; (S340) Provide a priority differentially depending on the type of the determined frame

Description

PACKET-LEVEL VIDEO STREAMING PRIORITIZATION SCHEME AND SYSTEM ENHANCING QUALITY OF H.264 / AVC OVER MPEG- 2 TRANSPORT STREAM}

The present invention relates to a packet-based priority transmission method and system for compensating a problem of a frame-based video streaming priority transmission scheme and a weakness of an error recovery method in decoding of H.264 / AVC.

Due to the increasing use of mobile terminals such as smartphones and tablet PCs, traffic over Wi-Fi (IEEE 802.11) networks continues to increase. In particular, as the use of multimedia services such as YouTube and Internet broadcasting increases, video traffic requiring a large amount of bandwidth is rapidly increasing.

However, due to the low bandwidth and technical limitations of current wireless networks, the following problems are caused by the increased use of multimedia services. First, due to the limitation of the large data processing capacity of the public Wi-Fi access point (AP), service connection delays and failures frequently occur. Second, the deterioration of the video transmission environment due to bandwidth saturation is caused by real-time, In the service, video dropout and picture quality deterioration occur, and non-real-time services such as Video On Demand (VOD) also cause frequent buffering due to data loss between transmissions.

In order to cope with such increased multimedia data usage in the mobile terminal and technical limitations of the AP, improvements to wireless network equipment and video transmission technology are required. Therefore, IEEE 802.11ac / ad, a new Wi-Fi standard that increases the available bandwidth and enhances the multimedia support function at the speed of 1 Gbps, is being proposed, and researches to improve the quality of video transmission are actively proposed in the cross layer aspect. have.

However, the H.264 / AVC video quality improvement studies proposed to date have the following limitations. First, many studies have been limited to extended profiles, which are rarely used among the profiles of H.264 / AVC. This is because the extension profile does not have enough functions related to encoding capacity optimization, and in particular, does not support Context-Adaptive Binary Arithmetic Coding (CABAC), which is a method for more efficient compression supported by other profiles. As a result, an image encoded with an H.264 / AVC extended profile has a lower compression efficiency than an image encoded with a main and high profile.

Second, there are few studies on MPEG-2 with MPEG-2 Transport Stream (TS), which is the most used H.264 / AVC service type. Considering that MPEG-2 TS is the method used in HTTP Live Streaming (HLS), the delivery method of broadcasting contents or multimedia serviced on the web, research on this is necessary to increase the practical value of the proposed scheme.

Lastly, among the H.264 / AVC and the network-based cross-layer researches that have been proposed, attempts to improve transmission quality are limited to video frame units rather than packet units. This is in accordance with the conventional notion that guaranteeing video quality on a packet basis generates a lot of computer power, which is why frame-based priorities in studies on H.264 / AVC transmission and video quality improvement based on MPEG-2 TS Proposals limited to transmission have been proposed. However, in order to guarantee transmission quality at a more sophisticated level, an invention of a packet-based priority transmission method is required.

To counteract data loss between video transmissions, several error concealment techniques exist in H.264 / AVC. The H.264 decoder extracts the vector value between the previous frame and the next frame of the lost frame by measuring and predicting the vector value, and uses it to recover some information of the frame or estimate the lost MB from the adjacent MB. Restore it.

However, meta data such as Sequence Parameter Set (SPS), Picture Parameter Set (PPS), frame, and slice header are difficult to recover through adjacent information as described above. In the case of SPS and PPS, this can be improved through repetitive transmission based on a parameter set structure. However, a technique for guaranteeing transmission quality for meta data such as frame and slice header has not yet appeared.

In order to solve the above-described problems of the present invention and to ensure H.264 / AVC over MPEG-2 TS video quality improvement performance, the following problems are solved.

First, since H.264 / AVC is encoded with different profiles according to the use, the most commonly used profile is a high profile with good compression efficiency, and a base profile is mainly used in mobile devices. An embodiment of the present invention is to propose a method that can improve the video transmission quality when applied, without being limited to the application according to the individual characteristics of these profiles.

In addition, due to the universal transmission scheme used in the HLS scheme used in mobile devices and the most widely used broadcasting network, it is applicable to H.264 / AVC over MPEG-2 TS, which is the most widely used video data packetization scheme. To provide.

In addition, the embodiment of the present invention consumes less computer power when applying the actual system, and at the same time does not cause any additional changes to the equipments constituting the existing network, and recovers at the decoder of the H.264 / AVC video stream data. It is intended to provide a method for improving transmission stability for meta data such as frame and slice header, which are not possible.

Determining that the transport packet is not a program association table (PAT) and a program map table (PMT) through a packet identifier (PID) for all MPEG-2 TSs in a transport packet of a server; Identifying whether a transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of a TS packet header; Determining a type of a frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header; And if the frame is determined to be a P or B frame including a packet (PFH) having header information of the P and B frames according to the payload value, a high value of 0x38 for WMM (Wi-fi Multimedia) wireless transmission of the transport packet. A packet-based video streaming priority transmission method may be provided that includes transmitting priority and adjusting a packet delivery rate (PDR) value of the PFH according to a setting.

Determining that the transport packet is not PAT and PMT through PID for all MPEG-2 TS packets in the transport packet of the server; Identifying whether the transport packet is the first packet of the frame through the PUSI information of the TS packet header; Determining a type of a frame based on the NRI payload information of the NAL header; And if the payload value is determined to be the first packet of the I frame so that the frame is determined to be the I frame, the packet-based video streaming priority transmission method comprising the step of assigning a high transmission priority of 0x38 for WMM wireless transmission of the transport packet. Can be provided.

Determining that the transport packet is not PAT and PMT through PID for all MPEG-2 TS packets in the transport packet of the server; Identifying whether the transport packet is the first packet of the frame through the PUSI information of the TS packet header; Determining a type of a frame based on the NRI payload information of the NAL header; And if the frame is determined to be a B frame that does not include the PFH according to the payload value, a packet-based video streaming priority transmission method may include providing a low transmission priority of 0x28 for WMM wireless transmission of a transport packet. have.

On one side, the server encodes the transport packet into H.264 / AVC, then transmits the packetized video to MPEG-2 TS, and transmits Real-time Transport Protocol (RTP) / User Datagram Protocol (UDP) / TCP (transmission). Transmission packets are transmitted based on a control protocol, and an Ethernet or wireless network interface may be used for video transmission.

In another aspect, the server may correspond to a video server, a Wi-Fi based wireless transmission router, a wireless transmission switch, or a wireless transmission access point (AP).

In another aspect, in the step of determining that the transport packet is not PAT and PMT through the PID for all MPEG-2 TS packets in the transport packet of the server, WMM wireless transmission to the packet determined to be a PAT or PMT You can give it a high priority of 0x38.

In another aspect, the step of identifying whether a transport packet is the first packet of a frame through PUSI information of the TS packet header includes: for H.264 / AVC video packetized with MPEG-2 TS for identification of a TS packet type. Packet identification programs can be used.

In another aspect, the packet-based video streaming priority transmission method may be performed in a network environment of IEEE 802.11.

In another aspect, the packet-based video streaming priority transmission method includes the step of evaluating the stability of data transmission according to the transmission priority of the transport packet, the evaluation step is a packet utilization ratio for video-stream ) Value can be used as an evaluation index.

In another aspect, the packet-based video streaming priority transmission method includes evaluating the stability of data transmission according to the priority transmission of the transport packet, wherein the evaluating step comprises converting the original data of the transport packet into a byte stream. Loggers can be used to read and recover lost packets during WMM radio transmissions.

A packet determination unit for determining that the transport packet is not PAT and PMT through PID for all MPEG-2 TS packets in the transport packet of the server; A first packet identification unit for identifying whether a transport packet is a first packet of a frame through PUSI information of a TS packet header; A frame discriminating unit determining a type of a frame based on the NRI payload information of the NAL header; And if the frame is determined to be a P or B frame including the PFH according to the payload value, a high transmission priority of 0x38 is assigned for WMM (Wi-fi Multimedia) wireless transmission of the transport packet, and the PDR of the PFH is set according to the setting. A packet-based video streaming priority transmission system including a rank determiner for adjusting a packet delivery rate value may be provided.

A packet determination unit for determining that the transport packet is not PAT and PMT through PID for all MPEG-2 TS packets in the transport packet of the server; A first packet identification unit for identifying whether a transport packet is a first packet of a frame through PUSI information of a TS packet header; A frame discriminating unit determining a type of a frame based on the NRI payload information of the NAL header; And a ranking unit configured to determine the first packet of the I frame according to the payload value and determine a frame as the I frame to give a high transmission priority of 0x38 for WMM wireless transmission of the transport packet. This may be provided.

A packet determination unit for determining that the transport packet is not PAT and PMT through PID for all MPEG-2 TS packets in the transport packet of the server; A first packet identification unit for identifying whether a transport packet is a first packet of a frame through PUSI information of a TS packet header; A frame discriminating unit determining a type of a frame based on the NRI payload information of the NAL header; And if the frame is determined to be a B frame that does not include PFH according to the payload value, a packet-based video streaming priority transmission system including a ranker for assigning a low transmission priority of 0x28 for WMM wireless transmission of a transport packet may be provided. Can be.

According to an embodiment of the present invention, video quality improvement can be achieved through packet-based priority transmission for H.264 / AVC over MPEG-2 TS video stream, and transmission priority can be guaranteed to PFH during wireless transmission. It can be seen that the Peak Signal-to-Noise Ratio (PSNR) and Packet Utilization Ratio for Video-stream (PURV) values are improved compared to the frame-based priority transmission.

More specifically, it can be organized into four items as follows. First, an embodiment of the present invention is a packet-based priority transmission method and system applicable to all profiles of H.264. Second, additional computer power consumption and transmission delay in H.264 / AVC over MPEG-2 TS transmission. It can be applied without occurrence. Third, the present invention is a simple method that can be applied to a real environment such as a home network only by program modifications on the video server and client side. Finally, to evaluate the proposed method, we can propose a new evaluation index that can be evaluated in terms of data usefulness.

1 illustrates an actual transmission environment of MPEG-2 TS based H.264 according to an embodiment of the present invention.
FIG. 2 is a diagram for describing loss of concatenated information due to loss of first packet information and first packet of P and B frames according to an embodiment of the present invention.
3 is a flowchart illustrating the steps of a packet-based video streaming priority transmission method according to an embodiment of the present invention.
FIG. 4 is a diagram for describing a method of detecting the start of an H.264 / AVC frame in an MPEG-2 TS video stream according to an embodiment of the present invention.
5 shows a graph comparing and analyzing the PSNR based PFH transmission test according to one embodiment of the present invention.
FIG. 6 shows a graph comparing PDR values and PSNR test results according to an embodiment of the present invention.
7 is a graph illustrating a comparative analysis of PURV test results in one embodiment of the present invention.
8 is a block diagram illustrating a configuration of a packet-based video streaming priority transmission system according to an embodiment of the present invention.

Hereinafter, a packet-based video streaming priority transmission method and a system thereof will be described in detail with reference to the accompanying drawings.

In the existing frame-based video streaming priority transmission scheme, SPS, PPS, Program Association Table (PAT), Program Map Table (PMT) and I-frame or Instantaneous Decoder Refresh (IDR) frames, which are mainly video metadata, A high priority of level-1 is assigned and a low priority of level-2 is assigned to P and B frames.

However, this method of priority allocation assumes that the level-1 classified data is a collection of data necessary for decoding, and theoretically, even if both level-2 classified P and B frames are lost, If the data is well communicated, it should be decodeable, but the actual experimental results could not be decoded with level-1 data alone.

In this regard, a detailed analysis can be performed in the environment as shown in FIG. 1. 1 illustrates the actual transmission environment using the x264 codec and VLC which are the most widely used open source programs. For packet-based filtering of P and B frame data, an identifier program that can filter video traffic by packet is implemented.

The result can be obtained in four cases, where the decoding of the image proceeds without any problem when there are no missing frames, only B frames are missing, P frames are missing, and both P and B frames are missing. Check if

If there are no missing frames, they are decoded without problem, and even in the case where the B and P frames are selectively removed, the image can be decoded even though distortion or delay occurs, but it is possible to decode P and B corresponding to level-2. In the case of removing all the frame data, decoding was not performed after the initial buffering start. Given that the data classified as Level-1 are only those that are essential for decoding, the result shows that frame-based priority transmission is insufficient to protect the data necessary for decoding.

When a file containing an image applied to an embodiment of the present invention is analyzed, a TS (Transport Stream) packet including byte information of a NAL unit header and a slice header positioned at the forefront of each frame, as shown in FIG. If lost, subsequent link packets may be discarded without being decoded as shown in (b).

This occurs because the decoder cannot identify which frame or slice the packets belong to. Therefore, in order to increase the usefulness of packets transmitted safely through the network, the header is located at the beginning of each P and B frame. Packets containing information should have a higher transmission priority than packets containing other data in the frame. In the following description, these packets will be referred to as 'Packets which contain P or B Frame Header (PFH)' in the sense of a packet including header information of P and B frames among the packets constituting the P and B frames.

3 is a flowchart illustrating steps of a packet-based video streaming priority transmission method according to an embodiment of the present invention. Embodiment of the present invention can be applied in an Ethernet environment, Ethernet refers to a representative communication protocol of a local area network (LAN), most of the computer communication we use today is based on Ethernet technology. Ethernet uses a program called the Internet Protocol to connect a wide range of communications and computer devices. The present invention can ensure high transmission priority for PFH, thereby increasing the usefulness of transmitted packets with improved video quality.

In step S310, it is possible to determine that the transport packet is not PAT and PMT through PID (Packet Identifier) for all MPEG-2 TS packets in the transport packet of the server. According to ISO / IEC standards 13818-1 and 13818-2, when packetizing and transmitting H.264 / AVC in MPEG-2 TS, video streams and audio streams are given specific PIDs. By checking the value of such a PID, it is possible to determine a transport packet.

Here, the server transmitting the transport packet encodes the transport packet into H.264 / AVC and transmits the packetized video to MPEG-2 TS, and transmits the real-time transport protocol (RTP) / User datagram protocol (UDP) / The server transmits a transmission packet based on a transmission control protocol (TCP), and an Ethernet or wireless network interface may be used for video transmission. Alternatively, the present invention may correspond to a wireless communication device itself capable of transmitting data such as a video server, a Wi-fi based wireless transmission router, a wireless transmission switch, or a wireless transmission access point (AP).

4 illustrates how to detect the start of an H.264 / AVC frame in an MPEG-2 TS video stream according to one embodiment of the invention. As shown, the video stream is assigned a PID other than 0x00 used as PAT and the PID designated for PMT.

In addition, since the MPEG-2 TS header is a variable length structure in which several fields are included or not included as necessary, the structure of the MPEG-2 TS header is determined according to the value of the Payload Unit Start Indicator (PUSI) bit indicating the start of specific data belonging to the payload. Changes dynamically. In an embodiment, when the PUSI bit is set to true, a Packet Elementary Stream (PES) field and associated fields that record payload type information are dynamically included in the MPEG-2 TS header.

In operation S320, whether the transport packet is the first packet of the frame may be identified through Payload Unit Start Indicator (PUSI) information of the packet header. Referring back to FIG. 4, it is important to note that when H.264 / AVC is loaded into a TS packet as a payload, the PUSI bit is always set to true at the beginning of each frame. Therefore, referring to this, it is possible to identify a packet at the start of a frame among packets constituting video streaming.

In operation S320, a packet identification program for H.264 / AVC video packetized to MPEG-2 TS may be used to identify whether a transport packet is the first packet of a frame.

In operation S330, the type of the frame may be determined based on the NAL reference IDC (NRI) payload information of the network abstraction layer (NAL) header, and the frame identified in operation S320 may be referred to. In detail, by using the byte unit information of the H.264 / AVC NAL header and slice header derived by analyzing the file encoded by the H.264 / AVC encoder, it is possible to determine the starting point of each frame and the type of the frame. Can be identified.

In operation S340, the transmission priority may be differentially assigned according to the type of the frame identified in operation S330. Here, the P and B frames including the PFH described above are assigned a high transmission priority, that is, a priority of 0x38 for WMM radio transmission, and a B frame that does not correspond to the PFH or is not referenced to other frames. A low transmission priority of 0x28 can be assigned. In addition, if the corresponding frame is determined as an I frame, a high transmission priority of 0x38 may be assigned for WMM wireless transmission of the transport packet.

Here, the priority given may be divided into a low priority transmission rank of 0x28 and a high priority transmission rank of 0x38, or may be determined as a rank higher than a predetermined reference rank and a rank lower than a predetermined reference rank.

In an embodiment, if it is determined in step S310 that the transport packet is a PAT or PMT, it can be determined that the packet corresponds to the metadata of the video, and thus can be given a high priority of 0x38.

Using the video streaming priority transmission method as shown in FIG. 3, packet-based priority transmission for the video stream is possible. The program for implementing the method of FIG. 3 is a program of 10 KB or less, and the delay caused by the application to a real system is almost 0 ms in a server environment having a 3.4 Ghz CPU and 4 GB memory, and is measured at a maximum of 1 ms or less. This can be

In the embodiment of the present invention, the packet-based video streaming priority transmission method of FIG. 3 may include evaluating the stability of data transmission according to the transmission of the packet (not shown). Therefore, the performance of the present invention is to be evaluated through the peak signal-to-noise ratio (PSNR) which is a commonly used evaluation index.

PSNR evaluation in an environment where packet loss may occur due to packet loss requires synchronization between before and after transmission. Using the logger, the original data of the packet is read into the byte stream and the video corresponds to the lost packet. By performing the synchronization task of converting the value of the byte stream portion to 0, the packet loss is reflected. The PSNR value can be derived by comparing this image with the original image.

As shown in the graph shown in FIG. 5, the loss at the 20% level showed a higher PSNR result than the loss at the 80% level. Since all other conditions were calculated by adjusting only the PDR of the PFH under the same conditions, this result can show that the PFH has a significant impact on the quality of the image that is delivered to the client and decoded.

In addition, if packets containing important metadata are missing during decoding of H.264 / AVC over MPEG-2 TS such as the identified PFH, the size of the packet delivered on the network and the size of the video file through decoding A difference occurs, and in the step of evaluating the stability, an evaluation index of a packet utilization ratio for video-stream (PURV) is presented to evaluate the difference, and PURV is expressed by Equation 1 below.

PURV measures the rate at which video data packets successfully transmitted over the network are used for video restoration during actual decoding. As shown in Equation 1, the PURV is determined as a value obtained by dividing the total amount of data decoded and recorded as an image by the amount of data transmitted through the network.

In an embodiment, it can be seen in Table 1 how the PURV varies depending on the rate of PFH loss.

As shown in Table 1, when the PFH was lost at the 20% level, the PURV value was about 84.4%, whereas when the PFH was lost at the 80% level, the PURV value was 37.3%. This result suggests that the usefulness index used for decoding video packets from the network is affected by the transmission rate of PFH.

Embodiment of the present invention can be applied in a wireless network environment of IEEE 802.11. For the embodiment using the IEEE 802.11 WMM, the PFH is assigned a high priority value of 0x38 on the WMM, so that it has a higher transmission priority than the data of the remaining P and B frames assigned 0x28.

Priority Marker, which adds priority recording to the packet identifier for WMM-based priority transmission, and solves problems on decoders that do not support inter-packet delays due to the use of multiple queues in the network. In addition to the VLC client, a packet sorter (Serializer) was developed and applied.

As shown in FIG. 6, in the embodiment, the results shown in the table of FIG. (A) are derived. When the PFH rates for the two schemes are compared when the total PDR is 80%, the method proposed in the present patent is About 20% higher PFH transmission rate. As shown in the graph of (b), the difference in the PFH data rate is 24% higher than the PSNR value of the packet-based priority transmission.

In an embodiment of the present invention, for the frame-based priority transmission method and the packet-based priority transmission method, a result of measuring the PURV value at a PDR level of 60 to 100% may be shown as shown in FIG. 7.

Analyzing the graph of FIG. 7, first, in the case of packet-based priority transmission in which the PFH rate is always maintained at a high level regardless of the overall PDR value, the PURV value decreases slowly due to the decrease in the overall PDR value. However, in the case of frame-based priority transmission, the PURV value decreases in proportion to the total PDR and is about 15% lower than the packet-based priority transmission.

These results indicate that the transmission of PFH over the air has a significant impact on the overall usefulness of the transmitted video data.

8 is a block diagram illustrating a configuration of a packet-based video streaming priority transmission system 800 according to an embodiment of the present invention. The system 800 is a system for implementing the packet-based video streaming priority transmission method described with reference to FIG. 3, and each component of the system 800 is combined or subdivided with other components in the practice of the invention. Can be configured.

The packet-based video streaming priority transmission system 800 includes a packet determination unit 810, a first packet identification unit 820, a frame determination unit 830, and a priority determination unit 840. The evaluation unit 850 may be included.

The packet determiner 810 may determine that all MPEG-2 TS packets in the transport packet of the server are not PAT and PMT. When packetizing and transmitting H.264 / AVC in the MPEG-2 TS, the video stream and the audio stream are given a specific PID. The transmission packet can be determined by checking the PID value. In addition, if the TS determiner 810 determines that the TS packet is PAT or PMT, the packet determiner 810 may be given a priority value of 0x38 without any other configuration.

The first packet identification unit 820 may identify that the transport packet is the first packet of the frame through the PUSI information of the TS packet header. Here, it is possible to identify whether a transport packet is the first packet of a frame using a packet identification program for H.264 / AVC video packetized with MPEG-2 TS.

In addition, the frame determination unit 830 may determine the type of frame based on the NRI payload information value of the NAL header. In detail, by using the byte unit information of the H.264 / AVC NAL header and slice header derived by analyzing the file encoded by the H.264 / AVC encoder, it is possible to determine the starting point of each frame and the type of the frame. Can be identified.

According to the type of the frame determined by the frame determining unit 830, the priority determining unit 840 may assign the priority to each frame differentially. For example, P and B frames including PFH may be assigned a high transmission priority, that is, a priority of 0x38 for WMM wireless transmission. B frame, which does not correspond to PFH or is not referred to other frames, may be assigned a low transmission priority of 0x28, and if the frame is determined to be an I frame, for WMM wireless transmission of a transport packet. A high transmission priority value of 0x38 can be assigned.

In the embodiment of the present invention, as a configuration of the system 800 for implementing the packet-based video streaming priority transmission method of FIG. 3, the system 800 may include a stability evaluator 850 for evaluating stability during data transmission. . Thus, the performance of the present invention can be evaluated through PSNR (Peak Signal-to-Noise Ratio), which is a commonly used evaluation index, and PURV newly proposed by the present invention.

In this case, the PSNR evaluation requires synchronization between images before and after transmission. The logger reads the original data of the packet into the byte stream and converts the value of the byte stream in the image corresponding to the lost packet to 0. By performing the synchronization operation, the image reflects packet loss. The PSNR value can be derived by comparing this image with the original image.

In addition, when packets containing important metadata are missing when decoding H.264 / AVC over MPEG-2 TS, there is a difference between the size of a packet transmitted normally on a network and the size of a video file through decoding. In order to evaluate this difference, the stability evaluator 850 provides an evaluation index of PURV (Packet Utilization Ratio for Video-stream), which is used to restore video data packets successfully transmitted through a network. Measure the ratio used. The PURV may be determined as a value obtained by dividing the total amount of data decoded and recorded as an image by the amount of data transmitted through the network.

As a result, when combining the embodiments of the present invention, if the PFH is assigned a higher transmission priority than other P and B frame packets using the packet-based priority transmission method and system proposed by the present invention, In addition, the higher quality video can be transmitted by increasing the usefulness of video streaming packets transmitted than when using a frame-based priority transmission technique.

The packet-based video streaming priority transmission method according to the embodiment may be implemented in the form of program instructions that may be executed by various computer means and may be recorded in a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as a hard disk, a floppy disk and a magnetic tape, optical media such as CD-ROM and DVD, magnetic disks such as a floppy disk, - Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents thereof, the appropriate results may be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

800: packet-based video streaming preferred transmission system
810: packet determination unit
820: first packet identification unit
830: frame determination unit
840: priority determination unit
850: stability evaluation unit

Claims (16)

Determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
Identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
Determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the frame is determined to be a P and B frame including a packet (PFH) having header information of the P and B frames according to the payload value, the WMM (Wi-fi Multimedia) wireless transmission of the transport packet in advance Assigning a transmission priority higher than a predetermined reference priority and adjusting a packet delivery rate (PDR) value of the PFH according to a setting; And
Evaluating stability of data transmission according to transmission priority of the transmission packet;
Lt; / RTI >
The evaluating step is to use a Packet Utilization Ratio for Video-stream (PURV) value as an evaluation index.
Packet-based video streaming priority transmission method characterized in that. Determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
Identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
Determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the payload value is identified as the first packet of an I frame and the frame is determined to be an I frame, giving a transmission priority higher than a predetermined reference priority for WMM (Wi-fi Multimedia) wireless transmission of the transport packet ; And
Evaluating stability of data transmission according to transmission priority of the transmission packet;
Lt; / RTI >
The evaluating step is to use a Packet Utilization Ratio for Video-stream (PURV) value as an evaluation index.
Packet-based video streaming priority transmission method characterized in that. Determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
Identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
Determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the frame is determined to be a B frame that does not include a packet (PFH) having header information of P and B frames according to the payload value, a predetermined criterion for wireless transmission of WMM (Wi-fi Multimedia) of the transport packet Assigning a transmission priority lower than a priority; And
Evaluating stability of data transmission according to transmission priority of the transmission packet;
Lt; / RTI >
The evaluating step is to use a Packet Utilization Ratio for Video-stream (PURV) value as an evaluation index.
Packet-based video streaming priority transmission method characterized in that. 4. The method according to any one of claims 1 to 3,
The server comprises:
Encode the transport packet in H.264 / AVC and transmit the packetized video in MPEG-2 TS,
Transmitting the transport packet based on Real-time Transport Protocol (RTP) / User Datagram Protocol (UDP) / transmission control protocol (TCP),
Using Ethernet or wireless network interfaces for video transmission
Packet-based video streaming priority transmission method characterized in that. 4. The method according to any one of claims 1 to 3,
The server corresponds to a video server, a Wi-Fi based wireless transmission router, a wireless transmission switch, or a wireless transmission access point (AP).
Packet-based video streaming priority transmission method characterized in that. Determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
Identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
Determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the frame is determined to be a P and B frame including a packet (PFH) having header information of the P and B frames according to the payload value, the WMM (Wi-fi Multimedia) wireless transmission of the transport packet in advance Assigning a transmission priority higher than a predetermined reference priority and adjusting a packet delivery rate (PDR) value of the PFH according to a setting; And
Evaluating stability of data transmission according to transmission priority of the transmission packet;
Lt; / RTI >
The evaluating step uses a logger which reads the original data of the transport packet into a byte stream and compares and recovers packets lost during the WMM wireless transmission.
Packet-based video streaming priority transmission method characterized in that. Determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
Identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
Determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the payload value is identified as the first packet of an I frame and the frame is determined to be an I frame, giving a transmission priority higher than a predetermined reference priority for WMM (Wi-fi Multimedia) wireless transmission of the transport packet ; And
Evaluating stability of data transmission according to transmission priority of the transmission packet;
Lt; / RTI >
The evaluating step uses a logger which reads the original data of the transport packet into a byte stream and compares and recovers packets lost during the WMM wireless transmission.
Packet-based video streaming priority transmission method characterized in that. Determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
Identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
Determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the frame is determined to be a B frame that does not include a packet (PFH) having header information of P and B frames according to the payload value, a predetermined criterion for wireless transmission of WMM (Wi-fi Multimedia) of the transport packet Assigning a transmission priority lower than a priority; And
Evaluating stability of data transmission according to transmission priority of the transmission packet;
Lt; / RTI >
The evaluating step uses a logger which reads the original data of the transport packet into a byte stream and compares and recovers packets lost during the WMM wireless transmission.
Packet-based video streaming priority transmission method characterized in that. delete delete A packet determination unit for determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
A first packet identification unit identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
A frame determination unit for determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the frame is determined to be a P and B frame including a packet (PFH) having header information of the P and B frames according to the payload value, the WMM (Wi-fi Multimedia) wireless transmission of the transport packet in advance A ranking unit configured to give a transmission priority higher than a predetermined reference rank and adjust a packet delivery rate (PDR) value of the PFH according to a setting; And
Stability evaluation unit for evaluating the stability of data transmission according to the transmission priority of the transmission packet
Lt; / RTI >
The stability evaluator uses a packet utilization ratio for video-stream (PURV) value as an evaluation index.
Packet-based video streaming priority transmission system characterized in that. A packet determination unit for determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
A first packet identification unit identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
A frame determination unit for determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the first packet of the I frame according to the payload value is identified and the frame is determined to be an I frame, a priority that gives a transmission priority higher than a predetermined reference priority for WMM (Wi-fi Multimedia) wireless transmission of the transport packet Decision unit; And
Stability evaluation unit for evaluating the stability of data transmission according to the transmission priority of the transmission packet
Lt; / RTI >
The stability evaluator uses a packet utilization ratio for video-stream (PURV) value as an evaluation index.
Packet-based video streaming priority transmission system characterized in that. A packet determination unit for determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
A first packet identification unit identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
A frame determination unit for determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the frame is determined to be a B frame that does not include a packet (PFH) having header information of P and B frames according to the payload value, a predetermined criterion for wireless transmission of WMM (Wi-fi Multimedia) of the transport packet A ranking determiner which gives a transmission priority lower than the ranking; And
Stability evaluation unit for evaluating the stability of data transmission according to the transmission priority of the transmission packet
Lt; / RTI >
The stability evaluator uses a packet utilization ratio for video-stream (PURV) value as an evaluation index.
Packet-based video streaming priority transmission system characterized in that. A packet determination unit for determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
A first packet identification unit identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
A frame determination unit for determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the frame is determined to be a P and B frame including a packet (PFH) having header information of the P and B frames according to the payload value, the WMM (Wi-fi Multimedia) wireless transmission of the transport packet in advance A ranking unit configured to give a transmission priority higher than a predetermined reference rank and adjust a packet delivery rate (PDR) value of the PFH according to a setting; And
Stability evaluation unit for evaluating the stability of data transmission according to the transmission priority of the transmission packet
Lt; / RTI >
The stability evaluator uses a logger that reads the original data of the transport packet into a byte stream and compares and recovers packets lost during the WMM wireless transmission.
Packet-based video streaming priority transmission system characterized in that. A packet determination unit for determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
A first packet identification unit identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
A frame determination unit for determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the first packet of the I frame according to the payload value is identified and the frame is determined to be an I frame, a priority that gives a transmission priority higher than a predetermined reference priority for WMM (Wi-fi Multimedia) wireless transmission of the transport packet Decision unit; And
Stability evaluation unit for evaluating the stability of data transmission according to the transmission priority of the transmission packet
Lt; / RTI >
The stability evaluator uses a logger that reads the original data of the transport packet into a byte stream and compares and recovers packets lost during the WMM wireless transmission.
Packet-based video streaming priority transmission system characterized in that. A packet determination unit for determining that the transport packet is not a Program Association Table (PAT) and a Program Map Table (PMT) through a packet identifier (PID) for all MPEG-2 Transport Stream (TS) packets in a transport packet of a server;
A first packet identification unit identifying whether the transport packet is a first packet of a frame through payload unit start indicator (PUSI) information of the TS packet header;
A frame determination unit for determining the type of the frame based on NAL reference IDC (NRI) payload information of a network abstraction layer (NAL) header;
If the frame is determined to be a B frame that does not include a packet (PFH) having header information of P and B frames according to the payload value, a predetermined criterion for wireless transmission of WMM (Wi-fi Multimedia) of the transport packet A ranking determiner which gives a transmission priority lower than the ranking; And
Stability evaluation unit for evaluating the stability of data transmission according to the transmission priority of the transmission packet
Lt; / RTI >
The stability evaluator uses a logger that reads the original data of the transport packet into a byte stream and compares and recovers packets lost during the WMM wireless transmission.
Packet-based video streaming priority transmission system characterized in that.

Images