KR101704655B1 - Method And Apparatus for Transmitting Video Frames Considering Power Consumption - Google Patents

Method And Apparatus for Transmitting Video Frames Considering Power Consumption Download PDF

Info

Publication number
KR101704655B1
KR101704655B1 KR1020150129263A KR20150129263A KR101704655B1 KR 101704655 B1 KR101704655 B1 KR 101704655B1 KR 1020150129263 A KR1020150129263 A KR 1020150129263A KR 20150129263 A KR20150129263 A KR 20150129263A KR 101704655 B1 KR101704655 B1 KR 101704655B1
Authority
KR
South Korea
Prior art keywords
frame
type
size
target size
frames
Prior art date
Application number
KR1020150129263A
Other languages
Korean (ko)
Inventor
이정륜
김매화
정지영
김영재
Original Assignee
중앙대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 중앙대학교 산학협력단 filed Critical 중앙대학교 산학협력단
Priority to KR1020150129263A priority Critical patent/KR101704655B1/en
Application granted granted Critical
Publication of KR101704655B1 publication Critical patent/KR101704655B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4516—Management of client data or end-user data involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A video frame transmission method considering power consumption is disclosed. The method of transmitting a video frame considering power consumption according to an exemplary embodiment of the present invention is a method for transmitting a maximum frame size of a single frame transmitted during a single awake period for each frame type of I-, P- and B- Determining a target size for each frame type by considering a size distribution for each frame type; Setting an awake interval for each frame type based on a target size for each frame type and a transmission rate of a channel for transmitting the frame; And transmitting a video frame to the client based on the set awake interval for each frame type.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and apparatus for transmitting video frames considering power consumption,

The present invention relates to a method and apparatus for transmitting a video frame to a client. More particularly, to a method and apparatus for transmitting video frames while considering power consumption.

The Wi-Fi Alliance has announced a new technology called Wi-Fi direct that allows mobile terminals with mobility in existing Wi-Fi networks to communicate directly and from anywhere without a router or router. In the Wi-Fi direct, the group owner (GO) plays the role of the AP in the existing Wi-Fi network, and the devices connected to the GO are called the clients.

In the Wi-Fi direct standard, two approaches are proposed to reduce power consumption: Opportunistic technique and NOA (Notice of Absent) technique. Opportunistic technique is characterized in that when the GO starts data transmission to the client within a predetermined CTWindow (Client Traffic Window) time, the GO can enter the sleep interval again after the transmission is completed. The NOA technique is a GO The data can be transmitted to the client only within the predetermined awake interval.

Meanwhile, the traffic pattern can be classified into two types: periodic traffic, which occurs periodically, such as video traffic, and burst traffic, which generates data for a specific period of time. If the data is periodic traffic, the NOA technique is more efficient in terms of power consumption because the GO is wake-up time in the opportunistic technique. However, if the data is burst traffic, the NOA technique should be awake even if there is no data transmission. Unnecessary power consumption may occur.

Thus, it can be seen that the NOA technique consumes less power when the data traffic is periodic traffic, and the opportunistic technique reduces the power consumption when the data traffic is burst traffic. In the case of transmitting video data, the NOA technique is more efficient in terms of power consumption because video frames are periodically generated and thus can be regarded as periodic traffic.

However, in the conventional NOA technique, regardless of the size of the video traffic, the awake interval of the GO is always the same, and the difference in frame size of each frame type, such as I-frame, P-frame and B- There is a problem that is not considered.

Accordingly, there is a need for a video frame transmission method and apparatus capable of reducing power consumption in consideration of characteristics of each type of video frame.

Relevant prior art is disclosed in Korean Patent Laid-open No. 10-2013-0029236 (entitled "Simultaneous Usage of Legacy Wi-Fi and Wi-Fi P2P, Public Date: March 23, 2013).

The present invention provides a method and apparatus for transmitting a video frame considering power consumption by setting different lengths of awake intervals for different types of video frames.

It is another object of the present invention to provide a video frame transmission method and apparatus capable of minimizing delays and omissions of video frames while considering power consumption by transmitting video frames that have not yet been transmitted along with video frames in the following order .

The problems to be solved by the present invention are not limited to the above-mentioned problem (s), and another problem (s) not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, a video frame transmission method considering power consumption provided in the present invention is a method for transmitting a video frame in which a single frame transmitted during a single awake interval for each frame type of I-, P- Determining a target size for each frame type, which is a maximum size of a frame, considering a size distribution for each frame type; Setting an awake interval for each frame type based on a target size for each frame type and a transmission rate of a channel for transmitting the frame; And transmitting the frame to the client based on the set awake interval for each frame type.

Setting a priority of each of the frames based on at least one of a type and an order of the frames in the GOP of the video data to be transmitted; And if a part of the frames transmitted during the awake period of the frame type is transmitted to the client, the remaining part of the non-transmitted frame is selectively With at least one other frame of the sequence.

Preferably, the step of setting the priority of each of the frames sets the priority of each of the frames to three kinds of upper, middle, and lower, and optionally transmitting with the at least one other frame of the next sequence If the priority of the transmitted frame is higher than the priority, transmitting the remaining part together with a plurality of other frames in the next order, and transmitting the remaining part together with one other frame in the next order if the priority is higher, I can not.

Analyzing a power consumption amount according to the changed target size and a delay or omission count of a frame according to the selective transmission while changing the target size according to the type; And determining an optimal target size for each type of the frame according to the analysis result.

Advantageously, the step of selectively transmitting along with at least one other type of frame of the next sequence comprises: if the at least one non-transmitted frame occurs, determining, based on the set priority, Re-determining a target size for each frame type; Resetting an awake interval for each frame type of the at least one frame based on a target size of the at least one other frame by the recursive frame type and a transmission rate of a channel for transmitting the frame; And transmitting the remainder of the part of the non-transmitted frames along with the at least one other frame in the next order, based on the re-established awake interval for each of the frame types.

Preferably, the step of re-determining the target size for each frame type of the at least one other frame may include determining a size distribution and a target size for each frame type corresponding to the partial non- ; Deriving a size distribution of a residual sum frame obtained by performing a convolution operation on the derived size distribution and a size distribution of at least one other frame of the next frame; And redetermining a target size for each frame type of the at least one other frame based on the size distribution of the remaining amount sum frame.

Preferably, the step of determining the target size for each frame type in consideration of the size distribution for each frame type may be performed based on the importance of each type of the frame.

Preferably, the size distribution of the I-frame is represented by a gamma distribution, and the size distribution of the P-frame and the B-frame corresponds to a gamma scale parameter of the gamma distribution representing a size distribution of the I- Can be expressed by multiplying the gamma scale factor.

Preferably, the target size for each frame type may be calculated based on an average value of the frame type, a standard deviation of the size for each frame type, and a standard scale factor to be applied to the standard deviation.

Preferably, the length of the awake interval may be calculated based on the number of bits per pixel, the resolution, and the transmission rate of the data channel for each frame type.

In order to achieve the above object, a video frame transmission apparatus considering the power consumption provided in the present invention is characterized in that a frame type of an I-frame, a P-frame and a B- A target size determination unit for determining a target size for each frame type, which is a maximum size of a single frame, considering a size distribution for each frame type; An interval setting unit setting an awake interval for each frame type based on a target size for each frame type and a transmission rate of a channel for transmitting the frame; And a transmission unit for transmitting a video frame to a client based on the set awake interval for each frame type.

And a priority setting unit configured to set a priority of each of the frames based on at least one of a type and an order of the frame in the GOP of the video data to be transmitted, Wherein when a part of the frames transmitted during the awake period of the frame type is transmitted to the client, the remaining part of the part of the non-transmitted frames is selectively It can be further transmitted along with other frames.

Preferably, the priority setting unit sets priority of each of the frames to three types of upper, middle, and lower, and when the priority of the transmitted frame is higher than the priority, It may be transmitted together with a plurality of other frames, and in the middle case, it may be transmitted together with one other frame in the next order, and in the case of the lower order, it may not be transmitted.

Preferably, the apparatus further includes a result analyzer for analyzing a power consumption amount according to the changed target size and a delay or omission count of the frame according to the selective transmission while changing the target size for each type, According to the analysis result, it is possible to further determine an optimum target size for each frame type.

Preferably, the target size determining unit re-determines the target size for each frame type of the at least one other frame in the next sequence based on the set priority when the partial transmission frame is generated, And resets an awake interval for each of the frame types of the at least one frame based on the target size of the re-determined frame type of one different frame and the transmission rate of the channel for transmitting the frame, Based on the type-specific awake interval, the remaining portion of the non-transmitted frames may be transmitted along with at least one other frame in the next sequence.

Preferably, the target size determination unit derives a size distribution of the remaining part of the partial transmission frame considering the size distribution and the target size for each frame type corresponding to the partial transmission frame, Calculating a size distribution of remaining sum summing frames obtained by convoluting a size distribution of at least one other frame of the sequence in accordance with a frame type of the at least one other frame; Can be recrystallized.

Preferably, the target size determining unit may determine based on at least one of power consumption according to type of importance of the frame.

Preferably, the size distribution of the I-frame is represented by a gamma distribution, and the size distribution of the P-frame and the B-frame corresponds to a gamma scale parameter of the gamma distribution representing a size distribution of the I- Can be expressed by multiplying the gamma scale factor.

Preferably, the target size for each frame type may be calculated based on an average value of the frame type, a standard deviation of the size for each frame type, and a standard scale factor to be applied to the standard deviation.

Preferably, the length of the awake interval may be calculated based on the number of bits per pixel, the resolution, and the transmission rate of the data channel for each frame type.

The present invention has the effect of reducing the power consumption by setting the length of the awake section differently for each type of video frame to be transmitted.

In addition, the present invention minimizes delays and omissions of video frames, while consid- ering power consumption, by transmitting an untransmitted portion of the video frame along with at least one video frame in the following order if a portion of the video frame is not transmitted There is an effect that can be done.

1 is a flowchart of a video frame transmission method according to an embodiment of the present invention.
2 is a flowchart of a video frame transmission method according to another embodiment of the present invention.
Figure 3 is a flow diagram of a method for transmitting along with at least one other type of frame in the next order according to one embodiment of the present invention.
4 is a diagram illustrating a video frame transmission apparatus according to an embodiment of the present invention.
5 is a view for explaining a video frame transmission apparatus according to another embodiment of the present invention.
6 is a diagram illustrating a structure of a GOP.
FIG. 7 is a view for explaining the size distribution of the frame, the target size and the setting of the awake interval.
8 is a diagram for explaining a selective transmission method for each frame type.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, A, B, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

The present invention can be applied to transmitting and receiving video data in a communication network to which the Wi-Fi Direct standard is applied. However, the present invention is not necessarily applied to a communication network to which Wi-Fi Direct is applied, and can be applied to transmission of video data in all applicable other types of communication networks.

In the meantime, a frame may be interpreted to mean a video frame unless otherwise specified in the present invention.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a flowchart of a video frame transmission method according to an embodiment of the present invention.

In step S110, the video frame transmission apparatus transmits a target size for each frame type, which is the maximum size of a single frame transmitted during a single awake period, for each frame type of I-frame, P-frame and B- Size distribution.

Here, the target size is set for each frame type, and the target size can be determined so that the video frame to be actually transmitted is included with a proper probability considering the probability distribution of sizes of the video frames.

In another embodiment, the determination of the target size may be performed further based on at least one of the power consumption according to type-specific importance of each frame.

For example, if an I-frame is lost in one GOP, the entire GOP will be unusable, but the P-frame will not be able to use the B-frame and subsequent P-frames and the B- As with the absence, the importance by frame type can also be a factor in determining the target size.

In addition, when the target size is increased to reduce the omission and delay of the transmitted frame, the awake section is increased in proportion to the increase of the target size. As a result, the power consumption of the video frame transmission apparatus will also increase. This can be a consideration factor.

In another embodiment, the size distribution of the I-frame is represented by a gamma distribution, the size distribution of the P-frame and the B-frame includes a gamma scale parameter of the gamma distribution representing the size distribution of the I- - the gamma scale factor of each frame.

Here, the gamma distribution is a continuous probability distribution determined by gamma shape parameters and gamma scale parameters.

For example, the size of the I-frame may be represented by a gamma distribution with a gamma shape parameter value of 22 and a gamma scale parameter value of 44. [ Since the P-frame and the B-frame are smaller in size than the I-frame, they can be represented by different gamma distributions by multiplying the gamma scale parameter values of the I-frame by the respective gamma scale factors.

Referring to FIG. 7, the shape of the gamma distribution F (Z) with respect to the input frame size Z can be known. 7, the target sizes T I , T IrB , T B , and T P for the I-frame, B-frame, and P- T PrB, etc. are displayed, and the awake sections t I , t IrB , t B , t p , t PrB, etc. are displayed.

A target value for each frame type can be selected on the basis of this type of distribution, and the length of the corresponding awake section can be calculated using the selected target size. A concrete calculation method of the awake interval will be described later in detail in the description of Equation (5).

More specifically, the gamma distribution of the I-frame, the P-frame, and the B-frame can be expressed by the following equations (1) to (3).

Figure 112015088749837-pat00001

Here, f (Z I) is the probability density function of the magnitude of the I- frame, λ is a scale parameter gamma, gamma k is a shape parameter, Z I is the magnitude of the input I- frame, Г (k) is It is the result of putting the gamma shape parameter into the gamma function.

Figure 112015088749837-pat00002

Where f (Z B ) is a probability density function for the size of the B-frame, [lambda] is the gamma scale parameter, S B is the gamma scale factor for the I-frame of the B- frame, k is the gamma shape parameter , Z B is the size of the corresponding B-frame, and Γ (k) is the result of putting the gamma shape parameter into the gamma function.

Figure 112015088749837-pat00003

Where f (Z P ) is a probability density function for the size of a P-frame, [lambda] is a gamma scale parameter, S P is a gamma scale factor for an I- frame of a P- frame, k is a gamma shape parameter , Z P is the size of the corresponding P-frame, and G (k) is the result of putting the gamma shape parameter into the gamma function.

In another embodiment, the target size (unit is bit or bit / pixel) for each frame type can be calculated based on a standard scale factor to be applied to the average value of the size according to the frame type, the standard deviation and the standard deviation of the size for each frame type.

For example, the target size (unit is bit) can be calculated by adding a value obtained by multiplying the standard deviation of the size of the frame type by the standard scale factor to the average value of the size of each frame type as shown in Equation (4). That is, when the standard scale factor is selected as an appropriate value in the range of 0.5 to 1.7, an appropriate target size can be calculated.

Figure 112015088749837-pat00004

Here, T x (S) is the frame type of the target size (a unit bit) and, E [Z x] is the average value of the frame type, size, S is a standard scale factor to determine the frame type, the target size, σ [Z x ] Is the standard deviation of the size for each frame type.

In step S120, the video frame transmission apparatus sets an awake interval for each frame type based on a target size (unit is bit) and a transmission rate (unit is bit / s) of a channel through which the frame is transmitted.

For example, the calculation of the length of the awake interval for each frame type can be performed by Equation (5). In addition, the video frame transmission apparatus can set an awake interval equal to the calculated length.

Figure 112015088749837-pat00005

Here, t x is a length of an awake interval for each frame type, E (Z x ) is an average value of sizes of the frame types, S is a standard scale factor for determining a target size for each frame type, and σ [Z x ] And v is the transmission rate of the data channel.

In another embodiment, the length of the awake interval may be calculated based on the target size (unit is bit / pixel), the resolution, and the transmission rate of the data channel for each frame type.

For example, the calculation of the length of the awake interval for each frame type can be performed by Equation (6).

On the other hand, when the target size is defined as a unit of bits per pixel (Equation 6), the target size is multiplied by the frame resolution? *?, And the multiplied value is multiplied by the transmission rate of the data channel (v), the length of the awake section for each frame type can be calculated.

Figure 112015088749837-pat00006

Here, t x is a frame type and control the length of the wake period, E (Z x) + S * σ (Z x) is the frame type of the target size (in bit / pixel) and, α is the horizontal resolution (in units of frames is pixel), β is the frame's vertical resolution (unit is pixel), and v is the data rate (unit is bit / s) of the data channel.

Finally, in step S130, the video frame transmission apparatus transmits a frame to the client based on the awake interval for each set frame type.

For example, if the size of the frame to be transmitted by the video frame transmitting apparatus is smaller than or equal to the target size corresponding to the frame type within the awake interval, the entire frame can be transmitted.

However, if the size of the frame to be transmitted is larger than the target size, the video frame transmitting apparatus may transmit only the same size as the target size among the frames to be transmitted, and may not transmit the remaining unsent portions within the awake section.

When the awake interval ends, the video frame transmission apparatus can enter the sleep state again. In this case, the remaining untransferred portion may be lost and may not reach the client.

At this time, a countermeasure for the case where the remaining part that has not been transmitted occurs will be described later in detail with reference to FIG.

As described above, the video frame transmission method according to an embodiment of the present invention has an effect of improving power consumption by dynamically setting an awake interval according to a target size for each frame type to be transmitted.

2 is a flowchart of a video frame transmission method according to another embodiment of the present invention.

In step S210, the video frame transmission apparatus transmits a target size for each frame type, which is the maximum size of a single frame transmitted during a single awake period, for each frame type of I-frame, P-frame, and B- Size distribution.

In step S220, the video frame transmission apparatus sets priority of each frame based on at least one of the type and order of frames in the GOP of the video data to be transmitted.

More specifically, if an I-frame is lost, all frames in the GOP will be lost, and if a P-frame is lost, all subsequent P-frames and B-frames in the GOP will be lost. However, if a B-frame is lost, it will not affect other frames.

In addition, even in the case of the same P-frame, its importance may be changed depending on whether the transmission order is forward or backward in one GOP. This is because the number of subsequent frames (P-frame and B-frame) affected by the P-frame transmitted earlier is larger than that of the P-frame transmitted later in the GOP.

For example, if the GOP is configured in the order of {I, B1, B2, P1, B3, B4, P2, B5, B6, P3, B7, B8} Frame 601 and P1 and P2 (604, 607) frames having larger influence on the subsequent frame by the transmitting apparatus are set to 1 and the priority of the remaining frames 602, 603, 605, 606, 608, 609 , 610, 611, and 612 can be set to zero.

On the other hand, the order of execution of step S220 may be changed anywhere before step S260 as needed.

In step S230, the video frame transmission apparatus sets an awake interval for each frame type based on the target size for each frame type and the transmission rate of the channel through which the frame is transmitted.

In step S240, the video frame transmission apparatus transmits the frame to the client based on the awake interval for each set frame type.

In step S250, the video frame transmission apparatus determines whether some untransmitted frames are transmitted to the client for only a part of the frames during the awake interval for each frame type among the respective frames.

If some unsent frames are generated, step S260 is performed. However, if some untransmitted frames do not occur, the video frame transmitting apparatus ends the operation.

If the size of the frame to be transmitted by the video frame transmission apparatus is larger than the determined target size, the partial transmission frame may be generated by transmitting only the target frame. It may also be caused by other internal or external circumstances (eg network errors).

Finally, in step S260, when some untransmitted frames are generated, the video frame transmission apparatus selectively transmits the remaining portion of some untransmitted frames along with at least one other frame in the next sequence based on the set priority. For example, If some untransmitted frames have occurred, processing for the remaining part of some untransmitted frames may be selectively performed according to the priority set in step S210.

That is, if the partial transmission frame is one of the I-frame 601 and the P1 and P2 frames 604 and 607 whose priority is set to 1, the remaining part of the partial transmission frame is transmitted to at least one other Frame. However, if the partial transmission frame is one of the P3 frame 610 and the B1 through B8 frames 602, 603, 605, 606, 608, 609, 611, and 612 whose priority is set to 0, The rest of the frame may be lost without being transmitted.

At this time, a frame obtained by summing other frames transmitted together with the remaining portion of some untransmitted frames may be referred to as a residual sum frame.

In another embodiment, when the priority of each frame is set to three kinds of upper, middle, and lower, if the priority of the frame to which the video frame transmission apparatus is transmitted is higher than that of the other frames, If it is a middle level, it is transmitted together with one other frame in the following order, and if it is a lower level, it is not transmitted.

For example, if the GOP is configured in the order of {I, B1, B2, P1, B3, B4, P2, B5, B6, P3, B7, B8} 601 and P1-frame 604 are set to an upper priority, the P2-frame 607 is set to a middle priority and the remaining P3-frame 610 and B1 to B8 frames 602, 603, 605, 606, 608, 609, 611, 612) can be set as a priority lower level.

At this time, if some untransmitted frames are generated, the remaining frames of the I-frame 601 and the P1-frame 604 having the higher priority are transmitted to the video frame transmission apparatus in the order {B1, B2} 602, 603 and {B3, B4} (605, 606). Also, for the P2-frame 607 with a medium priority, the remaining portion of the partially untransmitted frame may be transmitted along with the B5-frame 608 of the next sequence. In addition, the remainder of the frames not yet transmitted may not be transmitted to the remaining frames 602, 603, 605, 606, 608, 609, 610, 611, 612 which are lower in priority.

On the other hand, a method of transmitting the remaining part of some untransmitted frames together with two frames in the following order will be described later in detail with reference to FIG.

In another embodiment, the video frame transmission apparatus analyzes the power consumption amount according to the changed target size and the delay or omission count of the frame according to the selective transmission while changing the target size according to the type. According to the analysis result, And determining the optimal target size as the optimal target size.

For example, when the video frame transmission apparatus changes the target size for each frame type while moving the value of the standard scale factor S expressed in Equation (4) by 0.1 in the range of 0.5 to 1.7, the power consumption of the video frame transmission apparatus The change of the frame delay and the number of missing frames are analyzed.

Then, the analysis result is reviewed to find a standard scale factor S value that minimizes the power consumption of the video frame transmission apparatus while minimizing the delay and omission of the frame as much as possible, The target size for each frame type to which the value is applied can be determined again.

At this time, the process of determining the optimum target size may be performed using video data that is actually streamed, but may also be performed through simulation using previously stored video data.

As described above, in the video frame transmission method according to another embodiment of the present invention, when some untransmitted frames occur, the remaining portion of the untransmitted frames can be transmitted along with at least one frame of the next sequence based on the set priority So that it is possible to minimize delay and omission of frames while reducing power consumption.

Figure 3 is a flow diagram of a method for transmitting along with at least one other type of frame in the next order according to one embodiment of the present invention.

In step S310, when some unsent frames are generated, the video frame transmission apparatus re-determines the target sizes for the frame types of at least one other frame in the next sequence based on the set priority.

For example, if some non-transmitted frames occur and the priority set in some of the non-transmitted frames is a priority to be retransmitted, then the video frame transmission apparatus transmits at least one frame of the next non- The remaining part is transmitted.

However, since the awake interval for at least one other frame of the next sequence will be set to correspond to the type-specific target size of that frame only, the awake interval thus set will not affect the transmission time May not be sufficiently secured.

Therefore, if the remaining portion of some non-transmitted frames and the next ordered frame are transmitted together, it is possible to re-determine a target time different from the target time for at least one frame type of the next sequence. The concrete recrystallization process is as follows.

In the first step, the size distribution of the remaining portions (Ir, Pr) of some untransmitted frames is derived in consideration of the size distribution and target size of each frame type corresponding to some untransmitted frames.

At this time, if some untransmitted frames are I frames, the remaining part of the I frames can be represented by Ir, and if some untransmitted frames are P frames, the remaining part of the P frames can be indicated as Pr.

In the second step, the size distribution of the remaining part (Ir, Pr) of the derived non-transmitted frame and the size distribution of the frame type of at least one other frame (B frame) in the following order are convolutionalized to obtain residual sum frames IrB , PrB).

In the third step, the target size for each frame type of at least one other frame is re-determined based on the size distribution of the remaining amount sum frame (IrB, PrB).

For example, referring to FIG. 6, when a part of the non-transmitted frames is an I-frame 601, the remaining part Ir of the non-transmitted frames is transmitted with the B1- The target size of the I-frame remaining amount summing frame IrB can be calculated using the following Equation (7) using the size distribution of the remaining amount summing frame IrB derived through the convolution operation in this embodiment.

Likewise, if some of the non-transmitted frames are P-frames 604 and 607, the target size of the P-frame remaining amount sum frame (PrB), which is the size of data to be transmitted together with the B-frames 605, 606, Can be calculated using the following equation (8). (Note that P2-frame 607 is assumed to be transmitted with one B5 frame 608 in the next sequence).

Figure 112015088749837-pat00007

Here, T IrB (S) is a target size of the I-frame remaining amount summing frame IrB , E [ ZIrB ] is an average value of the I-frame remaining amount summing frame IrB, and S is an I- a standard scale factor for determining the size of the target IrB), σ [Z IrB] is the standard deviation of the size of the summing I- frames remaining frame (IrB).

Figure 112015088749837-pat00008

Here, T PrB (S) is the target size of the P-frame remaining amount summing frame PrB , E [Z PrB ] is the average value of the P-frame remaining amount summing frame PrB, and S is the P- PrB), and [ Sigma ] [Z PrB ] is a standard deviation of the magnitude of the P-frame remaining amount summing frame (PrB).

In step S320, the video frame transmission apparatus resets the awake interval for each frame type of the at least one frame based on the target size of the at least one other frame in accordance with the re-determined frame type and the transmission rate of the channel for transmitting the frame.

For example, the length of the awake interval, which is reset by the video frame transmission apparatus, can be calculated by Equation (5) using the target size of the remaining amount sum frame re-determined in the previous step.

Finally, in step S330, the video frame transmission apparatus transmits the remaining portion of some untransmitted frames along with at least one other frame of the next sequence, based on the awake interval for each frame type that has been reset.

8, when some untransmitted frames are I-frames 802, 812, and 822, and when some untransmitted frames are P-frames 832, 842, and 852, 814, 824, 826, 834, 844, 846, 854, and 856 are transmitted using the first, second, third, fourth, fifth, sixth, seventh, eighth,

In the upper left embodiment, since the I-frame is larger than the target size T I and only a part of the frame is transmitted during the awake interval of the I-frame, the I-frame becomes a part of the non-transmission frame, (802) is transmitted along with the next frame, the B1-frame. At this time, since the size of the remaining amount sum frame in which the remaining portion 802 of the I-frame, which is a non-transmitted frame, and the B1-frame are smaller than the target size TIrB of the B1-frame, All can be transmitted during the wake time. In this case, it can be seen that the target size of the B1-frame is reset to T IrB . If the initial target size is set to T B , the remaining sum frame can not be transmitted during the awake period of the B1-frame, Is reset to T IrB , so that the awake interval is reset to a value as high as the interval, so that the remaining sum frame can be transmitted during the re-awake interval of the B1 frame.

In the upper middle example, when the size of the remaining amount summing frame in which the remaining portion 812 of the I-frame and the B1-frame are partially larger than the target size T IrB of the B1-frame, A portion 814a of the remainder 812 of the frame 814 is transmitted with the B1-frame and the other portion 814b is transmitted with the B2-frame.

In the upper right embodiment, when the size of the B1-frame is equal to the target size, the remaining portion 822 of the I-frame, which is a part of the non-transmitted frames, can not be transmitted together during the awake interval of the B1- - Sent along with the frame. At this time, a portion 826a of the remaining portion 822 of the I-frame, which is some non-transmitted frame, is transmitted along with the B2-frame, but the other portion 826b is lost.

In the lower left embodiment, when the size of the remaining amount summing frame in which the remaining portion 832 of the P2-frame and the B5-frame are partially larger than the target size T PrB of the B5-frame, A portion 834a of the remainder 832 of the frame is transmitted with the B1-frame and the other portion 834b is lost.

In the lower middle example, when the size of the remaining amount summing frame in which the remaining portion 842 of the P2-frame and the B5-frame are partially equal to the target size T PrB of the B5-frame, The remaining portion 842 of the B5-frame is transmitted together with the B5-frame during the awake interval of the B5-frame. In this case, the remainder of the size of the frame exceeds the target size B6- T B Because of B6- target frame size larger than T B of B6- frame is partially not there is a transmission frame, B6- frame is a low-priority frame portion (846) is lost.

In the lower-right embodiment, when the sizes of the P3-frame, the B7-frame, and the B8-frame are larger than the target sizes of the respective frame types, the priority of the P3-frame, the B7-frame, and the B8- The remaining portions 852, 854, and 856 exceeding the target size are all lost.

8, the awake interval of the B2 and B6 frames is not reset but is set to the initial awake interval T B , which is an embodiment only. In another embodiment, the awake interval of the B2 and B6 frames is T IrB And T PrB .

As such, the method of transmitting along with at least one other type of frame in the following order according to an embodiment of the present invention re-determines the target size of the next frame to be transmitted with the remainder of some untransmitted frames, It is possible to set an awake interval that more accurately corresponds to the video data to be actually transmitted, and as a result, the number of missing video frames can be minimized.

4 is a diagram illustrating a video frame transmission apparatus according to an embodiment of the present invention.

Referring to FIG. 4, a video frame transmission apparatus 400 according to an embodiment of the present invention includes a target size determination unit 410, an interval setting unit 420, and a transmission unit 430.

The target size determination unit 410 determines a target size for each frame type, which is the maximum size of a single frame transmitted during a single awake period, for each frame type of I-frame, P-frame, and B- And the distribution is determined.

The interval setting unit 420 sets an awake interval for each frame type based on a target size for each frame type and a transmission rate of a channel for transmitting the frame.

Finally, the transmitting unit 430 transmits the video frame to the client based on the awake interval for each set frame type.

5 is a view for explaining a video frame transmission apparatus according to another embodiment of the present invention.

5, a video frame transmission apparatus 400 according to another exemplary embodiment of the present invention includes a target size determination unit 410, an interval setting unit 420, a transmission unit 430, and a priority setting unit 440, . It may also optionally include a result analyzer (not shown).

The target size determination unit 410 determines a target size for each frame type, which is the maximum size of a single frame transmitted during a single awake period, for each frame type of I-frame, P-frame, and B- And the distribution is determined.

The interval setting unit 420 sets an awake interval for each frame type based on a target size for each frame type and a transmission rate of a channel for transmitting the frame.

The transmitting unit 430 transmits the video frame to the client based on the awake period for each set frame type.

The priority setting unit 510 sets the priority of each frame based on at least one of the type and order of frames in the GOP of the video data to be transmitted.

Finally, the result analyzing unit (not shown) analyzes the power consumption according to the changed target size and the delay or omission frequency of the frame according to the selective transmission while changing the target size according to the type.

In another embodiment, when some untransmitted frames are transmitted to the client for only a part of the frames during the awake interval for each frame type among the respective frames, the transmitting unit 430 transmits the remaining part May optionally be transmitted with at least one other frame of the next sequence.

In another embodiment, the priority setting unit 510 sets the priority of each frame to three types of upper, middle, and lower, and when the priority of the transmitted frame is higher, Is transmitted together with a plurality of other frames in the next sequence, if it is the middle order, it is transmitted together with one other frame in the next sequence, and if it is lower, it is not transmitted.

In another embodiment, the target size determination unit 410 may further determine an optimum target size for each frame type according to the analysis result of the result analysis unit (not shown).

The above-described embodiments of the present invention can be embodied in a general-purpose digital computer that can be embodied as a program that can be executed by a computer and operates the program using a computer-readable recording medium.

The computer readable recording medium includes a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.), optical reading medium (e.g., CD ROM, DVD, etc.).

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (20)

Determining a target size for each frame type, which is a maximum size of a single frame transmitted during a single awake interval, for each frame type of the I-frame, the P-frame, and the B-frame constituting the video data in consideration of the size distribution for each frame type;
Setting a priority of each of the frames based on at least one of a type and an order of the frames in a GOP of the video data;
Setting an awake interval for each frame type based on a target size for each frame type and a transmission rate of a channel for transmitting the frame;
Transmitting the frame to a client based on the set awake interval for each frame type; And
When a part of the frames transmitted during the awake interval of the frame type is transmitted to the client, the remaining part of the non-transmitted frames is selectively transmitted in the next order With at least one other frame of the frame;
The method of claim 1, wherein the power consumption of the video frame is less than the power consumption of the video frame. delete The method according to claim 1,
The step of setting the priority of each of the frames
The priority of each of the frames is set to three types of upper, middle, and lower,
Wherein the step of selectively transmitting along with at least one other frame of the next sequence comprises:
If the priority of the transmitted frame is higher than the priority, the remaining part is transmitted together with a plurality of other frames in the next sequence, and if the priority is higher than the priority, Wherein the video frame transmission method is a method for transmitting a video frame considering power consumption. The method according to claim 1,
Analyzing a power consumption amount according to the changed target size and a delay or omission count of a frame according to the selective transmission while changing the target size according to the type; And
Determining an optimal target size for each type of frame according to the analysis result;
The method of claim 1, further comprising: The method according to claim 1,
Wherein the step of selectively transmitting along with at least one other type of frame in the next sequence comprises:
Reassigning the target size for each frame type of at least one other frame of the next sequence based on the set priority if the partial non-transmitted frame occurs;
Resetting an awake interval for each frame type of the at least one frame based on a target size of the at least one other frame by the recursive frame type and a transmission rate of a channel for transmitting the frame; And
Transmitting the remaining portion of the part of the non-transmitted frames along with the at least one other frame of the next sequence based on the re-established awake interval for each frame type;
The method of claim 1, wherein the power consumption of the video frame is less than the power consumption of the video frame. 6. The method of claim 5,
The step of redetermining the target size for each frame type of the at least one other frame
Deriving a size distribution of a remaining portion of the partial transmission frame considering a size distribution and a target size for each frame type corresponding to the partial transmission frame;
Deriving a size distribution of a residual sum frame obtained by performing a convolution operation on the derived size distribution and a size distribution of at least one other frame of the next frame; And
Reassigning the target size for each frame type of the at least one other frame based on the size distribution of the remaining amount sum frame;
The method of claim 1, wherein the power consumption of the video frame is less than the power consumption of the video frame. The method according to claim 1,
Wherein the step of determining the target size for each frame type in consideration of the size distribution for each frame type
Wherein the priority of the video frame is determined based on the importance of each frame. The method according to claim 1,
The size distribution of the I-frame is represented by a gamma distribution,
Wherein the size distribution of the P-frame and the B-frame is expressed by multiplying gamma scale factors of the gamma distribution representing the size distribution of the I-frame by respective gamma scale factors. Frame transmission method. The method according to claim 1,
The target size for each frame type is
A standard deviation of a size of each frame type, and a standard scale factor to be applied to the standard deviation. The method according to claim 1,
The length of the awake section is
And the transmission rate of the data channel is calculated based on the number of bits per pixel, the resolution, and the transmission rate of the data channel. A target size for determining a target size for each frame type, which is the maximum size of a single frame transmitted during a single awake interval, for each frame type of I-frame, P-frame and B- A decision unit;
A priority setting unit for setting a priority of each of the frames based on at least one of a type and an order of the frame in the GOP of the video data;
An interval setting unit setting an awake interval for each frame type based on a target size for each frame type and a transmission rate of a channel for transmitting the frame; And
A transmitting unit for transmitting a video frame to a client based on the set awake interval for each frame type;
Lt; / RTI >
The transmitter
When a part of the frames transmitted during the awake interval of the frame type is transmitted to the client, the remaining part of the non-transmitted frames is selectively transmitted in the next order Wherein the at least one other frame of the at least one video frame is further transmitted. delete 12. The method of claim 11,
The priority setting unit
The priority of each of the frames is set to three types of upper, middle, and lower,
The transmitter
If the priority of the transmitted frame is higher than the priority, the remaining part is transmitted together with a plurality of other frames in the next sequence, and if the priority is higher than the priority, Wherein the video frame transmission apparatus considers power consumption. 12. The method of claim 11,
A result analyzing unit for analyzing a power consumption amount according to the changed target size and a delay or omission count of a frame according to the selective transmission while changing the target size for each type;
Further comprising:
The target size determination unit
And determines an optimal target size for each frame type according to the analysis result. 12. The method of claim 11,
The target size determination unit
And when the partial transmission frame is generated, re-determining the target size for each frame type of at least one other frame of the next sequence based on the set priority,
The section setting unit
Resetting the awake interval for each frame type of the at least one frame based on the target size of the recoded frame type of the at least one other frame and the transmission rate of the channel transmitting the frame,
The transmitter
And transmits the remaining part of the part of the non-transmitted frames along with the at least one other frame in the next order, based on the re-established awake interval for each frame type. 16. The method of claim 15,
The target size determination unit
Deriving a size distribution of a remaining portion of the partial transmission frame by considering a size distribution and a target size for each frame type corresponding to the partial transmission frame,
Calculating a size distribution of a residual sum frame obtained by performing a convolution operation on the derived size distribution and a size distribution of at least one other frame of the next frame,
And re-determines a target size for each frame type of the at least one other frame based on the size distribution of the remaining amount sum frame. 12. The method of claim 11,
The target size determination unit
Wherein the frame rate is determined based on the importance of each frame. 12. The method of claim 11,
The size distribution of the I-frame is represented by a gamma distribution,
Wherein the size distribution of the P-frame and the B-frame is expressed by multiplying gamma scale factors of the gamma distribution representing the size distribution of the I-frame by respective gamma scale factors. Frame transmission device. 12. The method of claim 11,
The target size for each frame type is
And a standard scale factor to be applied to the standard deviation and a standard deviation of a size of the frame type, and a standard scale factor to be applied to the standard deviation. 12. The method of claim 11,
The length of the awake section is
And the transmission rate of the data channel is calculated based on the number of bits per pixel, the resolution, and the transmission rate of the data channel for each frame type.
KR1020150129263A 2015-09-11 2015-09-11 Method And Apparatus for Transmitting Video Frames Considering Power Consumption KR101704655B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150129263A KR101704655B1 (en) 2015-09-11 2015-09-11 Method And Apparatus for Transmitting Video Frames Considering Power Consumption

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150129263A KR101704655B1 (en) 2015-09-11 2015-09-11 Method And Apparatus for Transmitting Video Frames Considering Power Consumption

Publications (1)

Publication Number Publication Date
KR101704655B1 true KR101704655B1 (en) 2017-02-09

Family

ID=58154389

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150129263A KR101704655B1 (en) 2015-09-11 2015-09-11 Method And Apparatus for Transmitting Video Frames Considering Power Consumption

Country Status (1)

Country Link
KR (1) KR101704655B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210084211A (en) 2019-12-27 2021-07-07 중앙대학교 산학협력단 Method and apparatus for video frame transmission based on expected value maximization algorithm in Wi-Fi Direct

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
Zhang Y. et al., ‘A new VBR model of MPEG streams on ATM networks on ATM networks’, International Conference on Communication Technology, 1998.10.* *
김매화 외 2, ‘Wi-Fi Direct에서 VBR 비디오 트래픽을 고려한 동적 에너지 관리 기법’, The Journal of The Korean Institute of Communication Sciences 40(11), 2015.11, 2218-2229 *
정영하 외 2, ‘DiffServ 네트워크에서 비디오 스트리밍을 위한 적응적 트래픽 마커 알고리듬 연구’, 한국통신학회 논문지 vol.32, No. 12(2007) *
황제윤, ‘Wifi Direct 네트워크에서 트래픽 부하량을 고려한 향상된 전력 절감 기법’, 경북대학교, 석사학위논문, 2013.12.* *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210084211A (en) 2019-12-27 2021-07-07 중앙대학교 산학협력단 Method and apparatus for video frame transmission based on expected value maximization algorithm in Wi-Fi Direct
KR102388186B1 (en) * 2019-12-27 2022-04-19 중앙대학교 산학협력단 Method and apparatus for video frame transmission based on expected value maximization algorithm in Wi-Fi Direct

Similar Documents

Publication Publication Date Title
US20210203607A1 (en) Bandwidth Management
EP2888844B1 (en) Device and method for adaptive rate multimedia communications on a wireless network
US10805196B2 (en) Packet loss and bandwidth coordination
US20160044329A1 (en) Image Predictive Coding Method and Image Encoder
US9781474B2 (en) Content playback information estimation apparatus and method and program
JP6099107B2 (en) Method and apparatus for assessing media quality
US7974479B2 (en) Encoding apparatus, method, and computer product, for controlling intra-refresh
KR20130112056A (en) Video data quality assessment method and device
JP2007524299A (en) Method and apparatus for measuring transmission quality of multimedia data
KR20190122830A (en) Video frame coding method, terminal and storage medium
WO2014035896A2 (en) Device and method for adaptive rate multimedia communications on a wireless network
JP4460506B2 (en) User experience quality estimation apparatus, method, and program
KR102037413B1 (en) Method and Apparatus of Dynamic Buffering for Providing Streaming Service
JP2006203910A (en) Method for transmitting data with no jitter in synchronizing ethernet (r) system
CN111726656A (en) Transcoding method, device, server and storage medium for live video
KR101704655B1 (en) Method And Apparatus for Transmitting Video Frames Considering Power Consumption
US20170063703A1 (en) Bandwidth Management
US20080123619A1 (en) Apparatus, method, and computer readable medium thereof for dividing a beacon interval
JP2017076892A (en) Buffer size-deciding device, system, buffer size-deciding method, video data reproducing method and program
US20130081071A1 (en) Estimating user-perceived quality of an encoded video stream
CN109769258B (en) Resource optimization method based on secure URLLC communication protocol
CN113473125B (en) Code rate control method, equipment, storage medium and product
KR100902114B1 (en) End-to-end available bandwidth estimation apparatus and method for multimedia streaming
JP2007329778A (en) Apparatus, method and program for estimating user's sensory quality
KR101637022B1 (en) Apparatus and method for transmitting and receiving content

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant