BR112016029138B1 - ADAPTIVE BIT RATE SEAMLESS TRANSFER FOR WIRELESS VIDEO - Google Patents

Abstract

ADAPTIVE BIT RATE SEAMLESS TRANSFER FOR WIRELESS VIDEO. Techniques related to adaptive bitrate streaming for wireless video are discussed. Such techniques may include determining candidate bitrates for encoding segments of a source video. A minimum of the candidate bitrates can be selected and a segment of the source video can be encoded based on the selected encoding bitrate. The encoded bitstream can be transmitted wirelessly from a transmitting device to a receiving device, which can decode the bitstream and present the decoded video to a user.

Description

PRIORITY CLAIM

[0001] This application claims the priority of U.S. Serial Patent Application No. 14/327,752 entitled “ADAPTIVE BITRATE STREAMING FOR WIRELESS VIDEO” and filed on July 10, 2014, which is incorporated herein by reference, in its entirety.

HISTORIC

[0002] Streaming video content (eg Internet content, locally saved content, or the like) from a mobile device to a television via wireless display technology is becoming increasingly popular. For example, a Wi-Fi communications channel can be used to deploy Wireless Display (WiDi) and/or Miracast technology to allow users to seamlessly stream videos, movies, photos or displayed content from a mobile device to a television. .

[0003] In some deployments, wireless channel capacity may not be a bottleneck or concern when transmitting video content over a wireless channel. However, continuous transmission of video content at an unnecessarily high encoding bit rate over a wireless channel can lead to various problems such as wasting wireless bandwidth, causing interference in the transmission environment, and shortening the life of mobile device battery that continuously streams video content. In particular, the reduced battery life can be considerable and can degrade the user experience for a mobile device and/or television user. In other deployments, wireless channel capacity may be a concern, and streaming video content at a lower bit rate continuously may be advantageous for utilizing the wireless communications channel.

[0004] Current WiDi/Miracast solutions can set a fixed relatively high video encoding bitrate (for example, an average encoding bitrate of about 9 megabits per second (Mbps) and an encoding bitrate maximum of about 12 Mbps for video with a resolution of 1920x1080) to ensure that the transmission will not degrade the quality of the original content (for example, the content on the transmitting device) whatever video content is streamed continuously. Such techniques can lead to short battery life during continuous streaming of WiDi/Miracast type video. Solutions have been proposed to reduce the encoding bit rate, but such solutions may not ensure quality video or quality user experience on the receiving display device (eg a television).

[0005] As such, existing techniques do not provide for wireless streaming of video content at a reduced bit rate to improve battery life in the transmitting device (e.g., a mobile device) and high quality video presentation on the receiving device (for example, a television). Such problems can become alarming as the desire to stream video content from a transmitting device for the presentation of high quality, aesthetically pleasing video content on a receiving device becomes even more pervasive.

BRIEF DESCRIPTION OF THE DRAWINGS

[0006] The material described in this document is illustrated by way of example and not by way of limitation in the attached Figures. For the sake of simplicity and clarity of the invention, the elements illustrated in the Figures are not necessarily to scale. For example, the dimensions of some elements may be exaggerated relative to other elements for clarity. Additionally, where deemed appropriate, reference labels have been repeated within the Figures to indicate either corresponding or analogous elements. In the Figures:

[0007] Figure 1 is an illustrative diagram of an exemplary system for wireless transmission of video content;

[0008] Figure 2 illustrates an exemplary system for encoding video content for wireless transmission;

[0009] Figure 3 illustrates an exemplary system for encoding video content for wireless transmission;

[0010] Figure 4 is a flow chart illustrating an exemplary process for encoding video content for wireless transmission;

[0011] Figure 5 is a flow chart illustrating an exemplary process for encoding video content for wireless transmission;

[0012] Figure 6 is an illustrative diagram of an exemplary system;

[0013] Figure 7 is an illustrative diagram of an exemplary system; It is

[0014] Figure 8 illustrates an exemplary device fully arranged in accordance with at least some implementations of the present disclosure.

DETAILED DESCRIPTION

[0015] One or more embodiments or implementations will now be described with reference to the attached Figures. While specific configurations and arrangements are discussed, it should be understood that this is done for illustrative purposes only. Persons skilled in the relevant art will recognize that other configurations and arrangements may be employed without departing from the spirit and scope of the description. It will also be apparent to those skilled in the relevant art that techniques and/or arrangements described herein may also be employed in a variety of other systems and applications than what is described herein.

[0016] While the following description sets out various deployments that can be manifested in architectures such as system-on-a-chip (SoC) architectures, for example, deployment of the techniques and/or arrangements described in this document are not restricted to architectures and/or particular computing systems and may be deployed by any architecture and/or computing system for similar purposes. For example, various architectures employing e.g. chips and/or multiple integrated circuit (IC) packages, and/or various computing devices and/or consumer electronics (CE) devices such as signal converters, smart phones, etc., may implement the techniques and/or arrangements described in this document. Additionally, although the following description may establish numerous specific details such as logical deployments, types and interrelationships of system components, logical partitioning/integration choices, etc., the claimed subject matter can be practiced without such specific details. In other cases, some material, such as control structures and complete software instruction sequences, may not be shown in detail in order not to obscure material disclosed herein.

[0017] The material disclosed herein may be implanted by hardware, firmware, software or any combination thereof. The material disclosed herein may also be implemented as instructions stored on a machine-readable medium that can be read and executed by one or more processors. Machine-readable media can include any media and/or mechanism for storing or transmitting information in a machine-readable form (eg, a computing device). For example, a machine-readable medium may include read-only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; electrical, optical, acoustic or other forms of propagated signals (eg carrier waves, infrared signals, digital signals, etc.), and others.

[0018] References in the descriptive report to “one (1) deployment”, “one deployment”, “an exemplary deployment”, etc., indicate that the described deployment may include a particular feature, structure or characteristic, but every modality may include, or not necessarily include, the particular feature, structure or characteristic. Furthermore, such phrases do not necessarily refer to the same deployment. Furthermore, when a particular feature, structure or feature is described in conjunction with a modality, it is suggested that it is within the knowledge of a person skilled in the art to perform such feature, structure or feature in conjunction with other deployments regardless of whether or not they are explicitly stated. described in this document.

[0019] Methods, devices, apparatus, computing platforms and articles are described in this document in relation to the encoding of video content for wireless transmission and, in particular, the selection of an encoding bitrate for encoding the content of video.

[0020] As described above, it may be advantageous to stream video content such as a source video (e.g. Internet content, locally saved content or the like) from a mobile device to a television via wireless display technology. . For example, such a system can provide users with flexibility in presenting and sharing content. Furthermore, as discussed, some existing techniques can provide fixed relatively high encoding bitrates that can decrease battery life in the transmitting device and/or lead to overuse or overstrain of the wireless communications channel. Other existing techniques can reduce encoding bitrates at the cost of diminished video quality that reduces a user's experience.

[0021] In some embodiments discussed in this document, encoding video content for wireless transmission may include determining bitrates of multiple candidates for encoding a source video segment. For example, candidate bitrates can be candidate bitrates for source video encoding based on the local codec (for example, the local video codec used by the sending device for encoding and the receiving device for decoding ). The local codec can be any suitable codec such as the codec based on the H.264/MPEG-4 Advanced Video Coding (AVC) standard or the High Efficiency Video Coding (HEVC) standard or the like. A minimal portion of the candidate bitrates can be selected for segment encoding and the segment can be encoded based on the local video codec and selected bitrate. The resulting encoded bitstream can be transmitted to a receiving device for decoding and eventual presentation to a user.

[0022] In some examples, a first candidate bitrate may be determined based on a source video bitrate modified by a scaling factor. For example, the source video can be compressed source video that has been compressed based on a video codec associated with the source video. The video codec used to compress the source video can be any suitable codec like MPEG-2, H.264/MPEG-4 AVC standard, HEVC standard, Audio and Video (AVS) standard, Windows Media codec Video or similar. For example, the local video codec and the video codec associated with the source video compression can be different. A bitrate associated with the compressed source video can be determined (e.g. through an application programming interface or the like) and the determined bitrate can be modified by a scaling factor to generate the first bitrate of candidate. The scaling factor can be an adaptive scaling factor based on the video codec associated with the compressed source video and the local codec.

[0023] Furthermore, a second candidate bitrate can be determined based on an average bitrate for the segment encoded using the local codec or a previously encoded segment (for example, a previous segment in the source video encoded using the local codec). In some examples, a previously encoded segment can be used to generate a candidate bitrate for a subsequent segment (for example, a current segment). Such examples can provide low-latency, substantially real-time encoding bitrates for encoding and streaming the source video. In other examples, the segment itself may be encoded (for example, based on a previous target bitrate, a default bitrate, or based on another encoding parameter) and a candidate bitrate determined to the segment. In such examples, after determining a selected encoding bitrate from candidate bitrates, the segment may be encoded (again) based on the selected bitrate. Such examples can provide increased accuracy in encoding bitrate selection at the cost of potential latency issues in transmitting the video content to the receiving device.

[0024] In some examples, a third candidate bitrate may be determined based on an encoding bitrate prediction for the segment encoded using the local codec or a previously encoded segment (e.g., a previous segment in the source video encoded using the local codec). Encoding bitrate prediction can be based on the encoded bitstream of the segment or the previously encoded segment, a selected desired average opinion index (MOS; for example, a measure of a user's vision of quality), thresholds of selected minimum and maximum bitrate and quality coefficients associated with the receiving device (eg based on the resolution of the receiving device or similar). The encoding bitrate prediction can provide a MOS-based bitrate prediction without reference to the encoding of the segment. As discussed in connection with the second candidate bitrate, encoding bitrate prediction can be based on an encoding of the segment itself or based on an encoding of a previous segment of the video content.

[0025] A selected encoding bitrate for the segment may be determined as a minimum of the first, second, and third candidate bitrates. Furthermore, the segment can be encoded using the local video codec and based on the selected encoding bitrate. The resulting bitstream can be transmitted wirelessly to a receiving device, which can decode the bitstream to generate video frames for presentation to a user. Such techniques can provide reduced bit rates for transmitting video content, which can save battery life on the transmitting device. Furthermore, the techniques discussed in this document can provide high quality video with a lower encoding bit rate and lower required wireless bandwidth and improve the robustness of WiDi/Miracast performance under interference, thus enhancing the user experience. user during streaming video.

[0026] Figure 1 is an illustrative diagram of an exemplary system 100 for wireless transmission of video content, arranged in accordance with at least some implementations of the present disclosure. As shown in Figure 1, the system 100 may include a transmitter device 101 and a receiver device 102 communicatively coupled over the wireless communications channel 103. In some examples, the transmitter device 101 may transmit over the wireless communications channel wire 103, encoded video data to the receiving device 102. The receiving device 102 can receive the encoded video data, decode it to generate video frames or the like, and present the decoded video to a user. Although illustrated with a single transmitter device 101 and a single receiver device 102 communicating over a single wireless communications channel 103, any number of transmitter devices, receiver devices, and/or wireless communications channels may be employed in the system 100 .

[0027] In the illustrated example, transmitter device 101 is a tablet and receiver device 102 is a television. However, any combination of suitable devices can be deployed through system 100. For example, transmitter device 101 can include any suitable device such as a computer, laptop, ultrabook, smart phone, tablet, or the like. Furthermore, the receiving device 102 can include any suitable device such as a television, a smart television, a computer, a laptop, an ultrabook, a smart phone, a tablet or the like. In some examples, receiver device 102 may be a set-top box or a digital recorder or the like. In such examples, receiver device 102 may not include a screen, but receiver device 102 may be coupled to a screen for displaying video content. In any case, the transmitting device 101 and/or the receiving device 102 can be described as a computing device as used herein. Furthermore, the video content transmitted from the transmitting device 101 to the receiving device 102 may include any suitable video content such as a video or other content downloaded to the transmitting device 101 over the Internet or a local area network or the like, a video file or container of video or other video content saved in a transmitting device's memory, a continuous stream of video data, or other images that emulate the screen of the transmitting device 101 (for example, the receiving device 102 may mirror the content displayed through the transmitter device 101), photographs continuously transmitted from the transmitter device 101 to the receiver device 102, or the like. In some examples, the receiving device 102 and the transmitting device 101 may present the same content to a user or users, and in other examples they may present different content.

[0028] Wireless communications channel 103 may be any suitable wireless link and communications may be facilitated via any suitable protocol(s) or standard(s). In some examples, wireless communications channel 103 is a Wi-Fi connection based on an Institute of Electrical and Electronics Engineers (IEEE) 802.11 standard such as 802.11a/b/g/n/ac/ad or similar. In other examples, wireless communications channel 103 may be based on an implementation of a Wi-Fi Multimedia Interoperability (WMM) standard. In yet other examples, wireless communications channel 103 can provide communications based on wireless display technology (WiDi) and/or based on the deployment of a wireless screen broadcasting standard such as a Miracast standard that uses wireless connections. WiFi direction. In one embodiment, wireless communications channel 103 forms part of a wireless local area network (WLAN).

[0029] As discussed in this document, it may be advantageous, even in cases where the bandwidth of the wireless communications channel 103 is not a bottleneck or a concern, to limit the bit rate for transmitting video content from the transmitting device 101 to the receiving device 102. For example, such bandwidth throttling can preserve the battery life of the transmitting device 101. Techniques discussed herein can reduce the bit rate of transmitted video while providing a higher video quality and/or or quality of experience (QoE) desirable for a system user 100.

[0030] For example, the techniques discussed herein can evaluate source video content information (e.g., bitrate, resolution, time complexity, or the like) and display information associated with the receiving device 102 based on a tool or No-Reference (NR) Average Opinion Index (MOS) Bitrate Prediction Module to reduce the differently required video encoding bitrate for different video content while achieving a certain desired video quality.

[0031] Figure 2 illustrates an exemplary system 200 for encoding video content for wireless transmission, arranged in accordance with at least some implementations of the present disclosure. In some examples, system 200 may be deployed as a portion of transmitter device 101. As shown in Figure 2, system 200 may include a decoder 202, an encoder 203, an encoding bitrate prediction module 204, a segment average bitrate determination module 205, an encoded source video based bitrate determination module 206, and a bitrate selection module 207. As shown, the system 200 can receive, obtain, or contain (e.g., through memory), the source video 201. Furthermore, as shown, in some examples, the system 200 may receive, obtain, or contain multiple source videos including source video 201 and source video 221 Although illustrated with two source videos 201, 221, any number of source videos can be supplied. As further discussed herein, in some examples, source video 201 and source video 221 may have been compressed with different video codecs. In this document, the source video discussion will use source video 201 for exemplary purposes; however, the techniques discussed can be used with 221 or similar source video. Source video 201 may include any suitable video content, such as those discussed herein, for transmission to receiving device 102 obtained through any suitable manner, such as downloading over the Internet, as saved in memory, through a video media device or similar. As discussed, source video 201 may be compressed video content such that source video 201 is compressed using a video codec. The video codec used to compress the source video 201 can be described as a video codec associated with the source video. In many instances, the video codec associated with the source video can be based on the H.264/MPEG-4 AVC standard, the HEVC standard, the Audio Vide Standard (AVS), the Windows Media Video codec, or any other suitable standard. . In some examples, source video 201 may be a video file or a container or the like.

[0032] As shown, decoder 202 may receive source video 201 or a portion thereof. Decoder 202 can decode source video 201 based on the video codec associated with the source video, and decoder 202 can transfer the decoded video content or a decoded portion of the video content to encoder 203. Encoder 203 can receive the decoded video content or the decoded portion of the video content. Encoder 203 may encode a segment of the decoded video content to generate encoded (ES) segment 208 (e.g., a bitstream encoded for source video segment 201). The segment of the source video 201 can be any suitable portion of the source video 201 that has any number of frames such as 1 to 100 frames, 1 to 300 frames or the like, or any time duration of the source video 201 such as 1 to 3 seconds or similar. As discussed, encoder 203 can encode the decoded video content based on a local video codec (e.g., so that transmission of the video content can be based on the local video codec between transmitting device 101 and device receiver 102). The local video codec can be determined in any suitable manner such as a negotiation between the transmitting device 101 and the receiving device 102, a predetermined codec, a standard based codec (eg WiDi and/or Miracast) or the like. For example, decoder 202 may decode source video 201 based on a first video codec (e.g., a video codec associated with source video 201), and encoder 203 may encode the decoded video content (or a segment) based on a second video codec (for example, a local video codec). In this way, the decoder 202 and encoder 203 can provide a transcoding of the source video 201 from one compression format to another compression format. Furthermore, in some examples, encoded segment 208 may also be provided as a portion of bitstream 216 (e.g., as a portion of a resulting bitstream for transmission to receiving device 102).

[0033] The encoding bitrate prediction module 204 can receive the encoded segment 208 (for example, a bitstream for an encoded segment of the source video 201), a maximum bitrate and a minimum bitrate (max, min bitrates) 209, an average opinion index (MOS) 210 and display data 211. For example, the maximum and minimum bitrates 209 may be predefined by a compression and/or transmission standard or protocol , either predefined by a system developer or heuristically determined by the system 200 or similar. The maximum and minimum bitrates 209 can be any suitable bitrate that imposes limits on quality video transmission and limits the bandwidth used for transmission. For example, the maximum bit rate can be 10 Mbps, 15 Mbps, 20 Mbps or the like, and the minimum bit rate can be 1 Mbps, 2 Mbps, 5 Mbps or the like.

[0034] Furthermore, the MOS 210 can be any suitable average opinion index and can be predefined by a compression and/or transmission standard or protocol, predefined by a system developer, heuristically determined by the system 200, or defined by a user or similar. For example, a user may select a subjective quality selection (eg high, medium, or low quality) based on a user interface presented to the user as a slider bar or the like, which can then be translated into a MOS. For example, MOS 210 can be 3.5, 4.0, 4.5 or 5.0 or similar.

[0035] Display data 211 can be any suitable display data representative of a quality and/or resolution of a display from receiving device 102. In some examples, display data 211 can be one or more display quality coefficients based on the display from the receiving device 102. For example, a request for display information may be transmitted from the transmitting device 101 to the receiving device 102 over the wireless communications channel 103. The receiving device 102 may respond over the communications channel wireless device 103 to transmitting device 101 with display information including, for example, a display resolution, model numbers, or other data associated with receiving device 102 or the like. In one embodiment, the receiving device 102 can be a WiDi sink and the display information can be communicated via a real-time streaming protocol (RTSP; e.g., a network control protocol designed to control media devices). . The system 200 may receive the display information and may determine, using a look-up table, for example, the display data 211. For example, the display data 211 may include one or more dependent display quality coefficients of receiving device. Such receiving device dependent display quality coefficients may approximate a receiving device display quality 102, for example. In some examples, system 200 may receive such device-dependent display quality coefficients directly from receiving device 102 (eg, so that a local look-up table or similar technique is not required).

[0036] The encoding bit rate prediction module 204 can, based on the encoded segment 208, the maximum and minimum bit rates 209, the MOS 210 and/or the display data 211, determine a bit rate prediction encoding bits for the encoded segment 208 or a source video segment 201 subsequent to the encoded segment 208. The generated encoding bitrate prediction may be provided to the bitrate selection module 207 as candidate bitrate (CBR) 212. In some examples, the encoding bitrate prediction module 204 of the system 200 may generate candidate bitrate 212 for a current segment of the source video 201 based on a previously encoded segment of the source video. source 201. In other examples, encoding bitrate prediction module 204 of system 200 may generate candidate bitrate 212 for a current segment of source video 201 based on a prior encoding of the current segment itself. In such examples, the current segment may be encoded (eg, encoded a second time) based on a selected encoding bitrate (eg, selected encoding bitrate 215). Such examples may provide more accurate bitrate selection at the cost of potential latency in transferring portions of the bitstream 216. In examples where the candidate bitrate 212 for a current segment of the source video 201 is based on a pre-encoded segment, improved latency can be provided at the cost of potentially less accurate bitrate selection.

[0037] In any case, the encoding bitrate prediction module 204 can determine the candidate bitrate 212 based on an analysis of encoded segment bitstream 208 that can provide segment bitstream parameters such as a 208 coded segment average bit per pixel, a 208 coded segment average quantization parameter, a 208 coded segment code frame rate, a 208 coded segment video height, or the like. Furthermore, the candidate bitrate 212 may be based on the predetermined average opinion rate (e.g., MOS 210), the predetermined maximum and minimum bitrates (e.g., maximum and minimum bitrates 209), and the ) display quality coefficient(s) associated with receiving device 102 (e.g., display data 211). For example, a time complexity can be determined based on the encoded segment 208 using any suitable technique. Temporal complexity, display data, and segment bitrate parameters can be provided to a pre-trained bitrate prediction model, which can generate a candidate bitrate 212. Details for an exemplary determination of the 212 candidate bit rate are discussed herein below in relation to Figure 3

[0038] Furthermore, as shown in Figure 2, the segment average bitrate determination module 205 can receive the encoded segment 208. The segment average bitrate determination module 205 can determine an average bitrate for the encoded segment 208 and may provide the average bitrate as the candidate bitrate (CBR) 213 to the bitrate selection module 207. In one embodiment, the candidate bitrate 213 is the number of bits in the encoded segment 208 divided by the playback time represented by the encoded segment 208. In another embodiment, the candidate bit rate 213 (e.g., the average bit rate for the encoded segment 208) is the number of bits in the encoded segment 208 divided by the number of pixels represented by the encoded segment 208. As with the encoding bitrate prediction module 204, the candidate bitrate 213 can be determined based on the encoded segment 208 for a subsequent segment of the encoding video. source 201 or to the coded segment itself 208.

[0039] As shown, the encoded source video based bitrate determination module 206 may receive source video 201 or a portion thereof. The encoded source video based bitrate determination module 206 can determine a candidate bitrate (CBR) 214 based on the received encoded source video 201. For example, the encoded source video based bitrate determination module encoded source video 206 may determine a bitrate for the encoded source video and modify the determined bitrate by a scaling factor to generate candidate bitrate 214. As discussed, the encoded source video (e.g. , the source video 201 or a portion thereof) may be encoded based on the video codec used for the video that is different from the video codec used to encode the bitstream 216 for transmission to the receiving device 102. In one example , the bitrate of the encoded source video can be determined by the system 200 using an application programming interface that can access the encoded video content to determine its bitrate. The determined bitrate can be modified by a scaling factor (for example, multiplied by a scaling factor). For example, the scaling factor can increase or decrease the determined bitrate to the determined candidate bitrate 214. The scaling factor can be any scaling factor suitable for determining the candidate bitrate 214. In some examples , the scaling factor can be in the range of 50% to 75%, 75% to 125%, 90% to 100%, 125% to 150%, or 175% to 225% or similar.

[0040] In some examples, the scaling factor may be adaptive based on the codec associated with the encoded source video (for example, the codec previously used to encode the 201 compressed source video) and the codec used to encode the stream. bits 216 (for example, the local codec used by sending device 101 and receiving device 102). In some examples, the candidate bitrate 214 may provide a minimum bitrate needed to encode the source video 201, 221 such that the local video codec produces the same or better quality than the source video 201, 221 In some examples, the scaling factor may be determined based on a difference (for example, a difference in capability) between the codec previously used to encode the source video and the codec used to encode the 216 bit stream. For example, if the source video 201 was MPEG-2 compressed at 12 Mbps, the candidate bitrate 214 may only need to be 6 Mbps if the local codec is an H.264. In such examples (eg video codec used from source video of MPEG-2 and video codec used local from H.264), the scaling factor can therefore be around 50% or 60% or similar . Such a scaling factor can be provided due to the fact that the local codec, H.264 in this example, is more efficient video codec used than MPEG-2 with the same encoding capabilities. Furthermore, if the local codec and the source video codec use the same codec, the candidate bitrate 214 may still be modified based on, for example, different resources used by the codecs. For example, video codec used may allow I-frames for archival only, I- and P-frames for real-time streaming or I-, P- and B-frames for high quality or similar. For example, an H.264 compressed source video at 6 Mbps with B-frames (eg I-, P- and B-frames) may need a bit rate of around 12 Mbps for encoding based on Used local video codec without B frames (eg with I- and P-frames or I-frames only). In such an example, the scaling factor might therefore be around 200% or similar. Other combinations may be available. Using the techniques discussed herein, a candidate bitrate for the source video 201 (e.g., candidate bitrate 214 in a first example) and a candidate bitrate for the source video 221 (e.g. candidate bitrate 214 in a second example) can therefore be different. As such, the scaling factor can be adaptive based on the video codec used to compress a source video such as 201 source video, 221 source video, or the like.

[0041] As shown in Figure 2, the bitrate selection module 207 can receive the candidate bitrates 212, 213, 214 and the bitrate selection module 207 can select the selected encoding bitrate 215 for encoding a segment (e.g., either the segment associated with encoded segment 208 or a subsequent or different segment, as discussed). For example, the bit rate selection module 207 may select a minimum bit rate from candidate bit rates 212, 213, 214 as the selected encoding bit rates 215. In one embodiment, the rate selection module bit rate 207 may select the minimum bit rate using a switch 217 as illustrated in Figure 2. For example, switch 217 may be connected based on a minimum bit rate candidate 212, 213, 214 to transmit the minimum as the selected encoding bitrate 215.

[0042] The encoder 203 can receive the selected encoding bitrate 215 and can encode decoded source video content based on the selected encoding bitrate 215 to generate the bitstream 216, which can be delivered to the device receiver 102. As discussed, receiver device 102 may receive bitstream 216 and receiver device 102 may decode bitstream 216 to generate video frames for display to a user. Encoder 203 may encode any portion of decoded source video content based on selected encoding bitrate 215. In one embodiment, encoder 203 may encode source video content associated with encoded segment 208 based on bitrate selected encoding bitrate 215. In another embodiment, the encoder 203 may encode source video content associated with another segment of the source video 201 based on the selected encoding bitrate 215. For example, the encoded segment based on the selected bitrate Selected encoding bitrate 215 may be a subsequent segment relative to encoded segment 208. In some embodiments, all or the remainder of the source video 201 may be encoded based on the selected encoding bitrate 215.

[0043] Figure 3 illustrates an exemplary system 300 for encoding video content for wireless transmission, arranged in accordance with at least some implementations of the present disclosure. In some examples, system 300 may be deployed as a portion of transmitter device 101. As shown in Figure 3, system 300 may include decoder 202, encoder 203, encoding bitrate prediction module 204, segment average bitrate determination module 205, the encoded source video based bitrate determination module 206, the bitrate selection module 207, an opinion average index module 301, a maximum and minimum bit rate 302 and a display information module 303. Furthermore, the display information module 303 may include a display parameters module 304 and a display quality coefficient look-up table (LUT) 305, the encoding bitrate prediction module may include a 306 function modeling module, a 307 bitstream analysis module, a 308 time complexity module, and a 309 bitrate prediction module, the 309 bitrate prediction module. segment averaging bitrate determination 205 may include a bitstream analysis module 310 and a segment averaging module 311, and the encoded source video based bitrate determination module 206 may include a source video bitrate module and a 313 scaling factor modification module.

[0044] As shown, decoder 202 may receive source video 201 and/or source video 221 or a portion or portions thereof, and decoder 202 may decode source video 201 based on the video codec associated with the source video and transfer the decoded video content or a decoded portion of the video content to the encoder 203. The encoder 203 can receive the decoded video content or the decoded portion of the video content and the encoder 203 can encode a segment of the decoded video content to generate encoded (ES) segment 208. Details associated with source video 201, source video 221, decoder 202, encoder 203, and encoded segment 208 have been discussed with reference to Figure 2 and will not be discussed further. repeated for the sake of brevity.

[0045] Furthermore, as shown, the average opinion rating module 301 may determine, store and/or transmit the MOS 210, which may include any appropriate information as discussed herein. For example, the average opinion index module 301 can provide functionality (e.g., through an application programming interface or the like) for a system developer and/or a user to tune the MOS 210 and/or a memory to store a current MOS. Similarly, the maximum and minimum bitrate (max, min bitrate) module 302 may determine, store and/or transmit maximum and minimum bitrates (max, min BRs) 209, which may include any suitable information as discussed in this document. For example, the maximum and minimum bitrate module may provide functionality (eg, through an application programming interface or the like) for a system developer and/or user to adjust the maximum and minimum bitrates 209 and/or a memory to store maximum and minimum bitrates (max, min BRs) 209.

[0046] The display information module can determine and/or generate display data (DD) 211 as shown. For example, display parameter module 304 may obtain parameters or display information (e.g., resolution information) from receiving device 102. In one embodiment, receiving device 102 is a WiDi sink and display parameters may be communicated from the receiving device 102 via a real-time streaming protocol (RTSP). The display parameters may be passed to Display Quality Coefficients LUT 305, which may determine receiving device dependent coefficients based on the display parameters. For example, the coefficients can indicate a quality associated with the display of (or associated with) the receiving device 102. In one embodiment, the quality coefficients include two coefficients for use by the encoding bitrate prediction module 204 for generating candidate bitrate 212, as discussed further herein. In some examples, the quality coefficients may be received directly from the receiving device 102, and in such examples, the display quality coefficients LUT 305 may not be required.

[0047] As shown, the bitstream analysis module 307 of the encoding bitrate prediction module 204 can receive the encoded segment 208 (for example, the encoded bitstream for a segment of the source video 201) . Bitstream analysis module 307 may determine segment bitstream parameters associated with encoded segment 208. For example, segment bitstream parameters may include average bits per pixel, average quantization parameter, frame rate encoding or encoding video height. In some examples, segment bitstream parameters may be frame size data, frame type data, frame resolution data, or bit rate data. The bitstream analysis module 307 may transfer the segment bitstream parameters to the function modeling module 306 and to the time complexity module 308.

[0048] Time complexity module 308 may determine a time complexity associated with coded segment 208 based at least in part on received segment bitstream parameters. Time complexity module 308 can determine time complexity using any suitable technique or techniques. For example, time complexity can be based on Equation (1) as follows: where TC can be the time complexity, fTC can be a function to determine TC, f_parameters can be the segment bitstream parameters, mean(BitsP) can be the average bits per pixel, SF can be a scaling factor of about 40, c may be a constant of about 0.87, mean(QPP) may be the average quantization parameter, fps may be the encoding frame rate, and f_h may be the encoding video height. While described in relation to video height, f_h, other information or data associated with video or frame size may be used. In various examples, video height, video width, video aspect ratio, or combination thereof can be used.

[0049] As shown, the temporal complexity can be transferred to the function modeling module 306 and to the bit rate prediction module 309. The function modeling module 306 can provide content (for example, the video of source via segment bitrate and time complexity parameters) and device (e.g. receiver device 102 via display data 211) model-based to predict a video bit rate. For example, the model can be a pre-trained linear and/or non-linear model. For example, a training model can be provided as a non-linear fit of parameters based on a training set of video clips as shown in Equation (2) and/or as a linear fit as shown in Equation (3) and based on a test as shown in Equation (4): where v can be function modeling parameters or coefficients to predict the encoding bitrate, bitrate can be the bitrate of a training video clip, and MOS can be the average opinion index of the training video clip. training. where a and b can be the slope and y-intercept that correspond to vi respectively and TCtraining can be the time complexity of the training set. where vi_test can be a predicted vi for input test video.

[0050] In some examples, the training of the function modeling module 306 can be performed offline (for example, before a runtime with respect to the source video 201) and the function modeling module 306 can be saved via of memory for deployment. As shown, the bit rate prediction module 306 can receive parameters from the function shaping module 306 and the time complexity from the time complexity module 308. The bit rate prediction module 306 can determine the candidate bit rate 212 based on an encoding bitrate prediction using any suitable technique or techniques. In one example, the bitrate prediction module 306 can determine the candidate bitrate 212 based on an encoding bitrate prediction determined by Equation (5) as follows: where e_bitrate can be the predicted encoding bitrate, desired_MOS can be MOS 210, b_max and b_min can be the maximum and minimum bitrates respectively of maximum and minimum bitrates 209, and b can be a constant of about of 3.7.

[0051] As shown in Figure 3 and as discussed herein, the encoding bitrate prediction as described may be provided to the bitrate selection module 207 as the candidate bitrate 212.

[0052] Furthermore, the bitstream analysis module 310 of the segment average bitrate determination module 205 can receive the coded segment 208 as shown. The bitstream analysis module 310 can determine an average bit rate for the encoded segment 208 and/or an average bit per pixel for the encoded segment 208. Furthermore, the segment averaging module 311 can determine a rate average bit rate for encoded segment 208. In some examples, the bitstream analysis modules 307, 310 may be deployed separately (as shown), and in other examples they may be deployed together. Furthermore, in some examples, the segment averaging module 311 may be eliminated and the discussed averaging may be provided by the bitstream analysis module 310.

[0053] As discussed, in some examples, the candidate bitrate 213 may be provided as an average bitrate for the encoded segment 208. In such examples, the bitstream analysis module 310 or the calculation module segment average module 311 can provide the average bit rate (and the other module can be dropped if desired). In other examples, one of the candidate bitrate 212 or the candidate bitrate 213 may be dropped (before reaching the bitrate selection module 207) based on a throttling performed by the flow analysis module. bitrate 307 and/or by bitstream analysis module 310. For example, an average bit per pixel can be determined for the encoded segment 208. The average bits per pixel can be compared to a threshold to determine whether the bit rate candidate bits 212 or candidate bitrate 213 can be provided to bitrate selection module 207. For example, if the average bits per pixel is greater than (or equal to) the threshold, the bitrate candidate bitrate 212 may be given (and candidate bitrate 213 may be dropped), and if the average bits per pixel is less than (or equal to) the threshold, candidate bitrate 212 may be given (and candidate bitrate 213 may be dropped). In such examples, bitrate selection module 207 may, for a particular segment, select between two candidate bitrates (e.g., candidate bitrate 214 and one of candidate bitrate 212 or the candidate bitrate 213) and not three, as illustrated in Figure 3. Such techniques are discussed further herein in relation to Figure 4.

[0054] As shown in Figure 3, the source video bitrate module 312 of the encoded source video bitrate determining module 206 can receive the source video 201 or the portion thereof. For example, the encoded source video bitrate determination module 206 may receive a compressed (e.g. encoded) source video such that the source video is compressed based on the video codec used of the associated video. source video 201 (e.g., before downloading, at the time of storage in memory, at the time of capture, or the like; and different from the video codec used by the encoder 203 or the same as the video codec used by the encoder 203, but with different resources deployed). The source video bitrate module 312 may determine a compressed source video bitrate based on an average bitrate or the like. The source video bitrate module 312 can transfer the determined bitrate of the compressed source video to the scaling factor modification module 313. The scaling factor modification module 313 can modify the determined bitrate by a scaling factor as discussed in this document. For example, the scaling factor can be based on a difference between the codec used to compress the compressed source video and the local codec used to encode the 216 bit stream. As discussed, the scaling factor can therefore be adaptive based on the quality of the codec used to compress the compressed source video and/or the quality of the local codec used to encode the 216 bitstream. For example, two source videos compressed using different codecs may have different compression factors. scaling as determined by scaling factor modification module 313. The determined bit rate may be modified by the scaling factor in any suitable manner. In one embodiment, the scaling factor (positive or negative in this example) is added to the determined bit rate. In another embodiment, the scaling factor is multiplied by the determined bitrate (for example, the determined bitrate is modified by x%, where x is the scaling factor).

[0055] Bitrate selection module 207 may receive candidate bitrates 212, 213, 214 or candidate bitrate 214 and one of candidate bitrates 212, 213 (as discussed) and the bitrate selection module 207 can determine the selected encoding bitrate 215 for encoding a segment of the source video 201 (e.g., for encoding a decoded segment of video content so that the segment is equal to the segment represented by coded segment 208 or different from the segment represented by coded segment 208). For example, the bitrate selection module 207 can select a minimum bitrate from the received candidate bitrates as the selected encoding bitrate 215. In one embodiment, the bitrate selection module 207 can select a minimum bit rate based on switch 215 as discussed herein.

[0056] The encoder 203 can receive the selected encoding bitrate 215 and can encode the source video 201 (for example, the decoded video content based on the selected encoding bitrate 215) to generate the bitstream 216, which may be provided to receiving device 102. As discussed, bitstream 216 may be encoded using the video codec used from local video. The local video codec may be determined based on a standard, a negotiation between transmitter device 101 and receiver device 102, or the like. Receiving device 102 may receive bitstream 216 and decode bitstream 216 to generate video frames for display to a user. Encoder 203 may encode any portion of the decoded video content based on the selected encoding bitrate 215. In one embodiment, encoder 203 may encode video content associated with the encoded segment 208 based on the selected encoding bitrate 215 In another embodiment, the encoder 203 may encode video content associated with another segment of the source video 201 based on the selected encoding bitrate 215. For example, the encoded segment based on the selected encoding bitrate 215 may be a subsequent segment relative to the encoded segment 208. In some embodiments, all or the remainder of the source video 201 may be encoded based on the selected encoding bitrate 215.

[0057] Figure 4 is a flow chart illustrating an exemplary process 400 for encoding video content for wireless transmission, arranged in accordance with at least some implementations of the present disclosure. Process 400 can include one or more operations 401 to 415 as illustrated in Figure 4. Process 400 can form at least part of a video encoding process. By way of non-limiting example, process 400 may form at least part of a video content video encoding process as performed by devices 101 or 800 or systems 200, 300, 600, or 700 as discussed herein.

[0058] In some examples, process 400 may be deployed even when a wireless channel capacity is not a bottleneck or concern. Furthermore, process 400 may be based on unreferenced (NR) bitrate predictor (e.g., coding bitrate predictor module 204). In some examples, the encoding bitrate prediction may be skipped or ignored when the segment average bit per pixel is below a specific threshold (for example, as discussed in connection with decision operation 409). In other examples, the predicted encoding bitrate and average segment bitrate may be provided for selection as discussed in relation to candidate bitrates 212 and 213. In such examples, when the hop has occurred (from so that only the candidate bitrate 213 is given), the candidate bitrate 213 would likely (or necessarily) be less than the candidate 212 so that a jump or determination would give the same result. Such hopping and/or determination of a segment average bitrate can provide improved bitrate predictions in cases where encoding bitrate prediction may have limitations, for example, in evaluating segments consisting of frames. static with an extremely small number of bits (for example, black and white frames).

[0059] Furthermore, as discussed, a bitrate determination based on encoded source video can be performed based on a compressed source video bitrate modified by a scaling factor. Such techniques may be advantageous when the source video 201 is Internet video content that has relatively low video quality or local video content that has relatively high video quality (e.g., low or high quality compared to high quality). of H.264 AVC or HEVC). For both cases, the achievable video quality bitstream 216 (e.g., broadcast encoded video) is determined largely by the bitrate and resolution of the source video 201. If the source video 201 has a high bitrate, bits and MOS greater than the desired MOS (for example, MOS 210), the encoding MOS bitrate prediction discussed can be used to reduce the encoding bitrate significantly. However, if the source video 201 has a low or very low bitrate, then using a high encoder bitrate (e.g., the selected encoding bitrate 215) might be wasteful and would not improve the MOS of the video presentation on the receiving device 102. In such cases, as discussed, a scaling factor (e.g., modifying the source video bit rate by a scaling factor) can be used to determine the bit rate to encoding (for example, the selected encoding bitrate 215). For example, the scaling factor (eg x) can be adaptively adjusted based on the difference between local and source codec performance as discussed.

[0060] Again with reference to Figure 4, process 400 can start at operation 401, "Set Min and Max Bit Rates for Local Encoding", in which a minimum bit rate and a maximum bit rate can be set or determined as discussed in this document. For example, the maximum and minimum bitrates 209 can be set or determined through the maximum and minimum bitrate module 302 of the system 300.

[0061] Process 400 may continue to operation 402, “Set Desired MOS for Local Coding”, in which a desired mean opinion index (MOS) may be defined or determined as discussed herein. For example, the average opinion rating 210 can be defined or determined using the average opinion rating module 301.

[0062] Process 400 may continue to operation 403, "Get Receiver Display Information", in which display information for a receiver (eg, receiver device 102) may be obtained or received as discussed herein. For example, display parameter module 304 from display information module 303 may obtain or receive display information (e.g., display resolution information) for receiving device 102.

[0063] Process 400 may continue to operation 404, "Determine Device Dependent Coefficients", wherein device dependent coefficients such as display quality coefficients may be determined as discussed herein. For example, the display data 211 including display quality coefficients can be determined through the display quality coefficient lookup table 305 of the display information module 303.

[0064] Process 400 may continue at operation 405, "Get Bitstream of Locally Encoded Video Segment", in which a bitstream of a locally encoded video segment can be obtained and/or determined as discussed herein . For example, decoder 202 can decode a segment of source video 201 (based on video codec used from video associated with compressed source video) and encoder 203 can encode segment based on video codec used from local video as discussed.

[0065] Process 400 may continue at operation 406, "Perform Bitstream Analysis", in which a bitstream analysis may be performed based on the bitstream associated with the video segment as discussed herein. For example, the bitstream analysis module 307 of the encoding bitrate prediction module 204 can perform a bitstream analysis based on the encoded segment 208 to generate segment bitstream parameters including one bit per segment average pixel, a segment average quantization parameter, a segment encoding frame rate, or a segment encoding video height.

[0066] Process 400 may continue to operation 407, "Collect Source Video Content Bitrate", wherein a source video content bitrate may be collected or determined as discussed herein. For example, source video bitrate module 312 of encoded source video based bitrate determination module 206 may receive source video 201 (e.g., compressed source video) or a portion of same, and source video bitrate module 312 may determine a bitrate for source video encoded using the video codec associated with the source video's compression.

[0067] Process 400 may continue at operation 408, “Adjust by Scaling Factor to Determine CBR”, in which the bit rate for the compressed source video may be adjusted by a scaling factor as discussed in this document . For example, the scaling factor modification module 313 of the encoded source video based bitrate determination module 206 can modify the bitrate by a scaling factor to generate candidate bitrate 214. As discussed, the scaling factor can be adaptively based on the video codec associated with the source video compression.

[0068] Process 400 may continue from operation 406 as discussed in decision operation 409, "Segment Average Bits Per Pixel < Threshold?", in which a segment average bit per pixel may be compared to a threshold. As shown, if the average bits per pixel for the segment is less than a threshold (or less than or equal in some deployments), process 400 may continue at operation 410, and if the average bits per pixel for the segment is greater than or equal to the limit (or greater in some deployments), process 400 can continue at operation 413.

[0069] Process 400 may thus continue at operation 410, "Determine Temporal Complexity", in which a temporal complexity for the segment may be determined as discussed herein. For example, the time complexity module 308 of the encoding bitrate prediction module 204 can determine the time complexity based on Equation (1) or the like.

[0070] Process 400 may continue at operation 411, "Determine Function Shaping Coefficients", in which the function modeling coefficients may be determined based on the device-dependent coefficients determined through operation 404 and the time complexity determined through of operation 410. For example, the function modeling coefficients can provide coefficients for a pre-trained bitrate prediction model, which can generate a bitrate prediction dependent on the segment content (for example, the temporal complexity ) and a quality of the receiver display (for example, the quality device-dependent coefficients).

[0071] Process 400 may continue to operation 412, "Determine Encoding Bitrate Prediction as CBR", in which an encoding bitrate prediction may be determined based on the function shaping coefficients determined through operation 411, at the minimum and maximum bit rates determined through operation 401, and at the desired MOS determined through operation 402. For example, the bitrate prediction module 309 of the encoding bitrate prediction module 204 can determine the candidate bit rate 212 based on Equation (5) or the like.

[0072] As discussed, in examples where the segment average bits per pixel are less than a threshold (or less than or equal to the threshold), process 400 may continue from decision operation 409 to operation 413, “Use Average Bits as CBR”, where the average bits of the segment (or an average bitrate for the segment) can be used as the candidate bitrate. As discussed, in some examples, decision operation 409 and operation 413 can provide a jump or branch from operations 410 to 412. For example, such a jump can occur when the segment average bits per pixel is less than a threshold ( or less than or equal to the limit). In such examples, the discussed encoding bitrate prediction model may not provide useful results as in low or very low bitrate scenarios (eg, static black and white frame segments or the like). For example, the segment averaging module 311 or the bitstream analysis module 310 may provide a candidate bitrate 213 as the average bits of the segment.

[0073] Process 400 may continue at operation 414, "Determine Minimum Candidate Bitrates", wherein a minimum of candidate bitrates may be determined. For example, bitrate selection module 207 may determine a minimum of candidate bitrates. As discussed, in process example 400, operation 414 can be used to select the minimum of a candidate bit rate provided by operation 408 and a candidate bit rate provided by operation 412 or a candidate bit rate provided by by the 413 operation (depending on the decision in the 409 decision operation). Such a leap deployment might provide fewer computations and shorter processing times, for example.

[0074] In other embodiments, as discussed herein, the decision operation 409 may be skipped and a candidate bitrate provided by operation 412 and a candidate bitrate provided by operation 413 (along with a bitrate provided by operation 408) may be provided for determining a minimum of the candidate bitrates in operation 414.

[0075] Process 400 may continue to operation 415, "Set Encoding Bitrate and Encode Segment", in which an encoding bitrate can be set and a segment can be encoded. For example, bitrate selection module 207 may set the selected encoding bitrate 215 to encoder 203 for encoding a segment of source (decoded) video 201. As discussed, in some examples, the bitrate selected bitrate can be used to encode a segment subsequent to the segment currently being evaluated, and in other examples the selected bit rate can be used to encode the current segment itself at the present time.

[0076] The operations of process 400 may be repeated any number of times serially or in parallel for any number of segments of a source video and/or for any number of source videos. As discussed, multiple source videos may have been compressed using different video codecs, which may influence the scaling factor implemented via the 408 operation.

[0077] Figure 5 is a flowchart illustrating an exemplary process 500 for encoding video content for wireless transmission, arranged in accordance with at least some implementations of the present disclosure. Process 500 can include one or more operations 501 to 505 as illustrated in Figure 5. Process 500 can form at least part of a video encoding process. By way of non-limiting example, process 500 may form at least part of a video encoding process as performed by devices 101 or 800 or by systems 200, 300, 600 or 700 as discussed herein. Furthermore, process 500 will be described herein with reference to system 600 of Figure 6.

[0078] Figure 6 is an illustrative diagram of an exemplary system 600, arranged in accordance with at least some implementations of the present disclosure. For example, system 600 may be a video encryption device 101 system or the like. As shown in Figure 6, system 600 may include one or more imaging devices 602, an antenna 602, one or more processing units 620 including logic circuitry 630, one or more processors 603, one or more memory stores 604 and a display device 605. Furthermore, the logic circuitry 630 may include the decoder 202, the decoder 202, the encoding bitstream prediction module 205, the segment average bitrate determination module 205, the encoded source video-based bitrate determination module 206, and the bitrate selection module 207. As illustrated, the imaging device(s) 601, the antenna 602, the ) processing unit(s) 620, logic circuitry 630, decoder 202, decoder 202, processor(s) 603, memory store(s) 604, and/or display device 605 can have the ability to communicate with each other.

[0079] As shown, in some examples, system 600 may include antenna 602. Antenna 602 may be configured to transmit or receive an encoded bitstream of video data, for example. Additionally, in some examples, system 600 may include display device 605. Display device 605 may be configured to display video data as decoded source video 201. As shown, in some examples, the display circuitry Logic 630 may be implemented via processing unit(s) 620. Processing unit(s) 620 may include application-specific integrated circuit (ASIC) logic, graphics processor(s) , general purpose processor(s) or similar. System 600 may also include optional (optional) processor(s) 603, which may similarly include application-specific integrated circuit (ASIC) logic, graphics processor(s), purpose-built processor(s). general or similar. In some examples, logic circuitry 630 may be implemented via hardware, dedicated video encoding hardware, or the like, and processor(s) 603 may deploy general purpose software, operating systems, or the like, via , for example, a multi-core central processing unit (CPU). Furthermore, the memory store(s) 604 can be any type of memory such as volatile memory (e.g., Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), etc.) or memory non-volatile (e.g. flash memory, etc.), and so on. In a non-limiting example, the memory store(s) 604 may be implemented by caching memory. In some examples, logic circuitry 630 may access memory store(s) 604 (for implementing a video frame buffer, for example). In other examples, logic circuitry 630 and/or processing unit(s) 620 may include memory stores (e.g., cache or the like) for implementing a video frame buffer or similar. For example, the memory store(s) 604 can store any video data such as the source video 201 (e.g., the compressed source video), the decoded source video, the encoded segment 208, the stream bitrate 216, candidate bitrates 212, 213, 214, maximum and minimum bitrates 209, MOS 210, display data 211, selected encoding bitrate 215, or any other data used or generated as discussed in this document.

[0080] In some examples, encoder 100 deployed via logic circuitry 630 may include frame buffering (e.g., via processing unit(s) 620 or frame storage(s) ) of memory 604) and a graphics processing unit (e.g., via processing unit(s) 620). The graphics processing unit may be communicatively coupled to the frame buffer, for example. The graphics processing unit may include encoder 100 as implemented through logic circuitry 630 and/or the various modules as discussed herein. For example, the graphics processing unit may include the decoder 202, the decoder 202, the encoding bitstream prediction module 205, the segment average bitrate determination module 205, the bits based on encoded source video 206 and the bitrate selection module 207, as shown. The illustrated modules can be deployed to perform any of the operations as discussed in this document.

[0081] In some examples, antenna 602 of system 2000 may be configured to transmit an encoded bitstream of video data as bitstream 216. As discussed, the encoded bitstream may include encoded video data with the Use local used video codec like H.264 AVC codec or HEVC codec or similar.

[0082] Again with reference to the discussion of Figure 5, process 500 may begin at operation 501, “Determine a First Candidate Bitrate for Encoding a Segment of a Source Video, Using a First Video codec, as a Bitrate for Source Video Encoded Using a Second Video Codec Modified by a Scaling Factor”, wherein a first candidate bitrate for encoding a segment of a source video, with using a first video codec, may be determined such that the first candidate bitrate is a bitrate for source video encoded using a second video codec modified by a scaling factor. For example, encoded source video-based bitrate determination module 206 as deployed through logic circuitry 630 may receive a compressed source video or a portion thereof such that compression is performed using of a codec associated with a compression of the source video (e.g., the second video codec) and the encoded source video-based bitrate determination module 206 can determine the bitrate for the compressed source video and modify it by a scaling factor as discussed in this document to generate the first candidate bitrate. The first bitrate can be determined for encoding the segment using a local video codec (for example, the first video codec). For example, the scaling factor can be based on a video codec quality associated with the source video compression so that for a greater quality difference between video codecs, a larger scaling factor can be used.

[0083] For example, a candidate bitrate may be determined for encoding, using the first video codec, a second segment of a second source video such that the candidate bitrate comprises a rate of bits for the second source video encoded using a third video codec modified by a second scaling factor. In one embodiment, if the second video codec and the third video codec are different, the determined scaling factors are also different. For example, when a first quality difference between the first video codec and the second video codec is greater than a second quality difference between the first video codec and the third video codec, the scaling factor for the encoded segment using the second video codec is greater than the scaling factor for the segment encoded using the third video codec.

[0084] Processing may continue at operation 502, “Determine a Second Candidate Bitrate to Encode the Source Video Segment, Using the First Video Codec, as an Average Bitrate for the Segment or a Segment Source Video Preview Encoded Using First Video codec", wherein a second candidate bitrate for encoding the source video segment using the first video codec may be determined such that the second candidate bitrate is an average bitrate for at least one of the source video segment encoded using the first video codec or a previous source video segment encoded using the first video codec . In one embodiment, the pre-segment is used and the pre-segment is immediately preceding the segment in the source video. For example, segment averaging bitrate determination module 205 as deployed via logic circuitry 630 may receive a segment encoded using a local codec (e.g., the first video codec) and the module Segment average bitrate determination device 205 as implemented through logic circuitry 630 may determine an average bitrate based on the received encoded segment as the second candidate bitrate.

[0085] Processing may continue at operation 503, “Determine a Third Candidate Bitrate to Encode the Source Video Segment, Using the First Video Codec, as a Prediction of Encoding Bitrate for the Segment or for Previous Segment Encoded Using First Video codec”, wherein the third candidate bitrate for encoding the source video segment using first video codec may be determined such that the third candidate bitrate is an encoding bitrate prediction for at least one of the segment encoded using the first video codec or the previous segment encoded using the first video codec. For example, the encoding bitrate prediction module 204 as deployed via logic circuitry 630 may receive a segment encoded using a local codec (e.g., the first video codec) and the encoding module encoding bitrate prediction 204 as implemented through logic circuitry 630 may determine a bitrate prediction based on the encoded segment and/or other data to determine the third candidate bitrate as the prediction of encoding bitrate. For example, the encoding bitrate prediction may be based at least in part on one of a predetermined average opinion rating, a predetermined maximum bitrate, a predetermined minimum bitrate, or a display quality coefficient associated with a wireless transmission receiving device as discussed herein.

[0086] In some examples, determining the encoding bitrate prediction may include analyzing a bitstream of the segment encoded using the first video codec or the previous segment encoded using the first video codec to determine segment bitstream parameters, to determine a temporal complexity based on the segment bitstream parameters, and to generate a bitrate prediction based on temporal complexity and a predefined bitrate prediction model -trained. In one embodiment, the segment bitstream parameters include at least one of a segment average bit per pixel, a segment average quantization parameter, a segment encoding frame rate, or a segment encoding video height. . In some examples, the bitrate prediction is additionally based on a predetermined average opinion index, a predetermined maximum bitrate, a predetermined minimum bitrate, and a display quality coefficient associated with a device receiving the wireless transmission. as discussed in this document. For example, the display quality coefficient associated with the receiving device can be determined using a look-up table based on resolution information received from the receiving device.

[0087] Processing may continue at operation 504, “Select an Encoding Bitrate for the Segment as a Minimum of the First, Second, and Third Candidate Bitrate,” where an encoding bitrate for the source video segment can be selected as a minimum of the first, second and third candidate bitrates. For example, the bitrate selection module 207 as deployed through logic circuitry 630 can receive the first, second, and third candidate bitrates and select a minimum of them as an encoding bitrate. selected. As discussed, in some examples, the bitrate selection module 207 as deployed through logic circuitry 630 can receive three candidate bitrates. In other examples, the second or third candidate bitrate may be skipped and the bitrate selection module 207 as implemented through logic circuitry 630 may select a minimum of the first candidate bitrate and the second or third candidate bitrate to provide the selected encoding bitrate.

[0088] Processing can continue at operation 505, “Encode, Using the First Video Codec, the Segment Based on the Selected Encoding Bit Rate”, in which the source video segment can be encoded using the first video codec and based on selected encoding bitrate. For example, decoder 202 as implemented through logic circuitry 630 can encode a segment of a source video based on the selected encoding bitrate.

[0089] Furthermore, the bitstream of the encoded segment can be provided to a receiving device, which can decode the bitstream and present a video to a user. For example, decoder 202 as implemented through logic circuitry 630 can deliver the encoded bitstream (e.g., encoded based on the selected encoding bitrate) to antenna 602 for wireless transmission to a device. receiver.

[0090] The operations of process 500 may be repeated any number of times serially or in parallel for any number of segments of a source video and/or for any number of source videos.

[0091] Various components of the systems described in this document may be implemented in software, firmware and/or hardware and/or any combination thereof. For example, various components of devices 101 or 800 or systems 200, 300, 600 or 700 may be provided, at least in part, by hardware of a computational System on a Chip (SoC) as might be found in a computational system such as , for example, a smart phone. Those skilled in the art will recognize that systems described herein may include additional components that are not described in the corresponding Figures. For example, the systems discussed herein may include additional components such as bitstream multiplexers or demultiplexers modules and the like that have not been described in the interest of clarity.

[0092] While deployment of the exemplary processes discussed herein may include performing all of the operations shown in the illustrated order, the present disclosure is not limited to that aspect, and in various examples, deployment of the exemplary processes herein may include only a subset of the operations shown, operations performed in a different order than illustrated, or additional operations.

[0093] Furthermore, any one or more of the operations discussed herein may be performed in response to instructions provided by one or more computer program products. Such program products may include signal-carrying media that provide instructions that, when executed by, for example, a processor, can provide the functionality described herein. Computer program products may be provided in any form on one or more machine-readable media. Thus, for example, a processor including one or more graphics processing unit(s) or processor core(s) can perform one or more of the blocks of the exemplary processes herein in response to program code and/or instructions or set of instructions conveyed to the processor by one or more machine-readable media. In general, a machine-readable medium can carry software in the form of program code and/or instructions or instruction sets that can cause any of the devices and/or systems described herein to implant at least portions of the devices 101 or 800 or Systems 200, 300, 600 or 700, or any other module or component as discussed herein.

[0094] As used in any deployment described in this document, the term "module" refers to any combination of software logic, firmware logic, hardware logic, and/or circuitry configured to provide the functionality described in this document . The software may be incorporated as a software package, code and/or set of instructions or instructions, and "hardware", as used in any deployment described herein, may include, for example, solely or in any combination, a set of hardwired circuitry, programmable circuitry, state machine circuitry, fixed-function circuitry, execution unit circuitry, and/or firmware that stores instructions executed by the programmable circuitry. Modules can, collectively or individually, be realized as circuitry that forms part of a larger system, for example, an integrated circuit (IC), system on chip (SoC), and so on.

[0095] Figure 7 is an illustrative diagram of an exemplary system 700, arranged in accordance with at least some implementations of the present disclosure. In many deployments, System 700 can be a media system, although System 700 is not limited to that context. For example, the 700 system can be incorporated into a personal computer (PC), laptop computer, ultralaptop computer, tablet computer, touch element, portable computer, handheld computer, palmtop computer, assistant personal digital (PDA), mobile phone, combination cell phone/PDA, television, smart device (e.g. smart phone, smart tablet computer or smart television), mobile internet device (MID), messaging device, data communication device, cameras (for example, point-and-shoot cameras, close-up cameras, digital single-lens reflex (DSLR) cameras), and so on.

[0096] In various deployments, system 700 includes a platform 702 coupled to a display 720. Platform 702 may receive content from a content device such as content services device(s) 730 or distribution device(s) 740 content sources or other similar content sources. A navigation controller 750 that includes one or more navigation features can be used to interact with, for example, the platform 702 and/or the display 720. Each of these components is described in more detail below.

[0097] In various deployments, the platform 702 may include any combination of a chip set 705, a processor 710, a memory 712, an antenna 713, a storage 714, a graphics subsystem 715, applications 716 and/or a radio 718. Chipset 705 can provide intercommunication between processor 710, memory 712, storage 714, graphics subsystems 715, applications 716, and/or radio 718. storage (not shown) capable of providing intercom with the 714 storage.

[0098] The 710 processor can be deployed as a processor of a Complex Instruction Set Computer (CISC) or a Reduced Instruction Set Computer (RISC), processors with an x86 compatible instruction set, multiple cores, or any other microprocessor or central processing unit (CPU). In various deployments, the 710 processor can be dual-core processor(s), dual-core mobile processor(s), and so on.

[0099] Memory 712 may be deployed as a volatile memory device such as, without limitation, Random Access Memory (RAM), Dynamic Random Access Memory (DRAM), or Static RAM (SRAM).

[00100] Storage 714 may be deployed as a non-volatile storage device such as, without limitation, a magnetic disk drive, optical disk drive, a tape drive, an internal storage device, a fixed storage device, a flash memory, a battery-backed SDRAM (synchronized DRAM), and/or a network access storage device. In many deployments, 714 storage can include technology to increase storage performance and enhance protection for valuable digital media when multiple hard drives are included, for example.

[00101] The graphics subsystem 715 can perform image processing as still image or video for the display. Graphics subsystem 715 can be a graphics processing unit (GPU) or a visual processing unit (VPU), for example. An analog or digital interface may be used to communicatively couple graphics subsystem 715 and display 720. For example, the interface can be any High Durability Multimedia Interface, DisplayPort, Wireless HDMI and/or Wireless HD compatible techniques. Graphics subsystem 715 may be integrated with processor 710 or chipset 705. In some deployments, graphics subsystem 715 may be a standalone card communicatively coupled to chipset 705.

[00102] The graphics and/or video processing techniques described in this document can be deployed on various hardware architectures. For example, graphics and/or video functionality can be built into a chip set. Alternatively, a discrete graphics and/or video processor can be used. As yet another implementation, graphics and or video functions may be provided by a general purpose processor that includes a multi-core processor. In additional embodiments, the functions may be implemented in an electronics consumer device.

[00103] The 718 radio may include one or more radios capable of transmitting and receiving signals using various appropriate wireless communication techniques. Such techniques may involve communications over one or more wireless networks. Examples of wireless networks include (but are not limited to) wireless local area networks (WLANs), wireless personal area networks (WPANs), wireless metropolitan area networks (WMANs), cellular networks, and satellite networks. When communicating over such networks, the 718 radio may operate in accordance with one or more applicable standards in any version.

[00104] In various deployments, the display 720 may include any type of television monitor or display. Display 720 may include, for example, a computer display screen, a touch screen display, a video monitor, a television-like device, and/or a television. Display 720 can be digital and/or analog. In many deployments, the 720 display can be a holographic display. Furthermore, the display 720 can be a transparent surface that can receive a visual projection. Such projections can transmit various forms of information, images and/or objects. For example, such projections could be a visual overlay for a Mobile Augmented Reality (MAR) application. Under the control of one or more software applications 716, platform 702 may display user interface 722 on display 720.

[00105] In various deployments, the content services device(s) 730 may be hosted by any national, international and/or independent service and thus be accessible to the platform 702 via the Internet, for example. The content services device(s) 730 may be coupled to the platform 702 and/or the display 720. The platform 702 and/or the content services device(s) 730 may be coupled to the network 760 to communicate (e.g., send and/or receive) media information to and from network 760. Content delivery device(s) 740 may also be coupled to platform 702 and/or display 720 .

[00106] In various deployments, the content services device(s) 730 may include a cable television box, personal computer, network, telephone, Internet-enabled devices, or appliances capable of distributing digital information and/or or content and any other similar device capable of communicating content unidirectionally or bidirectionally between content providers and platform 702 and/or display 720 over network 760 or directly. It can be seen that content can be communicated unidirectionally and/or bidirectionally and from any of the components in system 700 and a content provider over network 760. Examples of content can include any media information, including, for example, video, music, medical and gaming information, and so on.

[00107] The content services device(s) 730 can receive content such as cable TV programming that includes media information, digital information, and/or other content. Examples of content providers could include any cable or satellite television or radio or Internet content providers. The examples provided are not intended to limit deployments in accordance with the present disclosure in any way.

[00108] In various deployments, the platform 702 may receive control signals from the navigation controller 750 that has one or more navigation capabilities. The navigation features of controller 750 can be used to interact with user interface 722, for example. In embodiments, the navigation controller 750 can be a pointing device which can be a computer hardware component (specifically, a human interface device) that allows a user to input spatial (e.g., continuous and multidimensional) data into a computer. . Many systems such as graphical user interfaces (GUI) and televisions and monitors allow the user to control and provide data to the computer or television using physical gestures.

[00109] Movements of navigation features of the 750 controller can be replicated on a display (for example, display 720) by movements of a pointer, cursor, focusing rings or other visual indicators displayed on the display. For example, under the control of software applications 716, navigation features located in navigation controller 750 can be mapped to virtual navigation features displayed on user interface 722, for example. In embodiments, controller 750 may not be a separate component, but may be integrated with platform 702 and/or display 720. The present disclosure, however, is not limited to the elements or context presented or described herein.

[00110] In various deployments, triggers (not shown) may include technology to enable users to instantly turn the 702 platform on and off such as a television at the touch of a button upon startup, when enabled, for example. Program logic may allow the platform 702 to stream content to media adapters or other content serving device(s) 730 or content delivery device(s) 740 even when the platform is "powered off". In addition, chipset 705 may include hardware and/or software support for 5.1 surround sound audio and/or high definition 7.1 surround sound audio, for example. Triggers can include a graphics trigger for integrated graphics platforms. In embodiments, the graphics driver may comprise a Component Peripheral Interconnect (PCI) Express graphics card.

[00111] In various deployments, any one or more of the components shown in the 700 system can be integrated. For example, platform 702 and content serving device(s) 730 may be integrated, or platform 702 and content delivery device(s) 740 may be integrated, or platform 702 , the content services device(s) 730 and the content delivery device(s) 740 may be integrated, for example. In various embodiments, platform 702 and display 720 can be an integrated unit. Display 720 and content serving device(s) 730 may be integrated, or display 720 and content delivery device(s) 740 may be integrated, for example. These examples are not intended to limit the present disclosure.

[00112] In various embodiments, the 700 system can be deployed as a wireless system, a wired system, or a combination of both. When deployed as a wireless system, system 700 may include components and interfaces appropriate for communicating over a shared wireless medium, such as one or more antennas, transmitters, receivers, transceivers, amplifiers, filters, control logic, and so on. . An example of a wireless shared medium might include portions of a wireless spectrum, such as the RF spectrum and so on. When deployed as a wired system, system 700 can include components and interfaces adapted for communicating over wired communications media, such as input/output (I/O) adapters, physical connectors for connecting the I/O adapter to a wired wired communications port, a network interface card (NIC), disk controller, video controller, audio controller, and the like. Examples of wired communications media may include a wire, cable, metal fillet, printed circuit board (PCB), backplane, switching fabric, semiconductor material, twisted pair wire, coaxial cable, fiber optics, and so on. .

[00113] The platform 702 can establish one or more physical or logical channels to communicate information. Information may include media information and control information. Media information can refer to any data representing content intended for a user. Examples of content may include, for example, data from a voice conversation, video conference, streaming video, electronic mail (“email”) message, voicemail message, alphanumeric symbols, graphics, image, video, text and so on. Data from a voice conversation can be, for example, speech information, silence periods, background noise, comfort noise, tones, and so on. Control information can refer to any data representing commands, instructions, or control words intended for an automated system. For example, information control can be used to route media information through a system or instruct a node to process media information in a predetermined manner. The modalities, however, are not limited to the elements or context shown or described in Figure 7.

[00114] As described above, the 700 system can be molded into various physical styles or form factors. Figure 8 illustrates deployments of a small form factor device 800 into which system 800 can be molded. In embodiments, for example, device 800 can be deployed as a mobile computing device that has wireless capabilities. A mobile computing device can refer to any device that has a processing system and an energy source or supply, such as one or more batteries, for example.

[00115] As described above, examples of a mobile computing device may include a personal computer (PC), laptop computer, ultralaptop computer, tablet computer, touch element, portable computer, handheld computer, palmtop computer, personal digital assistant (PDA), cell phone, combination cell phone/PDA, television, smart device (e.g., smart phone, smart tablet computer, or smart television), mobile internet device (MID), messaging device, data communication device, cameras (for example, point-and-shoot cameras, close-up cameras, digital single-lens reflex (DSLR) cameras), and so on.

[00116] Examples of a mobile computing device may also include computers that are mounted to be worn on the body by a person, such as a wrist computer, finger computer, ring computer, eyeglass computer, belt computer, armband computers, shoe computers, apparel computers, and other body-worn computers. In various embodiments, for example, a mobile computing device can be deployed such as a smart phone capable of running computer applications as well as voice communications and/or data communications. While some embodiments may be described with a mobile computing device deployed as a smart phone as an example, it can be seen that other embodiments may also be deployed using other mobile wireless computing devices. Modalities are not limited in this context.

[00117] As shown in Figure 8, the device 800 may include a housing 802, a display 804, an input/output (I/O) device 806 and an antenna 808. The device 800 may also include navigation features 812. Display 804 can include any display unit suitable for displaying information suitable for a mobile computing device. I/O device 806 can include any I/O device suitable for inputting information into a mobile computing device. Examples of I/O device 806 may include an alphanumeric keyboard, a numeric keyboard, a touch sensitive element, action keys, buttons, switches, two-position switches, microphones, speakers, speech recognition device and software and so on. Information can also be entered into the 800 device via the microphone (not shown). Such information can be scanned by a voice recognition device (not shown). Modalities are not limited in this context.

[00118] Several modalities can be implemented using hardware elements, software elements or a combination of both. Examples of hardware elements may include processors, microprocessors, circuits, circuit elements (for example, transistors, resistors, capacitors, inductors, and so on), integrated circuits, application-specific integrated circuits (ASIC), programmable logic devices (PLD ), digital signal processors (DSP), field-programmable gate array (FPGA), logic gates, registers, semiconductor device, chips, microchips, chipsets, and so on. Examples of software may include software components, programs, applications, computer programs, application programs, system programs, machine programs, operating system software, middleware, firmware, software modules, routines, subroutines, functions , methods, procedures, software interfaces, application program interfaces (API), instruction sets, computer code, computer code, code segments, computer code segments, words, values, symbols, or any combination thereof . Determining whether a modality is deployed using hardware elements and/or software elements can vary based on any number of factors such as desired compute rate, power levels, heat tolerances, processing cycle budget, input data, output data rates, memory resources, data bus speeds, and other design or performance constraints.

[00119] One or more aspects of at least one embodiment can be implemented by representative instructions stored on a machine-readable medium that represent various logic in the processor, which, when read by a machine, cause the machine to manufacture logic to perform the techniques described in this document. Such representations known as “IP cores” can be stored on a machine-readable, tangible medium and provided to various customers or manufacturing facilities to upload to the manufacturing machines that actually make the logic or processor.

[00120] While certain features presented in this document are described in relation to various deployments, this description is not intended to be understood in a limiting sense. Therefore, various modifications of the deployments described herein, as well as other deployments that are apparent to those skilled in the art, to which the present disclosure pertains, are considered to be within the spirit and scope of the present disclosure.

[00121] The following examples pertain to additional modalities.

[00122] In one or more first embodiments, a computer-implemented method for encoding video content for wireless transmission comprises determining a first, a second, and a third candidate bitrate for encoding, using a first video codec of a segment of a source video, wherein the first candidate bitrate comprises the bitrate for the source video encoded using a second video codec modified by a scaling factor , wherein the second candidate bitrate comprises an average bitrate for at least one of a source video segment encoded using the first video codec or a previous source video segment encoded using the first video codec, and wherein the third candidate bitrate comprises an encoding bitrate prediction for at least one of the segment encoded using the first video codec or the previous segment encoded using the first codec video, select an encoding bitrate for the source video segment as a minimum of the first, second, and third candidate bitrates, and encode, using the first video codec, the video segment based on the selected encoding bitrate.

[00123] In addition to the first embodiments, the method further comprises determining a fourth candidate bit rate for encoding, using the first video codec, a second segment of a second source video, where the fourth bit rate candidate bits comprises a bit rate for the second source video encoded using a third video codec modified by a second scaling factor, and where the scaling factor is different from the second scaling factor.

[00124] In addition to the first embodiments, the first video codec is a local video codec associated with wireless transmission and the second video codec is associated with a compression of the source video.

[00125] In addition to the first embodiments, the encoding bitrate prediction is based at least in part on one of a predetermined average opinion index, a predetermined maximum bitrate, a predetermined minimum bitrate, or a predetermined quality coefficient display associated with a device receiving the wireless transmission.

[00126] In addition to the first embodiments, determining the third candidate bitrate based on the coding bitrate prediction comprises analyzing a bitstream of the segment encoded using the first video codec or the previous segment encoded with the using the first video codec to determine segment bitstream parameters, to determine a temporal complexity based on the segment bitstream parameters, and to generate a bitrate prediction based on temporal complexity and a data model. pre-trained bitrate prediction.

[00127] In addition to the first embodiments, determining the third candidate bitrate based on the coding bitrate prediction comprises analyzing a bitstream of the segment encoded using the first video codec or the previous segment encoded with the using the first video codec to determine segment bitstream parameters, determine a temporal complexity based on the segment bitstream parameters, and generate a bitrate prediction based on temporal complexity and a prediction model a pre-trained bitrate parameter, wherein the segment bitstream parameters comprise at least one of segment average bits per pixel, a segment average quantization parameter, a segment encoding frame rate, or a segment height. segment encoding video.

[00128] In addition to the first embodiments, determining the third candidate bitrate based on the encoding bitrate prediction comprises analyzing a bitstream of the encoded segment using the first video codec or the previous segment encoded with using the first video codec to determine segment bitstream parameters, determine a temporal complexity based on the segment bitstream parameters, and generate a bitrate prediction based on temporal complexity and a data model pre-trained bitrate prediction, wherein the bitrate prediction generation is additionally based on a predetermined average opinion index, a predetermined maximum bitrate, a predetermined minimum bitrate, and a display quality coefficient associated with a device receiving the wireless transmission.

[00129] In addition to the first embodiments, determining the third candidate bitrate based on the encoding bitrate prediction comprises analyzing a bitstream of the encoded segment using the first video codec or the previous segment encoded with using the first video codec to determine segment bitstream parameters, determine a temporal complexity based on the segment bitstream parameters, and generate a bitrate prediction based on temporal complexity and a data model pre-trained bitrate prediction, wherein the bitrate prediction generation is additionally based on a predetermined average opinion index, a predetermined maximum bitrate, a predetermined minimum bitrate, and a display quality coefficient associated with a receiving device of the wireless transmission, and wherein the display quality coefficient associated with the receiving device is determined using a look-up table based on resolution information received from the receiving device.

[00130] In addition to the first embodiments, the second candidate bitrate and the third candidate bitrate are determined based on the previous segment of the source video, and where the previous segment is immediately preceding the segment of the source video .

[00131] In addition to the first embodiments, the method further comprises wirelessly transmitting a resultant bit stream generated by coding the segment to a receiving device.

[00132] In one or more second embodiments, a system for encoding video content for wireless transmission comprises a memory configured to store video data and a processing unit coupled to the memory, wherein the processing unit comprises a set of coded source video-based bitrate determination circuitry configured to determine a first candidate bitrate for encoding, based on a first video codec, a segment of a source video, where the first candidate bitrate comprises a bitrate for source video encoded using a second video codec modified by a scaling factor, segment average bitrate determination circuitry configured to determine a second rate candidate bitrate for encoding, based on the first video codec, the source video segment, wherein the second candidate bitrate comprises an average bitrate for at least one of the encoded source video segment using the first video codec or a previous segment of source video encoded using the first video codec, encoding bitrate prediction circuitry configured to determine a third candidate bitrate for encoding , based on the first video codec of the source video segment, wherein the third candidate bitrate comprises an encoding bitrate prediction for at least one of the segment encoded using the first video codec or the previous segment encoded using the first video codec, bitrate selection circuitry configured to select an encoding bitrate for the source video segment as a minimum of the first, second, and third candidate bitrates, and encoder circuitry configured to encode, based on the first video codec, the source video segment based on the selected encoding bitrate.

[00133] In addition to the second embodiments, the bitrate determination circuitry based on encoded source video is further configured to determine a fourth candidate bitrate for encoding, using the first video codec, of a second segment of a second source video, wherein the fourth candidate bitrate comprises a bitrate for the second source video encoded using a third video codec modified by a second scaling factor, and in that the scaling factor is different from the second scaling factor.

[00134] In addition to the second embodiments, the first video codec is a local video codec associated with wireless transmission and the second video codec is associated with a compression of the source video.

[00135] In addition to the second embodiments, the encoding bitrate prediction is based at least in part on one of a predetermined average opinion index, a predetermined maximum bitrate, a predetermined minimum bitrate, or a predetermined quality coefficient display associated with a device receiving the wireless transmission.

[00136] In addition to the second embodiments, the encoding bitrate prediction circuitry that is configured to determine the third candidate bitrate comprises the encoding bitrate prediction circuitry that is configured to analyze a bitstream of the segment encoded using the first video codec or the previous segment encoded using the first video codec to determine segment bitstream parameters, determine a time complexity based on the bitstream parameters segment, and generate a bitrate prediction based on temporal complexity and a pre-trained bitrate prediction model.

[00137] In addition to the second embodiments, the encoding bitrate prediction circuitry that is configured to determine the third candidate bitrate comprises the encoding bitrate prediction circuitry that is configured to analyze a bitstream of the segment encoded using the first video codec or the previous segment encoded using the first video codec to determine segment bitstream parameters, determine a time complexity based on the bitstream parameters segment, and generating a bitrate prediction based on temporal complexity and a pretrained bitrate prediction model, wherein the segment bitstream parameters comprise at least one of the average bits per pixel of the segment. segment, a segment average quantization parameter, a segment encoding frame rate, or a segment encoding video height.

[00138] In addition to the second embodiments, the encoding bitrate prediction circuitry that is configured to determine the third candidate bitrate comprises the encoding bitrate prediction circuitry that is configured to analyze a bitstream of the segment encoded using the first video codec or the previous segment encoded using the first video codec to determine segment bitstream parameters, determine a time complexity based on the bitstream parameters segment, and generating a bitrate prediction based on temporal complexity and a pre-trained bitrate prediction model, wherein the generated bitrate prediction is additionally based on a predetermined average opinion index, a predetermined maximum bit rate, a predetermined minimum bit rate, and a display quality coefficient associated with a device receiving the wireless transmission.

[00139] In addition to the second embodiments, the encoding bitrate prediction circuitry that is configured to determine the third candidate bitrate comprises the encoding bitrate prediction circuitry that is configured to analyze a bitstream of the segment encoded using the first video codec or the previous segment encoded using the first video codec to determine segment bitstream parameters, determine a time complexity based on the bitstream parameters segment, and generating a bitrate prediction based on temporal complexity and a pre-trained bitrate prediction model, wherein the generated bitrate prediction is additionally based on a predetermined average opinion index, a predetermined maximum bit rate, a predetermined minimum bit rate, and a display quality coefficient associated with a device receiving the wireless transmission, the system further comprising a look-up table comprising the associated display quality coefficient the resolution information of the receiving device.

[00140] In addition to the second embodiments, the second candidate bitrate and the third candidate bitrate are determined based on the previous segment of the source video, and where the previous segment is immediately preceding the segment of the source video .

[00141] In addition to the second embodiments, the second candidate bitrate and the third candidate bitrate are based on the previous segment of the source video, and where the previous segment is immediately preceding the segment of the source video.

[00142] In addition to the second embodiments, the system comprises at least a portion of a computer, a laptop, an ultrabook, a smart phone or a tablet.

[00143] In one or more third embodiments, a system for encoding video content for wireless transmission comprises a memory configured to store video data and a processing unit coupled to the memory, wherein the processing unit comprises means for determining a first, second, and third candidate bitrate for encoding, using a first video codec, a segment of a source video, wherein the first candidate bitrate comprises the bitrate of bits for source video encoded using a second video codec modified by a scaling factor, wherein the second candidate bitrate comprises an average bitrate for at least one of the encoded source video segments using the first video codec or a previous segment of source video encoded using the first video codec, and wherein the third candidate bitrate comprises an encoding bitrate prediction for at least one of the segment encoded using the first video codec or the previously encoded segment using the first video codec, means for selecting an encoding bitrate for the source video segment as a minimum of the first, second and second of the third candidate bitrate, and means for encoding, using the first video codec, the source video segment based on the selected encoding bitrate.

[00144] In addition to the third embodiments, the processing unit further comprises means for determining a fourth candidate bit rate for encoding, using the first video codec, a second segment of a second source video, where the fourth candidate bitrate comprises a bitrate for the second source video encoded using a third video codec modified by a second scaling factor, and wherein the scaling factor is different from the second scaling factor .

[00145] In addition to the third embodiments, the means for determining the first, second and third candidate bit rates comprise means for analyzing a bit stream of the encoded segment using the first video codec or the previous segment encoded with using the first video codec to determine segment bitstream parameters, means for determining a temporal complexity based on the segment bitstream parameters, and means for generating a bitrate prediction as the third bitrate candidate data based on temporal complexity and a pre-trained bitrate prediction model.

[00146] In addition to the third embodiments, the means for determining the first, second and third candidate bit rates comprise means for analyzing a bit stream of the encoded segment using the first video codec or the previous segment encoded with using the first video codec to determine segment bitstream parameters, means for determining a temporal complexity based on the segment bitstream parameters, and means for generating a bitrate prediction as the third bitrate based on temporal complexity and a pre-trained bitrate prediction model, wherein the segment bitstream parameters comprise at least one of segment average bits per pixel, a segment average quantization parameter , a segment encoding frame rate, or a segment encoding video height.

[00147] In one or more fourth embodiments, a machine-readable medium comprises a plurality of instructions that, in response to execution on a computing device, cause the computing device to encode video content for wireless transmission over the determining a first, second, and third candidate bitrate for encoding, using a first video codec, a segment of a source video, wherein the first candidate bitrate comprises the rate bitrate for source video encoded using a second video codec modified by a scaling factor, wherein the second candidate bitrate comprises an average bitrate for at least one of the source video segments encoded using the first video codec or a previous segment of the source video encoded using the first video codec, and wherein the third candidate bitrate comprises an encoding bitrate prediction for at least one among the segment encoded using the first video codec or the previously encoded segment using the first video codec, select an encoding bitrate for the source video segment as a minimum of the first, second, and third candidate bitrate, and encode, using the first video codec, the source video segment based on the selected encoding bitrate.

[00148] In addition to the fourth embodiments, the machine-readable medium further comprises instructions that cause the computing device to encode video content for wireless transmission by determining a fourth candidate bitrate for encoding, with the using the first video codec, a second segment of a second source video, wherein the fourth candidate bitrate comprises a bitrate for the second source video encoded using a third video codec modified by a second scaling factor, and wherein the scaling factor is different from the second scaling factor.

[00149] In addition to the fourth embodiments, the encoding bitrate prediction is based at least in part on one of a predetermined average opinion index, a predetermined maximum bitrate, a predetermined minimum bitrate, or a predetermined quality coefficient display associated with a device receiving the wireless transmission.

[00150] In addition to the fourth embodiments, determining the third candidate bitrate based on the encoding bitrate prediction comprises analyzing a bitstream of the segment encoded using the first video codec or the previous segment encoded with the using the first video codec to determine segment bitstream parameters, to determine a temporal complexity based on the segment bitstream parameters, and to generate a bitrate prediction based on temporal complexity and a data model. pre-trained bitrate prediction.

[00151] In addition to the fourth embodiments, determining the third candidate bitrate based on the encoding bitrate prediction comprises analyzing a bitstream of the segment encoded using the first video codec or the previous segment encoded with the using the first video codec to determine segment bitstream parameters, determine a temporal complexity based on the segment bitstream parameters, and generate a bitrate prediction based on temporal complexity and a prediction model a pre-trained bitrate parameter, wherein the segment bitrate parameters comprise at least one of segment average bits per pixel, a segment average quantization parameter, a segment encoding frame rate, or a segment height. segment encoding video.

[00152] In addition to the fourth embodiments, determining the third candidate bitrate based on the encoding bitrate prediction comprises analyzing a bitstream of the encoded segment using the first video codec or the previous segment encoded with using the first video codec to determine segment bitstream parameters, determine a temporal complexity based on the segment bitstream parameters, and generate a bitrate prediction based on temporal complexity and a data model pre-trained bitrate prediction, wherein the bitrate prediction generation is additionally based on a predetermined average opinion index, a predetermined maximum bitrate, a predetermined minimum bitrate, and a display quality coefficient associated with a device receiving the wireless transmission.

[00153] In one or more fifth embodiments, the at least one machine-readable medium may include a plurality of instructions that, in response to execution in a computing device, cause the computing device to execute a method in accordance with any one of the above modalities.

[00154] In one or more sixth embodiments, an apparatus may include means for performing a method according to any of the above embodiments.

[00155] It will be understood that the modalities are not limited to the modalities described herein, but can be practiced with modification and alteration without departing from the scope of the appended claims. For example, the above modalities may include specific combination of features. However, the above embodiments are not limited to these aspects, and in various deployments, the above embodiments may include performing only a subset of such features, performing a different order of such features, performing a different combination of such features, such features and/or the realization of additional features beyond those features explicitly mentioned. The scope of embodiments should, therefore, be determined with reference to the appended claims, together with the full scope of coincidences to which such claims are assigned.

Claims (15)

1. A computer-implemented method for encoding video content for wireless transmission, the method comprising: determining a first, second, and third candidate bitrate for encoding using a first codec of a segment of a source video, where the first candidate bitrate is a bitrate for the source video encoded using a second video codec modified by a scaling factor, where the second candidate bitrate is an average bitrate for at least one of the source video segment encoded using the first video codec or a previous source video segment encoded using the first video codec , and wherein the third candidate bitrate is an encoding bitrate prediction for at least one of the segment encoded using the first video codec or the previous segment encoded using the first video codec; selecting an encoding bitrate for the source video segment as a minimum of the first, second, and third candidate bitrates; and encoding, using the first video codec, the source video segment based on the selected encoding bitrate. 2. Method according to claim 1, characterized in that it further comprises: determining a fourth candidate bit rate for encoding, using the first video codec, a second segment of a second source video , wherein the fourth candidate bitrate comprises a bitrate for the second source video encoded using a third video codec modified by a second scaling factor, and wherein the scaling factor is different from the second scaling factor. 3. Method according to claim 1, characterized in that the encoding bit rate prediction is based at least in part on one of a predetermined average opinion index, a predetermined maximum bit rate, a predetermined minimum bit or display quality coefficient associated with a device receiving the wireless transmission. 4. Method according to claim 1, characterized in that the determination of the third candidate bit rate based on the coding bit rate prediction comprises: analyzing a bit stream of the coded segment using the first codec of video or the previous encoded segment using the first video codec to determine segment bitstream parameters; determining a time complexity based on the segment bitstream parameters; and generating a bitrate prediction based on temporal complexity and a pre-trained bitrate prediction model. 5. Method according to claim 4, characterized in that the segment bitstream parameters comprise at least one of bits per segment average pixel, a segment average quantization parameter, a coding frame rate segment or a segment encoding video height. 6. Method, according to claim 4, characterized in that the generation of the bit rate prediction is additionally based on a predetermined average opinion index, a predetermined maximum bit rate, a predetermined minimum bit rate and a display quality coefficient associated with a device receiving the wireless transmission. 7. Method according to claim 6, characterized in that the display quality coefficient associated with the receiving device is determined using a look-up table based on resolution information received from the receiving device. 8. Method according to claim 1, characterized in that the second candidate bitrate and the third candidate bitrate are determined based on the previous segment of the source video, and in which the previous segment is immediately preceding the source video segment. 9. System for encoding video content for wireless transmission, the system characterized by comprising: a memory configured to store video data; and a memory-coupled processing unit, the processing unit comprising: bitrate determination circuitry based on encoded source video configured to determine a first candidate bitrate for encoding based on a first video codec of a segment of a source video, wherein the first candidate bitrate is a bitrate for source video encoded using a second video codec modified by a scaling factor; segment average bitrate determination circuitry configured to determine a second candidate bitrate for encoding, based on the first video codec, of the source video segment, where the second candidate bitrate is an average bit rate for at least one of the source video segment encoded using the first video codec or a previous source video segment encoded using the first video codec; encoding bitrate prediction circuitry configured to determine a third candidate bitrate for encoding, based on the first video codec, of the source video segment, where the third candidate bitrate is an encoding bitrate prediction for at least one of the segment encoded using the first video codec or the previous segment encoded using the first video codec; bitrate selection circuitry configured to select an encoding bitrate for the source video segment as a minimum of the first, second, and third candidate bitrates; and encoder circuitry configured to encode, based on the first video codec, the source video segment based on the selected encoding bitrate. 10. System according to claim 9, characterized in that the encoded source video-based bitrate determination circuitry is further configured to determine a fourth candidate bitrate for encoding, with the using the first video codec, a second segment of a second source video, wherein the fourth candidate bitrate comprises a bitrate for the second source video encoded using a third video codec modified by a second scaling factor, and wherein the scaling factor is different from the second scaling factor. 11. System according to claim 9, characterized in that the coding bitrate prediction circuitry that is configured to determine a third candidate bitrate comprises the bitrate prediction circuitry encoding bits that is configured to: analyze a segment bitstream encoded using the first video codec or the previous segment encoded using the first video codec to determine segment bitstream parameters; determining a time complexity based on the segment bitstream parameters; and generating a bitrate prediction based on temporal complexity and a pre-trained bitrate prediction model. 12. System according to claim 11, characterized in that the segment bitstream parameters comprise at least one of the segment average bits per pixel, a segment average quantization parameter, a coding frame rate segment or a segment encoding video height. 13. System according to claim 11, characterized in that the generated bitrate prediction is additionally based on a predetermined average opinion index, a predetermined maximum bitrate, a predetermined minimum bitrate and a predetermined coefficient of display quality associated with a device receiving the wireless transmission. 14. Apparatus, characterized in that it comprises means for performing the method as defined in claim 1. 15. Machine-readable storage including machine-readable instructions that, when executed on a computing device, cause the computing device to perform the method as defined in claim 1.